2024-09-17T00:42:10.929 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T00:42:10.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T00:42:11.040 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907972 branch: squid description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7907972' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: e20bff7d16f5b09c58ead9548e8cf98cf87ee227 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 599 sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f sleep_before_teardown: 0 subset: 33/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: e20bff7d16f5b09c58ead9548e8cf98cf87ee227 targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNPVgtY8R8r9QGPzCq9Vcm010bl+G1dxS/5+0Gwbi77C3VNKnAuB2PXvkn9wn3ijk5Yrumm6u81W4TBkLmyLaOY= smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOKDf3ItX/8WfztjtLpuEtaTBM2bKoIctFyp+lZLSUIGJfj6Qzy2au47yGnEPGEnFGnklQk9v3eSVYd2cECYWfA= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_21:08:04 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-17T00:42:11.041 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa; will attempt to use it 2024-09-17T00:42:11.041 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_e20bff7d16f5b09c58ead9548e8cf98cf87ee227/qa/tasks 2024-09-17T00:42:11.042 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T00:42:11.043 INFO:teuthology.task.internal:Checking packages... 2024-09-17T00:42:11.069 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c2ddf9721ef254645201cdbabd9c8f49c30a586f' 2024-09-17T00:42:11.069 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:42:11.069 INFO:teuthology.packaging:ref: None 2024-09-17T00:42:11.069 INFO:teuthology.packaging:tag: None 2024-09-17T00:42:11.069 INFO:teuthology.packaging:branch: squid 2024-09-17T00:42:11.069 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:42:11.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-17T00:42:11.297 INFO:teuthology.task.internal:Found packages for ceph version 19.2.0-0 2024-09-17T00:42:11.298 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T00:42:11.305 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T00:42:11.305 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T00:42:11.349 INFO:teuthology.task.internal:Saving configuration 2024-09-17T00:42:11.369 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T00:42:11.396 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T00:42:11.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907972', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 00:36:55.857091', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNPVgtY8R8r9QGPzCq9Vcm010bl+G1dxS/5+0Gwbi77C3VNKnAuB2PXvkn9wn3ijk5Yrumm6u81W4TBkLmyLaOY='} 2024-09-17T00:42:11.441 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907972', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 00:36:55.858588', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOKDf3ItX/8WfztjtLpuEtaTBM2bKoIctFyp+lZLSUIGJfj6Qzy2au47yGnEPGEnFGnklQk9v3eSVYd2cECYWfA='} 2024-09-17T00:42:11.441 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T00:42:11.447 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-17T00:42:11.447 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-17T00:42:11.447 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T00:42:11.646 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fefe500bac0>, signals=[15]) 2024-09-17T00:42:11.646 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T00:42:12.299 INFO:teuthology.task.internal:Opening connections... 2024-09-17T00:42:12.299 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T00:42:12.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:42:12.378 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-09-17T00:42:12.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:42:12.459 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T00:42:12.662 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-09-17T00:42:12.681 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-09-17T00:42:12.681 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-09-17T00:42:12.739 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-09-17T00:42:12.739 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-09-17T00:42:12.739 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-09-17T00:42:12.739 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-09-17T00:42:12.739 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-09-17T00:42:12.739 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-09-17T00:42:12.739 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T00:42:12.740 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-09-17T00:42:12.740 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-09-17T00:42:12.740 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T00:42:12.740 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-09-17T00:42:12.740 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T00:42:12.740 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T00:42:12.740 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T00:42:12.741 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-09-17T00:42:12.759 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-09-17T00:42:12.778 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-09-17T00:42:12.778 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-09-17T00:42:12.837 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-09-17T00:42:12.837 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-09-17T00:42:12.837 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-09-17T00:42:12.837 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-09-17T00:42:12.837 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-09-17T00:42:12.837 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-09-17T00:42:12.838 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T00:42:12.838 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-09-17T00:42:12.838 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-09-17T00:42:12.838 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T00:42:12.838 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-09-17T00:42:12.838 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T00:42:12.838 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T00:42:12.838 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T00:42:12.839 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-09-17T00:42:12.859 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T00:42:13.078 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T00:42:13.116 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T00:42:13.116 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-09-17T00:42:13.118 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-09-17T00:42:13.135 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T00:42:13.431 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T00:42:13.431 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-09-17T00:42:13.434 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-09-17T00:42:13.456 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T00:42:13.510 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T00:42:13.804 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T00:42:13.805 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T00:42:13.805 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T00:42:13.805 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T00:42:13.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T00:42:13.823 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-17T00:42:13.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T00:42:13.824 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-17T00:42:13.880 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-503.el9.x86_64 2024-09-17T00:42:13.881 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.14.0-503.el9.x86_64 2024-09-17T00:42:13.881 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y kernel 2024-09-17T00:42:13.882 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-503.el9.x86_64 2024-09-17T00:42:13.882 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.14.0-503.el9.x86_64 2024-09-17T00:42:13.882 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum install -y kernel 2024-09-17T00:42:16.209 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-17T00:42:16.601 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 8.3 MB 00:00 2024-09-17T00:42:17.951 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-17T00:42:21.341 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 5.5 MB/s | 20 MB 00:03 2024-09-17T00:42:22.269 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-17T00:42:23.753 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-17T00:42:25.018 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-17T00:42:26.450 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.5 MB 00:01 2024-09-17T00:42:28.150 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 19 kB 00:00 2024-09-17T00:42:30.563 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-17T00:42:32.528 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T00:42:32.528 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T00:42:32.611 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:42:32.618 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:42:32.618 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-17T00:42:32.618 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:42:32.618 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:42:32.618 INFO:teuthology.orchestra.run.smithi002.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T00:42:32.619 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-17T00:42:32.619 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T00:42:32.619 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T00:42:32.619 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T00:42:32.619 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:42:32.619 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:42:32.619 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:42:32.619 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2024-09-17T00:42:32.619 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:42:32.620 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 79 M 2024-09-17T00:42:32.620 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 126 M 2024-09-17T00:42:32.620 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:42:32.674 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 5.1 MB/s | 23 MB 00:04 2024-09-17T00:42:32.952 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:42:32.952 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:42:32.952 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:42:33.027 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:42:33.032 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:42:33.040 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:42:33.100 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T00:42:33.102 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T00:42:33.138 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T00:42:33.199 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T00:42:33.200 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T00:42:33.200 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T00:42:33.773 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 42 kB/s | 36 kB 00:00 2024-09-17T00:42:33.795 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:42:33.817 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T00:42:33.863 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T00:42:33.915 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T00:42:35.589 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 5.8 MB/s | 16 MB 00:02 2024-09-17T00:42:36.373 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 10 MB/s | 35 MB 00:03 2024-09-17T00:42:38.109 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-17T00:42:39.673 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 4.8 MB/s | 29 MB 00:05 2024-09-17T00:42:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:42:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:Total 11 MB/s | 79 MB 00:07 2024-09-17T00:42:40.049 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T00:42:40.049 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T00:42:40.136 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:42:40.139 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:42:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-09-17T00:42:40.139 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:42:40.139 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:42:40.139 INFO:teuthology.orchestra.run.smithi099.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T00:42:40.139 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-17T00:42:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T00:42:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T00:42:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T00:42:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:42:40.140 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:42:40.140 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:42:40.140 INFO:teuthology.orchestra.run.smithi099.stdout:Install 4 Packages 2024-09-17T00:42:40.140 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:42:40.141 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 79 M 2024-09-17T00:42:40.141 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 126 M 2024-09-17T00:42:40.141 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:42:40.229 INFO:teuthology.orchestra.run.smithi099.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T00:42:40.247 INFO:teuthology.orchestra.run.smithi099.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T00:42:40.268 INFO:teuthology.orchestra.run.smithi099.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T00:42:40.333 INFO:teuthology.orchestra.run.smithi099.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T00:42:40.333 INFO:teuthology.orchestra.run.smithi099.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T00:42:40.356 INFO:teuthology.orchestra.run.smithi099.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T00:42:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:42:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:42:40.782 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:42:40.894 INFO:teuthology.orchestra.run.smithi099.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 49 kB/s | 36 kB 00:00 2024-09-17T00:42:40.935 INFO:teuthology.orchestra.run.smithi099.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T00:42:40.991 INFO:teuthology.orchestra.run.smithi099.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T00:42:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:42:41.752 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:42:44.285 INFO:teuthology.orchestra.run.smithi099.stdout:(2/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 8.4 MB/s | 35 MB 00:04 2024-09-17T00:42:44.300 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:42:44.469 INFO:teuthology.orchestra.run.smithi099.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.6 MB/s | 16 MB 00:04 2024-09-17T00:42:44.968 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T00:42:45.064 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:42:45.602 INFO:teuthology.orchestra.run.smithi099.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 6.1 MB/s | 29 MB 00:04 2024-09-17T00:42:45.605 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:42:45.605 INFO:teuthology.orchestra.run.smithi099.stdout:Total 14 MB/s | 79 MB 00:05 2024-09-17T00:42:46.288 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:42:46.651 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:42:46.652 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:42:47.624 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:42:47.625 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:42:47.834 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:42:47.959 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:42:50.064 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:42:50.707 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T00:42:50.787 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:42:53.080 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:42:53.127 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:42:53.539 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:42:53.669 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:42:58.262 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:42:58.568 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:42:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:43:03.576 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:43:37.064 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:43:37.105 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:43:37.421 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:43:37.421 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T00:43:37.421 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:43:37.421 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:43:38.294 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:43:38.294 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:43:38.294 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:43:38.294 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T00:43:38.294 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T00:43:38.294 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T00:43:38.294 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T00:43:38.294 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:43:38.294 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:43:38.627 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T00:43:38.761 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T00:43:38.762 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T00:43:38.762 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T00:43:38.762 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T00:43:38.762 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T00:43:38.762 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-17T00:43:38.762 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T00:43:38.762 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T00:43:38.821 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T00:43:38.822 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T00:43:38.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-09-17T00:43:38.864 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-09-17T00:43:38.864 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-09-17T00:43:38.864 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-09-17T00:43:38.864 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 82.el9 2024-09-17T00:43:38.864 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-09-17T00:43:38.864 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T00:43:38.865 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-09-17T00:43:38.865 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8274670 2024-09-17T00:43:38.865 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-09-17T00:43:38.865 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T00:43:38.865 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T00:43:38.865 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T00:43:38.865 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T00:43:38.865 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-09-17T00:43:38.865 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-09-17T00:43:38.865 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T00:43:38.865 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-09-17T00:43:38.865 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-09-17T00:43:38.865 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:43:38.865 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T00:43:38.866 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T00:43:38.866 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T00:43:38.866 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-09-17T00:43:38.866 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:43:38.866 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T00:43:38.866 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T00:43:38.867 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 5.14.0-508.el9.x86_64 2024-09-17T00:43:38.867 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T00:43:39.533 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-09-17T00:43:41.047 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T00:43:41.066 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-09-17T00:43:41.068 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-17T00:43:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.EHFWRXKRIC 2024-09-17T00:43:41.084 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.EHFWRXKRIC 2024-09-17T00:43:41.151 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.EHFWRXKRIC 2024-09-17T00:43:41.288 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.EHFWRXKRIC is 6KB 2024-09-17T00:43:41.336 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.EHFWRXKRIC 2024-09-17T00:43:41.351 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T00:43:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T00:43:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T00:43:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T00:43:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T00:43:41.415 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T00:43:41.551 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-09-17T00:43:41.766 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:43:41.807 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:43:42.120 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:43:42.120 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T00:43:42.120 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T00:43:42.120 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T00:43:42.995 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T00:43:42.995 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:43:42.995 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:43:42.995 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T00:43:42.996 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T00:43:42.996 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T00:43:42.996 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T00:43:42.996 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:43:42.996 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:43:43.337 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T00:43:43.425 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T00:43:43.425 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T00:43:43.425 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T00:43:43.426 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T00:43:43.426 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T00:43:43.426 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-17T00:43:43.426 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T00:43:43.426 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T00:43:43.485 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T00:43:43.485 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T00:43:43.485 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -qi grub2-tools 2024-09-17T00:43:43.527 INFO:teuthology.orchestra.run.smithi099.stdout:Name : grub2-tools 2024-09-17T00:43:43.527 INFO:teuthology.orchestra.run.smithi099.stdout:Epoch : 1 2024-09-17T00:43:43.527 INFO:teuthology.orchestra.run.smithi099.stdout:Version : 2.06 2024-09-17T00:43:43.527 INFO:teuthology.orchestra.run.smithi099.stdout:Release : 82.el9 2024-09-17T00:43:43.527 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: x86_64 2024-09-17T00:43:43.528 INFO:teuthology.orchestra.run.smithi099.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T00:43:43.528 INFO:teuthology.orchestra.run.smithi099.stdout:Group : Unspecified 2024-09-17T00:43:43.528 INFO:teuthology.orchestra.run.smithi099.stdout:Size : 8274670 2024-09-17T00:43:43.528 INFO:teuthology.orchestra.run.smithi099.stdout:License : GPLv3+ 2024-09-17T00:43:43.528 INFO:teuthology.orchestra.run.smithi099.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T00:43:43.528 INFO:teuthology.orchestra.run.smithi099.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T00:43:43.528 INFO:teuthology.orchestra.run.smithi099.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T00:43:43.528 INFO:teuthology.orchestra.run.smithi099.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T00:43:43.528 INFO:teuthology.orchestra.run.smithi099.stdout:Packager : builder@centos.org 2024-09-17T00:43:43.528 INFO:teuthology.orchestra.run.smithi099.stdout:Vendor : CentOS 2024-09-17T00:43:43.528 INFO:teuthology.orchestra.run.smithi099.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T00:43:43.528 INFO:teuthology.orchestra.run.smithi099.stdout:Summary : Support tools for GRUB. 2024-09-17T00:43:43.529 INFO:teuthology.orchestra.run.smithi099.stdout:Description : 2024-09-17T00:43:43.529 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:43:43.529 INFO:teuthology.orchestra.run.smithi099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T00:43:43.529 INFO:teuthology.orchestra.run.smithi099.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T00:43:43.529 INFO:teuthology.orchestra.run.smithi099.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T00:43:43.529 INFO:teuthology.orchestra.run.smithi099.stdout:hardware devices. 2024-09-17T00:43:43.529 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:43:43.529 INFO:teuthology.orchestra.run.smithi099.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T00:43:43.530 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T00:43:43.530 INFO:teuthology.task.kernel:Updating grub on smithi099 to boot 5.14.0-508.el9.x86_64 2024-09-17T00:43:43.531 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T00:43:44.178 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-09-17T00:43:45.423 INFO:teuthology.orchestra.run.smithi099.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T00:43:45.456 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-09-17T00:43:45.458 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-17T00:43:45.473 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.1VjlFxj4yU 2024-09-17T00:43:45.474 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1VjlFxj4yU 2024-09-17T00:43:45.541 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.1VjlFxj4yU 2024-09-17T00:43:45.699 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.1VjlFxj4yU is 6KB 2024-09-17T00:43:45.748 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.1VjlFxj4yU 2024-09-17T00:43:45.763 DEBUG:teuthology.orchestra.run.smithi099:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T00:43:45.827 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T00:43:45.827 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T00:43:45.827 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T00:43:45.827 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T00:43:45.828 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T00:43:45.992 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-09-17T00:44:11.581 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-17T00:44:11.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-17T00:44:11.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:44:15.999 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-17T00:44:16.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-17T00:44:16.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:44:30.141 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-09-17T00:44:34.493 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-17T00:44:39.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-17T00:44:39.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:44:42.205 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-09-17T00:44:43.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-17T00:44:43.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:44:46.561 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-17T00:44:54.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-17T00:44:54.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:44:58.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-17T00:44:58.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:45:26.010 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-17T00:45:26.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-17T00:45:26.489 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-17T00:45:26.490 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-17T00:45:26.505 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-508.el9.x86_64 2024-09-17T00:45:26.505 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T00:45:26.505 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T00:45:26.505 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T00:45:27.506 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-17T00:45:27.507 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T00:45:27.588 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2024-09-17T00:45:27.617 DEBUG:teuthology.parallel:result is None 2024-09-17T00:45:30.412 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-17T00:45:30.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-17T00:45:30.771 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-17T00:45:30.772 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-17T00:45:30.786 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-508.el9.x86_64 2024-09-17T00:45:30.786 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T00:45:30.786 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T00:45:30.786 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T00:45:31.787 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-17T00:45:31.787 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T00:45:31.913 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2024-09-17T00:45:31.934 DEBUG:teuthology.parallel:result is None 2024-09-17T00:45:31.934 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T00:45:31.941 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T00:45:31.941 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T00:45:31.944 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T00:45:31.975 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T00:45:32.048 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T00:45:32.372 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T00:45:32.372 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T00:45:32.375 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T00:45:32.414 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T00:45:32.741 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T00:45:32.742 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T00:45:32.745 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T00:45:32.783 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T00:45:32.795 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T00:45:32.853 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T00:45:32.864 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T00:45:32.866 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T00:45:32.873 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T00:45:32.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T00:45:32.876 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T00:45:32.903 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T00:45:32.917 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T00:45:32.918 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T00:45:32.946 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T00:45:32.963 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T00:45:33.047 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T00:45:33.100 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T00:45:33.182 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T00:45:33.228 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:45:33.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T00:45:33.295 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T00:45:33.338 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T00:45:33.391 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T00:45:33.473 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T00:45:33.512 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T00:45:33.512 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T00:45:33.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-09-17T00:45:33.580 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-09-17T00:45:33.626 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T00:45:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T00:45:34.051 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T00:45:34.059 INFO:teuthology.task.internal:Starting timer... 2024-09-17T00:45:34.059 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T00:45:34.127 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T00:45:34.383 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-17T00:45:34.383 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-09-17T00:45:34.444 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-09-17T00:45:34.446 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2024-09-17T00:45:34.493 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2024-09-17T00:45:34.495 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T00:45:34.495 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-09-17T00:45:34.533 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-09-17T00:45:34.533 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2024-09-17T00:45:34.553 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2024-09-17T00:45:34.554 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi099.front.sepia.ceph.com': 'permissive'} 2024-09-17T00:45:34.554 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T00:45:34.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T00:45:34.601 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T00:45:34.629 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T00:45:34.630 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T00:45:34.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-09-17T00:45:34.672 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2024-09-17T00:45:34.707 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T00:45:34.760 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T00:45:34.773 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T00:45:34.775 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi099.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T00:49:22.188 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi099.front.sepia.ceph.com')] 2024-09-17T00:49:22.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-17T00:49:22.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:49:22.268 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-17T00:49:22.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-17T00:49:22.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-17T00:49:22.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T00:49:22.473 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-17T00:49:22.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-17T00:49:22.560 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T00:49:22.573 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T00:49:22.573 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T00:49:22.574 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T00:49:22.577 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T00:49:22.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T00:49:22.605 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T00:49:22.621 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T00:49:22.633 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T00:49:22.647 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-09-17T00:49:22.649 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T00:49:22.659 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-09-17T00:49:22.674 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T00:49:22.675 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2024-09-17T00:49:22.686 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2024-09-17T00:49:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T00:49:22.701 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T00:49:22.715 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T00:49:22.747 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-17T00:49:22.750 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T00:49:22.750 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-17T00:49:22.750 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:49:22.750 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:49:22.751 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:49:22.751 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:49:22.769 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-09-17T00:49:22.772 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T00:49:22.772 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-09-17T00:49:22.772 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:49:22.772 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:49:22.772 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:49:22.772 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T00:49:22.773 INFO:teuthology.run_tasks:Running task install... 2024-09-17T00:49:22.857 DEBUG:teuthology.task.install:project ceph 2024-09-17T00:49:22.857 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}} 2024-09-17T00:49:22.857 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'} 2024-09-17T00:49:22.858 INFO:teuthology.task.install:Using flavor: default 2024-09-17T00:49:22.868 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T00:49:22.868 INFO:teuthology.task.install:extra packages: [] 2024-09-17T00:49:22.869 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'tag': None, 'wait_for_package': False} 2024-09-17T00:49:22.869 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:49:22.870 INFO:teuthology.packaging:ref: None 2024-09-17T00:49:22.870 INFO:teuthology.packaging:tag: None 2024-09-17T00:49:22.870 INFO:teuthology.packaging:branch: quincy 2024-09-17T00:49:22.870 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:49:22.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-17T00:49:22.873 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'tag': None, 'wait_for_package': False} 2024-09-17T00:49:22.874 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:49:22.874 INFO:teuthology.packaging:ref: None 2024-09-17T00:49:22.874 INFO:teuthology.packaging:tag: None 2024-09-17T00:49:22.874 INFO:teuthology.packaging:branch: quincy 2024-09-17T00:49:22.874 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:49:22.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-17T00:49:23.098 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/ 2024-09-17T00:49:23.098 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1635.g4a704134 2024-09-17T00:49:23.111 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/ 2024-09-17T00:49:23.111 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1635.g4a704134 2024-09-17T00:49:23.214 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T00:49:23.214 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:49:23.215 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T00:49:23.225 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/4a704134aa895fa24b75bb03cb263f1e3316004e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T00:49:23.225 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T00:49:23.225 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T00:49:23.244 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T00:49:23.244 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:49:23.244 INFO:teuthology.packaging:ref: None 2024-09-17T00:49:23.244 INFO:teuthology.packaging:tag: None 2024-09-17T00:49:23.244 INFO:teuthology.packaging:branch: quincy 2024-09-17T00:49:23.245 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:49:23.245 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T00:49:23.251 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T00:49:23.251 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:49:23.252 INFO:teuthology.packaging:ref: None 2024-09-17T00:49:23.252 INFO:teuthology.packaging:tag: None 2024-09-17T00:49:23.252 INFO:teuthology.packaging:branch: quincy 2024-09-17T00:49:23.252 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:49:23.253 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T00:49:23.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T00:49:23.318 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T00:49:23.392 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T00:49:23.394 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T00:49:23.458 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2024-09-17T00:49:23.459 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2024-09-17T00:49:23.460 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-09-17T00:49:23.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-09-17T00:49:23.692 INFO:teuthology.orchestra.run.smithi099.stdout:45 files removed 2024-09-17T00:49:23.704 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-09-17T00:49:23.718 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw 2024-09-17T00:49:23.732 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw 2024-09-17T00:49:24.270 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 288 kB/s | 77 kB 00:00 2024-09-17T00:49:24.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 284 kB/s | 77 kB 00:00 2024-09-17T00:49:24.561 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-17T00:49:24.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 44 kB/s | 11 kB 00:00 2024-09-17T00:49:24.845 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 7.2 kB/s | 1.8 kB 00:00 2024-09-17T00:49:24.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 7.5 kB/s | 1.8 kB 00:00 2024-09-17T00:49:25.353 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.3 MB 00:00 2024-09-17T00:49:25.570 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-17T00:49:27.021 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-17T00:49:27.671 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-17T00:49:31.538 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-17T00:49:32.491 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 6.5 MB 00:00 2024-09-17T00:49:33.981 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-17T00:49:34.013 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-17T00:49:35.153 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-17T00:49:37.617 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 6.4 MB/s | 23 MB 00:03 2024-09-17T00:49:40.590 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-17T00:49:42.832 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:49:42.853 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:49:42.853 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-17T00:49:42.853 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:49:42.853 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:49:42.854 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:17.2.7-1635.g4a704134.el9 ceph 14 M 2024-09-17T00:49:42.854 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2024-09-17T00:49:42.854 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 3.1 M 2024-09-17T00:49:42.854 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 2.9 M 2024-09-17T00:49:42.854 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-17T00:49:42.854 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:17.2.7-1635.g4a704134.el9 ceph 5.0 M 2024-09-17T00:49:42.854 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:17.2.7-1635.g4a704134.el9 ceph 22 M 2024-09-17T00:49:42.854 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:17.2.7-1635.g4a704134.el9 ceph 25 k 2024-09-17T00:49:42.855 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T00:49:42.855 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 637 k 2024-09-17T00:49:42.855 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T00:49:42.855 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T00:49:42.855 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T00:49:42.855 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 457 k 2024-09-17T00:49:42.855 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T00:49:42.855 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 4.9 M 2024-09-17T00:49:42.855 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T00:49:42.855 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T00:49:42.855 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:17.2.7-1635.g4a704134.el9 ceph 45 k 2024-09-17T00:49:42.855 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:17.2.7-1635.g4a704134.el9 ceph 120 k 2024-09-17T00:49:42.856 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:17.2.7-1635.g4a704134.el9 ceph 156 k 2024-09-17T00:49:42.856 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T00:49:42.856 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:17.2.7-1635.g4a704134.el9 ceph 320 k 2024-09-17T00:49:42.856 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:17.2.7-1635.g4a704134.el9 ceph 295 k 2024-09-17T00:49:42.856 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:17.2.7-1635.g4a704134.el9 ceph 99 k 2024-09-17T00:49:42.856 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T00:49:42.856 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:49:42.856 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:49:42.856 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:49:42.856 INFO:teuthology.orchestra.run.smithi099.stdout:Install 22 Packages 2024-09-17T00:49:42.857 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 2 Packages 2024-09-17T00:49:42.857 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:49:42.857 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 58 M 2024-09-17T00:49:42.857 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:49:43.250 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-17T00:49:43.749 INFO:teuthology.orchestra.run.smithi099.stdout:(1/24): ceph-base-17.2.7-1635.g4a704134.el9.x86 11 MB/s | 5.0 MB 00:00 2024-09-17T00:49:43.808 INFO:teuthology.orchestra.run.smithi099.stdout:(2/24): ceph-selinux-17.2.7-1635.g4a704134.el9. 432 kB/s | 25 kB 00:00 2024-09-17T00:49:43.900 INFO:teuthology.orchestra.run.smithi099.stdout:(3/24): libcephfs2-17.2.7-1635.g4a704134.el9.x8 6.8 MB/s | 637 kB 00:00 2024-09-17T00:49:43.992 INFO:teuthology.orchestra.run.smithi099.stdout:(4/24): libradosstriper1-17.2.7-1635.g4a704134. 4.9 MB/s | 457 kB 00:00 2024-09-17T00:49:44.317 INFO:teuthology.orchestra.run.smithi099.stdout:(5/24): ceph-radosgw-17.2.7-1635.g4a704134.el9. 14 MB/s | 14 MB 00:01 2024-09-17T00:49:44.401 INFO:teuthology.orchestra.run.smithi099.stdout:(6/24): librgw2-17.2.7-1635.g4a704134.el9.x86_6 12 MB/s | 4.9 MB 00:00 2024-09-17T00:49:44.426 INFO:teuthology.orchestra.run.smithi099.stdout:(7/24): python3-ceph-argparse-17.2.7-1635.g4a70 416 kB/s | 45 kB 00:00 2024-09-17T00:49:44.451 INFO:teuthology.orchestra.run.smithi099.stdout:(8/24): python3-ceph-common-17.2.7-1635.g4a7041 2.3 MB/s | 120 kB 00:00 2024-09-17T00:49:44.476 INFO:teuthology.orchestra.run.smithi099.stdout:(9/24): python3-cephfs-17.2.7-1635.g4a704134.el 3.1 MB/s | 156 kB 00:00 2024-09-17T00:49:44.502 INFO:teuthology.orchestra.run.smithi099.stdout:(10/24): python3-rados-17.2.7-1635.g4a704134.el 6.2 MB/s | 320 kB 00:00 2024-09-17T00:49:44.535 INFO:teuthology.orchestra.run.smithi099.stdout:(11/24): python3-rbd-17.2.7-1635.g4a704134.el9. 4.9 MB/s | 295 kB 00:00 2024-09-17T00:49:44.560 INFO:teuthology.orchestra.run.smithi099.stdout:(12/24): python3-rgw-17.2.7-1635.g4a704134.el9. 1.7 MB/s | 99 kB 00:00 2024-09-17T00:49:44.786 INFO:teuthology.orchestra.run.smithi099.stdout:(13/24): ceph-common-17.2.7-1635.g4a704134.el9. 15 MB/s | 22 MB 00:01 2024-09-17T00:49:44.878 INFO:teuthology.orchestra.run.smithi099.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 143 kB/s | 45 kB 00:00 2024-09-17T00:49:44.903 INFO:teuthology.orchestra.run.smithi099.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 436 kB/s | 160 kB 00:00 2024-09-17T00:49:44.978 INFO:teuthology.orchestra.run.smithi099.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 563 kB/s | 42 kB 00:00 2024-09-17T00:49:45.003 INFO:teuthology.orchestra.run.smithi099.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-17T00:49:45.037 INFO:teuthology.orchestra.run.smithi099.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.6 MB/s | 662 kB 00:00 2024-09-17T00:49:45.104 INFO:teuthology.orchestra.run.smithi099.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-09-17T00:49:45.129 INFO:teuthology.orchestra.run.smithi099.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 870 kB/s | 67 kB 00:00 2024-09-17T00:49:45.171 INFO:teuthology.orchestra.run.smithi099.stdout:(21/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.6 MB/s | 308 kB 00:00 2024-09-17T00:49:45.263 INFO:teuthology.orchestra.run.smithi099.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-17T00:49:45.330 INFO:teuthology.orchestra.run.smithi099.stdout:(23/24): librados2-17.2.7-1635.g4a704134.el9.x8 15 MB/s | 3.1 MB 00:00 2024-09-17T00:49:45.413 INFO:teuthology.orchestra.run.smithi099.stdout:(24/24): librbd1-17.2.7-1635.g4a704134.el9.x86_ 12 MB/s | 2.9 MB 00:00 2024-09-17T00:49:45.419 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:49:45.419 INFO:teuthology.orchestra.run.smithi099.stdout:Total 23 MB/s | 58 MB 00:02 2024-09-17T00:49:45.481 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:49:45.514 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:49:45.514 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:49:45.562 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:49:45.577 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:49:45.577 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-17T00:49:45.577 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:49:45.577 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:49:45.577 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:17.2.7-1635.g4a704134.el9 ceph 14 M 2024-09-17T00:49:45.577 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-09-17T00:49:45.577 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 3.1 M 2024-09-17T00:49:45.577 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 2.9 M 2024-09-17T00:49:45.577 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-17T00:49:45.577 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:17.2.7-1635.g4a704134.el9 ceph 5.0 M 2024-09-17T00:49:45.578 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:17.2.7-1635.g4a704134.el9 ceph 22 M 2024-09-17T00:49:45.578 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:17.2.7-1635.g4a704134.el9 ceph 25 k 2024-09-17T00:49:45.578 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T00:49:45.578 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 637 k 2024-09-17T00:49:45.578 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T00:49:45.578 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T00:49:45.578 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T00:49:45.578 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 457 k 2024-09-17T00:49:45.578 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T00:49:45.578 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:17.2.7-1635.g4a704134.el9 ceph 4.9 M 2024-09-17T00:49:45.578 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T00:49:45.578 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T00:49:45.578 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:17.2.7-1635.g4a704134.el9 ceph 45 k 2024-09-17T00:49:45.579 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:17.2.7-1635.g4a704134.el9 ceph 120 k 2024-09-17T00:49:45.579 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:17.2.7-1635.g4a704134.el9 ceph 156 k 2024-09-17T00:49:45.579 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T00:49:45.579 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:17.2.7-1635.g4a704134.el9 ceph 320 k 2024-09-17T00:49:45.579 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:17.2.7-1635.g4a704134.el9 ceph 295 k 2024-09-17T00:49:45.579 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:17.2.7-1635.g4a704134.el9 ceph 99 k 2024-09-17T00:49:45.579 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T00:49:45.579 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:49:45.579 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:49:45.579 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:49:45.579 INFO:teuthology.orchestra.run.smithi002.stdout:Install 22 Packages 2024-09-17T00:49:45.579 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 2 Packages 2024-09-17T00:49:45.579 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:49:45.580 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 58 M 2024-09-17T00:49:45.580 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:49:46.167 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:49:46.168 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:49:46.810 INFO:teuthology.orchestra.run.smithi002.stdout:(1/24): ceph-base-17.2.7-1635.g4a704134.el9.x86 9.3 MB/s | 5.0 MB 00:00 2024-09-17T00:49:46.876 INFO:teuthology.orchestra.run.smithi002.stdout:(2/24): ceph-selinux-17.2.7-1635.g4a704134.el9. 379 kB/s | 25 kB 00:00 2024-09-17T00:49:46.977 INFO:teuthology.orchestra.run.smithi002.stdout:(3/24): libcephfs2-17.2.7-1635.g4a704134.el9.x8 6.2 MB/s | 637 kB 00:00 2024-09-17T00:49:47.077 INFO:teuthology.orchestra.run.smithi002.stdout:(4/24): libradosstriper1-17.2.7-1635.g4a704134. 4.5 MB/s | 457 kB 00:00 2024-09-17T00:49:47.227 INFO:teuthology.orchestra.run.smithi002.stdout:(5/24): ceph-radosgw-17.2.7-1635.g4a704134.el9. 15 MB/s | 14 MB 00:00 2024-09-17T00:49:47.269 INFO:teuthology.orchestra.run.smithi002.stdout:(6/24): python3-ceph-argparse-17.2.7-1635.g4a70 1.1 MB/s | 45 kB 00:00 2024-09-17T00:49:47.353 INFO:teuthology.orchestra.run.smithi002.stdout:(7/24): librgw2-17.2.7-1635.g4a704134.el9.x86_6 18 MB/s | 4.9 MB 00:00 2024-09-17T00:49:47.383 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:49:47.420 INFO:teuthology.orchestra.run.smithi002.stdout:(8/24): python3-ceph-common-17.2.7-1635.g4a7041 800 kB/s | 120 kB 00:00 2024-09-17T00:49:47.445 INFO:teuthology.orchestra.run.smithi002.stdout:(9/24): python3-cephfs-17.2.7-1635.g4a704134.el 1.7 MB/s | 156 kB 00:00 2024-09-17T00:49:47.470 INFO:teuthology.orchestra.run.smithi002.stdout:(10/24): python3-rados-17.2.7-1635.g4a704134.el 6.2 MB/s | 320 kB 00:00 2024-09-17T00:49:47.504 INFO:teuthology.orchestra.run.smithi002.stdout:(11/24): python3-rbd-17.2.7-1635.g4a704134.el9. 4.9 MB/s | 295 kB 00:00 2024-09-17T00:49:47.529 INFO:teuthology.orchestra.run.smithi002.stdout:(12/24): python3-rgw-17.2.7-1635.g4a704134.el9. 1.7 MB/s | 99 kB 00:00 2024-09-17T00:49:47.754 INFO:teuthology.orchestra.run.smithi002.stdout:(13/24): ceph-common-17.2.7-1635.g4a704134.el9. 15 MB/s | 22 MB 00:01 2024-09-17T00:49:47.770 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-17T00:49:47.824 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:17.2.7-1635.g4a704134.el9.x86_64 2/26 2024-09-17T00:49:47.838 INFO:teuthology.orchestra.run.smithi002.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 146 kB/s | 45 kB 00:00 2024-09-17T00:49:47.863 INFO:teuthology.orchestra.run.smithi002.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 446 kB/s | 160 kB 00:00 2024-09-17T00:49:47.914 INFO:teuthology.orchestra.run.smithi002.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 842 kB/s | 42 kB 00:00 2024-09-17T00:49:47.916 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:17.2.7-1635.g4a704134.el9.x86_64 2/26 2024-09-17T00:49:47.972 INFO:teuthology.orchestra.run.smithi002.stdout:(17/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 5.2 MB/s | 308 kB 00:00 2024-09-17T00:49:47.997 INFO:teuthology.orchestra.run.smithi002.stdout:(18/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-09-17T00:49:47.999 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 3/26 2024-09-17T00:49:48.023 INFO:teuthology.orchestra.run.smithi002.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 961 kB/s | 49 kB 00:00 2024-09-17T00:49:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 4/26 2024-09-17T00:49:48.056 INFO:teuthology.orchestra.run.smithi002.stdout:(20/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.1 MB/s | 662 kB 00:00 2024-09-17T00:49:48.090 INFO:teuthology.orchestra.run.smithi002.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 730 kB/s | 67 kB 00:00 2024-09-17T00:49:48.114 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 4/26 2024-09-17T00:49:48.132 INFO:teuthology.orchestra.run.smithi002.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-17T00:49:48.167 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-17T00:49:48.205 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-17T00:49:48.249 INFO:teuthology.orchestra.run.smithi002.stdout:(23/24): librados2-17.2.7-1635.g4a704134.el9.x8 16 MB/s | 3.1 MB 00:00 2024-09-17T00:49:48.307 INFO:teuthology.orchestra.run.smithi002.stdout:(24/24): librbd1-17.2.7-1635.g4a704134.el9.x86_ 14 MB/s | 2.9 MB 00:00 2024-09-17T00:49:48.313 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:49:48.313 INFO:teuthology.orchestra.run.smithi002.stdout:Total 21 MB/s | 58 MB 00:02 2024-09-17T00:49:48.380 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:49:48.417 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:49:48.417 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:49:48.648 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-17T00:49:48.678 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 8/26 2024-09-17T00:49:48.761 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 8/26 2024-09-17T00:49:48.794 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-17T00:49:48.837 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:17.2.7-1635.g4a704134.el9. 10/26 2024-09-17T00:49:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 11/26 2024-09-17T00:49:48.961 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 12/26 2024-09-17T00:49:48.997 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_6 13/26 2024-09-17T00:49:49.071 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_6 13/26 2024-09-17T00:49:49.093 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:49:49.093 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:49:49.120 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-17T00:49:49.165 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-17T00:49:49.204 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-17T00:49:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-17T00:49:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 18/26 2024-09-17T00:49:49.633 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 18/26 2024-09-17T00:49:49.707 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 19/26 2024-09-17T00:49:49.737 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:17.2.7-1635.g4a704134.el9.x8 20/26 2024-09-17T00:49:50.369 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:49:50.774 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-17T00:49:50.826 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:17.2.7-1635.g4a704134.el9.x86_64 2/26 2024-09-17T00:49:50.919 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:17.2.7-1635.g4a704134.el9.x86_64 2/26 2024-09-17T00:49:51.014 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 3/26 2024-09-17T00:49:51.044 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 4/26 2024-09-17T00:49:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 4/26 2024-09-17T00:49:51.162 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-17T00:49:51.199 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-17T00:49:51.664 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-17T00:49:51.697 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 8/26 2024-09-17T00:49:51.762 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 8/26 2024-09-17T00:49:51.799 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-17T00:49:51.842 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:17.2.7-1635.g4a704134.el9. 10/26 2024-09-17T00:49:51.879 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 11/26 2024-09-17T00:49:51.951 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 12/26 2024-09-17T00:49:52.002 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_6 13/26 2024-09-17T00:49:52.082 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_6 13/26 2024-09-17T00:49:52.125 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-17T00:49:52.150 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 21/26 2024-09-17T00:49:52.177 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-17T00:49:52.192 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 21/26 2024-09-17T00:49:52.215 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-17T00:49:52.531 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-17T00:49:52.714 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 18/26 2024-09-17T00:49:52.739 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 21/26 2024-09-17T00:49:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 22/26 2024-09-17T00:49:52.814 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 18/26 2024-09-17T00:49:52.876 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 22/26 2024-09-17T00:49:52.877 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T00:49:52.877 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T00:49:52.877 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:49:52.889 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 19/26 2024-09-17T00:49:52.904 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 23/26 2024-09-17T00:49:52.916 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:17.2.7-1635.g4a704134.el9.x8 20/26 2024-09-17T00:49:55.483 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 21/26 2024-09-17T00:49:55.513 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 21/26 2024-09-17T00:49:56.064 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 21/26 2024-09-17T00:49:56.100 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 22/26 2024-09-17T00:49:56.205 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 22/26 2024-09-17T00:49:56.206 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T00:49:56.206 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T00:49:56.206 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:49:56.251 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 23/26 2024-09-17T00:50:02.797 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 23/26 2024-09-17T00:50:02.798 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2024-09-17T00:50:02.798 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2024-09-17T00:50:02.798 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2024-09-17T00:50:02.798 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2024-09-17T00:50:02.798 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2024-09-17T00:50:02.798 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /root 2024-09-17T00:50:02.799 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2024-09-17T00:50:02.799 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:04.128 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 24/26 2024-09-17T00:50:04.198 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 24/26 2024-09-17T00:50:04.198 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:50:04.198 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T00:50:04.198 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T00:50:04.199 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T00:50:04.199 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-17T00:50:04.290 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-17T00:50:04.290 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-17T00:50:05.563 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-17T00:50:05.564 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 1/26 2024-09-17T00:50:05.564 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 2/26 2024-09-17T00:50:05.564 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 3/26 2024-09-17T00:50:05.564 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 4/26 2024-09-17T00:50:05.564 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 5/26 2024-09-17T00:50:05.564 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_6 6/26 2024-09-17T00:50:05.564 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 7/26 2024-09-17T00:50:05.564 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1635.g4a704134.el9. 8/26 2024-09-17T00:50:05.564 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:17.2.7-1635.g4a704134.el9.x8 9/26 2024-09-17T00:50:05.564 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 10/26 2024-09-17T00:50:05.565 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 11/26 2024-09-17T00:50:05.565 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 12/26 2024-09-17T00:50:05.565 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 13/26 2024-09-17T00:50:05.565 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-17T00:50:05.565 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-17T00:50:05.565 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-17T00:50:05.565 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-17T00:50:05.565 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-17T00:50:05.565 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-17T00:50:05.565 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-17T00:50:05.565 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-17T00:50:05.565 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-17T00:50:05.566 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:17.2.7-1635.g4a704134.el9.x86_64 23/26 2024-09-17T00:50:05.566 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-17T00:50:05.566 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 25/26 2024-09-17T00:50:06.631 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-17T00:50:06.631 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:06.631 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2024-09-17T00:50:06.632 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.632 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.632 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:50:06.632 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.632 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.632 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.632 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.632 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T00:50:06.632 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.632 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T00:50:06.632 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T00:50:06.632 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T00:50:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T00:50:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T00:50:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T00:50:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T00:50:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T00:50:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:06.634 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:50:06.695 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 23/26 2024-09-17T00:50:06.696 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-09-17T00:50:06.696 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-09-17T00:50:06.696 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-09-17T00:50:06.696 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-09-17T00:50:06.696 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-09-17T00:50:06.696 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-09-17T00:50:06.696 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-09-17T00:50:06.697 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:06.968 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-test 2024-09-17T00:50:07.545 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:27 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:50:07.681 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:50:07.681 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:07.681 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-17T00:50:07.681 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:07.681 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:50:07.682 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:17.2.7-1635.g4a704134.el9 ceph 48 M 2024-09-17T00:50:07.682 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-17T00:50:07.682 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:17.2.7-1635.g4a704134.el9 ceph 163 k 2024-09-17T00:50:07.682 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T00:50:07.682 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T00:50:07.682 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:07.682 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:50:07.682 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:07.682 INFO:teuthology.orchestra.run.smithi099.stdout:Install 4 Packages 2024-09-17T00:50:07.682 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:07.683 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 48 M 2024-09-17T00:50:07.683 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 193 M 2024-09-17T00:50:07.683 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:50:08.036 INFO:teuthology.orchestra.run.smithi099.stdout:(1/4): libcephsqlite-17.2.7-1635.g4a704134.el9. 720 kB/s | 163 kB 00:00 2024-09-17T00:50:08.059 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 24/26 2024-09-17T00:50:08.061 INFO:teuthology.orchestra.run.smithi099.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-17T00:50:08.139 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 24/26 2024-09-17T00:50:08.139 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:50:08.139 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T00:50:08.139 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T00:50:08.139 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T00:50:08.139 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:08.141 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-17T00:50:08.195 INFO:teuthology.orchestra.run.smithi099.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 402 kB/s | 64 kB 00:00 2024-09-17T00:50:08.229 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-17T00:50:08.229 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-17T00:50:09.345 INFO:teuthology.orchestra.run.smithi099.stdout:(4/4): ceph-test-17.2.7-1635.g4a704134.el9.x86_ 31 MB/s | 48 MB 00:01 2024-09-17T00:50:09.347 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:09.348 INFO:teuthology.orchestra.run.smithi099.stdout:Total 29 MB/s | 48 MB 00:01 2024-09-17T00:50:09.374 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:50:09.393 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:50:09.393 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:50:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-17T00:50:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 1/26 2024-09-17T00:50:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 2/26 2024-09-17T00:50:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 3/26 2024-09-17T00:50:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 4/26 2024-09-17T00:50:09.618 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 5/26 2024-09-17T00:50:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_6 6/26 2024-09-17T00:50:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 7/26 2024-09-17T00:50:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1635.g4a704134.el9. 8/26 2024-09-17T00:50:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:17.2.7-1635.g4a704134.el9.x8 9/26 2024-09-17T00:50:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 10/26 2024-09-17T00:50:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 11/26 2024-09-17T00:50:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 12/26 2024-09-17T00:50:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 13/26 2024-09-17T00:50:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-17T00:50:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-17T00:50:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-17T00:50:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-17T00:50:09.619 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-17T00:50:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-17T00:50:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-17T00:50:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-17T00:50:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-17T00:50:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:17.2.7-1635.g4a704134.el9.x86_64 23/26 2024-09-17T00:50:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-17T00:50:09.620 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 25/26 2024-09-17T00:50:09.766 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:50:09.766 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:50:10.291 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:50:10.372 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T00:50:10.420 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T00:50:10.447 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 3/4 2024-09-17T00:50:10.449 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-17T00:50:10.449 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:10.449 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-09-17T00:50:10.450 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.450 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.450 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:50:10.450 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.450 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.450 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.450 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.450 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T00:50:10.450 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.450 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T00:50:10.450 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T00:50:10.450 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T00:50:10.450 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T00:50:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T00:50:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T00:50:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T00:50:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T00:50:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:10.452 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:50:10.791 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-test 2024-09-17T00:50:11.392 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:50:11.535 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:50:11.536 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-17T00:50:11.537 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:11.537 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:50:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:17.2.7-1635.g4a704134.el9 ceph 48 M 2024-09-17T00:50:11.537 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-17T00:50:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:17.2.7-1635.g4a704134.el9 ceph 163 k 2024-09-17T00:50:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T00:50:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T00:50:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:11.538 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:50:11.538 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:11.538 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2024-09-17T00:50:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:11.539 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 48 M 2024-09-17T00:50:11.539 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 193 M 2024-09-17T00:50:11.540 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:50:11.717 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.9 MB/s | 304 kB 00:00 2024-09-17T00:50:11.759 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-17T00:50:11.784 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): libcephsqlite-17.2.7-1635.g4a704134.el9. 726 kB/s | 163 kB 00:00 2024-09-17T00:50:13.059 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): ceph-test-17.2.7-1635.g4a704134.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-17T00:50:13.061 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:13.062 INFO:teuthology.orchestra.run.smithi002.stdout:Total 32 MB/s | 48 MB 00:01 2024-09-17T00:50:13.090 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:50:13.112 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:50:13.112 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:50:13.502 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:50:13.503 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:50:14.038 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:50:14.128 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T00:50:14.175 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T00:50:14.202 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 3/4 2024-09-17T00:50:14.810 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 3/4 2024-09-17T00:50:14.893 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 4/4 2024-09-17T00:50:17.165 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 4/4 2024-09-17T00:50:17.166 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 1/4 2024-09-17T00:50:17.166 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 2/4 2024-09-17T00:50:17.166 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T00:50:17.509 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T00:50:17.509 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:17.509 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:50:17.509 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:17.509 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:17.509 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T00:50:17.510 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T00:50:17.510 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:17.510 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:50:17.786 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph 2024-09-17T00:50:18.369 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:50:18.502 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-17T00:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:18.504 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:17.2.7-1635.g4a704134.el9 ceph 6.5 k 2024-09-17T00:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-17T00:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:17.2.7-1635.g4a704134.el9 ceph 2.1 M 2024-09-17T00:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:17.2.7-1635.g4a704134.el9 ceph 1.4 M 2024-09-17T00:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 240 k 2024-09-17T00:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:17.2.7-1635.g4a704134.el9 ceph 3.9 M 2024-09-17T00:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:17.2.7-1635.g4a704134.el9 ceph 15 M 2024-09-17T00:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T00:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T00:50:18.505 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T00:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T00:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T00:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T00:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T00:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections 2024-09-17T00:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-17T00:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T00:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T00:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T00:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T00:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T00:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T00:50:18.506 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T00:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T00:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T00:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T00:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T00:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T00:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T00:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T00:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T00:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T00:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T00:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T00:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T00:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T00:50:18.507 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout:Install 34 Packages 2024-09-17T00:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 27 M 2024-09-17T00:50:18.508 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 96 M 2024-09-17T00:50:18.509 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:50:18.846 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 3/4 2024-09-17T00:50:18.928 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 4/4 2024-09-17T00:50:19.319 INFO:teuthology.orchestra.run.smithi099.stdout:(1/34): ceph-17.2.7-1635.g4a704134.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-17T00:50:19.469 INFO:teuthology.orchestra.run.smithi099.stdout:(2/34): ceph-mgr-17.2.7-1635.g4a704134.el9.x86_ 5.0 MB/s | 1.4 MB 00:00 2024-09-17T00:50:19.545 INFO:teuthology.orchestra.run.smithi099.stdout:(3/34): ceph-mds-17.2.7-1635.g4a704134.el9.x86_ 5.8 MB/s | 2.1 MB 00:00 2024-09-17T00:50:19.645 INFO:teuthology.orchestra.run.smithi099.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1635.g4a70 2.4 MB/s | 240 kB 00:00 2024-09-17T00:50:19.729 INFO:teuthology.orchestra.run.smithi099.stdout:(5/34): ceph-mon-17.2.7-1635.g4a704134.el9.x86_ 9.6 MB/s | 3.9 MB 00:00 2024-09-17T00:50:20.037 INFO:teuthology.orchestra.run.smithi099.stdout:(6/34): ceph-osd-17.2.7-1635.g4a704134.el9.x86_ 27 MB/s | 15 MB 00:00 2024-09-17T00:50:20.154 INFO:teuthology.orchestra.run.smithi099.stdout:(7/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 498 kB/s | 253 kB 00:00 2024-09-17T00:50:20.280 INFO:teuthology.orchestra.run.smithi099.stdout:(8/34): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-17T00:50:20.338 INFO:teuthology.orchestra.run.smithi099.stdout:(9/34): python3-ply-3.11-14.el9.noarch.rpm 355 kB/s | 106 kB 00:00 2024-09-17T00:50:20.363 INFO:teuthology.orchestra.run.smithi099.stdout:(10/34): python3-requests-2.25.1-8.el9.noarch.r 1.5 MB/s | 125 kB 00:00 2024-09-17T00:50:20.480 INFO:teuthology.orchestra.run.smithi099.stdout:(11/34): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-17T00:50:20.522 INFO:teuthology.orchestra.run.smithi099.stdout:(12/34): python3-markupsafe-1.1.1-12.el9.x86_64 835 kB/s | 35 kB 00:00 2024-09-17T00:50:20.564 INFO:teuthology.orchestra.run.smithi099.stdout:(13/34): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-17T00:50:20.606 INFO:teuthology.orchestra.run.smithi099.stdout:(14/34): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-17T00:50:20.640 INFO:teuthology.orchestra.run.smithi099.stdout:(15/34): python3-urllib3-1.26.5-6.el9.noarch.rp 713 kB/s | 215 kB 00:00 2024-09-17T00:50:20.665 INFO:teuthology.orchestra.run.smithi099.stdout:(16/34): python3-toml-0.10.2-6.el9.noarch.rpm 708 kB/s | 42 kB 00:00 2024-09-17T00:50:20.707 INFO:teuthology.orchestra.run.smithi099.stdout:(17/34): python3-cryptography-36.0.1-4.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2024-09-17T00:50:20.757 INFO:teuthology.orchestra.run.smithi099.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 370 kB/s | 43 kB 00:00 2024-09-17T00:50:20.782 INFO:teuthology.orchestra.run.smithi099.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 465 kB/s | 11 kB 00:00 2024-09-17T00:50:20.808 INFO:teuthology.orchestra.run.smithi099.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 709 kB/s | 18 kB 00:00 2024-09-17T00:50:20.841 INFO:teuthology.orchestra.run.smithi099.stdout:(21/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 977 kB/s | 172 kB 00:00 2024-09-17T00:50:20.878 INFO:teuthology.orchestra.run.smithi099.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 331 kB/s | 23 kB 00:00 2024-09-17T00:50:20.903 INFO:teuthology.orchestra.run.smithi099.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 315 kB/s | 19 kB 00:00 2024-09-17T00:50:20.937 INFO:teuthology.orchestra.run.smithi099.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 335 kB/s | 20 kB 00:00 2024-09-17T00:50:20.963 INFO:teuthology.orchestra.run.smithi099.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 787 kB/s | 46 kB 00:00 2024-09-17T00:50:20.988 INFO:teuthology.orchestra.run.smithi099.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-17T00:50:21.013 INFO:teuthology.orchestra.run.smithi099.stdout:(27/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-09-17T00:50:21.038 INFO:teuthology.orchestra.run.smithi099.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-09-17T00:50:21.064 INFO:teuthology.orchestra.run.smithi099.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-17T00:50:21.089 INFO:teuthology.orchestra.run.smithi099.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-17T00:50:21.114 INFO:teuthology.orchestra.run.smithi099.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-17T00:50:21.125 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 4/4 2024-09-17T00:50:21.125 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 1/4 2024-09-17T00:50:21.125 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 2/4 2024-09-17T00:50:21.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T00:50:21.139 INFO:teuthology.orchestra.run.smithi099.stdout:(32/34): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-17T00:50:21.165 INFO:teuthology.orchestra.run.smithi099.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 399 kB/s | 20 kB 00:00 2024-09-17T00:50:21.190 INFO:teuthology.orchestra.run.smithi099.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-17T00:50:21.195 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:21.195 INFO:teuthology.orchestra.run.smithi099.stdout:Total 10 MB/s | 27 MB 00:02 2024-09-17T00:50:21.325 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:50:21.362 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:50:21.362 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:50:21.424 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T00:50:21.424 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:21.424 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:50:21.424 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:21.425 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:21.425 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T00:50:21.425 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T00:50:21.425 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:21.425 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:50:21.721 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph 2024-09-17T00:50:21.758 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:50:21.758 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:50:22.327 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:50:22.470 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:50:22.473 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:22.473 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-17T00:50:22.473 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:22.473 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:50:22.473 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:17.2.7-1635.g4a704134.el9 ceph 6.5 k 2024-09-17T00:50:22.473 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-17T00:50:22.473 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:17.2.7-1635.g4a704134.el9 ceph 2.1 M 2024-09-17T00:50:22.473 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:17.2.7-1635.g4a704134.el9 ceph 1.4 M 2024-09-17T00:50:22.473 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 240 k 2024-09-17T00:50:22.474 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:17.2.7-1635.g4a704134.el9 ceph 3.9 M 2024-09-17T00:50:22.474 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:17.2.7-1635.g4a704134.el9 ceph 15 M 2024-09-17T00:50:22.474 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T00:50:22.474 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T00:50:22.474 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T00:50:22.474 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T00:50:22.474 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T00:50:22.474 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T00:50:22.474 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T00:50:22.474 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections 2024-09-17T00:50:22.474 INFO:teuthology.orchestra.run.smithi002.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-17T00:50:22.474 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T00:50:22.474 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T00:50:22.475 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T00:50:22.476 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T00:50:22.476 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T00:50:22.476 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T00:50:22.476 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:22.476 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:50:22.476 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:22.476 INFO:teuthology.orchestra.run.smithi002.stdout:Install 34 Packages 2024-09-17T00:50:22.476 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:22.477 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 27 M 2024-09-17T00:50:22.477 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 96 M 2024-09-17T00:50:22.477 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:50:23.004 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:50:23.059 INFO:teuthology.orchestra.run.smithi002.stdout:(1/34): ceph-17.2.7-1635.g4a704134.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-17T00:50:23.068 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-17T00:50:23.125 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-17T00:50:23.166 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-17T00:50:23.235 INFO:teuthology.orchestra.run.smithi002.stdout:(2/34): ceph-mgr-17.2.7-1635.g4a704134.el9.x86_ 4.8 MB/s | 1.4 MB 00:00 2024-09-17T00:50:23.259 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-17T00:50:23.301 INFO:teuthology.orchestra.run.smithi002.stdout:(3/34): ceph-mds-17.2.7-1635.g4a704134.el9.x86_ 5.7 MB/s | 2.1 MB 00:00 2024-09-17T00:50:23.337 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-17T00:50:23.377 INFO:teuthology.orchestra.run.smithi002.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1635.g4a70 3.1 MB/s | 240 kB 00:00 2024-09-17T00:50:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-17T00:50:23.420 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-17T00:50:23.451 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-17T00:50:23.452 INFO:teuthology.orchestra.run.smithi002.stdout:(5/34): ceph-mon-17.2.7-1635.g4a704134.el9.x86_ 10 MB/s | 3.9 MB 00:00 2024-09-17T00:50:23.485 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-17T00:50:23.526 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-17T00:50:23.566 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-17T00:50:23.602 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-17T00:50:23.636 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-17T00:50:23.684 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-17T00:50:23.720 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-17T00:50:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:(6/34): ceph-osd-17.2.7-1635.g4a704134.el9.x86_ 31 MB/s | 15 MB 00:00 2024-09-17T00:50:23.752 INFO:teuthology.orchestra.run.smithi002.stdout:(7/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 675 kB/s | 253 kB 00:00 2024-09-17T00:50:23.798 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-17T00:50:23.803 INFO:teuthology.orchestra.run.smithi002.stdout:(8/34): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-17T00:50:23.853 INFO:teuthology.orchestra.run.smithi002.stdout:(9/34): python3-cryptography-36.0.1-4.el9.x86_6 3.1 MB/s | 1.2 MB 00:00 2024-09-17T00:50:23.878 INFO:teuthology.orchestra.run.smithi002.stdout:(10/34): python3-requests-2.25.1-8.el9.noarch.r 1.6 MB/s | 125 kB 00:00 2024-09-17T00:50:23.912 INFO:teuthology.orchestra.run.smithi002.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-17T00:50:23.936 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-17T00:50:23.937 INFO:teuthology.orchestra.run.smithi002.stdout:(12/34): python3-ply-3.11-14.el9.noarch.rpm 508 kB/s | 106 kB 00:00 2024-09-17T00:50:24.012 INFO:teuthology.orchestra.run.smithi002.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 346 kB/s | 35 kB 00:00 2024-09-17T00:50:24.024 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-17T00:50:24.071 INFO:teuthology.orchestra.run.smithi002.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 894 kB/s | 172 kB 00:00 2024-09-17T00:50:24.094 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-17T00:50:24.096 INFO:teuthology.orchestra.run.smithi002.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 485 kB/s | 77 kB 00:00 2024-09-17T00:50:24.113 INFO:teuthology.orchestra.run.smithi002.stdout:(16/34): python3-pytz-2021.1-5.el9.noarch.rpm 507 kB/s | 51 kB 00:00 2024-09-17T00:50:24.130 INFO:teuthology.orchestra.run.smithi002.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 706 kB/s | 42 kB 00:00 2024-09-17T00:50:24.133 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-17T00:50:24.173 INFO:teuthology.orchestra.run.smithi002.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 576 kB/s | 43 kB 00:00 2024-09-17T00:50:24.190 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-17T00:50:24.197 INFO:teuthology.orchestra.run.smithi002.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 465 kB/s | 11 kB 00:00 2024-09-17T00:50:24.214 INFO:teuthology.orchestra.run.smithi002.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-17T00:50:24.245 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-17T00:50:24.265 INFO:teuthology.orchestra.run.smithi002.stdout:(21/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-17T00:50:24.282 INFO:teuthology.orchestra.run.smithi002.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 345 kB/s | 23 kB 00:00 2024-09-17T00:50:24.299 INFO:teuthology.orchestra.run.smithi002.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 573 kB/s | 19 kB 00:00 2024-09-17T00:50:24.316 INFO:teuthology.orchestra.run.smithi002.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 585 kB/s | 20 kB 00:00 2024-09-17T00:50:24.332 INFO:teuthology.orchestra.run.smithi002.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2024-09-17T00:50:24.358 INFO:teuthology.orchestra.run.smithi002.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-17T00:50:24.383 INFO:teuthology.orchestra.run.smithi002.stdout:(27/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-09-17T00:50:24.408 INFO:teuthology.orchestra.run.smithi002.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-17T00:50:24.434 INFO:teuthology.orchestra.run.smithi002.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-17T00:50:24.438 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-17T00:50:24.459 INFO:teuthology.orchestra.run.smithi002.stdout:(30/34): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-17T00:50:24.484 INFO:teuthology.orchestra.run.smithi002.stdout:(31/34): python3-tempora-5.0.0-2.el9.noarch.rpm 474 kB/s | 36 kB 00:00 2024-09-17T00:50:24.495 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-17T00:50:24.509 INFO:teuthology.orchestra.run.smithi002.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 799 kB/s | 20 kB 00:00 2024-09-17T00:50:24.543 INFO:teuthology.orchestra.run.smithi002.stdout:(33/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-17T00:50:24.568 INFO:teuthology.orchestra.run.smithi002.stdout:(34/34): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-17T00:50:24.573 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-17T00:50:24.573 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:24.573 INFO:teuthology.orchestra.run.smithi002.stdout:Total 13 MB/s | 27 MB 00:02 2024-09-17T00:50:24.662 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-17T00:50:24.703 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:50:24.714 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-17T00:50:24.744 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:50:24.745 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:50:24.833 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-17T00:50:24.993 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1635.g4a704134.el9. 29/34 2024-09-17T00:50:25.021 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 30/34 2024-09-17T00:50:25.047 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 30/34 2024-09-17T00:50:25.047 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:50:25.047 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T00:50:25.048 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T00:50:25.048 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T00:50:25.048 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:25.156 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:50:25.156 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:50:26.355 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 31/34 2024-09-17T00:50:26.382 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 31/34 2024-09-17T00:50:26.382 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:50:26.382 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T00:50:26.382 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T00:50:26.382 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T00:50:26.382 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:26.391 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:50:26.446 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-17T00:50:26.488 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-17T00:50:26.529 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-17T00:50:26.625 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-17T00:50:26.710 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-17T00:50:26.756 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 32/34 2024-09-17T00:50:26.765 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-17T00:50:26.779 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 32/34 2024-09-17T00:50:26.779 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:50:26.779 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T00:50:26.780 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T00:50:26.780 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T00:50:26.780 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:26.808 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-17T00:50:26.846 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-17T00:50:26.881 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-17T00:50:26.914 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-17T00:50:26.955 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-17T00:50:26.981 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 33/34 2024-09-17T00:50:26.998 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-17T00:50:27.005 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 33/34 2024-09-17T00:50:27.005 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:50:27.005 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T00:50:27.005 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T00:50:27.005 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T00:50:27.005 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:27.032 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-17T00:50:27.069 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:17.2.7-1635.g4a704134.el9.x86_64 34/34 2024-09-17T00:50:27.082 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-17T00:50:27.143 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-17T00:50:27.223 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-17T00:50:27.379 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-17T00:50:27.461 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-17T00:50:27.513 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-17T00:50:27.549 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-17T00:50:27.608 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-17T00:50:27.671 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-17T00:50:27.875 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-17T00:50:27.920 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-17T00:50:28.001 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-17T00:50:28.100 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-17T00:50:28.153 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-17T00:50:28.282 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-17T00:50:28.442 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1635.g4a704134.el9. 29/34 2024-09-17T00:50:28.470 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 30/34 2024-09-17T00:50:28.497 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 30/34 2024-09-17T00:50:28.497 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:50:28.497 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T00:50:28.497 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T00:50:28.497 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T00:50:28.497 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:28.877 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-2:17.2.7-1635.g4a704134.el9.x86_64 34/34 2024-09-17T00:50:28.878 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:17.2.7-1635.g4a704134.el9.x86_64 1/34 2024-09-17T00:50:28.878 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 2/34 2024-09-17T00:50:28.878 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 3/34 2024-09-17T00:50:28.878 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 4/34 2024-09-17T00:50:28.878 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 5/34 2024-09-17T00:50:28.878 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1635.g4a704134.el9. 6/34 2024-09-17T00:50:28.878 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-17T00:50:28.878 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-17T00:50:28.878 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-17T00:50:28.878 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-17T00:50:28.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-17T00:50:28.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-17T00:50:28.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-17T00:50:28.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-17T00:50:28.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-17T00:50:28.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-17T00:50:28.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-17T00:50:28.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-17T00:50:28.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-17T00:50:28.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-17T00:50:28.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-17T00:50:28.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-17T00:50:28.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-17T00:50:28.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-17T00:50:28.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-17T00:50:28.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-17T00:50:28.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-17T00:50:28.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-17T00:50:28.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-17T00:50:28.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-17T00:50:28.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-17T00:50:28.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-17T00:50:28.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-17T00:50:29.757 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-17T00:50:29.757 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:29.757 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:50:29.757 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:29.757 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:29.758 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:29.758 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:50:29.758 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:29.758 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:29.758 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T00:50:29.758 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T00:50:29.758 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T00:50:29.758 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T00:50:29.758 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T00:50:29.758 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T00:50:29.758 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T00:50:29.758 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T00:50:29.758 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T00:50:29.759 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T00:50:29.759 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T00:50:29.759 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T00:50:29.759 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T00:50:29.759 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T00:50:29.759 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T00:50:29.759 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T00:50:29.759 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T00:50:29.759 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T00:50:29.759 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T00:50:29.759 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T00:50:29.759 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T00:50:29.759 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T00:50:29.760 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T00:50:29.760 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T00:50:29.760 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T00:50:29.760 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T00:50:29.760 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T00:50:29.760 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T00:50:29.760 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:29.760 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:50:29.880 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 31/34 2024-09-17T00:50:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 31/34 2024-09-17T00:50:29.909 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:50:29.909 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T00:50:29.909 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T00:50:29.909 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T00:50:29.909 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:30.197 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-base 2024-09-17T00:50:30.297 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 32/34 2024-09-17T00:50:30.323 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 32/34 2024-09-17T00:50:30.323 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:50:30.323 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T00:50:30.323 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T00:50:30.323 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T00:50:30.324 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:30.539 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 33/34 2024-09-17T00:50:30.564 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 33/34 2024-09-17T00:50:30.565 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:50:30.565 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T00:50:30.565 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T00:50:30.565 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T00:50:30.565 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:30.631 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:17.2.7-1635.g4a704134.el9.x86_64 34/34 2024-09-17T00:50:30.801 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:50:30.890 INFO:teuthology.orchestra.run.smithi099.stdout:Package ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:50:30.932 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:50:30.933 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-17T00:50:30.933 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:50:30.998 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install cephadm 2024-09-17T00:50:31.571 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:50:31.700 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:50:31.700 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-17T00:50:31.701 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:31.701 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:50:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 83 k 2024-09-17T00:50:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:31.701 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:50:31.701 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:31.701 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-17T00:50:31.701 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:31.701 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 83 k 2024-09-17T00:50:31.701 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 375 k 2024-09-17T00:50:31.701 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:50:31.890 INFO:teuthology.orchestra.run.smithi099.stdout:cephadm-17.2.7-1635.g4a704134.el9.noarch.rpm 440 kB/s | 83 kB 00:00 2024-09-17T00:50:31.890 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:31.890 INFO:teuthology.orchestra.run.smithi099.stdout:Total 437 kB/s | 83 kB 00:00 2024-09-17T00:50:31.891 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:50:31.895 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:50:31.895 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:50:31.898 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:50:31.898 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:50:31.972 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:50:32.355 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T00:50:32.388 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-2:17.2.7-1635.g4a704134.el9.x86_64 34/34 2024-09-17T00:50:32.388 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:17.2.7-1635.g4a704134.el9.x86_64 1/34 2024-09-17T00:50:32.388 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 2/34 2024-09-17T00:50:32.388 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 3/34 2024-09-17T00:50:32.388 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 4/34 2024-09-17T00:50:32.388 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 5/34 2024-09-17T00:50:32.389 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1635.g4a704134.el9. 6/34 2024-09-17T00:50:32.389 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-17T00:50:32.389 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-17T00:50:32.389 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-17T00:50:32.389 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-17T00:50:32.389 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-17T00:50:32.389 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-17T00:50:32.389 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-17T00:50:32.389 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-17T00:50:32.389 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-17T00:50:32.389 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-17T00:50:32.390 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-17T00:50:32.390 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-17T00:50:32.390 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-17T00:50:32.390 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-17T00:50:32.390 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-17T00:50:32.390 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-17T00:50:32.390 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-17T00:50:32.390 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-17T00:50:32.390 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-17T00:50:32.392 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-17T00:50:32.392 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-17T00:50:32.392 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-17T00:50:32.392 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-17T00:50:32.392 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-17T00:50:32.392 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-17T00:50:32.392 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-17T00:50:32.392 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-17T00:50:32.459 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T00:50:32.848 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T00:50:33.089 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T00:50:33.090 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:33.090 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:50:33.090 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:50:33.090 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:33.090 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:50:33.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-17T00:50:33.126 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:33.127 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:50:33.127 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:33.127 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:33.127 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:33.127 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:50:33.127 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:33.127 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:33.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T00:50:33.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T00:50:33.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T00:50:33.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T00:50:33.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T00:50:33.127 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T00:50:33.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T00:50:33.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T00:50:33.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T00:50:33.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T00:50:33.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T00:50:33.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T00:50:33.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T00:50:33.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T00:50:33.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T00:50:33.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T00:50:33.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T00:50:33.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T00:50:33.128 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T00:50:33.129 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T00:50:33.129 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T00:50:33.129 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T00:50:33.129 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T00:50:33.129 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T00:50:33.129 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T00:50:33.129 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T00:50:33.129 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T00:50:33.129 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T00:50:33.129 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:33.129 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:50:33.300 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T00:50:33.497 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-base 2024-09-17T00:50:33.896 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:50:34.029 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:50:34.030 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-09-17T00:50:34.030 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:34.030 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:50:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1635.g4a704134.el9 ceph 137 k 2024-09-17T00:50:34.030 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:34.030 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:50:34.030 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:34.031 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-17T00:50:34.031 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:34.031 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 137 k 2024-09-17T00:50:34.031 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 379 k 2024-09-17T00:50:34.031 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:50:34.106 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:50:34.199 INFO:teuthology.orchestra.run.smithi002.stdout:Package ceph-base-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:50:34.228 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-immutable-object-cache-17.2.7-1635.g4a7041 697 kB/s | 137 kB 00:00 2024-09-17T00:50:34.229 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:34.229 INFO:teuthology.orchestra.run.smithi099.stdout:Total 691 kB/s | 137 kB 00:00 2024-09-17T00:50:34.229 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:50:34.237 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:50:34.237 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:50:34.242 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:50:34.244 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-17T00:50:34.244 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:50:34.293 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:50:34.294 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:50:34.306 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install cephadm 2024-09-17T00:50:34.443 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:50:34.537 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1635.g4a704134. 1/1 2024-09-17T00:50:34.562 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1635.g4a704134. 1/1 2024-09-17T00:50:34.562 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:50:34.562 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T00:50:34.563 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:34.912 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:50:35.049 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:50:35.050 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:35.050 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-17T00:50:35.050 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:35.050 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:50:35.050 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 83 k 2024-09-17T00:50:35.050 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:35.050 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:50:35.050 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:35.050 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-17T00:50:35.051 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:35.051 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 83 k 2024-09-17T00:50:35.051 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 375 k 2024-09-17T00:50:35.051 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:50:35.255 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm-17.2.7-1635.g4a704134.el9.noarch.rpm 405 kB/s | 83 kB 00:00 2024-09-17T00:50:35.255 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:35.256 INFO:teuthology.orchestra.run.smithi002.stdout:Total 402 kB/s | 83 kB 00:00 2024-09-17T00:50:35.256 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:50:35.261 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:50:35.261 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:50:35.263 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:50:35.264 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:50:35.330 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:50:35.484 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1635.g4a704134. 1/1 2024-09-17T00:50:35.484 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:35.484 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:50:35.484 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:35.485 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:35.485 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:50:35.706 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr 2024-09-17T00:50:35.739 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T00:50:35.837 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T00:50:36.172 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T00:50:36.293 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:50:36.388 INFO:teuthology.orchestra.run.smithi099.stdout:Package ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:50:36.390 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/1 2024-09-17T00:50:36.391 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:36.391 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:50:36.391 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:50:36.391 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:36.391 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:50:36.431 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:50:36.432 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-17T00:50:36.432 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:50:36.503 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T00:50:36.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T00:50:37.070 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:50:37.197 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:50:37.199 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:50:37.200 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-17T00:50:37.200 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:37.200 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:50:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 3.4 M 2024-09-17T00:50:37.200 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-17T00:50:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 24 k 2024-09-17T00:50:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 15 k 2024-09-17T00:50:37.200 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-17T00:50:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T00:50:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T00:50:37.201 INFO:teuthology.orchestra.run.smithi099.stdout:Installing weak dependencies: 2024-09-17T00:50:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-17T00:50:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:37.201 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:50:37.201 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:37.201 INFO:teuthology.orchestra.run.smithi099.stdout:Install 7 Packages 2024-09-17T00:50:37.201 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:37.202 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 3.7 M 2024-09-17T00:50:37.202 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 80 M 2024-09-17T00:50:37.202 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:50:37.334 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:50:37.335 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:37.335 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-09-17T00:50:37.335 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:37.336 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:50:37.336 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1635.g4a704134.el9 ceph 137 k 2024-09-17T00:50:37.336 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:37.336 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:50:37.336 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:37.336 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-17T00:50:37.336 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:37.336 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 137 k 2024-09-17T00:50:37.336 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 379 k 2024-09-17T00:50:37.336 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:50:37.407 INFO:teuthology.orchestra.run.smithi099.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1635.g4a7 167 kB/s | 24 kB 00:00 2024-09-17T00:50:37.432 INFO:teuthology.orchestra.run.smithi099.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1635.g4a70 85 kB/s | 15 kB 00:00 2024-09-17T00:50:37.465 INFO:teuthology.orchestra.run.smithi099.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 155 kB/s | 9.0 kB 00:00 2024-09-17T00:50:37.483 INFO:teuthology.orchestra.run.smithi099.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 2.0 MB/s | 31 kB 00:00 2024-09-17T00:50:37.499 INFO:teuthology.orchestra.run.smithi099.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 609 kB/s | 41 kB 00:00 2024-09-17T00:50:37.533 INFO:teuthology.orchestra.run.smithi099.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-17T00:50:37.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-immutable-object-cache-17.2.7-1635.g4a7041 660 kB/s | 137 kB 00:00 2024-09-17T00:50:37.545 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:37.545 INFO:teuthology.orchestra.run.smithi002.stdout:Total 656 kB/s | 137 kB 00:00 2024-09-17T00:50:37.545 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:50:37.554 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:50:37.554 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:50:37.614 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:50:37.615 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:50:37.666 INFO:teuthology.orchestra.run.smithi099.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1635.g4a704134 8.3 MB/s | 3.4 MB 00:00 2024-09-17T00:50:37.670 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:37.670 INFO:teuthology.orchestra.run.smithi099.stdout:Total 7.8 MB/s | 3.7 MB 00:00 2024-09-17T00:50:37.670 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:50:37.678 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:50:37.678 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:50:37.764 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:50:37.771 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:50:37.771 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:50:37.837 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1635.g4a704134. 1/1 2024-09-17T00:50:37.864 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1635.g4a704134. 1/1 2024-09-17T00:50:37.864 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:50:37.864 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T00:50:37.864 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:38.083 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:50:38.152 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-17T00:50:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-17T00:50:38.231 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-17T00:50:38.263 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-17T00:50:38.292 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1635.g4a704134.el9.n 5/7 2024-09-17T00:50:38.799 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1635.g4a704134. 1/1 2024-09-17T00:50:38.799 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:38.799 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:50:38.799 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:50:38.799 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:38.799 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:50:39.016 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr 2024-09-17T00:50:39.281 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1635.g4a704134.el9. 6/7 2024-09-17T00:50:39.320 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarc 7/7 2024-09-17T00:50:39.623 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:50:39.716 INFO:teuthology.orchestra.run.smithi002.stdout:Package ceph-mgr-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:50:39.762 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-17T00:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:50:39.835 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T00:50:40.460 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarc 7/7 2024-09-17T00:50:40.460 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1635.g4a704134.el9. 1/7 2024-09-17T00:50:40.460 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarc 2/7 2024-09-17T00:50:40.460 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1635.g4a704134.el9.n 3/7 2024-09-17T00:50:40.460 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-17T00:50:40.461 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-17T00:50:40.461 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-17T00:50:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:50:40.606 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-17T00:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 3.4 M 2024-09-17T00:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-17T00:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 24 k 2024-09-17T00:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 15 k 2024-09-17T00:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-17T00:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T00:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T00:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-09-17T00:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-17T00:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:Install 7 Packages 2024-09-17T00:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 3.7 M 2024-09-17T00:50:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 80 M 2024-09-17T00:50:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:50:40.746 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-17T00:50:40.747 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:40.747 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:50:40.747 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:50:40.747 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:50:40.747 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:50:40.747 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-17T00:50:40.747 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-17T00:50:40.747 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T00:50:40.747 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T00:50:40.747 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:40.747 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:50:40.822 INFO:teuthology.orchestra.run.smithi002.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1635.g4a7 159 kB/s | 24 kB 00:00 2024-09-17T00:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1635.g4a70 81 kB/s | 15 kB 00:00 2024-09-17T00:50:40.890 INFO:teuthology.orchestra.run.smithi002.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-17T00:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-17T00:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 443 kB/s | 41 kB 00:00 2024-09-17T00:50:40.960 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T00:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-17T00:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1635.g4a704134 8.3 MB/s | 3.4 MB 00:00 2024-09-17T00:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:Total 7.8 MB/s | 3.7 MB 00:00 2024-09-17T00:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:50:41.086 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:50:41.086 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:50:41.182 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:50:41.182 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:50:41.498 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:50:41.533 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:01 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-17T00:50:41.594 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-17T00:50:41.649 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-17T00:50:41.666 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:50:41.668 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================= 2024-09-17T00:50:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-17T00:50:41.668 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================= 2024-09-17T00:50:41.668 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:50:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 7.4 M 2024-09-17T00:50:41.668 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-17T00:50:41.668 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T00:50:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T00:50:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T00:50:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T00:50:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T00:50:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T00:50:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T00:50:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T00:50:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T00:50:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T00:50:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T00:50:41.669 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:41.669 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:50:41.670 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================= 2024-09-17T00:50:41.670 INFO:teuthology.orchestra.run.smithi099.stdout:Install 12 Packages 2024-09-17T00:50:41.670 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:41.670 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 38 M 2024-09-17T00:50:41.671 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 212 M 2024-09-17T00:50:41.671 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:50:41.688 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-17T00:50:41.734 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1635.g4a704134.el9.n 5/7 2024-09-17T00:50:41.915 INFO:teuthology.orchestra.run.smithi099.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-17T00:50:41.949 INFO:teuthology.orchestra.run.smithi099.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-17T00:50:42.032 INFO:teuthology.orchestra.run.smithi099.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-17T00:50:42.083 INFO:teuthology.orchestra.run.smithi099.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-09-17T00:50:42.183 INFO:teuthology.orchestra.run.smithi099.stdout:(5/12): ceph-mgr-diskprediction-local-17.2.7-16 17 MB/s | 7.4 MB 00:00 2024-09-17T00:50:42.208 INFO:teuthology.orchestra.run.smithi099.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 307 kB/s | 38 kB 00:00 2024-09-17T00:50:42.333 INFO:teuthology.orchestra.run.smithi099.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-17T00:50:42.392 INFO:teuthology.orchestra.run.smithi099.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.8 MB/s | 3.0 MB 00:00 2024-09-17T00:50:42.450 INFO:teuthology.orchestra.run.smithi099.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-09-17T00:50:42.668 INFO:teuthology.orchestra.run.smithi099.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-09-17T00:50:42.768 INFO:teuthology.orchestra.run.smithi099.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 8.5 MB/s | 4.9 MB 00:00 2024-09-17T00:50:42.791 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1635.g4a704134.el9. 6/7 2024-09-17T00:50:42.829 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarc 7/7 2024-09-17T00:50:43.160 INFO:teuthology.orchestra.run.smithi099.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-17T00:50:43.160 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:43.161 INFO:teuthology.orchestra.run.smithi099.stdout:Total 26 MB/s | 38 MB 00:01 2024-09-17T00:50:43.512 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:50:43.538 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:50:43.538 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarc 7/7 2024-09-17T00:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1635.g4a704134.el9. 1/7 2024-09-17T00:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarc 2/7 2024-09-17T00:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1635.g4a704134.el9.n 3/7 2024-09-17T00:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-17T00:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-17T00:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-17T00:50:44.052 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:50:44.053 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:50:44.176 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-17T00:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-17T00:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-17T00:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T00:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T00:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:44.178 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:50:44.373 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T00:50:44.805 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:50:44.892 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T00:50:44.933 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T00:50:44.975 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:01 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:50:45.031 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T00:50:45.067 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T00:50:45.114 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-09-17T00:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-17T00:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-09-17T00:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 7.4 M 2024-09-17T00:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-17T00:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T00:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T00:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T00:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T00:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T00:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T00:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T00:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T00:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T00:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T00:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T00:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-09-17T00:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:Install 12 Packages 2024-09-17T00:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 38 M 2024-09-17T00:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 212 M 2024-09-17T00:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:50:45.250 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T00:50:45.291 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T00:50:45.367 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T00:50:45.540 INFO:teuthology.orchestra.run.smithi002.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-17T00:50:45.582 INFO:teuthology.orchestra.run.smithi002.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-17T00:50:45.609 INFO:teuthology.orchestra.run.smithi002.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 474 kB/s | 33 kB 00:00 2024-09-17T00:50:45.651 INFO:teuthology.orchestra.run.smithi002.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 439 kB/s | 18 kB 00:00 2024-09-17T00:50:45.693 INFO:teuthology.orchestra.run.smithi002.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 926 kB/s | 38 kB 00:00 2024-09-17T00:50:45.818 INFO:teuthology.orchestra.run.smithi002.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2024-09-17T00:50:45.911 INFO:teuthology.orchestra.run.smithi002.stdout:(7/12): ceph-mgr-diskprediction-local-17.2.7-16 14 MB/s | 7.4 MB 00:00 2024-09-17T00:50:45.936 INFO:teuthology.orchestra.run.smithi002.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-17T00:50:45.986 INFO:teuthology.orchestra.run.smithi002.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.9 MB/s | 250 kB 00:00 2024-09-17T00:50:46.025 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T00:50:46.120 INFO:teuthology.orchestra.run.smithi002.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 12 MB/s | 4.9 MB 00:00 2024-09-17T00:50:46.153 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T00:50:46.386 INFO:teuthology.orchestra.run.smithi002.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-09-17T00:50:46.595 INFO:teuthology.orchestra.run.smithi002.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.5 MB/s | 5.1 MB 00:00 2024-09-17T00:50:46.596 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:46.596 INFO:teuthology.orchestra.run.smithi002.stdout:Total 26 MB/s | 38 MB 00:01 2024-09-17T00:50:46.961 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:50:46.988 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:50:46.988 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:50:47.392 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T00:50:47.511 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:50:47.511 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:50:48.302 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:50:48.387 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T00:50:48.416 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T00:50:48.431 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T00:50:48.448 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704 12/12 2024-09-17T00:50:48.540 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T00:50:48.587 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T00:50:48.780 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T00:50:48.810 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T00:50:48.898 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T00:50:49.602 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T00:50:49.719 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T00:50:51.051 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T00:50:51.119 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704 12/12 2024-09-17T00:50:51.119 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704 1/12 2024-09-17T00:50:51.119 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T00:50:51.119 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T00:50:51.119 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T00:50:51.120 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T00:50:51.120 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T00:50:51.120 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T00:50:51.120 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T00:50:51.120 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T00:50:51.120 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T00:50:51.120 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T00:50:51.494 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T00:50:51.494 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:51.494 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:50:51.494 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:50:51.494 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T00:50:51.495 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T00:50:51.495 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T00:50:51.495 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T00:50:51.495 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T00:50:51.495 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T00:50:51.495 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T00:50:51.495 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T00:50:51.495 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T00:50:51.495 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T00:50:51.495 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T00:50:51.495 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:51.495 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:50:51.897 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-rook 2024-09-17T00:50:52.131 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T00:50:52.159 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704 12/12 2024-09-17T00:50:52.492 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:12 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:50:52.631 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:50:52.632 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:52.632 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-17T00:50:52.633 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:52.633 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:50:52.633 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 47 k 2024-09-17T00:50:52.633 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-17T00:50:52.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T00:50:52.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T00:50:52.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T00:50:52.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T00:50:52.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T00:50:52.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T00:50:52.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T00:50:52.633 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T00:50:52.634 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T00:50:52.634 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T00:50:52.634 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T00:50:52.634 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T00:50:52.634 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:52.634 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:50:52.634 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:52.634 INFO:teuthology.orchestra.run.smithi099.stdout:Install 13 Packages 2024-09-17T00:50:52.634 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:52.635 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 2.2 M 2024-09-17T00:50:52.635 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 26 M 2024-09-17T00:50:52.635 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:50:53.181 INFO:teuthology.orchestra.run.smithi099.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 340 kB/s | 26 kB 00:00 2024-09-17T00:50:53.206 INFO:teuthology.orchestra.run.smithi099.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 191 kB/s | 19 kB 00:00 2024-09-17T00:50:53.273 INFO:teuthology.orchestra.run.smithi099.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-17T00:50:53.301 INFO:teuthology.orchestra.run.smithi099.stdout:(4/13): ceph-mgr-rook-17.2.7-1635.g4a704134.el9 246 kB/s | 47 kB 00:00 2024-09-17T00:50:53.324 INFO:teuthology.orchestra.run.smithi099.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-09-17T00:50:53.357 INFO:teuthology.orchestra.run.smithi099.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.3 MB/s | 279 kB 00:00 2024-09-17T00:50:53.408 INFO:teuthology.orchestra.run.smithi099.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 493 kB/s | 54 kB 00:00 2024-09-17T00:50:53.433 INFO:teuthology.orchestra.run.smithi099.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 296 kB/s | 32 kB 00:00 2024-09-17T00:50:53.466 INFO:teuthology.orchestra.run.smithi099.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 130 kB/s | 14 kB 00:00 2024-09-17T00:50:53.500 INFO:teuthology.orchestra.run.smithi099.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.9 MB/s | 59 kB 00:00 2024-09-17T00:50:53.534 INFO:teuthology.orchestra.run.smithi099.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-17T00:50:53.576 INFO:teuthology.orchestra.run.smithi099.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.3 MB/s | 220 kB 00:00 2024-09-17T00:50:53.609 INFO:teuthology.orchestra.run.smithi099.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.2 MB/s | 1.0 MB 00:00 2024-09-17T00:50:53.612 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:53.612 INFO:teuthology.orchestra.run.smithi099.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-09-17T00:50:53.675 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:50:53.690 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:50:53.690 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:50:53.780 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:50:53.780 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:50:54.319 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:50:54.496 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T00:50:54.560 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T00:50:54.623 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T00:50:54.653 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T00:50:54.694 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T00:50:54.795 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T00:50:54.862 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704 12/12 2024-09-17T00:50:54.862 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704 1/12 2024-09-17T00:50:54.862 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T00:50:54.862 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T00:50:54.862 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T00:50:54.862 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T00:50:54.862 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T00:50:54.862 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T00:50:54.862 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T00:50:54.863 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T00:50:54.863 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T00:50:54.863 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T00:50:54.896 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T00:50:54.954 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T00:50:55.289 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T00:50:55.290 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:55.290 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:50:55.290 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:50:55.290 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T00:50:55.290 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T00:50:55.290 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T00:50:55.290 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T00:50:55.290 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T00:50:55.290 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T00:50:55.290 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T00:50:55.290 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T00:50:55.290 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T00:50:55.291 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T00:50:55.291 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T00:50:55.291 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:55.291 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:50:55.660 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T00:50:55.718 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T00:50:55.761 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-rook 2024-09-17T00:50:55.761 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T00:50:55.806 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T00:50:55.831 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 13/13 2024-09-17T00:50:56.369 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:13 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:50:56.506 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:50:56.507 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:56.507 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-17T00:50:56.507 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:56.507 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:50:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 47 k 2024-09-17T00:50:56.508 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-17T00:50:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T00:50:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T00:50:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T00:50:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T00:50:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T00:50:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T00:50:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T00:50:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T00:50:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T00:50:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T00:50:56.508 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T00:50:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T00:50:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:56.509 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:50:56.509 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:50:56.509 INFO:teuthology.orchestra.run.smithi002.stdout:Install 13 Packages 2024-09-17T00:50:56.509 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:50:56.509 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 2.2 M 2024-09-17T00:50:56.510 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 26 M 2024-09-17T00:50:56.510 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:50:56.592 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 13/13 2024-09-17T00:50:56.592 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 1/13 2024-09-17T00:50:56.592 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T00:50:56.593 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T00:50:56.593 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T00:50:56.593 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T00:50:56.593 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T00:50:56.593 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T00:50:56.593 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T00:50:56.593 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T00:50:56.593 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T00:50:56.593 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T00:50:56.593 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T00:50:56.909 INFO:teuthology.orchestra.run.smithi002.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 328 kB/s | 26 kB 00:00 2024-09-17T00:50:56.934 INFO:teuthology.orchestra.run.smithi002.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 185 kB/s | 19 kB 00:00 2024-09-17T00:50:56.935 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T00:50:56.935 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:56.935 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:50:56.935 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:50:56.935 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T00:50:56.935 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T00:50:56.936 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T00:50:56.936 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T00:50:56.936 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T00:50:56.936 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T00:50:56.936 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T00:50:56.936 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T00:50:56.936 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T00:50:56.936 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T00:50:56.936 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T00:50:56.936 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T00:50:56.936 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:56.936 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:50:57.009 INFO:teuthology.orchestra.run.smithi002.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-09-17T00:50:57.035 INFO:teuthology.orchestra.run.smithi002.stdout:(4/13): ceph-mgr-rook-17.2.7-1635.g4a704134.el9 232 kB/s | 47 kB 00:00 2024-09-17T00:50:57.059 INFO:teuthology.orchestra.run.smithi002.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-17T00:50:57.093 INFO:teuthology.orchestra.run.smithi002.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.3 MB/s | 279 kB 00:00 2024-09-17T00:50:57.135 INFO:teuthology.orchestra.run.smithi002.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 535 kB/s | 54 kB 00:00 2024-09-17T00:50:57.160 INFO:teuthology.orchestra.run.smithi002.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-17T00:50:57.190 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T00:50:57.194 INFO:teuthology.orchestra.run.smithi002.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 152 kB/s | 14 kB 00:00 2024-09-17T00:50:57.227 INFO:teuthology.orchestra.run.smithi002.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2024-09-17T00:50:57.261 INFO:teuthology.orchestra.run.smithi002.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-17T00:50:57.294 INFO:teuthology.orchestra.run.smithi002.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.4 MB/s | 220 kB 00:00 2024-09-17T00:50:57.328 INFO:teuthology.orchestra.run.smithi002.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.4 MB/s | 1.0 MB 00:00 2024-09-17T00:50:57.331 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:57.331 INFO:teuthology.orchestra.run.smithi002.stdout:Total 2.7 MB/s | 2.2 MB 00:00 2024-09-17T00:50:57.400 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:50:57.417 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:50:57.417 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:50:57.517 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:50:57.518 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:50:57.773 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:17 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:50:57.906 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:50:57.907 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:57.907 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-17T00:50:57.907 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:57.907 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:50:57.907 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 124 k 2024-09-17T00:50:57.907 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-17T00:50:57.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T00:50:57.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T00:50:57.907 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T00:50:57.908 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T00:50:57.908 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T00:50:57.908 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:57.908 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:50:57.908 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:50:57.908 INFO:teuthology.orchestra.run.smithi099.stdout:Install 6 Packages 2024-09-17T00:50:57.908 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:50:57.909 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 7.0 M 2024-09-17T00:50:57.909 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 33 M 2024-09-17T00:50:57.909 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:50:58.036 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:50:58.217 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T00:50:58.282 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T00:50:58.345 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T00:50:58.381 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T00:50:58.423 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T00:50:58.529 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T00:50:58.577 INFO:teuthology.orchestra.run.smithi099.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1635.g4a704134.e 560 kB/s | 124 kB 00:00 2024-09-17T00:50:58.636 INFO:teuthology.orchestra.run.smithi099.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-17T00:50:58.640 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T00:50:58.661 INFO:teuthology.orchestra.run.smithi099.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-17T00:50:58.687 INFO:teuthology.orchestra.run.smithi099.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-17T00:50:58.692 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T00:50:58.912 INFO:teuthology.orchestra.run.smithi099.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 446 kB/s | 248 kB 00:00 2024-09-17T00:50:59.387 INFO:teuthology.orchestra.run.smithi099.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.8 MB/s | 6.0 MB 00:01 2024-09-17T00:50:59.389 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:50:59.389 INFO:teuthology.orchestra.run.smithi099.stdout:Total 4.7 MB/s | 7.0 MB 00:01 2024-09-17T00:50:59.452 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T00:50:59.461 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:50:59.473 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:50:59.473 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:50:59.505 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T00:50:59.538 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T00:50:59.572 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:50:59.574 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:50:59.585 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T00:50:59.607 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 13/13 2024-09-17T00:50:59.877 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:51:00.034 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T00:51:00.088 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T00:51:00.474 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 13/13 2024-09-17T00:51:00.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 1/13 2024-09-17T00:51:00.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T00:51:00.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T00:51:00.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T00:51:00.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T00:51:00.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T00:51:00.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T00:51:00.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T00:51:00.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T00:51:00.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T00:51:00.474 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T00:51:00.475 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T00:51:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T00:51:00.705 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T00:51:00.762 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T00:51:00.792 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 6/6 2024-09-17T00:51:00.940 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T00:51:00.940 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:00.940 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:51:00.940 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:51:00.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T00:51:00.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T00:51:00.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T00:51:00.940 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T00:51:00.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T00:51:00.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T00:51:00.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T00:51:00.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T00:51:00.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T00:51:00.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T00:51:00.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T00:51:00.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T00:51:00.941 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:00.941 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:01.210 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T00:51:01.581 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 6/6 2024-09-17T00:51:01.582 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/6 2024-09-17T00:51:01.582 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T00:51:01.582 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T00:51:01.582 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T00:51:01.582 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T00:51:01.821 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:18 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:51:01.867 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T00:51:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:01.868 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:51:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:51:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T00:51:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T00:51:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T00:51:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T00:51:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T00:51:01.868 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:01.868 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:51:01.960 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:51:01.961 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-17T00:51:01.961 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:01.961 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:51:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1635.g4a704134.el9 ceph-noarch 124 k 2024-09-17T00:51:01.961 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-17T00:51:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T00:51:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T00:51:01.961 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T00:51:01.962 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T00:51:01.962 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T00:51:01.962 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:01.962 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:51:01.962 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:01.962 INFO:teuthology.orchestra.run.smithi002.stdout:Install 6 Packages 2024-09-17T00:51:01.962 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:01.963 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 7.0 M 2024-09-17T00:51:01.963 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 33 M 2024-09-17T00:51:01.963 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:51:02.127 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-fuse 2024-09-17T00:51:02.598 INFO:teuthology.orchestra.run.smithi002.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-17T00:51:02.623 INFO:teuthology.orchestra.run.smithi002.stdout:(2/6): ceph-mgr-cephadm-17.2.7-1635.g4a704134.e 518 kB/s | 124 kB 00:00 2024-09-17T00:51:02.682 INFO:teuthology.orchestra.run.smithi002.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 990 kB/s | 58 kB 00:00 2024-09-17T00:51:02.701 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:22 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:51:02.716 INFO:teuthology.orchestra.run.smithi002.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.6 MB/s | 548 kB 00:00 2024-09-17T00:51:02.740 INFO:teuthology.orchestra.run.smithi002.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-17T00:51:02.832 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:51:02.832 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-17T00:51:02.833 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:02.833 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:51:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:17.2.7-1635.g4a704134.el9 ceph 813 k 2024-09-17T00:51:02.833 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-17T00:51:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T00:51:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:02.833 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:51:02.833 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:02.833 INFO:teuthology.orchestra.run.smithi099.stdout:Install 2 Packages 2024-09-17T00:51:02.833 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:02.834 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 893 k 2024-09-17T00:51:02.834 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 2.6 M 2024-09-17T00:51:02.834 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:51:02.916 INFO:teuthology.orchestra.run.smithi002.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-09-17T00:51:02.918 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:51:02.918 INFO:teuthology.orchestra.run.smithi002.stdout:Total 7.3 MB/s | 7.0 MB 00:00 2024-09-17T00:51:02.992 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:51:03.004 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:51:03.005 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:51:03.110 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:51:03.112 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:51:03.388 INFO:teuthology.orchestra.run.smithi099.stdout:(1/2): ceph-fuse-17.2.7-1635.g4a704134.el9.x86_ 2.9 MB/s | 813 kB 00:00 2024-09-17T00:51:03.421 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:51:03.580 INFO:teuthology.orchestra.run.smithi099.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 170 kB/s | 80 kB 00:00 2024-09-17T00:51:03.580 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:51:03.581 INFO:teuthology.orchestra.run.smithi099.stdout:Total 1.2 MB/s | 893 kB 00:00 2024-09-17T00:51:03.593 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:51:03.605 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T00:51:03.615 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:51:03.615 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:51:03.677 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T00:51:03.693 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:51:03.694 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:51:03.886 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:51:04.024 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T00:51:04.112 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 2/2 2024-09-17T00:51:04.230 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T00:51:04.324 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T00:51:04.395 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T00:51:04.421 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 6/6 2024-09-17T00:51:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 2/2 2024-09-17T00:51:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/2 2024-09-17T00:51:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T00:51:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:05.047 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:51:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T00:51:05.047 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:05.047 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:51:05.205 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 6/6 2024-09-17T00:51:05.205 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 1/6 2024-09-17T00:51:05.206 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T00:51:05.206 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T00:51:05.206 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T00:51:05.206 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T00:51:05.349 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librados-devel 2024-09-17T00:51:05.497 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T00:51:05.537 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:05.537 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:51:05.537 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:17.2.7-1635.g4a704134.el9.noarch 2024-09-17T00:51:05.537 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T00:51:05.537 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T00:51:05.537 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T00:51:05.537 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T00:51:05.538 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T00:51:05.538 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:05.538 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:05.751 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-fuse 2024-09-17T00:51:05.948 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:25 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:51:06.084 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:51:06.085 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:06.085 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-09-17T00:51:06.085 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:06.085 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:51:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:17.2.7-1635.g4a704134.el9 ceph 126 k 2024-09-17T00:51:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:06.086 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:51:06.086 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:06.086 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-17T00:51:06.086 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:06.086 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 126 k 2024-09-17T00:51:06.086 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 448 k 2024-09-17T00:51:06.086 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:51:06.284 INFO:teuthology.orchestra.run.smithi099.stdout:librados-devel-17.2.7-1635.g4a704134.el9.x86_64 640 kB/s | 126 kB 00:00 2024-09-17T00:51:06.285 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:51:06.285 INFO:teuthology.orchestra.run.smithi099.stdout:Total 634 kB/s | 126 kB 00:00 2024-09-17T00:51:06.285 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:51:06.290 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:51:06.290 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:51:06.354 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:51:06.355 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:51:06.360 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:23 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:51:06.499 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:51:06.500 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:06.500 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-17T00:51:06.501 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:06.501 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:51:06.501 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:17.2.7-1635.g4a704134.el9 ceph 813 k 2024-09-17T00:51:06.501 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-17T00:51:06.501 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T00:51:06.502 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:06.502 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:51:06.502 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:06.502 INFO:teuthology.orchestra.run.smithi002.stdout:Install 2 Packages 2024-09-17T00:51:06.502 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:06.503 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 893 k 2024-09-17T00:51:06.503 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 2.6 M 2024-09-17T00:51:06.503 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:51:06.505 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:51:06.607 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:06.826 INFO:teuthology.orchestra.run.smithi002.stdout:(1/2): ceph-fuse-17.2.7-1635.g4a704134.el9.x86_ 2.6 MB/s | 813 kB 00:00 2024-09-17T00:51:07.060 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:07.167 INFO:teuthology.orchestra.run.smithi002.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 124 kB/s | 80 kB 00:00 2024-09-17T00:51:07.168 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:51:07.169 INFO:teuthology.orchestra.run.smithi002.stdout:Total 1.3 MB/s | 893 kB 00:00 2024-09-17T00:51:07.182 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:51:07.207 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:51:07.207 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:51:07.294 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:51:07.295 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:51:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:07.315 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:51:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:51:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:07.315 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:51:07.489 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:51:07.595 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install libcephfs2 2024-09-17T00:51:07.625 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T00:51:07.694 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 2/2 2024-09-17T00:51:08.181 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:28 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:51:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:Package libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:51:08.314 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:51:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-17T00:51:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:51:08.397 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install libcephfs-devel 2024-09-17T00:51:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 2/2 2024-09-17T00:51:08.399 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/2 2024-09-17T00:51:08.680 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T00:51:08.681 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:08.681 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:51:08.681 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T00:51:08.681 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:08.681 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:08.962 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librados-devel 2024-09-17T00:51:08.975 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:28 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:51:09.107 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:51:09.108 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:09.108 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-09-17T00:51:09.108 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:09.108 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:51:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:17.2.7-1635.g4a704134.el9 ceph 25 k 2024-09-17T00:51:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:09.109 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:51:09.109 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:09.109 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-17T00:51:09.109 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:09.109 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 25 k 2024-09-17T00:51:09.109 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 110 k 2024-09-17T00:51:09.109 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:51:09.256 INFO:teuthology.orchestra.run.smithi099.stdout:libcephfs-devel-17.2.7-1635.g4a704134.el9.x86_6 172 kB/s | 25 kB 00:00 2024-09-17T00:51:09.256 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:51:09.257 INFO:teuthology.orchestra.run.smithi099.stdout:Total 170 kB/s | 25 kB 00:00 2024-09-17T00:51:09.257 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:51:09.258 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:51:09.258 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:51:09.260 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:51:09.260 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:51:09.348 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:51:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:09.570 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:26 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:51:09.710 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:51:09.711 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-09-17T00:51:09.711 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:09.711 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:51:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:17.2.7-1635.g4a704134.el9 ceph 126 k 2024-09-17T00:51:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:09.711 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:51:09.711 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:09.711 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-17T00:51:09.711 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:09.711 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 126 k 2024-09-17T00:51:09.711 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 448 k 2024-09-17T00:51:09.712 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:51:09.838 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:09.930 INFO:teuthology.orchestra.run.smithi002.stdout:librados-devel-17.2.7-1635.g4a704134.el9.x86_64 579 kB/s | 126 kB 00:00 2024-09-17T00:51:09.930 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:51:09.931 INFO:teuthology.orchestra.run.smithi002.stdout:Total 575 kB/s | 126 kB 00:00 2024-09-17T00:51:09.931 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:51:09.937 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:51:09.937 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:51:10.003 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:51:10.003 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:51:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:10.072 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:51:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:51:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:10.073 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:51:10.160 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:51:10.259 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librados2 2024-09-17T00:51:10.271 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:10.741 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:10.842 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:30 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:51:10.929 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:51:10.972 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:51:10.972 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-17T00:51:10.973 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:51:11.003 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:11.003 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:11.003 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:51:11.003 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:51:11.003 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:11.003 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:11.036 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librbd1 2024-09-17T00:51:11.210 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install libcephfs2 2024-09-17T00:51:11.617 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:31 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:51:11.706 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:51:11.748 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:51:11.748 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-17T00:51:11.749 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:51:11.820 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rados 2024-09-17T00:51:11.823 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:28 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:51:11.920 INFO:teuthology.orchestra.run.smithi002.stdout:Package libcephfs2-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:51:11.966 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:51:11.967 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-17T00:51:11.967 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:12.041 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install libcephfs-devel 2024-09-17T00:51:12.405 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:51:12.494 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:51:12.536 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:51:12.537 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-17T00:51:12.537 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:51:12.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rgw 2024-09-17T00:51:12.649 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:29 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:51:12.787 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:51:12.788 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-09-17T00:51:12.788 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:12.788 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:51:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:17.2.7-1635.g4a704134.el9 ceph 25 k 2024-09-17T00:51:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:12.788 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:51:12.788 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:12.789 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-17T00:51:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:12.789 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 25 k 2024-09-17T00:51:12.789 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 110 k 2024-09-17T00:51:12.789 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:51:12.941 INFO:teuthology.orchestra.run.smithi002.stdout:libcephfs-devel-17.2.7-1635.g4a704134.el9.x86_6 164 kB/s | 25 kB 00:00 2024-09-17T00:51:12.942 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:51:12.942 INFO:teuthology.orchestra.run.smithi002.stdout:Total 162 kB/s | 25 kB 00:00 2024-09-17T00:51:12.942 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:51:12.946 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:51:12.946 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:51:12.947 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:51:12.948 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:51:13.027 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:51:13.141 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:13.191 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:33 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:51:13.281 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:51:13.323 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:51:13.324 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-17T00:51:13.324 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:51:13.387 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-cephfs 2024-09-17T00:51:13.506 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:13.735 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:51:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:51:13.735 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:13.735 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:13.916 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librados2 2024-09-17T00:51:13.962 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:33 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:51:14.051 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:51:14.094 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:51:14.095 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-17T00:51:14.096 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:51:14.168 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rbd 2024-09-17T00:51:14.526 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:31 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:51:14.621 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:51:14.667 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:51:14.667 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-17T00:51:14.667 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:14.739 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librbd1 2024-09-17T00:51:14.743 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:51:14.831 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:51:14.874 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:51:14.875 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-17T00:51:14.875 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:51:14.936 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-fuse 2024-09-17T00:51:15.354 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:51:15.448 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:51:15.494 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:51:15.495 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-17T00:51:15.495 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:15.515 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:51:15.564 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rados 2024-09-17T00:51:15.644 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:51:15.644 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:15.645 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-09-17T00:51:15.645 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:15.645 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:51:15.645 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:17.2.7-1635.g4a704134.el9 ceph 82 k 2024-09-17T00:51:15.645 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:15.645 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:51:15.645 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:15.645 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-17T00:51:15.645 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:15.645 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 82 k 2024-09-17T00:51:15.645 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 222 k 2024-09-17T00:51:15.645 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:51:15.856 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-fuse-17.2.7-1635.g4a704134.el9.x86_64.rpm 389 kB/s | 82 kB 00:00 2024-09-17T00:51:15.857 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:51:15.857 INFO:teuthology.orchestra.run.smithi099.stdout:Total 386 kB/s | 82 kB 00:00 2024-09-17T00:51:15.857 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:51:15.864 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:51:15.864 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:51:15.927 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:51:15.927 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:51:16.079 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:51:16.172 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:33 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:51:16.179 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:16.265 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rados-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:51:16.310 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:51:16.311 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-17T00:51:16.311 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:16.385 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rgw 2024-09-17T00:51:16.527 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:16.745 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:16.746 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:16.746 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:51:16.746 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:51:16.746 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:16.746 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:51:16.974 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-mirror 2024-09-17T00:51:16.991 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:33 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:51:17.085 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rgw-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:51:17.130 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:51:17.131 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-17T00:51:17.132 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:17.214 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-cephfs 2024-09-17T00:51:17.571 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:37 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:51:17.706 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:51:17.707 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-09-17T00:51:17.707 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:17.707 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:51:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:17.2.7-1635.g4a704134.el9 ceph 2.9 M 2024-09-17T00:51:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:17.707 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:51:17.707 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:17.707 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-17T00:51:17.707 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:17.708 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 2.9 M 2024-09-17T00:51:17.708 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 12 M 2024-09-17T00:51:17.708 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:51:17.819 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:51:17.911 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-cephfs-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:51:17.957 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:51:17.957 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-17T00:51:17.958 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:18.035 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rbd 2024-09-17T00:51:18.060 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-mirror-17.2.7-1635.g4a704134.el9.x86_64.rpm 8.3 MB/s | 2.9 MB 00:00 2024-09-17T00:51:18.061 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:51:18.061 INFO:teuthology.orchestra.run.smithi099.stdout:Total 8.3 MB/s | 2.9 MB 00:00 2024-09-17T00:51:18.061 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:51:18.070 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:51:18.070 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:51:18.150 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:51:18.150 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:51:18.571 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:51:18.635 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:18.639 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:51:18.660 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:18.660 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:51:18.660 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T00:51:18.660 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T00:51:18.660 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T00:51:18.660 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:18.732 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rbd-2:17.2.7-1635.g4a704134.el9.x86_64 is already installed. 2024-09-17T00:51:18.777 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:51:18.778 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-17T00:51:18.778 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:18.860 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-fuse 2024-09-17T00:51:19.465 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:51:19.604 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:51:19.604 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:19.605 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-17T00:51:19.605 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:19.605 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:51:19.605 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:17.2.7-1635.g4a704134.el9 ceph 82 k 2024-09-17T00:51:19.605 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:19.605 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:51:19.605 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:19.605 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-17T00:51:19.605 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:19.605 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 82 k 2024-09-17T00:51:19.606 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 222 k 2024-09-17T00:51:19.606 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:51:19.746 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:19.746 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:19.746 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:51:19.746 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:51:19.746 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:19.746 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:51:19.803 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-fuse-17.2.7-1635.g4a704134.el9.x86_64.rpm 415 kB/s | 82 kB 00:00 2024-09-17T00:51:19.804 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:51:19.804 INFO:teuthology.orchestra.run.smithi002.stdout:Total 412 kB/s | 82 kB 00:00 2024-09-17T00:51:19.804 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:51:19.811 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:51:19.812 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:51:19.877 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:51:19.878 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:51:20.046 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:51:20.050 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-nbd 2024-09-17T00:51:20.153 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:20.514 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:20.647 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:40 ago on Tue 17 Sep 2024 12:49:40 AM UTC. 2024-09-17T00:51:20.780 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-17T00:51:20.781 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:20.781 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-09-17T00:51:20.781 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:20.781 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-17T00:51:20.781 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:17.2.7-1635.g4a704134.el9 ceph 165 k 2024-09-17T00:51:20.781 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:20.782 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-17T00:51:20.782 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-17T00:51:20.782 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-17T00:51:20.782 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:20.782 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 165 k 2024-09-17T00:51:20.782 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 477 k 2024-09-17T00:51:20.782 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-17T00:51:20.785 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:20.785 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:20.785 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:51:20.785 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:51:20.785 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:20.785 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:21.013 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-nbd-17.2.7-1635.g4a704134.el9.x86_64.rpm 717 kB/s | 165 kB 00:00 2024-09-17T00:51:21.013 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:51:21.014 INFO:teuthology.orchestra.run.smithi099.stdout:Total 712 kB/s | 165 kB 00:00 2024-09-17T00:51:21.014 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-17T00:51:21.021 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-17T00:51:21.021 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-17T00:51:21.028 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-mirror 2024-09-17T00:51:21.085 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-17T00:51:21.085 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-17T00:51:21.237 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-17T00:51:21.343 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:21.640 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:38 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:51:21.761 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:21.781 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:51:21.782 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:21.782 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2024-09-17T00:51:21.782 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:21.782 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:51:21.782 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:17.2.7-1635.g4a704134.el9 ceph 2.9 M 2024-09-17T00:51:21.782 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:21.782 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:51:21.782 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:21.782 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-17T00:51:21.782 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:21.782 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 2.9 M 2024-09-17T00:51:21.782 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 12 M 2024-09-17T00:51:21.783 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:51:22.005 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:22.005 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:22.005 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-17T00:51:22.005 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:51:22.005 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:51:22.005 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-17T00:51:22.114 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-mirror-17.2.7-1635.g4a704134.el9.x86_64.rpm 8.9 MB/s | 2.9 MB 00:00 2024-09-17T00:51:22.115 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:51:22.115 INFO:teuthology.orchestra.run.smithi002.stdout:Total 8.8 MB/s | 2.9 MB 00:00 2024-09-17T00:51:22.115 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:51:22.125 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:51:22.125 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:51:22.211 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:51:22.211 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:51:22.276 DEBUG:teuthology.parallel:result is None 2024-09-17T00:51:22.646 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:51:22.723 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:22.750 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:22.750 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T00:51:22.750 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T00:51:22.750 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T00:51:22.750 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T00:51:22.751 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:23.910 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:23.910 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:23.910 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:51:23.911 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:51:23.911 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:23.911 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:24.191 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-nbd 2024-09-17T00:51:24.810 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:41 ago on Tue 17 Sep 2024 12:49:43 AM UTC. 2024-09-17T00:51:24.951 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-17T00:51:24.952 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:24.952 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-17T00:51:24.952 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:24.952 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-17T00:51:24.952 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:17.2.7-1635.g4a704134.el9 ceph 165 k 2024-09-17T00:51:24.952 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:24.953 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-17T00:51:24.953 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-17T00:51:24.953 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2024-09-17T00:51:24.953 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:24.953 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 165 k 2024-09-17T00:51:24.953 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 477 k 2024-09-17T00:51:24.953 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-17T00:51:25.159 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-nbd-17.2.7-1635.g4a704134.el9.x86_64.rpm 802 kB/s | 165 kB 00:00 2024-09-17T00:51:25.159 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:51:25.159 INFO:teuthology.orchestra.run.smithi002.stdout:Total 797 kB/s | 165 kB 00:00 2024-09-17T00:51:25.160 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-17T00:51:25.168 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-17T00:51:25.168 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-17T00:51:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-17T00:51:25.235 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-17T00:51:25.395 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-17T00:51:25.501 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:25.979 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:26.252 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 1/1 2024-09-17T00:51:26.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:26.252 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-17T00:51:26.252 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:17.2.7-1635.g4a704134.el9.x86_64 2024-09-17T00:51:26.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:51:26.252 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-17T00:51:26.523 DEBUG:teuthology.parallel:result is None 2024-09-17T00:51:26.524 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:51:26.524 INFO:teuthology.packaging:ref: None 2024-09-17T00:51:26.524 INFO:teuthology.packaging:tag: None 2024-09-17T00:51:26.524 INFO:teuthology.packaging:branch: quincy 2024-09-17T00:51:26.524 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:51:26.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-17T00:51:26.755 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T00:51:26.778 INFO:teuthology.orchestra.run.smithi002.stdout:17.2.7-1635.g4a704134.el9 2024-09-17T00:51:26.779 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1635.g4a704134.el9 2024-09-17T00:51:26.779 INFO:teuthology.task.install:The correct ceph version 17.2.7-1635.g4a704134 is installed. 2024-09-17T00:51:26.781 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T00:51:26.781 INFO:teuthology.packaging:ref: None 2024-09-17T00:51:26.781 INFO:teuthology.packaging:tag: None 2024-09-17T00:51:26.781 INFO:teuthology.packaging:branch: quincy 2024-09-17T00:51:26.781 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T00:51:26.781 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-17T00:51:27.050 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T00:51:27.076 INFO:teuthology.orchestra.run.smithi099.stdout:17.2.7-1635.g4a704134.el9 2024-09-17T00:51:27.076 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1635.g4a704134.el9 2024-09-17T00:51:27.076 INFO:teuthology.task.install:The correct ceph version 17.2.7-1635.g4a704134 is installed. 2024-09-17T00:51:27.078 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T00:51:27.078 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:51:27.078 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T00:51:27.110 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T00:51:27.110 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T00:51:27.147 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T00:51:27.148 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:51:27.148 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T00:51:27.194 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T00:51:27.263 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T00:51:27.263 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T00:51:27.290 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T00:51:27.356 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T00:51:27.356 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:51:27.357 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T00:51:27.384 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T00:51:27.454 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T00:51:27.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T00:51:27.480 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T00:51:27.545 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T00:51:27.546 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:51:27.546 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T00:51:27.574 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T00:51:27.641 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T00:51:27.642 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T00:51:27.667 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T00:51:27.732 INFO:teuthology.run_tasks:Running task print... 2024-09-17T00:51:27.741 INFO:teuthology.task.print:**** done install task... 2024-09-17T00:51:27.741 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-17T00:51:28.191 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'} 2024-09-17T00:51:28.191 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-09-17T00:51:28.191 INFO:tasks.cephadm:Cluster fsid is f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:51:28.191 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-17T00:51:28.192 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-17T00:51:28.192 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi002': '172.21.15.2', 'mon.smithi099': '172.21.15.99'} 2024-09-17T00:51:28.192 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-17T00:51:28.192 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname $(hostname -s) 2024-09-17T00:51:28.225 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname $(hostname -s) 2024-09-17T00:51:28.252 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-09-17T00:51:28.252 DEBUG:teuthology.orchestra.run.smithi002:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T00:51:28.498 INFO:teuthology.orchestra.run.smithi002.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 17 00:51 /home/ubuntu/cephtest/cephadm 2024-09-17T00:51:28.499 DEBUG:teuthology.orchestra.run.smithi099:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T00:51:28.632 INFO:teuthology.orchestra.run.smithi099.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 17 00:51 /home/ubuntu/cephtest/cephadm 2024-09-17T00:51:28.632 DEBUG:teuthology.orchestra.run.smithi002:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T00:51:28.652 DEBUG:teuthology.orchestra.run.smithi099:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T00:51:28.688 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-09-17T00:51:28.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-17T00:51:28.695 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-17T00:51:30.292 INFO:teuthology.orchestra.run.smithi099.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-17T00:51:30.348 INFO:teuthology.orchestra.run.smithi002.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-17T00:52:02.370 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-17T00:52:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)", 2024-09-17T00:52:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "image_id": "f22ead590badffde0cfa54f24f421cfc85eb73db2472525e9773349cda0adf30", 2024-09-17T00:52:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "repo_digests": [ 2024-09-17T00:52:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028" 2024-09-17T00:52:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-17T00:52:02.371 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-17T00:52:27.889 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)", 2024-09-17T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stdout: "image_id": "f22ead590badffde0cfa54f24f421cfc85eb73db2472525e9773349cda0adf30", 2024-09-17T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stdout: "repo_digests": [ 2024-09-17T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028" 2024-09-17T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-17T00:52:27.890 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T00:52:27.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph 2024-09-17T00:52:27.968 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph 2024-09-17T00:52:28.001 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /etc/ceph 2024-09-17T00:52:28.028 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /etc/ceph 2024-09-17T00:52:28.070 INFO:tasks.cephadm:Writing seed config... 2024-09-17T00:52:28.072 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-17T00:52:28.072 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-17T00:52:28.072 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-17T00:52:28.072 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-17T00:52:28.072 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-17T00:52:28.072 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-17T00:52:28.072 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-17T00:52:28.072 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-17T00:52:28.072 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-17T00:52:28.072 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-17T00:52:28.072 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-17T00:52:28.073 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-17T00:52:28.073 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-17T00:52:28.073 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-17T00:52:28.073 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-17T00:52:28.073 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-17T00:52:28.073 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-17T00:52:28.073 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-17T00:52:28.073 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-17T00:52:28.073 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-17T00:52:28.073 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-17T00:52:28.073 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-17T00:52:28.073 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-17T00:52:28.073 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-17T00:52:28.074 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-17T00:52:28.074 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-17T00:52:28.074 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-17T00:52:28.074 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-17T00:52:28.074 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-17T00:52:28.074 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-17T00:52:28.074 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-17T00:52:28.074 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-17T00:52:28.074 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-17T00:52:28.074 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-17T00:52:28.074 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-17T00:52:28.074 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-17T00:52:28.074 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-17T00:52:28.074 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-17T00:52:28.075 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-17T00:52:28.075 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-17T00:52:28.075 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-17T00:52:28.075 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-17T00:52:28.075 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-17T00:52:28.075 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:52:28.076 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-17T00:52:28.092 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f8e82564-748e-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-17T00:52:28.093 DEBUG:teuthology.orchestra.run.smithi002:mon.smithi002> sudo journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi002.service 2024-09-17T00:52:28.136 INFO:tasks.cephadm:Bootstrapping... 2024-09-17T00:52:28.136 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid f8e82564-748e-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.2 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-17T00:52:28.343 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-17T00:52:28.344 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'f8e82564-748e-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.2', '--skip-admin-label'] 2024-09-17T00:52:28.368 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-17T00:52:28.368 INFO:teuthology.orchestra.run.smithi002.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-17T00:52:28.369 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying podman|docker is present... 2024-09-17T00:52:28.391 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-17T00:52:28.391 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying lvm2 is present... 2024-09-17T00:52:28.392 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying time synchronization is in place... 2024-09-17T00:52:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T00:52:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T00:52:28.406 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T00:52:28.407 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-17T00:52:28.414 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-17T00:52:28.421 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-17T00:52:28.421 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-17T00:52:28.421 INFO:teuthology.orchestra.run.smithi002.stdout:Repeating the final host check... 2024-09-17T00:52:28.444 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.2.2 2024-09-17T00:52:28.444 INFO:teuthology.orchestra.run.smithi002.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-17T00:52:28.444 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl is present 2024-09-17T00:52:28.444 INFO:teuthology.orchestra.run.smithi002.stdout:lvcreate is present 2024-09-17T00:52:28.451 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T00:52:28.451 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T00:52:28.458 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T00:52:28.458 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-17T00:52:28.465 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-09-17T00:52:28.472 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-09-17T00:52:28.472 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-09-17T00:52:28.472 INFO:teuthology.orchestra.run.smithi002.stdout:Host looks OK 2024-09-17T00:52:28.472 INFO:teuthology.orchestra.run.smithi002.stdout:Cluster fsid: f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:52:28.472 INFO:teuthology.orchestra.run.smithi002.stdout:Acquiring lock 140360262525280 on /run/cephadm/f8e82564-748e-11ef-bceb-c7b262605968.lock 2024-09-17T00:52:28.472 INFO:teuthology.orchestra.run.smithi002.stdout:Lock 140360262525280 acquired on /run/cephadm/f8e82564-748e-11ef-bceb-c7b262605968.lock 2024-09-17T00:52:28.473 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 3300 ... 2024-09-17T00:52:28.473 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 6789 ... 2024-09-17T00:52:28.473 INFO:teuthology.orchestra.run.smithi002.stdout:Base mon IP(s) is [172.21.15.2:3300, 172.21.15.2:6789], mon addrv is [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-17T00:52:28.477 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.2 metric 100 2024-09-17T00:52:28.477 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.2 metric 100 2024-09-17T00:52:28.480 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-17T00:52:28.480 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-17T00:52:28.480 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1773sec hoplimit 64 pref medium 2024-09-17T00:52:28.483 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-17T00:52:28.483 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-17T00:52:28.483 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T00:52:28.483 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-17T00:52:28.483 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-17T00:52:28.483 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T00:52:28.484 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-17T00:52:28.484 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-09-17T00:52:28.484 INFO:teuthology.orchestra.run.smithi002.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-17T00:52:28.484 INFO:teuthology.orchestra.run.smithi002.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-17T00:52:28.485 INFO:teuthology.orchestra.run.smithi002.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-17T00:52:28.905 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout f22ead590badffde0cfa54f24f421cfc85eb73db2472525e9773349cda0adf30 2024-09-17T00:52:28.905 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-17T00:52:28.905 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Getting image source signatures 2024-09-17T00:52:28.905 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:afc1ef11d118e12ca6c3c802d7e4e9c8308fe940f6e297f4487b945b23e4c9f6 2024-09-17T00:52:28.905 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-17T00:52:28.905 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying config sha256:f22ead590badffde0cfa54f24f421cfc85eb73db2472525e9773349cda0adf30 2024-09-17T00:52:28.906 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-17T00:52:29.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph: stdout ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable) 2024-09-17T00:52:29.828 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph version: ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable) 2024-09-17T00:52:29.828 INFO:teuthology.orchestra.run.smithi002.stdout:Extracting ceph user uid/gid from container image... 2024-09-17T00:52:30.732 INFO:teuthology.orchestra.run.smithi002.stdout:stat: stdout 167 167 2024-09-17T00:52:30.732 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial keys... 2024-09-17T00:52:31.537 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQDP0uhmHtlxABAApys9KrplvooEIva/A3m3tg== 2024-09-17T00:52:32.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQDP0uhmq21kMxAAkL2QXGRUbRXSyIFKqV+1fw== 2024-09-17T00:52:33.423 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQDQ0uhm/4vmLRAAJchkdGZAXDfFkqNhmH1buA== 2024-09-17T00:52:33.424 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial monmap... 2024-09-17T00:52:34.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T00:52:34.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-17T00:52:34.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:52:34.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T00:52:34.297 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool for smithi002 [v2:172.21.15.2:3300,v1:172.21.15.2:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T00:52:34.297 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = octopus 2024-09-17T00:52:34.297 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: set fsid to f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:52:34.298 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T00:52:34.298 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:52:34.298 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mon... 2024-09-17T00:52:35.277 INFO:teuthology.orchestra.run.smithi002.stdout:create mon.smithi002 on 2024-09-17T00:52:35.481 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-17T00:52:35.658 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-17T00:52:35.824 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f8e82564-748e-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-f8e82564-748e-11ef-bceb-c7b262605968.target. 2024-09-17T00:52:35.824 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f8e82564-748e-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-f8e82564-748e-11ef-bceb-c7b262605968.target. 2024-09-17T00:52:36.149 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi002 2024-09-17T00:52:36.149 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi002.service: Unit ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi002.service not loaded. 2024-09-17T00:52:36.334 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f8e82564-748e-11ef-bceb-c7b262605968.target.wants/ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi002.service → /etc/systemd/system/ceph-f8e82564-748e-11ef-bceb-c7b262605968@.service. 2024-09-17T00:52:36.393 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:36 smithi002 systemd[1]: Starting Ceph mon.smithi002 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T00:52:36.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:36 smithi002 podman[27268]: 2024-09-17 00:52:36.493318586 +0000 UTC m=+0.017936437 image pull f22ead590badffde0cfa54f24f421cfc85eb73db2472525e9773349cda0adf30 quay.ceph.io/ceph-ci/ceph:quincy 2024-09-17T00:52:36.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:36 smithi002 podman[27268]: 2024-09-17 00:52:36.604378921 +0000 UTC m=+0.128996741 container create 5dd5dde79c1139547e48a909d1e52fa288383ee59768e11047e07638299d10a0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, RELEASE=quincy-4a70413, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T00:52:36.918 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T00:52:36.918 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-17T00:52:36.927 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T00:52:36.927 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-17T00:52:36.927 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-17T00:52:36.927 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T00:52:36.928 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon to start... 2024-09-17T00:52:36.928 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon... 2024-09-17T00:52:37.054 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:36 smithi002 podman[27268]: 2024-09-17 00:52:36.814868977 +0000 UTC m=+0.339486815 container init 5dd5dde79c1139547e48a909d1e52fa288383ee59768e11047e07638299d10a0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=quincy-4a70413, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-17T00:52:37.054 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:36 smithi002 podman[27268]: 2024-09-17 00:52:36.818263221 +0000 UTC m=+0.342881040 container start 5dd5dde79c1139547e48a909d1e52fa288383ee59768e11047e07638299d10a0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=quincy-4a70413, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T00:52:37.054 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:36 smithi002 ceph-mon[27287]: mkfs f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:52:37.054 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:36 smithi002 ceph-mon[27287]: mon.smithi002 is new leader, mons smithi002 in quorum (ranks 0) 2024-09-17T00:52:37.054 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:36 smithi002 bash[27268]: 5dd5dde79c1139547e48a909d1e52fa288383ee59768e11047e07638299d10a0 2024-09-17T00:52:37.054 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:36 smithi002 systemd[1]: Started Ceph mon.smithi002 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T00:52:37.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout cluster: 2024-09-17T00:52:37.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout id: f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:52:37.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-17T00:52:37.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-17T00:52:37.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout services: 2024-09-17T00:52:37.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi002 (age 0.571413s) 2024-09-17T00:52:37.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-17T00:52:37.986 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-17T00:52:37.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-17T00:52:37.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout data: 2024-09-17T00:52:37.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-17T00:52:37.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-17T00:52:37.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-17T00:52:37.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pgs: 2024-09-17T00:52:37.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-17T00:52:37.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.351+0000 7f6104aa2640 1 Processor -- start 2024-09-17T00:52:37.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.352+0000 7f6104aa2640 1 -- start start 2024-09-17T00:52:37.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.352+0000 7f6104aa2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6100102460 0x7f6100102870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:37.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.352+0000 7f6104aa2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6100102db0 con 0x7f6100102460 2024-09-17T00:52:37.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.352+0000 7f60fe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6100102460 0x7f6100102870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:37.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.352+0000 7f60fe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6100102460 0x7f6100102870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48156/0 (socket says 172.21.15.2:48156) 2024-09-17T00:52:37.987 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.352+0000 7f60fe59c640 1 -- 172.21.15.2:0/599783795 learned_addr learned my addr 172.21.15.2:0/599783795 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:37.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.353+0000 7f60fe59c640 1 -- 172.21.15.2:0/599783795 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6100102ef0 con 0x7f6100102460 2024-09-17T00:52:37.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.355+0000 7f60fe59c640 1 --2- 172.21.15.2:0/599783795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6100102460 0x7f6100102870 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f60f000baf0 tx=0x7f60f000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72741c8a802e672 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:37.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.355+0000 7f60fd59a640 1 -- 172.21.15.2:0/599783795 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60f00327a0 con 0x7f6100102460 2024-09-17T00:52:37.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.355+0000 7f60fd59a640 1 -- 172.21.15.2:0/599783795 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f0032900 con 0x7f6100102460 2024-09-17T00:52:37.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.355+0000 7f60fd59a640 1 -- 172.21.15.2:0/599783795 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60f0032c30 con 0x7f6100102460 2024-09-17T00:52:37.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.355+0000 7f6104aa2640 1 -- 172.21.15.2:0/599783795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6100102460 msgr2=0x7f6100102870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:37.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.355+0000 7f6104aa2640 1 --2- 172.21.15.2:0/599783795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6100102460 0x7f6100102870 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f60f000baf0 tx=0x7f60f000b460 comp rx=0 tx=0).stop 2024-09-17T00:52:37.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.355+0000 7f6104aa2640 1 -- 172.21.15.2:0/599783795 shutdown_connections 2024-09-17T00:52:37.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.355+0000 7f6104aa2640 1 --2- 172.21.15.2:0/599783795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6100102460 0x7f6100102870 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:37.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.355+0000 7f6104aa2640 1 -- 172.21.15.2:0/599783795 >> 172.21.15.2:0/599783795 conn(0x7f61000fbde0 msgr2=0x7f61000fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:37.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.356+0000 7f6104aa2640 1 -- 172.21.15.2:0/599783795 shutdown_connections 2024-09-17T00:52:37.988 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.356+0000 7f6104aa2640 1 -- 172.21.15.2:0/599783795 wait complete. 2024-09-17T00:52:37.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.356+0000 7f6104aa2640 1 Processor -- start 2024-09-17T00:52:37.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.356+0000 7f6104aa2640 1 -- start start 2024-09-17T00:52:37.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.356+0000 7f6104aa2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6100102460 0x7f610010e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:37.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.356+0000 7f6104aa2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610010e840 con 0x7f6100102460 2024-09-17T00:52:37.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.356+0000 7f60fe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6100102460 0x7f610010e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:37.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.356+0000 7f60fe59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6100102460 0x7f610010e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48160/0 (socket says 172.21.15.2:48160) 2024-09-17T00:52:37.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.356+0000 7f60fe59c640 1 -- 172.21.15.2:0/2436755775 learned_addr learned my addr 172.21.15.2:0/2436755775 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:37.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.357+0000 7f60fe59c640 1 -- 172.21.15.2:0/2436755775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f000b700 con 0x7f6100102460 2024-09-17T00:52:37.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.357+0000 7f60fe59c640 1 --2- 172.21.15.2:0/2436755775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6100102460 0x7f610010e300 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f60f000b4a0 tx=0x7f60f003a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:37.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.357+0000 7f60eeffd640 1 -- 172.21.15.2:0/2436755775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60f0032790 con 0x7f6100102460 2024-09-17T00:52:37.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.357+0000 7f60eeffd640 1 -- 172.21.15.2:0/2436755775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f003c880 con 0x7f6100102460 2024-09-17T00:52:37.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.357+0000 7f6104aa2640 1 -- 172.21.15.2:0/2436755775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610010ea40 con 0x7f6100102460 2024-09-17T00:52:37.989 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.357+0000 7f60eeffd640 1 -- 172.21.15.2:0/2436755775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60f003cb90 con 0x7f6100102460 2024-09-17T00:52:37.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.357+0000 7f6104aa2640 1 -- 172.21.15.2:0/2436755775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610010eeb0 con 0x7f6100102460 2024-09-17T00:52:37.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.357+0000 7f60eeffd640 1 -- 172.21.15.2:0/2436755775 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f60f0045070 con 0x7f6100102460 2024-09-17T00:52:37.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.357+0000 7f60eeffd640 1 -- 172.21.15.2:0/2436755775 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f60f0051840 con 0x7f6100102460 2024-09-17T00:52:37.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.358+0000 7f6104aa2640 1 -- 172.21.15.2:0/2436755775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610004b720 con 0x7f6100102460 2024-09-17T00:52:37.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.360+0000 7f60eeffd640 1 -- 172.21.15.2:0/2436755775 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f610010eeb0 con 0x7f6100102460 2024-09-17T00:52:37.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.420+0000 7f6104aa2640 1 -- 172.21.15.2:0/2436755775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f6100107870 con 0x7f6100102460 2024-09-17T00:52:37.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.421+0000 7f60eeffd640 1 -- 172.21.15.2:0/2436755775 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f60f004c070 con 0x7f6100102460 2024-09-17T00:52:37.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.421+0000 7f6104aa2640 1 -- 172.21.15.2:0/2436755775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6100102460 msgr2=0x7f610010e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:37.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.421+0000 7f6104aa2640 1 --2- 172.21.15.2:0/2436755775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6100102460 0x7f610010e300 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f60f000b4a0 tx=0x7f60f003a000 comp rx=0 tx=0).stop 2024-09-17T00:52:37.990 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.421+0000 7f6104aa2640 1 -- 172.21.15.2:0/2436755775 shutdown_connections 2024-09-17T00:52:37.991 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.421+0000 7f6104aa2640 1 --2- 172.21.15.2:0/2436755775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6100102460 0x7f610010e300 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:37.991 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.421+0000 7f6104aa2640 1 -- 172.21.15.2:0/2436755775 >> 172.21.15.2:0/2436755775 conn(0x7f61000fbde0 msgr2=0x7f61000fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:37.991 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.422+0000 7f6104aa2640 1 -- 172.21.15.2:0/2436755775 shutdown_connections 2024-09-17T00:52:37.991 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:37.422+0000 7f6104aa2640 1 -- 172.21.15.2:0/2436755775 wait complete. 2024-09-17T00:52:37.991 INFO:teuthology.orchestra.run.smithi002.stdout:mon is available 2024-09-17T00:52:37.991 INFO:teuthology.orchestra.run.smithi002.stdout:Assimilating anything we can from ceph.conf... 2024-09-17T00:52:38.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:37 smithi002 ceph-mon[27287]: mon.smithi002 is new leader, mons smithi002 in quorum (ranks 0) 2024-09-17T00:52:38.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:37 smithi002 ceph-mon[27287]: monmap e1: 1 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T00:52:38.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:37 smithi002 ceph-mon[27287]: fsmap 2024-09-17T00:52:38.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:37 smithi002 ceph-mon[27287]: osdmap e1: 0 total, 0 up, 0 in 2024-09-17T00:52:38.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:37 smithi002 ceph-mon[27287]: mgrmap e1: no daemons active 2024-09-17T00:52:38.103 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:37 smithi002 ceph-mon[27287]: from='client.? 172.21.15.2:0/2436755775' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-17T00:52:39.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:38 smithi002 ceph-mon[27287]: from='client.? 172.21.15.2:0/897096464' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T00:52:39.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:38 smithi002 ceph-mon[27287]: from='client.? 172.21.15.2:0/897096464' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-17T00:52:39.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-17T00:52:39.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T00:52:39.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:52:39.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-17T00:52:39.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-09-17T00:52:39.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T00:52:39.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T00:52:39.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T00:52:39.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T00:52:39.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-17T00:52:39.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T00:52:39.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T00:52:39.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-17T00:52:39.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T00:52:39.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-17T00:52:39.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-17T00:52:39.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-17T00:52:39.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T00:52:39.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T00:52:39.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.398+0000 7fcc72451640 1 Processor -- start 2024-09-17T00:52:39.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.398+0000 7fcc72451640 1 -- start start 2024-09-17T00:52:39.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.398+0000 7fcc72451640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc6c076b70 0x7fcc6c104c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:39.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.398+0000 7fcc72451640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c076f80 con 0x7fcc6c076b70 2024-09-17T00:52:39.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.398+0000 7fcc6bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc6c076b70 0x7fcc6c104c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:39.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.398+0000 7fcc6bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc6c076b70 0x7fcc6c104c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48164/0 (socket says 172.21.15.2:48164) 2024-09-17T00:52:39.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.398+0000 7fcc6bfff640 1 -- 172.21.15.2:0/3655588437 learned_addr learned my addr 172.21.15.2:0/3655588437 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:39.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.399+0000 7fcc6bfff640 1 -- 172.21.15.2:0/3655588437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c105160 con 0x7fcc6c076b70 2024-09-17T00:52:39.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.399+0000 7fcc6bfff640 1 --2- 172.21.15.2:0/3655588437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc6c076b70 0x7fcc6c104c20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009840 tx=0x7fcc5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa082ff2d6e9af32 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:39.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.400+0000 7fcc6affd640 1 -- 172.21.15.2:0/3655588437 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc5c032440 con 0x7fcc6c076b70 2024-09-17T00:52:39.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.400+0000 7fcc6affd640 1 -- 172.21.15.2:0/3655588437 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5c0325a0 con 0x7fcc6c076b70 2024-09-17T00:52:39.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.400+0000 7fcc6affd640 1 -- 172.21.15.2:0/3655588437 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc5c0328d0 con 0x7fcc6c076b70 2024-09-17T00:52:39.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.400+0000 7fcc72451640 1 -- 172.21.15.2:0/3655588437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc6c076b70 msgr2=0x7fcc6c104c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:39.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.400+0000 7fcc72451640 1 --2- 172.21.15.2:0/3655588437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc6c076b70 0x7fcc6c104c20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009840 tx=0x7fcc5c0091d0 comp rx=0 tx=0).stop 2024-09-17T00:52:39.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.400+0000 7fcc72451640 1 -- 172.21.15.2:0/3655588437 shutdown_connections 2024-09-17T00:52:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.400+0000 7fcc72451640 1 --2- 172.21.15.2:0/3655588437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc6c076b70 0x7fcc6c104c20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.400+0000 7fcc72451640 1 -- 172.21.15.2:0/3655588437 >> 172.21.15.2:0/3655588437 conn(0x7fcc6c0fc630 msgr2=0x7fcc6c0fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.400+0000 7fcc72451640 1 -- 172.21.15.2:0/3655588437 shutdown_connections 2024-09-17T00:52:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.400+0000 7fcc72451640 1 -- 172.21.15.2:0/3655588437 wait complete. 2024-09-17T00:52:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.401+0000 7fcc72451640 1 Processor -- start 2024-09-17T00:52:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.401+0000 7fcc72451640 1 -- start start 2024-09-17T00:52:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.401+0000 7fcc72451640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc6c076b70 0x7fcc6c110590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.401+0000 7fcc72451640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c110ad0 con 0x7fcc6c076b70 2024-09-17T00:52:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.401+0000 7fcc6bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc6c076b70 0x7fcc6c110590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.401+0000 7fcc6bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc6c076b70 0x7fcc6c110590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48180/0 (socket says 172.21.15.2:48180) 2024-09-17T00:52:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.402+0000 7fcc6bfff640 1 -- 172.21.15.2:0/897096464 learned_addr learned my addr 172.21.15.2:0/897096464 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.402+0000 7fcc6bfff640 1 -- 172.21.15.2:0/897096464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c009450 con 0x7fcc6c076b70 2024-09-17T00:52:39.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.402+0000 7fcc6bfff640 1 --2- 172.21.15.2:0/897096464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc6c076b70 0x7fcc6c110590 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c02a700 tx=0x7fcc5c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:39.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.402+0000 7fcc68ff9640 1 -- 172.21.15.2:0/897096464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc5c031be0 con 0x7fcc6c076b70 2024-09-17T00:52:39.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.402+0000 7fcc68ff9640 1 -- 172.21.15.2:0/897096464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5c031d40 con 0x7fcc6c076b70 2024-09-17T00:52:39.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.402+0000 7fcc68ff9640 1 -- 172.21.15.2:0/897096464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc5c03b5a0 con 0x7fcc6c076b70 2024-09-17T00:52:39.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.402+0000 7fcc72451640 1 -- 172.21.15.2:0/897096464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6c110cd0 con 0x7fcc6c076b70 2024-09-17T00:52:39.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.402+0000 7fcc72451640 1 -- 172.21.15.2:0/897096464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6c1110e0 con 0x7fcc6c076b70 2024-09-17T00:52:39.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.402+0000 7fcc68ff9640 1 -- 172.21.15.2:0/897096464 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fcc5c039040 con 0x7fcc6c076b70 2024-09-17T00:52:39.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.402+0000 7fcc68ff9640 1 -- 172.21.15.2:0/897096464 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcc5c041030 con 0x7fcc6c076b70 2024-09-17T00:52:39.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.403+0000 7fcc72451640 1 -- 172.21.15.2:0/897096464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6c04b720 con 0x7fcc6c076b70 2024-09-17T00:52:39.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.405+0000 7fcc68ff9640 1 -- 172.21.15.2:0/897096464 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fcc5c037070 con 0x7fcc6c076b70 2024-09-17T00:52:39.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.463+0000 7fcc72451640 1 -- 172.21.15.2:0/897096464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fcc6c105470 con 0x7fcc6c076b70 2024-09-17T00:52:39.055 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.467+0000 7fcc68ff9640 1 -- 172.21.15.2:0/897096464 <== mon.0 v2:172.21.15.2:3300/0 7 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcc5c04e7e0 con 0x7fcc6c076b70 2024-09-17T00:52:39.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.467+0000 7fcc68ff9640 1 -- 172.21.15.2:0/897096464 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+463 (secure 0 0 0) 0x7fcc5c054d80 con 0x7fcc6c076b70 2024-09-17T00:52:39.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.468+0000 7fcc72451640 1 -- 172.21.15.2:0/897096464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc6c076b70 msgr2=0x7fcc6c110590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:39.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.468+0000 7fcc72451640 1 --2- 172.21.15.2:0/897096464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc6c076b70 0x7fcc6c110590 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c02a700 tx=0x7fcc5c032000 comp rx=0 tx=0).stop 2024-09-17T00:52:39.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.468+0000 7fcc72451640 1 -- 172.21.15.2:0/897096464 shutdown_connections 2024-09-17T00:52:39.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.468+0000 7fcc72451640 1 --2- 172.21.15.2:0/897096464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc6c076b70 0x7fcc6c110590 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:39.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.468+0000 7fcc72451640 1 -- 172.21.15.2:0/897096464 >> 172.21.15.2:0/897096464 conn(0x7fcc6c0fc630 msgr2=0x7fcc6c0fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:39.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.468+0000 7fcc72451640 1 -- 172.21.15.2:0/897096464 shutdown_connections 2024-09-17T00:52:39.056 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:38.468+0000 7fcc72451640 1 -- 172.21.15.2:0/897096464 wait complete. 2024-09-17T00:52:39.056 INFO:teuthology.orchestra.run.smithi002.stdout:Generating new minimal ceph.conf... 2024-09-17T00:52:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.442+0000 7f109fd2d640 1 Processor -- start 2024-09-17T00:52:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.442+0000 7f109fd2d640 1 -- start start 2024-09-17T00:52:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.442+0000 7f109fd2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1098102440 0x7f1098102850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.442+0000 7f109fd2d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1098102d90 con 0x7f1098102440 2024-09-17T00:52:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.443+0000 7f109dac9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1098102440 0x7f1098102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.443+0000 7f109dac9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1098102440 0x7f1098102850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48188/0 (socket says 172.21.15.2:48188) 2024-09-17T00:52:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.443+0000 7f109dac9640 1 -- 172.21.15.2:0/553798620 learned_addr learned my addr 172.21.15.2:0/553798620 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.443+0000 7f109dac9640 1 -- 172.21.15.2:0/553798620 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1098102ed0 con 0x7f1098102440 2024-09-17T00:52:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.444+0000 7f109dac9640 1 --2- 172.21.15.2:0/553798620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1098102440 0x7f1098102850 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1094009840 tx=0x7f10940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abc662622bda4e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.444+0000 7f109cac7640 1 -- 172.21.15.2:0/553798620 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1094032440 con 0x7f1098102440 2024-09-17T00:52:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.444+0000 7f109cac7640 1 -- 172.21.15.2:0/553798620 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1094032a00 con 0x7f1098102440 2024-09-17T00:52:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.444+0000 7f109cac7640 1 -- 172.21.15.2:0/553798620 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10940319e0 con 0x7f1098102440 2024-09-17T00:52:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.444+0000 7f109fd2d640 1 -- 172.21.15.2:0/553798620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1098102440 msgr2=0x7f1098102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.444+0000 7f109fd2d640 1 --2- 172.21.15.2:0/553798620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1098102440 0x7f1098102850 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1094009840 tx=0x7f10940091d0 comp rx=0 tx=0).stop 2024-09-17T00:52:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.444+0000 7f109fd2d640 1 -- 172.21.15.2:0/553798620 shutdown_connections 2024-09-17T00:52:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.444+0000 7f109fd2d640 1 --2- 172.21.15.2:0/553798620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1098102440 0x7f1098102850 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.444+0000 7f109fd2d640 1 -- 172.21.15.2:0/553798620 >> 172.21.15.2:0/553798620 conn(0x7f10980fbde0 msgr2=0x7f10980fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.444+0000 7f109fd2d640 1 -- 172.21.15.2:0/553798620 shutdown_connections 2024-09-17T00:52:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.445+0000 7f109fd2d640 1 -- 172.21.15.2:0/553798620 wait complete. 2024-09-17T00:52:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.445+0000 7f109fd2d640 1 Processor -- start 2024-09-17T00:52:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.445+0000 7f109fd2d640 1 -- start start 2024-09-17T00:52:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.445+0000 7f109fd2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1098102440 0x7f1098100c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.445+0000 7f109fd2d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1098113a90 con 0x7f1098102440 2024-09-17T00:52:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.445+0000 7f109dac9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1098102440 0x7f1098100c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.445+0000 7f109dac9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1098102440 0x7f1098100c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48204/0 (socket says 172.21.15.2:48204) 2024-09-17T00:52:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.445+0000 7f109dac9640 1 -- 172.21.15.2:0/861850399 learned_addr learned my addr 172.21.15.2:0/861850399 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.446+0000 7f109dac9640 1 -- 172.21.15.2:0/861850399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1094009450 con 0x7f1098102440 2024-09-17T00:52:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.446+0000 7f109dac9640 1 --2- 172.21.15.2:0/861850399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1098102440 0x7f1098100c10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1094000c00 tx=0x7f1094008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.446+0000 7f108e7fc640 1 -- 172.21.15.2:0/861850399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f109403d450 con 0x7f1098102440 2024-09-17T00:52:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.446+0000 7f108e7fc640 1 -- 172.21.15.2:0/861850399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f109403da10 con 0x7f1098102440 2024-09-17T00:52:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.446+0000 7f109fd2d640 1 -- 172.21.15.2:0/861850399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1098113bd0 con 0x7f1098102440 2024-09-17T00:52:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.446+0000 7f108e7fc640 1 -- 172.21.15.2:0/861850399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f109403b880 con 0x7f1098102440 2024-09-17T00:52:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.446+0000 7f109fd2d640 1 -- 172.21.15.2:0/861850399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1098114040 con 0x7f1098102440 2024-09-17T00:52:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.446+0000 7f108e7fc640 1 -- 172.21.15.2:0/861850399 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1094039070 con 0x7f1098102440 2024-09-17T00:52:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.446+0000 7f108e7fc640 1 -- 172.21.15.2:0/861850399 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f10940466c0 con 0x7f1098102440 2024-09-17T00:52:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.447+0000 7f109fd2d640 1 -- 172.21.15.2:0/861850399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109804b720 con 0x7f1098102440 2024-09-17T00:52:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.449+0000 7f108e7fc640 1 -- 172.21.15.2:0/861850399 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f10940657a0 con 0x7f1098102440 2024-09-17T00:52:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.507+0000 7f109fd2d640 1 -- 172.21.15.2:0/861850399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f10981144d0 con 0x7f1098102440 2024-09-17T00:52:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.507+0000 7f108e7fc640 1 -- 172.21.15.2:0/861850399 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7f1094054020 con 0x7f1098102440 2024-09-17T00:52:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.508+0000 7f109fd2d640 1 -- 172.21.15.2:0/861850399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1098102440 msgr2=0x7f1098100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.508+0000 7f109fd2d640 1 --2- 172.21.15.2:0/861850399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1098102440 0x7f1098100c10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1094000c00 tx=0x7f1094008040 comp rx=0 tx=0).stop 2024-09-17T00:52:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.508+0000 7f109fd2d640 1 -- 172.21.15.2:0/861850399 shutdown_connections 2024-09-17T00:52:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.508+0000 7f109fd2d640 1 --2- 172.21.15.2:0/861850399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1098102440 0x7f1098100c10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.508+0000 7f109fd2d640 1 -- 172.21.15.2:0/861850399 >> 172.21.15.2:0/861850399 conn(0x7f10980fbde0 msgr2=0x7f10980fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.508+0000 7f109fd2d640 1 -- 172.21.15.2:0/861850399 shutdown_connections 2024-09-17T00:52:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:39.508+0000 7f109fd2d640 1 -- 172.21.15.2:0/861850399 wait complete. 2024-09-17T00:52:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:Restarting the monitor... 2024-09-17T00:52:40.018 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:39 smithi002 ceph-mon[27287]: from='client.? 172.21.15.2:0/861850399' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:52:40.375 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:40 smithi002 systemd[1]: Stopping Ceph mon.smithi002 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T00:52:40.375 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:40 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[27283]: 2024-09-17T00:52:40.254+0000 7f5bc1ca7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi002 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T00:52:40.375 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:40 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[27283]: 2024-09-17T00:52:40.254+0000 7f5bc1ca7640 -1 mon.smithi002@0(leader) e1 *** Got Signal Terminated *** 2024-09-17T00:52:40.643 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:40 smithi002 podman[27530]: 2024-09-17 00:52:40.378200208 +0000 UTC m=+0.208102316 container died 5dd5dde79c1139547e48a909d1e52fa288383ee59768e11047e07638299d10a0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=quincy-4a70413, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-17T00:52:40.643 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:40 smithi002 podman[27530]: 2024-09-17 00:52:40.646225151 +0000 UTC m=+0.476127256 container cleanup 5dd5dde79c1139547e48a909d1e52fa288383ee59768e11047e07638299d10a0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=quincy-4a70413, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-17T00:52:40.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:40 smithi002 bash[27530]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002 2024-09-17T00:52:41.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:40 smithi002 podman[27541]: 2024-09-17 00:52:40.922238383 +0000 UTC m=+0.534720359 container remove 5dd5dde79c1139547e48a909d1e52fa288383ee59768e11047e07638299d10a0 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, RELEASE=quincy-4a70413, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-17T00:52:41.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi002.service: Deactivated successfully. 2024-09-17T00:52:41.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 systemd[1]: Stopped Ceph mon.smithi002 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T00:52:41.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 systemd[1]: Starting Ceph mon.smithi002 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T00:52:41.484 INFO:teuthology.orchestra.run.smithi002.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-17T00:52:41.510 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 podman[27632]: 2024-09-17 00:52:41.248149464 +0000 UTC m=+0.092584103 container create 08b932b41bfa9090a8319243a47c8fa2a55f2bd4c8a1ebd2ac0d31fc727706dc (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=quincy-4a70413, ceph=True) 2024-09-17T00:52:41.510 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 podman[27632]: 2024-09-17 00:52:41.171779433 +0000 UTC m=+0.016214046 image pull f22ead590badffde0cfa54f24f421cfc85eb73db2472525e9773349cda0adf30 quay.ceph.io/ceph-ci/ceph:quincy 2024-09-17T00:52:41.510 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 podman[27632]: 2024-09-17 00:52:41.42524169 +0000 UTC m=+0.269676296 container init 08b932b41bfa9090a8319243a47c8fa2a55f2bd4c8a1ebd2ac0d31fc727706dc (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-4a70413, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T00:52:41.510 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 podman[27632]: 2024-09-17 00:52:41.428353524 +0000 UTC m=+0.272788125 container start 08b932b41bfa9090a8319243a47c8fa2a55f2bd4c8a1ebd2ac0d31fc727706dc (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=quincy-4a70413, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-17T00:52:41.510 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T00:52:41.510 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable), process ceph-mon, pid 2 2024-09-17T00:52:41.511 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: pidfile_write: ignore empty --pid-file 2024-09-17T00:52:41.511 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: load: jerasure load: lrc 2024-09-17T00:52:41.511 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: RocksDB version: 6.15.5 2024-09-17T00:52:41.511 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-17T00:52:41.511 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Compile date Sep 16 2024 2024-09-17T00:52:41.511 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: DB SUMMARY 2024-09-17T00:52:41.511 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: DB Session ID: 2P90CSVK36R1HMBG6GF6 2024-09-17T00:52:41.511 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: CURRENT file: CURRENT 2024-09-17T00:52:41.511 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T00:52:41.511 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-17T00:52:41.511 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi002/store.db dir, Total Num: 1, files: 000008.sst 2024-09-17T00:52:41.511 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi002/store.db: 000010.log size: 98082 ; 2024-09-17T00:52:41.512 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.error_if_exists: 0 2024-09-17T00:52:41.512 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.create_if_missing: 0 2024-09-17T00:52:41.512 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.paranoid_checks: 1 2024-09-17T00:52:41.512 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T00:52:41.512 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.env: 0x55df21c10440 2024-09-17T00:52:41.512 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.fs: Posix File System 2024-09-17T00:52:41.512 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.info_log: 0x55df231a70c0 2024-09-17T00:52:41.512 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T00:52:41.512 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.statistics: (nil) 2024-09-17T00:52:41.512 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.use_fsync: 0 2024-09-17T00:52:41.512 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_log_file_size: 0 2024-09-17T00:52:41.512 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T00:52:41.512 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T00:52:41.513 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T00:52:41.513 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T00:52:41.513 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.allow_fallocate: 1 2024-09-17T00:52:41.513 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T00:52:41.513 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T00:52:41.513 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.use_direct_reads: 0 2024-09-17T00:52:41.513 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T00:52:41.513 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T00:52:41.513 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.db_log_dir: 2024-09-17T00:52:41.513 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi002/store.db 2024-09-17T00:52:41.513 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T00:52:41.513 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T00:52:41.513 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T00:52:41.514 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T00:52:41.514 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T00:52:41.514 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T00:52:41.514 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T00:52:41.514 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T00:52:41.514 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.write_buffer_manager: 0x55df23264870 2024-09-17T00:52:41.514 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T00:52:41.514 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-17T00:52:41.514 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T00:52:41.514 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T00:52:41.514 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T00:52:41.514 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T00:52:41.515 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T00:52:41.515 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T00:52:41.515 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T00:52:41.516 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.unordered_write: 0 2024-09-17T00:52:41.516 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T00:52:41.516 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T00:52:41.517 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T00:52:41.517 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T00:52:41.517 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.row_cache: None 2024-09-17T00:52:41.517 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.wal_filter: None 2024-09-17T00:52:41.517 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T00:52:41.517 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T00:52:41.517 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.preserve_deletes: 0 2024-09-17T00:52:41.517 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.two_write_queues: 0 2024-09-17T00:52:41.517 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T00:52:41.517 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.atomic_flush: 0 2024-09-17T00:52:41.517 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T00:52:41.517 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T00:52:41.517 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T00:52:41.518 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.log_readahead_size: 0 2024-09-17T00:52:41.518 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T00:52:41.518 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T00:52:41.518 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T00:52:41.518 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T00:52:41.518 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T00:52:41.518 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T00:52:41.518 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_background_jobs: 2 2024-09-17T00:52:41.518 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_background_compactions: -1 2024-09-17T00:52:41.519 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_subcompactions: 1 2024-09-17T00:52:41.519 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T00:52:41.519 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T00:52:41.519 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T00:52:41.519 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T00:52:41.519 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T00:52:41.519 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T00:52:41.519 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T00:52:41.519 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T00:52:41.519 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_open_files: -1 2024-09-17T00:52:41.519 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T00:52:41.519 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T00:52:41.519 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T00:52:41.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T00:52:41.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_background_flushes: -1 2024-09-17T00:52:41.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Compression algorithms supported: 2024-09-17T00:52:41.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: kZSTD supported: 0 2024-09-17T00:52:41.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: kXpressCompression supported: 0 2024-09-17T00:52:41.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: kBZip2Compression supported: 0 2024-09-17T00:52:41.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T00:52:41.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: kLZ4Compression supported: 1 2024-09-17T00:52:41.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: kZlibCompression supported: 1 2024-09-17T00:52:41.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T00:52:41.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: kSnappyCompression supported: 1 2024-09-17T00:52:41.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T00:52:41.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi002/store.db/MANIFEST-000009 2024-09-17T00:52:41.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-17T00:52:41.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T00:52:41.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.merge_operator: 2024-09-17T00:52:41.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compaction_filter: None 2024-09-17T00:52:41.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T00:52:41.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T00:52:41.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T00:52:41.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T00:52:41.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55df2314da38) 2024-09-17T00:52:41.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: cache_index_and_filter_blocks: 1 2024-09-17T00:52:41.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T00:52:41.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T00:52:41.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: pin_top_level_index_and_filter: 1 2024-09-17T00:52:41.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_type: 0 2024-09-17T00:52:41.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_block_index_type: 0 2024-09-17T00:52:41.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_shortening: 1 2024-09-17T00:52:41.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T00:52:41.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: hash_index_allow_collision: 1 2024-09-17T00:52:41.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: checksum: 1 2024-09-17T00:52:41.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: no_block_cache: 0 2024-09-17T00:52:41.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache: 0x55df231831f0 2024-09-17T00:52:41.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_name: BinnedLRUCache 2024-09-17T00:52:41.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_options: 2024-09-17T00:52:41.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: capacity : 536870912 2024-09-17T00:52:41.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: num_shard_bits : 4 2024-09-17T00:52:41.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: strict_capacity_limit : 0 2024-09-17T00:52:41.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: high_pri_pool_ratio: 0.000 2024-09-17T00:52:41.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_compressed: (nil) 2024-09-17T00:52:41.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: persistent_cache: (nil) 2024-09-17T00:52:41.523 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_size: 4096 2024-09-17T00:52:41.523 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_size_deviation: 10 2024-09-17T00:52:41.523 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_restart_interval: 16 2024-09-17T00:52:41.523 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_block_restart_interval: 1 2024-09-17T00:52:41.523 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: metadata_block_size: 4096 2024-09-17T00:52:41.523 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: partition_filters: 0 2024-09-17T00:52:41.523 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: use_delta_encoding: 1 2024-09-17T00:52:41.523 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-17T00:52:41.523 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: whole_key_filtering: 1 2024-09-17T00:52:41.523 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: verify_compression: 0 2024-09-17T00:52:41.523 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: read_amp_bytes_per_bit: 0 2024-09-17T00:52:41.523 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: format_version: 4 2024-09-17T00:52:41.523 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: enable_index_compression: 1 2024-09-17T00:52:41.523 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_align: 0 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compression: NoCompression 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.num_levels: 7 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T00:52:41.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T00:52:41.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T00:52:41.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T00:52:41.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T00:52:41.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T00:52:41.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T00:52:41.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T00:52:41.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T00:52:41.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T00:52:41.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T00:52:41.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T00:52:41.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T00:52:41.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T00:52:41.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T00:52:41.525 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T00:52:41.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T00:52:41.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T00:52:41.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T00:52:41.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T00:52:41.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T00:52:41.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T00:52:41.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T00:52:41.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T00:52:41.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T00:52:41.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T00:52:41.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T00:52:41.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T00:52:41.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.arena_block_size: 4194304 2024-09-17T00:52:41.527 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T00:52:41.527 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T00:52:41.527 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-17T00:52:41.527 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T00:52:41.527 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T00:52:41.527 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T00:52:41.527 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T00:52:41.527 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T00:52:41.527 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T00:52:41.527 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T00:52:41.527 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T00:52:41.527 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T00:52:41.527 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T00:52:41.527 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T00:52:41.528 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T00:52:41.528 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.inplace_update_support: 0 2024-09-17T00:52:41.528 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T00:52:41.528 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T00:52:41.528 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T00:52:41.528 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T00:52:41.528 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.bloom_locality: 0 2024-09-17T00:52:41.528 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.max_successive_merges: 0 2024-09-17T00:52:41.528 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T00:52:41.528 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T00:52:41.528 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T00:52:41.528 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T00:52:41.528 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.ttl: 2592000 2024-09-17T00:52:41.528 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T00:52:41.529 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.enable_blob_files: false 2024-09-17T00:52:41.529 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.min_blob_size: 0 2024-09-17T00:52:41.529 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T00:52:41.529 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T00:52:41.529 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T00:52:41.529 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T00:52:41.529 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi002/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T00:52:41.529 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-17T00:52:41.529 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-17T00:52:41.529 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534361452601, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-17T00:52:41.529 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-17T00:52:41.530 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-17T00:52:41.530 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534361453906, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93314, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91394, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13564, "raw_average_key_size": 49, "raw_value_size": 83976, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726534361, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "c3a10afe-7c48-40a3-bfa0-72e2997c7948", "db_session_id": "2P90CSVK36R1HMBG6GF6"}} 2024-09-17T00:52:41.530 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-17T00:52:41.530 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726534361454385, "job": 1, "event": "recovery_finished"} 2024-09-17T00:52:41.530 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi002/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T00:52:41.530 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55df231b6700 2024-09-17T00:52:41.530 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: DB pointer 0x55df23186000 2024-09-17T00:52:41.530 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-17T00:52:41.530 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-17T00:52:41.530 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** DB Stats ** 2024-09-17T00:52:41.530 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T00:52:41.530 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T00:52:41.530 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T00:52:41.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T00:52:41.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T00:52:41.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-17T00:52:41.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T00:52:41.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T00:52:41.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-17T00:52:41.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T00:52:41.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T00:52:41.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: L0 2/0 92.95 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.3 0.00 0.00 1 0.001 0 0 2024-09-17T00:52:41.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Sum 2/0 92.95 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.3 0.00 0.00 1 0.001 0 0 2024-09-17T00:52:41.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.3 0.00 0.00 1 0.001 0 0 2024-09-17T00:52:41.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T00:52:41.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-17T00:52:41.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T00:52:41.532 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T00:52:41.532 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 104.3 0.00 0.00 1 0.001 0 0 2024-09-17T00:52:41.532 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T00:52:41.532 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T00:52:41.532 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T00:52:41.532 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T00:52:41.532 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T00:52:41.532 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T00:52:41.532 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative compaction: 0.00 GB write, 18.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T00:52:41.532 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval compaction: 0.00 GB write, 18.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T00:52:41.532 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T00:52:41.532 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T00:52:41.532 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T00:52:41.532 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T00:52:41.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-17T00:52:41.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T00:52:41.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T00:52:41.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: L0 2/0 92.95 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.3 0.00 0.00 1 0.001 0 0 2024-09-17T00:52:41.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Sum 2/0 92.95 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 104.3 0.00 0.00 1 0.001 0 0 2024-09-17T00:52:41.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-17T00:52:41.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T00:52:41.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-17T00:52:41.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-17T00:52:41.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T00:52:41.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 104.3 0.00 0.00 1 0.001 0 0 2024-09-17T00:52:41.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T00:52:41.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative compaction: 0.00 GB write, 18.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: starting mon.smithi002 rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi002 fsid f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: mon.smithi002@-1(???) e1 preinit fsid f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: mon.smithi002@-1(???).mds e1 new map 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: mon.smithi002@-1(???).mds e1 print_map 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: e1 2024-09-17T00:52:41.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: legacy client fscid: -1 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: No filesystems configured 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: mon.smithi002@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: mon.smithi002@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: mon.smithi002@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: mon.smithi002@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: mon.smithi002@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 bash[27632]: 08b932b41bfa9090a8319243a47c8fa2a55f2bd4c8a1ebd2ac0d31fc727706dc 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 systemd[1]: Started Ceph mon.smithi002 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: mon.smithi002 is new leader, mons smithi002 in quorum (ranks 0) 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: monmap e1: 1 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: fsmap 2024-09-17T00:52:41.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: osdmap e1: 0 total, 0 up, 0 in 2024-09-17T00:52:41.536 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:41 smithi002 ceph-mon[27650]: mgrmap e1: no daemons active 2024-09-17T00:52:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.899+0000 7f3305f75640 1 Processor -- start 2024-09-17T00:52:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.899+0000 7f3305f75640 1 -- start start 2024-09-17T00:52:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.899+0000 7f3305f75640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3300102440 0x7f3300102850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.899+0000 7f3305f75640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3300102d90 con 0x7f3300102440 2024-09-17T00:52:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.900+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3300102440 0x7f3300102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.900+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3300102440 0x7f3300102850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40638/0 (socket says 172.21.15.2:40638) 2024-09-17T00:52:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.900+0000 7f32ff7fe640 1 -- 172.21.15.2:0/2403929786 learned_addr learned my addr 172.21.15.2:0/2403929786 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.900+0000 7f32ff7fe640 1 -- 172.21.15.2:0/2403929786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3300102ed0 con 0x7f3300102440 2024-09-17T00:52:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.902+0000 7f32ff7fe640 1 --2- 172.21.15.2:0/2403929786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3300102440 0x7f3300102850 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f32f000baf0 tx=0x7f32f000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e6149ac50fbd92 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.902+0000 7f32fe7fc640 1 -- 172.21.15.2:0/2403929786 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32f00327a0 con 0x7f3300102440 2024-09-17T00:52:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.902+0000 7f32fe7fc640 1 -- 172.21.15.2:0/2403929786 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f32f0032d60 con 0x7f3300102440 2024-09-17T00:52:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.902+0000 7f32fe7fc640 1 -- 172.21.15.2:0/2403929786 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32f0031df0 con 0x7f3300102440 2024-09-17T00:52:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.903+0000 7f3305f75640 1 -- 172.21.15.2:0/2403929786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3300102440 msgr2=0x7f3300102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.903+0000 7f3305f75640 1 --2- 172.21.15.2:0/2403929786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3300102440 0x7f3300102850 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f32f000baf0 tx=0x7f32f000b460 comp rx=0 tx=0).stop 2024-09-17T00:52:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.903+0000 7f3305f75640 1 -- 172.21.15.2:0/2403929786 shutdown_connections 2024-09-17T00:52:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.903+0000 7f3305f75640 1 --2- 172.21.15.2:0/2403929786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3300102440 0x7f3300102850 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.903+0000 7f3305f75640 1 -- 172.21.15.2:0/2403929786 >> 172.21.15.2:0/2403929786 conn(0x7f33000fbde0 msgr2=0x7f33000fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.903+0000 7f3305f75640 1 -- 172.21.15.2:0/2403929786 shutdown_connections 2024-09-17T00:52:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.903+0000 7f3305f75640 1 -- 172.21.15.2:0/2403929786 wait complete. 2024-09-17T00:52:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.903+0000 7f3305f75640 1 Processor -- start 2024-09-17T00:52:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.904+0000 7f3305f75640 1 -- start start 2024-09-17T00:52:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.904+0000 7f3305f75640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3300102440 0x7f330010eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.904+0000 7f3305f75640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330010f0e0 con 0x7f3300102440 2024-09-17T00:52:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.904+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3300102440 0x7f330010eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.904+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3300102440 0x7f330010eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40652/0 (socket says 172.21.15.2:40652) 2024-09-17T00:52:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.904+0000 7f32ff7fe640 1 -- 172.21.15.2:0/371748173 learned_addr learned my addr 172.21.15.2:0/371748173 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.904+0000 7f32ff7fe640 1 -- 172.21.15.2:0/371748173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f000b700 con 0x7f3300102440 2024-09-17T00:52:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.904+0000 7f32ff7fe640 1 --2- 172.21.15.2:0/371748173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3300102440 0x7f330010eba0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f32f0031ad0 tx=0x7f32f000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.904+0000 7f32e7fff640 1 -- 172.21.15.2:0/371748173 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32f0032a30 con 0x7f3300102440 2024-09-17T00:52:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.905+0000 7f32e7fff640 1 -- 172.21.15.2:0/371748173 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f32f0032b90 con 0x7f3300102440 2024-09-17T00:52:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.905+0000 7f3305f75640 1 -- 172.21.15.2:0/371748173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330010f2e0 con 0x7f3300102440 2024-09-17T00:52:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.905+0000 7f32e7fff640 1 -- 172.21.15.2:0/371748173 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f32f00447d0 con 0x7f3300102440 2024-09-17T00:52:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.905+0000 7f3305f75640 1 -- 172.21.15.2:0/371748173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330010f750 con 0x7f3300102440 2024-09-17T00:52:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.905+0000 7f32e7fff640 1 -- 172.21.15.2:0/371748173 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f32f0044930 con 0x7f3300102440 2024-09-17T00:52:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.905+0000 7f32e7fff640 1 -- 172.21.15.2:0/371748173 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f32f004ec70 con 0x7f3300102440 2024-09-17T00:52:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.906+0000 7f3305f75640 1 -- 172.21.15.2:0/371748173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330004b720 con 0x7f3300102440 2024-09-17T00:52:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.908+0000 7f32e7fff640 1 -- 172.21.15.2:0/371748173 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f330010f750 con 0x7f3300102440 2024-09-17T00:52:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.969+0000 7f3305f75640 1 -- 172.21.15.2:0/371748173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f3300100b20 con 0x7f3300102440 2024-09-17T00:52:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.971+0000 7f32e7fff640 1 -- 172.21.15.2:0/371748173 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f32f0049070 con 0x7f3300102440 2024-09-17T00:52:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.972+0000 7f3305f75640 1 -- 172.21.15.2:0/371748173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3300102440 msgr2=0x7f330010eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.972+0000 7f3305f75640 1 --2- 172.21.15.2:0/371748173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3300102440 0x7f330010eba0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f32f0031ad0 tx=0x7f32f000b460 comp rx=0 tx=0).stop 2024-09-17T00:52:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.972+0000 7f3305f75640 1 -- 172.21.15.2:0/371748173 shutdown_connections 2024-09-17T00:52:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.972+0000 7f3305f75640 1 --2- 172.21.15.2:0/371748173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3300102440 0x7f330010eba0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.972+0000 7f3305f75640 1 -- 172.21.15.2:0/371748173 >> 172.21.15.2:0/371748173 conn(0x7f33000fbde0 msgr2=0x7f3300105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.972+0000 7f3305f75640 1 -- 172.21.15.2:0/371748173 shutdown_connections 2024-09-17T00:52:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:41.972+0000 7f3305f75640 1 -- 172.21.15.2:0/371748173 wait complete. 2024-09-17T00:52:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-17T00:52:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-17T00:52:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mgr... 2024-09-17T00:52:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-17T00:52:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-17T00:52:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-17T00:52:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f8e82564-748e-11ef-bceb-c7b262605968@mgr.smithi002.vjeexr 2024-09-17T00:52:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f8e82564-748e-11ef-bceb-c7b262605968@mgr.smithi002.vjeexr.service: Unit ceph-f8e82564-748e-11ef-bceb-c7b262605968@mgr.smithi002.vjeexr.service not loaded. 2024-09-17T00:52:42.866 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f8e82564-748e-11ef-bceb-c7b262605968.target.wants/ceph-f8e82564-748e-11ef-bceb-c7b262605968@mgr.smithi002.vjeexr.service → /etc/systemd/system/ceph-f8e82564-748e-11ef-bceb-c7b262605968@.service. 2024-09-17T00:52:43.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:42 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/371748173' entity='client.admin' 2024-09-17T00:52:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T00:52:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-17T00:52:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T00:52:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-17T00:52:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-17T00:52:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T00:52:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T00:52:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-17T00:52:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T00:52:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-17T00:52:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-17T00:52:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-17T00:52:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr to start... 2024-09-17T00:52:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr... 2024-09-17T00:52:44.100 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:43 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2309859638' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T00:52:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-17T00:52:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-17T00:52:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "f8e82564-748e-11ef-bceb-c7b262605968", 2024-09-17T00:52:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T00:52:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T00:52:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T00:52:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T00:52:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T00:52:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T00:52:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-17T00:52:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:52:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T00:52:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "smithi002" 2024-09-17T00:52:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:52:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-17T00:52:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T00:52:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:52:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-17T00:52:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T00:52:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T00:52:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:52:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T00:52:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T00:52:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T00:52:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T00:52:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T00:52:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T00:52:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T00:52:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T00:52:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T00:52:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T00:52:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T00:52:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T00:52:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T00:52:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T00:52:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T00:52:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T00:52:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:52:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T00:52:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T00:52:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T00:52:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T00:52:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T00:52:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T00:52:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T00:52:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T00:52:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T00:52:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:52:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T00:52:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T00:52:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:52:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T00:52:36.852071+0000", 2024-09-17T00:52:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T00:52:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T00:52:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-17T00:52:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.856+0000 7fc7911fd640 1 Processor -- start 2024-09-17T00:52:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.857+0000 7fc7911fd640 1 -- start start 2024-09-17T00:52:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.857+0000 7fc7911fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c100e40 0x7fc78c101250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.857+0000 7fc7911fd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c101790 con 0x7fc78c100e40 2024-09-17T00:52:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.857+0000 7fc78ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c100e40 0x7fc78c101250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.857+0000 7fc78ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c100e40 0x7fc78c101250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40676/0 (socket says 172.21.15.2:40676) 2024-09-17T00:52:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.857+0000 7fc78ad9d640 1 -- 172.21.15.2:0/3320870946 learned_addr learned my addr 172.21.15.2:0/3320870946 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.858+0000 7fc78ad9d640 1 -- 172.21.15.2:0/3320870946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c1018d0 con 0x7fc78c100e40 2024-09-17T00:52:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.858+0000 7fc78ad9d640 1 --2- 172.21.15.2:0/3320870946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c100e40 0x7fc78c101250 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009840 tx=0x7fc77c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5479d94045662b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.859+0000 7fc789d9b640 1 -- 172.21.15.2:0/3320870946 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc77c032440 con 0x7fc78c100e40 2024-09-17T00:52:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.859+0000 7fc789d9b640 1 -- 172.21.15.2:0/3320870946 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fc77c032a00 con 0x7fc78c100e40 2024-09-17T00:52:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.859+0000 7fc789d9b640 1 -- 172.21.15.2:0/3320870946 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc77c0319e0 con 0x7fc78c100e40 2024-09-17T00:52:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.859+0000 7fc7911fd640 1 -- 172.21.15.2:0/3320870946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c100e40 msgr2=0x7fc78c101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.859+0000 7fc7911fd640 1 --2- 172.21.15.2:0/3320870946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c100e40 0x7fc78c101250 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc77c009840 tx=0x7fc77c0091d0 comp rx=0 tx=0).stop 2024-09-17T00:52:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.859+0000 7fc7911fd640 1 -- 172.21.15.2:0/3320870946 shutdown_connections 2024-09-17T00:52:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.859+0000 7fc7911fd640 1 --2- 172.21.15.2:0/3320870946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c100e40 0x7fc78c101250 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.859+0000 7fc7911fd640 1 -- 172.21.15.2:0/3320870946 >> 172.21.15.2:0/3320870946 conn(0x7fc78c0fc560 msgr2=0x7fc78c0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.859+0000 7fc7911fd640 1 -- 172.21.15.2:0/3320870946 shutdown_connections 2024-09-17T00:52:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.859+0000 7fc7911fd640 1 -- 172.21.15.2:0/3320870946 wait complete. 2024-09-17T00:52:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.860+0000 7fc7911fd640 1 Processor -- start 2024-09-17T00:52:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.860+0000 7fc7911fd640 1 -- start start 2024-09-17T00:52:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.860+0000 7fc7911fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c100e40 0x7fc78c1070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.860+0000 7fc7911fd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c1075f0 con 0x7fc78c100e40 2024-09-17T00:52:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.860+0000 7fc78ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c100e40 0x7fc78c1070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.860+0000 7fc78ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c100e40 0x7fc78c1070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40686/0 (socket says 172.21.15.2:40686) 2024-09-17T00:52:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.860+0000 7fc78ad9d640 1 -- 172.21.15.2:0/2309859638 learned_addr learned my addr 172.21.15.2:0/2309859638 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.861+0000 7fc78ad9d640 1 -- 172.21.15.2:0/2309859638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c009450 con 0x7fc78c100e40 2024-09-17T00:52:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.861+0000 7fc78ad9d640 1 --2- 172.21.15.2:0/2309859638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c100e40 0x7fc78c1070b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc77c000c00 tx=0x7fc77c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.861+0000 7fc7737fe640 1 -- 172.21.15.2:0/2309859638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc77c03d450 con 0x7fc78c100e40 2024-09-17T00:52:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.861+0000 7fc7737fe640 1 -- 172.21.15.2:0/2309859638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fc77c03da10 con 0x7fc78c100e40 2024-09-17T00:52:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.861+0000 7fc7911fd640 1 -- 172.21.15.2:0/2309859638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78c105680 con 0x7fc78c100e40 2024-09-17T00:52:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.861+0000 7fc7737fe640 1 -- 172.21.15.2:0/2309859638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc77c03b8e0 con 0x7fc78c100e40 2024-09-17T00:52:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.861+0000 7fc7911fd640 1 -- 172.21.15.2:0/2309859638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78c105af0 con 0x7fc78c100e40 2024-09-17T00:52:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.861+0000 7fc7737fe640 1 -- 172.21.15.2:0/2309859638 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fc77c039070 con 0x7fc78c100e40 2024-09-17T00:52:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.862+0000 7fc7737fe640 1 -- 172.21.15.2:0/2309859638 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc77c0467e0 con 0x7fc78c100e40 2024-09-17T00:52:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.862+0000 7fc7911fd640 1 -- 172.21.15.2:0/2309859638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78c05ed70 con 0x7fc78c100e40 2024-09-17T00:52:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.864+0000 7fc7737fe640 1 -- 172.21.15.2:0/2309859638 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fc77c0657a0 con 0x7fc78c100e40 2024-09-17T00:52:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.925+0000 7fc7911fd640 1 -- 172.21.15.2:0/2309859638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc78c102bc0 con 0x7fc78c100e40 2024-09-17T00:52:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.926+0000 7fc7737fe640 1 -- 172.21.15.2:0/2309859638 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fc77c054020 con 0x7fc78c100e40 2024-09-17T00:52:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.927+0000 7fc7911fd640 1 -- 172.21.15.2:0/2309859638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c100e40 msgr2=0x7fc78c1070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.927+0000 7fc7911fd640 1 --2- 172.21.15.2:0/2309859638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c100e40 0x7fc78c1070b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc77c000c00 tx=0x7fc77c008040 comp rx=0 tx=0).stop 2024-09-17T00:52:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.927+0000 7fc7911fd640 1 -- 172.21.15.2:0/2309859638 shutdown_connections 2024-09-17T00:52:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.927+0000 7fc7911fd640 1 --2- 172.21.15.2:0/2309859638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c100e40 0x7fc78c1070b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.927+0000 7fc7911fd640 1 -- 172.21.15.2:0/2309859638 >> 172.21.15.2:0/2309859638 conn(0x7fc78c0fc560 msgr2=0x7fc78c0fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.927+0000 7fc7911fd640 1 -- 172.21.15.2:0/2309859638 shutdown_connections 2024-09-17T00:52:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:43.927+0000 7fc7911fd640 1 -- 172.21.15.2:0/2309859638 wait complete. 2024-09-17T00:52:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (1/15)... 2024-09-17T00:52:47.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:46 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3571604238' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T00:52:47.550 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-17T00:52:47.550 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-17T00:52:47.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "f8e82564-748e-11ef-bceb-c7b262605968", 2024-09-17T00:52:47.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T00:52:47.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T00:52:47.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T00:52:47.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T00:52:47.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:47.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T00:52:47.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T00:52:47.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-17T00:52:47.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:52:47.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T00:52:47.551 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "smithi002" 2024-09-17T00:52:47.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:52:47.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-17T00:52:47.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T00:52:47.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:52:47.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-17T00:52:47.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T00:52:47.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:47.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T00:52:47.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:52:47.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T00:52:47.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T00:52:47.552 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T00:52:47.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T00:52:47.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T00:52:47.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T00:52:47.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:47.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T00:52:47.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T00:52:47.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T00:52:47.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T00:52:47.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T00:52:47.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T00:52:47.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T00:52:47.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T00:52:47.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T00:52:47.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:47.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T00:52:47.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:52:47.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T00:52:47.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T00:52:47.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:47.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T00:52:47.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T00:52:47.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T00:52:47.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T00:52:47.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T00:52:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T00:52:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T00:52:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:52:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T00:52:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T00:52:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:52:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T00:52:36.852071+0000", 2024-09-17T00:52:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T00:52:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T00:52:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-17T00:52:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.844+0000 7f6ba4f3e640 1 Processor -- start 2024-09-17T00:52:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.844+0000 7f6ba4f3e640 1 -- start start 2024-09-17T00:52:47.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.844+0000 7f6ba4f3e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba0076ca0 0x7f6ba0104a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:47.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.844+0000 7f6ba4f3e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba0104fd0 con 0x7f6ba0076ca0 2024-09-17T00:52:47.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.844+0000 7f6b9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba0076ca0 0x7f6ba0104a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:47.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.844+0000 7f6b9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba0076ca0 0x7f6ba0104a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40696/0 (socket says 172.21.15.2:40696) 2024-09-17T00:52:47.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.844+0000 7f6b9e59c640 1 -- 172.21.15.2:0/2199772450 learned_addr learned my addr 172.21.15.2:0/2199772450 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:47.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.845+0000 7f6b9e59c640 1 -- 172.21.15.2:0/2199772450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba0105110 con 0x7f6ba0076ca0 2024-09-17T00:52:47.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.845+0000 7f6b9e59c640 1 --2- 172.21.15.2:0/2199772450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba0076ca0 0x7f6ba0104a90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009840 tx=0x7f6b900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cf60046214c845 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:47.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.845+0000 7f6b9d59a640 1 -- 172.21.15.2:0/2199772450 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b90032440 con 0x7f6ba0076ca0 2024-09-17T00:52:47.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.846+0000 7f6b9d59a640 1 -- 172.21.15.2:0/2199772450 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6b90032a00 con 0x7f6ba0076ca0 2024-09-17T00:52:47.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.846+0000 7f6b9d59a640 1 -- 172.21.15.2:0/2199772450 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b900319e0 con 0x7f6ba0076ca0 2024-09-17T00:52:47.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.846+0000 7f6ba4f3e640 1 -- 172.21.15.2:0/2199772450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba0076ca0 msgr2=0x7f6ba0104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:47.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.846+0000 7f6ba4f3e640 1 --2- 172.21.15.2:0/2199772450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba0076ca0 0x7f6ba0104a90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009840 tx=0x7f6b900091d0 comp rx=0 tx=0).stop 2024-09-17T00:52:47.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.846+0000 7f6ba4f3e640 1 -- 172.21.15.2:0/2199772450 shutdown_connections 2024-09-17T00:52:47.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.846+0000 7f6ba4f3e640 1 --2- 172.21.15.2:0/2199772450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba0076ca0 0x7f6ba0104a90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:47.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.846+0000 7f6ba4f3e640 1 -- 172.21.15.2:0/2199772450 >> 172.21.15.2:0/2199772450 conn(0x7f6ba00fc560 msgr2=0x7f6ba00fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:47.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.846+0000 7f6ba4f3e640 1 -- 172.21.15.2:0/2199772450 shutdown_connections 2024-09-17T00:52:47.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.846+0000 7f6ba4f3e640 1 -- 172.21.15.2:0/2199772450 wait complete. 2024-09-17T00:52:47.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.847+0000 7f6ba4f3e640 1 Processor -- start 2024-09-17T00:52:47.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.847+0000 7f6ba4f3e640 1 -- start start 2024-09-17T00:52:47.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.847+0000 7f6ba4f3e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba0076ca0 0x7f6ba0110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:47.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.847+0000 7f6ba4f3e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba0111330 con 0x7f6ba0076ca0 2024-09-17T00:52:47.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.847+0000 7f6b9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba0076ca0 0x7f6ba0110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:47.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.847+0000 7f6b9e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba0076ca0 0x7f6ba0110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40708/0 (socket says 172.21.15.2:40708) 2024-09-17T00:52:47.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.847+0000 7f6b9e59c640 1 -- 172.21.15.2:0/3571604238 learned_addr learned my addr 172.21.15.2:0/3571604238 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:47.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.847+0000 7f6b9e59c640 1 -- 172.21.15.2:0/3571604238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b90009450 con 0x7f6ba0076ca0 2024-09-17T00:52:47.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.848+0000 7f6b9e59c640 1 --2- 172.21.15.2:0/3571604238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba0076ca0 0x7f6ba0110df0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6b90006f00 tx=0x7f6b90008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:47.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.848+0000 7f6b8effd640 1 -- 172.21.15.2:0/3571604238 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b90031e30 con 0x7f6ba0076ca0 2024-09-17T00:52:47.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.848+0000 7f6b8effd640 1 -- 172.21.15.2:0/3571604238 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6b9003d8b0 con 0x7f6ba0076ca0 2024-09-17T00:52:47.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.848+0000 7f6ba4f3e640 1 -- 172.21.15.2:0/3571604238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba0111530 con 0x7f6ba0076ca0 2024-09-17T00:52:47.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.848+0000 7f6b8effd640 1 -- 172.21.15.2:0/3571604238 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b9003b8f0 con 0x7f6ba0076ca0 2024-09-17T00:52:47.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.848+0000 7f6ba4f3e640 1 -- 172.21.15.2:0/3571604238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba0111f80 con 0x7f6ba0076ca0 2024-09-17T00:52:47.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.848+0000 7f6b8effd640 1 -- 172.21.15.2:0/3571604238 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6b90039070 con 0x7f6ba0076ca0 2024-09-17T00:52:47.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.848+0000 7f6b8effd640 1 -- 172.21.15.2:0/3571604238 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6b900468e0 con 0x7f6ba0076ca0 2024-09-17T00:52:47.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.849+0000 7f6ba4f3e640 1 -- 172.21.15.2:0/3571604238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba005ed70 con 0x7f6ba0076ca0 2024-09-17T00:52:47.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.851+0000 7f6b8effd640 1 -- 172.21.15.2:0/3571604238 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f6b900657a0 con 0x7f6ba0076ca0 2024-09-17T00:52:47.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.911+0000 7f6ba4f3e640 1 -- 172.21.15.2:0/3571604238 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6ba0105ec0 con 0x7f6ba0076ca0 2024-09-17T00:52:47.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.911+0000 7f6b8effd640 1 -- 172.21.15.2:0/3571604238 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f6b90054020 con 0x7f6ba0076ca0 2024-09-17T00:52:47.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.913+0000 7f6ba4f3e640 1 -- 172.21.15.2:0/3571604238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba0076ca0 msgr2=0x7f6ba0110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:47.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.913+0000 7f6ba4f3e640 1 --2- 172.21.15.2:0/3571604238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba0076ca0 0x7f6ba0110df0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6b90006f00 tx=0x7f6b90008040 comp rx=0 tx=0).stop 2024-09-17T00:52:47.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.913+0000 7f6ba4f3e640 1 -- 172.21.15.2:0/3571604238 shutdown_connections 2024-09-17T00:52:47.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.913+0000 7f6ba4f3e640 1 --2- 172.21.15.2:0/3571604238 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba0076ca0 0x7f6ba0110df0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:47.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.913+0000 7f6ba4f3e640 1 -- 172.21.15.2:0/3571604238 >> 172.21.15.2:0/3571604238 conn(0x7f6ba00fc560 msgr2=0x7f6ba00fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:47.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.913+0000 7f6ba4f3e640 1 -- 172.21.15.2:0/3571604238 shutdown_connections 2024-09-17T00:52:47.567 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:46.913+0000 7f6ba4f3e640 1 -- 172.21.15.2:0/3571604238 wait complete. 2024-09-17T00:52:47.567 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (2/15)... 2024-09-17T00:52:48.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:47 smithi002 ceph-mon[27650]: Activating manager daemon smithi002.vjeexr 2024-09-17T00:52:48.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:47 smithi002 ceph-mon[27650]: mgrmap e2: smithi002.vjeexr(active, starting, since 0.00309769s) 2024-09-17T00:52:48.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:47 smithi002 ceph-mon[27650]: from='mgr.14100 172.21.15.2:0/375448617' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T00:52:48.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:47 smithi002 ceph-mon[27650]: from='mgr.14100 172.21.15.2:0/375448617' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T00:52:48.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:47 smithi002 ceph-mon[27650]: from='mgr.14100 172.21.15.2:0/375448617' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T00:52:48.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:47 smithi002 ceph-mon[27650]: from='mgr.14100 172.21.15.2:0/375448617' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T00:52:48.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:47 smithi002 ceph-mon[27650]: from='mgr.14100 172.21.15.2:0/375448617' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr metadata", "who": "smithi002.vjeexr", "id": "smithi002.vjeexr"}]: dispatch 2024-09-17T00:52:48.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:47 smithi002 ceph-mon[27650]: Manager daemon smithi002.vjeexr is now available 2024-09-17T00:52:48.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:47 smithi002 ceph-mon[27650]: from='mgr.14100 172.21.15.2:0/375448617' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:52:48.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:47 smithi002 ceph-mon[27650]: from='mgr.14100 172.21.15.2:0/375448617' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/trash_purge_schedule"}]: dispatch 2024-09-17T00:52:48.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:47 smithi002 ceph-mon[27650]: from='mgr.14100 172.21.15.2:0/375448617' entity='mgr.smithi002.vjeexr' 2024-09-17T00:52:48.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:47 smithi002 ceph-mon[27650]: from='mgr.14100 172.21.15.2:0/375448617' entity='mgr.smithi002.vjeexr' 2024-09-17T00:52:48.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:47 smithi002 ceph-mon[27650]: from='mgr.14100 172.21.15.2:0/375448617' entity='mgr.smithi002.vjeexr' 2024-09-17T00:52:49.956 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:49 smithi002 ceph-mon[27650]: mgrmap e3: smithi002.vjeexr(active, since 1.00669s) 2024-09-17T00:52:50.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-17T00:52:50.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-17T00:52:50.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "f8e82564-748e-11ef-bceb-c7b262605968", 2024-09-17T00:52:50.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T00:52:50.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T00:52:50.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T00:52:50.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T00:52:50.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:50.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T00:52:50.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T00:52:50.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-09-17T00:52:50.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:52:50.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T00:52:50.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "smithi002" 2024-09-17T00:52:50.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:52:50.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-17T00:52:50.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T00:52:50.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:52:50.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-17T00:52:50.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T00:52:50.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:50.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T00:52:50.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:52:50.820 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T00:52:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T00:52:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T00:52:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T00:52:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T00:52:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T00:52:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T00:52:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T00:52:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T00:52:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T00:52:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T00:52:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T00:52:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T00:52:50.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T00:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T00:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T00:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T00:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T00:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T00:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T00:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T00:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T00:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T00:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T00:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T00:52:50.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-09-17T00:52:50.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T00:52:50.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:50.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T00:52:50.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T00:52:50.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T00:52:36.852071+0000", 2024-09-17T00:52:50.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T00:52:50.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-09-17T00:52:50.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T00:52:50.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-17T00:52:50.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.964+0000 7ff1f557b640 1 Processor -- start 2024-09-17T00:52:50.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.964+0000 7ff1f557b640 1 -- start start 2024-09-17T00:52:50.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.964+0000 7ff1f557b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1f01014b0 0x7ff1f01018c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.964+0000 7ff1f557b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f0101e00 con 0x7ff1f01014b0 2024-09-17T00:52:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.965+0000 7ff1eeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1f01014b0 0x7ff1f01018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.965+0000 7ff1eeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1f01014b0 0x7ff1f01018c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40786/0 (socket says 172.21.15.2:40786) 2024-09-17T00:52:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.965+0000 7ff1eeffd640 1 -- 172.21.15.2:0/224048809 learned_addr learned my addr 172.21.15.2:0/224048809 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.965+0000 7ff1eeffd640 1 -- 172.21.15.2:0/224048809 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f0101f40 con 0x7ff1f01014b0 2024-09-17T00:52:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.966+0000 7ff1eeffd640 1 --2- 172.21.15.2:0/224048809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1f01014b0 0x7ff1f01018c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009840 tx=0x7ff1e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81576c5c1fbab6cf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.966+0000 7ff1edffb640 1 -- 172.21.15.2:0/224048809 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1e0032440 con 0x7ff1f01014b0 2024-09-17T00:52:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.966+0000 7ff1edffb640 1 -- 172.21.15.2:0/224048809 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff1e0032a00 con 0x7ff1f01014b0 2024-09-17T00:52:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.966+0000 7ff1edffb640 1 -- 172.21.15.2:0/224048809 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1e00319e0 con 0x7ff1f01014b0 2024-09-17T00:52:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.966+0000 7ff1f557b640 1 -- 172.21.15.2:0/224048809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1f01014b0 msgr2=0x7ff1f01018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.966+0000 7ff1f557b640 1 --2- 172.21.15.2:0/224048809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1f01014b0 0x7ff1f01018c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009840 tx=0x7ff1e00091d0 comp rx=0 tx=0).stop 2024-09-17T00:52:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.967+0000 7ff1f557b640 1 -- 172.21.15.2:0/224048809 shutdown_connections 2024-09-17T00:52:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.967+0000 7ff1f557b640 1 --2- 172.21.15.2:0/224048809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1f01014b0 0x7ff1f01018c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:50.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.967+0000 7ff1f557b640 1 -- 172.21.15.2:0/224048809 >> 172.21.15.2:0/224048809 conn(0x7ff1f00fbde0 msgr2=0x7ff1f00fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:50.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.967+0000 7ff1f557b640 1 -- 172.21.15.2:0/224048809 shutdown_connections 2024-09-17T00:52:50.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.967+0000 7ff1f557b640 1 -- 172.21.15.2:0/224048809 wait complete. 2024-09-17T00:52:50.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.967+0000 7ff1f557b640 1 Processor -- start 2024-09-17T00:52:50.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.967+0000 7ff1f557b640 1 -- start start 2024-09-17T00:52:50.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.968+0000 7ff1f557b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1f01014b0 0x7ff1f0110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:50.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.968+0000 7ff1f557b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f0111340 con 0x7ff1f01014b0 2024-09-17T00:52:50.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.968+0000 7ff1eeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1f01014b0 0x7ff1f0110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:50.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.968+0000 7ff1eeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1f01014b0 0x7ff1f0110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40790/0 (socket says 172.21.15.2:40790) 2024-09-17T00:52:50.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.968+0000 7ff1eeffd640 1 -- 172.21.15.2:0/1624041261 learned_addr learned my addr 172.21.15.2:0/1624041261 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:50.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.968+0000 7ff1eeffd640 1 -- 172.21.15.2:0/1624041261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e0009450 con 0x7ff1f01014b0 2024-09-17T00:52:50.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.968+0000 7ff1eeffd640 1 --2- 172.21.15.2:0/1624041261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1f01014b0 0x7ff1f0110e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00098a0 tx=0x7ff1e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:50.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.968+0000 7ff1d77fe640 1 -- 172.21.15.2:0/1624041261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1e0032880 con 0x7ff1f01014b0 2024-09-17T00:52:50.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.968+0000 7ff1d77fe640 1 -- 172.21.15.2:0/1624041261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff1e003d8b0 con 0x7ff1f01014b0 2024-09-17T00:52:50.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.968+0000 7ff1f557b640 1 -- 172.21.15.2:0/1624041261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f0111540 con 0x7ff1f01014b0 2024-09-17T00:52:50.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.968+0000 7ff1d77fe640 1 -- 172.21.15.2:0/1624041261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1e003b8a0 con 0x7ff1f01014b0 2024-09-17T00:52:50.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.969+0000 7ff1f557b640 1 -- 172.21.15.2:0/1624041261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f0111f90 con 0x7ff1f01014b0 2024-09-17T00:52:50.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.969+0000 7ff1d77fe640 1 -- 172.21.15.2:0/1624041261 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7ff1e0039070 con 0x7ff1f01014b0 2024-09-17T00:52:50.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.969+0000 7ff1f557b640 1 -- 172.21.15.2:0/1624041261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f005ed70 con 0x7ff1f01014b0 2024-09-17T00:52:50.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.970+0000 7ff1d77fe640 1 --2- 172.21.15.2:0/1624041261 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7ff1d8039490 0x7ff1d803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:50.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.970+0000 7ff1d77fe640 1 -- 172.21.15.2:0/1624041261 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff1e006cf40 con 0x7ff1f01014b0 2024-09-17T00:52:50.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.970+0000 7ff1ee7fc640 1 --2- 172.21.15.2:0/1624041261 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7ff1d8039490 0x7ff1d803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:50.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.970+0000 7ff1ee7fc640 1 --2- 172.21.15.2:0/1624041261 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7ff1d8039490 0x7ff1d803b940 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4006fd0 tx=0x7ff1e4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:50.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:49.975+0000 7ff1d77fe640 1 -- 172.21.15.2:0/1624041261 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff1e004eda0 con 0x7ff1f01014b0 2024-09-17T00:52:50.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:50.205+0000 7ff1f557b640 1 -- 172.21.15.2:0/1624041261 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff1f004b720 con 0x7ff1f01014b0 2024-09-17T00:52:50.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:50.205+0000 7ff1d77fe640 1 -- 172.21.15.2:0/1624041261 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7ff1e0041070 con 0x7ff1f01014b0 2024-09-17T00:52:50.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:50.208+0000 7ff1f557b640 1 -- 172.21.15.2:0/1624041261 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7ff1d8039490 msgr2=0x7ff1d803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:50.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:50.208+0000 7ff1f557b640 1 --2- 172.21.15.2:0/1624041261 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7ff1d8039490 0x7ff1d803b940 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4006fd0 tx=0x7ff1e4006db0 comp rx=0 tx=0).stop 2024-09-17T00:52:50.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:50.208+0000 7ff1f557b640 1 -- 172.21.15.2:0/1624041261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1f01014b0 msgr2=0x7ff1f0110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:50.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:50.208+0000 7ff1f557b640 1 --2- 172.21.15.2:0/1624041261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1f01014b0 0x7ff1f0110e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00098a0 tx=0x7ff1e0008040 comp rx=0 tx=0).stop 2024-09-17T00:52:50.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:50.208+0000 7ff1f557b640 1 -- 172.21.15.2:0/1624041261 shutdown_connections 2024-09-17T00:52:50.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:50.208+0000 7ff1f557b640 1 --2- 172.21.15.2:0/1624041261 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7ff1d8039490 0x7ff1d803b940 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:50.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:50.208+0000 7ff1f557b640 1 --2- 172.21.15.2:0/1624041261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1f01014b0 0x7ff1f0110e00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:50.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:50.208+0000 7ff1f557b640 1 -- 172.21.15.2:0/1624041261 >> 172.21.15.2:0/1624041261 conn(0x7ff1f00fbde0 msgr2=0x7ff1f00fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:50.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:50.208+0000 7ff1f557b640 1 -- 172.21.15.2:0/1624041261 shutdown_connections 2024-09-17T00:52:50.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:50.208+0000 7ff1f557b640 1 -- 172.21.15.2:0/1624041261 wait complete. 2024-09-17T00:52:50.827 INFO:teuthology.orchestra.run.smithi002.stdout:mgr is available 2024-09-17T00:52:51.137 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:50 smithi002 ceph-mon[27650]: mgrmap e4: smithi002.vjeexr(active, since 2s) 2024-09-17T00:52:51.137 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:50 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/1624041261' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T00:52:52.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:52:51 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/226756926' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T00:52:57.888 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-17T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-17T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-17T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-09-17T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T00:52:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-17T00:52:57.890 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-17T00:52:57.890 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-17T00:52:57.890 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T00:52:57.890 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T00:52:57.890 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.218+0000 7fda67bf2640 1 Processor -- start 2024-09-17T00:52:57.890 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.219+0000 7fda67bf2640 1 -- start start 2024-09-17T00:52:57.890 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.219+0000 7fda67bf2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda60076ca0 0x7fda60104a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:57.890 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.219+0000 7fda67bf2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda60104fd0 con 0x7fda60076ca0 2024-09-17T00:52:57.890 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.219+0000 7fda6598e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda60076ca0 0x7fda60104a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:57.890 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.219+0000 7fda6598e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda60076ca0 0x7fda60104a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41084/0 (socket says 172.21.15.2:41084) 2024-09-17T00:52:57.890 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.219+0000 7fda6598e640 1 -- 172.21.15.2:0/2630997534 learned_addr learned my addr 172.21.15.2:0/2630997534 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:57.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.219+0000 7fda6598e640 1 -- 172.21.15.2:0/2630997534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda60105110 con 0x7fda60076ca0 2024-09-17T00:52:57.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.220+0000 7fda6598e640 1 --2- 172.21.15.2:0/2630997534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda60076ca0 0x7fda60104a90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009840 tx=0x7fda5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd39d007c8305f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:57.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.220+0000 7fda6498c640 1 -- 172.21.15.2:0/2630997534 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda5c032440 con 0x7fda60076ca0 2024-09-17T00:52:57.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.220+0000 7fda6498c640 1 -- 172.21.15.2:0/2630997534 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fda5c032a00 con 0x7fda60076ca0 2024-09-17T00:52:57.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.220+0000 7fda6498c640 1 -- 172.21.15.2:0/2630997534 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda5c0319e0 con 0x7fda60076ca0 2024-09-17T00:52:57.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.221+0000 7fda67bf2640 1 -- 172.21.15.2:0/2630997534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda60076ca0 msgr2=0x7fda60104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:57.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.221+0000 7fda67bf2640 1 --2- 172.21.15.2:0/2630997534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda60076ca0 0x7fda60104a90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009840 tx=0x7fda5c0091d0 comp rx=0 tx=0).stop 2024-09-17T00:52:57.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.221+0000 7fda67bf2640 1 -- 172.21.15.2:0/2630997534 shutdown_connections 2024-09-17T00:52:57.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.221+0000 7fda67bf2640 1 --2- 172.21.15.2:0/2630997534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda60076ca0 0x7fda60104a90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:57.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.221+0000 7fda67bf2640 1 -- 172.21.15.2:0/2630997534 >> 172.21.15.2:0/2630997534 conn(0x7fda600fc560 msgr2=0x7fda600fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:57.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.221+0000 7fda67bf2640 1 -- 172.21.15.2:0/2630997534 shutdown_connections 2024-09-17T00:52:57.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.221+0000 7fda67bf2640 1 -- 172.21.15.2:0/2630997534 wait complete. 2024-09-17T00:52:57.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.221+0000 7fda67bf2640 1 Processor -- start 2024-09-17T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.222+0000 7fda67bf2640 1 -- start start 2024-09-17T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.222+0000 7fda67bf2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda60076ca0 0x7fda60110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.222+0000 7fda67bf2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda60111330 con 0x7fda60076ca0 2024-09-17T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.222+0000 7fda6598e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda60076ca0 0x7fda60110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.222+0000 7fda6598e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda60076ca0 0x7fda60110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41094/0 (socket says 172.21.15.2:41094) 2024-09-17T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.222+0000 7fda6598e640 1 -- 172.21.15.2:0/226756926 learned_addr learned my addr 172.21.15.2:0/226756926 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.222+0000 7fda6598e640 1 -- 172.21.15.2:0/226756926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c009450 con 0x7fda60076ca0 2024-09-17T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.222+0000 7fda6598e640 1 --2- 172.21.15.2:0/226756926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda60076ca0 0x7fda60110df0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0098a0 tx=0x7fda5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.222+0000 7fda567fc640 1 -- 172.21.15.2:0/226756926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda5c032880 con 0x7fda60076ca0 2024-09-17T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.222+0000 7fda567fc640 1 -- 172.21.15.2:0/226756926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fda5c03d8b0 con 0x7fda60076ca0 2024-09-17T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.222+0000 7fda67bf2640 1 -- 172.21.15.2:0/226756926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda60111530 con 0x7fda60076ca0 2024-09-17T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.223+0000 7fda567fc640 1 -- 172.21.15.2:0/226756926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda5c03b8e0 con 0x7fda60076ca0 2024-09-17T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.223+0000 7fda67bf2640 1 -- 172.21.15.2:0/226756926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda60111f80 con 0x7fda60076ca0 2024-09-17T00:52:57.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.223+0000 7fda567fc640 1 -- 172.21.15.2:0/226756926 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fda5c039070 con 0x7fda60076ca0 2024-09-17T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.223+0000 7fda67bf2640 1 -- 172.21.15.2:0/226756926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6005ed70 con 0x7fda60076ca0 2024-09-17T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.224+0000 7fda567fc640 1 --2- 172.21.15.2:0/226756926 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fda4c039450 0x7fda4c03b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.224+0000 7fda567fc640 1 -- 172.21.15.2:0/226756926 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fda5c06cee0 con 0x7fda60076ca0 2024-09-17T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.224+0000 7fda6518d640 1 --2- 172.21.15.2:0/226756926 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fda4c039450 0x7fda4c03b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.224+0000 7fda6518d640 1 --2- 172.21.15.2:0/226756926 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fda4c039450 0x7fda4c03b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda50006fd0 tx=0x7fda50006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.228+0000 7fda567fc640 1 -- 172.21.15.2:0/226756926 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fda5c03da20 con 0x7fda60076ca0 2024-09-17T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.393+0000 7fda67bf2640 1 -- 172.21.15.2:0/226756926 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fda6004b720 con 0x7fda60076ca0 2024-09-17T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.395+0000 7fda567fc640 1 -- 172.21.15.2:0/226756926 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+409 (secure 0 0 0) 0x7fda5c041070 con 0x7fda60076ca0 2024-09-17T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.396+0000 7fda67bf2640 1 -- 172.21.15.2:0/226756926 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fda4c039450 msgr2=0x7fda4c03b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.396+0000 7fda67bf2640 1 --2- 172.21.15.2:0/226756926 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fda4c039450 0x7fda4c03b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda50006fd0 tx=0x7fda50006db0 comp rx=0 tx=0).stop 2024-09-17T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.396+0000 7fda67bf2640 1 -- 172.21.15.2:0/226756926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda60076ca0 msgr2=0x7fda60110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.396+0000 7fda67bf2640 1 --2- 172.21.15.2:0/226756926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda60076ca0 0x7fda60110df0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0098a0 tx=0x7fda5c008040 comp rx=0 tx=0).stop 2024-09-17T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.396+0000 7fda67bf2640 1 -- 172.21.15.2:0/226756926 shutdown_connections 2024-09-17T00:52:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.396+0000 7fda67bf2640 1 --2- 172.21.15.2:0/226756926 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fda4c039450 0x7fda4c03b900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:57.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.396+0000 7fda67bf2640 1 --2- 172.21.15.2:0/226756926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda60076ca0 0x7fda60110df0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:52:57.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.396+0000 7fda67bf2640 1 -- 172.21.15.2:0/226756926 >> 172.21.15.2:0/226756926 conn(0x7fda600fc560 msgr2=0x7fda600fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:52:57.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.397+0000 7fda67bf2640 1 -- 172.21.15.2:0/226756926 shutdown_connections 2024-09-17T00:52:57.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:52:51.397+0000 7fda67bf2640 1 -- 172.21.15.2:0/226756926 wait complete. 2024-09-17T00:52:57.894 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling cephadm module... 2024-09-17T00:53:01.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:01 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2809625164' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-17T00:53:02.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:02 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2809625164' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-17T00:53:02.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:02 smithi002 ceph-mon[27650]: mgrmap e5: smithi002.vjeexr(active, since 13s) 2024-09-17T00:53:02.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.895+0000 7fde5f317640 1 Processor -- start 2024-09-17T00:53:02.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.895+0000 7fde5f317640 1 -- start start 2024-09-17T00:53:02.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.895+0000 7fde5f317640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde58102440 0x7fde58102850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:02.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.895+0000 7fde5f317640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde58102d90 con 0x7fde58102440 2024-09-17T00:53:02.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.895+0000 7fde5d0b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde58102440 0x7fde58102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:02.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.895+0000 7fde5d0b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde58102440 0x7fde58102850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49270/0 (socket says 172.21.15.2:49270) 2024-09-17T00:53:02.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.895+0000 7fde5d0b3640 1 -- 172.21.15.2:0/4075108224 learned_addr learned my addr 172.21.15.2:0/4075108224 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:02.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.896+0000 7fde5d0b3640 1 -- 172.21.15.2:0/4075108224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde58102ed0 con 0x7fde58102440 2024-09-17T00:53:02.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.897+0000 7fde5d0b3640 1 --2- 172.21.15.2:0/4075108224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde58102440 0x7fde58102850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fde5400baf0 tx=0x7fde5400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d5c2e8fc87eb6d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:02.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.897+0000 7fde4ffff640 1 -- 172.21.15.2:0/4075108224 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde540327a0 con 0x7fde58102440 2024-09-17T00:53:02.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.897+0000 7fde4ffff640 1 -- 172.21.15.2:0/4075108224 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fde54032d60 con 0x7fde58102440 2024-09-17T00:53:02.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.897+0000 7fde4ffff640 1 -- 172.21.15.2:0/4075108224 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde54031df0 con 0x7fde58102440 2024-09-17T00:53:02.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.897+0000 7fde5f317640 1 -- 172.21.15.2:0/4075108224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde58102440 msgr2=0x7fde58102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:02.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.897+0000 7fde5f317640 1 --2- 172.21.15.2:0/4075108224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde58102440 0x7fde58102850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fde5400baf0 tx=0x7fde5400b460 comp rx=0 tx=0).stop 2024-09-17T00:53:02.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.897+0000 7fde5f317640 1 -- 172.21.15.2:0/4075108224 shutdown_connections 2024-09-17T00:53:02.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.897+0000 7fde5f317640 1 --2- 172.21.15.2:0/4075108224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde58102440 0x7fde58102850 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:02.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.897+0000 7fde5f317640 1 -- 172.21.15.2:0/4075108224 >> 172.21.15.2:0/4075108224 conn(0x7fde580fbde0 msgr2=0x7fde580fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:02.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.897+0000 7fde5f317640 1 -- 172.21.15.2:0/4075108224 shutdown_connections 2024-09-17T00:53:02.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.898+0000 7fde5f317640 1 -- 172.21.15.2:0/4075108224 wait complete. 2024-09-17T00:53:02.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.898+0000 7fde5f317640 1 Processor -- start 2024-09-17T00:53:02.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.898+0000 7fde5f317640 1 -- start start 2024-09-17T00:53:02.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.898+0000 7fde5f317640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde58102440 0x7fde58112fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:02.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.898+0000 7fde5f317640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde581134f0 con 0x7fde58102440 2024-09-17T00:53:02.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.898+0000 7fde5d0b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde58102440 0x7fde58112fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:02.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.898+0000 7fde5d0b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde58102440 0x7fde58112fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49284/0 (socket says 172.21.15.2:49284) 2024-09-17T00:53:02.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.898+0000 7fde5d0b3640 1 -- 172.21.15.2:0/2809625164 learned_addr learned my addr 172.21.15.2:0/2809625164 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:02.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.899+0000 7fde5d0b3640 1 -- 172.21.15.2:0/2809625164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5400b700 con 0x7fde58102440 2024-09-17T00:53:02.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.899+0000 7fde5d0b3640 1 --2- 172.21.15.2:0/2809625164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde58102440 0x7fde58112fb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fde54031ad0 tx=0x7fde5400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:02.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.899+0000 7fde4dffb640 1 -- 172.21.15.2:0/2809625164 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde54032a80 con 0x7fde58102440 2024-09-17T00:53:02.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.899+0000 7fde4dffb640 1 -- 172.21.15.2:0/2809625164 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fde54032be0 con 0x7fde58102440 2024-09-17T00:53:02.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.899+0000 7fde5f317640 1 -- 172.21.15.2:0/2809625164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde581136f0 con 0x7fde58102440 2024-09-17T00:53:02.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.899+0000 7fde4dffb640 1 -- 172.21.15.2:0/2809625164 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde54045650 con 0x7fde58102440 2024-09-17T00:53:02.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.899+0000 7fde5f317640 1 -- 172.21.15.2:0/2809625164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde58113b60 con 0x7fde58102440 2024-09-17T00:53:02.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.900+0000 7fde4dffb640 1 -- 172.21.15.2:0/2809625164 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fde5403b420 con 0x7fde58102440 2024-09-17T00:53:02.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.901+0000 7fde4dffb640 1 --2- 172.21.15.2:0/2809625164 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fde44039490 0x7fde4403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:02.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.901+0000 7fde4dffb640 1 -- 172.21.15.2:0/2809625164 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fde5406cfe0 con 0x7fde58102440 2024-09-17T00:53:02.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.901+0000 7fde5f317640 1 -- 172.21.15.2:0/2809625164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde58113b60 con 0x7fde58102440 2024-09-17T00:53:02.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.901+0000 7fde5c8b2640 1 --2- 172.21.15.2:0/2809625164 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fde44039490 0x7fde4403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:02.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.901+0000 7fde5c8b2640 1 --2- 172.21.15.2:0/2809625164 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fde44039490 0x7fde4403b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde48006fd0 tx=0x7fde48006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:02.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:00.905+0000 7fde4dffb640 1 -- 172.21.15.2:0/2809625164 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fde58113b60 con 0x7fde58102440 2024-09-17T00:53:02.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:01.110+0000 7fde5f317640 1 -- 172.21.15.2:0/2809625164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fde5804b720 con 0x7fde58102440 2024-09-17T00:53:02.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:01.163+0000 7fde4dffb640 1 -- 172.21.15.2:0/2809625164 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fde54044cc0 con 0x7fde58102440 2024-09-17T00:53:02.964 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:01.164+0000 7fde4dffb640 1 -- 172.21.15.2:0/2809625164 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fde540449c0 con 0x7fde58102440 2024-09-17T00:53:02.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:01.166+0000 7fde5f317640 1 -- 172.21.15.2:0/2809625164 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fde44039490 msgr2=0x7fde4403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:02.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:01.166+0000 7fde5f317640 1 --2- 172.21.15.2:0/2809625164 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fde44039490 0x7fde4403b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde48006fd0 tx=0x7fde48006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:02.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:01.166+0000 7fde5f317640 1 -- 172.21.15.2:0/2809625164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde58102440 msgr2=0x7fde58112fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:02.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:01.166+0000 7fde5f317640 1 --2- 172.21.15.2:0/2809625164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde58102440 0x7fde58112fb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fde54031ad0 tx=0x7fde5400b460 comp rx=0 tx=0).stop 2024-09-17T00:53:02.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:01.166+0000 7fde5f317640 1 -- 172.21.15.2:0/2809625164 shutdown_connections 2024-09-17T00:53:02.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:01.166+0000 7fde5f317640 1 --2- 172.21.15.2:0/2809625164 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fde44039490 0x7fde4403b940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:02.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:01.166+0000 7fde5f317640 1 --2- 172.21.15.2:0/2809625164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde58102440 0x7fde58112fb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:02.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:01.166+0000 7fde5f317640 1 -- 172.21.15.2:0/2809625164 >> 172.21.15.2:0/2809625164 conn(0x7fde580fbde0 msgr2=0x7fde58105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:02.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:01.166+0000 7fde5f317640 1 -- 172.21.15.2:0/2809625164 shutdown_connections 2024-09-17T00:53:02.965 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:01.166+0000 7fde5f317640 1 -- 172.21.15.2:0/2809625164 wait complete. 2024-09-17T00:53:03.860 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:03 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2393488061' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T00:53:04.152 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-17T00:53:04.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-17T00:53:04.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T00:53:04.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "smithi002.vjeexr", 2024-09-17T00:53:04.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T00:53:04.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-17T00:53:04.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.328+0000 7ff23eb25640 1 Processor -- start 2024-09-17T00:53:04.153 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.328+0000 7ff23eb25640 1 -- start start 2024-09-17T00:53:04.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.328+0000 7ff23eb25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff238076be0 0x7ff238104b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:04.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.328+0000 7ff23eb25640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff238105090 con 0x7ff238076be0 2024-09-17T00:53:04.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.329+0000 7ff23c8c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff238076be0 0x7ff238104b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:04.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.329+0000 7ff23c8c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff238076be0 0x7ff238104b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49310/0 (socket says 172.21.15.2:49310) 2024-09-17T00:53:04.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.329+0000 7ff23c8c1640 1 -- 172.21.15.2:0/63111965 learned_addr learned my addr 172.21.15.2:0/63111965 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:04.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.329+0000 7ff23c8c1640 1 -- 172.21.15.2:0/63111965 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2381051d0 con 0x7ff238076be0 2024-09-17T00:53:04.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.330+0000 7ff23c8c1640 1 --2- 172.21.15.2:0/63111965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff238076be0 0x7ff238104b50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff220009840 tx=0x7ff2200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f432896073037bb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:04.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.330+0000 7ff2377fe640 1 -- 172.21.15.2:0/63111965 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff220032440 con 0x7ff238076be0 2024-09-17T00:53:04.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.330+0000 7ff2377fe640 1 -- 172.21.15.2:0/63111965 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff220032a00 con 0x7ff238076be0 2024-09-17T00:53:04.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.330+0000 7ff2377fe640 1 -- 172.21.15.2:0/63111965 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2200319e0 con 0x7ff238076be0 2024-09-17T00:53:04.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.331+0000 7ff23eb25640 1 -- 172.21.15.2:0/63111965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff238076be0 msgr2=0x7ff238104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:04.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.331+0000 7ff23eb25640 1 --2- 172.21.15.2:0/63111965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff238076be0 0x7ff238104b50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff220009840 tx=0x7ff2200091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:04.154 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.331+0000 7ff23eb25640 1 -- 172.21.15.2:0/63111965 shutdown_connections 2024-09-17T00:53:04.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.331+0000 7ff23eb25640 1 --2- 172.21.15.2:0/63111965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff238076be0 0x7ff238104b50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:04.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.331+0000 7ff23eb25640 1 -- 172.21.15.2:0/63111965 >> 172.21.15.2:0/63111965 conn(0x7ff2380fc560 msgr2=0x7ff2380fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:04.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.331+0000 7ff23eb25640 1 -- 172.21.15.2:0/63111965 shutdown_connections 2024-09-17T00:53:04.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.331+0000 7ff23eb25640 1 -- 172.21.15.2:0/63111965 wait complete. 2024-09-17T00:53:04.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.331+0000 7ff23eb25640 1 Processor -- start 2024-09-17T00:53:04.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.331+0000 7ff23eb25640 1 -- start start 2024-09-17T00:53:04.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.331+0000 7ff23eb25640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff238076be0 0x7ff238112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:04.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.331+0000 7ff23eb25640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff238113490 con 0x7ff238076be0 2024-09-17T00:53:04.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.332+0000 7ff23c8c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff238076be0 0x7ff238112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:04.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.332+0000 7ff23c8c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff238076be0 0x7ff238112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49322/0 (socket says 172.21.15.2:49322) 2024-09-17T00:53:04.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.332+0000 7ff23c8c1640 1 -- 172.21.15.2:0/2393488061 learned_addr learned my addr 172.21.15.2:0/2393488061 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:04.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.332+0000 7ff23c8c1640 1 -- 172.21.15.2:0/2393488061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff220009450 con 0x7ff238076be0 2024-09-17T00:53:04.155 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.332+0000 7ff23c8c1640 1 --2- 172.21.15.2:0/2393488061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff238076be0 0x7ff238112f50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff220006f00 tx=0x7ff220008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:04.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.332+0000 7ff2357fa640 1 -- 172.21.15.2:0/2393488061 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff220031e30 con 0x7ff238076be0 2024-09-17T00:53:04.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.332+0000 7ff2357fa640 1 -- 172.21.15.2:0/2393488061 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff22003d8b0 con 0x7ff238076be0 2024-09-17T00:53:04.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.332+0000 7ff23eb25640 1 -- 172.21.15.2:0/2393488061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff238113690 con 0x7ff238076be0 2024-09-17T00:53:04.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.332+0000 7ff23eb25640 1 -- 172.21.15.2:0/2393488061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff238113b00 con 0x7ff238076be0 2024-09-17T00:53:04.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.332+0000 7ff2357fa640 1 -- 172.21.15.2:0/2393488061 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff22003b8f0 con 0x7ff238076be0 2024-09-17T00:53:04.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.333+0000 7ff2357fa640 1 -- 172.21.15.2:0/2393488061 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7ff220039070 con 0x7ff238076be0 2024-09-17T00:53:04.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.333+0000 7ff2357fa640 1 --2- 172.21.15.2:0/2393488061 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7ff224039490 0x7ff22403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:04.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.333+0000 7ff2357fa640 1 -- 172.21.15.2:0/2393488061 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff22006cde0 con 0x7ff238076be0 2024-09-17T00:53:04.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.333+0000 7ff237fff640 1 -- 172.21.15.2:0/2393488061 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7ff224039490 msgr2=0x7ff22403b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1951809935 2024-09-17T00:53:04.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.333+0000 7ff237fff640 1 --2- 172.21.15.2:0/2393488061 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7ff224039490 0x7ff22403b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T00:53:04.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.334+0000 7ff23eb25640 1 -- 172.21.15.2:0/2393488061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23805ed70 con 0x7ff238076be0 2024-09-17T00:53:04.156 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.338+0000 7ff2357fa640 1 -- 172.21.15.2:0/2393488061 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff220041020 con 0x7ff238076be0 2024-09-17T00:53:04.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.534+0000 7ff237fff640 1 -- 172.21.15.2:0/2393488061 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7ff224039490 msgr2=0x7ff22403b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1951809935 2024-09-17T00:53:04.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.534+0000 7ff237fff640 1 --2- 172.21.15.2:0/2393488061 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7ff224039490 0x7ff22403b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T00:53:04.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.571+0000 7ff23eb25640 1 -- 172.21.15.2:0/2393488061 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff238105ea0 con 0x7ff238076be0 2024-09-17T00:53:04.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.572+0000 7ff2357fa640 1 -- 172.21.15.2:0/2393488061 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7ff220037070 con 0x7ff238076be0 2024-09-17T00:53:04.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.574+0000 7ff23eb25640 1 -- 172.21.15.2:0/2393488061 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7ff224039490 msgr2=0x7ff22403b940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T00:53:04.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.574+0000 7ff23eb25640 1 --2- 172.21.15.2:0/2393488061 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7ff224039490 0x7ff22403b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:04.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.574+0000 7ff23eb25640 1 -- 172.21.15.2:0/2393488061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff238076be0 msgr2=0x7ff238112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:04.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.574+0000 7ff23eb25640 1 --2- 172.21.15.2:0/2393488061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff238076be0 0x7ff238112f50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff220006f00 tx=0x7ff220008040 comp rx=0 tx=0).stop 2024-09-17T00:53:04.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.574+0000 7ff23eb25640 1 -- 172.21.15.2:0/2393488061 shutdown_connections 2024-09-17T00:53:04.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.574+0000 7ff23eb25640 1 --2- 172.21.15.2:0/2393488061 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7ff224039490 0x7ff22403b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:04.157 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.574+0000 7ff23eb25640 1 --2- 172.21.15.2:0/2393488061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff238076be0 0x7ff238112f50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:04.158 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.574+0000 7ff23eb25640 1 -- 172.21.15.2:0/2393488061 >> 172.21.15.2:0/2393488061 conn(0x7ff2380fc560 msgr2=0x7ff2380fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:04.158 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.574+0000 7ff23eb25640 1 -- 172.21.15.2:0/2393488061 shutdown_connections 2024-09-17T00:53:04.158 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:03.574+0000 7ff23eb25640 1 -- 172.21.15.2:0/2393488061 wait complete. 2024-09-17T00:53:04.158 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-17T00:53:04.158 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 5... 2024-09-17T00:53:06.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: Active manager daemon smithi002.vjeexr restarted 2024-09-17T00:53:06.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: Activating manager daemon smithi002.vjeexr 2024-09-17T00:53:06.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: osdmap e2: 0 total, 0 up, 0 in 2024-09-17T00:53:06.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: mgrmap e6: smithi002.vjeexr(active, starting, since 0.0032612s) 2024-09-17T00:53:06.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T00:53:06.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr metadata", "who": "smithi002.vjeexr", "id": "smithi002.vjeexr"}]: dispatch 2024-09-17T00:53:06.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T00:53:06.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T00:53:06.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T00:53:06.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: Manager daemon smithi002.vjeexr is now available 2024-09-17T00:53:06.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:06.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:06.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:06.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:06.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:53:06.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:05 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/trash_purge_schedule"}]: dispatch 2024-09-17T00:53:07.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:06 smithi002 ceph-mon[27650]: Found migration_current of "None". Setting to last migration. 2024-09-17T00:53:07.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:06 smithi002 ceph-mon[27650]: mgrmap e7: smithi002.vjeexr(active, since 1.00539s) 2024-09-17T00:53:07.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-17T00:53:07.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-17T00:53:07.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T00:53:07.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-17T00:53:07.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.660+0000 7fd4c56ad640 1 Processor -- start 2024-09-17T00:53:07.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.660+0000 7fd4c56ad640 1 -- start start 2024-09-17T00:53:07.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.660+0000 7fd4c56ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c0103650 0x7fd4c0103a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:07.261 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.660+0000 7fd4c56ad640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0103fa0 con 0x7fd4c0103650 2024-09-17T00:53:07.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.660+0000 7fd4beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c0103650 0x7fd4c0103a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:07.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.660+0000 7fd4beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c0103650 0x7fd4c0103a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49330/0 (socket says 172.21.15.2:49330) 2024-09-17T00:53:07.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.660+0000 7fd4beffd640 1 -- 172.21.15.2:0/3219972763 learned_addr learned my addr 172.21.15.2:0/3219972763 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:07.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.660+0000 7fd4beffd640 1 -- 172.21.15.2:0/3219972763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c01040e0 con 0x7fd4c0103650 2024-09-17T00:53:07.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.661+0000 7fd4beffd640 1 --2- 172.21.15.2:0/3219972763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c0103650 0x7fd4c0103a60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009840 tx=0x7fd4b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53bf5fdd23980a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:07.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.661+0000 7fd4be7fc640 1 -- 172.21.15.2:0/3219972763 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4b0032440 con 0x7fd4c0103650 2024-09-17T00:53:07.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.661+0000 7fd4be7fc640 1 -- 172.21.15.2:0/3219972763 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd4b0032a00 con 0x7fd4c0103650 2024-09-17T00:53:07.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.661+0000 7fd4be7fc640 1 -- 172.21.15.2:0/3219972763 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4b00319e0 con 0x7fd4c0103650 2024-09-17T00:53:07.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.662+0000 7fd4c56ad640 1 -- 172.21.15.2:0/3219972763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c0103650 msgr2=0x7fd4c0103a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:07.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.662+0000 7fd4c56ad640 1 --2- 172.21.15.2:0/3219972763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c0103650 0x7fd4c0103a60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009840 tx=0x7fd4b00091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:07.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.662+0000 7fd4c56ad640 1 -- 172.21.15.2:0/3219972763 shutdown_connections 2024-09-17T00:53:07.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.662+0000 7fd4c56ad640 1 --2- 172.21.15.2:0/3219972763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c0103650 0x7fd4c0103a60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:07.262 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.662+0000 7fd4c56ad640 1 -- 172.21.15.2:0/3219972763 >> 172.21.15.2:0/3219972763 conn(0x7fd4c00fbdb0 msgr2=0x7fd4c00fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:07.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.662+0000 7fd4c56ad640 1 -- 172.21.15.2:0/3219972763 shutdown_connections 2024-09-17T00:53:07.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.662+0000 7fd4c56ad640 1 -- 172.21.15.2:0/3219972763 wait complete. 2024-09-17T00:53:07.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.663+0000 7fd4c56ad640 1 Processor -- start 2024-09-17T00:53:07.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.663+0000 7fd4c56ad640 1 -- start start 2024-09-17T00:53:07.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.663+0000 7fd4c56ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c0103650 0x7fd4c0102d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:07.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.663+0000 7fd4c56ad640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c01032a0 con 0x7fd4c0103650 2024-09-17T00:53:07.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.663+0000 7fd4beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c0103650 0x7fd4c0102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:07.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.663+0000 7fd4beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c0103650 0x7fd4c0102d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49346/0 (socket says 172.21.15.2:49346) 2024-09-17T00:53:07.263 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.663+0000 7fd4beffd640 1 -- 172.21.15.2:0/1624805706 learned_addr learned my addr 172.21.15.2:0/1624805706 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:07.264 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.663+0000 7fd4beffd640 1 -- 172.21.15.2:0/1624805706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b0009450 con 0x7fd4c0103650 2024-09-17T00:53:07.264 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.664+0000 7fd4beffd640 1 --2- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c0103650 0x7fd4c0102d60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00098a0 tx=0x7fd4b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:07.264 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.664+0000 7fd4b77fe640 1 -- 172.21.15.2:0/1624805706 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4b0032880 con 0x7fd4c0103650 2024-09-17T00:53:07.264 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.664+0000 7fd4c56ad640 1 -- 172.21.15.2:0/1624805706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c0101330 con 0x7fd4c0103650 2024-09-17T00:53:07.264 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.664+0000 7fd4b77fe640 1 -- 172.21.15.2:0/1624805706 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd4b003d8d0 con 0x7fd4c0103650 2024-09-17T00:53:07.264 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.664+0000 7fd4b77fe640 1 -- 172.21.15.2:0/1624805706 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4b003b980 con 0x7fd4c0103650 2024-09-17T00:53:07.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.664+0000 7fd4c56ad640 1 -- 172.21.15.2:0/1624805706 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c01017a0 con 0x7fd4c0103650 2024-09-17T00:53:07.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.665+0000 7fd4b77fe640 1 -- 172.21.15.2:0/1624805706 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fd4b0039070 con 0x7fd4c0103650 2024-09-17T00:53:07.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.665+0000 7fd4b77fe640 1 --2- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fd4ac0394e0 0x7fd4ac03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:07.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.665+0000 7fd4b77fe640 1 -- 172.21.15.2:0/1624805706 --> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4ac03c0a0 con 0x7fd4ac0394e0 2024-09-17T00:53:07.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.665+0000 7fd4b77fe640 1 -- 172.21.15.2:0/1624805706 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd4b006cb70 con 0x7fd4c0103650 2024-09-17T00:53:07.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.665+0000 7fd4b7fff640 1 -- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fd4ac0394e0 msgr2=0x7fd4ac03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1951809935 2024-09-17T00:53:07.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.665+0000 7fd4b7fff640 1 --2- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fd4ac0394e0 0x7fd4ac03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T00:53:07.265 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.866+0000 7fd4b7fff640 1 -- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fd4ac0394e0 msgr2=0x7fd4ac03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1951809935 2024-09-17T00:53:07.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:04.866+0000 7fd4b7fff640 1 --2- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fd4ac0394e0 0x7fd4ac03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T00:53:07.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:05.267+0000 7fd4b7fff640 1 -- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fd4ac0394e0 msgr2=0x7fd4ac03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/1951809935 2024-09-17T00:53:07.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:05.267+0000 7fd4b7fff640 1 --2- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fd4ac0394e0 0x7fd4ac03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-17T00:53:07.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:05.761+0000 7fd4b77fe640 1 -- 172.21.15.2:0/1624805706 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 6) v1 ==== 45274+0+0 (secure 0 0 0) 0x7fd4b006c070 con 0x7fd4c0103650 2024-09-17T00:53:07.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:05.761+0000 7fd4b77fe640 1 -- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fd4ac0394e0 msgr2=0x7fd4ac03b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T00:53:07.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:05.761+0000 7fd4b77fe640 1 --2- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fd4ac0394e0 0x7fd4ac03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:07.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.762+0000 7fd4b77fe640 1 -- 172.21.15.2:0/1624805706 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7fd4b003bae0 con 0x7fd4c0103650 2024-09-17T00:53:07.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.762+0000 7fd4b77fe640 1 --2- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fd4ac03cdf0 0x7fd4ac03f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:07.266 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.762+0000 7fd4b77fe640 1 -- 172.21.15.2:0/1624805706 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4ac03c0a0 con 0x7fd4ac03cdf0 2024-09-17T00:53:07.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.762+0000 7fd4b7fff640 1 --2- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fd4ac03cdf0 0x7fd4ac03f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:07.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.763+0000 7fd4b7fff640 1 --2- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fd4ac03cdf0 0x7fd4ac03f1d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8003940 tx=0x7fd4a8006ec0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:07.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.764+0000 7fd4b77fe640 1 -- 172.21.15.2:0/1624805706 <== mgr.14118 v2:172.21.15.2:6800/3082534604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fd4ac03c0a0 con 0x7fd4ac03cdf0 2024-09-17T00:53:07.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.769+0000 7fd4c56ad640 1 -- 172.21.15.2:0/1624805706 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fd4c004b720 con 0x7fd4ac03cdf0 2024-09-17T00:53:07.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.769+0000 7fd4b77fe640 1 -- 172.21.15.2:0/1624805706 <== mgr.14118 v2:172.21.15.2:6800/3082534604 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd4c004b720 con 0x7fd4ac03cdf0 2024-09-17T00:53:07.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.769+0000 7fd4c56ad640 1 -- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fd4ac03cdf0 msgr2=0x7fd4ac03f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:07.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.769+0000 7fd4c56ad640 1 --2- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fd4ac03cdf0 0x7fd4ac03f1d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8003940 tx=0x7fd4a8006ec0 comp rx=0 tx=0).stop 2024-09-17T00:53:07.267 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.769+0000 7fd4c56ad640 1 -- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c0103650 msgr2=0x7fd4c0102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:07.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.769+0000 7fd4c56ad640 1 --2- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c0103650 0x7fd4c0102d60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00098a0 tx=0x7fd4b0008040 comp rx=0 tx=0).stop 2024-09-17T00:53:07.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.769+0000 7fd4c56ad640 1 -- 172.21.15.2:0/1624805706 shutdown_connections 2024-09-17T00:53:07.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.769+0000 7fd4c56ad640 1 --2- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fd4ac03cdf0 0x7fd4ac03f1d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:07.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.769+0000 7fd4c56ad640 1 --2- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:6800/1951809935,v1:172.21.15.2:6801/1951809935] conn(0x7fd4ac0394e0 0x7fd4ac03b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:07.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.769+0000 7fd4c56ad640 1 --2- 172.21.15.2:0/1624805706 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4c0103650 0x7fd4c0102d60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:07.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.769+0000 7fd4c56ad640 1 -- 172.21.15.2:0/1624805706 >> 172.21.15.2:0/1624805706 conn(0x7fd4c00fbdb0 msgr2=0x7fd4c0107bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:07.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.769+0000 7fd4c56ad640 1 -- 172.21.15.2:0/1624805706 shutdown_connections 2024-09-17T00:53:07.268 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:06.770+0000 7fd4c56ad640 1 -- 172.21.15.2:0/1624805706 wait complete. 2024-09-17T00:53:07.269 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 5 is available 2024-09-17T00:53:07.269 INFO:teuthology.orchestra.run.smithi002.stdout:Setting orchestrator backend to cephadm... 2024-09-17T00:53:07.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:07 smithi002 ceph-mon[27650]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T00:53:07.811 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:07 smithi002 ceph-mon[27650]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T00:53:08.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.641+0000 7f99fe51a640 1 Processor -- start 2024-09-17T00:53:08.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.641+0000 7f99fe51a640 1 -- start start 2024-09-17T00:53:08.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.641+0000 7f99fe51a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f8100e40 0x7f99f8101250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:08.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.641+0000 7f99fe51a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f8101790 con 0x7f99f8100e40 2024-09-17T00:53:08.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.641+0000 7f99f7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f8100e40 0x7f99f8101250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:08.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.641+0000 7f99f7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f8100e40 0x7f99f8101250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49394/0 (socket says 172.21.15.2:49394) 2024-09-17T00:53:08.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.641+0000 7f99f7fff640 1 -- 172.21.15.2:0/727167742 learned_addr learned my addr 172.21.15.2:0/727167742 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:08.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.642+0000 7f99f7fff640 1 -- 172.21.15.2:0/727167742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f81018d0 con 0x7f99f8100e40 2024-09-17T00:53:08.356 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.642+0000 7f99f7fff640 1 --2- 172.21.15.2:0/727167742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f8100e40 0x7f99f8101250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f99e800baf0 tx=0x7f99e800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f257e4178723c003 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:08.357 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.642+0000 7f99f6ffd640 1 -- 172.21.15.2:0/727167742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99e80327a0 con 0x7f99f8100e40 2024-09-17T00:53:08.357 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.642+0000 7f99f6ffd640 1 -- 172.21.15.2:0/727167742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f99e8032d60 con 0x7f99f8100e40 2024-09-17T00:53:08.357 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.642+0000 7f99f6ffd640 1 -- 172.21.15.2:0/727167742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99e8031df0 con 0x7f99f8100e40 2024-09-17T00:53:08.357 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.643+0000 7f99fe51a640 1 -- 172.21.15.2:0/727167742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f8100e40 msgr2=0x7f99f8101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:08.357 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.643+0000 7f99fe51a640 1 --2- 172.21.15.2:0/727167742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f8100e40 0x7f99f8101250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f99e800baf0 tx=0x7f99e800b460 comp rx=0 tx=0).stop 2024-09-17T00:53:08.357 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.643+0000 7f99fe51a640 1 -- 172.21.15.2:0/727167742 shutdown_connections 2024-09-17T00:53:08.357 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.643+0000 7f99fe51a640 1 --2- 172.21.15.2:0/727167742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f8100e40 0x7f99f8101250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:08.357 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.643+0000 7f99fe51a640 1 -- 172.21.15.2:0/727167742 >> 172.21.15.2:0/727167742 conn(0x7f99f80fc560 msgr2=0x7f99f80fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:08.357 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.643+0000 7f99fe51a640 1 -- 172.21.15.2:0/727167742 shutdown_connections 2024-09-17T00:53:08.357 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.643+0000 7f99fe51a640 1 -- 172.21.15.2:0/727167742 wait complete. 2024-09-17T00:53:08.357 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.644+0000 7f99fe51a640 1 Processor -- start 2024-09-17T00:53:08.357 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.644+0000 7f99fe51a640 1 -- start start 2024-09-17T00:53:08.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.644+0000 7f99fe51a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f8100e40 0x7f99f810eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:08.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.644+0000 7f99fe51a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f810f0a0 con 0x7f99f8100e40 2024-09-17T00:53:08.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.644+0000 7f99f7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f8100e40 0x7f99f810eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:08.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.644+0000 7f99f7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f8100e40 0x7f99f810eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49406/0 (socket says 172.21.15.2:49406) 2024-09-17T00:53:08.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.644+0000 7f99f7fff640 1 -- 172.21.15.2:0/1395144893 learned_addr learned my addr 172.21.15.2:0/1395144893 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:08.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.644+0000 7f99f7fff640 1 -- 172.21.15.2:0/1395144893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e800b700 con 0x7f99f8100e40 2024-09-17T00:53:08.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.645+0000 7f99f7fff640 1 --2- 172.21.15.2:0/1395144893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f8100e40 0x7f99f810eb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f99e8031ad0 tx=0x7f99e800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:08.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.645+0000 7f99f4ff9640 1 -- 172.21.15.2:0/1395144893 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99e8032b80 con 0x7f99f8100e40 2024-09-17T00:53:08.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.645+0000 7f99fe51a640 1 -- 172.21.15.2:0/1395144893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f810f2a0 con 0x7f99f8100e40 2024-09-17T00:53:08.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.645+0000 7f99f4ff9640 1 -- 172.21.15.2:0/1395144893 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f99e803b880 con 0x7f99f8100e40 2024-09-17T00:53:08.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.645+0000 7f99f4ff9640 1 -- 172.21.15.2:0/1395144893 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99e80447d0 con 0x7f99f8100e40 2024-09-17T00:53:08.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.645+0000 7f99fe51a640 1 -- 172.21.15.2:0/1395144893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f810f710 con 0x7f99f8100e40 2024-09-17T00:53:08.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.646+0000 7f99f4ff9640 1 -- 172.21.15.2:0/1395144893 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7f99e804e440 con 0x7f99f8100e40 2024-09-17T00:53:08.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.646+0000 7f99f4ff9640 1 --2- 172.21.15.2:0/1395144893 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f99e0039380 0x7f99e003b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:08.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.646+0000 7f99fe51a640 1 -- 172.21.15.2:0/1395144893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f804b720 con 0x7f99f8100e40 2024-09-17T00:53:08.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.646+0000 7f99f4ff9640 1 -- 172.21.15.2:0/1395144893 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f99e806cdb0 con 0x7f99f8100e40 2024-09-17T00:53:08.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.646+0000 7f99f77fe640 1 --2- 172.21.15.2:0/1395144893 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f99e0039380 0x7f99e003b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:08.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.646+0000 7f99f77fe640 1 --2- 172.21.15.2:0/1395144893 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f99e0039380 0x7f99e003b830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f99ec006fd0 tx=0x7f99ec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:08.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.651+0000 7f99f4ff9640 1 -- 172.21.15.2:0/1395144893 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f99e80395d0 con 0x7f99f8100e40 2024-09-17T00:53:08.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.813+0000 7f99f4ff9640 1 -- 172.21.15.2:0/1395144893 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f99e804eb10 con 0x7f99f8100e40 2024-09-17T00:53:08.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.828+0000 7f99fe51a640 1 -- 172.21.15.2:0/1395144893 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f99f810f710 con 0x7f99e0039380 2024-09-17T00:53:08.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.836+0000 7f99f4ff9640 1 -- 172.21.15.2:0/1395144893 <== mgr.14118 v2:172.21.15.2:6800/3082534604 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f99f810f710 con 0x7f99e0039380 2024-09-17T00:53:08.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.838+0000 7f99fe51a640 1 -- 172.21.15.2:0/1395144893 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f99e0039380 msgr2=0x7f99e003b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:08.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.838+0000 7f99fe51a640 1 --2- 172.21.15.2:0/1395144893 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f99e0039380 0x7f99e003b830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f99ec006fd0 tx=0x7f99ec006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:08.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.838+0000 7f99fe51a640 1 -- 172.21.15.2:0/1395144893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f8100e40 msgr2=0x7f99f810eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:08.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.838+0000 7f99fe51a640 1 --2- 172.21.15.2:0/1395144893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f8100e40 0x7f99f810eb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f99e8031ad0 tx=0x7f99e800b460 comp rx=0 tx=0).stop 2024-09-17T00:53:08.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.838+0000 7f99fe51a640 1 -- 172.21.15.2:0/1395144893 shutdown_connections 2024-09-17T00:53:08.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.838+0000 7f99fe51a640 1 --2- 172.21.15.2:0/1395144893 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f99e0039380 0x7f99e003b830 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:08.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.838+0000 7f99fe51a640 1 --2- 172.21.15.2:0/1395144893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99f8100e40 0x7f99f810eb60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:08.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.838+0000 7f99fe51a640 1 -- 172.21.15.2:0/1395144893 >> 172.21.15.2:0/1395144893 conn(0x7f99f80fc560 msgr2=0x7f99f81053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:08.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.838+0000 7f99fe51a640 1 -- 172.21.15.2:0/1395144893 shutdown_connections 2024-09-17T00:53:08.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:07.838+0000 7f99fe51a640 1 -- 172.21.15.2:0/1395144893 wait complete. 2024-09-17T00:53:08.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:08 smithi002 ceph-mon[27650]: mgrmap e8: smithi002.vjeexr(active, since 2s) 2024-09-17T00:53:08.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:08 smithi002 ceph-mon[27650]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:08.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:08 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:08.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:08 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:08.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:08 smithi002 ceph-mon[27650]: [17/Sep/2024:00:53:08] ENGINE Bus STARTING 2024-09-17T00:53:08.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:08 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:08.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:08 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:09.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-17T00:53:09.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.732+0000 7f8058fa2640 1 Processor -- start 2024-09-17T00:53:09.496 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.732+0000 7f8058fa2640 1 -- start start 2024-09-17T00:53:09.497 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.732+0000 7f8058fa2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8054102450 0x7f8054102860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:09.497 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.732+0000 7f8058fa2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8054102da0 con 0x7f8054102450 2024-09-17T00:53:09.497 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.732+0000 7f80537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8054102450 0x7f8054102860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:09.497 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.732+0000 7f80537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8054102450 0x7f8054102860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49418/0 (socket says 172.21.15.2:49418) 2024-09-17T00:53:09.497 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.732+0000 7f80537fe640 1 -- 172.21.15.2:0/443823112 learned_addr learned my addr 172.21.15.2:0/443823112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:09.497 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.733+0000 7f80537fe640 1 -- 172.21.15.2:0/443823112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8054102ee0 con 0x7f8054102450 2024-09-17T00:53:09.497 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.733+0000 7f80537fe640 1 --2- 172.21.15.2:0/443823112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8054102450 0x7f8054102860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8044009840 tx=0x7f80440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf41a47a80591e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:09.497 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.733+0000 7f80527fc640 1 -- 172.21.15.2:0/443823112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8044032440 con 0x7f8054102450 2024-09-17T00:53:09.497 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.733+0000 7f80527fc640 1 -- 172.21.15.2:0/443823112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f8044032a00 con 0x7f8054102450 2024-09-17T00:53:09.497 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.733+0000 7f80527fc640 1 -- 172.21.15.2:0/443823112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80440319e0 con 0x7f8054102450 2024-09-17T00:53:09.497 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.734+0000 7f8058fa2640 1 -- 172.21.15.2:0/443823112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8054102450 msgr2=0x7f8054102860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:09.497 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.734+0000 7f8058fa2640 1 --2- 172.21.15.2:0/443823112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8054102450 0x7f8054102860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8044009840 tx=0x7f80440091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:09.497 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.734+0000 7f8058fa2640 1 -- 172.21.15.2:0/443823112 shutdown_connections 2024-09-17T00:53:09.498 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.734+0000 7f8058fa2640 1 --2- 172.21.15.2:0/443823112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8054102450 0x7f8054102860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:09.498 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.734+0000 7f8058fa2640 1 -- 172.21.15.2:0/443823112 >> 172.21.15.2:0/443823112 conn(0x7f80540fbc40 msgr2=0x7f80540fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:09.498 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.734+0000 7f8058fa2640 1 -- 172.21.15.2:0/443823112 shutdown_connections 2024-09-17T00:53:09.498 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.734+0000 7f8058fa2640 1 -- 172.21.15.2:0/443823112 wait complete. 2024-09-17T00:53:09.498 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.735+0000 7f8058fa2640 1 Processor -- start 2024-09-17T00:53:09.498 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.735+0000 7f8058fa2640 1 -- start start 2024-09-17T00:53:09.498 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.735+0000 7f8058fa2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8054102450 0x7f8054112e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:09.498 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.735+0000 7f8058fa2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80541133a0 con 0x7f8054102450 2024-09-17T00:53:09.498 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.735+0000 7f80537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8054102450 0x7f8054112e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:09.498 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.735+0000 7f80537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8054102450 0x7f8054112e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49428/0 (socket says 172.21.15.2:49428) 2024-09-17T00:53:09.498 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.735+0000 7f80537fe640 1 -- 172.21.15.2:0/1685252821 learned_addr learned my addr 172.21.15.2:0/1685252821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:09.498 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.735+0000 7f80537fe640 1 -- 172.21.15.2:0/1685252821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8044009450 con 0x7f8054102450 2024-09-17T00:53:09.498 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.735+0000 7f80537fe640 1 --2- 172.21.15.2:0/1685252821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8054102450 0x7f8054112e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f80440098a0 tx=0x7f8044008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:09.499 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.736+0000 7f803bfff640 1 -- 172.21.15.2:0/1685252821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8044032880 con 0x7f8054102450 2024-09-17T00:53:09.499 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.736+0000 7f803bfff640 1 -- 172.21.15.2:0/1685252821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f804403d8b0 con 0x7f8054102450 2024-09-17T00:53:09.499 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.736+0000 7f8058fa2640 1 -- 172.21.15.2:0/1685252821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80541135a0 con 0x7f8054102450 2024-09-17T00:53:09.499 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.736+0000 7f803bfff640 1 -- 172.21.15.2:0/1685252821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f804403b8a0 con 0x7f8054102450 2024-09-17T00:53:09.499 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.736+0000 7f8058fa2640 1 -- 172.21.15.2:0/1685252821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8054114080 con 0x7f8054102450 2024-09-17T00:53:09.499 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.736+0000 7f803bfff640 1 -- 172.21.15.2:0/1685252821 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f8044039070 con 0x7f8054102450 2024-09-17T00:53:09.499 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.737+0000 7f8058fa2640 1 -- 172.21.15.2:0/1685252821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f805405ed70 con 0x7f8054102450 2024-09-17T00:53:09.499 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.737+0000 7f803bfff640 1 --2- 172.21.15.2:0/1685252821 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f803c039490 0x7f803c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:09.499 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.737+0000 7f803bfff640 1 -- 172.21.15.2:0/1685252821 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f804406d290 con 0x7f8054102450 2024-09-17T00:53:09.499 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.737+0000 7f8052ffd640 1 --2- 172.21.15.2:0/1685252821 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f803c039490 0x7f803c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:09.499 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.737+0000 7f8052ffd640 1 --2- 172.21.15.2:0/1685252821 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f803c039490 0x7f803c03b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8048006fd0 tx=0x7f8048006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:09.499 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.741+0000 7f803bfff640 1 -- 172.21.15.2:0/1685252821 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f804404e7c0 con 0x7f8054102450 2024-09-17T00:53:09.500 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.929+0000 7f8058fa2640 1 -- 172.21.15.2:0/1685252821 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f80540fd020 con 0x7f803c039490 2024-09-17T00:53:09.500 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.930+0000 7f803bfff640 1 -- 172.21.15.2:0/1685252821 <== mgr.14118 v2:172.21.15.2:6800/3082534604 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f80540fd020 con 0x7f803c039490 2024-09-17T00:53:09.500 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.932+0000 7f8058fa2640 1 -- 172.21.15.2:0/1685252821 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f803c039490 msgr2=0x7f803c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:09.500 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.932+0000 7f8058fa2640 1 --2- 172.21.15.2:0/1685252821 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f803c039490 0x7f803c03b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8048006fd0 tx=0x7f8048006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:09.500 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.932+0000 7f8058fa2640 1 -- 172.21.15.2:0/1685252821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8054102450 msgr2=0x7f8054112e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:09.500 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.932+0000 7f8058fa2640 1 --2- 172.21.15.2:0/1685252821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8054102450 0x7f8054112e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f80440098a0 tx=0x7f8044008040 comp rx=0 tx=0).stop 2024-09-17T00:53:09.500 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.932+0000 7f8058fa2640 1 -- 172.21.15.2:0/1685252821 shutdown_connections 2024-09-17T00:53:09.500 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.932+0000 7f8058fa2640 1 --2- 172.21.15.2:0/1685252821 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f803c039490 0x7f803c03b940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:09.500 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.932+0000 7f8058fa2640 1 --2- 172.21.15.2:0/1685252821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8054102450 0x7f8054112e60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:09.500 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.932+0000 7f8058fa2640 1 -- 172.21.15.2:0/1685252821 >> 172.21.15.2:0/1685252821 conn(0x7f80540fbc40 msgr2=0x7f80540fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:09.501 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.932+0000 7f8058fa2640 1 -- 172.21.15.2:0/1685252821 shutdown_connections 2024-09-17T00:53:09.501 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:08.932+0000 7f8058fa2640 1 -- 172.21.15.2:0/1685252821 wait complete. 2024-09-17T00:53:09.501 INFO:teuthology.orchestra.run.smithi002.stdout:Generating ssh key... 2024-09-17T00:53:10.036 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:09 smithi002 ceph-mon[27650]: [17/Sep/2024:00:53:08] ENGINE Serving on https://172.21.15.2:7150 2024-09-17T00:53:10.036 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:09 smithi002 ceph-mon[27650]: [17/Sep/2024:00:53:08] ENGINE Bus STARTED 2024-09-17T00:53:10.037 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:09 smithi002 ceph-mon[27650]: [17/Sep/2024:00:53:08] ENGINE Error in HTTPServer.serve 2024-09-17T00:53:10.037 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Traceback (most recent call last): 2024-09-17T00:53:10.037 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T00:53:10.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-17T00:53:10.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T00:53:10.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._run(expiration_interval) 2024-09-17T00:53:10.041 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T00:53:10.041 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T00:53:10.041 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T00:53:10.041 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T00:53:10.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T00:53:10.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s = self.context.wrap_socket( 2024-09-17T00:53:10.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T00:53:10.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: return self.sslsocket_class._create( 2024-09-17T00:53:10.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T00:53:10.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self.do_handshake() 2024-09-17T00:53:10.043 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T00:53:10.043 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._sslobj.do_handshake() 2024-09-17T00:53:10.043 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T00:53:10.043 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:09 smithi002 ceph-mon[27650]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:10.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.863+0000 7fece7677640 1 Processor -- start 2024-09-17T00:53:10.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.863+0000 7fece7677640 1 -- start start 2024-09-17T00:53:10.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.863+0000 7fece7677640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0101490 0x7fece01018a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:10.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.863+0000 7fece7677640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece0101de0 con 0x7fece0101490 2024-09-17T00:53:10.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.863+0000 7fece5413640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0101490 0x7fece01018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:10.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.863+0000 7fece5413640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0101490 0x7fece01018a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49430/0 (socket says 172.21.15.2:49430) 2024-09-17T00:53:10.685 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.863+0000 7fece5413640 1 -- 172.21.15.2:0/2591453624 learned_addr learned my addr 172.21.15.2:0/2591453624 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:10.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.864+0000 7fece5413640 1 -- 172.21.15.2:0/2591453624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece0101f20 con 0x7fece0101490 2024-09-17T00:53:10.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.864+0000 7fece5413640 1 --2- 172.21.15.2:0/2591453624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0101490 0x7fece01018a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009840 tx=0x7fecdc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad3c4f15f014f23 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:10.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.864+0000 7fecd7fff640 1 -- 172.21.15.2:0/2591453624 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fecdc032440 con 0x7fece0101490 2024-09-17T00:53:10.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.864+0000 7fecd7fff640 1 -- 172.21.15.2:0/2591453624 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fecdc032a00 con 0x7fece0101490 2024-09-17T00:53:10.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.864+0000 7fecd7fff640 1 -- 172.21.15.2:0/2591453624 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fecdc0319e0 con 0x7fece0101490 2024-09-17T00:53:10.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.865+0000 7fece7677640 1 -- 172.21.15.2:0/2591453624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0101490 msgr2=0x7fece01018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:10.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.865+0000 7fece7677640 1 --2- 172.21.15.2:0/2591453624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0101490 0x7fece01018a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009840 tx=0x7fecdc0091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:10.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.865+0000 7fece7677640 1 -- 172.21.15.2:0/2591453624 shutdown_connections 2024-09-17T00:53:10.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.865+0000 7fece7677640 1 --2- 172.21.15.2:0/2591453624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0101490 0x7fece01018a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:10.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.865+0000 7fece7677640 1 -- 172.21.15.2:0/2591453624 >> 172.21.15.2:0/2591453624 conn(0x7fece00fbde0 msgr2=0x7fece00fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:10.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.865+0000 7fece7677640 1 -- 172.21.15.2:0/2591453624 shutdown_connections 2024-09-17T00:53:10.686 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.865+0000 7fece7677640 1 -- 172.21.15.2:0/2591453624 wait complete. 2024-09-17T00:53:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.866+0000 7fece7677640 1 Processor -- start 2024-09-17T00:53:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.866+0000 7fece7677640 1 -- start start 2024-09-17T00:53:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.866+0000 7fece7677640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0101490 0x7fece0110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.866+0000 7fece7677640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece0111330 con 0x7fece0101490 2024-09-17T00:53:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.866+0000 7fece5413640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0101490 0x7fece0110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.866+0000 7fece5413640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0101490 0x7fece0110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49446/0 (socket says 172.21.15.2:49446) 2024-09-17T00:53:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.866+0000 7fece5413640 1 -- 172.21.15.2:0/4208967603 learned_addr learned my addr 172.21.15.2:0/4208967603 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.866+0000 7fece5413640 1 -- 172.21.15.2:0/4208967603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc009450 con 0x7fece0101490 2024-09-17T00:53:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.866+0000 7fece5413640 1 --2- 172.21.15.2:0/4208967603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0101490 0x7fece0110df0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0098a0 tx=0x7fecdc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.867+0000 7fecd5ffb640 1 -- 172.21.15.2:0/4208967603 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fecdc032880 con 0x7fece0101490 2024-09-17T00:53:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.867+0000 7fecd5ffb640 1 -- 172.21.15.2:0/4208967603 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fecdc03d8b0 con 0x7fece0101490 2024-09-17T00:53:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.867+0000 7fecd5ffb640 1 -- 172.21.15.2:0/4208967603 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fecdc03b8a0 con 0x7fece0101490 2024-09-17T00:53:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.867+0000 7fece7677640 1 -- 172.21.15.2:0/4208967603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece0111530 con 0x7fece0101490 2024-09-17T00:53:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.867+0000 7fece7677640 1 -- 172.21.15.2:0/4208967603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece0111f80 con 0x7fece0101490 2024-09-17T00:53:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.868+0000 7fecd5ffb640 1 -- 172.21.15.2:0/4208967603 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fecdc039070 con 0x7fece0101490 2024-09-17T00:53:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.868+0000 7fecd5ffb640 1 --2- 172.21.15.2:0/4208967603 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7feccc039490 0x7feccc03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.868+0000 7fecd5ffb640 1 -- 172.21.15.2:0/4208967603 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fecdc06d360 con 0x7fece0101490 2024-09-17T00:53:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.868+0000 7fece7677640 1 -- 172.21.15.2:0/4208967603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece005ed70 con 0x7fece0101490 2024-09-17T00:53:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.868+0000 7fece4c12640 1 --2- 172.21.15.2:0/4208967603 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7feccc039490 0x7feccc03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.868+0000 7fece4c12640 1 --2- 172.21.15.2:0/4208967603 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7feccc039490 0x7feccc03b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fecd0006fd0 tx=0x7fecd0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:09.873+0000 7fecd5ffb640 1 -- 172.21.15.2:0/4208967603 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fecdc041020 con 0x7fece0101490 2024-09-17T00:53:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:10.038+0000 7fece7677640 1 -- 172.21.15.2:0/4208967603 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fece0112b60 con 0x7feccc039490 2024-09-17T00:53:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:10.157+0000 7fecd5ffb640 1 -- 172.21.15.2:0/4208967603 <== mgr.14118 v2:172.21.15.2:6800/3082534604 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fece0112b60 con 0x7feccc039490 2024-09-17T00:53:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:10.159+0000 7fece7677640 1 -- 172.21.15.2:0/4208967603 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7feccc039490 msgr2=0x7feccc03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:10.159+0000 7fece7677640 1 --2- 172.21.15.2:0/4208967603 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7feccc039490 0x7feccc03b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fecd0006fd0 tx=0x7fecd0006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:10.159+0000 7fece7677640 1 -- 172.21.15.2:0/4208967603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0101490 msgr2=0x7fece0110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:10.159+0000 7fece7677640 1 --2- 172.21.15.2:0/4208967603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0101490 0x7fece0110df0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecdc0098a0 tx=0x7fecdc008040 comp rx=0 tx=0).stop 2024-09-17T00:53:10.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:10.159+0000 7fece7677640 1 -- 172.21.15.2:0/4208967603 shutdown_connections 2024-09-17T00:53:10.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:10.159+0000 7fece7677640 1 --2- 172.21.15.2:0/4208967603 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7feccc039490 0x7feccc03b940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:10.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:10.159+0000 7fece7677640 1 --2- 172.21.15.2:0/4208967603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fece0101490 0x7fece0110df0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:10.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:10.159+0000 7fece7677640 1 -- 172.21.15.2:0/4208967603 >> 172.21.15.2:0/4208967603 conn(0x7fece00fbde0 msgr2=0x7fece00fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:10.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:10.159+0000 7fece7677640 1 -- 172.21.15.2:0/4208967603 shutdown_connections 2024-09-17T00:53:10.689 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:10.159+0000 7fece7677640 1 -- 172.21.15.2:0/4208967603 wait complete. 2024-09-17T00:53:11.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:11 smithi002 ceph-mon[27650]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:11.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:11 smithi002 ceph-mon[27650]: Generating ssh key... 2024-09-17T00:53:11.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:11 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:11.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:11 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:11.692 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCDVhqpeWDweskQWFfPdd7kfWRztdWUDq6fkxwwAeQ2SrlAgvU/WtRXgLn5YbGe2QoLH2tYhZBqZBimt/q7sqgAfNzWA6do4HEBxvZNrLUsvo8yAgZj6Z70KgFFKh764kktwo0jMbMMR9tXVlIiQ1TVwjgBikk6O5pVNIT8Nnbphczap4C9a9Z6wkSDw/Rq4Q8HfQe8+2/6JPSTc5JQy0I4M0CZU2M3RMJktodqx7d+WEAgEsJmR+JQryt00Igp4LIEc7DbleoZDqeOzPF+beTGYHDQtutxEo1FvX4hO4M0QBPtLXwmx7u34uJkokHGBwUDdW2B9JsU3sO1RozMRPvGuvSeNdJLqZea8UtryDwh7chsszH+u+LIC8mG6qphdQQiXaVc+eJ3EgbZG81zyCT32EGTNj1XwCYsBbct6O5W/nGZbYeYNy7LEY1/3w6djPeE+Xn7QHQyJPlW0f59ojEOnOVlpYdOve4B10OZFEEbE5FDlcc6uD9BobGHfqZrTmc= ceph-f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:53:11.693 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.079+0000 7fcfd76c7640 1 Processor -- start 2024-09-17T00:53:11.693 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.080+0000 7fcfd76c7640 1 -- start start 2024-09-17T00:53:11.693 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.080+0000 7fcfd76c7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd01005e0 0x7fcfd01009f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:11.693 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.080+0000 7fcfd76c7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0100f30 con 0x7fcfd01005e0 2024-09-17T00:53:11.693 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.080+0000 7fcfd5463640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd01005e0 0x7fcfd01009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:11.693 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.080+0000 7fcfd5463640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd01005e0 0x7fcfd01009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52864/0 (socket says 172.21.15.2:52864) 2024-09-17T00:53:11.693 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.080+0000 7fcfd5463640 1 -- 172.21.15.2:0/243702302 learned_addr learned my addr 172.21.15.2:0/243702302 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:11.693 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.081+0000 7fcfd5463640 1 -- 172.21.15.2:0/243702302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd0101070 con 0x7fcfd01005e0 2024-09-17T00:53:11.693 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.081+0000 7fcfd5463640 1 --2- 172.21.15.2:0/243702302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd01005e0 0x7fcfd01009f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009840 tx=0x7fcfc80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f3fc6ca0b50e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:11.693 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.081+0000 7fcfcffff640 1 -- 172.21.15.2:0/243702302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfc8032440 con 0x7fcfd01005e0 2024-09-17T00:53:11.693 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.081+0000 7fcfcffff640 1 -- 172.21.15.2:0/243702302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcfc8032a00 con 0x7fcfd01005e0 2024-09-17T00:53:11.694 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.081+0000 7fcfcffff640 1 -- 172.21.15.2:0/243702302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfc80319e0 con 0x7fcfd01005e0 2024-09-17T00:53:11.694 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.082+0000 7fcfd76c7640 1 -- 172.21.15.2:0/243702302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd01005e0 msgr2=0x7fcfd01009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:11.694 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.082+0000 7fcfd76c7640 1 --2- 172.21.15.2:0/243702302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd01005e0 0x7fcfd01009f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8009840 tx=0x7fcfc80091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:11.694 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.082+0000 7fcfd76c7640 1 -- 172.21.15.2:0/243702302 shutdown_connections 2024-09-17T00:53:11.694 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.082+0000 7fcfd76c7640 1 --2- 172.21.15.2:0/243702302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd01005e0 0x7fcfd01009f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:11.694 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.082+0000 7fcfd76c7640 1 -- 172.21.15.2:0/243702302 >> 172.21.15.2:0/243702302 conn(0x7fcfd00fbde0 msgr2=0x7fcfd00fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:11.694 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.082+0000 7fcfd76c7640 1 -- 172.21.15.2:0/243702302 shutdown_connections 2024-09-17T00:53:11.694 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.082+0000 7fcfd76c7640 1 -- 172.21.15.2:0/243702302 wait complete. 2024-09-17T00:53:11.694 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.083+0000 7fcfd76c7640 1 Processor -- start 2024-09-17T00:53:11.694 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.083+0000 7fcfd76c7640 1 -- start start 2024-09-17T00:53:11.694 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.083+0000 7fcfd76c7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd01005e0 0x7fcfd0104620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:11.694 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.083+0000 7fcfd76c7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0104b60 con 0x7fcfd01005e0 2024-09-17T00:53:11.694 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.083+0000 7fcfd5463640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd01005e0 0x7fcfd0104620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:11.694 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.083+0000 7fcfd5463640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd01005e0 0x7fcfd0104620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52880/0 (socket says 172.21.15.2:52880) 2024-09-17T00:53:11.695 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.083+0000 7fcfd5463640 1 -- 172.21.15.2:0/3531224799 learned_addr learned my addr 172.21.15.2:0/3531224799 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:11.695 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.084+0000 7fcfd5463640 1 -- 172.21.15.2:0/3531224799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc8009450 con 0x7fcfd01005e0 2024-09-17T00:53:11.695 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.084+0000 7fcfd5463640 1 --2- 172.21.15.2:0/3531224799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd01005e0 0x7fcfd0104620 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80098a0 tx=0x7fcfc8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:11.695 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.084+0000 7fcfcdffb640 1 -- 172.21.15.2:0/3531224799 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfc8032880 con 0x7fcfd01005e0 2024-09-17T00:53:11.695 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.084+0000 7fcfcdffb640 1 -- 172.21.15.2:0/3531224799 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcfc803d8b0 con 0x7fcfd01005e0 2024-09-17T00:53:11.695 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.084+0000 7fcfd76c7640 1 -- 172.21.15.2:0/3531224799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd0102bf0 con 0x7fcfd01005e0 2024-09-17T00:53:11.695 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.084+0000 7fcfcdffb640 1 -- 172.21.15.2:0/3531224799 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfc803b8a0 con 0x7fcfd01005e0 2024-09-17T00:53:11.695 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.084+0000 7fcfd76c7640 1 -- 172.21.15.2:0/3531224799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd0103060 con 0x7fcfd01005e0 2024-09-17T00:53:11.695 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.085+0000 7fcfcdffb640 1 -- 172.21.15.2:0/3531224799 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fcfc8039070 con 0x7fcfd01005e0 2024-09-17T00:53:11.695 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.085+0000 7fcfcdffb640 1 --2- 172.21.15.2:0/3531224799 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fcfb80394e0 0x7fcfb803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:11.695 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.085+0000 7fcfcdffb640 1 -- 172.21.15.2:0/3531224799 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fcfc806d3b0 con 0x7fcfd01005e0 2024-09-17T00:53:11.695 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.085+0000 7fcfd4c62640 1 --2- 172.21.15.2:0/3531224799 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fcfb80394e0 0x7fcfb803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:11.695 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.085+0000 7fcfd76c7640 1 -- 172.21.15.2:0/3531224799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd005ed70 con 0x7fcfd01005e0 2024-09-17T00:53:11.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.086+0000 7fcfd4c62640 1 --2- 172.21.15.2:0/3531224799 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fcfb80394e0 0x7fcfb803b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4006fd0 tx=0x7fcfc4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:11.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.090+0000 7fcfcdffb640 1 -- 172.21.15.2:0/3531224799 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcfc8041070 con 0x7fcfd01005e0 2024-09-17T00:53:11.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.257+0000 7fcfd76c7640 1 -- 172.21.15.2:0/3531224799 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfd010a3f0 con 0x7fcfb80394e0 2024-09-17T00:53:11.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.257+0000 7fcfcdffb640 1 -- 172.21.15.2:0/3531224799 <== mgr.14118 v2:172.21.15.2:6800/3082534604 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fcfd010a3f0 con 0x7fcfb80394e0 2024-09-17T00:53:11.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.259+0000 7fcfd76c7640 1 -- 172.21.15.2:0/3531224799 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fcfb80394e0 msgr2=0x7fcfb803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:11.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.259+0000 7fcfd76c7640 1 --2- 172.21.15.2:0/3531224799 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fcfb80394e0 0x7fcfb803b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4006fd0 tx=0x7fcfc4006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:11.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.259+0000 7fcfd76c7640 1 -- 172.21.15.2:0/3531224799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd01005e0 msgr2=0x7fcfd0104620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:11.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.259+0000 7fcfd76c7640 1 --2- 172.21.15.2:0/3531224799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd01005e0 0x7fcfd0104620 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80098a0 tx=0x7fcfc8008040 comp rx=0 tx=0).stop 2024-09-17T00:53:11.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.260+0000 7fcfd76c7640 1 -- 172.21.15.2:0/3531224799 shutdown_connections 2024-09-17T00:53:11.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.260+0000 7fcfd76c7640 1 --2- 172.21.15.2:0/3531224799 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fcfb80394e0 0x7fcfb803b990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:11.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.260+0000 7fcfd76c7640 1 --2- 172.21.15.2:0/3531224799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfd01005e0 0x7fcfd0104620 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:11.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.260+0000 7fcfd76c7640 1 -- 172.21.15.2:0/3531224799 >> 172.21.15.2:0/3531224799 conn(0x7fcfd00fbde0 msgr2=0x7fcfd0105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:11.696 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.260+0000 7fcfd76c7640 1 -- 172.21.15.2:0/3531224799 shutdown_connections 2024-09-17T00:53:11.697 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:11.260+0000 7fcfd76c7640 1 -- 172.21.15.2:0/3531224799 wait complete. 2024-09-17T00:53:11.697 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-17T00:53:11.697 INFO:teuthology.orchestra.run.smithi002.stdout:Adding key to root@localhost authorized_keys... 2024-09-17T00:53:11.700 INFO:teuthology.orchestra.run.smithi002.stdout:Adding host smithi002... 2024-09-17T00:53:12.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:12 smithi002 ceph-mon[27650]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:13.325 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:13 smithi002 ceph-mon[27650]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:14.537 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:14 smithi002 ceph-mon[27650]: Deploying cephadm binary to smithi002 2024-09-17T00:53:16.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Added host 'smithi002' with addr '172.21.15.2' 2024-09-17T00:53:16.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.114+0000 7f1448234640 1 Processor -- start 2024-09-17T00:53:16.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.114+0000 7f1448234640 1 -- start start 2024-09-17T00:53:16.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.114+0000 7f1448234640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1440078d00 0x7f1440077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:16.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.114+0000 7f1448234640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440079110 con 0x7f1440078d00 2024-09-17T00:53:16.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.115+0000 7f1445fd0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1440078d00 0x7f1440077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:16.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.115+0000 7f1445fd0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1440078d00 0x7f1440077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52884/0 (socket says 172.21.15.2:52884) 2024-09-17T00:53:16.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.115+0000 7f1445fd0640 1 -- 172.21.15.2:0/1929027375 learned_addr learned my addr 172.21.15.2:0/1929027375 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:16.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.115+0000 7f1445fd0640 1 -- 172.21.15.2:0/1929027375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1440077770 con 0x7f1440078d00 2024-09-17T00:53:16.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.116+0000 7f1445fd0640 1 --2- 172.21.15.2:0/1929027375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1440078d00 0x7f1440077230 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1438009840 tx=0x7f14380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a27e00af72ecdd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:16.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.116+0000 7f1444fce640 1 -- 172.21.15.2:0/1929027375 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1438032440 con 0x7f1440078d00 2024-09-17T00:53:16.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.116+0000 7f1444fce640 1 -- 172.21.15.2:0/1929027375 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1438032a00 con 0x7f1440078d00 2024-09-17T00:53:16.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.116+0000 7f1444fce640 1 -- 172.21.15.2:0/1929027375 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14380319e0 con 0x7f1440078d00 2024-09-17T00:53:16.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.117+0000 7f1448234640 1 -- 172.21.15.2:0/1929027375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1440078d00 msgr2=0x7f1440077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:16.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.117+0000 7f1448234640 1 --2- 172.21.15.2:0/1929027375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1440078d00 0x7f1440077230 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1438009840 tx=0x7f14380091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:16.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.117+0000 7f1448234640 1 -- 172.21.15.2:0/1929027375 shutdown_connections 2024-09-17T00:53:16.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.117+0000 7f1448234640 1 --2- 172.21.15.2:0/1929027375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1440078d00 0x7f1440077230 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:16.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.117+0000 7f1448234640 1 -- 172.21.15.2:0/1929027375 >> 172.21.15.2:0/1929027375 conn(0x7f14400fd700 msgr2=0x7f14400ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:16.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.117+0000 7f1448234640 1 -- 172.21.15.2:0/1929027375 shutdown_connections 2024-09-17T00:53:16.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.117+0000 7f1448234640 1 -- 172.21.15.2:0/1929027375 wait complete. 2024-09-17T00:53:16.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.117+0000 7f1448234640 1 Processor -- start 2024-09-17T00:53:16.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.117+0000 7f1448234640 1 -- start start 2024-09-17T00:53:16.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.118+0000 7f1448234640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1440078d00 0x7f1440112f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:16.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.118+0000 7f1448234640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14401134b0 con 0x7f1440078d00 2024-09-17T00:53:16.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.118+0000 7f1445fd0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1440078d00 0x7f1440112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:16.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.118+0000 7f1445fd0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1440078d00 0x7f1440112f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52888/0 (socket says 172.21.15.2:52888) 2024-09-17T00:53:16.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.118+0000 7f1445fd0640 1 -- 172.21.15.2:0/1880839962 learned_addr learned my addr 172.21.15.2:0/1880839962 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:16.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.118+0000 7f1445fd0640 1 -- 172.21.15.2:0/1880839962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1438009450 con 0x7f1440078d00 2024-09-17T00:53:16.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.118+0000 7f1445fd0640 1 --2- 172.21.15.2:0/1880839962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1440078d00 0x7f1440112f70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1438006f00 tx=0x7f1438008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:16.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.118+0000 7f143e7fc640 1 -- 172.21.15.2:0/1880839962 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1438031d30 con 0x7f1440078d00 2024-09-17T00:53:16.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.118+0000 7f143e7fc640 1 -- 172.21.15.2:0/1880839962 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1438031e90 con 0x7f1440078d00 2024-09-17T00:53:16.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.118+0000 7f1448234640 1 -- 172.21.15.2:0/1880839962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14401136b0 con 0x7f1440078d00 2024-09-17T00:53:16.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.118+0000 7f143e7fc640 1 -- 172.21.15.2:0/1880839962 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f143803b790 con 0x7f1440078d00 2024-09-17T00:53:16.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.119+0000 7f1448234640 1 -- 172.21.15.2:0/1880839962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1440113b20 con 0x7f1440078d00 2024-09-17T00:53:16.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.119+0000 7f143e7fc640 1 -- 172.21.15.2:0/1880839962 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f1438039070 con 0x7f1440078d00 2024-09-17T00:53:16.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.120+0000 7f143e7fc640 1 --2- 172.21.15.2:0/1880839962 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f14280394e0 0x7f142803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:16.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.120+0000 7f143e7fc640 1 -- 172.21.15.2:0/1880839962 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f143806d060 con 0x7f1440078d00 2024-09-17T00:53:16.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.120+0000 7f14457cf640 1 --2- 172.21.15.2:0/1880839962 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f14280394e0 0x7f142803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:16.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.120+0000 7f1448234640 1 -- 172.21.15.2:0/1880839962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144005ed70 con 0x7f1440078d00 2024-09-17T00:53:16.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.120+0000 7f14457cf640 1 --2- 172.21.15.2:0/1880839962 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f14280394e0 0x7f142803b990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1434006fd0 tx=0x7f1434006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:16.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.125+0000 7f143e7fc640 1 -- 172.21.15.2:0/1880839962 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1438041070 con 0x7f1440078d00 2024-09-17T00:53:16.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:12.294+0000 7f1448234640 1 -- 172.21.15.2:0/1880839962 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}) v1 -- 0x7f14400feb00 con 0x7f14280394e0 2024-09-17T00:53:16.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:15.682+0000 7f143e7fc640 1 -- 172.21.15.2:0/1880839962 <== mgr.14118 v2:172.21.15.2:6800/3082534604 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f14400feb00 con 0x7f14280394e0 2024-09-17T00:53:16.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:15.684+0000 7f1448234640 1 -- 172.21.15.2:0/1880839962 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f14280394e0 msgr2=0x7f142803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:16.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:15.684+0000 7f1448234640 1 --2- 172.21.15.2:0/1880839962 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f14280394e0 0x7f142803b990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1434006fd0 tx=0x7f1434006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:16.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:15.684+0000 7f1448234640 1 -- 172.21.15.2:0/1880839962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1440078d00 msgr2=0x7f1440112f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:16.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:15.684+0000 7f1448234640 1 --2- 172.21.15.2:0/1880839962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1440078d00 0x7f1440112f70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1438006f00 tx=0x7f1438008040 comp rx=0 tx=0).stop 2024-09-17T00:53:16.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:15.684+0000 7f1448234640 1 -- 172.21.15.2:0/1880839962 shutdown_connections 2024-09-17T00:53:16.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:15.684+0000 7f1448234640 1 --2- 172.21.15.2:0/1880839962 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f14280394e0 0x7f142803b990 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:16.296 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:15.684+0000 7f1448234640 1 --2- 172.21.15.2:0/1880839962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1440078d00 0x7f1440112f70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:16.296 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:15.684+0000 7f1448234640 1 -- 172.21.15.2:0/1880839962 >> 172.21.15.2:0/1880839962 conn(0x7f14400fd700 msgr2=0x7f14400fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:16.296 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:15.684+0000 7f1448234640 1 -- 172.21.15.2:0/1880839962 shutdown_connections 2024-09-17T00:53:16.296 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:15.684+0000 7f1448234640 1 -- 172.21.15.2:0/1880839962 wait complete. 2024-09-17T00:53:16.296 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying mon service with default placement... 2024-09-17T00:53:16.889 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:16 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:16.889 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:16 smithi002 ceph-mon[27650]: Added host smithi002 2024-09-17T00:53:16.889 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:16 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:17.643 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-17T00:53:17.644 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.695+0000 7f6a9e07a640 1 Processor -- start 2024-09-17T00:53:17.644 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.695+0000 7f6a9e07a640 1 -- start start 2024-09-17T00:53:17.644 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.695+0000 7f6a9e07a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a98101f20 0x7f6a98102330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:17.644 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.695+0000 7f6a9e07a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a98102870 con 0x7f6a98101f20 2024-09-17T00:53:17.644 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.695+0000 7f6a977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a98101f20 0x7f6a98102330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:17.644 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.695+0000 7f6a977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a98101f20 0x7f6a98102330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52904/0 (socket says 172.21.15.2:52904) 2024-09-17T00:53:17.644 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.695+0000 7f6a977fe640 1 -- 172.21.15.2:0/300718411 learned_addr learned my addr 172.21.15.2:0/300718411 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:17.644 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.696+0000 7f6a977fe640 1 -- 172.21.15.2:0/300718411 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a981029b0 con 0x7f6a98101f20 2024-09-17T00:53:17.644 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.696+0000 7f6a977fe640 1 --2- 172.21.15.2:0/300718411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a98101f20 0x7f6a98102330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009840 tx=0x7f6a880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde27d3c4995136 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:17.644 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.697+0000 7f6a967fc640 1 -- 172.21.15.2:0/300718411 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a88032440 con 0x7f6a98101f20 2024-09-17T00:53:17.644 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.697+0000 7f6a967fc640 1 -- 172.21.15.2:0/300718411 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6a88032a00 con 0x7f6a98101f20 2024-09-17T00:53:17.645 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.697+0000 7f6a967fc640 1 -- 172.21.15.2:0/300718411 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a880319e0 con 0x7f6a98101f20 2024-09-17T00:53:17.645 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.697+0000 7f6a9e07a640 1 -- 172.21.15.2:0/300718411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a98101f20 msgr2=0x7f6a98102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:17.645 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.697+0000 7f6a9e07a640 1 --2- 172.21.15.2:0/300718411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a98101f20 0x7f6a98102330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009840 tx=0x7f6a880091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:17.645 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.697+0000 7f6a9e07a640 1 -- 172.21.15.2:0/300718411 shutdown_connections 2024-09-17T00:53:17.645 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.697+0000 7f6a9e07a640 1 --2- 172.21.15.2:0/300718411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a98101f20 0x7f6a98102330 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:17.645 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.697+0000 7f6a9e07a640 1 -- 172.21.15.2:0/300718411 >> 172.21.15.2:0/300718411 conn(0x7f6a980fd6a0 msgr2=0x7f6a980ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:17.645 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.697+0000 7f6a9e07a640 1 -- 172.21.15.2:0/300718411 shutdown_connections 2024-09-17T00:53:17.645 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.697+0000 7f6a9e07a640 1 -- 172.21.15.2:0/300718411 wait complete. 2024-09-17T00:53:17.645 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.698+0000 7f6a9e07a640 1 Processor -- start 2024-09-17T00:53:17.645 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.698+0000 7f6a9e07a640 1 -- start start 2024-09-17T00:53:17.645 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.698+0000 7f6a9e07a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a98101f20 0x7f6a98110e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:17.645 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.698+0000 7f6a9e07a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a98111360 con 0x7f6a98101f20 2024-09-17T00:53:17.645 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.699+0000 7f6a977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a98101f20 0x7f6a98110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:17.646 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.699+0000 7f6a977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a98101f20 0x7f6a98110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52912/0 (socket says 172.21.15.2:52912) 2024-09-17T00:53:17.646 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.699+0000 7f6a977fe640 1 -- 172.21.15.2:0/1072783179 learned_addr learned my addr 172.21.15.2:0/1072783179 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:17.646 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.699+0000 7f6a977fe640 1 -- 172.21.15.2:0/1072783179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a88009450 con 0x7f6a98101f20 2024-09-17T00:53:17.646 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.699+0000 7f6a977fe640 1 --2- 172.21.15.2:0/1072783179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a98101f20 0x7f6a98110e20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6a88000c00 tx=0x7f6a88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:17.646 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.699+0000 7f6a7ffff640 1 -- 172.21.15.2:0/1072783179 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a8803d450 con 0x7f6a98101f20 2024-09-17T00:53:17.646 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.699+0000 7f6a7ffff640 1 -- 172.21.15.2:0/1072783179 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6a8803da10 con 0x7f6a98101f20 2024-09-17T00:53:17.646 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.699+0000 7f6a9e07a640 1 -- 172.21.15.2:0/1072783179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a98111560 con 0x7f6a98101f20 2024-09-17T00:53:17.646 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.699+0000 7f6a7ffff640 1 -- 172.21.15.2:0/1072783179 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6a8803b880 con 0x7f6a98101f20 2024-09-17T00:53:17.646 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.699+0000 7f6a9e07a640 1 -- 172.21.15.2:0/1072783179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a98111fb0 con 0x7f6a98101f20 2024-09-17T00:53:17.646 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.700+0000 7f6a7ffff640 1 -- 172.21.15.2:0/1072783179 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f6a88039070 con 0x7f6a98101f20 2024-09-17T00:53:17.646 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.700+0000 7f6a7ffff640 1 --2- 172.21.15.2:0/1072783179 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f6a80039490 0x7f6a8003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:17.646 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.700+0000 7f6a7ffff640 1 -- 172.21.15.2:0/1072783179 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6a8806d3b0 con 0x7f6a98101f20 2024-09-17T00:53:17.646 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.700+0000 7f6a9e07a640 1 -- 172.21.15.2:0/1072783179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9805ed70 con 0x7f6a98101f20 2024-09-17T00:53:17.647 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.700+0000 7f6a96ffd640 1 --2- 172.21.15.2:0/1072783179 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f6a80039490 0x7f6a8003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:17.647 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.701+0000 7f6a96ffd640 1 --2- 172.21.15.2:0/1072783179 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f6a80039490 0x7f6a8003b940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c006fd0 tx=0x7f6a8c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:17.647 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.705+0000 7f6a7ffff640 1 -- 172.21.15.2:0/1072783179 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6a88037020 con 0x7f6a98101f20 2024-09-17T00:53:17.647 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.891+0000 7f6a9e07a640 1 -- 172.21.15.2:0/1072783179 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a980feb30 con 0x7f6a80039490 2024-09-17T00:53:17.647 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.895+0000 7f6a7ffff640 1 -- 172.21.15.2:0/1072783179 <== mgr.14118 v2:172.21.15.2:6800/3082534604 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6a980feb30 con 0x7f6a80039490 2024-09-17T00:53:17.647 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.897+0000 7f6a9e07a640 1 -- 172.21.15.2:0/1072783179 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f6a80039490 msgr2=0x7f6a8003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:17.647 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.897+0000 7f6a9e07a640 1 --2- 172.21.15.2:0/1072783179 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f6a80039490 0x7f6a8003b940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c006fd0 tx=0x7f6a8c006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:17.647 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.897+0000 7f6a9e07a640 1 -- 172.21.15.2:0/1072783179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a98101f20 msgr2=0x7f6a98110e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:17.647 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.897+0000 7f6a9e07a640 1 --2- 172.21.15.2:0/1072783179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a98101f20 0x7f6a98110e20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6a88000c00 tx=0x7f6a88008040 comp rx=0 tx=0).stop 2024-09-17T00:53:17.647 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.897+0000 7f6a9e07a640 1 -- 172.21.15.2:0/1072783179 shutdown_connections 2024-09-17T00:53:17.647 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.897+0000 7f6a9e07a640 1 --2- 172.21.15.2:0/1072783179 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f6a80039490 0x7f6a8003b940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:17.648 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.897+0000 7f6a9e07a640 1 --2- 172.21.15.2:0/1072783179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a98101f20 0x7f6a98110e20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:17.648 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.897+0000 7f6a9e07a640 1 -- 172.21.15.2:0/1072783179 >> 172.21.15.2:0/1072783179 conn(0x7f6a980fd6a0 msgr2=0x7f6a980fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:17.648 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.897+0000 7f6a9e07a640 1 -- 172.21.15.2:0/1072783179 shutdown_connections 2024-09-17T00:53:17.648 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:16.897+0000 7f6a9e07a640 1 -- 172.21.15.2:0/1072783179 wait complete. 2024-09-17T00:53:17.648 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying mgr service with default placement... 2024-09-17T00:53:18.087 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:17 smithi002 ceph-mon[27650]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:18.087 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:17 smithi002 ceph-mon[27650]: Saving service mon spec with placement count:5 2024-09-17T00:53:18.087 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:17 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:19.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-17T00:53:19.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.265+0000 7fcb9733b640 1 Processor -- start 2024-09-17T00:53:19.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.265+0000 7fcb9733b640 1 -- start start 2024-09-17T00:53:19.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.265+0000 7fcb9733b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb90076c50 0x7fcb90104b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:19.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.265+0000 7fcb9733b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90105040 con 0x7fcb90076c50 2024-09-17T00:53:19.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.265+0000 7fcb950d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb90076c50 0x7fcb90104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:19.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.265+0000 7fcb950d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb90076c50 0x7fcb90104b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52920/0 (socket says 172.21.15.2:52920) 2024-09-17T00:53:19.673 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.265+0000 7fcb950d7640 1 -- 172.21.15.2:0/3834157339 learned_addr learned my addr 172.21.15.2:0/3834157339 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:19.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.266+0000 7fcb950d7640 1 -- 172.21.15.2:0/3834157339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb90105180 con 0x7fcb90076c50 2024-09-17T00:53:19.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.266+0000 7fcb950d7640 1 --2- 172.21.15.2:0/3834157339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb90076c50 0x7fcb90104b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009840 tx=0x7fcb8c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5828415817f6d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:19.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.267+0000 7fcb87fff640 1 -- 172.21.15.2:0/3834157339 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb8c032440 con 0x7fcb90076c50 2024-09-17T00:53:19.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.267+0000 7fcb87fff640 1 -- 172.21.15.2:0/3834157339 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcb8c032a00 con 0x7fcb90076c50 2024-09-17T00:53:19.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.267+0000 7fcb87fff640 1 -- 172.21.15.2:0/3834157339 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb8c0319e0 con 0x7fcb90076c50 2024-09-17T00:53:19.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.267+0000 7fcb9733b640 1 -- 172.21.15.2:0/3834157339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb90076c50 msgr2=0x7fcb90104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:19.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.267+0000 7fcb9733b640 1 --2- 172.21.15.2:0/3834157339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb90076c50 0x7fcb90104b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009840 tx=0x7fcb8c0091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:19.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.267+0000 7fcb9733b640 1 -- 172.21.15.2:0/3834157339 shutdown_connections 2024-09-17T00:53:19.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.267+0000 7fcb9733b640 1 --2- 172.21.15.2:0/3834157339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb90076c50 0x7fcb90104b00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:19.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.267+0000 7fcb9733b640 1 -- 172.21.15.2:0/3834157339 >> 172.21.15.2:0/3834157339 conn(0x7fcb900fc5d0 msgr2=0x7fcb900fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:19.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.267+0000 7fcb9733b640 1 -- 172.21.15.2:0/3834157339 shutdown_connections 2024-09-17T00:53:19.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.268+0000 7fcb9733b640 1 -- 172.21.15.2:0/3834157339 wait complete. 2024-09-17T00:53:19.674 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.268+0000 7fcb9733b640 1 Processor -- start 2024-09-17T00:53:19.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.268+0000 7fcb9733b640 1 -- start start 2024-09-17T00:53:19.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.268+0000 7fcb9733b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb90076c50 0x7fcb90102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:19.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.268+0000 7fcb9733b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90102970 con 0x7fcb90076c50 2024-09-17T00:53:19.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.268+0000 7fcb950d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb90076c50 0x7fcb90102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:19.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.268+0000 7fcb950d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb90076c50 0x7fcb90102430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52934/0 (socket says 172.21.15.2:52934) 2024-09-17T00:53:19.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.268+0000 7fcb950d7640 1 -- 172.21.15.2:0/368411647 learned_addr learned my addr 172.21.15.2:0/368411647 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:19.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.269+0000 7fcb950d7640 1 -- 172.21.15.2:0/368411647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c009450 con 0x7fcb90076c50 2024-09-17T00:53:19.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.269+0000 7fcb950d7640 1 --2- 172.21.15.2:0/368411647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb90076c50 0x7fcb90102430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0098a0 tx=0x7fcb8c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:19.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.269+0000 7fcb85ffb640 1 -- 172.21.15.2:0/368411647 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb8c032880 con 0x7fcb90076c50 2024-09-17T00:53:19.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.269+0000 7fcb9733b640 1 -- 172.21.15.2:0/368411647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb90100a60 con 0x7fcb90076c50 2024-09-17T00:53:19.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.269+0000 7fcb85ffb640 1 -- 172.21.15.2:0/368411647 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcb8c03d8b0 con 0x7fcb90076c50 2024-09-17T00:53:19.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.269+0000 7fcb85ffb640 1 -- 172.21.15.2:0/368411647 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb8c03b8e0 con 0x7fcb90076c50 2024-09-17T00:53:19.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.269+0000 7fcb9733b640 1 -- 172.21.15.2:0/368411647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb90100f30 con 0x7fcb90076c50 2024-09-17T00:53:19.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.270+0000 7fcb85ffb640 1 -- 172.21.15.2:0/368411647 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fcb8c039070 con 0x7fcb90076c50 2024-09-17T00:53:19.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.270+0000 7fcb9733b640 1 -- 172.21.15.2:0/368411647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9004b720 con 0x7fcb90076c50 2024-09-17T00:53:19.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.271+0000 7fcb85ffb640 1 --2- 172.21.15.2:0/368411647 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fcb7c039490 0x7fcb7c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:19.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.271+0000 7fcb85ffb640 1 -- 172.21.15.2:0/368411647 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fcb8c06d480 con 0x7fcb90076c50 2024-09-17T00:53:19.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.271+0000 7fcb948d6640 1 --2- 172.21.15.2:0/368411647 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fcb7c039490 0x7fcb7c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:19.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.271+0000 7fcb948d6640 1 --2- 172.21.15.2:0/368411647 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fcb7c039490 0x7fcb7c03b940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcb80006fd0 tx=0x7fcb80006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:19.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.275+0000 7fcb85ffb640 1 -- 172.21.15.2:0/368411647 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcb8c039320 con 0x7fcb90076c50 2024-09-17T00:53:19.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.451+0000 7fcb9733b640 1 -- 172.21.15.2:0/368411647 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb901016c0 con 0x7fcb7c039490 2024-09-17T00:53:19.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.456+0000 7fcb85ffb640 1 -- 172.21.15.2:0/368411647 <== mgr.14118 v2:172.21.15.2:6800/3082534604 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fcb901016c0 con 0x7fcb7c039490 2024-09-17T00:53:19.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.458+0000 7fcb9733b640 1 -- 172.21.15.2:0/368411647 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fcb7c039490 msgr2=0x7fcb7c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:19.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.458+0000 7fcb9733b640 1 --2- 172.21.15.2:0/368411647 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fcb7c039490 0x7fcb7c03b940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcb80006fd0 tx=0x7fcb80006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:19.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.458+0000 7fcb9733b640 1 -- 172.21.15.2:0/368411647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb90076c50 msgr2=0x7fcb90102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:19.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.458+0000 7fcb9733b640 1 --2- 172.21.15.2:0/368411647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb90076c50 0x7fcb90102430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0098a0 tx=0x7fcb8c008040 comp rx=0 tx=0).stop 2024-09-17T00:53:19.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.458+0000 7fcb9733b640 1 -- 172.21.15.2:0/368411647 shutdown_connections 2024-09-17T00:53:19.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.458+0000 7fcb9733b640 1 --2- 172.21.15.2:0/368411647 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fcb7c039490 0x7fcb7c03b940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:19.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.458+0000 7fcb9733b640 1 --2- 172.21.15.2:0/368411647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb90076c50 0x7fcb90102430 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:19.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.458+0000 7fcb9733b640 1 -- 172.21.15.2:0/368411647 >> 172.21.15.2:0/368411647 conn(0x7fcb900fc5d0 msgr2=0x7fcb900fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:19.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.458+0000 7fcb9733b640 1 -- 172.21.15.2:0/368411647 shutdown_connections 2024-09-17T00:53:19.677 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:18.458+0000 7fcb9733b640 1 -- 172.21.15.2:0/368411647 wait complete. 2024-09-17T00:53:19.677 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying crash service with default placement... 2024-09-17T00:53:19.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:19 smithi002 ceph-mon[27650]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:19.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:19 smithi002 ceph-mon[27650]: Saving service mgr spec with placement count:2 2024-09-17T00:53:19.793 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:19 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:19.793 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:19 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:19.793 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:19 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:21.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-17T00:53:21.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.107+0000 7fb079eaf640 1 Processor -- start 2024-09-17T00:53:21.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.107+0000 7fb079eaf640 1 -- start start 2024-09-17T00:53:21.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.107+0000 7fb079eaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb074101ee0 0x7fb0741022f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:21.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.107+0000 7fb079eaf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb074102830 con 0x7fb074101ee0 2024-09-17T00:53:21.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.107+0000 7fb0737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb074101ee0 0x7fb0741022f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:21.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.107+0000 7fb0737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb074101ee0 0x7fb0741022f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52948/0 (socket says 172.21.15.2:52948) 2024-09-17T00:53:21.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.107+0000 7fb0737fe640 1 -- 172.21.15.2:0/4059639985 learned_addr learned my addr 172.21.15.2:0/4059639985 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:21.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.107+0000 7fb0737fe640 1 -- 172.21.15.2:0/4059639985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074102970 con 0x7fb074101ee0 2024-09-17T00:53:21.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.108+0000 7fb0737fe640 1 --2- 172.21.15.2:0/4059639985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb074101ee0 0x7fb0741022f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb064009840 tx=0x7fb0640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b8b8a159e0697a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:21.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.108+0000 7fb0727fc640 1 -- 172.21.15.2:0/4059639985 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb064032440 con 0x7fb074101ee0 2024-09-17T00:53:21.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.108+0000 7fb0727fc640 1 -- 172.21.15.2:0/4059639985 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb064032a40 con 0x7fb074101ee0 2024-09-17T00:53:21.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.108+0000 7fb0727fc640 1 -- 172.21.15.2:0/4059639985 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb064031a70 con 0x7fb074101ee0 2024-09-17T00:53:21.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.109+0000 7fb079eaf640 1 -- 172.21.15.2:0/4059639985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb074101ee0 msgr2=0x7fb0741022f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:21.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.109+0000 7fb079eaf640 1 --2- 172.21.15.2:0/4059639985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb074101ee0 0x7fb0741022f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb064009840 tx=0x7fb0640091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:21.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.109+0000 7fb079eaf640 1 -- 172.21.15.2:0/4059639985 shutdown_connections 2024-09-17T00:53:21.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.109+0000 7fb079eaf640 1 --2- 172.21.15.2:0/4059639985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb074101ee0 0x7fb0741022f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:21.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.109+0000 7fb079eaf640 1 -- 172.21.15.2:0/4059639985 >> 172.21.15.2:0/4059639985 conn(0x7fb0740fd700 msgr2=0x7fb0740ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:21.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.109+0000 7fb079eaf640 1 -- 172.21.15.2:0/4059639985 shutdown_connections 2024-09-17T00:53:21.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.109+0000 7fb079eaf640 1 -- 172.21.15.2:0/4059639985 wait complete. 2024-09-17T00:53:21.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.109+0000 7fb079eaf640 1 Processor -- start 2024-09-17T00:53:21.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.110+0000 7fb079eaf640 1 -- start start 2024-09-17T00:53:21.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.110+0000 7fb079eaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb074101ee0 0x7fb074110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:21.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.110+0000 7fb079eaf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb074111370 con 0x7fb074101ee0 2024-09-17T00:53:21.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.110+0000 7fb0737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb074101ee0 0x7fb074110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:21.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.110+0000 7fb0737fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb074101ee0 0x7fb074110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52960/0 (socket says 172.21.15.2:52960) 2024-09-17T00:53:21.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.110+0000 7fb0737fe640 1 -- 172.21.15.2:0/3280678616 learned_addr learned my addr 172.21.15.2:0/3280678616 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:21.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.110+0000 7fb0737fe640 1 -- 172.21.15.2:0/3280678616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb064009450 con 0x7fb074101ee0 2024-09-17T00:53:21.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.110+0000 7fb0737fe640 1 --2- 172.21.15.2:0/3280678616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb074101ee0 0x7fb074110e30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb064031670 tx=0x7fb0640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:21.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.110+0000 7fb05bfff640 1 -- 172.21.15.2:0/3280678616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb06403c400 con 0x7fb074101ee0 2024-09-17T00:53:21.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.111+0000 7fb05bfff640 1 -- 172.21.15.2:0/3280678616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb06403ca00 con 0x7fb074101ee0 2024-09-17T00:53:21.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.111+0000 7fb079eaf640 1 -- 172.21.15.2:0/3280678616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb074111570 con 0x7fb074101ee0 2024-09-17T00:53:21.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.111+0000 7fb05bfff640 1 -- 172.21.15.2:0/3280678616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb06403a910 con 0x7fb074101ee0 2024-09-17T00:53:21.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.111+0000 7fb079eaf640 1 -- 172.21.15.2:0/3280678616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb074111fc0 con 0x7fb074101ee0 2024-09-17T00:53:21.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.111+0000 7fb05bfff640 1 -- 172.21.15.2:0/3280678616 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fb06403ab00 con 0x7fb074101ee0 2024-09-17T00:53:21.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.112+0000 7fb05bfff640 1 --2- 172.21.15.2:0/3280678616 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fb05c039490 0x7fb05c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:21.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.112+0000 7fb079eaf640 1 -- 172.21.15.2:0/3280678616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07405ed70 con 0x7fb074101ee0 2024-09-17T00:53:21.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.112+0000 7fb05bfff640 1 -- 172.21.15.2:0/3280678616 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb06406cfd0 con 0x7fb074101ee0 2024-09-17T00:53:21.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.112+0000 7fb072ffd640 1 --2- 172.21.15.2:0/3280678616 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fb05c039490 0x7fb05c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:21.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.112+0000 7fb072ffd640 1 --2- 172.21.15.2:0/3280678616 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fb05c039490 0x7fb05c03b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb068006fd0 tx=0x7fb068006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:21.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.116+0000 7fb05bfff640 1 -- 172.21.15.2:0/3280678616 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb064037070 con 0x7fb074101ee0 2024-09-17T00:53:21.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.295+0000 7fb079eaf640 1 -- 172.21.15.2:0/3280678616 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0740feac0 con 0x7fb05c039490 2024-09-17T00:53:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.300+0000 7fb05bfff640 1 -- 172.21.15.2:0/3280678616 <== mgr.14118 v2:172.21.15.2:6800/3082534604 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fb0740feac0 con 0x7fb05c039490 2024-09-17T00:53:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.303+0000 7fb079eaf640 1 -- 172.21.15.2:0/3280678616 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fb05c039490 msgr2=0x7fb05c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.303+0000 7fb079eaf640 1 --2- 172.21.15.2:0/3280678616 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fb05c039490 0x7fb05c03b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb068006fd0 tx=0x7fb068006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.303+0000 7fb079eaf640 1 -- 172.21.15.2:0/3280678616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb074101ee0 msgr2=0x7fb074110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.303+0000 7fb079eaf640 1 --2- 172.21.15.2:0/3280678616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb074101ee0 0x7fb074110e30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb064031670 tx=0x7fb0640091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.303+0000 7fb079eaf640 1 -- 172.21.15.2:0/3280678616 shutdown_connections 2024-09-17T00:53:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.303+0000 7fb079eaf640 1 --2- 172.21.15.2:0/3280678616 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fb05c039490 0x7fb05c03b940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.303+0000 7fb079eaf640 1 --2- 172.21.15.2:0/3280678616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb074101ee0 0x7fb074110e30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.303+0000 7fb079eaf640 1 -- 172.21.15.2:0/3280678616 >> 172.21.15.2:0/3280678616 conn(0x7fb0740fd700 msgr2=0x7fb0740fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.303+0000 7fb079eaf640 1 -- 172.21.15.2:0/3280678616 shutdown_connections 2024-09-17T00:53:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:20.303+0000 7fb079eaf640 1 -- 172.21.15.2:0/3280678616 wait complete. 2024-09-17T00:53:21.429 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying prometheus service with default placement... 2024-09-17T00:53:21.560 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:21 smithi002 ceph-mon[27650]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:21.560 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:21 smithi002 ceph-mon[27650]: Saving service crash spec with placement * 2024-09-17T00:53:21.561 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:21 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:21.561 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:21 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:22.658 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-17T00:53:22.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.833+0000 7fb8b9b2b640 1 Processor -- start 2024-09-17T00:53:22.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.833+0000 7fb8b9b2b640 1 -- start start 2024-09-17T00:53:22.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.833+0000 7fb8b9b2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b4078cb0 0x7fb8b4077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:22.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.833+0000 7fb8b9b2b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40790c0 con 0x7fb8b4078cb0 2024-09-17T00:53:22.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.834+0000 7fb8b37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b4078cb0 0x7fb8b4077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:22.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.834+0000 7fb8b37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b4078cb0 0x7fb8b4077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42000/0 (socket says 172.21.15.2:42000) 2024-09-17T00:53:22.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.834+0000 7fb8b37fe640 1 -- 172.21.15.2:0/534047684 learned_addr learned my addr 172.21.15.2:0/534047684 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:22.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.834+0000 7fb8b37fe640 1 -- 172.21.15.2:0/534047684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4077770 con 0x7fb8b4078cb0 2024-09-17T00:53:22.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.835+0000 7fb8b37fe640 1 --2- 172.21.15.2:0/534047684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b4078cb0 0x7fb8b4077230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009840 tx=0x7fb8a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb75ba860ea86f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:22.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.835+0000 7fb8b27fc640 1 -- 172.21.15.2:0/534047684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8a4032440 con 0x7fb8b4078cb0 2024-09-17T00:53:22.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.835+0000 7fb8b27fc640 1 -- 172.21.15.2:0/534047684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb8a4032a40 con 0x7fb8b4078cb0 2024-09-17T00:53:22.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.835+0000 7fb8b27fc640 1 -- 172.21.15.2:0/534047684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8a4031a70 con 0x7fb8b4078cb0 2024-09-17T00:53:22.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.835+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/534047684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b4078cb0 msgr2=0x7fb8b4077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:22.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.835+0000 7fb8b9b2b640 1 --2- 172.21.15.2:0/534047684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b4078cb0 0x7fb8b4077230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009840 tx=0x7fb8a40091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:22.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.835+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/534047684 shutdown_connections 2024-09-17T00:53:22.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.835+0000 7fb8b9b2b640 1 --2- 172.21.15.2:0/534047684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b4078cb0 0x7fb8b4077230 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:22.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.835+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/534047684 >> 172.21.15.2:0/534047684 conn(0x7fb8b40fd700 msgr2=0x7fb8b40ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:22.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.835+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/534047684 shutdown_connections 2024-09-17T00:53:22.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.835+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/534047684 wait complete. 2024-09-17T00:53:22.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.836+0000 7fb8b9b2b640 1 Processor -- start 2024-09-17T00:53:22.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.836+0000 7fb8b9b2b640 1 -- start start 2024-09-17T00:53:22.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.836+0000 7fb8b9b2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b4078cb0 0x7fb8b4112fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:22.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.836+0000 7fb8b9b2b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b41134e0 con 0x7fb8b4078cb0 2024-09-17T00:53:22.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.836+0000 7fb8b37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b4078cb0 0x7fb8b4112fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:22.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.836+0000 7fb8b37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b4078cb0 0x7fb8b4112fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42010/0 (socket says 172.21.15.2:42010) 2024-09-17T00:53:22.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.836+0000 7fb8b37fe640 1 -- 172.21.15.2:0/1627485050 learned_addr learned my addr 172.21.15.2:0/1627485050 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:22.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.837+0000 7fb8b37fe640 1 -- 172.21.15.2:0/1627485050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a4009450 con 0x7fb8b4078cb0 2024-09-17T00:53:22.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.837+0000 7fb8b37fe640 1 --2- 172.21.15.2:0/1627485050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b4078cb0 0x7fb8b4112fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4006f00 tx=0x7fb8a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:22.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.837+0000 7fb89bfff640 1 -- 172.21.15.2:0/1627485050 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8a403c400 con 0x7fb8b4078cb0 2024-09-17T00:53:22.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.837+0000 7fb89bfff640 1 -- 172.21.15.2:0/1627485050 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb8a403ca00 con 0x7fb8b4078cb0 2024-09-17T00:53:22.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.837+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/1627485050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b41136e0 con 0x7fb8b4078cb0 2024-09-17T00:53:22.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.837+0000 7fb89bfff640 1 -- 172.21.15.2:0/1627485050 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8a403a8f0 con 0x7fb8b4078cb0 2024-09-17T00:53:22.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.837+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/1627485050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b4113b50 con 0x7fb8b4078cb0 2024-09-17T00:53:22.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.838+0000 7fb89bfff640 1 -- 172.21.15.2:0/1627485050 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fb8a403cb70 con 0x7fb8b4078cb0 2024-09-17T00:53:22.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.838+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/1627485050 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b404b720 con 0x7fb8b4078cb0 2024-09-17T00:53:22.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.838+0000 7fb89bfff640 1 --2- 172.21.15.2:0/1627485050 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fb89c039490 0x7fb89c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:22.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.838+0000 7fb89bfff640 1 -- 172.21.15.2:0/1627485050 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb8a406cc60 con 0x7fb8b4078cb0 2024-09-17T00:53:22.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.838+0000 7fb8b2ffd640 1 --2- 172.21.15.2:0/1627485050 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fb89c039490 0x7fb89c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:22.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.839+0000 7fb8b2ffd640 1 --2- 172.21.15.2:0/1627485050 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fb89c039490 0x7fb89c03b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8006fd0 tx=0x7fb8a8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:22.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:21.843+0000 7fb89bfff640 1 -- 172.21.15.2:0/1627485050 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb8a403b360 con 0x7fb8b4078cb0 2024-09-17T00:53:22.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:22.020+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/1627485050 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8b4113b50 con 0x7fb89c039490 2024-09-17T00:53:22.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:22.026+0000 7fb89bfff640 1 -- 172.21.15.2:0/1627485050 <== mgr.14118 v2:172.21.15.2:6800/3082534604 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fb8b4113b50 con 0x7fb89c039490 2024-09-17T00:53:22.663 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:22.028+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/1627485050 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fb89c039490 msgr2=0x7fb89c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:22.663 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:22.028+0000 7fb8b9b2b640 1 --2- 172.21.15.2:0/1627485050 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fb89c039490 0x7fb89c03b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8006fd0 tx=0x7fb8a8006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:22.663 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:22.028+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/1627485050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b4078cb0 msgr2=0x7fb8b4112fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:22.663 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:22.028+0000 7fb8b9b2b640 1 --2- 172.21.15.2:0/1627485050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b4078cb0 0x7fb8b4112fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4006f00 tx=0x7fb8a40091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:22.663 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:22.028+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/1627485050 shutdown_connections 2024-09-17T00:53:22.663 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:22.028+0000 7fb8b9b2b640 1 --2- 172.21.15.2:0/1627485050 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fb89c039490 0x7fb89c03b940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:22.663 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:22.028+0000 7fb8b9b2b640 1 --2- 172.21.15.2:0/1627485050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8b4078cb0 0x7fb8b4112fa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:22.663 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:22.028+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/1627485050 >> 172.21.15.2:0/1627485050 conn(0x7fb8b40fd700 msgr2=0x7fb8b40fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:22.663 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:22.028+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/1627485050 shutdown_connections 2024-09-17T00:53:22.663 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:22.028+0000 7fb8b9b2b640 1 -- 172.21.15.2:0/1627485050 wait complete. 2024-09-17T00:53:22.663 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying grafana service with default placement... 2024-09-17T00:53:23.289 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:23 smithi002 ceph-mon[27650]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:23.289 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:23 smithi002 ceph-mon[27650]: Saving service prometheus spec with placement count:1 2024-09-17T00:53:23.289 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:23 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:23.289 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:23 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:24.469 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:24 smithi002 ceph-mon[27650]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:24.469 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:24 smithi002 ceph-mon[27650]: Saving service grafana spec with placement count:1 2024-09-17T00:53:24.470 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:24 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:24.472 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-17T00:53:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.091+0000 7f12bcdd2640 1 Processor -- start 2024-09-17T00:53:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.091+0000 7f12bcdd2640 1 -- start start 2024-09-17T00:53:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.091+0000 7f12bcdd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8076bb0 0x7f12b8106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:24.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.091+0000 7f12bcdd2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b8102990 con 0x7f12b8076bb0 2024-09-17T00:53:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.091+0000 7f12b659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8076bb0 0x7f12b8106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.091+0000 7f12b659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8076bb0 0x7f12b8106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42020/0 (socket says 172.21.15.2:42020) 2024-09-17T00:53:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.091+0000 7f12b659c640 1 -- 172.21.15.2:0/369706552 learned_addr learned my addr 172.21.15.2:0/369706552 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.091+0000 7f12b659c640 1 -- 172.21.15.2:0/369706552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b81074e0 con 0x7f12b8076bb0 2024-09-17T00:53:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.092+0000 7f12b659c640 1 --2- 172.21.15.2:0/369706552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8076bb0 0x7f12b8106fa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009840 tx=0x7f12a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ae8eef0d9d6b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.092+0000 7f12b559a640 1 -- 172.21.15.2:0/369706552 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12a8032440 con 0x7f12b8076bb0 2024-09-17T00:53:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.092+0000 7f12b559a640 1 -- 172.21.15.2:0/369706552 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f12a8032a40 con 0x7f12b8076bb0 2024-09-17T00:53:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.092+0000 7f12b559a640 1 -- 172.21.15.2:0/369706552 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12a8031a70 con 0x7f12b8076bb0 2024-09-17T00:53:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.093+0000 7f12bcdd2640 1 -- 172.21.15.2:0/369706552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8076bb0 msgr2=0x7f12b8106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.093+0000 7f12bcdd2640 1 --2- 172.21.15.2:0/369706552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8076bb0 0x7f12b8106fa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009840 tx=0x7f12a80091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.093+0000 7f12bcdd2640 1 -- 172.21.15.2:0/369706552 shutdown_connections 2024-09-17T00:53:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.093+0000 7f12bcdd2640 1 --2- 172.21.15.2:0/369706552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8076bb0 0x7f12b8106fa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.093+0000 7f12bcdd2640 1 -- 172.21.15.2:0/369706552 >> 172.21.15.2:0/369706552 conn(0x7f12b80fc5d0 msgr2=0x7f12b80fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:24.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.093+0000 7f12bcdd2640 1 -- 172.21.15.2:0/369706552 shutdown_connections 2024-09-17T00:53:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.093+0000 7f12bcdd2640 1 -- 172.21.15.2:0/369706552 wait complete. 2024-09-17T00:53:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.094+0000 7f12bcdd2640 1 Processor -- start 2024-09-17T00:53:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.094+0000 7f12bcdd2640 1 -- start start 2024-09-17T00:53:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.094+0000 7f12bcdd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8076bb0 0x7f12b8112f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.094+0000 7f12bcdd2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b81134b0 con 0x7f12b8076bb0 2024-09-17T00:53:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.094+0000 7f12b659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8076bb0 0x7f12b8112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.094+0000 7f12b659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8076bb0 0x7f12b8112f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42022/0 (socket says 172.21.15.2:42022) 2024-09-17T00:53:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.094+0000 7f12b659c640 1 -- 172.21.15.2:0/1258359898 learned_addr learned my addr 172.21.15.2:0/1258359898 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.094+0000 7f12b659c640 1 -- 172.21.15.2:0/1258359898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a8009450 con 0x7f12b8076bb0 2024-09-17T00:53:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.094+0000 7f12b659c640 1 --2- 172.21.15.2:0/1258359898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8076bb0 0x7f12b8112f70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009420 tx=0x7f12a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.094+0000 7f12a6ffd640 1 -- 172.21.15.2:0/1258359898 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12a803c400 con 0x7f12b8076bb0 2024-09-17T00:53:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.094+0000 7f12a6ffd640 1 -- 172.21.15.2:0/1258359898 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f12a803ca00 con 0x7f12b8076bb0 2024-09-17T00:53:24.479 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.094+0000 7f12bcdd2640 1 -- 172.21.15.2:0/1258359898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b81136b0 con 0x7f12b8076bb0 2024-09-17T00:53:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.094+0000 7f12a6ffd640 1 -- 172.21.15.2:0/1258359898 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12a803a920 con 0x7f12b8076bb0 2024-09-17T00:53:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.095+0000 7f12bcdd2640 1 -- 172.21.15.2:0/1258359898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b8113b20 con 0x7f12b8076bb0 2024-09-17T00:53:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.095+0000 7f12a6ffd640 1 -- 172.21.15.2:0/1258359898 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f12a803aa80 con 0x7f12b8076bb0 2024-09-17T00:53:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.095+0000 7f12bcdd2640 1 -- 172.21.15.2:0/1258359898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b804b720 con 0x7f12b8076bb0 2024-09-17T00:53:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.095+0000 7f12a6ffd640 1 --2- 172.21.15.2:0/1258359898 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f12a00394e0 0x7f12a003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.096+0000 7f12a6ffd640 1 -- 172.21.15.2:0/1258359898 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f12a806cdd0 con 0x7f12b8076bb0 2024-09-17T00:53:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.096+0000 7f12b5d9b640 1 --2- 172.21.15.2:0/1258359898 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f12a00394e0 0x7f12a003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.096+0000 7f12b5d9b640 1 --2- 172.21.15.2:0/1258359898 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f12a00394e0 0x7f12a003b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f12ac006fd0 tx=0x7f12ac006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.100+0000 7f12a6ffd640 1 -- 172.21.15.2:0/1258359898 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f12a8071070 con 0x7f12b8076bb0 2024-09-17T00:53:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.290+0000 7f12bcdd2640 1 -- 172.21.15.2:0/1258359898 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f12b8113b20 con 0x7f12a00394e0 2024-09-17T00:53:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.295+0000 7f12a6ffd640 1 -- 172.21.15.2:0/1258359898 <== mgr.14118 v2:172.21.15.2:6800/3082534604 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f12b8113b20 con 0x7f12a00394e0 2024-09-17T00:53:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.297+0000 7f12bcdd2640 1 -- 172.21.15.2:0/1258359898 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f12a00394e0 msgr2=0x7f12a003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:24.480 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.297+0000 7f12bcdd2640 1 --2- 172.21.15.2:0/1258359898 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f12a00394e0 0x7f12a003b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f12ac006fd0 tx=0x7f12ac006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.297+0000 7f12bcdd2640 1 -- 172.21.15.2:0/1258359898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8076bb0 msgr2=0x7f12b8112f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.297+0000 7f12bcdd2640 1 --2- 172.21.15.2:0/1258359898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8076bb0 0x7f12b8112f70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009420 tx=0x7f12a80091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.297+0000 7f12bcdd2640 1 -- 172.21.15.2:0/1258359898 shutdown_connections 2024-09-17T00:53:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.297+0000 7f12bcdd2640 1 --2- 172.21.15.2:0/1258359898 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f12a00394e0 0x7f12a003b990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.297+0000 7f12bcdd2640 1 --2- 172.21.15.2:0/1258359898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b8076bb0 0x7f12b8112f70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.297+0000 7f12bcdd2640 1 -- 172.21.15.2:0/1258359898 >> 172.21.15.2:0/1258359898 conn(0x7f12b80fc5d0 msgr2=0x7f12b80fd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.297+0000 7f12bcdd2640 1 -- 172.21.15.2:0/1258359898 shutdown_connections 2024-09-17T00:53:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:23.297+0000 7f12bcdd2640 1 -- 172.21.15.2:0/1258359898 wait complete. 2024-09-17T00:53:24.481 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying node-exporter service with default placement... 2024-09-17T00:53:25.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-17T00:53:25.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.876+0000 7f239a46a640 1 Processor -- start 2024-09-17T00:53:25.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.876+0000 7f239a46a640 1 -- start start 2024-09-17T00:53:25.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.877+0000 7f239a46a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2394100e20 0x7f2394101230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:25.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.877+0000 7f239a46a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2394101770 con 0x7f2394100e20 2024-09-17T00:53:25.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.877+0000 7f2393fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2394100e20 0x7f2394101230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:25.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.877+0000 7f2393fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2394100e20 0x7f2394101230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42028/0 (socket says 172.21.15.2:42028) 2024-09-17T00:53:25.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.877+0000 7f2393fff640 1 -- 172.21.15.2:0/1331696447 learned_addr learned my addr 172.21.15.2:0/1331696447 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:25.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.877+0000 7f2393fff640 1 -- 172.21.15.2:0/1331696447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23941018b0 con 0x7f2394100e20 2024-09-17T00:53:25.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.878+0000 7f2393fff640 1 --2- 172.21.15.2:0/1331696447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2394100e20 0x7f2394101230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2384009840 tx=0x7f23840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed51db3b7d18990 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:25.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.878+0000 7f2392ffd640 1 -- 172.21.15.2:0/1331696447 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2384032440 con 0x7f2394100e20 2024-09-17T00:53:25.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.878+0000 7f2392ffd640 1 -- 172.21.15.2:0/1331696447 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2384032a40 con 0x7f2394100e20 2024-09-17T00:53:25.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.878+0000 7f2392ffd640 1 -- 172.21.15.2:0/1331696447 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2384031a70 con 0x7f2394100e20 2024-09-17T00:53:25.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.879+0000 7f239a46a640 1 -- 172.21.15.2:0/1331696447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2394100e20 msgr2=0x7f2394101230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:25.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.879+0000 7f239a46a640 1 --2- 172.21.15.2:0/1331696447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2394100e20 0x7f2394101230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2384009840 tx=0x7f23840091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:25.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.879+0000 7f239a46a640 1 -- 172.21.15.2:0/1331696447 shutdown_connections 2024-09-17T00:53:25.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.879+0000 7f239a46a640 1 --2- 172.21.15.2:0/1331696447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2394100e20 0x7f2394101230 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:25.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.879+0000 7f239a46a640 1 -- 172.21.15.2:0/1331696447 >> 172.21.15.2:0/1331696447 conn(0x7f23940fc540 msgr2=0x7f23940fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:25.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.879+0000 7f239a46a640 1 -- 172.21.15.2:0/1331696447 shutdown_connections 2024-09-17T00:53:25.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.879+0000 7f239a46a640 1 -- 172.21.15.2:0/1331696447 wait complete. 2024-09-17T00:53:25.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.879+0000 7f239a46a640 1 Processor -- start 2024-09-17T00:53:25.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.879+0000 7f239a46a640 1 -- start start 2024-09-17T00:53:25.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.880+0000 7f239a46a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2394100e20 0x7f2394110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:25.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.880+0000 7f239a46a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2394111310 con 0x7f2394100e20 2024-09-17T00:53:25.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.880+0000 7f2393fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2394100e20 0x7f2394110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:25.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.880+0000 7f2393fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2394100e20 0x7f2394110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42042/0 (socket says 172.21.15.2:42042) 2024-09-17T00:53:25.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.880+0000 7f2393fff640 1 -- 172.21.15.2:0/741660907 learned_addr learned my addr 172.21.15.2:0/741660907 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:25.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.880+0000 7f2393fff640 1 -- 172.21.15.2:0/741660907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2384009450 con 0x7f2394100e20 2024-09-17T00:53:25.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.880+0000 7f2393fff640 1 --2- 172.21.15.2:0/741660907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2394100e20 0x7f2394110dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2384006a70 tx=0x7f23840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:25.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.880+0000 7f2390ff9640 1 -- 172.21.15.2:0/741660907 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f238403c400 con 0x7f2394100e20 2024-09-17T00:53:25.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.881+0000 7f2390ff9640 1 -- 172.21.15.2:0/741660907 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f238403ca00 con 0x7f2394100e20 2024-09-17T00:53:25.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.881+0000 7f239a46a640 1 -- 172.21.15.2:0/741660907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2394111510 con 0x7f2394100e20 2024-09-17T00:53:25.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.881+0000 7f2390ff9640 1 -- 172.21.15.2:0/741660907 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f238403a9a0 con 0x7f2394100e20 2024-09-17T00:53:25.834 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.881+0000 7f239a46a640 1 -- 172.21.15.2:0/741660907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2394111f60 con 0x7f2394100e20 2024-09-17T00:53:25.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.882+0000 7f2390ff9640 1 -- 172.21.15.2:0/741660907 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f238403cb70 con 0x7f2394100e20 2024-09-17T00:53:25.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.882+0000 7f239a46a640 1 -- 172.21.15.2:0/741660907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239405ed70 con 0x7f2394100e20 2024-09-17T00:53:25.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.882+0000 7f2390ff9640 1 --2- 172.21.15.2:0/741660907 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f237c039490 0x7f237c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:25.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.882+0000 7f2390ff9640 1 -- 172.21.15.2:0/741660907 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f238406ce40 con 0x7f2394100e20 2024-09-17T00:53:25.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.882+0000 7f23937fe640 1 --2- 172.21.15.2:0/741660907 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f237c039490 0x7f237c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:25.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.882+0000 7f23937fe640 1 --2- 172.21.15.2:0/741660907 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f237c039490 0x7f237c03b940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2388006fd0 tx=0x7f2388006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:25.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:24.886+0000 7f2390ff9640 1 -- 172.21.15.2:0/741660907 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f238403b960 con 0x7f2394100e20 2024-09-17T00:53:25.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:25.060+0000 7f239a46a640 1 -- 172.21.15.2:0/741660907 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f23940fd8c0 con 0x7f237c039490 2024-09-17T00:53:25.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:25.065+0000 7f2390ff9640 1 -- 172.21.15.2:0/741660907 <== mgr.14118 v2:172.21.15.2:6800/3082534604 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f23940fd8c0 con 0x7f237c039490 2024-09-17T00:53:25.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:25.066+0000 7f239a46a640 1 -- 172.21.15.2:0/741660907 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f237c039490 msgr2=0x7f237c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:25.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:25.066+0000 7f239a46a640 1 --2- 172.21.15.2:0/741660907 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f237c039490 0x7f237c03b940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2388006fd0 tx=0x7f2388006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:25.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:25.067+0000 7f239a46a640 1 -- 172.21.15.2:0/741660907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2394100e20 msgr2=0x7f2394110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:25.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:25.067+0000 7f239a46a640 1 --2- 172.21.15.2:0/741660907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2394100e20 0x7f2394110dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2384006a70 tx=0x7f23840091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:25.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:25.067+0000 7f239a46a640 1 -- 172.21.15.2:0/741660907 shutdown_connections 2024-09-17T00:53:25.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:25.067+0000 7f239a46a640 1 --2- 172.21.15.2:0/741660907 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f237c039490 0x7f237c03b940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:25.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:25.067+0000 7f239a46a640 1 --2- 172.21.15.2:0/741660907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2394100e20 0x7f2394110dd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:25.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:25.067+0000 7f239a46a640 1 -- 172.21.15.2:0/741660907 >> 172.21.15.2:0/741660907 conn(0x7f23940fc540 msgr2=0x7f23940fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:25.837 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:25.067+0000 7f239a46a640 1 -- 172.21.15.2:0/741660907 shutdown_connections 2024-09-17T00:53:25.837 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:25.067+0000 7f239a46a640 1 -- 172.21.15.2:0/741660907 wait complete. 2024-09-17T00:53:25.837 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying alertmanager service with default placement... 2024-09-17T00:53:26.076 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:26 smithi002 ceph-mon[27650]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:26.076 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:26 smithi002 ceph-mon[27650]: Saving service node-exporter spec with placement * 2024-09-17T00:53:26.076 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:26 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:27.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-17T00:53:27.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.260+0000 7fda96cbb640 1 Processor -- start 2024-09-17T00:53:27.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.260+0000 7fda96cbb640 1 -- start start 2024-09-17T00:53:27.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.260+0000 7fda96cbb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90078cb0 0x7fda90077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:27.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.260+0000 7fda96cbb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900790c0 con 0x7fda90078cb0 2024-09-17T00:53:27.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.260+0000 7fda94a57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90078cb0 0x7fda90077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:27.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.260+0000 7fda94a57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90078cb0 0x7fda90077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42044/0 (socket says 172.21.15.2:42044) 2024-09-17T00:53:27.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.260+0000 7fda94a57640 1 -- 172.21.15.2:0/1872046192 learned_addr learned my addr 172.21.15.2:0/1872046192 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:27.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.261+0000 7fda94a57640 1 -- 172.21.15.2:0/1872046192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda90077770 con 0x7fda90078cb0 2024-09-17T00:53:27.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.261+0000 7fda94a57640 1 --2- 172.21.15.2:0/1872046192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90078cb0 0x7fda90077230 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fda84009840 tx=0x7fda840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db625df7c0888336 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.262+0000 7fda8f7fe640 1 -- 172.21.15.2:0/1872046192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda84032440 con 0x7fda90078cb0 2024-09-17T00:53:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.262+0000 7fda8f7fe640 1 -- 172.21.15.2:0/1872046192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fda84032a40 con 0x7fda90078cb0 2024-09-17T00:53:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.262+0000 7fda8f7fe640 1 -- 172.21.15.2:0/1872046192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda84031a70 con 0x7fda90078cb0 2024-09-17T00:53:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.262+0000 7fda96cbb640 1 -- 172.21.15.2:0/1872046192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90078cb0 msgr2=0x7fda90077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.262+0000 7fda96cbb640 1 --2- 172.21.15.2:0/1872046192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90078cb0 0x7fda90077230 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fda84009840 tx=0x7fda840091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.262+0000 7fda96cbb640 1 -- 172.21.15.2:0/1872046192 shutdown_connections 2024-09-17T00:53:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.262+0000 7fda96cbb640 1 --2- 172.21.15.2:0/1872046192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90078cb0 0x7fda90077230 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.262+0000 7fda96cbb640 1 -- 172.21.15.2:0/1872046192 >> 172.21.15.2:0/1872046192 conn(0x7fda900fd6a0 msgr2=0x7fda900ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.262+0000 7fda96cbb640 1 -- 172.21.15.2:0/1872046192 shutdown_connections 2024-09-17T00:53:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.262+0000 7fda96cbb640 1 -- 172.21.15.2:0/1872046192 wait complete. 2024-09-17T00:53:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.263+0000 7fda96cbb640 1 Processor -- start 2024-09-17T00:53:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.263+0000 7fda96cbb640 1 -- start start 2024-09-17T00:53:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.264+0000 7fda96cbb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90078cb0 0x7fda90112fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.264+0000 7fda96cbb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda901134f0 con 0x7fda90078cb0 2024-09-17T00:53:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.264+0000 7fda94a57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90078cb0 0x7fda90112fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.264+0000 7fda94a57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90078cb0 0x7fda90112fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42052/0 (socket says 172.21.15.2:42052) 2024-09-17T00:53:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.264+0000 7fda94a57640 1 -- 172.21.15.2:0/3915309157 learned_addr learned my addr 172.21.15.2:0/3915309157 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.264+0000 7fda94a57640 1 -- 172.21.15.2:0/3915309157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda84009450 con 0x7fda90078cb0 2024-09-17T00:53:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.264+0000 7fda94a57640 1 --2- 172.21.15.2:0/3915309157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90078cb0 0x7fda90112fb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda84006f00 tx=0x7fda840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.264+0000 7fda8d7fa640 1 -- 172.21.15.2:0/3915309157 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda8403c400 con 0x7fda90078cb0 2024-09-17T00:53:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.264+0000 7fda8d7fa640 1 -- 172.21.15.2:0/3915309157 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fda8403ca00 con 0x7fda90078cb0 2024-09-17T00:53:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.264+0000 7fda96cbb640 1 -- 172.21.15.2:0/3915309157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda901136f0 con 0x7fda90078cb0 2024-09-17T00:53:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.264+0000 7fda8d7fa640 1 -- 172.21.15.2:0/3915309157 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda8403a8f0 con 0x7fda90078cb0 2024-09-17T00:53:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.265+0000 7fda96cbb640 1 -- 172.21.15.2:0/3915309157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda90113b60 con 0x7fda90078cb0 2024-09-17T00:53:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.265+0000 7fda8d7fa640 1 -- 172.21.15.2:0/3915309157 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fda8403aa50 con 0x7fda90078cb0 2024-09-17T00:53:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.265+0000 7fda96cbb640 1 -- 172.21.15.2:0/3915309157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9004b720 con 0x7fda90078cb0 2024-09-17T00:53:27.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.266+0000 7fda8d7fa640 1 --2- 172.21.15.2:0/3915309157 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fda800394e0 0x7fda8003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:27.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.266+0000 7fda8d7fa640 1 -- 172.21.15.2:0/3915309157 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fda8406cbe0 con 0x7fda90078cb0 2024-09-17T00:53:27.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.266+0000 7fda8ffff640 1 --2- 172.21.15.2:0/3915309157 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fda800394e0 0x7fda8003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:27.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.266+0000 7fda8ffff640 1 --2- 172.21.15.2:0/3915309157 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fda800394e0 0x7fda8003b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda7c006fd0 tx=0x7fda7c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:27.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.270+0000 7fda8d7fa640 1 -- 172.21.15.2:0/3915309157 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fda84046460 con 0x7fda90078cb0 2024-09-17T00:53:27.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.443+0000 7fda96cbb640 1 -- 172.21.15.2:0/3915309157 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fda90113b60 con 0x7fda800394e0 2024-09-17T00:53:27.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.447+0000 7fda8d7fa640 1 -- 172.21.15.2:0/3915309157 <== mgr.14118 v2:172.21.15.2:6800/3082534604 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fda90113b60 con 0x7fda800394e0 2024-09-17T00:53:27.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.449+0000 7fda96cbb640 1 -- 172.21.15.2:0/3915309157 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fda800394e0 msgr2=0x7fda8003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:27.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.449+0000 7fda96cbb640 1 --2- 172.21.15.2:0/3915309157 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fda800394e0 0x7fda8003b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda7c006fd0 tx=0x7fda7c006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:27.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.449+0000 7fda96cbb640 1 -- 172.21.15.2:0/3915309157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90078cb0 msgr2=0x7fda90112fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:27.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.449+0000 7fda96cbb640 1 --2- 172.21.15.2:0/3915309157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90078cb0 0x7fda90112fb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda84006f00 tx=0x7fda840091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:27.053 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.449+0000 7fda96cbb640 1 -- 172.21.15.2:0/3915309157 shutdown_connections 2024-09-17T00:53:27.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.449+0000 7fda96cbb640 1 --2- 172.21.15.2:0/3915309157 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7fda800394e0 0x7fda8003b990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:27.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.449+0000 7fda96cbb640 1 --2- 172.21.15.2:0/3915309157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda90078cb0 0x7fda90112fb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:27.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.449+0000 7fda96cbb640 1 -- 172.21.15.2:0/3915309157 >> 172.21.15.2:0/3915309157 conn(0x7fda900fd6a0 msgr2=0x7fda900fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:27.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.449+0000 7fda96cbb640 1 -- 172.21.15.2:0/3915309157 shutdown_connections 2024-09-17T00:53:27.054 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:26.449+0000 7fda96cbb640 1 -- 172.21.15.2:0/3915309157 wait complete. 2024-09-17T00:53:27.261 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:27 smithi002 ceph-mon[27650]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:27.261 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:27 smithi002 ceph-mon[27650]: from='mgr.14118 172.21.15.2:0/1266679757' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:28.390 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:28 smithi002 ceph-mon[27650]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:28.390 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:28 smithi002 ceph-mon[27650]: Saving service alertmanager spec with placement count:1 2024-09-17T00:53:28.390 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:28 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3934871297' entity='client.admin' 2024-09-17T00:53:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.457+0000 7f798e790640 1 Processor -- start 2024-09-17T00:53:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.457+0000 7f798e790640 1 -- start start 2024-09-17T00:53:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.457+0000 7f798e790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7988103600 0x7f7988103a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.457+0000 7f798e790640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7988103f50 con 0x7f7988103600 2024-09-17T00:53:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.457+0000 7f7987fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7988103600 0x7f7988103a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:28.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.457+0000 7f7987fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7988103600 0x7f7988103a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42054/0 (socket says 172.21.15.2:42054) 2024-09-17T00:53:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.457+0000 7f7987fff640 1 -- 172.21.15.2:0/873000016 learned_addr learned my addr 172.21.15.2:0/873000016 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.458+0000 7f7987fff640 1 -- 172.21.15.2:0/873000016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7988104090 con 0x7f7988103600 2024-09-17T00:53:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.458+0000 7f7987fff640 1 --2- 172.21.15.2:0/873000016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7988103600 0x7f7988103a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7978009840 tx=0x7f79780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf920b65bc137a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.459+0000 7f79877fe640 1 -- 172.21.15.2:0/873000016 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7978032440 con 0x7f7988103600 2024-09-17T00:53:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.459+0000 7f79877fe640 1 -- 172.21.15.2:0/873000016 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7978032a40 con 0x7f7988103600 2024-09-17T00:53:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.459+0000 7f79877fe640 1 -- 172.21.15.2:0/873000016 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7978031a70 con 0x7f7988103600 2024-09-17T00:53:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.459+0000 7f798e790640 1 -- 172.21.15.2:0/873000016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7988103600 msgr2=0x7f7988103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.459+0000 7f798e790640 1 --2- 172.21.15.2:0/873000016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7988103600 0x7f7988103a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7978009840 tx=0x7f79780091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.459+0000 7f798e790640 1 -- 172.21.15.2:0/873000016 shutdown_connections 2024-09-17T00:53:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.459+0000 7f798e790640 1 --2- 172.21.15.2:0/873000016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7988103600 0x7f7988103a10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.459+0000 7f798e790640 1 -- 172.21.15.2:0/873000016 >> 172.21.15.2:0/873000016 conn(0x7f79880fbde0 msgr2=0x7f79880fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.459+0000 7f798e790640 1 -- 172.21.15.2:0/873000016 shutdown_connections 2024-09-17T00:53:28.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.459+0000 7f798e790640 1 -- 172.21.15.2:0/873000016 wait complete. 2024-09-17T00:53:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.460+0000 7f798e790640 1 Processor -- start 2024-09-17T00:53:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.460+0000 7f798e790640 1 -- start start 2024-09-17T00:53:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.460+0000 7f798e790640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7988103600 0x7f7988110e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.460+0000 7f798e790640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79881113b0 con 0x7f7988103600 2024-09-17T00:53:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.460+0000 7f7987fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7988103600 0x7f7988110e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.460+0000 7f7987fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7988103600 0x7f7988110e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42070/0 (socket says 172.21.15.2:42070) 2024-09-17T00:53:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.460+0000 7f7987fff640 1 -- 172.21.15.2:0/3934871297 learned_addr learned my addr 172.21.15.2:0/3934871297 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.460+0000 7f7987fff640 1 -- 172.21.15.2:0/3934871297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7978009450 con 0x7f7988103600 2024-09-17T00:53:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.461+0000 7f7987fff640 1 --2- 172.21.15.2:0/3934871297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7988103600 0x7f7988110e70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7978009810 tx=0x7f79780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.461+0000 7f79857fa640 1 -- 172.21.15.2:0/3934871297 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7978032830 con 0x7f7988103600 2024-09-17T00:53:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.461+0000 7f79857fa640 1 -- 172.21.15.2:0/3934871297 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f797803c8a0 con 0x7f7988103600 2024-09-17T00:53:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.461+0000 7f798e790640 1 -- 172.21.15.2:0/3934871297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79881115b0 con 0x7f7988103600 2024-09-17T00:53:28.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.461+0000 7f798e790640 1 -- 172.21.15.2:0/3934871297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7988112090 con 0x7f7988103600 2024-09-17T00:53:28.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.461+0000 7f79857fa640 1 -- 172.21.15.2:0/3934871297 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f797803a870 con 0x7f7988103600 2024-09-17T00:53:28.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.462+0000 7f79857fa640 1 -- 172.21.15.2:0/3934871297 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f797803aa60 con 0x7f7988103600 2024-09-17T00:53:28.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.462+0000 7f798e790640 1 -- 172.21.15.2:0/3934871297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798805ed70 con 0x7f7988103600 2024-09-17T00:53:28.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.462+0000 7f79857fa640 1 --2- 172.21.15.2:0/3934871297 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f79740394e0 0x7f797403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:28.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.462+0000 7f79857fa640 1 -- 172.21.15.2:0/3934871297 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f797806ceb0 con 0x7f7988103600 2024-09-17T00:53:28.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.463+0000 7f797ffff640 1 --2- 172.21.15.2:0/3934871297 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f79740394e0 0x7f797403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:28.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.463+0000 7f797ffff640 1 --2- 172.21.15.2:0/3934871297 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f79740394e0 0x7f797403b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7970006fd0 tx=0x7f7970006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:28.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.467+0000 7f79857fa640 1 -- 172.21.15.2:0/3934871297 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7978030340 con 0x7f7988103600 2024-09-17T00:53:28.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.629+0000 7f798e790640 1 -- 172.21.15.2:0/3934871297 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f7988112430 con 0x7f7988103600 2024-09-17T00:53:28.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.632+0000 7f79857fa640 1 -- 172.21.15.2:0/3934871297 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f7978037020 con 0x7f7988103600 2024-09-17T00:53:28.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.634+0000 7f798e790640 1 -- 172.21.15.2:0/3934871297 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f79740394e0 msgr2=0x7f797403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:28.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.634+0000 7f798e790640 1 --2- 172.21.15.2:0/3934871297 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f79740394e0 0x7f797403b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7970006fd0 tx=0x7f7970006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:28.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.634+0000 7f798e790640 1 -- 172.21.15.2:0/3934871297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7988103600 msgr2=0x7f7988110e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:28.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.634+0000 7f798e790640 1 --2- 172.21.15.2:0/3934871297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7988103600 0x7f7988110e70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7978009810 tx=0x7f79780091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:28.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.634+0000 7f798e790640 1 -- 172.21.15.2:0/3934871297 shutdown_connections 2024-09-17T00:53:28.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.634+0000 7f798e790640 1 --2- 172.21.15.2:0/3934871297 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f79740394e0 0x7f797403b990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:28.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.634+0000 7f798e790640 1 --2- 172.21.15.2:0/3934871297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7988103600 0x7f7988110e70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:28.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.634+0000 7f798e790640 1 -- 172.21.15.2:0/3934871297 >> 172.21.15.2:0/3934871297 conn(0x7f79880fbde0 msgr2=0x7f79880fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:28.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.634+0000 7f798e790640 1 -- 172.21.15.2:0/3934871297 shutdown_connections 2024-09-17T00:53:28.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:27.634+0000 7f798e790640 1 -- 172.21.15.2:0/3934871297 wait complete. 2024-09-17T00:53:29.310 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:29 smithi002 ceph-mon[27650]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:29.310 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:29 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3369827539' entity='client.admin' 2024-09-17T00:53:29.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.841+0000 7f685012f640 1 Processor -- start 2024-09-17T00:53:29.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.841+0000 7f685012f640 1 -- start start 2024-09-17T00:53:29.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.842+0000 7f685012f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6848076c20 0x7f6848104b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:29.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.842+0000 7f685012f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6848105050 con 0x7f6848076c20 2024-09-17T00:53:29.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.842+0000 7f684decb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6848076c20 0x7f6848104b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:29.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.842+0000 7f684decb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6848076c20 0x7f6848104b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42074/0 (socket says 172.21.15.2:42074) 2024-09-17T00:53:29.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.842+0000 7f684decb640 1 -- 172.21.15.2:0/176082099 learned_addr learned my addr 172.21.15.2:0/176082099 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:29.621 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.842+0000 7f684decb640 1 -- 172.21.15.2:0/176082099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6848105190 con 0x7f6848076c20 2024-09-17T00:53:29.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.843+0000 7f684decb640 1 --2- 172.21.15.2:0/176082099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6848076c20 0x7f6848104b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6840009840 tx=0x7f68400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610bd61c9bfe2587 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:29.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.843+0000 7f684cec9640 1 -- 172.21.15.2:0/176082099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6840032440 con 0x7f6848076c20 2024-09-17T00:53:29.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.843+0000 7f684cec9640 1 -- 172.21.15.2:0/176082099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6840032a40 con 0x7f6848076c20 2024-09-17T00:53:29.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.843+0000 7f684cec9640 1 -- 172.21.15.2:0/176082099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6840031aa0 con 0x7f6848076c20 2024-09-17T00:53:29.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.844+0000 7f685012f640 1 -- 172.21.15.2:0/176082099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6848076c20 msgr2=0x7f6848104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:29.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.844+0000 7f685012f640 1 --2- 172.21.15.2:0/176082099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6848076c20 0x7f6848104b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6840009840 tx=0x7f68400091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:29.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.844+0000 7f685012f640 1 -- 172.21.15.2:0/176082099 shutdown_connections 2024-09-17T00:53:29.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.844+0000 7f685012f640 1 --2- 172.21.15.2:0/176082099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6848076c20 0x7f6848104b10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:29.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.844+0000 7f685012f640 1 -- 172.21.15.2:0/176082099 >> 172.21.15.2:0/176082099 conn(0x7f68480fc560 msgr2=0x7f68480fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:29.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.844+0000 7f685012f640 1 -- 172.21.15.2:0/176082099 shutdown_connections 2024-09-17T00:53:29.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.844+0000 7f685012f640 1 -- 172.21.15.2:0/176082099 wait complete. 2024-09-17T00:53:29.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.844+0000 7f685012f640 1 Processor -- start 2024-09-17T00:53:29.622 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.844+0000 7f685012f640 1 -- start start 2024-09-17T00:53:29.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.845+0000 7f685012f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6848076c20 0x7f6848110e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:29.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.845+0000 7f685012f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6848111380 con 0x7f6848076c20 2024-09-17T00:53:29.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.845+0000 7f684decb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6848076c20 0x7f6848110e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:29.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.845+0000 7f684decb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6848076c20 0x7f6848110e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42076/0 (socket says 172.21.15.2:42076) 2024-09-17T00:53:29.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.845+0000 7f684decb640 1 -- 172.21.15.2:0/3369827539 learned_addr learned my addr 172.21.15.2:0/3369827539 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:29.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.845+0000 7f684decb640 1 -- 172.21.15.2:0/3369827539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6840009450 con 0x7f6848076c20 2024-09-17T00:53:29.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.845+0000 7f684decb640 1 --2- 172.21.15.2:0/3369827539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6848076c20 0x7f6848110e40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6840031780 tx=0x7f68400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:29.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.845+0000 7f68467fc640 1 -- 172.21.15.2:0/3369827539 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68400327b0 con 0x7f6848076c20 2024-09-17T00:53:29.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.845+0000 7f68467fc640 1 -- 172.21.15.2:0/3369827539 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f684003b8d0 con 0x7f6848076c20 2024-09-17T00:53:29.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.845+0000 7f685012f640 1 -- 172.21.15.2:0/3369827539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6848111580 con 0x7f6848076c20 2024-09-17T00:53:29.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.846+0000 7f68467fc640 1 -- 172.21.15.2:0/3369827539 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f684003a790 con 0x7f6848076c20 2024-09-17T00:53:29.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.846+0000 7f685012f640 1 -- 172.21.15.2:0/3369827539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6848111fd0 con 0x7f6848076c20 2024-09-17T00:53:29.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.846+0000 7f685012f640 1 -- 172.21.15.2:0/3369827539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684805ed70 con 0x7f6848076c20 2024-09-17T00:53:29.623 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.847+0000 7f68467fc640 1 -- 172.21.15.2:0/3369827539 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f6840039040 con 0x7f6848076c20 2024-09-17T00:53:29.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.847+0000 7f68467fc640 1 --2- 172.21.15.2:0/3369827539 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f68300394e0 0x7f683003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:29.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.847+0000 7f68467fc640 1 -- 172.21.15.2:0/3369827539 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f684006cb00 con 0x7f6848076c20 2024-09-17T00:53:29.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.847+0000 7f684d6ca640 1 --2- 172.21.15.2:0/3369827539 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f68300394e0 0x7f683003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:29.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.847+0000 7f684d6ca640 1 --2- 172.21.15.2:0/3369827539 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f68300394e0 0x7f683003b990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f683c006fd0 tx=0x7f683c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:29.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:28.851+0000 7f68467fc640 1 -- 172.21.15.2:0/3369827539 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f684003a8f0 con 0x7f6848076c20 2024-09-17T00:53:29.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:29.018+0000 7f685012f640 1 -- 172.21.15.2:0/3369827539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f684804b720 con 0x7f6848076c20 2024-09-17T00:53:29.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:29.021+0000 7f68467fc640 1 -- 172.21.15.2:0/3369827539 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f684003f0c0 con 0x7f6848076c20 2024-09-17T00:53:29.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:29.024+0000 7f685012f640 1 -- 172.21.15.2:0/3369827539 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f68300394e0 msgr2=0x7f683003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:29.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:29.024+0000 7f685012f640 1 --2- 172.21.15.2:0/3369827539 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f68300394e0 0x7f683003b990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f683c006fd0 tx=0x7f683c006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:29.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:29.024+0000 7f685012f640 1 -- 172.21.15.2:0/3369827539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6848076c20 msgr2=0x7f6848110e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:29.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:29.024+0000 7f685012f640 1 --2- 172.21.15.2:0/3369827539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6848076c20 0x7f6848110e40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6840031780 tx=0x7f68400091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:29.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:29.024+0000 7f685012f640 1 -- 172.21.15.2:0/3369827539 shutdown_connections 2024-09-17T00:53:29.624 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:29.024+0000 7f685012f640 1 --2- 172.21.15.2:0/3369827539 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f68300394e0 0x7f683003b990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:29.625 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:29.024+0000 7f685012f640 1 --2- 172.21.15.2:0/3369827539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6848076c20 0x7f6848110e40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:29.625 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:29.024+0000 7f685012f640 1 -- 172.21.15.2:0/3369827539 >> 172.21.15.2:0/3369827539 conn(0x7f68480fc560 msgr2=0x7f68480fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:29.625 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:29.024+0000 7f685012f640 1 -- 172.21.15.2:0/3369827539 shutdown_connections 2024-09-17T00:53:29.625 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:29.024+0000 7f685012f640 1 -- 172.21.15.2:0/3369827539 wait complete. 2024-09-17T00:53:29.625 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling the dashboard module... 2024-09-17T00:53:31.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:31 smithi002 ceph-mon[27650]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:31.341 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:31 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/929177087' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-17T00:53:31.752 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.047+0000 7f72d35f1640 1 Processor -- start 2024-09-17T00:53:31.752 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.047+0000 7f72d35f1640 1 -- start start 2024-09-17T00:53:31.753 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.047+0000 7f72d35f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72cc101f50 0x7f72cc102360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:31.753 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.047+0000 7f72d35f1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc1028a0 con 0x7f72cc101f50 2024-09-17T00:53:31.753 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.047+0000 7f72d138d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72cc101f50 0x7f72cc102360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:31.753 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.047+0000 7f72d138d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72cc101f50 0x7f72cc102360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42084/0 (socket says 172.21.15.2:42084) 2024-09-17T00:53:31.753 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.048+0000 7f72d138d640 1 -- 172.21.15.2:0/2213793799 learned_addr learned my addr 172.21.15.2:0/2213793799 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:31.753 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.048+0000 7f72d138d640 1 -- 172.21.15.2:0/2213793799 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc1029e0 con 0x7f72cc101f50 2024-09-17T00:53:31.753 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.048+0000 7f72d138d640 1 --2- 172.21.15.2:0/2213793799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72cc101f50 0x7f72cc102360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009840 tx=0x7f72c80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412740a1eb6c9c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:31.753 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.049+0000 7f72c3fff640 1 -- 172.21.15.2:0/2213793799 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72c8032440 con 0x7f72cc101f50 2024-09-17T00:53:31.753 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.049+0000 7f72c3fff640 1 -- 172.21.15.2:0/2213793799 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f72c8032a40 con 0x7f72cc101f50 2024-09-17T00:53:31.753 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.049+0000 7f72c3fff640 1 -- 172.21.15.2:0/2213793799 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72c8031a70 con 0x7f72cc101f50 2024-09-17T00:53:31.753 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.049+0000 7f72d35f1640 1 -- 172.21.15.2:0/2213793799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72cc101f50 msgr2=0x7f72cc102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:31.753 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.049+0000 7f72d35f1640 1 --2- 172.21.15.2:0/2213793799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72cc101f50 0x7f72cc102360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009840 tx=0x7f72c80091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:31.754 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.049+0000 7f72d35f1640 1 -- 172.21.15.2:0/2213793799 shutdown_connections 2024-09-17T00:53:31.754 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.049+0000 7f72d35f1640 1 --2- 172.21.15.2:0/2213793799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72cc101f50 0x7f72cc102360 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:31.754 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.049+0000 7f72d35f1640 1 -- 172.21.15.2:0/2213793799 >> 172.21.15.2:0/2213793799 conn(0x7f72cc0fd730 msgr2=0x7f72cc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:31.754 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.049+0000 7f72d35f1640 1 -- 172.21.15.2:0/2213793799 shutdown_connections 2024-09-17T00:53:31.754 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.049+0000 7f72d35f1640 1 -- 172.21.15.2:0/2213793799 wait complete. 2024-09-17T00:53:31.754 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.050+0000 7f72d35f1640 1 Processor -- start 2024-09-17T00:53:31.754 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.050+0000 7f72d35f1640 1 -- start start 2024-09-17T00:53:31.754 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.050+0000 7f72d35f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72cc101f50 0x7f72cc078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:31.754 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.050+0000 7f72d35f1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc079160 con 0x7f72cc101f50 2024-09-17T00:53:31.754 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.050+0000 7f72d138d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72cc101f50 0x7f72cc078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:31.754 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.050+0000 7f72d138d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72cc101f50 0x7f72cc078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42092/0 (socket says 172.21.15.2:42092) 2024-09-17T00:53:31.754 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.050+0000 7f72d138d640 1 -- 172.21.15.2:0/929177087 learned_addr learned my addr 172.21.15.2:0/929177087 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:31.754 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.050+0000 7f72d138d640 1 -- 172.21.15.2:0/929177087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c8009450 con 0x7f72cc101f50 2024-09-17T00:53:31.755 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.051+0000 7f72d138d640 1 --2- 172.21.15.2:0/929177087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72cc101f50 0x7f72cc078c20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f72c8031670 tx=0x7f72c80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:31.755 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.051+0000 7f72c1ffb640 1 -- 172.21.15.2:0/929177087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72c803c400 con 0x7f72cc101f50 2024-09-17T00:53:31.755 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.051+0000 7f72c1ffb640 1 -- 172.21.15.2:0/929177087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f72c803ca00 con 0x7f72cc101f50 2024-09-17T00:53:31.755 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.051+0000 7f72d35f1640 1 -- 172.21.15.2:0/929177087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc0771f0 con 0x7f72cc101f50 2024-09-17T00:53:31.755 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.051+0000 7f72c1ffb640 1 -- 172.21.15.2:0/929177087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72c803a910 con 0x7f72cc101f50 2024-09-17T00:53:31.755 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.051+0000 7f72d35f1640 1 -- 172.21.15.2:0/929177087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc077660 con 0x7f72cc101f50 2024-09-17T00:53:31.755 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.052+0000 7f72c1ffb640 1 -- 172.21.15.2:0/929177087 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f72c803cb70 con 0x7f72cc101f50 2024-09-17T00:53:31.755 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.052+0000 7f72c1ffb640 1 --2- 172.21.15.2:0/929177087 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f72b80394e0 0x7f72b803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:31.755 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.052+0000 7f72d35f1640 1 -- 172.21.15.2:0/929177087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc04b720 con 0x7f72cc101f50 2024-09-17T00:53:31.755 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.052+0000 7f72c1ffb640 1 -- 172.21.15.2:0/929177087 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f72c806ce10 con 0x7f72cc101f50 2024-09-17T00:53:31.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.053+0000 7f72d0b8c640 1 --2- 172.21.15.2:0/929177087 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f72b80394e0 0x7f72b803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:31.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.053+0000 7f72d0b8c640 1 --2- 172.21.15.2:0/929177087 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f72b80394e0 0x7f72b803b990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f72bc006fd0 tx=0x7f72bc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:31.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.061+0000 7f72c1ffb640 1 -- 172.21.15.2:0/929177087 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f72c8037030 con 0x7f72cc101f50 2024-09-17T00:53:31.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:30.271+0000 7f72d35f1640 1 -- 172.21.15.2:0/929177087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f72cc077bf0 con 0x7f72cc101f50 2024-09-17T00:53:31.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:31.068+0000 7f72c1ffb640 1 -- 172.21.15.2:0/929177087 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f72c8046460 con 0x7f72cc101f50 2024-09-17T00:53:31.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:31.070+0000 7f72c1ffb640 1 -- 172.21.15.2:0/929177087 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f72c8007c80 con 0x7f72cc101f50 2024-09-17T00:53:31.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:31.073+0000 7f72d35f1640 1 -- 172.21.15.2:0/929177087 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f72b80394e0 msgr2=0x7f72b803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:31.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:31.073+0000 7f72d35f1640 1 --2- 172.21.15.2:0/929177087 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f72b80394e0 0x7f72b803b990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f72bc006fd0 tx=0x7f72bc006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:31.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:31.073+0000 7f72d35f1640 1 -- 172.21.15.2:0/929177087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72cc101f50 msgr2=0x7f72cc078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:31.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:31.073+0000 7f72d35f1640 1 --2- 172.21.15.2:0/929177087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72cc101f50 0x7f72cc078c20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f72c8031670 tx=0x7f72c80091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:31.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:31.073+0000 7f72d35f1640 1 -- 172.21.15.2:0/929177087 shutdown_connections 2024-09-17T00:53:31.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:31.073+0000 7f72d35f1640 1 --2- 172.21.15.2:0/929177087 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f72b80394e0 0x7f72b803b990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:31.756 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:31.073+0000 7f72d35f1640 1 --2- 172.21.15.2:0/929177087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72cc101f50 0x7f72cc078c20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:31.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:31.073+0000 7f72d35f1640 1 -- 172.21.15.2:0/929177087 >> 172.21.15.2:0/929177087 conn(0x7f72cc0fd730 msgr2=0x7f72cc0fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:31.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:31.073+0000 7f72d35f1640 1 -- 172.21.15.2:0/929177087 shutdown_connections 2024-09-17T00:53:31.757 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:31.073+0000 7f72d35f1640 1 -- 172.21.15.2:0/929177087 wait complete. 2024-09-17T00:53:32.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:32 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/929177087' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-17T00:53:32.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:32 smithi002 ceph-mon[27650]: mgrmap e9: smithi002.vjeexr(active, since 25s) 2024-09-17T00:53:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-17T00:53:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-17T00:53:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T00:53:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "smithi002.vjeexr", 2024-09-17T00:53:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T00:53:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-17T00:53:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.144+0000 7f7ff977d640 1 Processor -- start 2024-09-17T00:53:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.144+0000 7f7ff977d640 1 -- start start 2024-09-17T00:53:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.145+0000 7f7ff977d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ff4101f00 0x7f7ff4102310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.145+0000 7f7ff977d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff4102850 con 0x7f7ff4101f00 2024-09-17T00:53:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.145+0000 7f7ff2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ff4101f00 0x7f7ff4102310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.145+0000 7f7ff2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ff4101f00 0x7f7ff4102310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53294/0 (socket says 172.21.15.2:53294) 2024-09-17T00:53:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.145+0000 7f7ff2ffd640 1 -- 172.21.15.2:0/2812960057 learned_addr learned my addr 172.21.15.2:0/2812960057 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.145+0000 7f7ff2ffd640 1 -- 172.21.15.2:0/2812960057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff4102990 con 0x7f7ff4101f00 2024-09-17T00:53:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.146+0000 7f7ff2ffd640 1 --2- 172.21.15.2:0/2812960057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ff4101f00 0x7f7ff4102310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009840 tx=0x7f7fe40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41eaf95f4b88fcac server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.146+0000 7f7ff1ffb640 1 -- 172.21.15.2:0/2812960057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fe4032440 con 0x7f7ff4101f00 2024-09-17T00:53:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.146+0000 7f7ff1ffb640 1 -- 172.21.15.2:0/2812960057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7fe4032a40 con 0x7f7ff4101f00 2024-09-17T00:53:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.146+0000 7f7ff1ffb640 1 -- 172.21.15.2:0/2812960057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fe4031a70 con 0x7f7ff4101f00 2024-09-17T00:53:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.147+0000 7f7ff977d640 1 -- 172.21.15.2:0/2812960057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ff4101f00 msgr2=0x7f7ff4102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.147+0000 7f7ff977d640 1 --2- 172.21.15.2:0/2812960057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ff4101f00 0x7f7ff4102310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009840 tx=0x7f7fe40091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.147+0000 7f7ff977d640 1 -- 172.21.15.2:0/2812960057 shutdown_connections 2024-09-17T00:53:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.147+0000 7f7ff977d640 1 --2- 172.21.15.2:0/2812960057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ff4101f00 0x7f7ff4102310 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.147+0000 7f7ff977d640 1 -- 172.21.15.2:0/2812960057 >> 172.21.15.2:0/2812960057 conn(0x7f7ff40fd700 msgr2=0x7f7ff40ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.147+0000 7f7ff977d640 1 -- 172.21.15.2:0/2812960057 shutdown_connections 2024-09-17T00:53:32.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.147+0000 7f7ff977d640 1 -- 172.21.15.2:0/2812960057 wait complete. 2024-09-17T00:53:32.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.147+0000 7f7ff977d640 1 Processor -- start 2024-09-17T00:53:32.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.148+0000 7f7ff977d640 1 -- start start 2024-09-17T00:53:32.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.148+0000 7f7ff977d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ff4101f00 0x7f7ff4110e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:32.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.148+0000 7f7ff977d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff41113a0 con 0x7f7ff4101f00 2024-09-17T00:53:32.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.148+0000 7f7ff2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ff4101f00 0x7f7ff4110e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:32.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.148+0000 7f7ff2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ff4101f00 0x7f7ff4110e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53310/0 (socket says 172.21.15.2:53310) 2024-09-17T00:53:32.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.148+0000 7f7ff2ffd640 1 -- 172.21.15.2:0/1315912540 learned_addr learned my addr 172.21.15.2:0/1315912540 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:32.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.148+0000 7f7ff2ffd640 1 -- 172.21.15.2:0/1315912540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4009450 con 0x7f7ff4101f00 2024-09-17T00:53:32.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.148+0000 7f7ff2ffd640 1 --2- 172.21.15.2:0/1315912540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ff4101f00 0x7f7ff4110e60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009420 tx=0x7f7fe40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:32.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.149+0000 7f7fdb7fe640 1 -- 172.21.15.2:0/1315912540 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fe403c400 con 0x7f7ff4101f00 2024-09-17T00:53:32.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.149+0000 7f7fdb7fe640 1 -- 172.21.15.2:0/1315912540 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7fe403ca00 con 0x7f7ff4101f00 2024-09-17T00:53:32.971 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.149+0000 7f7ff977d640 1 -- 172.21.15.2:0/1315912540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff41115a0 con 0x7f7ff4101f00 2024-09-17T00:53:32.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.149+0000 7f7fdb7fe640 1 -- 172.21.15.2:0/1315912540 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fe403a850 con 0x7f7ff4101f00 2024-09-17T00:53:32.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.149+0000 7f7ff977d640 1 -- 172.21.15.2:0/1315912540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff4111ff0 con 0x7f7ff4101f00 2024-09-17T00:53:32.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.150+0000 7f7fdb7fe640 1 -- 172.21.15.2:0/1315912540 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f7fe403ab10 con 0x7f7ff4101f00 2024-09-17T00:53:32.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.150+0000 7f7ff977d640 1 -- 172.21.15.2:0/1315912540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff405ed70 con 0x7f7ff4101f00 2024-09-17T00:53:32.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.150+0000 7f7fdb7fe640 1 --2- 172.21.15.2:0/1315912540 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f7fdc0394e0 0x7f7fdc03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:32.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.150+0000 7f7fdb7fe640 1 -- 172.21.15.2:0/1315912540 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7fe406d070 con 0x7f7ff4101f00 2024-09-17T00:53:32.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.150+0000 7f7ff27fc640 1 -- 172.21.15.2:0/1315912540 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f7fdc0394e0 msgr2=0x7f7fdc03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3082534604 2024-09-17T00:53:32.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.150+0000 7f7ff27fc640 1 --2- 172.21.15.2:0/1315912540 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f7fdc0394e0 0x7f7fdc03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T00:53:32.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.159+0000 7f7fdb7fe640 1 -- 172.21.15.2:0/1315912540 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7fe403c560 con 0x7f7ff4101f00 2024-09-17T00:53:32.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.351+0000 7f7ff27fc640 1 -- 172.21.15.2:0/1315912540 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f7fdc0394e0 msgr2=0x7f7fdc03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3082534604 2024-09-17T00:53:32.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.351+0000 7f7ff27fc640 1 --2- 172.21.15.2:0/1315912540 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f7fdc0394e0 0x7f7fdc03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T00:53:32.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.367+0000 7f7ff977d640 1 -- 172.21.15.2:0/1315912540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f7ff41123b0 con 0x7f7ff4101f00 2024-09-17T00:53:32.972 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.368+0000 7f7fdb7fe640 1 -- 172.21.15.2:0/1315912540 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f7fe4037030 con 0x7f7ff4101f00 2024-09-17T00:53:32.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.370+0000 7f7ff977d640 1 -- 172.21.15.2:0/1315912540 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f7fdc0394e0 msgr2=0x7f7fdc03b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T00:53:32.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.370+0000 7f7ff977d640 1 --2- 172.21.15.2:0/1315912540 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f7fdc0394e0 0x7f7fdc03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:32.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.370+0000 7f7ff977d640 1 -- 172.21.15.2:0/1315912540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ff4101f00 msgr2=0x7f7ff4110e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:32.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.370+0000 7f7ff977d640 1 --2- 172.21.15.2:0/1315912540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ff4101f00 0x7f7ff4110e60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009420 tx=0x7f7fe40091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:32.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.370+0000 7f7ff977d640 1 -- 172.21.15.2:0/1315912540 shutdown_connections 2024-09-17T00:53:32.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.370+0000 7f7ff977d640 1 --2- 172.21.15.2:0/1315912540 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f7fdc0394e0 0x7f7fdc03b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:32.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.370+0000 7f7ff977d640 1 --2- 172.21.15.2:0/1315912540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ff4101f00 0x7f7ff4110e60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:32.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.370+0000 7f7ff977d640 1 -- 172.21.15.2:0/1315912540 >> 172.21.15.2:0/1315912540 conn(0x7f7ff40fd700 msgr2=0x7f7ff40fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:32.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.370+0000 7f7ff977d640 1 -- 172.21.15.2:0/1315912540 shutdown_connections 2024-09-17T00:53:32.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:32.370+0000 7f7ff977d640 1 -- 172.21.15.2:0/1315912540 wait complete. 2024-09-17T00:53:32.973 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-09-17T00:53:32.973 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 9... 2024-09-17T00:53:33.215 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:33 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/1315912540' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T00:53:35.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:35 smithi002 ceph-mon[27650]: Active manager daemon smithi002.vjeexr restarted 2024-09-17T00:53:35.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:35 smithi002 ceph-mon[27650]: Activating manager daemon smithi002.vjeexr 2024-09-17T00:53:35.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:35 smithi002 ceph-mon[27650]: osdmap e3: 0 total, 0 up, 0 in 2024-09-17T00:53:35.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:35 smithi002 ceph-mon[27650]: mgrmap e10: smithi002.vjeexr(active, starting, since 0.00323602s) 2024-09-17T00:53:35.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:35 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T00:53:35.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:35 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr metadata", "who": "smithi002.vjeexr", "id": "smithi002.vjeexr"}]: dispatch 2024-09-17T00:53:35.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:35 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T00:53:35.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:35 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T00:53:35.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:35 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T00:53:35.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:35 smithi002 ceph-mon[27650]: Manager daemon smithi002.vjeexr is now available 2024-09-17T00:53:35.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:35 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:53:35.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:35 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:53:35.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:35 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/trash_purge_schedule"}]: dispatch 2024-09-17T00:53:37.512 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-09-17T00:53:37.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-17T00:53:37.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T00:53:37.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-09-17T00:53:37.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.385+0000 7f4573709640 1 Processor -- start 2024-09-17T00:53:37.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.385+0000 7f4573709640 1 -- start start 2024-09-17T00:53:37.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.385+0000 7f4573709640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c076c40 0x7f456c104ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:37.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.385+0000 7f4573709640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c105010 con 0x7f456c076c40 2024-09-17T00:53:37.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.385+0000 7f45714a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c076c40 0x7f456c104ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:37.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.385+0000 7f45714a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c076c40 0x7f456c104ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53322/0 (socket says 172.21.15.2:53322) 2024-09-17T00:53:37.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.385+0000 7f45714a5640 1 -- 172.21.15.2:0/2552986229 learned_addr learned my addr 172.21.15.2:0/2552986229 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:37.513 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.385+0000 7f45714a5640 1 -- 172.21.15.2:0/2552986229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c105150 con 0x7f456c076c40 2024-09-17T00:53:37.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.386+0000 7f45714a5640 1 --2- 172.21.15.2:0/2552986229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c076c40 0x7f456c104ad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4568009840 tx=0x7f45680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2277c2fb3f657435 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:37.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.386+0000 7f4563fff640 1 -- 172.21.15.2:0/2552986229 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4568032440 con 0x7f456c076c40 2024-09-17T00:53:37.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.386+0000 7f4563fff640 1 -- 172.21.15.2:0/2552986229 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4568032a40 con 0x7f456c076c40 2024-09-17T00:53:37.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.386+0000 7f4563fff640 1 -- 172.21.15.2:0/2552986229 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4568031a70 con 0x7f456c076c40 2024-09-17T00:53:37.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.387+0000 7f4573709640 1 -- 172.21.15.2:0/2552986229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c076c40 msgr2=0x7f456c104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:37.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.387+0000 7f4573709640 1 --2- 172.21.15.2:0/2552986229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c076c40 0x7f456c104ad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4568009840 tx=0x7f45680091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:37.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.387+0000 7f4573709640 1 -- 172.21.15.2:0/2552986229 shutdown_connections 2024-09-17T00:53:37.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.387+0000 7f4573709640 1 --2- 172.21.15.2:0/2552986229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c076c40 0x7f456c104ad0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:37.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.387+0000 7f4573709640 1 -- 172.21.15.2:0/2552986229 >> 172.21.15.2:0/2552986229 conn(0x7f456c0fc540 msgr2=0x7f456c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:37.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.387+0000 7f4573709640 1 -- 172.21.15.2:0/2552986229 shutdown_connections 2024-09-17T00:53:37.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.387+0000 7f4573709640 1 -- 172.21.15.2:0/2552986229 wait complete. 2024-09-17T00:53:37.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.388+0000 7f4573709640 1 Processor -- start 2024-09-17T00:53:37.514 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.388+0000 7f4573709640 1 -- start start 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.388+0000 7f4573709640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c076c40 0x7f456c102400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.388+0000 7f4573709640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c102940 con 0x7f456c076c40 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.388+0000 7f45714a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c076c40 0x7f456c102400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.388+0000 7f45714a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c076c40 0x7f456c102400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53324/0 (socket says 172.21.15.2:53324) 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.388+0000 7f45714a5640 1 -- 172.21.15.2:0/3316903112 learned_addr learned my addr 172.21.15.2:0/3316903112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.388+0000 7f45714a5640 1 -- 172.21.15.2:0/3316903112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4568009450 con 0x7f456c076c40 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.389+0000 7f45714a5640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c076c40 0x7f456c102400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4568031750 tx=0x7f45680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.389+0000 7f4561ffb640 1 -- 172.21.15.2:0/3316903112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f456803c400 con 0x7f456c076c40 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.389+0000 7f4561ffb640 1 -- 172.21.15.2:0/3316903112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f456803ca00 con 0x7f456c076c40 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.389+0000 7f4573709640 1 -- 172.21.15.2:0/3316903112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456c1009d0 con 0x7f456c076c40 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.389+0000 7f4561ffb640 1 -- 172.21.15.2:0/3316903112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f456803a880 con 0x7f456c076c40 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.389+0000 7f4573709640 1 -- 172.21.15.2:0/3316903112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456c100de0 con 0x7f456c076c40 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.390+0000 7f4561ffb640 1 -- 172.21.15.2:0/3316903112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f456803cb70 con 0x7f456c076c40 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.390+0000 7f4561ffb640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f45580394e0 0x7f455803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:37.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.390+0000 7f4561ffb640 1 -- 172.21.15.2:0/3316903112 --> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f455803c0a0 con 0x7f45580394e0 2024-09-17T00:53:37.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.390+0000 7f4561ffb640 1 -- 172.21.15.2:0/3316903112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f456806cf50 con 0x7f456c076c40 2024-09-17T00:53:37.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.390+0000 7f4570ca4640 1 -- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f45580394e0 msgr2=0x7f455803b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3082534604 2024-09-17T00:53:37.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.390+0000 7f4570ca4640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f45580394e0 0x7f455803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T00:53:37.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.591+0000 7f4570ca4640 1 -- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f45580394e0 msgr2=0x7f455803b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3082534604 2024-09-17T00:53:37.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.591+0000 7f4570ca4640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f45580394e0 0x7f455803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T00:53:37.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.992+0000 7f4570ca4640 1 -- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f45580394e0 msgr2=0x7f455803b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3082534604 2024-09-17T00:53:37.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:33.992+0000 7f4570ca4640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f45580394e0 0x7f455803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-17T00:53:37.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:34.793+0000 7f4570ca4640 1 -- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f45580394e0 msgr2=0x7f455803b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3082534604 2024-09-17T00:53:37.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:34.793+0000 7f4570ca4640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f45580394e0 0x7f455803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-17T00:53:37.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:35.657+0000 7f4561ffb640 1 -- 172.21.15.2:0/3316903112 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 10) v1 ==== 45287+0+0 (secure 0 0 0) 0x7f456806c050 con 0x7f456c076c40 2024-09-17T00:53:37.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:35.657+0000 7f4561ffb640 1 -- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f45580394e0 msgr2=0x7f455803b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T00:53:37.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:35.657+0000 7f4561ffb640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f45580394e0 0x7f455803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:37.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.659+0000 7f4561ffb640 1 -- 172.21.15.2:0/3316903112 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f456803c560 con 0x7f456c076c40 2024-09-17T00:53:37.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.659+0000 7f4561ffb640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f455803cf80 0x7f455803f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:37.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.659+0000 7f4561ffb640 1 -- 172.21.15.2:0/3316903112 --> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f455803c0a0 con 0x7f455803cf80 2024-09-17T00:53:37.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.659+0000 7f4570ca4640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f455803cf80 0x7f455803f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:37.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.660+0000 7f4570ca4640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f455803cf80 0x7f455803f360 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f455c003940 tx=0x7f455c009350 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:37.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.660+0000 7f4561ffb640 1 -- 172.21.15.2:0/3316903112 <== mgr.14160 v2:172.21.15.2:6800/2191872617 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f455803c0a0 con 0x7f455803cf80 2024-09-17T00:53:37.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.666+0000 7f4573709640 1 -- 172.21.15.2:0/3316903112 --> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f456c04b720 con 0x7f455803cf80 2024-09-17T00:53:37.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.666+0000 7f4561ffb640 1 -- 172.21.15.2:0/3316903112 <== mgr.14160 v2:172.21.15.2:6800/2191872617 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f456c04b720 con 0x7f455803cf80 2024-09-17T00:53:37.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.666+0000 7f4573709640 1 -- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f455803cf80 msgr2=0x7f455803f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:37.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.666+0000 7f4573709640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f455803cf80 0x7f455803f360 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f455c003940 tx=0x7f455c009350 comp rx=0 tx=0).stop 2024-09-17T00:53:37.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.666+0000 7f4573709640 1 -- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c076c40 msgr2=0x7f456c102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:37.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.666+0000 7f4573709640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c076c40 0x7f456c102400 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4568031750 tx=0x7f45680091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:37.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.666+0000 7f4573709640 1 -- 172.21.15.2:0/3316903112 shutdown_connections 2024-09-17T00:53:37.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.666+0000 7f4573709640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f455803cf80 0x7f455803f360 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:37.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.666+0000 7f4573709640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:6800/3082534604,v1:172.21.15.2:6801/3082534604] conn(0x7f45580394e0 0x7f455803b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:37.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.666+0000 7f4573709640 1 --2- 172.21.15.2:0/3316903112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f456c076c40 0x7f456c102400 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:37.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.666+0000 7f4573709640 1 -- 172.21.15.2:0/3316903112 >> 172.21.15.2:0/3316903112 conn(0x7f456c0fc540 msgr2=0x7f456c0fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:37.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.666+0000 7f4573709640 1 -- 172.21.15.2:0/3316903112 shutdown_connections 2024-09-17T00:53:37.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:36.666+0000 7f4573709640 1 -- 172.21.15.2:0/3316903112 wait complete. 2024-09-17T00:53:37.518 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 9 is available 2024-09-17T00:53:37.518 INFO:teuthology.orchestra.run.smithi002.stdout:Generating a dashboard self-signed certificate... 2024-09-17T00:53:37.831 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:37 smithi002 ceph-mon[27650]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T00:53:37.831 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:37 smithi002 ceph-mon[27650]: mgrmap e11: smithi002.vjeexr(active, since 1.0057s) 2024-09-17T00:53:37.831 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:37 smithi002 ceph-mon[27650]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T00:53:37.831 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:37 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:38.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-17T00:53:38.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.031+0000 7f0c2a7c6640 1 Processor -- start 2024-09-17T00:53:38.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.031+0000 7f0c2a7c6640 1 -- start start 2024-09-17T00:53:38.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.031+0000 7f0c2a7c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24076c20 0x7f0c24104b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:38.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.031+0000 7f0c2a7c6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c24105050 con 0x7f0c24076c20 2024-09-17T00:53:38.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.031+0000 7f0c23fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24076c20 0x7f0c24104b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:38.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.031+0000 7f0c23fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24076c20 0x7f0c24104b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53392/0 (socket says 172.21.15.2:53392) 2024-09-17T00:53:38.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.031+0000 7f0c23fff640 1 -- 172.21.15.2:0/2676430371 learned_addr learned my addr 172.21.15.2:0/2676430371 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:38.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.031+0000 7f0c23fff640 1 -- 172.21.15.2:0/2676430371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c24105190 con 0x7f0c24076c20 2024-09-17T00:53:38.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.032+0000 7f0c23fff640 1 --2- 172.21.15.2:0/2676430371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24076c20 0x7f0c24104b10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009840 tx=0x7f0c140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1662673b5345a250 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:38.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.032+0000 7f0c22ffd640 1 -- 172.21.15.2:0/2676430371 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c14032440 con 0x7f0c24076c20 2024-09-17T00:53:38.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.032+0000 7f0c22ffd640 1 -- 172.21.15.2:0/2676430371 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0c14032a40 con 0x7f0c24076c20 2024-09-17T00:53:38.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.032+0000 7f0c22ffd640 1 -- 172.21.15.2:0/2676430371 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c14031aa0 con 0x7f0c24076c20 2024-09-17T00:53:38.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.033+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/2676430371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24076c20 msgr2=0x7f0c24104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:38.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.033+0000 7f0c2a7c6640 1 --2- 172.21.15.2:0/2676430371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24076c20 0x7f0c24104b10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009840 tx=0x7f0c140091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:38.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.033+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/2676430371 shutdown_connections 2024-09-17T00:53:38.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.033+0000 7f0c2a7c6640 1 --2- 172.21.15.2:0/2676430371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24076c20 0x7f0c24104b10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:38.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.033+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/2676430371 >> 172.21.15.2:0/2676430371 conn(0x7f0c240fc560 msgr2=0x7f0c240fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:38.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.033+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/2676430371 shutdown_connections 2024-09-17T00:53:38.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.033+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/2676430371 wait complete. 2024-09-17T00:53:38.929 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.034+0000 7f0c2a7c6640 1 Processor -- start 2024-09-17T00:53:38.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.034+0000 7f0c2a7c6640 1 -- start start 2024-09-17T00:53:38.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.034+0000 7f0c2a7c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24076c20 0x7f0c24102440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:38.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.034+0000 7f0c2a7c6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c24102980 con 0x7f0c24076c20 2024-09-17T00:53:38.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.034+0000 7f0c23fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24076c20 0x7f0c24102440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:38.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.034+0000 7f0c23fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24076c20 0x7f0c24102440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53404/0 (socket says 172.21.15.2:53404) 2024-09-17T00:53:38.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.034+0000 7f0c23fff640 1 -- 172.21.15.2:0/3270166758 learned_addr learned my addr 172.21.15.2:0/3270166758 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:38.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.034+0000 7f0c23fff640 1 -- 172.21.15.2:0/3270166758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c14009450 con 0x7f0c24076c20 2024-09-17T00:53:38.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.035+0000 7f0c23fff640 1 --2- 172.21.15.2:0/3270166758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24076c20 0x7f0c24102440 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0c14031780 tx=0x7f0c140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:38.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.035+0000 7f0c20ff9640 1 -- 172.21.15.2:0/3270166758 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c140327b0 con 0x7f0c24076c20 2024-09-17T00:53:38.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.035+0000 7f0c20ff9640 1 -- 172.21.15.2:0/3270166758 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0c1403b8d0 con 0x7f0c24076c20 2024-09-17T00:53:38.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.035+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/3270166758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c24100a10 con 0x7f0c24076c20 2024-09-17T00:53:38.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.035+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/3270166758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c24100e80 con 0x7f0c24076c20 2024-09-17T00:53:38.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.035+0000 7f0c20ff9640 1 -- 172.21.15.2:0/3270166758 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c1403a790 con 0x7f0c24076c20 2024-09-17T00:53:38.930 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.036+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/3270166758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c10005240 con 0x7f0c24076c20 2024-09-17T00:53:38.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.036+0000 7f0c20ff9640 1 -- 172.21.15.2:0/3270166758 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f0c14039040 con 0x7f0c24076c20 2024-09-17T00:53:38.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.036+0000 7f0c20ff9640 1 --2- 172.21.15.2:0/3270166758 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0c0c039420 0x7f0c0c03b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:38.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.036+0000 7f0c20ff9640 1 -- 172.21.15.2:0/3270166758 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0c1406c9f0 con 0x7f0c24076c20 2024-09-17T00:53:38.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.036+0000 7f0c237fe640 1 --2- 172.21.15.2:0/3270166758 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0c0c039420 0x7f0c0c03b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:38.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.037+0000 7f0c237fe640 1 --2- 172.21.15.2:0/3270166758 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0c0c039420 0x7f0c0c03b8d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0c18006fd0 tx=0x7f0c18006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:38.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.041+0000 7f0c20ff9640 1 -- 172.21.15.2:0/3270166758 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0c1404b8e0 con 0x7f0c24076c20 2024-09-17T00:53:38.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.154+0000 7f0c20ff9640 1 -- 172.21.15.2:0/3270166758 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f0c1404b4e0 con 0x7f0c24076c20 2024-09-17T00:53:38.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.226+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/3270166758 --> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c10000bf0 con 0x7f0c0c039420 2024-09-17T00:53:38.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.286+0000 7f0c20ff9640 1 -- 172.21.15.2:0/3270166758 <== mgr.14160 v2:172.21.15.2:6800/2191872617 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f0c10000bf0 con 0x7f0c0c039420 2024-09-17T00:53:38.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.288+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/3270166758 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0c0c039420 msgr2=0x7f0c0c03b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:38.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.288+0000 7f0c2a7c6640 1 --2- 172.21.15.2:0/3270166758 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0c0c039420 0x7f0c0c03b8d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0c18006fd0 tx=0x7f0c18006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:38.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.288+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/3270166758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24076c20 msgr2=0x7f0c24102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:38.931 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.288+0000 7f0c2a7c6640 1 --2- 172.21.15.2:0/3270166758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24076c20 0x7f0c24102440 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0c14031780 tx=0x7f0c140091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:38.932 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.288+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/3270166758 shutdown_connections 2024-09-17T00:53:38.932 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.288+0000 7f0c2a7c6640 1 --2- 172.21.15.2:0/3270166758 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0c0c039420 0x7f0c0c03b8d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:38.932 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.288+0000 7f0c2a7c6640 1 --2- 172.21.15.2:0/3270166758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24076c20 0x7f0c24102440 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:38.932 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.288+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/3270166758 >> 172.21.15.2:0/3270166758 conn(0x7f0c240fc560 msgr2=0x7f0c240fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:38.932 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.288+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/3270166758 shutdown_connections 2024-09-17T00:53:38.932 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:38.288+0000 7f0c2a7c6640 1 -- 172.21.15.2:0/3270166758 wait complete. 2024-09-17T00:53:38.932 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial admin user... 2024-09-17T00:53:39.038 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:38 smithi002 ceph-mon[27650]: [17/Sep/2024:00:53:37] ENGINE Bus STARTING 2024-09-17T00:53:39.038 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:38 smithi002 ceph-mon[27650]: [17/Sep/2024:00:53:37] ENGINE Serving on https://172.21.15.2:7150 2024-09-17T00:53:39.038 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:38 smithi002 ceph-mon[27650]: [17/Sep/2024:00:53:37] ENGINE Bus STARTED 2024-09-17T00:53:39.038 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:38 smithi002 ceph-mon[27650]: [17/Sep/2024:00:53:37] ENGINE Error in HTTPServer.serve 2024-09-17T00:53:39.038 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Traceback (most recent call last): 2024-09-17T00:53:39.038 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T00:53:39.038 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-17T00:53:39.038 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T00:53:39.038 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._run(expiration_interval) 2024-09-17T00:53:39.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T00:53:39.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T00:53:39.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T00:53:39.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T00:53:39.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T00:53:39.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s = self.context.wrap_socket( 2024-09-17T00:53:39.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T00:53:39.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: return self.sslsocket_class._create( 2024-09-17T00:53:39.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T00:53:39.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self.do_handshake() 2024-09-17T00:53:39.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T00:53:39.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._sslobj.do_handshake() 2024-09-17T00:53:39.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T00:53:39.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:38 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:39.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:38 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:39.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:38 smithi002 ceph-mon[27650]: mgrmap e12: smithi002.vjeexr(active, since 2s) 2024-09-17T00:53:39.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:38 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:39.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:38 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:39.804 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:39 smithi002 ceph-mon[27650]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Uq.VUIwpFpOYBaOP4Cblr.BTCIT4n71CQTQMTchX8FGDlY28ankya", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726534420, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-17T00:53:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.230+0000 7fa905c6d640 1 Processor -- start 2024-09-17T00:53:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.230+0000 7fa905c6d640 1 -- start start 2024-09-17T00:53:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.230+0000 7fa905c6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa900078d00 0x7fa900077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.230+0000 7fa905c6d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa900079110 con 0x7fa900078d00 2024-09-17T00:53:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.231+0000 7fa8ff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa900078d00 0x7fa900077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.231+0000 7fa8ff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa900078d00 0x7fa900077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53406/0 (socket says 172.21.15.2:53406) 2024-09-17T00:53:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.231+0000 7fa8ff7fe640 1 -- 172.21.15.2:0/3677369336 learned_addr learned my addr 172.21.15.2:0/3677369336 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.231+0000 7fa8ff7fe640 1 -- 172.21.15.2:0/3677369336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa900077770 con 0x7fa900078d00 2024-09-17T00:53:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.232+0000 7fa8ff7fe640 1 --2- 172.21.15.2:0/3677369336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa900078d00 0x7fa900077230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009840 tx=0x7fa8f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c42133adaf31b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.232+0000 7fa8fe7fc640 1 -- 172.21.15.2:0/3677369336 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8f0032440 con 0x7fa900078d00 2024-09-17T00:53:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.232+0000 7fa8fe7fc640 1 -- 172.21.15.2:0/3677369336 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa8f0032a40 con 0x7fa900078d00 2024-09-17T00:53:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.232+0000 7fa8fe7fc640 1 -- 172.21.15.2:0/3677369336 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8f0031a70 con 0x7fa900078d00 2024-09-17T00:53:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.233+0000 7fa905c6d640 1 -- 172.21.15.2:0/3677369336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa900078d00 msgr2=0x7fa900077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.233+0000 7fa905c6d640 1 --2- 172.21.15.2:0/3677369336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa900078d00 0x7fa900077230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009840 tx=0x7fa8f00091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.233+0000 7fa905c6d640 1 -- 172.21.15.2:0/3677369336 shutdown_connections 2024-09-17T00:53:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.233+0000 7fa905c6d640 1 --2- 172.21.15.2:0/3677369336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa900078d00 0x7fa900077230 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.233+0000 7fa905c6d640 1 -- 172.21.15.2:0/3677369336 >> 172.21.15.2:0/3677369336 conn(0x7fa9000fd700 msgr2=0x7fa9000ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.233+0000 7fa905c6d640 1 -- 172.21.15.2:0/3677369336 shutdown_connections 2024-09-17T00:53:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.233+0000 7fa905c6d640 1 -- 172.21.15.2:0/3677369336 wait complete. 2024-09-17T00:53:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.233+0000 7fa905c6d640 1 Processor -- start 2024-09-17T00:53:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.234+0000 7fa905c6d640 1 -- start start 2024-09-17T00:53:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.234+0000 7fa905c6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa900078d00 0x7fa900113040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.234+0000 7fa905c6d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa900113580 con 0x7fa900078d00 2024-09-17T00:53:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.234+0000 7fa8ff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa900078d00 0x7fa900113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.234+0000 7fa8ff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa900078d00 0x7fa900113040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53414/0 (socket says 172.21.15.2:53414) 2024-09-17T00:53:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.234+0000 7fa8ff7fe640 1 -- 172.21.15.2:0/4013067651 learned_addr learned my addr 172.21.15.2:0/4013067651 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.234+0000 7fa8ff7fe640 1 -- 172.21.15.2:0/4013067651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f0009450 con 0x7fa900078d00 2024-09-17T00:53:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.234+0000 7fa8ff7fe640 1 --2- 172.21.15.2:0/4013067651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa900078d00 0x7fa900113040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0031670 tx=0x7fa8f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.235+0000 7fa8e7fff640 1 -- 172.21.15.2:0/4013067651 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8f0031e90 con 0x7fa900078d00 2024-09-17T00:53:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.235+0000 7fa905c6d640 1 -- 172.21.15.2:0/4013067651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa900113780 con 0x7fa900078d00 2024-09-17T00:53:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.235+0000 7fa8e7fff640 1 -- 172.21.15.2:0/4013067651 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa8f003c8a0 con 0x7fa900078d00 2024-09-17T00:53:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.235+0000 7fa8e7fff640 1 -- 172.21.15.2:0/4013067651 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8f003a820 con 0x7fa900078d00 2024-09-17T00:53:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.235+0000 7fa905c6d640 1 -- 172.21.15.2:0/4013067651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa900113bf0 con 0x7fa900078d00 2024-09-17T00:53:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.236+0000 7fa8e7fff640 1 -- 172.21.15.2:0/4013067651 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fa8f003ca10 con 0x7fa900078d00 2024-09-17T00:53:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.236+0000 7fa8e7fff640 1 --2- 172.21.15.2:0/4013067651 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fa8e80394e0 0x7fa8e803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.236+0000 7fa905c6d640 1 -- 172.21.15.2:0/4013067651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa900113bf0 con 0x7fa900078d00 2024-09-17T00:53:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.236+0000 7fa8e7fff640 1 -- 172.21.15.2:0/4013067651 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa8f006cda0 con 0x7fa900078d00 2024-09-17T00:53:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.236+0000 7fa8feffd640 1 --2- 172.21.15.2:0/4013067651 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fa8e80394e0 0x7fa8e803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.236+0000 7fa8feffd640 1 --2- 172.21.15.2:0/4013067651 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fa8e80394e0 0x7fa8e803b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4006fd0 tx=0x7fa8f4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.241+0000 7fa8e7fff640 1 -- 172.21.15.2:0/4013067651 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa900113bf0 con 0x7fa900078d00 2024-09-17T00:53:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.443+0000 7fa905c6d640 1 -- 172.21.15.2:0/4013067651 --> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fa900108260 con 0x7fa8e80394e0 2024-09-17T00:53:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.692+0000 7fa8e7fff640 1 -- 172.21.15.2:0/4013067651 <== mgr.14160 v2:172.21.15.2:6800/2191872617 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fa900108260 con 0x7fa8e80394e0 2024-09-17T00:53:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.694+0000 7fa905c6d640 1 -- 172.21.15.2:0/4013067651 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fa8e80394e0 msgr2=0x7fa8e803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.694+0000 7fa905c6d640 1 --2- 172.21.15.2:0/4013067651 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fa8e80394e0 0x7fa8e803b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4006fd0 tx=0x7fa8f4006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.694+0000 7fa905c6d640 1 -- 172.21.15.2:0/4013067651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa900078d00 msgr2=0x7fa900113040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.694+0000 7fa905c6d640 1 --2- 172.21.15.2:0/4013067651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa900078d00 0x7fa900113040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0031670 tx=0x7fa8f00091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.694+0000 7fa905c6d640 1 -- 172.21.15.2:0/4013067651 shutdown_connections 2024-09-17T00:53:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.694+0000 7fa905c6d640 1 --2- 172.21.15.2:0/4013067651 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fa8e80394e0 0x7fa8e803b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.694+0000 7fa905c6d640 1 --2- 172.21.15.2:0/4013067651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa900078d00 0x7fa900113040 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.694+0000 7fa905c6d640 1 -- 172.21.15.2:0/4013067651 >> 172.21.15.2:0/4013067651 conn(0x7fa9000fd700 msgr2=0x7fa9000fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.694+0000 7fa905c6d640 1 -- 172.21.15.2:0/4013067651 shutdown_connections 2024-09-17T00:53:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:40.694+0000 7fa905c6d640 1 -- 172.21.15.2:0/4013067651 wait complete. 2024-09-17T00:53:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:Fetching dashboard port number... 2024-09-17T00:53:42.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:41 smithi002 ceph-mon[27650]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:42.153 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:41 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 8443 2024-09-17T00:53:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.690+0000 7f5b485e0640 1 Processor -- start 2024-09-17T00:53:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.690+0000 7f5b485e0640 1 -- start start 2024-09-17T00:53:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.690+0000 7f5b485e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b40076bb0 0x7f5b40106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.690+0000 7f5b485e0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b401029b0 con 0x7f5b40076bb0 2024-09-17T00:53:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.690+0000 7f5b4637c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b40076bb0 0x7f5b40106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.690+0000 7f5b4637c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b40076bb0 0x7f5b40106fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49174/0 (socket says 172.21.15.2:49174) 2024-09-17T00:53:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.690+0000 7f5b4637c640 1 -- 172.21.15.2:0/445290858 learned_addr learned my addr 172.21.15.2:0/445290858 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.691+0000 7f5b4637c640 1 -- 172.21.15.2:0/445290858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b40107500 con 0x7f5b40076bb0 2024-09-17T00:53:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.691+0000 7f5b4637c640 1 --2- 172.21.15.2:0/445290858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b40076bb0 0x7f5b40106fc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009840 tx=0x7f5b3c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b662a3e93531dc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.693+0000 7f5b4537a640 1 -- 172.21.15.2:0/445290858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b3c032440 con 0x7f5b40076bb0 2024-09-17T00:53:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.693+0000 7f5b4537a640 1 -- 172.21.15.2:0/445290858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5b3c032a40 con 0x7f5b40076bb0 2024-09-17T00:53:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.693+0000 7f5b4537a640 1 -- 172.21.15.2:0/445290858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b3c031a70 con 0x7f5b40076bb0 2024-09-17T00:53:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.694+0000 7f5b485e0640 1 -- 172.21.15.2:0/445290858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b40076bb0 msgr2=0x7f5b40106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.694+0000 7f5b485e0640 1 --2- 172.21.15.2:0/445290858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b40076bb0 0x7f5b40106fc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009840 tx=0x7f5b3c0091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.694+0000 7f5b485e0640 1 -- 172.21.15.2:0/445290858 shutdown_connections 2024-09-17T00:53:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.694+0000 7f5b485e0640 1 --2- 172.21.15.2:0/445290858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b40076bb0 0x7f5b40106fc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.694+0000 7f5b485e0640 1 -- 172.21.15.2:0/445290858 >> 172.21.15.2:0/445290858 conn(0x7f5b400fc5f0 msgr2=0x7f5b400fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.694+0000 7f5b485e0640 1 -- 172.21.15.2:0/445290858 shutdown_connections 2024-09-17T00:53:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.694+0000 7f5b485e0640 1 -- 172.21.15.2:0/445290858 wait complete. 2024-09-17T00:53:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.695+0000 7f5b485e0640 1 Processor -- start 2024-09-17T00:53:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.695+0000 7f5b485e0640 1 -- start start 2024-09-17T00:53:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.695+0000 7f5b485e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b40076bb0 0x7f5b40112f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.695+0000 7f5b485e0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b401134b0 con 0x7f5b40076bb0 2024-09-17T00:53:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.695+0000 7f5b4637c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b40076bb0 0x7f5b40112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.695+0000 7f5b4637c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b40076bb0 0x7f5b40112f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49190/0 (socket says 172.21.15.2:49190) 2024-09-17T00:53:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.695+0000 7f5b4637c640 1 -- 172.21.15.2:0/3069065290 learned_addr learned my addr 172.21.15.2:0/3069065290 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.696+0000 7f5b4637c640 1 -- 172.21.15.2:0/3069065290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c009450 con 0x7f5b40076bb0 2024-09-17T00:53:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.696+0000 7f5b4637c640 1 --2- 172.21.15.2:0/3069065290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b40076bb0 0x7f5b40112f70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009420 tx=0x7f5b3c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.696+0000 7f5b36ffd640 1 -- 172.21.15.2:0/3069065290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b3c03c400 con 0x7f5b40076bb0 2024-09-17T00:53:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.696+0000 7f5b36ffd640 1 -- 172.21.15.2:0/3069065290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5b3c03ca00 con 0x7f5b40076bb0 2024-09-17T00:53:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.696+0000 7f5b485e0640 1 -- 172.21.15.2:0/3069065290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b401136b0 con 0x7f5b40076bb0 2024-09-17T00:53:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.696+0000 7f5b36ffd640 1 -- 172.21.15.2:0/3069065290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5b3c03a920 con 0x7f5b40076bb0 2024-09-17T00:53:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.696+0000 7f5b485e0640 1 -- 172.21.15.2:0/3069065290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b40113b20 con 0x7f5b40076bb0 2024-09-17T00:53:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.697+0000 7f5b36ffd640 1 -- 172.21.15.2:0/3069065290 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45562+0+0 (secure 0 0 0) 0x7f5b3c03aa80 con 0x7f5b40076bb0 2024-09-17T00:53:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.697+0000 7f5b36ffd640 1 --2- 172.21.15.2:0/3069065290 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f5b2c0395d0 0x7f5b2c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.697+0000 7f5b36ffd640 1 -- 172.21.15.2:0/3069065290 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5b3c06dde0 con 0x7f5b40076bb0 2024-09-17T00:53:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.697+0000 7f5b45b7b640 1 --2- 172.21.15.2:0/3069065290 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f5b2c0395d0 0x7f5b2c03ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.697+0000 7f5b485e0640 1 -- 172.21.15.2:0/3069065290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4005ed70 con 0x7f5b40076bb0 2024-09-17T00:53:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.698+0000 7f5b45b7b640 1 --2- 172.21.15.2:0/3069065290 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f5b2c0395d0 0x7f5b2c03ba80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5b30006fd0 tx=0x7f5b30006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.702+0000 7f5b36ffd640 1 -- 172.21.15.2:0/3069065290 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5b3c037030 con 0x7f5b40076bb0 2024-09-17T00:53:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.865+0000 7f5b485e0640 1 -- 172.21.15.2:0/3069065290 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f5b40108160 con 0x7f5b40076bb0 2024-09-17T00:53:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.865+0000 7f5b36ffd640 1 -- 172.21.15.2:0/3069065290 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f5b3c046460 con 0x7f5b40076bb0 2024-09-17T00:53:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.867+0000 7f5b485e0640 1 -- 172.21.15.2:0/3069065290 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f5b2c0395d0 msgr2=0x7f5b2c03ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.867+0000 7f5b485e0640 1 --2- 172.21.15.2:0/3069065290 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f5b2c0395d0 0x7f5b2c03ba80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5b30006fd0 tx=0x7f5b30006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.867+0000 7f5b485e0640 1 -- 172.21.15.2:0/3069065290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b40076bb0 msgr2=0x7f5b40112f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.867+0000 7f5b485e0640 1 --2- 172.21.15.2:0/3069065290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b40076bb0 0x7f5b40112f70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009420 tx=0x7f5b3c0091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.867+0000 7f5b485e0640 1 -- 172.21.15.2:0/3069065290 shutdown_connections 2024-09-17T00:53:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.867+0000 7f5b485e0640 1 --2- 172.21.15.2:0/3069065290 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f5b2c0395d0 0x7f5b2c03ba80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.867+0000 7f5b485e0640 1 --2- 172.21.15.2:0/3069065290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b40076bb0 0x7f5b40112f70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.867+0000 7f5b485e0640 1 -- 172.21.15.2:0/3069065290 >> 172.21.15.2:0/3069065290 conn(0x7f5b400fc5f0 msgr2=0x7f5b400fd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.867+0000 7f5b485e0640 1 -- 172.21.15.2:0/3069065290 shutdown_connections 2024-09-17T00:53:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:41.867+0000 7f5b485e0640 1 -- 172.21.15.2:0/3069065290 wait complete. 2024-09-17T00:53:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T00:53:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-09-17T00:53:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T00:53:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-09-17T00:53:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-09-17T00:53:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-17T00:53:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph Dashboard is now available at: 2024-09-17T00:53:42.481 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:53:42.481 INFO:teuthology.orchestra.run.smithi002.stdout: URL: https://smithi002.front.sepia.ceph.com:8443/ 2024-09-17T00:53:42.481 INFO:teuthology.orchestra.run.smithi002.stdout: User: admin 2024-09-17T00:53:42.481 INFO:teuthology.orchestra.run.smithi002.stdout: Password: j7vdhhz67l 2024-09-17T00:53:42.481 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:53:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:Saving cluster configuration to /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config directory 2024-09-17T00:53:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling autotune for osd_memory_target 2024-09-17T00:53:42.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:42 smithi002 ceph-mon[27650]: mgrmap e13: smithi002.vjeexr(active, since 6s) 2024-09-17T00:53:42.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:42 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3069065290' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-17T00:53:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.905+0000 7f0681218640 1 Processor -- start 2024-09-17T00:53:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.905+0000 7f0681218640 1 -- start start 2024-09-17T00:53:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.905+0000 7f0681218640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c100e40 0x7f067c101250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.905+0000 7f0681218640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c101790 con 0x7f067c100e40 2024-09-17T00:53:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.906+0000 7f067ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c100e40 0x7f067c101250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.906+0000 7f067ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c100e40 0x7f067c101250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49200/0 (socket says 172.21.15.2:49200) 2024-09-17T00:53:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.906+0000 7f067ad9d640 1 -- 172.21.15.2:0/123241553 learned_addr learned my addr 172.21.15.2:0/123241553 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.906+0000 7f067ad9d640 1 -- 172.21.15.2:0/123241553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067c1018d0 con 0x7f067c100e40 2024-09-17T00:53:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.907+0000 7f067ad9d640 1 --2- 172.21.15.2:0/123241553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c100e40 0x7f067c101250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f066c009e50 tx=0x7f066c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6069923264558397 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.907+0000 7f0679d9b640 1 -- 172.21.15.2:0/123241553 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f066c031560 con 0x7f067c100e40 2024-09-17T00:53:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.907+0000 7f0679d9b640 1 -- 172.21.15.2:0/123241553 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f066c02d050 con 0x7f067c100e40 2024-09-17T00:53:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.907+0000 7f0679d9b640 1 -- 172.21.15.2:0/123241553 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f066c007a60 con 0x7f067c100e40 2024-09-17T00:53:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.907+0000 7f0681218640 1 -- 172.21.15.2:0/123241553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c100e40 msgr2=0x7f067c101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.907+0000 7f0681218640 1 --2- 172.21.15.2:0/123241553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c100e40 0x7f067c101250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f066c009e50 tx=0x7f066c009840 comp rx=0 tx=0).stop 2024-09-17T00:53:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.907+0000 7f0681218640 1 -- 172.21.15.2:0/123241553 shutdown_connections 2024-09-17T00:53:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.907+0000 7f0681218640 1 --2- 172.21.15.2:0/123241553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c100e40 0x7f067c101250 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.907+0000 7f0681218640 1 -- 172.21.15.2:0/123241553 >> 172.21.15.2:0/123241553 conn(0x7f067c0fc560 msgr2=0x7f067c0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.907+0000 7f0681218640 1 -- 172.21.15.2:0/123241553 shutdown_connections 2024-09-17T00:53:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.908+0000 7f0681218640 1 -- 172.21.15.2:0/123241553 wait complete. 2024-09-17T00:53:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.908+0000 7f0681218640 1 Processor -- start 2024-09-17T00:53:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.908+0000 7f0681218640 1 -- start start 2024-09-17T00:53:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.908+0000 7f0681218640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c100e40 0x7f067c10fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.908+0000 7f0681218640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c110190 con 0x7f067c100e40 2024-09-17T00:53:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.908+0000 7f067ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c100e40 0x7f067c10fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.909+0000 7f067ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c100e40 0x7f067c10fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49206/0 (socket says 172.21.15.2:49206) 2024-09-17T00:53:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.909+0000 7f067ad9d640 1 -- 172.21.15.2:0/1731576298 learned_addr learned my addr 172.21.15.2:0/1731576298 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.909+0000 7f067ad9d640 1 -- 172.21.15.2:0/1731576298 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c009ae0 con 0x7f067c100e40 2024-09-17T00:53:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.909+0000 7f067ad9d640 1 --2- 172.21.15.2:0/1731576298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c100e40 0x7f067c10fc50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f066c009560 tx=0x7f066c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.909+0000 7f06737fe640 1 -- 172.21.15.2:0/1731576298 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f066c03b410 con 0x7f067c100e40 2024-09-17T00:53:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.909+0000 7f06737fe640 1 -- 172.21.15.2:0/1731576298 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f066c03ba10 con 0x7f067c100e40 2024-09-17T00:53:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.909+0000 7f0681218640 1 -- 172.21.15.2:0/1731576298 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067c110390 con 0x7f067c100e40 2024-09-17T00:53:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.909+0000 7f06737fe640 1 -- 172.21.15.2:0/1731576298 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f066c045710 con 0x7f067c100e40 2024-09-17T00:53:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.909+0000 7f0681218640 1 -- 172.21.15.2:0/1731576298 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067c110800 con 0x7f067c100e40 2024-09-17T00:53:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.910+0000 7f06737fe640 1 -- 172.21.15.2:0/1731576298 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45562+0+0 (secure 0 0 0) 0x7f066c038050 con 0x7f067c100e40 2024-09-17T00:53:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.910+0000 7f0681218640 1 -- 172.21.15.2:0/1731576298 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f067c04b720 con 0x7f067c100e40 2024-09-17T00:53:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.910+0000 7f06737fe640 1 --2- 172.21.15.2:0/1731576298 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0668039580 0x7f066803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.910+0000 7f06737fe640 1 -- 172.21.15.2:0/1731576298 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f066c06d020 con 0x7f067c100e40 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.911+0000 7f067a59c640 1 --2- 172.21.15.2:0/1731576298 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0668039580 0x7f066803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.911+0000 7f067a59c640 1 --2- 172.21.15.2:0/1731576298 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0668039580 0x7f066803ba30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0664006fd0 tx=0x7f0664006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:42.915+0000 7f06737fe640 1 -- 172.21.15.2:0/1731576298 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f066c04d8e0 con 0x7f067c100e40 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:43.078+0000 7f0681218640 1 -- 172.21.15.2:0/1731576298 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f067c111160 con 0x7f067c100e40 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:43.078+0000 7f06737fe640 1 -- 172.21.15.2:0/1731576298 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f066c041070 con 0x7f067c100e40 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:43.080+0000 7f0681218640 1 -- 172.21.15.2:0/1731576298 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0668039580 msgr2=0x7f066803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:43.080+0000 7f0681218640 1 --2- 172.21.15.2:0/1731576298 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0668039580 0x7f066803ba30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0664006fd0 tx=0x7f0664006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:43.080+0000 7f0681218640 1 -- 172.21.15.2:0/1731576298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c100e40 msgr2=0x7f067c10fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:43.080+0000 7f0681218640 1 --2- 172.21.15.2:0/1731576298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c100e40 0x7f067c10fc50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f066c009560 tx=0x7f066c009840 comp rx=0 tx=0).stop 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:43.081+0000 7f0681218640 1 -- 172.21.15.2:0/1731576298 shutdown_connections 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:43.081+0000 7f0681218640 1 --2- 172.21.15.2:0/1731576298 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0668039580 0x7f066803ba30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:43.081+0000 7f0681218640 1 --2- 172.21.15.2:0/1731576298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c100e40 0x7f067c10fc50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:43.081+0000 7f0681218640 1 -- 172.21.15.2:0/1731576298 >> 172.21.15.2:0/1731576298 conn(0x7f067c0fc560 msgr2=0x7f067c0fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:43.081+0000 7f0681218640 1 -- 172.21.15.2:0/1731576298 shutdown_connections 2024-09-17T00:53:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:43.081+0000 7f0681218640 1 -- 172.21.15.2:0/1731576298 wait complete. 2024-09-17T00:53:44.867 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.089+0000 7f1c21306640 1 Processor -- start 2024-09-17T00:53:44.867 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.090+0000 7f1c21306640 1 -- start start 2024-09-17T00:53:44.867 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.090+0000 7f1c21306640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c078d00 0x7f1c1c077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:44.867 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.090+0000 7f1c21306640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c079110 con 0x7f1c1c078d00 2024-09-17T00:53:44.867 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.090+0000 7f1c1affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c078d00 0x7f1c1c077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:44.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.090+0000 7f1c1affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c078d00 0x7f1c1c077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49216/0 (socket says 172.21.15.2:49216) 2024-09-17T00:53:44.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.090+0000 7f1c1affd640 1 -- 172.21.15.2:0/2830281374 learned_addr learned my addr 172.21.15.2:0/2830281374 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:44.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.090+0000 7f1c1affd640 1 -- 172.21.15.2:0/2830281374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c077770 con 0x7f1c1c078d00 2024-09-17T00:53:44.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.091+0000 7f1c1affd640 1 --2- 172.21.15.2:0/2830281374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c078d00 0x7f1c1c077230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009840 tx=0x7f1c0c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9f502c5614b4df server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:44.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.091+0000 7f1c19ffb640 1 -- 172.21.15.2:0/2830281374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c0c032440 con 0x7f1c1c078d00 2024-09-17T00:53:44.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.091+0000 7f1c19ffb640 1 -- 172.21.15.2:0/2830281374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c0c032a40 con 0x7f1c1c078d00 2024-09-17T00:53:44.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.091+0000 7f1c19ffb640 1 -- 172.21.15.2:0/2830281374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c0c031a70 con 0x7f1c1c078d00 2024-09-17T00:53:44.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.092+0000 7f1c21306640 1 -- 172.21.15.2:0/2830281374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c078d00 msgr2=0x7f1c1c077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:44.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.092+0000 7f1c21306640 1 --2- 172.21.15.2:0/2830281374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c078d00 0x7f1c1c077230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009840 tx=0x7f1c0c0091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:44.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.092+0000 7f1c21306640 1 -- 172.21.15.2:0/2830281374 shutdown_connections 2024-09-17T00:53:44.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.092+0000 7f1c21306640 1 --2- 172.21.15.2:0/2830281374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c078d00 0x7f1c1c077230 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:44.868 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.092+0000 7f1c21306640 1 -- 172.21.15.2:0/2830281374 >> 172.21.15.2:0/2830281374 conn(0x7f1c1c0fd700 msgr2=0x7f1c1c0ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:44.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.092+0000 7f1c21306640 1 -- 172.21.15.2:0/2830281374 shutdown_connections 2024-09-17T00:53:44.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.092+0000 7f1c21306640 1 -- 172.21.15.2:0/2830281374 wait complete. 2024-09-17T00:53:44.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.093+0000 7f1c21306640 1 Processor -- start 2024-09-17T00:53:44.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.093+0000 7f1c21306640 1 -- start start 2024-09-17T00:53:44.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.093+0000 7f1c21306640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c078d00 0x7f1c1c112fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:44.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.093+0000 7f1c21306640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c113520 con 0x7f1c1c078d00 2024-09-17T00:53:44.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.093+0000 7f1c1affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c078d00 0x7f1c1c112fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:44.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.093+0000 7f1c1affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c078d00 0x7f1c1c112fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49228/0 (socket says 172.21.15.2:49228) 2024-09-17T00:53:44.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.093+0000 7f1c1affd640 1 -- 172.21.15.2:0/2608406833 learned_addr learned my addr 172.21.15.2:0/2608406833 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:44.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.093+0000 7f1c1affd640 1 -- 172.21.15.2:0/2608406833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c009450 con 0x7f1c1c078d00 2024-09-17T00:53:44.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.093+0000 7f1c1affd640 1 --2- 172.21.15.2:0/2608406833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c078d00 0x7f1c1c112fe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c031670 tx=0x7f1c0c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:44.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.094+0000 7f1c037fe640 1 -- 172.21.15.2:0/2608406833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c0c031e90 con 0x7f1c1c078d00 2024-09-17T00:53:44.869 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.094+0000 7f1c21306640 1 -- 172.21.15.2:0/2608406833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c113720 con 0x7f1c1c078d00 2024-09-17T00:53:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.094+0000 7f1c037fe640 1 -- 172.21.15.2:0/2608406833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c0c03c8a0 con 0x7f1c1c078d00 2024-09-17T00:53:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.094+0000 7f1c037fe640 1 -- 172.21.15.2:0/2608406833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c0c03a820 con 0x7f1c1c078d00 2024-09-17T00:53:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.094+0000 7f1c21306640 1 -- 172.21.15.2:0/2608406833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c113b90 con 0x7f1c1c078d00 2024-09-17T00:53:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.094+0000 7f1c037fe640 1 -- 172.21.15.2:0/2608406833 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45562+0+0 (secure 0 0 0) 0x7f1c0c03a980 con 0x7f1c1c078d00 2024-09-17T00:53:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.095+0000 7f1c21306640 1 -- 172.21.15.2:0/2608406833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c04b720 con 0x7f1c1c078d00 2024-09-17T00:53:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.095+0000 7f1c037fe640 1 --2- 172.21.15.2:0/2608406833 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f1c04039580 0x7f1c0403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.095+0000 7f1c037fe640 1 -- 172.21.15.2:0/2608406833 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1c0c06cf30 con 0x7f1c1c078d00 2024-09-17T00:53:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.095+0000 7f1c1a7fc640 1 --2- 172.21.15.2:0/2608406833 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f1c04039580 0x7f1c0403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.095+0000 7f1c1a7fc640 1 --2- 172.21.15.2:0/2608406833 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f1c04039580 0x7f1c0403ba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1c10006fd0 tx=0x7f1c10006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.099+0000 7f1c037fe640 1 -- 172.21.15.2:0/2608406833 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1c0c046460 con 0x7f1c1c078d00 2024-09-17T00:53:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.353+0000 7f1c21306640 1 -- 172.21.15.2:0/2608406833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f1c1c1144f0 con 0x7f1c1c078d00 2024-09-17T00:53:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.356+0000 7f1c037fe640 1 -- 172.21.15.2:0/2608406833 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f1c0c037030 con 0x7f1c1c078d00 2024-09-17T00:53:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-17T00:53:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.358+0000 7f1c21306640 1 -- 172.21.15.2:0/2608406833 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f1c04039580 msgr2=0x7f1c0403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.359+0000 7f1c21306640 1 --2- 172.21.15.2:0/2608406833 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f1c04039580 0x7f1c0403ba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1c10006fd0 tx=0x7f1c10006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.359+0000 7f1c21306640 1 -- 172.21.15.2:0/2608406833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c078d00 msgr2=0x7f1c1c112fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.359+0000 7f1c21306640 1 --2- 172.21.15.2:0/2608406833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c078d00 0x7f1c1c112fe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c031670 tx=0x7f1c0c0091d0 comp rx=0 tx=0).stop 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.359+0000 7f1c21306640 1 -- 172.21.15.2:0/2608406833 shutdown_connections 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.359+0000 7f1c21306640 1 --2- 172.21.15.2:0/2608406833 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f1c04039580 0x7f1c0403ba30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.359+0000 7f1c21306640 1 --2- 172.21.15.2:0/2608406833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c078d00 0x7f1c1c112fe0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.359+0000 7f1c21306640 1 -- 172.21.15.2:0/2608406833 >> 172.21.15.2:0/2608406833 conn(0x7f1c1c0fd700 msgr2=0x7f1c1c0fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.359+0000 7f1c21306640 1 -- 172.21.15.2:0/2608406833 shutdown_connections 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-09-17T00:53:44.359+0000 7f1c21306640 1 -- 172.21.15.2:0/2608406833 wait complete. 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout:Or, if you are only running a single cluster on this host: 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:53:44.871 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-17T00:53:44.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:53:44.872 INFO:teuthology.orchestra.run.smithi002.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-17T00:53:44.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:53:44.872 INFO:teuthology.orchestra.run.smithi002.stdout: ceph telemetry on 2024-09-17T00:53:44.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:53:44.872 INFO:teuthology.orchestra.run.smithi002.stdout:For more information see: 2024-09-17T00:53:44.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:53:44.872 INFO:teuthology.orchestra.run.smithi002.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-17T00:53:44.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:53:44.872 INFO:teuthology.orchestra.run.smithi002.stdout:Bootstrap complete. 2024-09-17T00:53:44.902 INFO:tasks.cephadm:Fetching config... 2024-09-17T00:53:44.903 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:53:44.903 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-17T00:53:44.921 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-17T00:53:44.921 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:53:44.921 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-17T00:53:44.977 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-17T00:53:44.977 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:53:44.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/keyring of=/dev/stdout 2024-09-17T00:53:45.043 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-17T00:53:45.043 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:53:45.043 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-17T00:53:45.100 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-17T00:53:45.100 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCDVhqpeWDweskQWFfPdd7kfWRztdWUDq6fkxwwAeQ2SrlAgvU/WtRXgLn5YbGe2QoLH2tYhZBqZBimt/q7sqgAfNzWA6do4HEBxvZNrLUsvo8yAgZj6Z70KgFFKh764kktwo0jMbMMR9tXVlIiQ1TVwjgBikk6O5pVNIT8Nnbphczap4C9a9Z6wkSDw/Rq4Q8HfQe8+2/6JPSTc5JQy0I4M0CZU2M3RMJktodqx7d+WEAgEsJmR+JQryt00Igp4LIEc7DbleoZDqeOzPF+beTGYHDQtutxEo1FvX4hO4M0QBPtLXwmx7u34uJkokHGBwUDdW2B9JsU3sO1RozMRPvGuvSeNdJLqZea8UtryDwh7chsszH+u+LIC8mG6qphdQQiXaVc+eJ3EgbZG81zyCT32EGTNj1XwCYsBbct6O5W/nGZbYeYNy7LEY1/3w6djPeE+Xn7QHQyJPlW0f59ojEOnOVlpYdOve4B10OZFEEbE5FDlcc6uD9BobGHfqZrTmc= ceph-f8e82564-748e-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T00:53:45.177 INFO:teuthology.orchestra.run.smithi002.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCDVhqpeWDweskQWFfPdd7kfWRztdWUDq6fkxwwAeQ2SrlAgvU/WtRXgLn5YbGe2QoLH2tYhZBqZBimt/q7sqgAfNzWA6do4HEBxvZNrLUsvo8yAgZj6Z70KgFFKh764kktwo0jMbMMR9tXVlIiQ1TVwjgBikk6O5pVNIT8Nnbphczap4C9a9Z6wkSDw/Rq4Q8HfQe8+2/6JPSTc5JQy0I4M0CZU2M3RMJktodqx7d+WEAgEsJmR+JQryt00Igp4LIEc7DbleoZDqeOzPF+beTGYHDQtutxEo1FvX4hO4M0QBPtLXwmx7u34uJkokHGBwUDdW2B9JsU3sO1RozMRPvGuvSeNdJLqZea8UtryDwh7chsszH+u+LIC8mG6qphdQQiXaVc+eJ3EgbZG81zyCT32EGTNj1XwCYsBbct6O5W/nGZbYeYNy7LEY1/3w6djPeE+Xn7QHQyJPlW0f59ojEOnOVlpYdOve4B10OZFEEbE5FDlcc6uD9BobGHfqZrTmc= ceph-f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:53:45.195 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCDVhqpeWDweskQWFfPdd7kfWRztdWUDq6fkxwwAeQ2SrlAgvU/WtRXgLn5YbGe2QoLH2tYhZBqZBimt/q7sqgAfNzWA6do4HEBxvZNrLUsvo8yAgZj6Z70KgFFKh764kktwo0jMbMMR9tXVlIiQ1TVwjgBikk6O5pVNIT8Nnbphczap4C9a9Z6wkSDw/Rq4Q8HfQe8+2/6JPSTc5JQy0I4M0CZU2M3RMJktodqx7d+WEAgEsJmR+JQryt00Igp4LIEc7DbleoZDqeOzPF+beTGYHDQtutxEo1FvX4hO4M0QBPtLXwmx7u34uJkokHGBwUDdW2B9JsU3sO1RozMRPvGuvSeNdJLqZea8UtryDwh7chsszH+u+LIC8mG6qphdQQiXaVc+eJ3EgbZG81zyCT32EGTNj1XwCYsBbct6O5W/nGZbYeYNy7LEY1/3w6djPeE+Xn7QHQyJPlW0f59ojEOnOVlpYdOve4B10OZFEEbE5FDlcc6uD9BobGHfqZrTmc= ceph-f8e82564-748e-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T00:53:45.253 INFO:teuthology.orchestra.run.smithi099.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCDVhqpeWDweskQWFfPdd7kfWRztdWUDq6fkxwwAeQ2SrlAgvU/WtRXgLn5YbGe2QoLH2tYhZBqZBimt/q7sqgAfNzWA6do4HEBxvZNrLUsvo8yAgZj6Z70KgFFKh764kktwo0jMbMMR9tXVlIiQ1TVwjgBikk6O5pVNIT8Nnbphczap4C9a9Z6wkSDw/Rq4Q8HfQe8+2/6JPSTc5JQy0I4M0CZU2M3RMJktodqx7d+WEAgEsJmR+JQryt00Igp4LIEc7DbleoZDqeOzPF+beTGYHDQtutxEo1FvX4hO4M0QBPtLXwmx7u34uJkokHGBwUDdW2B9JsU3sO1RozMRPvGuvSeNdJLqZea8UtryDwh7chsszH+u+LIC8mG6qphdQQiXaVc+eJ3EgbZG81zyCT32EGTNj1XwCYsBbct6O5W/nGZbYeYNy7LEY1/3w6djPeE+Xn7QHQyJPlW0f59ojEOnOVlpYdOve4B10OZFEEbE5FDlcc6uD9BobGHfqZrTmc= ceph-f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:53:45.266 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-17T00:53:45.519 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:53:45.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:45 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2608406833' entity='client.admin' 2024-09-17T00:53:48.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.040+0000 7f5edd6e5640 1 -- 172.21.15.2:0/1109115763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed80fc1b0 msgr2=0x7f5ed80fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:48.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.040+0000 7f5edd6e5640 1 --2- 172.21.15.2:0/1109115763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed80fc1b0 0x7f5ed80fc5c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8004850 tx=0x7f5ec8009da0 comp rx=0 tx=0).stop 2024-09-17T00:53:48.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.041+0000 7f5edd6e5640 1 -- 172.21.15.2:0/1109115763 shutdown_connections 2024-09-17T00:53:48.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.041+0000 7f5edd6e5640 1 --2- 172.21.15.2:0/1109115763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed80fc1b0 0x7f5ed80fc5c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:48.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.041+0000 7f5edd6e5640 1 -- 172.21.15.2:0/1109115763 >> 172.21.15.2:0/1109115763 conn(0x7f5ed80f7990 msgr2=0x7f5ed80f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:48.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.041+0000 7f5edd6e5640 1 -- 172.21.15.2:0/1109115763 shutdown_connections 2024-09-17T00:53:48.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.042+0000 7f5edd6e5640 1 -- 172.21.15.2:0/1109115763 wait complete. 2024-09-17T00:53:48.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.042+0000 7f5edd6e5640 1 Processor -- start 2024-09-17T00:53:48.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.043+0000 7f5edd6e5640 1 -- start start 2024-09-17T00:53:48.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.043+0000 7f5edd6e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed80fc1b0 0x7f5ed810c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:48.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.043+0000 7f5edd6e5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed810cc30 con 0x7f5ed80fc1b0 2024-09-17T00:53:48.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.043+0000 7f5ed6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed80fc1b0 0x7f5ed810c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:48.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.043+0000 7f5ed6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed80fc1b0 0x7f5ed810c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49246/0 (socket says 172.21.15.2:49246) 2024-09-17T00:53:48.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.043+0000 7f5ed6ffd640 1 -- 172.21.15.2:0/913751077 learned_addr learned my addr 172.21.15.2:0/913751077 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:48.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.043+0000 7f5ed6ffd640 1 -- 172.21.15.2:0/913751077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec8005040 con 0x7f5ed80fc1b0 2024-09-17T00:53:48.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.043+0000 7f5ed6ffd640 1 --2- 172.21.15.2:0/913751077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed80fc1b0 0x7f5ed810c6f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5ec802a6d0 tx=0x7f5ec8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:48.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.044+0000 7f5ebf7fe640 1 -- 172.21.15.2:0/913751077 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ec8033630 con 0x7f5ed80fc1b0 2024-09-17T00:53:48.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.044+0000 7f5edd6e5640 1 -- 172.21.15.2:0/913751077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed810ce30 con 0x7f5ed80fc1b0 2024-09-17T00:53:48.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.044+0000 7f5edd6e5640 1 -- 172.21.15.2:0/913751077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed810d2a0 con 0x7f5ed80fc1b0 2024-09-17T00:53:48.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.044+0000 7f5ebf7fe640 1 -- 172.21.15.2:0/913751077 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5ec8033c30 con 0x7f5ed80fc1b0 2024-09-17T00:53:48.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.045+0000 7f5ebf7fe640 1 -- 172.21.15.2:0/913751077 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ec803dc00 con 0x7f5ed80fc1b0 2024-09-17T00:53:48.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.045+0000 7f5ebf7fe640 1 -- 172.21.15.2:0/913751077 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45562+0+0 (secure 0 0 0) 0x7f5ec8030020 con 0x7f5ed80fc1b0 2024-09-17T00:53:48.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.045+0000 7f5edd6e5640 1 -- 172.21.15.2:0/913751077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed805ed70 con 0x7f5ed80fc1b0 2024-09-17T00:53:48.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.045+0000 7f5ebf7fe640 1 --2- 172.21.15.2:0/913751077 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f5ec0039620 0x7f5ec003bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:48.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.045+0000 7f5ebf7fe640 1 -- 172.21.15.2:0/913751077 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5ec8033da0 con 0x7f5ed80fc1b0 2024-09-17T00:53:48.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.045+0000 7f5ed67fc640 1 --2- 172.21.15.2:0/913751077 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f5ec0039620 0x7f5ec003bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:48.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.046+0000 7f5ed67fc640 1 --2- 172.21.15.2:0/913751077 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f5ec0039620 0x7f5ec003bad0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc006fd0 tx=0x7f5ecc006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:48.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.050+0000 7f5ebf7fe640 1 -- 172.21.15.2:0/913751077 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5ec803bb50 con 0x7f5ed80fc1b0 2024-09-17T00:53:48.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.228+0000 7f5edd6e5640 1 -- 172.21.15.2:0/913751077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f5ed810d2a0 con 0x7f5ed80fc1b0 2024-09-17T00:53:48.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.231+0000 7f5ebf7fe640 1 -- 172.21.15.2:0/913751077 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f5ec803b370 con 0x7f5ed80fc1b0 2024-09-17T00:53:48.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.233+0000 7f5edd6e5640 1 -- 172.21.15.2:0/913751077 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f5ec0039620 msgr2=0x7f5ec003bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:48.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.233+0000 7f5edd6e5640 1 --2- 172.21.15.2:0/913751077 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f5ec0039620 0x7f5ec003bad0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc006fd0 tx=0x7f5ecc006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:48.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.233+0000 7f5edd6e5640 1 -- 172.21.15.2:0/913751077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed80fc1b0 msgr2=0x7f5ed810c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:48.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.233+0000 7f5edd6e5640 1 --2- 172.21.15.2:0/913751077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed80fc1b0 0x7f5ed810c6f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5ec802a6d0 tx=0x7f5ec8009da0 comp rx=0 tx=0).stop 2024-09-17T00:53:48.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.233+0000 7f5edd6e5640 1 -- 172.21.15.2:0/913751077 shutdown_connections 2024-09-17T00:53:48.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.233+0000 7f5edd6e5640 1 --2- 172.21.15.2:0/913751077 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f5ec0039620 0x7f5ec003bad0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:48.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.233+0000 7f5edd6e5640 1 --2- 172.21.15.2:0/913751077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed80fc1b0 0x7f5ed810c6f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:48.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.233+0000 7f5edd6e5640 1 -- 172.21.15.2:0/913751077 >> 172.21.15.2:0/913751077 conn(0x7f5ed80f7990 msgr2=0x7f5ed80f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:48.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.233+0000 7f5edd6e5640 1 -- 172.21.15.2:0/913751077 shutdown_connections 2024-09-17T00:53:48.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:48.234+0000 7f5edd6e5640 1 -- 172.21.15.2:0/913751077 wait complete. 2024-09-17T00:53:48.918 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-17T00:53:48.919 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-17T00:53:49.461 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:49 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/913751077' entity='client.admin' 2024-09-17T00:53:49.507 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:53:50.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:50 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:50.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:50 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:50.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:50 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:53:50.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:50 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:50.780 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:50 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T00:53:50.780 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:50 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-17T00:53:50.780 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:50 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:53:50.780 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:50 smithi002 ceph-mon[27650]: Deploying daemon crash.smithi002 on smithi002 2024-09-17T00:53:51.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.594+0000 7f65b3882640 1 -- 172.21.15.2:0/2953486839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac0715d0 msgr2=0x7f65ac06fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:51.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.594+0000 7f65b3882640 1 --2- 172.21.15.2:0/2953486839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac0715d0 0x7f65ac06fb00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f65a8004850 tx=0x7f65a8009da0 comp rx=0 tx=0).stop 2024-09-17T00:53:51.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.594+0000 7f65b3882640 1 -- 172.21.15.2:0/2953486839 shutdown_connections 2024-09-17T00:53:51.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.594+0000 7f65b3882640 1 --2- 172.21.15.2:0/2953486839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac0715d0 0x7f65ac06fb00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:51.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.594+0000 7f65b3882640 1 -- 172.21.15.2:0/2953486839 >> 172.21.15.2:0/2953486839 conn(0x7f65ac0f79b0 msgr2=0x7f65ac0f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:51.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.594+0000 7f65b3882640 1 -- 172.21.15.2:0/2953486839 shutdown_connections 2024-09-17T00:53:51.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.594+0000 7f65b3882640 1 -- 172.21.15.2:0/2953486839 wait complete. 2024-09-17T00:53:51.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.594+0000 7f65b3882640 1 Processor -- start 2024-09-17T00:53:51.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.594+0000 7f65b3882640 1 -- start start 2024-09-17T00:53:51.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.595+0000 7f65b3882640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac0715d0 0x7f65ac112d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:51.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.595+0000 7f65b3882640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac113250 con 0x7f65ac0715d0 2024-09-17T00:53:51.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.595+0000 7f65b161e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac0715d0 0x7f65ac112d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:51.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.595+0000 7f65b161e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac0715d0 0x7f65ac112d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56392/0 (socket says 172.21.15.2:56392) 2024-09-17T00:53:51.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.595+0000 7f65b161e640 1 -- 172.21.15.2:0/2726717303 learned_addr learned my addr 172.21.15.2:0/2726717303 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:51.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.595+0000 7f65b161e640 1 -- 172.21.15.2:0/2726717303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a8005040 con 0x7f65ac0715d0 2024-09-17T00:53:51.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.595+0000 7f65b161e640 1 --2- 172.21.15.2:0/2726717303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac0715d0 0x7f65ac112d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f65a802a6d0 tx=0x7f65a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:51.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.596+0000 7f65a1ffb640 1 -- 172.21.15.2:0/2726717303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65a8033630 con 0x7f65ac0715d0 2024-09-17T00:53:51.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.596+0000 7f65a1ffb640 1 -- 172.21.15.2:0/2726717303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f65a8033c30 con 0x7f65ac0715d0 2024-09-17T00:53:51.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.596+0000 7f65b3882640 1 -- 172.21.15.2:0/2726717303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac113450 con 0x7f65ac0715d0 2024-09-17T00:53:51.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.596+0000 7f65a1ffb640 1 -- 172.21.15.2:0/2726717303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65a803dc30 con 0x7f65ac0715d0 2024-09-17T00:53:51.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.596+0000 7f65b3882640 1 -- 172.21.15.2:0/2726717303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac1138c0 con 0x7f65ac0715d0 2024-09-17T00:53:51.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.597+0000 7f65a1ffb640 1 -- 172.21.15.2:0/2726717303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45562+0+0 (secure 0 0 0) 0x7f65a8030020 con 0x7f65ac0715d0 2024-09-17T00:53:51.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.597+0000 7f65b3882640 1 -- 172.21.15.2:0/2726717303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ac05ed70 con 0x7f65ac0715d0 2024-09-17T00:53:51.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.597+0000 7f65a1ffb640 1 --2- 172.21.15.2:0/2726717303 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f6598039620 0x7f659803bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:51.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.597+0000 7f65a1ffb640 1 -- 172.21.15.2:0/2726717303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f65a806c890 con 0x7f65ac0715d0 2024-09-17T00:53:51.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.597+0000 7f65b0e1d640 1 --2- 172.21.15.2:0/2726717303 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f6598039620 0x7f659803bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:51.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.598+0000 7f65b0e1d640 1 --2- 172.21.15.2:0/2726717303 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f6598039620 0x7f659803bad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f659c006fd0 tx=0x7f659c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:51.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.602+0000 7f65a1ffb640 1 -- 172.21.15.2:0/2726717303 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f65a8045db0 con 0x7f65ac0715d0 2024-09-17T00:53:51.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.772+0000 7f65b3882640 1 -- 172.21.15.2:0/2726717303 --> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f65ac1138c0 con 0x7f6598039620 2024-09-17T00:53:51.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.775+0000 7f65a1ffb640 1 -- 172.21.15.2:0/2726717303 <== mgr.14160 v2:172.21.15.2:6800/2191872617 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f65ac1138c0 con 0x7f6598039620 2024-09-17T00:53:51.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.778+0000 7f65b3882640 1 -- 172.21.15.2:0/2726717303 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f6598039620 msgr2=0x7f659803bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:51.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.778+0000 7f65b3882640 1 --2- 172.21.15.2:0/2726717303 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f6598039620 0x7f659803bad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f659c006fd0 tx=0x7f659c006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:51.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.778+0000 7f65b3882640 1 -- 172.21.15.2:0/2726717303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac0715d0 msgr2=0x7f65ac112d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:51.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.778+0000 7f65b3882640 1 --2- 172.21.15.2:0/2726717303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac0715d0 0x7f65ac112d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f65a802a6d0 tx=0x7f65a8009da0 comp rx=0 tx=0).stop 2024-09-17T00:53:51.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.778+0000 7f65b3882640 1 -- 172.21.15.2:0/2726717303 shutdown_connections 2024-09-17T00:53:51.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.778+0000 7f65b3882640 1 --2- 172.21.15.2:0/2726717303 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f6598039620 0x7f659803bad0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:51.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.778+0000 7f65b3882640 1 --2- 172.21.15.2:0/2726717303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65ac0715d0 0x7f65ac112d10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:51.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.778+0000 7f65b3882640 1 -- 172.21.15.2:0/2726717303 >> 172.21.15.2:0/2726717303 conn(0x7f65ac0f79b0 msgr2=0x7f65ac0f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:51.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.778+0000 7f65b3882640 1 -- 172.21.15.2:0/2726717303 shutdown_connections 2024-09-17T00:53:51.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:51.778+0000 7f65b3882640 1 -- 172.21.15.2:0/2726717303 wait complete. 2024-09-17T00:53:52.878 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi099 2024-09-17T00:53:52.878 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T00:53:52.878 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/etc/ceph/ceph.conf 2024-09-17T00:53:52.898 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T00:53:52.898 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:53:52.957 INFO:tasks.cephadm:Adding host smithi099 to orchestrator... 2024-09-17T00:53:52.957 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph orch host add smithi099 2024-09-17T00:53:53.046 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:52 smithi002 ceph-mon[27650]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:53.046 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:52 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:53.427 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:53:54.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:54 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:54.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:54 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:54.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:54 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:54.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:54 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:54.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:54 smithi002 ceph-mon[27650]: Deploying daemon node-exporter.smithi002 on smithi002 2024-09-17T00:53:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.012+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3270582998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd88066140 msgr2=0x7fbd880fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.012+0000 7fbd8deb3640 1 --2- 172.21.15.2:0/3270582998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd88066140 0x7fbd880fee40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd78004850 tx=0x7fbd78009da0 comp rx=0 tx=0).stop 2024-09-17T00:53:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.012+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3270582998 shutdown_connections 2024-09-17T00:53:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.012+0000 7fbd8deb3640 1 --2- 172.21.15.2:0/3270582998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd88066140 0x7fbd880fee40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.012+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3270582998 >> 172.21.15.2:0/3270582998 conn(0x7fbd880f6890 msgr2=0x7fbd880f8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.012+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3270582998 shutdown_connections 2024-09-17T00:53:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.013+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3270582998 wait complete. 2024-09-17T00:53:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.013+0000 7fbd8deb3640 1 Processor -- start 2024-09-17T00:53:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.013+0000 7fbd8deb3640 1 -- start start 2024-09-17T00:53:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.013+0000 7fbd8deb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd88066140 0x7fbd880fc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.013+0000 7fbd8deb3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd880fccb0 con 0x7fbd88066140 2024-09-17T00:53:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.014+0000 7fbd877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd88066140 0x7fbd880fc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.014+0000 7fbd877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd88066140 0x7fbd880fc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56422/0 (socket says 172.21.15.2:56422) 2024-09-17T00:53:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.014+0000 7fbd877fe640 1 -- 172.21.15.2:0/3093667571 learned_addr learned my addr 172.21.15.2:0/3093667571 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:53:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.014+0000 7fbd877fe640 1 -- 172.21.15.2:0/3093667571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd78005040 con 0x7fbd88066140 2024-09-17T00:53:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.014+0000 7fbd877fe640 1 --2- 172.21.15.2:0/3093667571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd88066140 0x7fbd880fc770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd780041d0 tx=0x7fbd78009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.014+0000 7fbd6ffff640 1 -- 172.21.15.2:0/3093667571 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd78007a20 con 0x7fbd88066140 2024-09-17T00:53:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.014+0000 7fbd6ffff640 1 -- 172.21.15.2:0/3093667571 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbd780328e0 con 0x7fbd88066140 2024-09-17T00:53:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.014+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3093667571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd880fad40 con 0x7fbd88066140 2024-09-17T00:53:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.014+0000 7fbd6ffff640 1 -- 172.21.15.2:0/3093667571 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd780339f0 con 0x7fbd88066140 2024-09-17T00:53:55.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.014+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3093667571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd880fb0d0 con 0x7fbd88066140 2024-09-17T00:53:55.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.015+0000 7fbd6ffff640 1 -- 172.21.15.2:0/3093667571 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45562+0+0 (secure 0 0 0) 0x7fbd78030020 con 0x7fbd88066140 2024-09-17T00:53:55.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.015+0000 7fbd6ffff640 1 --2- 172.21.15.2:0/3093667571 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fbd700395d0 0x7fbd7003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:53:55.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.015+0000 7fbd6ffff640 1 -- 172.21.15.2:0/3093667571 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbd7806c140 con 0x7fbd88066140 2024-09-17T00:53:55.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.015+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3093667571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8805ed70 con 0x7fbd88066140 2024-09-17T00:53:55.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.015+0000 7fbd86ffd640 1 --2- 172.21.15.2:0/3093667571 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fbd700395d0 0x7fbd7003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:53:55.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.016+0000 7fbd86ffd640 1 --2- 172.21.15.2:0/3093667571 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fbd700395d0 0x7fbd7003ba80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c006fd0 tx=0x7fbd7c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:53:55.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.020+0000 7fbd6ffff640 1 -- 172.21.15.2:0/3093667571 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbd7803cc90 con 0x7fbd88066140 2024-09-17T00:53:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:55.188+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3093667571 --> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi099", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd88101f40 con 0x7fbd700395d0 2024-09-17T00:53:56.973 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:56 smithi002 ceph-mon[27650]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi099", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:53:56.973 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:56 smithi002 ceph-mon[27650]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:56.974 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:56 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:57.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:57 smithi002 ceph-mon[27650]: Deploying cephadm binary to smithi099 2024-09-17T00:53:57.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:57 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:57.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:57 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:57.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:57 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:57.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:57 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:58.617 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi099' with addr '172.21.15.99' 2024-09-17T00:53:58.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:58.619+0000 7fbd6ffff640 1 -- 172.21.15.2:0/3093667571 <== mgr.14160 v2:172.21.15.2:6800/2191872617 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fbd88101f40 con 0x7fbd700395d0 2024-09-17T00:53:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:58.621+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3093667571 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fbd700395d0 msgr2=0x7fbd7003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:58.621+0000 7fbd8deb3640 1 --2- 172.21.15.2:0/3093667571 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fbd700395d0 0x7fbd7003ba80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c006fd0 tx=0x7fbd7c006db0 comp rx=0 tx=0).stop 2024-09-17T00:53:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:58.621+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3093667571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd88066140 msgr2=0x7fbd880fc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:53:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:58.621+0000 7fbd8deb3640 1 --2- 172.21.15.2:0/3093667571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd88066140 0x7fbd880fc770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd780041d0 tx=0x7fbd78009da0 comp rx=0 tx=0).stop 2024-09-17T00:53:58.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:58.621+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3093667571 shutdown_connections 2024-09-17T00:53:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:58.621+0000 7fbd8deb3640 1 --2- 172.21.15.2:0/3093667571 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fbd700395d0 0x7fbd7003ba80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:58.621+0000 7fbd8deb3640 1 --2- 172.21.15.2:0/3093667571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd88066140 0x7fbd880fc770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:53:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:58.621+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3093667571 >> 172.21.15.2:0/3093667571 conn(0x7fbd880f6890 msgr2=0x7fbd880f7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:53:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:58.621+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3093667571 shutdown_connections 2024-09-17T00:53:58.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:53:58.621+0000 7fbd8deb3640 1 -- 172.21.15.2:0/3093667571 wait complete. 2024-09-17T00:53:58.886 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:58 smithi002 ceph-mon[27650]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:53:58.887 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:58 smithi002 ceph-mon[27650]: Deploying daemon alertmanager.smithi002 on smithi002 2024-09-17T00:53:58.887 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:58 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:53:59.715 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-17T00:53:59.949 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:53:59 smithi002 ceph-mon[27650]: Added host smithi099 2024-09-17T00:53:59.988 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:54:00.770 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:00 smithi002 ceph-mon[27650]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:00.770 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:00 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:02.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.851+0000 7facbf093640 1 -- 172.21.15.2:0/4061567277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facb80fd8e0 msgr2=0x7facb80fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:02.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.851+0000 7facbf093640 1 --2- 172.21.15.2:0/4061567277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facb80fd8e0 0x7facb80fdcf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faca0004850 tx=0x7faca0009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:02.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.851+0000 7facbf093640 1 -- 172.21.15.2:0/4061567277 shutdown_connections 2024-09-17T00:54:02.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.851+0000 7facbf093640 1 --2- 172.21.15.2:0/4061567277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facb80fd8e0 0x7facb80fdcf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:02.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.851+0000 7facbf093640 1 -- 172.21.15.2:0/4061567277 >> 172.21.15.2:0/4061567277 conn(0x7facb80f6040 msgr2=0x7facb80f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:02.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.852+0000 7facbf093640 1 -- 172.21.15.2:0/4061567277 shutdown_connections 2024-09-17T00:54:02.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.852+0000 7facbf093640 1 -- 172.21.15.2:0/4061567277 wait complete. 2024-09-17T00:54:02.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.852+0000 7facbf093640 1 Processor -- start 2024-09-17T00:54:02.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.852+0000 7facbf093640 1 -- start start 2024-09-17T00:54:02.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.852+0000 7facbf093640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facb80fd8e0 0x7facb810c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:02.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.852+0000 7facbf093640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb810cc70 con 0x7facb80fd8e0 2024-09-17T00:54:02.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.853+0000 7facbce2f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facb80fd8e0 0x7facb810c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:02.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.853+0000 7facbce2f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facb80fd8e0 0x7facb810c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36580/0 (socket says 172.21.15.2:36580) 2024-09-17T00:54:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.853+0000 7facbce2f640 1 -- 172.21.15.2:0/284874361 learned_addr learned my addr 172.21.15.2:0/284874361 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:54:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.853+0000 7facbce2f640 1 -- 172.21.15.2:0/284874361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca0005040 con 0x7facb80fd8e0 2024-09-17T00:54:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.853+0000 7facbce2f640 1 --2- 172.21.15.2:0/284874361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facb80fd8e0 0x7facb810c730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faca002a6d0 tx=0x7faca0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.853+0000 7facb57fa640 1 -- 172.21.15.2:0/284874361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faca0033630 con 0x7facb80fd8e0 2024-09-17T00:54:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.853+0000 7facbf093640 1 -- 172.21.15.2:0/284874361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb810ce70 con 0x7facb80fd8e0 2024-09-17T00:54:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.853+0000 7facb57fa640 1 -- 172.21.15.2:0/284874361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faca0033c30 con 0x7facb80fd8e0 2024-09-17T00:54:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.853+0000 7facb57fa640 1 -- 172.21.15.2:0/284874361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faca003dc00 con 0x7facb80fd8e0 2024-09-17T00:54:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.853+0000 7facbf093640 1 -- 172.21.15.2:0/284874361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb810d2e0 con 0x7facb80fd8e0 2024-09-17T00:54:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.854+0000 7facb57fa640 1 -- 172.21.15.2:0/284874361 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45562+0+0 (secure 0 0 0) 0x7faca0030020 con 0x7facb80fd8e0 2024-09-17T00:54:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.854+0000 7facbf093640 1 -- 172.21.15.2:0/284874361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb805ed70 con 0x7facb80fd8e0 2024-09-17T00:54:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.854+0000 7facb57fa640 1 --2- 172.21.15.2:0/284874361 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7faca4039580 0x7faca403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.854+0000 7facb57fa640 1 -- 172.21.15.2:0/284874361 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7faca006c8c0 con 0x7facb80fd8e0 2024-09-17T00:54:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.855+0000 7facb7fff640 1 --2- 172.21.15.2:0/284874361 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7faca4039580 0x7faca403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:02.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.855+0000 7facb7fff640 1 --2- 172.21.15.2:0/284874361 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7faca4039580 0x7faca403ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faca8006fd0 tx=0x7faca8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:02.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:02.859+0000 7facb57fa640 1 -- 172.21.15.2:0/284874361 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7faca0033790 con 0x7facb80fd8e0 2024-09-17T00:54:03.010 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:02 smithi002 ceph-mon[27650]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:03.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:03.035+0000 7facbf093640 1 -- 172.21.15.2:0/284874361 --> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7facb810d2e0 con 0x7faca4039580 2024-09-17T00:54:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:03.036+0000 7facb57fa640 1 -- 172.21.15.2:0/284874361 <== mgr.14160 v2:172.21.15.2:6800/2191872617 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+158 (secure 0 0 0) 0x7facb810d2e0 con 0x7faca4039580 2024-09-17T00:54:03.037 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:54:03.037 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.99", "hostname": "smithi099", "labels": [], "status": ""}] 2024-09-17T00:54:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:03.038+0000 7facbf093640 1 -- 172.21.15.2:0/284874361 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7faca4039580 msgr2=0x7faca403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:03.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:03.038+0000 7facbf093640 1 --2- 172.21.15.2:0/284874361 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7faca4039580 0x7faca403ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faca8006fd0 tx=0x7faca8006db0 comp rx=0 tx=0).stop 2024-09-17T00:54:03.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:03.038+0000 7facbf093640 1 -- 172.21.15.2:0/284874361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facb80fd8e0 msgr2=0x7facb810c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:03.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:03.038+0000 7facbf093640 1 --2- 172.21.15.2:0/284874361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facb80fd8e0 0x7facb810c730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faca002a6d0 tx=0x7faca0009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:03.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:03.038+0000 7facbf093640 1 -- 172.21.15.2:0/284874361 shutdown_connections 2024-09-17T00:54:03.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:03.038+0000 7facbf093640 1 --2- 172.21.15.2:0/284874361 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7faca4039580 0x7faca403ba30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:03.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:03.038+0000 7facbf093640 1 --2- 172.21.15.2:0/284874361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facb80fd8e0 0x7facb810c730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:03.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:03.038+0000 7facbf093640 1 -- 172.21.15.2:0/284874361 >> 172.21.15.2:0/284874361 conn(0x7facb80f6040 msgr2=0x7facb80f6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:03.038+0000 7facbf093640 1 -- 172.21.15.2:0/284874361 shutdown_connections 2024-09-17T00:54:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:03.038+0000 7facbf093640 1 -- 172.21.15.2:0/284874361 wait complete. 2024-09-17T00:54:03.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:03 smithi002 ceph-mon[27650]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T00:54:04.681 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-17T00:54:04.681 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-17T00:54:04.952 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:04 smithi002 ceph-mon[27650]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:06.087 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:54:06.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:06 smithi002 ceph-mon[27650]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:08.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.226+0000 7febbb312640 1 -- 172.21.15.2:0/2432124216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb40fd7f0 msgr2=0x7febb40fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:08.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.226+0000 7febbb312640 1 --2- 172.21.15.2:0/2432124216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb40fd7f0 0x7febb40fdc00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7febb0004850 tx=0x7febb0009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:08.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.226+0000 7febbb312640 1 -- 172.21.15.2:0/2432124216 shutdown_connections 2024-09-17T00:54:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.226+0000 7febbb312640 1 --2- 172.21.15.2:0/2432124216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb40fd7f0 0x7febb40fdc00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.226+0000 7febbb312640 1 -- 172.21.15.2:0/2432124216 >> 172.21.15.2:0/2432124216 conn(0x7febb40f6010 msgr2=0x7febb40f8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.227+0000 7febbb312640 1 -- 172.21.15.2:0/2432124216 shutdown_connections 2024-09-17T00:54:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.227+0000 7febbb312640 1 -- 172.21.15.2:0/2432124216 wait complete. 2024-09-17T00:54:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.227+0000 7febbb312640 1 Processor -- start 2024-09-17T00:54:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.227+0000 7febbb312640 1 -- start start 2024-09-17T00:54:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.227+0000 7febbb312640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb40fd7f0 0x7febb410c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.227+0000 7febbb312640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb410cc70 con 0x7febb40fd7f0 2024-09-17T00:54:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.227+0000 7febb90ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb40fd7f0 0x7febb410c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.227+0000 7febb90ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb40fd7f0 0x7febb410c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36596/0 (socket says 172.21.15.2:36596) 2024-09-17T00:54:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.227+0000 7febb90ae640 1 -- 172.21.15.2:0/3349613504 learned_addr learned my addr 172.21.15.2:0/3349613504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:54:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.228+0000 7febb90ae640 1 -- 172.21.15.2:0/3349613504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb0005040 con 0x7febb40fd7f0 2024-09-17T00:54:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.228+0000 7febb90ae640 1 --2- 172.21.15.2:0/3349613504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb40fd7f0 0x7febb410c730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7febb0009920 tx=0x7febb0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.228+0000 7feba9ffb640 1 -- 172.21.15.2:0/3349613504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febb0033630 con 0x7febb40fd7f0 2024-09-17T00:54:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.228+0000 7febbb312640 1 -- 172.21.15.2:0/3349613504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb410ce70 con 0x7febb40fd7f0 2024-09-17T00:54:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.228+0000 7feba9ffb640 1 -- 172.21.15.2:0/3349613504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7febb0033c30 con 0x7febb40fd7f0 2024-09-17T00:54:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.228+0000 7feba9ffb640 1 -- 172.21.15.2:0/3349613504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7febb003dc40 con 0x7febb40fd7f0 2024-09-17T00:54:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.228+0000 7febbb312640 1 -- 172.21.15.2:0/3349613504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb410d2e0 con 0x7febb40fd7f0 2024-09-17T00:54:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.229+0000 7feba9ffb640 1 -- 172.21.15.2:0/3349613504 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45562+0+0 (secure 0 0 0) 0x7febb0030020 con 0x7febb40fd7f0 2024-09-17T00:54:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.229+0000 7febbb312640 1 -- 172.21.15.2:0/3349613504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb405ed70 con 0x7febb40fd7f0 2024-09-17T00:54:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.230+0000 7feba9ffb640 1 --2- 172.21.15.2:0/3349613504 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7feba0039580 0x7feba003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.230+0000 7feba9ffb640 1 -- 172.21.15.2:0/3349613504 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7febb006ca20 con 0x7febb40fd7f0 2024-09-17T00:54:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.230+0000 7febb88ad640 1 --2- 172.21.15.2:0/3349613504 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7feba0039580 0x7feba003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.230+0000 7febb88ad640 1 --2- 172.21.15.2:0/3349613504 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7feba0039580 0x7feba003ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feba4006fd0 tx=0x7feba4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.234+0000 7feba9ffb640 1 -- 172.21.15.2:0/3349613504 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7febb003b930 con 0x7febb40fd7f0 2024-09-17T00:54:08.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:08.404+0000 7febbb312640 1 -- 172.21.15.2:0/3349613504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7febb404b720 con 0x7febb40fd7f0 2024-09-17T00:54:09.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:09.151+0000 7feba9ffb640 1 -- 172.21.15.2:0/3349613504 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7febb003b370 con 0x7febb40fd7f0 2024-09-17T00:54:09.149 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-09-17T00:54:09.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:09.153+0000 7febbb312640 1 -- 172.21.15.2:0/3349613504 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7feba0039580 msgr2=0x7feba003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:09.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:09.153+0000 7febbb312640 1 --2- 172.21.15.2:0/3349613504 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7feba0039580 0x7feba003ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feba4006fd0 tx=0x7feba4006db0 comp rx=0 tx=0).stop 2024-09-17T00:54:09.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:09.153+0000 7febbb312640 1 -- 172.21.15.2:0/3349613504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb40fd7f0 msgr2=0x7febb410c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:09.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:09.153+0000 7febbb312640 1 --2- 172.21.15.2:0/3349613504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb40fd7f0 0x7febb410c730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7febb0009920 tx=0x7febb0009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:09.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:09.153+0000 7febbb312640 1 -- 172.21.15.2:0/3349613504 shutdown_connections 2024-09-17T00:54:09.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:09.153+0000 7febbb312640 1 --2- 172.21.15.2:0/3349613504 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7feba0039580 0x7feba003ba30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:09.153+0000 7febbb312640 1 --2- 172.21.15.2:0/3349613504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febb40fd7f0 0x7febb410c730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:09.153+0000 7febbb312640 1 -- 172.21.15.2:0/3349613504 >> 172.21.15.2:0/3349613504 conn(0x7febb40f6010 msgr2=0x7febb40f6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:09.153+0000 7febbb312640 1 -- 172.21.15.2:0/3349613504 shutdown_connections 2024-09-17T00:54:09.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:54:09.153+0000 7febbb312640 1 -- 172.21.15.2:0/3349613504 wait complete. 2024-09-17T00:54:09.403 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:09 smithi002 ceph-mon[27650]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:09.403 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:09 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:09.403 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:09 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:09.403 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:09 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:09.403 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:09 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:09.403 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:09 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:09.403 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:09 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:09.403 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:09 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T00:54:09.403 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:09 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:09.403 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:09 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3349613504' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-17T00:54:10.063 INFO:tasks.cephadm:Adding mon.smithi002 on smithi002 2024-09-17T00:54:10.064 INFO:tasks.cephadm:Adding mon.smithi099 on smithi099 2024-09-17T00:54:10.064 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi002:172.21.15.2=smithi002;smithi099:172.21.15.99=smithi099' 2024-09-17T00:54:10.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:10 smithi002 ceph-mon[27650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T00:54:10.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:10 smithi002 ceph-mon[27650]: Deploying daemon grafana.smithi002 on smithi002 2024-09-17T00:54:10.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:10 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3349613504' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T00:54:10.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:10 smithi002 ceph-mon[27650]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T00:54:10.413 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:10.460 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:11.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:11 smithi002 ceph-mon[27650]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:11.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:11 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:11.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.994+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3796164042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5440fc1d0 msgr2=0x7fc5440fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.994+0000 7fc54bdc2640 1 --2- 172.21.15.99:0/3796164042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5440fc1d0 0x7fc5440fc5e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc540004850 tx=0x7fc540009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.994+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3796164042 shutdown_connections 2024-09-17T00:54:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.994+0000 7fc54bdc2640 1 --2- 172.21.15.99:0/3796164042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5440fc1d0 0x7fc5440fc5e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.994+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3796164042 >> 172.21.15.99:0/3796164042 conn(0x7fc5440f79b0 msgr2=0x7fc5440f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.995+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3796164042 shutdown_connections 2024-09-17T00:54:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.995+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3796164042 wait complete. 2024-09-17T00:54:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.995+0000 7fc54bdc2640 1 Processor -- start 2024-09-17T00:54:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.995+0000 7fc54bdc2640 1 -- start start 2024-09-17T00:54:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.995+0000 7fc54bdc2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5440fc1d0 0x7fc544071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.995+0000 7fc54bdc2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440719d0 con 0x7fc5440fc1d0 2024-09-17T00:54:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.995+0000 7fc549b5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5440fc1d0 0x7fc544071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.995+0000 7fc549b5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5440fc1d0 0x7fc544071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.99:42860/0 (socket says 172.21.15.99:42860) 2024-09-17T00:54:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.995+0000 7fc549b5e640 1 -- 172.21.15.99:0/3327309039 learned_addr learned my addr 172.21.15.99:0/3327309039 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:54:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.996+0000 7fc549b5e640 1 -- 172.21.15.99:0/3327309039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc540005040 con 0x7fc5440fc1d0 2024-09-17T00:54:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.996+0000 7fc549b5e640 1 --2- 172.21.15.99:0/3327309039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5440fc1d0 0x7fc544071490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc54002a6d0 tx=0x7fc540009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.996+0000 7fc53a7fc640 1 -- 172.21.15.99:0/3327309039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc540033630 con 0x7fc5440fc1d0 2024-09-17T00:54:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.996+0000 7fc53a7fc640 1 -- 172.21.15.99:0/3327309039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc540033c30 con 0x7fc5440fc1d0 2024-09-17T00:54:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.996+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3327309039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54406fa60 con 0x7fc5440fc1d0 2024-09-17T00:54:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.996+0000 7fc53a7fc640 1 -- 172.21.15.99:0/3327309039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc54003dc00 con 0x7fc5440fc1d0 2024-09-17T00:54:11.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.996+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3327309039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54406fed0 con 0x7fc5440fc1d0 2024-09-17T00:54:11.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.997+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3327309039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5441025f0 con 0x7fc5440fc1d0 2024-09-17T00:54:11.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.997+0000 7fc53a7fc640 1 -- 172.21.15.99:0/3327309039 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45562+0+0 (secure 0 0 0) 0x7fc540030020 con 0x7fc5440fc1d0 2024-09-17T00:54:11.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.997+0000 7fc53a7fc640 1 --2- 172.21.15.99:0/3327309039 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fc530039580 0x7fc53003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:11.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.997+0000 7fc53a7fc640 1 -- 172.21.15.99:0/3327309039 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc54006caa0 con 0x7fc5440fc1d0 2024-09-17T00:54:11.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.997+0000 7fc54935d640 1 --2- 172.21.15.99:0/3327309039 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fc530039580 0x7fc53003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:11.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:11.998+0000 7fc54935d640 1 --2- 172.21.15.99:0/3327309039 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fc530039580 0x7fc53003ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc534006fd0 tx=0x7fc534006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:12.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:12.004+0000 7fc53a7fc640 1 -- 172.21.15.99:0/3327309039 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc540045800 con 0x7fc5440fc1d0 2024-09-17T00:54:12.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:12.165+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3327309039 --> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi002:172.21.15.2=smithi002;smithi099:172.21.15.99=smithi099", "target": ["mon-mgr", ""]}) v1 -- 0x7fc544070280 con 0x7fc530039580 2024-09-17T00:54:12.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:12.171+0000 7fc53a7fc640 1 -- 172.21.15.99:0/3327309039 <== mgr.14160 v2:172.21.15.2:6800/2191872617 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc544070280 con 0x7fc530039580 2024-09-17T00:54:12.169 INFO:teuthology.orchestra.run.smithi099.stdout:Scheduled mon update... 2024-09-17T00:54:12.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:12.173+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3327309039 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fc530039580 msgr2=0x7fc53003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:12.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:12.173+0000 7fc54bdc2640 1 --2- 172.21.15.99:0/3327309039 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fc530039580 0x7fc53003ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc534006fd0 tx=0x7fc534006db0 comp rx=0 tx=0).stop 2024-09-17T00:54:12.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:12.173+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3327309039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5440fc1d0 msgr2=0x7fc544071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:12.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:12.173+0000 7fc54bdc2640 1 --2- 172.21.15.99:0/3327309039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5440fc1d0 0x7fc544071490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc54002a6d0 tx=0x7fc540009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:12.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:12.173+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3327309039 shutdown_connections 2024-09-17T00:54:12.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:12.173+0000 7fc54bdc2640 1 --2- 172.21.15.99:0/3327309039 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fc530039580 0x7fc53003ba30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:12.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:12.173+0000 7fc54bdc2640 1 --2- 172.21.15.99:0/3327309039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5440fc1d0 0x7fc544071490 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:12.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:12.173+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3327309039 >> 172.21.15.99:0/3327309039 conn(0x7fc5440f79b0 msgr2=0x7fc5440f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:12.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:12.174+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3327309039 shutdown_connections 2024-09-17T00:54:12.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:12.174+0000 7fc54bdc2640 1 -- 172.21.15.99:0/3327309039 wait complete. 2024-09-17T00:54:12.767 DEBUG:teuthology.orchestra.run.smithi099:mon.smithi099> sudo journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi099.service 2024-09-17T00:54:12.769 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:54:12.769 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:54:13.034 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:13.086 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:13.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:13 smithi002 ceph-mon[27650]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:13.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:13 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:14.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:14 smithi002 ceph-mon[27650]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi002:172.21.15.2=smithi002;smithi099:172.21.15.99=smithi099", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:54:14.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:14 smithi002 ceph-mon[27650]: Saving service mon spec with placement smithi002:172.21.15.2=smithi002;smithi099:172.21.15.99=smithi099;count:2 2024-09-17T00:54:14.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.580+0000 7f73f775a640 1 -- 172.21.15.99:0/1812087542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f00fd820 msgr2=0x7f73f00fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:14.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.580+0000 7f73f775a640 1 --2- 172.21.15.99:0/1812087542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f00fd820 0x7f73f00fdc30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f73ec004850 tx=0x7f73ec009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.580+0000 7f73f775a640 1 -- 172.21.15.99:0/1812087542 shutdown_connections 2024-09-17T00:54:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.580+0000 7f73f775a640 1 --2- 172.21.15.99:0/1812087542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f00fd820 0x7f73f00fdc30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.580+0000 7f73f775a640 1 -- 172.21.15.99:0/1812087542 >> 172.21.15.99:0/1812087542 conn(0x7f73f00f6040 msgr2=0x7f73f00f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.580+0000 7f73f775a640 1 -- 172.21.15.99:0/1812087542 shutdown_connections 2024-09-17T00:54:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.580+0000 7f73f775a640 1 -- 172.21.15.99:0/1812087542 wait complete. 2024-09-17T00:54:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.580+0000 7f73f775a640 1 Processor -- start 2024-09-17T00:54:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.581+0000 7f73f775a640 1 -- start start 2024-09-17T00:54:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.581+0000 7f73f775a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f00fd820 0x7f73f010c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.581+0000 7f73f775a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f010cc20 con 0x7f73f00fd820 2024-09-17T00:54:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.581+0000 7f73f54f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f00fd820 0x7f73f010c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.581+0000 7f73f54f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f00fd820 0x7f73f010c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.99:42888/0 (socket says 172.21.15.99:42888) 2024-09-17T00:54:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.581+0000 7f73f54f6640 1 -- 172.21.15.99:0/3713597410 learned_addr learned my addr 172.21.15.99:0/3713597410 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:54:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.581+0000 7f73f54f6640 1 -- 172.21.15.99:0/3713597410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec005040 con 0x7f73f00fd820 2024-09-17T00:54:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.581+0000 7f73f54f6640 1 --2- 172.21.15.99:0/3713597410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f00fd820 0x7f73f010c6e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f73ec02a6d0 tx=0x7f73ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.581+0000 7f73e5ffb640 1 -- 172.21.15.99:0/3713597410 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73ec033630 con 0x7f73f00fd820 2024-09-17T00:54:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.582+0000 7f73f775a640 1 -- 172.21.15.99:0/3713597410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f010ce20 con 0x7f73f00fd820 2024-09-17T00:54:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.582+0000 7f73e5ffb640 1 -- 172.21.15.99:0/3713597410 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f73ec033c30 con 0x7f73f00fd820 2024-09-17T00:54:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.582+0000 7f73e5ffb640 1 -- 172.21.15.99:0/3713597410 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73ec03dc00 con 0x7f73f00fd820 2024-09-17T00:54:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.582+0000 7f73f775a640 1 -- 172.21.15.99:0/3713597410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f010d290 con 0x7f73f00fd820 2024-09-17T00:54:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.583+0000 7f73e5ffb640 1 -- 172.21.15.99:0/3713597410 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45562+0+0 (secure 0 0 0) 0x7f73ec030020 con 0x7f73f00fd820 2024-09-17T00:54:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.583+0000 7f73f775a640 1 -- 172.21.15.99:0/3713597410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f005ed70 con 0x7f73f00fd820 2024-09-17T00:54:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.583+0000 7f73e5ffb640 1 --2- 172.21.15.99:0/3713597410 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f73dc039580 0x7f73dc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.583+0000 7f73e5ffb640 1 -- 172.21.15.99:0/3713597410 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f73ec06c920 con 0x7f73f00fd820 2024-09-17T00:54:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.583+0000 7f73f4cf5640 1 --2- 172.21.15.99:0/3713597410 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f73dc039580 0x7f73dc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.583+0000 7f73f4cf5640 1 --2- 172.21.15.99:0/3713597410 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f73dc039580 0x7f73dc03ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f73e0006fd0 tx=0x7f73e0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.588+0000 7f73e5ffb640 1 -- 172.21.15.99:0/3713597410 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f73ec033790 con 0x7f73f00fd820 2024-09-17T00:54:14.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.800+0000 7f73f775a640 1 -- 172.21.15.99:0/3713597410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f73f004b720 con 0x7f73f00fd820 2024-09-17T00:54:14.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.801+0000 7f73e5ffb640 1 -- 172.21.15.99:0/3713597410 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f73ec045800 con 0x7f73f00fd820 2024-09-17T00:54:14.798 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:54:14.799 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":1,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:52:33.781919Z","created":"2024-09-17T00:52:33.781919Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:54:14.799 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 1 2024-09-17T00:54:14.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.803+0000 7f73f775a640 1 -- 172.21.15.99:0/3713597410 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f73dc039580 msgr2=0x7f73dc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:14.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.803+0000 7f73f775a640 1 --2- 172.21.15.99:0/3713597410 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f73dc039580 0x7f73dc03ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f73e0006fd0 tx=0x7f73e0006db0 comp rx=0 tx=0).stop 2024-09-17T00:54:14.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.803+0000 7f73f775a640 1 -- 172.21.15.99:0/3713597410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f00fd820 msgr2=0x7f73f010c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:14.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.803+0000 7f73f775a640 1 --2- 172.21.15.99:0/3713597410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f00fd820 0x7f73f010c6e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f73ec02a6d0 tx=0x7f73ec009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:14.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.803+0000 7f73f775a640 1 -- 172.21.15.99:0/3713597410 shutdown_connections 2024-09-17T00:54:14.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.803+0000 7f73f775a640 1 --2- 172.21.15.99:0/3713597410 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f73dc039580 0x7f73dc03ba30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:14.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.803+0000 7f73f775a640 1 --2- 172.21.15.99:0/3713597410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f00fd820 0x7f73f010c6e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:14.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.803+0000 7f73f775a640 1 -- 172.21.15.99:0/3713597410 >> 172.21.15.99:0/3713597410 conn(0x7f73f00f6040 msgr2=0x7f73f00f6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:14.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.803+0000 7f73f775a640 1 -- 172.21.15.99:0/3713597410 shutdown_connections 2024-09-17T00:54:14.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:14.803+0000 7f73f775a640 1 -- 172.21.15.99:0/3713597410 wait complete. 2024-09-17T00:54:15.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:15 smithi002 ceph-mon[27650]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:15.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:15 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/3713597410' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:54:16.363 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:54:16.363 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:54:16.616 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:16.662 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:17.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:17 smithi002 ceph-mon[27650]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:18.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.092+0000 7f40414d6640 1 -- 172.21.15.99:0/584839353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c0655d0 msgr2=0x7f403c0ff070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:18.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.092+0000 7f40414d6640 1 --2- 172.21.15.99:0/584839353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c0655d0 0x7f403c0ff070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f402c009bd0 tx=0x7f402c004d10 comp rx=0 tx=0).stop 2024-09-17T00:54:18.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.092+0000 7f40414d6640 1 -- 172.21.15.99:0/584839353 shutdown_connections 2024-09-17T00:54:18.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.092+0000 7f40414d6640 1 --2- 172.21.15.99:0/584839353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c0655d0 0x7f403c0ff070 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:18.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.092+0000 7f40414d6640 1 -- 172.21.15.99:0/584839353 >> 172.21.15.99:0/584839353 conn(0x7f403c0f6ac0 msgr2=0x7f403c0f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:18.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.092+0000 7f40414d6640 1 -- 172.21.15.99:0/584839353 shutdown_connections 2024-09-17T00:54:18.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.092+0000 7f40414d6640 1 -- 172.21.15.99:0/584839353 wait complete. 2024-09-17T00:54:18.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.093+0000 7f40414d6640 1 Processor -- start 2024-09-17T00:54:18.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.093+0000 7f40414d6640 1 -- start start 2024-09-17T00:54:18.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.093+0000 7f40414d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c0655d0 0x7f403c10c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:18.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.093+0000 7f40414d6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c10ce70 con 0x7f403c0655d0 2024-09-17T00:54:18.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.094+0000 7f403affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c0655d0 0x7f403c10c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:18.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.094+0000 7f403affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c0655d0 0x7f403c10c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.99:55542/0 (socket says 172.21.15.99:55542) 2024-09-17T00:54:18.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.094+0000 7f403affd640 1 -- 172.21.15.99:0/477316564 learned_addr learned my addr 172.21.15.99:0/477316564 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:54:18.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.094+0000 7f403affd640 1 -- 172.21.15.99:0/477316564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c0098b0 con 0x7f403c0655d0 2024-09-17T00:54:18.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.094+0000 7f403affd640 1 --2- 172.21.15.99:0/477316564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c0655d0 0x7f403c10c930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f402c004a30 tx=0x7f402c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:18.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.094+0000 7f40337fe640 1 -- 172.21.15.99:0/477316564 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f402c032910 con 0x7f403c0655d0 2024-09-17T00:54:18.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.094+0000 7f40337fe640 1 -- 172.21.15.99:0/477316564 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f402c03d420 con 0x7f403c0655d0 2024-09-17T00:54:18.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.094+0000 7f40414d6640 1 -- 172.21.15.99:0/477316564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403c10d070 con 0x7f403c0655d0 2024-09-17T00:54:18.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.094+0000 7f40337fe640 1 -- 172.21.15.99:0/477316564 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f402c031590 con 0x7f403c0655d0 2024-09-17T00:54:18.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.094+0000 7f40414d6640 1 -- 172.21.15.99:0/477316564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403c10dc00 con 0x7f403c0655d0 2024-09-17T00:54:18.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.095+0000 7f40414d6640 1 -- 172.21.15.99:0/477316564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403c10d540 con 0x7f403c0655d0 2024-09-17T00:54:18.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.095+0000 7f40337fe640 1 -- 172.21.15.99:0/477316564 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45562+0+0 (secure 0 0 0) 0x7f402c02f030 con 0x7f403c0655d0 2024-09-17T00:54:18.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.096+0000 7f40337fe640 1 --2- 172.21.15.99:0/477316564 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f40280395d0 0x7f402803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:18.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.096+0000 7f40337fe640 1 -- 172.21.15.99:0/477316564 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f402c06d230 con 0x7f403c0655d0 2024-09-17T00:54:18.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.096+0000 7f403a7fc640 1 --2- 172.21.15.99:0/477316564 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f40280395d0 0x7f402803ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:18.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.096+0000 7f403a7fc640 1 --2- 172.21.15.99:0/477316564 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f40280395d0 0x7f402803ba80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4024006fd0 tx=0x7f4024006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:18.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.101+0000 7f40337fe640 1 -- 172.21.15.99:0/477316564 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f403c10d540 con 0x7f403c0655d0 2024-09-17T00:54:18.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.314+0000 7f40414d6640 1 -- 172.21.15.99:0/477316564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f403c102810 con 0x7f403c0655d0 2024-09-17T00:54:18.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.315+0000 7f40337fe640 1 -- 172.21.15.99:0/477316564 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f402c041070 con 0x7f403c0655d0 2024-09-17T00:54:18.312 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:54:18.313 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":1,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:52:33.781919Z","created":"2024-09-17T00:52:33.781919Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:54:18.313 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 1 2024-09-17T00:54:18.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.317+0000 7f40414d6640 1 -- 172.21.15.99:0/477316564 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f40280395d0 msgr2=0x7f402803ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:18.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.317+0000 7f40414d6640 1 --2- 172.21.15.99:0/477316564 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f40280395d0 0x7f402803ba80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4024006fd0 tx=0x7f4024006db0 comp rx=0 tx=0).stop 2024-09-17T00:54:18.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.317+0000 7f40414d6640 1 -- 172.21.15.99:0/477316564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c0655d0 msgr2=0x7f403c10c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:18.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.317+0000 7f40414d6640 1 --2- 172.21.15.99:0/477316564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c0655d0 0x7f403c10c930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f402c004a30 tx=0x7f402c004d10 comp rx=0 tx=0).stop 2024-09-17T00:54:18.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.317+0000 7f40414d6640 1 -- 172.21.15.99:0/477316564 shutdown_connections 2024-09-17T00:54:18.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.317+0000 7f40414d6640 1 --2- 172.21.15.99:0/477316564 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f40280395d0 0x7f402803ba80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:18.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.317+0000 7f40414d6640 1 --2- 172.21.15.99:0/477316564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f403c0655d0 0x7f403c10c930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:18.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.317+0000 7f40414d6640 1 -- 172.21.15.99:0/477316564 >> 172.21.15.99:0/477316564 conn(0x7f403c0f6ac0 msgr2=0x7f403c0f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:18.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.317+0000 7f40414d6640 1 -- 172.21.15.99:0/477316564 shutdown_connections 2024-09-17T00:54:18.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:18.317+0000 7f40414d6640 1 -- 172.21.15.99:0/477316564 wait complete. 2024-09-17T00:54:19.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:19 smithi002 ceph-mon[27650]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:19.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:19 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/477316564' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:54:19.918 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:54:19.918 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:54:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:20.201 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:21.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:21 smithi002 ceph-mon[27650]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:21.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:21 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:21.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:21 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:21.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:21 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:21.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:21 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:21.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:21 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:21.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:21 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:21.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:21 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:21.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.547+0000 7fecba619640 1 -- 172.21.15.99:0/799364878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb40fc1d0 msgr2=0x7fecb40fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:21.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.547+0000 7fecba619640 1 --2- 172.21.15.99:0/799364878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb40fc1d0 0x7fecb40fc5e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feca4004850 tx=0x7feca4009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:21.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.547+0000 7fecba619640 1 -- 172.21.15.99:0/799364878 shutdown_connections 2024-09-17T00:54:21.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.547+0000 7fecba619640 1 --2- 172.21.15.99:0/799364878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb40fc1d0 0x7fecb40fc5e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:21.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.547+0000 7fecba619640 1 -- 172.21.15.99:0/799364878 >> 172.21.15.99:0/799364878 conn(0x7fecb40f79b0 msgr2=0x7fecb40f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:21.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.547+0000 7fecba619640 1 -- 172.21.15.99:0/799364878 shutdown_connections 2024-09-17T00:54:21.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.547+0000 7fecba619640 1 -- 172.21.15.99:0/799364878 wait complete. 2024-09-17T00:54:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.548+0000 7fecba619640 1 Processor -- start 2024-09-17T00:54:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.548+0000 7fecba619640 1 -- start start 2024-09-17T00:54:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.548+0000 7fecba619640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb40fc1d0 0x7fecb410c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.548+0000 7fecba619640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb410cc50 con 0x7fecb40fc1d0 2024-09-17T00:54:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.548+0000 7fecb3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb40fc1d0 0x7fecb410c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.548+0000 7fecb3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb40fc1d0 0x7fecb410c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.99:55570/0 (socket says 172.21.15.99:55570) 2024-09-17T00:54:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.548+0000 7fecb3fff640 1 -- 172.21.15.99:0/3466272512 learned_addr learned my addr 172.21.15.99:0/3466272512 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:54:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.548+0000 7fecb3fff640 1 -- 172.21.15.99:0/3466272512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca4005040 con 0x7fecb40fc1d0 2024-09-17T00:54:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.549+0000 7fecb3fff640 1 --2- 172.21.15.99:0/3466272512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb40fc1d0 0x7fecb410c710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feca402a6d0 tx=0x7feca4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.549+0000 7fecb0ff9640 1 -- 172.21.15.99:0/3466272512 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feca4033630 con 0x7fecb40fc1d0 2024-09-17T00:54:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.549+0000 7fecba619640 1 -- 172.21.15.99:0/3466272512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb410ce50 con 0x7fecb40fc1d0 2024-09-17T00:54:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.549+0000 7fecb0ff9640 1 -- 172.21.15.99:0/3466272512 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feca4033c30 con 0x7fecb40fc1d0 2024-09-17T00:54:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.549+0000 7fecb0ff9640 1 -- 172.21.15.99:0/3466272512 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feca403dc00 con 0x7fecb40fc1d0 2024-09-17T00:54:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.549+0000 7fecba619640 1 -- 172.21.15.99:0/3466272512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb410d2c0 con 0x7fecb40fc1d0 2024-09-17T00:54:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.550+0000 7fecb0ff9640 1 -- 172.21.15.99:0/3466272512 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45562+0+0 (secure 0 0 0) 0x7feca4030020 con 0x7fecb40fc1d0 2024-09-17T00:54:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.550+0000 7fecba619640 1 -- 172.21.15.99:0/3466272512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb405ed70 con 0x7fecb40fc1d0 2024-09-17T00:54:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.550+0000 7fecb0ff9640 1 --2- 172.21.15.99:0/3466272512 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fec9c0395d0 0x7fec9c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.550+0000 7fecb0ff9640 1 -- 172.21.15.99:0/3466272512 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7feca406c930 con 0x7fecb40fc1d0 2024-09-17T00:54:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.550+0000 7fecb37fe640 1 --2- 172.21.15.99:0/3466272512 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fec9c0395d0 0x7fec9c03ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.550+0000 7fecb37fe640 1 --2- 172.21.15.99:0/3466272512 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fec9c0395d0 0x7fec9c03ba80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feca8006fd0 tx=0x7feca8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.554+0000 7fecb0ff9640 1 -- 172.21.15.99:0/3466272512 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7feca4033790 con 0x7fecb40fc1d0 2024-09-17T00:54:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.768+0000 7fecba619640 1 -- 172.21.15.99:0/3466272512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fecb404b720 con 0x7fecb40fc1d0 2024-09-17T00:54:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.769+0000 7fecb0ff9640 1 -- 172.21.15.99:0/3466272512 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7feca4042210 con 0x7fecb40fc1d0 2024-09-17T00:54:21.767 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:54:21.767 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":1,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:52:33.781919Z","created":"2024-09-17T00:52:33.781919Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:54:21.767 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 1 2024-09-17T00:54:21.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.770+0000 7fecba619640 1 -- 172.21.15.99:0/3466272512 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fec9c0395d0 msgr2=0x7fec9c03ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:21.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.770+0000 7fecba619640 1 --2- 172.21.15.99:0/3466272512 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fec9c0395d0 0x7fec9c03ba80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feca8006fd0 tx=0x7feca8006db0 comp rx=0 tx=0).stop 2024-09-17T00:54:21.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.770+0000 7fecba619640 1 -- 172.21.15.99:0/3466272512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb40fc1d0 msgr2=0x7fecb410c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:21.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.770+0000 7fecba619640 1 --2- 172.21.15.99:0/3466272512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb40fc1d0 0x7fecb410c710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feca402a6d0 tx=0x7feca4009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:21.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.770+0000 7fecba619640 1 -- 172.21.15.99:0/3466272512 shutdown_connections 2024-09-17T00:54:21.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.770+0000 7fecba619640 1 --2- 172.21.15.99:0/3466272512 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fec9c0395d0 0x7fec9c03ba80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:21.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.770+0000 7fecba619640 1 --2- 172.21.15.99:0/3466272512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fecb40fc1d0 0x7fecb410c710 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:21.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.770+0000 7fecba619640 1 -- 172.21.15.99:0/3466272512 >> 172.21.15.99:0/3466272512 conn(0x7fecb40f79b0 msgr2=0x7fecb40f8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:21.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.770+0000 7fecba619640 1 -- 172.21.15.99:0/3466272512 shutdown_connections 2024-09-17T00:54:21.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:21.771+0000 7fecba619640 1 -- 172.21.15.99:0/3466272512 wait complete. 2024-09-17T00:54:22.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:22 smithi002 ceph-mon[27650]: Deploying daemon prometheus.smithi002 on smithi002 2024-09-17T00:54:22.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:22 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/3466272512' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:54:23.347 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:54:23.347 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:54:23.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:23 smithi002 ceph-mon[27650]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:23.588 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:23.632 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:25.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.114+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/3706104952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf880fb2e0 msgr2=0x7fdf880fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:25.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.114+0000 7fdf8f2b4640 1 --2- 172.21.15.99:0/3706104952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf880fb2e0 0x7fdf880fb6f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009bd0 tx=0x7fdf78004d10 comp rx=0 tx=0).stop 2024-09-17T00:54:25.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.114+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/3706104952 shutdown_connections 2024-09-17T00:54:25.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.114+0000 7fdf8f2b4640 1 --2- 172.21.15.99:0/3706104952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf880fb2e0 0x7fdf880fb6f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:25.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.114+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/3706104952 >> 172.21.15.99:0/3706104952 conn(0x7fdf880f6ac0 msgr2=0x7fdf880f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:25.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.114+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/3706104952 shutdown_connections 2024-09-17T00:54:25.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.114+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/3706104952 wait complete. 2024-09-17T00:54:25.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.115+0000 7fdf8f2b4640 1 Processor -- start 2024-09-17T00:54:25.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.115+0000 7fdf8f2b4640 1 -- start start 2024-09-17T00:54:25.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.115+0000 7fdf8f2b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf880fb2e0 0x7fdf8810b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:25.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.115+0000 7fdf8f2b4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8810bd60 con 0x7fdf880fb2e0 2024-09-17T00:54:25.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.115+0000 7fdf8d050640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf880fb2e0 0x7fdf8810b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:25.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.115+0000 7fdf8d050640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf880fb2e0 0x7fdf8810b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.99:55594/0 (socket says 172.21.15.99:55594) 2024-09-17T00:54:25.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.115+0000 7fdf8d050640 1 -- 172.21.15.99:0/2958929018 learned_addr learned my addr 172.21.15.99:0/2958929018 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:54:25.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.115+0000 7fdf8d050640 1 -- 172.21.15.99:0/2958929018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf780098b0 con 0x7fdf880fb2e0 2024-09-17T00:54:25.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.116+0000 7fdf8d050640 1 --2- 172.21.15.99:0/2958929018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf880fb2e0 0x7fdf8810b820 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdf78003400 tx=0x7fdf78004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:25.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.116+0000 7fdf85ffb640 1 -- 172.21.15.99:0/2958929018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf78032910 con 0x7fdf880fb2e0 2024-09-17T00:54:25.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.116+0000 7fdf85ffb640 1 -- 172.21.15.99:0/2958929018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdf7803d420 con 0x7fdf880fb2e0 2024-09-17T00:54:25.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.116+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/2958929018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8810bf60 con 0x7fdf880fb2e0 2024-09-17T00:54:25.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.116+0000 7fdf85ffb640 1 -- 172.21.15.99:0/2958929018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf78031590 con 0x7fdf880fb2e0 2024-09-17T00:54:25.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.117+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/2958929018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8810caf0 con 0x7fdf880fb2e0 2024-09-17T00:54:25.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.118+0000 7fdf85ffb640 1 -- 172.21.15.99:0/2958929018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45562+0+0 (secure 0 0 0) 0x7fdf7802f030 con 0x7fdf880fb2e0 2024-09-17T00:54:25.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.118+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/2958929018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf88101700 con 0x7fdf880fb2e0 2024-09-17T00:54:25.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.118+0000 7fdf85ffb640 1 --2- 172.21.15.99:0/2958929018 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fdf70039580 0x7fdf7003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:25.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.118+0000 7fdf85ffb640 1 -- 172.21.15.99:0/2958929018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdf7806d900 con 0x7fdf880fb2e0 2024-09-17T00:54:25.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.118+0000 7fdf8c84f640 1 --2- 172.21.15.99:0/2958929018 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fdf70039580 0x7fdf7003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:25.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.118+0000 7fdf8c84f640 1 --2- 172.21.15.99:0/2958929018 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fdf70039580 0x7fdf7003ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c006fd0 tx=0x7fdf7c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:25.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.123+0000 7fdf85ffb640 1 -- 172.21.15.99:0/2958929018 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdf78030c20 con 0x7fdf880fb2e0 2024-09-17T00:54:25.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.335+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/2958929018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdf880008d0 con 0x7fdf880fb2e0 2024-09-17T00:54:25.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.336+0000 7fdf85ffb640 1 -- 172.21.15.99:0/2958929018 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fdf78041020 con 0x7fdf880fb2e0 2024-09-17T00:54:25.333 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:54:25.334 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":1,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:52:33.781919Z","created":"2024-09-17T00:52:33.781919Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:54:25.334 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 1 2024-09-17T00:54:25.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.338+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/2958929018 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fdf70039580 msgr2=0x7fdf7003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:25.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.338+0000 7fdf8f2b4640 1 --2- 172.21.15.99:0/2958929018 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fdf70039580 0x7fdf7003ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c006fd0 tx=0x7fdf7c006db0 comp rx=0 tx=0).stop 2024-09-17T00:54:25.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.338+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/2958929018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf880fb2e0 msgr2=0x7fdf8810b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:25.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.338+0000 7fdf8f2b4640 1 --2- 172.21.15.99:0/2958929018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf880fb2e0 0x7fdf8810b820 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdf78003400 tx=0x7fdf78004d10 comp rx=0 tx=0).stop 2024-09-17T00:54:25.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.338+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/2958929018 shutdown_connections 2024-09-17T00:54:25.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.338+0000 7fdf8f2b4640 1 --2- 172.21.15.99:0/2958929018 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fdf70039580 0x7fdf7003ba30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:25.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.338+0000 7fdf8f2b4640 1 --2- 172.21.15.99:0/2958929018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf880fb2e0 0x7fdf8810b820 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:25.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.338+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/2958929018 >> 172.21.15.99:0/2958929018 conn(0x7fdf880f6ac0 msgr2=0x7fdf880f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:25.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.338+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/2958929018 shutdown_connections 2024-09-17T00:54:25.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:25.338+0000 7fdf8f2b4640 1 -- 172.21.15.99:0/2958929018 wait complete. 2024-09-17T00:54:25.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:25 smithi002 ceph-mon[27650]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:26.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:26 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/2958929018' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:54:26.944 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:54:26.945 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:54:27.187 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:27.232 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:27.357 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:27 smithi002 ceph-mon[27650]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:28.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.740+0000 7fedfffa6640 1 -- 172.21.15.99:0/1181722074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf80fb2e0 msgr2=0x7fedf80fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:28.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.740+0000 7fedfffa6640 1 --2- 172.21.15.99:0/1181722074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf80fb2e0 0x7fedf80fb6f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fedf4004850 tx=0x7fedf4009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:28.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.740+0000 7fedfffa6640 1 -- 172.21.15.99:0/1181722074 shutdown_connections 2024-09-17T00:54:28.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.740+0000 7fedfffa6640 1 --2- 172.21.15.99:0/1181722074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf80fb2e0 0x7fedf80fb6f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:28.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.740+0000 7fedfffa6640 1 -- 172.21.15.99:0/1181722074 >> 172.21.15.99:0/1181722074 conn(0x7fedf80f6ac0 msgr2=0x7fedf80f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:28.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.740+0000 7fedfffa6640 1 -- 172.21.15.99:0/1181722074 shutdown_connections 2024-09-17T00:54:28.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.740+0000 7fedfffa6640 1 -- 172.21.15.99:0/1181722074 wait complete. 2024-09-17T00:54:28.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.741+0000 7fedfffa6640 1 Processor -- start 2024-09-17T00:54:28.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.741+0000 7fedfffa6640 1 -- start start 2024-09-17T00:54:28.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.741+0000 7fedfffa6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf80fb2e0 0x7fedf80654f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:28.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.741+0000 7fedfffa6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf810f640 con 0x7fedf80fb2e0 2024-09-17T00:54:28.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.741+0000 7fedfdd42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf80fb2e0 0x7fedf80654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:28.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.741+0000 7fedfdd42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf80fb2e0 0x7fedf80654f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.99:53976/0 (socket says 172.21.15.99:53976) 2024-09-17T00:54:28.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.741+0000 7fedfdd42640 1 -- 172.21.15.99:0/2486988696 learned_addr learned my addr 172.21.15.99:0/2486988696 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:54:28.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.741+0000 7fedfdd42640 1 -- 172.21.15.99:0/2486988696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf4005040 con 0x7fedf80fb2e0 2024-09-17T00:54:28.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.741+0000 7fedfdd42640 1 --2- 172.21.15.99:0/2486988696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf80fb2e0 0x7fedf80654f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fedf402a6d0 tx=0x7fedf4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:28.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.742+0000 7fedee7fc640 1 -- 172.21.15.99:0/2486988696 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fedf4033630 con 0x7fedf80fb2e0 2024-09-17T00:54:28.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.742+0000 7fedfffa6640 1 -- 172.21.15.99:0/2486988696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf810f780 con 0x7fedf80fb2e0 2024-09-17T00:54:28.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.742+0000 7fedee7fc640 1 -- 172.21.15.99:0/2486988696 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fedf4033c30 con 0x7fedf80fb2e0 2024-09-17T00:54:28.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.742+0000 7fedee7fc640 1 -- 172.21.15.99:0/2486988696 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fedf403dc00 con 0x7fedf80fb2e0 2024-09-17T00:54:28.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.742+0000 7fedfffa6640 1 -- 172.21.15.99:0/2486988696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf810fbf0 con 0x7fedf80fb2e0 2024-09-17T00:54:28.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.743+0000 7fedee7fc640 1 -- 172.21.15.99:0/2486988696 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 45562+0+0 (secure 0 0 0) 0x7fedf4030020 con 0x7fedf80fb2e0 2024-09-17T00:54:28.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.743+0000 7fedfffa6640 1 -- 172.21.15.99:0/2486988696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf805ed70 con 0x7fedf80fb2e0 2024-09-17T00:54:28.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.743+0000 7fedee7fc640 1 --2- 172.21.15.99:0/2486988696 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fede4039580 0x7fede403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:28.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.743+0000 7fedee7fc640 1 -- 172.21.15.99:0/2486988696 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fedf406caa0 con 0x7fedf80fb2e0 2024-09-17T00:54:28.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.743+0000 7fedfd541640 1 --2- 172.21.15.99:0/2486988696 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fede4039580 0x7fede403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:28.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.743+0000 7fedfd541640 1 --2- 172.21.15.99:0/2486988696 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fede4039580 0x7fede403ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fede8006fd0 tx=0x7fede8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:28.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.748+0000 7fedee7fc640 1 -- 172.21.15.99:0/2486988696 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fedf4045800 con 0x7fedf80fb2e0 2024-09-17T00:54:28.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.968+0000 7fedfffa6640 1 -- 172.21.15.99:0/2486988696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fedf804b720 con 0x7fedf80fb2e0 2024-09-17T00:54:28.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.969+0000 7fedee7fc640 1 -- 172.21.15.99:0/2486988696 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fedf4045800 con 0x7fedf80fb2e0 2024-09-17T00:54:28.967 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:54:28.967 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":1,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:52:33.781919Z","created":"2024-09-17T00:52:33.781919Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:54:28.967 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 1 2024-09-17T00:54:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.971+0000 7fedfffa6640 1 -- 172.21.15.99:0/2486988696 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fede4039580 msgr2=0x7fede403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.971+0000 7fedfffa6640 1 --2- 172.21.15.99:0/2486988696 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fede4039580 0x7fede403ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fede8006fd0 tx=0x7fede8006db0 comp rx=0 tx=0).stop 2024-09-17T00:54:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.971+0000 7fedfffa6640 1 -- 172.21.15.99:0/2486988696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf80fb2e0 msgr2=0x7fedf80654f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.971+0000 7fedfffa6640 1 --2- 172.21.15.99:0/2486988696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf80fb2e0 0x7fedf80654f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fedf402a6d0 tx=0x7fedf4009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.971+0000 7fedfffa6640 1 -- 172.21.15.99:0/2486988696 shutdown_connections 2024-09-17T00:54:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.971+0000 7fedfffa6640 1 --2- 172.21.15.99:0/2486988696 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fede4039580 0x7fede403ba30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.971+0000 7fedfffa6640 1 --2- 172.21.15.99:0/2486988696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf80fb2e0 0x7fedf80654f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.971+0000 7fedfffa6640 1 -- 172.21.15.99:0/2486988696 >> 172.21.15.99:0/2486988696 conn(0x7fedf80f6ac0 msgr2=0x7fedf80f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.971+0000 7fedfffa6640 1 -- 172.21.15.99:0/2486988696 shutdown_connections 2024-09-17T00:54:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:28.971+0000 7fedfffa6640 1 -- 172.21.15.99:0/2486988696 wait complete. 2024-09-17T00:54:29.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:29 smithi002 ceph-mon[27650]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:29.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:29 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/2486988696' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:54:30.547 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:54:30.547 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:54:30.785 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:30.829 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:31.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:31 smithi002 ceph-mon[27650]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:31.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:31 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:31.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:31 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:31.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:31 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:31.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:31 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T00:54:31.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:31 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:32.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.359+0000 7fae607a8640 1 -- 172.21.15.99:0/2902221534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae580fb0c0 msgr2=0x7fae580fb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:32.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.359+0000 7fae607a8640 1 --2- 172.21.15.99:0/2902221534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae580fb0c0 0x7fae580fb4d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fae50009bd0 tx=0x7fae50004d10 comp rx=0 tx=0).stop 2024-09-17T00:54:32.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.359+0000 7fae607a8640 1 -- 172.21.15.99:0/2902221534 shutdown_connections 2024-09-17T00:54:32.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.359+0000 7fae607a8640 1 --2- 172.21.15.99:0/2902221534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae580fb0c0 0x7fae580fb4d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:32.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.359+0000 7fae607a8640 1 -- 172.21.15.99:0/2902221534 >> 172.21.15.99:0/2902221534 conn(0x7fae580f6880 msgr2=0x7fae580f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:32.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.359+0000 7fae607a8640 1 -- 172.21.15.99:0/2902221534 shutdown_connections 2024-09-17T00:54:32.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.359+0000 7fae607a8640 1 -- 172.21.15.99:0/2902221534 wait complete. 2024-09-17T00:54:32.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.359+0000 7fae607a8640 1 Processor -- start 2024-09-17T00:54:32.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.360+0000 7fae607a8640 1 -- start start 2024-09-17T00:54:32.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.360+0000 7fae607a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae580fb0c0 0x7fae5810c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:32.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.360+0000 7fae607a8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5810cc10 con 0x7fae580fb0c0 2024-09-17T00:54:32.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.360+0000 7fae5e544640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae580fb0c0 0x7fae5810c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:32.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.360+0000 7fae5e544640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae580fb0c0 0x7fae5810c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.99:53998/0 (socket says 172.21.15.99:53998) 2024-09-17T00:54:32.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.360+0000 7fae5e544640 1 -- 172.21.15.99:0/551929693 learned_addr learned my addr 172.21.15.99:0/551929693 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:54:32.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.360+0000 7fae5e544640 1 -- 172.21.15.99:0/551929693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae500098b0 con 0x7fae580fb0c0 2024-09-17T00:54:32.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.360+0000 7fae5e544640 1 --2- 172.21.15.99:0/551929693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae580fb0c0 0x7fae5810c6d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fae50003400 tx=0x7fae50004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:32.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.360+0000 7fae56ffd640 1 -- 172.21.15.99:0/551929693 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae50032910 con 0x7fae580fb0c0 2024-09-17T00:54:32.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.361+0000 7fae607a8640 1 -- 172.21.15.99:0/551929693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5810ce10 con 0x7fae580fb0c0 2024-09-17T00:54:32.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.361+0000 7fae56ffd640 1 -- 172.21.15.99:0/551929693 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fae5003d420 con 0x7fae580fb0c0 2024-09-17T00:54:32.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.361+0000 7fae607a8640 1 -- 172.21.15.99:0/551929693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5810d9a0 con 0x7fae580fb0c0 2024-09-17T00:54:32.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.361+0000 7fae56ffd640 1 -- 172.21.15.99:0/551929693 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae50031590 con 0x7fae580fb0c0 2024-09-17T00:54:32.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.361+0000 7fae607a8640 1 -- 172.21.15.99:0/551929693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5810d2e0 con 0x7fae580fb0c0 2024-09-17T00:54:32.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.361+0000 7fae56ffd640 1 -- 172.21.15.99:0/551929693 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) v1 ==== 45576+0+0 (secure 0 0 0) 0x7fae5002f030 con 0x7fae580fb0c0 2024-09-17T00:54:32.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.362+0000 7fae56ffd640 1 --2- 172.21.15.99:0/551929693 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fae400395d0 0x7fae4003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:32.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.362+0000 7fae56ffd640 1 -- 172.21.15.99:0/551929693 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fae5006d830 con 0x7fae580fb0c0 2024-09-17T00:54:32.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.362+0000 7fae5dd43640 1 -- 172.21.15.99:0/551929693 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fae400395d0 msgr2=0x7fae4003ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2191872617 2024-09-17T00:54:32.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.362+0000 7fae5dd43640 1 --2- 172.21.15.99:0/551929693 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fae400395d0 0x7fae4003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T00:54:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.370+0000 7fae56ffd640 1 -- 172.21.15.99:0/551929693 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fae5810d2e0 con 0x7fae580fb0c0 2024-09-17T00:54:32.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.563+0000 7fae5dd43640 1 -- 172.21.15.99:0/551929693 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fae400395d0 msgr2=0x7fae4003ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2191872617 2024-09-17T00:54:32.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.563+0000 7fae5dd43640 1 --2- 172.21.15.99:0/551929693 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fae400395d0 0x7fae4003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T00:54:32.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.584+0000 7fae607a8640 1 -- 172.21.15.99:0/551929693 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fae581025e0 con 0x7fae580fb0c0 2024-09-17T00:54:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.584+0000 7fae56ffd640 1 -- 172.21.15.99:0/551929693 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fae50041030 con 0x7fae580fb0c0 2024-09-17T00:54:32.582 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:54:32.582 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":1,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:52:33.781919Z","created":"2024-09-17T00:52:33.781919Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:54:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 1 2024-09-17T00:54:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.586+0000 7fae607a8640 1 -- 172.21.15.99:0/551929693 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fae400395d0 msgr2=0x7fae4003ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T00:54:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.586+0000 7fae607a8640 1 --2- 172.21.15.99:0/551929693 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fae400395d0 0x7fae4003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.586+0000 7fae607a8640 1 -- 172.21.15.99:0/551929693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae580fb0c0 msgr2=0x7fae5810c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.586+0000 7fae607a8640 1 --2- 172.21.15.99:0/551929693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae580fb0c0 0x7fae5810c6d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fae50003400 tx=0x7fae50004d10 comp rx=0 tx=0).stop 2024-09-17T00:54:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.586+0000 7fae607a8640 1 -- 172.21.15.99:0/551929693 shutdown_connections 2024-09-17T00:54:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.586+0000 7fae607a8640 1 --2- 172.21.15.99:0/551929693 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7fae400395d0 0x7fae4003ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.586+0000 7fae607a8640 1 --2- 172.21.15.99:0/551929693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae580fb0c0 0x7fae5810c6d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.586+0000 7fae607a8640 1 -- 172.21.15.99:0/551929693 >> 172.21.15.99:0/551929693 conn(0x7fae580f6880 msgr2=0x7fae580f70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.587+0000 7fae607a8640 1 -- 172.21.15.99:0/551929693 shutdown_connections 2024-09-17T00:54:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:32.587+0000 7fae607a8640 1 -- 172.21.15.99:0/551929693 wait complete. 2024-09-17T00:54:32.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:32 smithi002 ceph-mon[27650]: from='mgr.14160 172.21.15.2:0/2232381209' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T00:54:32.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:32 smithi002 ceph-mon[27650]: mgrmap e14: smithi002.vjeexr(active, since 56s) 2024-09-17T00:54:32.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:32 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/551929693' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:54:34.218 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:54:34.219 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:54:34.457 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:34.501 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.958+0000 7f0a4c761640 1 -- 172.21.15.99:0/2960027344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a440fb050 msgr2=0x7f0a440fb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:35.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.958+0000 7f0a4c761640 1 --2- 172.21.15.99:0/2960027344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a440fb050 0x7f0a440fb460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0a40009bd0 tx=0x7f0a40004d10 comp rx=0 tx=0).stop 2024-09-17T00:54:35.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.958+0000 7f0a4c761640 1 -- 172.21.15.99:0/2960027344 shutdown_connections 2024-09-17T00:54:35.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.958+0000 7f0a4c761640 1 --2- 172.21.15.99:0/2960027344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a440fb050 0x7f0a440fb460 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:35.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.958+0000 7f0a4c761640 1 -- 172.21.15.99:0/2960027344 >> 172.21.15.99:0/2960027344 conn(0x7f0a440f67f0 msgr2=0x7f0a440f8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:35.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.958+0000 7f0a4c761640 1 -- 172.21.15.99:0/2960027344 shutdown_connections 2024-09-17T00:54:35.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.958+0000 7f0a4c761640 1 -- 172.21.15.99:0/2960027344 wait complete. 2024-09-17T00:54:35.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.958+0000 7f0a4c761640 1 Processor -- start 2024-09-17T00:54:35.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.959+0000 7f0a4c761640 1 -- start start 2024-09-17T00:54:35.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.959+0000 7f0a4c761640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a440fb050 0x7f0a44066060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:35.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.959+0000 7f0a4c761640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4410f3a0 con 0x7f0a440fb050 2024-09-17T00:54:35.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.959+0000 7f0a4a4fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a440fb050 0x7f0a44066060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:35.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.959+0000 7f0a4a4fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a440fb050 0x7f0a44066060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.99:54014/0 (socket says 172.21.15.99:54014) 2024-09-17T00:54:35.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.959+0000 7f0a4a4fd640 1 -- 172.21.15.99:0/935436415 learned_addr learned my addr 172.21.15.99:0/935436415 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:54:35.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.959+0000 7f0a4a4fd640 1 -- 172.21.15.99:0/935436415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a400098b0 con 0x7f0a440fb050 2024-09-17T00:54:35.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.959+0000 7f0a4a4fd640 1 --2- 172.21.15.99:0/935436415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a440fb050 0x7f0a44066060 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0a40003400 tx=0x7f0a40004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:35.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.960+0000 7f0a3affd640 1 -- 172.21.15.99:0/935436415 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a40032910 con 0x7f0a440fb050 2024-09-17T00:54:35.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.960+0000 7f0a3affd640 1 -- 172.21.15.99:0/935436415 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0a4003d420 con 0x7f0a440fb050 2024-09-17T00:54:35.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.960+0000 7f0a4c761640 1 -- 172.21.15.99:0/935436415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4410f4e0 con 0x7f0a440fb050 2024-09-17T00:54:35.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.960+0000 7f0a3affd640 1 -- 172.21.15.99:0/935436415 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a40031590 con 0x7f0a440fb050 2024-09-17T00:54:35.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.960+0000 7f0a4c761640 1 -- 172.21.15.99:0/935436415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4410f9b0 con 0x7f0a440fb050 2024-09-17T00:54:35.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.961+0000 7f0a3affd640 1 -- 172.21.15.99:0/935436415 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) v1 ==== 45576+0+0 (secure 0 0 0) 0x7f0a4002f030 con 0x7f0a440fb050 2024-09-17T00:54:35.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.961+0000 7f0a3affd640 1 --2- 172.21.15.99:0/935436415 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0a300395d0 0x7f0a3003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:35.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.961+0000 7f0a3affd640 1 -- 172.21.15.99:0/935436415 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0a4006d870 con 0x7f0a440fb050 2024-09-17T00:54:35.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.961+0000 7f0a4c761640 1 -- 172.21.15.99:0/935436415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4405ed70 con 0x7f0a440fb050 2024-09-17T00:54:35.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.961+0000 7f0a49cfc640 1 -- 172.21.15.99:0/935436415 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0a300395d0 msgr2=0x7f0a3003ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2191872617 2024-09-17T00:54:35.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.961+0000 7f0a49cfc640 1 --2- 172.21.15.99:0/935436415 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0a300395d0 0x7f0a3003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T00:54:35.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:35.966+0000 7f0a3affd640 1 -- 172.21.15.99:0/935436415 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0a40041030 con 0x7f0a440fb050 2024-09-17T00:54:36.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:36.162+0000 7f0a49cfc640 1 -- 172.21.15.99:0/935436415 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0a300395d0 msgr2=0x7f0a3003ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2191872617 2024-09-17T00:54:36.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:36.162+0000 7f0a49cfc640 1 --2- 172.21.15.99:0/935436415 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0a300395d0 0x7f0a3003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-17T00:54:36.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:36.179+0000 7f0a4c761640 1 -- 172.21.15.99:0/935436415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0a44104d60 con 0x7f0a440fb050 2024-09-17T00:54:36.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:36.180+0000 7f0a3affd640 1 -- 172.21.15.99:0/935436415 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f0a4006a020 con 0x7f0a440fb050 2024-09-17T00:54:36.178 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:54:36.178 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":1,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:52:33.781919Z","created":"2024-09-17T00:52:33.781919Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:54:36.179 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 1 2024-09-17T00:54:36.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:36.182+0000 7f0a4c761640 1 -- 172.21.15.99:0/935436415 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0a300395d0 msgr2=0x7f0a3003ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T00:54:36.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:36.182+0000 7f0a4c761640 1 --2- 172.21.15.99:0/935436415 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0a300395d0 0x7f0a3003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:36.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:36.182+0000 7f0a4c761640 1 -- 172.21.15.99:0/935436415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a440fb050 msgr2=0x7f0a44066060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:36.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:36.182+0000 7f0a4c761640 1 --2- 172.21.15.99:0/935436415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a440fb050 0x7f0a44066060 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0a40003400 tx=0x7f0a40004d10 comp rx=0 tx=0).stop 2024-09-17T00:54:36.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:36.182+0000 7f0a4c761640 1 -- 172.21.15.99:0/935436415 shutdown_connections 2024-09-17T00:54:36.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:36.182+0000 7f0a4c761640 1 --2- 172.21.15.99:0/935436415 >> [v2:172.21.15.2:6800/2191872617,v1:172.21.15.2:6801/2191872617] conn(0x7f0a300395d0 0x7f0a3003ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:36.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:36.182+0000 7f0a4c761640 1 --2- 172.21.15.99:0/935436415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a440fb050 0x7f0a44066060 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:36.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:36.182+0000 7f0a4c761640 1 -- 172.21.15.99:0/935436415 >> 172.21.15.99:0/935436415 conn(0x7f0a440f67f0 msgr2=0x7f0a440f73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:36.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:36.182+0000 7f0a4c761640 1 -- 172.21.15.99:0/935436415 shutdown_connections 2024-09-17T00:54:36.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:36.182+0000 7f0a4c761640 1 -- 172.21.15.99:0/935436415 wait complete. 2024-09-17T00:54:36.526 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:36 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/935436415' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:54:37.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: Active manager daemon smithi002.vjeexr restarted 2024-09-17T00:54:37.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: Activating manager daemon smithi002.vjeexr 2024-09-17T00:54:37.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T00:54:37.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: mgrmap e15: smithi002.vjeexr(active, starting, since 0.00281213s) 2024-09-17T00:54:37.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T00:54:37.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr metadata", "who": "smithi002.vjeexr", "id": "smithi002.vjeexr"}]: dispatch 2024-09-17T00:54:37.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T00:54:37.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T00:54:37.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T00:54:37.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: Manager daemon smithi002.vjeexr is now available 2024-09-17T00:54:37.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:54:37.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:37.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:54:37.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/mirror_snapshot_schedule"}]: dispatch 2024-09-17T00:54:37.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/trash_purge_schedule"}]: dispatch 2024-09-17T00:54:37.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:37.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:37.807 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:54:37.807 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:54:38.041 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:38.092 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T00:54:38.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:38 smithi002 ceph-mon[27650]: mgrmap e16: smithi002.vjeexr(active, since 1.00572s) 2024-09-17T00:54:38.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:38 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:39.830 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:39 smithi002 ceph-mon[27650]: [17/Sep/2024:00:54:38] ENGINE Bus STARTING 2024-09-17T00:54:39.830 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:39 smithi002 ceph-mon[27650]: [17/Sep/2024:00:54:38] ENGINE Serving on https://172.21.15.2:7150 2024-09-17T00:54:39.830 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:39 smithi002 ceph-mon[27650]: [17/Sep/2024:00:54:38] ENGINE Bus STARTED 2024-09-17T00:54:39.830 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:39 smithi002 ceph-mon[27650]: [17/Sep/2024:00:54:38] ENGINE Error in HTTPServer.serve 2024-09-17T00:54:39.831 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Traceback (most recent call last): 2024-09-17T00:54:39.831 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T00:54:39.831 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-17T00:54:39.831 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T00:54:39.832 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._run(expiration_interval) 2024-09-17T00:54:39.832 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T00:54:39.832 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T00:54:39.832 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T00:54:39.832 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T00:54:39.832 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T00:54:39.833 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s = self.context.wrap_socket( 2024-09-17T00:54:39.833 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T00:54:39.833 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: return self.sslsocket_class._create( 2024-09-17T00:54:39.833 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T00:54:39.833 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self.do_handshake() 2024-09-17T00:54:39.833 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T00:54:39.834 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._sslobj.do_handshake() 2024-09-17T00:54:39.834 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T00:54:39.834 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:39 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:39.834 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:39 smithi002 ceph-mon[27650]: mgrmap e17: smithi002.vjeexr(active, since 2s) 2024-09-17T00:54:41.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.551+0000 7f9dd521f640 1 -- 172.21.15.99:0/547526494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dd00fc1c0 msgr2=0x7f9dd00fc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:41.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.551+0000 7f9dd521f640 1 --2- 172.21.15.99:0/547526494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dd00fc1c0 0x7f9dd00fc5d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0004850 tx=0x7f9dc0009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:41.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.551+0000 7f9dd521f640 1 -- 172.21.15.99:0/547526494 shutdown_connections 2024-09-17T00:54:41.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.551+0000 7f9dd521f640 1 --2- 172.21.15.99:0/547526494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dd00fc1c0 0x7f9dd00fc5d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:41.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.551+0000 7f9dd521f640 1 -- 172.21.15.99:0/547526494 >> 172.21.15.99:0/547526494 conn(0x7f9dd00f7980 msgr2=0x7f9dd00f9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:41.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.551+0000 7f9dd521f640 1 -- 172.21.15.99:0/547526494 shutdown_connections 2024-09-17T00:54:41.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.551+0000 7f9dd521f640 1 -- 172.21.15.99:0/547526494 wait complete. 2024-09-17T00:54:41.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.551+0000 7f9dd521f640 1 Processor -- start 2024-09-17T00:54:41.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.551+0000 7f9dd521f640 1 -- start start 2024-09-17T00:54:41.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.551+0000 7f9dd521f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dd00fc1c0 0x7f9dd010cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:41.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.551+0000 7f9dd521f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd010d1a0 con 0x7f9dd00fc1c0 2024-09-17T00:54:41.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.552+0000 7f9dced9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dd00fc1c0 0x7f9dd010cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:41.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.552+0000 7f9dced9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dd00fc1c0 0x7f9dd010cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.99:41472/0 (socket says 172.21.15.99:41472) 2024-09-17T00:54:41.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.552+0000 7f9dced9d640 1 -- 172.21.15.99:0/3002131212 learned_addr learned my addr 172.21.15.99:0/3002131212 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:54:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.552+0000 7f9dced9d640 1 -- 172.21.15.99:0/3002131212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc0005040 con 0x7f9dd00fc1c0 2024-09-17T00:54:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.552+0000 7f9dced9d640 1 --2- 172.21.15.99:0/3002131212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dd00fc1c0 0x7f9dd010cc60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9dc002a6d0 tx=0x7f9dc0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.552+0000 7f9db77fe640 1 -- 172.21.15.99:0/3002131212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dc0033630 con 0x7f9dd00fc1c0 2024-09-17T00:54:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.552+0000 7f9db77fe640 1 -- 172.21.15.99:0/3002131212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9dc0033c30 con 0x7f9dd00fc1c0 2024-09-17T00:54:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.552+0000 7f9dd521f640 1 -- 172.21.15.99:0/3002131212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd010b7b0 con 0x7f9dd00fc1c0 2024-09-17T00:54:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.552+0000 7f9db77fe640 1 -- 172.21.15.99:0/3002131212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dc003dc00 con 0x7f9dd00fc1c0 2024-09-17T00:54:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.552+0000 7f9dd521f640 1 -- 172.21.15.99:0/3002131212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd010bc20 con 0x7f9dd00fc1c0 2024-09-17T00:54:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.553+0000 7f9dd521f640 1 -- 172.21.15.99:0/3002131212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd005ed70 con 0x7f9dd00fc1c0 2024-09-17T00:54:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.553+0000 7f9db77fe640 1 -- 172.21.15.99:0/3002131212 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 45618+0+0 (secure 0 0 0) 0x7f9dc0030020 con 0x7f9dd00fc1c0 2024-09-17T00:54:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.554+0000 7f9db77fe640 1 --2- 172.21.15.99:0/3002131212 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9db8039670 0x7f9db803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.554+0000 7f9db77fe640 1 -- 172.21.15.99:0/3002131212 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f9dc006cd00 con 0x7f9dd00fc1c0 2024-09-17T00:54:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.554+0000 7f9dce59c640 1 --2- 172.21.15.99:0/3002131212 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9db8039670 0x7f9db803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.554+0000 7f9dce59c640 1 --2- 172.21.15.99:0/3002131212 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9db8039670 0x7f9db803bb20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4006fd0 tx=0x7f9dc4006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.558+0000 7f9db77fe640 1 -- 172.21.15.99:0/3002131212 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9dc0047440 con 0x7f9dd00fc1c0 2024-09-17T00:54:41.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:41 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:41.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:41 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:41.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:41 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:41.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:41 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:41.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:41 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:41.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.787+0000 7f9dd521f640 1 -- 172.21.15.99:0/3002131212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9dd004b720 con 0x7f9dd00fc1c0 2024-09-17T00:54:41.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.787+0000 7f9db77fe640 1 -- 172.21.15.99:0/3002131212 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f9dc003b7e0 con 0x7f9dd00fc1c0 2024-09-17T00:54:41.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:54:41.785 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":1,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:52:33.781919Z","created":"2024-09-17T00:52:33.781919Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:54:41.786 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 1 2024-09-17T00:54:41.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.789+0000 7f9dd521f640 1 -- 172.21.15.99:0/3002131212 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9db8039670 msgr2=0x7f9db803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:41.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.789+0000 7f9dd521f640 1 --2- 172.21.15.99:0/3002131212 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9db8039670 0x7f9db803bb20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4006fd0 tx=0x7f9dc4006db0 comp rx=0 tx=0).stop 2024-09-17T00:54:41.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.789+0000 7f9dd521f640 1 -- 172.21.15.99:0/3002131212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dd00fc1c0 msgr2=0x7f9dd010cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:41.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.789+0000 7f9dd521f640 1 --2- 172.21.15.99:0/3002131212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dd00fc1c0 0x7f9dd010cc60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9dc002a6d0 tx=0x7f9dc0009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:41.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.789+0000 7f9dd521f640 1 -- 172.21.15.99:0/3002131212 shutdown_connections 2024-09-17T00:54:41.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.789+0000 7f9dd521f640 1 --2- 172.21.15.99:0/3002131212 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9db8039670 0x7f9db803bb20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:41.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.789+0000 7f9dd521f640 1 --2- 172.21.15.99:0/3002131212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dd00fc1c0 0x7f9dd010cc60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:41.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.789+0000 7f9dd521f640 1 -- 172.21.15.99:0/3002131212 >> 172.21.15.99:0/3002131212 conn(0x7f9dd00f7980 msgr2=0x7f9dd00feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:41.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.789+0000 7f9dd521f640 1 -- 172.21.15.99:0/3002131212 shutdown_connections 2024-09-17T00:54:41.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:41.789+0000 7f9dd521f640 1 -- 172.21.15.99:0/3002131212 wait complete. 2024-09-17T00:54:42.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:42.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:42.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:42.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:42.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:54:42.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:42.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:54:42.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-17T00:54:42.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-17T00:54:42.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:54:42.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:54:42.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/3002131212' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:54:42.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:42.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:42.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:42.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:42.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:42.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T00:54:42.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-17T00:54:42.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:43.553 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:54:43.553 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:54:43.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:43 smithi002 ceph-mon[27650]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:54:43.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:43 smithi002 ceph-mon[27650]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:54:43.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:43 smithi002 ceph-mon[27650]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T00:54:43.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:43 smithi002 ceph-mon[27650]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T00:54:43.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:43 smithi002 ceph-mon[27650]: Deploying daemon crash.smithi099 on smithi099 2024-09-17T00:54:43.804 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:54:45.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.465+0000 7fc6d1130640 1 -- 172.21.15.99:0/2045586590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6cc102260 msgr2=0x7fc6cc102630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:45.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.465+0000 7fc6d1130640 1 --2- 172.21.15.99:0/2045586590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6cc102260 0x7fc6cc102630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc004850 tx=0x7fc6bc009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:45.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.465+0000 7fc6d1130640 1 -- 172.21.15.99:0/2045586590 shutdown_connections 2024-09-17T00:54:45.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.465+0000 7fc6d1130640 1 --2- 172.21.15.99:0/2045586590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6cc102260 0x7fc6cc102630 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:45.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.465+0000 7fc6d1130640 1 -- 172.21.15.99:0/2045586590 >> 172.21.15.99:0/2045586590 conn(0x7fc6cc0717c0 msgr2=0x7fc6cc071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:45.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.465+0000 7fc6d1130640 1 -- 172.21.15.99:0/2045586590 shutdown_connections 2024-09-17T00:54:45.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.465+0000 7fc6d1130640 1 -- 172.21.15.99:0/2045586590 wait complete. 2024-09-17T00:54:45.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.466+0000 7fc6d1130640 1 Processor -- start 2024-09-17T00:54:45.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.466+0000 7fc6d1130640 1 -- start start 2024-09-17T00:54:45.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.466+0000 7fc6d1130640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6cc102260 0x7fc6cc1128c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:45.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.466+0000 7fc6d1130640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc112e00 con 0x7fc6cc102260 2024-09-17T00:54:45.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.467+0000 7fc6cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6cc102260 0x7fc6cc1128c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:45.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.467+0000 7fc6cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6cc102260 0x7fc6cc1128c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.99:41488/0 (socket says 172.21.15.99:41488) 2024-09-17T00:54:45.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.467+0000 7fc6cad9d640 1 -- 172.21.15.99:0/4087904123 learned_addr learned my addr 172.21.15.99:0/4087904123 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:54:45.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.467+0000 7fc6cad9d640 1 -- 172.21.15.99:0/4087904123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc005040 con 0x7fc6cc102260 2024-09-17T00:54:45.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.467+0000 7fc6cad9d640 1 --2- 172.21.15.99:0/4087904123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6cc102260 0x7fc6cc1128c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0048b0 tx=0x7fc6bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:45.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.467+0000 7fc6b37fe640 1 -- 172.21.15.99:0/4087904123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6bc033700 con 0x7fc6cc102260 2024-09-17T00:54:45.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.467+0000 7fc6d1130640 1 -- 172.21.15.99:0/4087904123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc113000 con 0x7fc6cc102260 2024-09-17T00:54:45.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.467+0000 7fc6b37fe640 1 -- 172.21.15.99:0/4087904123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc6bc033d00 con 0x7fc6cc102260 2024-09-17T00:54:45.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.467+0000 7fc6b37fe640 1 -- 172.21.15.99:0/4087904123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6bc03dd50 con 0x7fc6cc102260 2024-09-17T00:54:45.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.467+0000 7fc6d1130640 1 -- 172.21.15.99:0/4087904123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc1133f0 con 0x7fc6cc102260 2024-09-17T00:54:45.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.468+0000 7fc6d1130640 1 -- 172.21.15.99:0/4087904123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc0fdb70 con 0x7fc6cc102260 2024-09-17T00:54:45.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.468+0000 7fc6b37fe640 1 -- 172.21.15.99:0/4087904123 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 45618+0+0 (secure 0 0 0) 0x7fc6bc030020 con 0x7fc6cc102260 2024-09-17T00:54:45.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.469+0000 7fc6b37fe640 1 --2- 172.21.15.99:0/4087904123 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc6b4039670 0x7fc6b403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:45.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.469+0000 7fc6b37fe640 1 -- 172.21.15.99:0/4087904123 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fc6bc06cb80 con 0x7fc6cc102260 2024-09-17T00:54:45.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.469+0000 7fc6ca59c640 1 --2- 172.21.15.99:0/4087904123 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc6b4039670 0x7fc6b403bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:45.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.469+0000 7fc6ca59c640 1 --2- 172.21.15.99:0/4087904123 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc6b4039670 0x7fc6b403bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0006fd0 tx=0x7fc6c0006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:45.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.473+0000 7fc6b37fe640 1 -- 172.21.15.99:0/4087904123 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc6bc03b580 con 0x7fc6cc102260 2024-09-17T00:54:45.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.692+0000 7fc6d1130640 1 -- 172.21.15.99:0/4087904123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc6cc106490 con 0x7fc6cc102260 2024-09-17T00:54:45.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.693+0000 7fc6b37fe640 1 -- 172.21.15.99:0/4087904123 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fc6bc045b40 con 0x7fc6cc102260 2024-09-17T00:54:45.691 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:54:45.691 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":1,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:52:33.781919Z","created":"2024-09-17T00:52:33.781919Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:54:45.691 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 1 2024-09-17T00:54:45.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.695+0000 7fc6d1130640 1 -- 172.21.15.99:0/4087904123 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc6b4039670 msgr2=0x7fc6b403bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:45.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.695+0000 7fc6d1130640 1 --2- 172.21.15.99:0/4087904123 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc6b4039670 0x7fc6b403bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0006fd0 tx=0x7fc6c0006db0 comp rx=0 tx=0).stop 2024-09-17T00:54:45.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.695+0000 7fc6d1130640 1 -- 172.21.15.99:0/4087904123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6cc102260 msgr2=0x7fc6cc1128c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:45.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.695+0000 7fc6d1130640 1 --2- 172.21.15.99:0/4087904123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6cc102260 0x7fc6cc1128c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0048b0 tx=0x7fc6bc009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:45.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.695+0000 7fc6d1130640 1 -- 172.21.15.99:0/4087904123 shutdown_connections 2024-09-17T00:54:45.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.695+0000 7fc6d1130640 1 --2- 172.21.15.99:0/4087904123 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc6b4039670 0x7fc6b403bb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:45.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.695+0000 7fc6d1130640 1 --2- 172.21.15.99:0/4087904123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc6cc102260 0x7fc6cc1128c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:45.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.695+0000 7fc6d1130640 1 -- 172.21.15.99:0/4087904123 >> 172.21.15.99:0/4087904123 conn(0x7fc6cc0717c0 msgr2=0x7fc6cc102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:45.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.695+0000 7fc6d1130640 1 -- 172.21.15.99:0/4087904123 shutdown_connections 2024-09-17T00:54:45.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:45.695+0000 7fc6d1130640 1 -- 172.21.15.99:0/4087904123 wait complete. 2024-09-17T00:54:46.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:45 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/4087904123' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:54:47.323 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:54:47.324 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:54:47.610 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:54:47.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:47 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:47.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:47 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:47.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:47 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:47.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:47 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:47.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:47 smithi002 ceph-mon[27650]: Deploying daemon node-exporter.smithi099 on smithi099 2024-09-17T00:54:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.953+0000 7fababa40640 1 -- 172.21.15.99:0/1700296507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fd1f0 msgr2=0x7faba40fd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.953+0000 7fababa40640 1 --2- 172.21.15.99:0/1700296507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fd1f0 0x7faba40fd5c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fab94009bd0 tx=0x7fab94004d10 comp rx=0 tx=0).stop 2024-09-17T00:54:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.953+0000 7fababa40640 1 -- 172.21.15.99:0/1700296507 shutdown_connections 2024-09-17T00:54:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.953+0000 7fababa40640 1 --2- 172.21.15.99:0/1700296507 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fd1f0 0x7faba40fd5c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.953+0000 7fababa40640 1 -- 172.21.15.99:0/1700296507 >> 172.21.15.99:0/1700296507 conn(0x7faba40f6d10 msgr2=0x7faba40f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.953+0000 7fababa40640 1 -- 172.21.15.99:0/1700296507 shutdown_connections 2024-09-17T00:54:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.953+0000 7fababa40640 1 -- 172.21.15.99:0/1700296507 wait complete. 2024-09-17T00:54:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.953+0000 7fababa40640 1 Processor -- start 2024-09-17T00:54:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.953+0000 7fababa40640 1 -- start start 2024-09-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.953+0000 7fababa40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fd1f0 0x7faba41127c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.953+0000 7fababa40640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4112d00 con 0x7faba40fd1f0 2024-09-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.954+0000 7faba97dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fd1f0 0x7faba41127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.954+0000 7faba97dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fd1f0 0x7faba41127c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.99:49512/0 (socket says 172.21.15.99:49512) 2024-09-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.954+0000 7faba97dc640 1 -- 172.21.15.99:0/998993580 learned_addr learned my addr 172.21.15.99:0/998993580 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.954+0000 7faba97dc640 1 -- 172.21.15.99:0/998993580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab940098b0 con 0x7faba40fd1f0 2024-09-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.954+0000 7faba97dc640 1 --2- 172.21.15.99:0/998993580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fd1f0 0x7faba41127c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fab94009ba0 tx=0x7fab94004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.955+0000 7faba1ffb640 1 -- 172.21.15.99:0/998993580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab940327a0 con 0x7faba40fd1f0 2024-09-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.955+0000 7fababa40640 1 -- 172.21.15.99:0/998993580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba4112f00 con 0x7faba40fd1f0 2024-09-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.955+0000 7faba1ffb640 1 -- 172.21.15.99:0/998993580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fab94032da0 con 0x7faba40fd1f0 2024-09-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.955+0000 7faba1ffb640 1 -- 172.21.15.99:0/998993580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab9403dd80 con 0x7faba40fd1f0 2024-09-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.955+0000 7fababa40640 1 -- 172.21.15.99:0/998993580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba4113350 con 0x7faba40fd1f0 2024-09-17T00:54:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.956+0000 7faba1ffb640 1 -- 172.21.15.99:0/998993580 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 45618+0+0 (secure 0 0 0) 0x7fab9402f030 con 0x7faba40fd1f0 2024-09-17T00:54:50.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.956+0000 7fababa40640 1 -- 172.21.15.99:0/998993580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba4065aa0 con 0x7faba40fd1f0 2024-09-17T00:54:50.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.956+0000 7faba1ffb640 1 --2- 172.21.15.99:0/998993580 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fab8c039620 0x7fab8c03bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:50.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.956+0000 7faba1ffb640 1 -- 172.21.15.99:0/998993580 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fab9406da70 con 0x7faba40fd1f0 2024-09-17T00:54:50.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.956+0000 7faba8fdb640 1 --2- 172.21.15.99:0/998993580 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fab8c039620 0x7fab8c03bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:50.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.957+0000 7faba8fdb640 1 --2- 172.21.15.99:0/998993580 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fab8c039620 0x7fab8c03bad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fab98006fd0 tx=0x7fab98006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:50.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:49.961+0000 7faba1ffb640 1 -- 172.21.15.99:0/998993580 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fab9404e530 con 0x7faba40fd1f0 2024-09-17T00:54:50.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:50.183+0000 7fababa40640 1 -- 172.21.15.99:0/998993580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7faba404b720 con 0x7faba40fd1f0 2024-09-17T00:54:50.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:50.184+0000 7faba1ffb640 1 -- 172.21.15.99:0/998993580 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fab9404e350 con 0x7faba40fd1f0 2024-09-17T00:54:50.182 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:54:50.182 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":1,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:52:33.781919Z","created":"2024-09-17T00:52:33.781919Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:54:50.182 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 1 2024-09-17T00:54:50.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:50.186+0000 7fababa40640 1 -- 172.21.15.99:0/998993580 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fab8c039620 msgr2=0x7fab8c03bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:50.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:50.186+0000 7fababa40640 1 --2- 172.21.15.99:0/998993580 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fab8c039620 0x7fab8c03bad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fab98006fd0 tx=0x7fab98006db0 comp rx=0 tx=0).stop 2024-09-17T00:54:50.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:50.186+0000 7fababa40640 1 -- 172.21.15.99:0/998993580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fd1f0 msgr2=0x7faba41127c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:50.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:50.186+0000 7fababa40640 1 --2- 172.21.15.99:0/998993580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fd1f0 0x7faba41127c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fab94009ba0 tx=0x7fab94004d10 comp rx=0 tx=0).stop 2024-09-17T00:54:50.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:50.186+0000 7fababa40640 1 -- 172.21.15.99:0/998993580 shutdown_connections 2024-09-17T00:54:50.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:50.186+0000 7fababa40640 1 --2- 172.21.15.99:0/998993580 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fab8c039620 0x7fab8c03bad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:50.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:50.186+0000 7fababa40640 1 --2- 172.21.15.99:0/998993580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fd1f0 0x7faba41127c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:50.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:50.186+0000 7fababa40640 1 -- 172.21.15.99:0/998993580 >> 172.21.15.99:0/998993580 conn(0x7faba40f6d10 msgr2=0x7faba4102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:50.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:50.186+0000 7fababa40640 1 -- 172.21.15.99:0/998993580 shutdown_connections 2024-09-17T00:54:50.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:50.186+0000 7fababa40640 1 -- 172.21.15.99:0/998993580 wait complete. 2024-09-17T00:54:50.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:50 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/998993580' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:54:52.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:52.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:52.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:52.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:52.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.vswzrb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T00:54:52.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.vswzrb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T00:54:52.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T00:54:52.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:52.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:51 smithi002 ceph-mon[27650]: Deploying daemon mgr.smithi099.vswzrb on smithi099 2024-09-17T00:54:52.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:52.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:54:52.220 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:54:52.220 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:54:52.478 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:54:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.202+0000 7f99070f5640 1 -- 172.21.15.99:0/1953380395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99001010d0 msgr2=0x7f99001014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.202+0000 7f99070f5640 1 --2- 172.21.15.99:0/1953380395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99001010d0 0x7f99001014a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f98fc004850 tx=0x7f98fc009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.202+0000 7f99070f5640 1 -- 172.21.15.99:0/1953380395 shutdown_connections 2024-09-17T00:54:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.202+0000 7f99070f5640 1 --2- 172.21.15.99:0/1953380395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99001010d0 0x7f99001014a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.202+0000 7f99070f5640 1 -- 172.21.15.99:0/1953380395 >> 172.21.15.99:0/1953380395 conn(0x7f99000f6cc0 msgr2=0x7f99000f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.202+0000 7f99070f5640 1 -- 172.21.15.99:0/1953380395 shutdown_connections 2024-09-17T00:54:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.202+0000 7f99070f5640 1 -- 172.21.15.99:0/1953380395 wait complete. 2024-09-17T00:54:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.203+0000 7f99070f5640 1 Processor -- start 2024-09-17T00:54:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.203+0000 7f99070f5640 1 -- start start 2024-09-17T00:54:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.203+0000 7f99070f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99001010d0 0x7f99000f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.203+0000 7f99070f5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99000f9140 con 0x7f99001010d0 2024-09-17T00:54:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.203+0000 7f9904e91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99001010d0 0x7f99000f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.203+0000 7f9904e91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99001010d0 0x7f99000f7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.99:49542/0 (socket says 172.21.15.99:49542) 2024-09-17T00:54:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.203+0000 7f9904e91640 1 -- 172.21.15.99:0/2624709559 learned_addr learned my addr 172.21.15.99:0/2624709559 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:54:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.204+0000 7f9904e91640 1 -- 172.21.15.99:0/2624709559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc005040 con 0x7f99001010d0 2024-09-17T00:54:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.204+0000 7f9904e91640 1 --2- 172.21.15.99:0/2624709559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99001010d0 0x7f99000f7160 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f98fc004820 tx=0x7f98fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.204+0000 7f98f57fa640 1 -- 172.21.15.99:0/2624709559 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98fc033630 con 0x7f99001010d0 2024-09-17T00:54:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.204+0000 7f99070f5640 1 -- 172.21.15.99:0/2624709559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99000f7700 con 0x7f99001010d0 2024-09-17T00:54:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.204+0000 7f98f57fa640 1 -- 172.21.15.99:0/2624709559 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f98fc033c30 con 0x7f99001010d0 2024-09-17T00:54:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.204+0000 7f98f57fa640 1 -- 172.21.15.99:0/2624709559 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98fc03dcc0 con 0x7f99001010d0 2024-09-17T00:54:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.204+0000 7f99070f5640 1 -- 172.21.15.99:0/2624709559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99000f7bd0 con 0x7f99001010d0 2024-09-17T00:54:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.205+0000 7f99070f5640 1 -- 172.21.15.99:0/2624709559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99000f9310 con 0x7f99001010d0 2024-09-17T00:54:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.205+0000 7f98f57fa640 1 -- 172.21.15.99:0/2624709559 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 45618+0+0 (secure 0 0 0) 0x7f98fc030020 con 0x7f99001010d0 2024-09-17T00:54:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.205+0000 7f98f57fa640 1 --2- 172.21.15.99:0/2624709559 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f98e8039670 0x7f98e803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.205+0000 7f98f57fa640 1 -- 172.21.15.99:0/2624709559 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f98fc06cb80 con 0x7f99001010d0 2024-09-17T00:54:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.205+0000 7f98f7fff640 1 --2- 172.21.15.99:0/2624709559 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f98e8039670 0x7f98e803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.206+0000 7f98f7fff640 1 --2- 172.21.15.99:0/2624709559 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f98e8039670 0x7f98e803bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f98f0006fd0 tx=0x7f98f0006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:54.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.210+0000 7f98f57fa640 1 -- 172.21.15.99:0/2624709559 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f98fc033da0 con 0x7f99001010d0 2024-09-17T00:54:54.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.431+0000 7f99070f5640 1 -- 172.21.15.99:0/2624709559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f990005edc0 con 0x7f99001010d0 2024-09-17T00:54:54.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.432+0000 7f98f57fa640 1 -- 172.21.15.99:0/2624709559 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f98fc06ce60 con 0x7f99001010d0 2024-09-17T00:54:54.430 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:54:54.430 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":1,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:52:33.781919Z","created":"2024-09-17T00:52:33.781919Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:54:54.430 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 1 2024-09-17T00:54:54.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.433+0000 7f99070f5640 1 -- 172.21.15.99:0/2624709559 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f98e8039670 msgr2=0x7f98e803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:54.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.433+0000 7f99070f5640 1 --2- 172.21.15.99:0/2624709559 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f98e8039670 0x7f98e803bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f98f0006fd0 tx=0x7f98f0006db0 comp rx=0 tx=0).stop 2024-09-17T00:54:54.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.433+0000 7f99070f5640 1 -- 172.21.15.99:0/2624709559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99001010d0 msgr2=0x7f99000f7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:54.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.433+0000 7f99070f5640 1 --2- 172.21.15.99:0/2624709559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99001010d0 0x7f99000f7160 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f98fc004820 tx=0x7f98fc009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:54.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.433+0000 7f99070f5640 1 -- 172.21.15.99:0/2624709559 shutdown_connections 2024-09-17T00:54:54.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.433+0000 7f99070f5640 1 --2- 172.21.15.99:0/2624709559 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f98e8039670 0x7f98e803bb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:54.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.434+0000 7f99070f5640 1 --2- 172.21.15.99:0/2624709559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99001010d0 0x7f99000f7160 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:54.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.434+0000 7f99070f5640 1 -- 172.21.15.99:0/2624709559 >> 172.21.15.99:0/2624709559 conn(0x7f99000f6cc0 msgr2=0x7f9900065820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:54.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.434+0000 7f99070f5640 1 -- 172.21.15.99:0/2624709559 shutdown_connections 2024-09-17T00:54:54.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:54.434+0000 7f99070f5640 1 -- 172.21.15.99:0/2624709559 wait complete. 2024-09-17T00:54:54.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:54 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/2624709559' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:54:56.282 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:54:56.282 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:54:56.611 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:54:56.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:56 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:56.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:56 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:56.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:56 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:56.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:56 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:56.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:56 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:54:56.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:56 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:54:56.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:56 smithi002 ceph-mon[27650]: Deploying daemon mon.smithi099 on smithi099 2024-09-17T00:54:56.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:56 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:54:57.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:57 smithi002 ceph-mon[27650]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.849+0000 7ff62d017640 1 -- 172.21.15.99:0/3704130164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6281010e0 msgr2=0x7ff6281014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.849+0000 7ff62d017640 1 --2- 172.21.15.99:0/3704130164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6281010e0 0x7ff6281014b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff618004850 tx=0x7ff618009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.849+0000 7ff62d017640 1 -- 172.21.15.99:0/3704130164 shutdown_connections 2024-09-17T00:54:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.849+0000 7ff62d017640 1 --2- 172.21.15.99:0/3704130164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6281010e0 0x7ff6281014b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.849+0000 7ff62d017640 1 -- 172.21.15.99:0/3704130164 >> 172.21.15.99:0/3704130164 conn(0x7ff6280710b0 msgr2=0x7ff6280714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.849+0000 7ff62d017640 1 -- 172.21.15.99:0/3704130164 shutdown_connections 2024-09-17T00:54:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.849+0000 7ff62d017640 1 -- 172.21.15.99:0/3704130164 wait complete. 2024-09-17T00:54:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.850+0000 7ff62d017640 1 Processor -- start 2024-09-17T00:54:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.850+0000 7ff62d017640 1 -- start start 2024-09-17T00:54:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.850+0000 7ff62d017640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6281010e0 0x7ff62810d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.850+0000 7ff62d017640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff628065910 con 0x7ff6281010e0 2024-09-17T00:54:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.850+0000 7ff626d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6281010e0 0x7ff62810d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.850+0000 7ff626d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6281010e0 0x7ff62810d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.99:41078/0 (socket says 172.21.15.99:41078) 2024-09-17T00:54:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.850+0000 7ff626d9d640 1 -- 172.21.15.99:0/1620803199 learned_addr learned my addr 172.21.15.99:0/1620803199 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:54:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.850+0000 7ff626d9d640 1 -- 172.21.15.99:0/1620803199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff618005040 con 0x7ff6281010e0 2024-09-17T00:54:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.851+0000 7ff626d9d640 1 --2- 172.21.15.99:0/1620803199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6281010e0 0x7ff62810d930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff61802a6d0 tx=0x7ff618009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.851+0000 7ff60f7fe640 1 -- 172.21.15.99:0/1620803199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff61802cf10 con 0x7ff6281010e0 2024-09-17T00:54:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.851+0000 7ff62d017640 1 -- 172.21.15.99:0/1620803199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62810df30 con 0x7ff6281010e0 2024-09-17T00:54:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.851+0000 7ff60f7fe640 1 -- 172.21.15.99:0/1620803199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff618033ad0 con 0x7ff6281010e0 2024-09-17T00:54:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.851+0000 7ff60f7fe640 1 -- 172.21.15.99:0/1620803199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff61803ebb0 con 0x7ff6281010e0 2024-09-17T00:54:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.851+0000 7ff62d017640 1 -- 172.21.15.99:0/1620803199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62810e380 con 0x7ff6281010e0 2024-09-17T00:54:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.852+0000 7ff62d017640 1 -- 172.21.15.99:0/1620803199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6280fc850 con 0x7ff6281010e0 2024-09-17T00:54:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.852+0000 7ff60f7fe640 1 -- 172.21.15.99:0/1620803199 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 45618+0+0 (secure 0 0 0) 0x7ff618030020 con 0x7ff6281010e0 2024-09-17T00:54:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.852+0000 7ff60f7fe640 1 --2- 172.21.15.99:0/1620803199 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff610039670 0x7ff61003bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:54:58.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.852+0000 7ff60f7fe640 1 -- 172.21.15.99:0/1620803199 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ff61806c7b0 con 0x7ff6281010e0 2024-09-17T00:54:58.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.852+0000 7ff62659c640 1 --2- 172.21.15.99:0/1620803199 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff610039670 0x7ff61003bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:54:58.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.853+0000 7ff62659c640 1 --2- 172.21.15.99:0/1620803199 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff610039670 0x7ff61003bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff61c006fd0 tx=0x7ff61c006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:54:58.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:58.857+0000 7ff60f7fe640 1 -- 172.21.15.99:0/1620803199 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff61803cb10 con 0x7ff6281010e0 2024-09-17T00:54:59.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:59.082+0000 7ff62d017640 1 -- 172.21.15.99:0/1620803199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff62805ed70 con 0x7ff6281010e0 2024-09-17T00:54:59.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:59.083+0000 7ff60f7fe640 1 -- 172.21.15.99:0/1620803199 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7ff61803c330 con 0x7ff6281010e0 2024-09-17T00:54:59.080 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:54:59.081 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":1,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:52:33.781919Z","created":"2024-09-17T00:52:33.781919Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T00:54:59.081 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 1 2024-09-17T00:54:59.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:59.085+0000 7ff62d017640 1 -- 172.21.15.99:0/1620803199 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff610039670 msgr2=0x7ff61003bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:59.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:59.085+0000 7ff62d017640 1 --2- 172.21.15.99:0/1620803199 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff610039670 0x7ff61003bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff61c006fd0 tx=0x7ff61c006db0 comp rx=0 tx=0).stop 2024-09-17T00:54:59.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:59.085+0000 7ff62d017640 1 -- 172.21.15.99:0/1620803199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6281010e0 msgr2=0x7ff62810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:54:59.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:59.085+0000 7ff62d017640 1 --2- 172.21.15.99:0/1620803199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6281010e0 0x7ff62810d930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff61802a6d0 tx=0x7ff618009da0 comp rx=0 tx=0).stop 2024-09-17T00:54:59.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:59.085+0000 7ff62d017640 1 -- 172.21.15.99:0/1620803199 shutdown_connections 2024-09-17T00:54:59.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:59.085+0000 7ff62d017640 1 --2- 172.21.15.99:0/1620803199 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff610039670 0x7ff61003bb20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:59.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:59.085+0000 7ff62d017640 1 --2- 172.21.15.99:0/1620803199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff6281010e0 0x7ff62810d930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:54:59.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:59.085+0000 7ff62d017640 1 -- 172.21.15.99:0/1620803199 >> 172.21.15.99:0/1620803199 conn(0x7ff6280710b0 msgr2=0x7ff628102630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:54:59.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:59.085+0000 7ff62d017640 1 -- 172.21.15.99:0/1620803199 shutdown_connections 2024-09-17T00:54:59.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:54:59.085+0000 7ff62d017640 1 -- 172.21.15.99:0/1620803199 wait complete. 2024-09-17T00:54:59.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:59 smithi002 ceph-mon[27650]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:54:59.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:54:59 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/1620803199' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:55:00.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:00 smithi002 ceph-mon[27650]: Standby manager daemon smithi099.vswzrb started 2024-09-17T00:55:00.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:00 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/3441889343' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/crt"}]: dispatch 2024-09-17T00:55:00.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:00 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/3441889343' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T00:55:00.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:00 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/3441889343' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/key"}]: dispatch 2024-09-17T00:55:00.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:00 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/3441889343' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T00:55:01.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:00 smithi099 systemd[1]: Started Ceph mon.smithi099 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T00:55:01.403 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T00:55:01.403 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T00:55:01.645 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-17T00:55:06.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.211+0000 7f13a795d640 1 -- 172.21.15.99:0/1661265881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13880034f0 msgr2=0x7f1388005970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:55:06.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.211+0000 7f13a795d640 1 --2- 172.21.15.99:0/1661265881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13880034f0 0x7f1388005970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f13a00fc250 tx=0x7f139000b040 comp rx=0 tx=0).stop 2024-09-17T00:55:06.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.211+0000 7f13a795d640 1 -- 172.21.15.99:0/1661265881 shutdown_connections 2024-09-17T00:55:06.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.211+0000 7f13a795d640 1 --2- 172.21.15.99:0/1661265881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13880034f0 0x7f1388005970 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:06.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.211+0000 7f13a795d640 1 -- 172.21.15.99:0/1661265881 >> 172.21.15.99:0/1661265881 conn(0x7f13a00f7ec0 msgr2=0x7f13a00fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:55:06.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.211+0000 7f13a795d640 1 -- 172.21.15.99:0/1661265881 shutdown_connections 2024-09-17T00:55:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.211+0000 7f13a795d640 1 -- 172.21.15.99:0/1661265881 wait complete. 2024-09-17T00:55:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.212+0000 7f13a795d640 1 Processor -- start 2024-09-17T00:55:06.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.212+0000 7f13a795d640 1 -- start start 2024-09-17T00:55:06.211 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T00:55:06.212 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: mon.smithi002 calling monitor election 2024-09-17T00:55:06.212 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:55:06.212 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:55:06.212 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:06.212 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:55:06.213 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: mon.smithi099 calling monitor election 2024-09-17T00:55:06.213 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:55:06.213 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:06.213 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:55:06.213 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:55:06.213 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: mon.smithi002 is new leader, mons smithi002,smithi099 in quorum (ranks 0,1) 2024-09-17T00:55:06.213 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: monmap e2: 2 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0],smithi099=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T00:55:06.213 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: fsmap 2024-09-17T00:55:06.213 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T00:55:06.213 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: mgrmap e18: smithi002.vjeexr(active, since 29s), standbys: smithi099.vswzrb 2024-09-17T00:55:06.213 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: overall HEALTH_OK 2024-09-17T00:55:06.214 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:06.214 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:06.214 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:06.214 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:06.214 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:05 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:06.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.212+0000 7f13a795d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13880034f0 0x7f13a01128b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:55:06.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.212+0000 7f13a795d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13a0112df0 0x7f13a010c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:55:06.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.212+0000 7f13a795d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a01133b0 con 0x7f13880034f0 2024-09-17T00:55:06.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.212+0000 7f13a795d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a01134f0 con 0x7f13a0112df0 2024-09-17T00:55:06.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.212+0000 7f13a4ef8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13a0112df0 0x7f13a010c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:55:06.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.212+0000 7f13a4ef8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13a0112df0 0x7f13a010c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56914/0 (socket says 172.21.15.99:56914) 2024-09-17T00:55:06.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.212+0000 7f13a4ef8640 1 -- 172.21.15.99:0/3717270142 learned_addr learned my addr 172.21.15.99:0/3717270142 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:55:06.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.212+0000 7f13a4ef8640 1 -- 172.21.15.99:0/3717270142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13a0112df0 msgr2=0x7f13a010c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-17T00:55:06.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.212+0000 7f13a4ef8640 1 -- 172.21.15.99:0/3717270142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13a0112df0 msgr2=0x7f13a010c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T00:55:06.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.212+0000 7f13a56f9640 1 --2- 172.21.15.99:0/3717270142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13880034f0 0x7f13a01128b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:55:06.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.212+0000 7f13a4ef8640 1 --2- 172.21.15.99:0/3717270142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13a0112df0 0x7f13a010c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-17T00:55:06.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.213+0000 7f13a4ef8640 1 --2- 172.21.15.99:0/3717270142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13a0112df0 0x7f13a010c850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T00:55:06.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.213+0000 7f13a56f9640 1 -- 172.21.15.99:0/3717270142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13a0112df0 msgr2=0x7f13a010c850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T00:55:06.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.213+0000 7f13a56f9640 1 --2- 172.21.15.99:0/3717270142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13a0112df0 0x7f13a010c850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:06.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.213+0000 7f13a56f9640 1 -- 172.21.15.99:0/3717270142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1390005040 con 0x7f13880034f0 2024-09-17T00:55:06.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.213+0000 7f13a56f9640 1 --2- 172.21.15.99:0/3717270142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13880034f0 0x7f13a01128b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f13a00fc250 tx=0x7f139000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:55:06.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.213+0000 7f139dffb640 1 -- 172.21.15.99:0/3717270142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1390030a70 con 0x7f13880034f0 2024-09-17T00:55:06.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.213+0000 7f139dffb640 1 -- 172.21.15.99:0/3717270142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f139000f040 con 0x7f13880034f0 2024-09-17T00:55:06.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.213+0000 7f13a795d640 1 -- 172.21.15.99:0/3717270142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a010ce50 con 0x7f13880034f0 2024-09-17T00:55:06.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.213+0000 7f139dffb640 1 -- 172.21.15.99:0/3717270142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f139003c410 con 0x7f13880034f0 2024-09-17T00:55:06.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.213+0000 7f13a795d640 1 -- 172.21.15.99:0/3717270142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a010d3f0 con 0x7f13880034f0 2024-09-17T00:55:06.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.214+0000 7f13a795d640 1 -- 172.21.15.99:0/3717270142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a010d660 con 0x7f13880034f0 2024-09-17T00:55:06.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.215+0000 7f139dffb640 1 -- 172.21.15.99:0/3717270142 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90809+0+0 (secure 0 0 0) 0x7f139003e440 con 0x7f13880034f0 2024-09-17T00:55:06.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.216+0000 7f139dffb640 1 --2- 172.21.15.99:0/3717270142 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f138c06edd0 0x7f138c071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:55:06.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.216+0000 7f139dffb640 1 -- 172.21.15.99:0/3717270142 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f13900ae2f0 con 0x7f13880034f0 2024-09-17T00:55:06.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.216+0000 7f13a4ef8640 1 --2- 172.21.15.99:0/3717270142 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f138c06edd0 0x7f138c071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:55:06.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.216+0000 7f13a4ef8640 1 --2- 172.21.15.99:0/3717270142 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f138c06edd0 0x7f138c071280 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1394009650 tx=0x7f1394009050 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:55:06.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.220+0000 7f139dffb640 1 -- 172.21.15.99:0/3717270142 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f139007c450 con 0x7f13880034f0 2024-09-17T00:55:06.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T00:55:06.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: mon.smithi002 calling monitor election 2024-09-17T00:55:06.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:55:06.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:55:06.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:06.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:55:06.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: mon.smithi099 calling monitor election 2024-09-17T00:55:06.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:55:06.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:06.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:55:06.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:55:06.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: mon.smithi002 is new leader, mons smithi002,smithi099 in quorum (ranks 0,1) 2024-09-17T00:55:06.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: monmap e2: 2 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0],smithi099=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T00:55:06.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: fsmap 2024-09-17T00:55:06.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T00:55:06.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: mgrmap e18: smithi002.vjeexr(active, since 29s), standbys: smithi099.vswzrb 2024-09-17T00:55:06.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: overall HEALTH_OK 2024-09-17T00:55:06.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:06.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:06.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:06.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:06.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:05 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:06.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.464+0000 7f13a795d640 1 -- 172.21.15.99:0/3717270142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f13a00fdab0 con 0x7f13880034f0 2024-09-17T00:55:06.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.464+0000 7f139dffb640 1 -- 172.21.15.99:0/3717270142 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1009 (secure 0 0 0) 0x7f1390042410 con 0x7f13880034f0 2024-09-17T00:55:06.466 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:55:06.466 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":2,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","modified":"2024-09-17T00:55:00.889701Z","created":"2024-09-17T00:52:33.781919Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-17T00:55:06.466 INFO:teuthology.orchestra.run.smithi099.stderr:dumped monmap epoch 2 2024-09-17T00:55:06.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.466+0000 7f13a795d640 1 -- 172.21.15.99:0/3717270142 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f138c06edd0 msgr2=0x7f138c071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:55:06.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.466+0000 7f13a795d640 1 --2- 172.21.15.99:0/3717270142 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f138c06edd0 0x7f138c071280 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1394009650 tx=0x7f1394009050 comp rx=0 tx=0).stop 2024-09-17T00:55:06.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.466+0000 7f13a795d640 1 -- 172.21.15.99:0/3717270142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13880034f0 msgr2=0x7f13a01128b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:55:06.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.466+0000 7f13a795d640 1 --2- 172.21.15.99:0/3717270142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13880034f0 0x7f13a01128b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f13a00fc250 tx=0x7f139000b040 comp rx=0 tx=0).stop 2024-09-17T00:55:06.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.466+0000 7f13a795d640 1 -- 172.21.15.99:0/3717270142 shutdown_connections 2024-09-17T00:55:06.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.466+0000 7f13a795d640 1 --2- 172.21.15.99:0/3717270142 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f138c06edd0 0x7f138c071280 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:06.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.466+0000 7f13a795d640 1 --2- 172.21.15.99:0/3717270142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13a0112df0 0x7f13a010c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:06.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.466+0000 7f13a795d640 1 --2- 172.21.15.99:0/3717270142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13880034f0 0x7f13a01128b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:06.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.466+0000 7f13a795d640 1 -- 172.21.15.99:0/3717270142 >> 172.21.15.99:0/3717270142 conn(0x7f13a00f7ec0 msgr2=0x7f13a0105740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:55:06.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.466+0000 7f13a795d640 1 -- 172.21.15.99:0/3717270142 shutdown_connections 2024-09-17T00:55:06.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:55:06.466+0000 7f13a795d640 1 -- 172.21.15.99:0/3717270142 wait complete. 2024-09-17T00:55:07.254 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:07.254 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:06 smithi099 ceph-mon[34357]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:07.254 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:55:07.254 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:07.254 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:06 smithi099 ceph-mon[34357]: from='client.? 172.21.15.99:0/3717270142' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:55:07.254 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:55:07.279 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-17T00:55:07.279 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-17T00:55:07.308 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:07.308 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:06 smithi002 ceph-mon[27650]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:07.308 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:55:07.308 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:07.308 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:06 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/3717270142' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T00:55:07.309 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:55:07.547 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:55:09.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.020+0000 7fb94364f640 1 -- 172.21.15.2:0/870265756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb93c1021e0 msgr2=0x7fb93c1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:55:09.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.020+0000 7fb94364f640 1 --2- 172.21.15.2:0/870265756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb93c1021e0 0x7fb93c1025b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb938004850 tx=0x7fb938009da0 comp rx=0 tx=0).stop 2024-09-17T00:55:09.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.021+0000 7fb94364f640 1 -- 172.21.15.2:0/870265756 shutdown_connections 2024-09-17T00:55:09.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.021+0000 7fb94364f640 1 --2- 172.21.15.2:0/870265756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb93c1021e0 0x7fb93c1025b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:09.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.021+0000 7fb94364f640 1 -- 172.21.15.2:0/870265756 >> 172.21.15.2:0/870265756 conn(0x7fb93c0710b0 msgr2=0x7fb93c0714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:55:09.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.021+0000 7fb94364f640 1 -- 172.21.15.2:0/870265756 shutdown_connections 2024-09-17T00:55:09.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.021+0000 7fb94364f640 1 -- 172.21.15.2:0/870265756 wait complete. 2024-09-17T00:55:09.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.021+0000 7fb94364f640 1 Processor -- start 2024-09-17T00:55:09.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.021+0000 7fb94364f640 1 -- start start 2024-09-17T00:55:09.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.021+0000 7fb94364f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb93c1021e0 0x7fb93c112890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:55:09.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.021+0000 7fb94364f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93c112dd0 0x7fb93c10c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:55:09.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.021+0000 7fb94364f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c113390 con 0x7fb93c1021e0 2024-09-17T00:55:09.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.021+0000 7fb94364f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c1134d0 con 0x7fb93c112dd0 2024-09-17T00:55:09.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.022+0000 7fb9413eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb93c1021e0 0x7fb93c112890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:55:09.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.022+0000 7fb9413eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb93c1021e0 0x7fb93c112890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58240/0 (socket says 172.21.15.2:58240) 2024-09-17T00:55:09.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.022+0000 7fb9413eb640 1 -- 172.21.15.2:0/2961830202 learned_addr learned my addr 172.21.15.2:0/2961830202 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:55:09.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.022+0000 7fb940bea640 1 --2- 172.21.15.2:0/2961830202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93c112dd0 0x7fb93c10c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:55:09.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.022+0000 7fb9413eb640 1 -- 172.21.15.2:0/2961830202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93c112dd0 msgr2=0x7fb93c10c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:55:09.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.022+0000 7fb9413eb640 1 --2- 172.21.15.2:0/2961830202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93c112dd0 0x7fb93c10c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:09.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.022+0000 7fb9413eb640 1 -- 172.21.15.2:0/2961830202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb938005040 con 0x7fb93c1021e0 2024-09-17T00:55:09.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.022+0000 7fb9413eb640 1 --2- 172.21.15.2:0/2961830202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb93c1021e0 0x7fb93c112890 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb938003080 tx=0x7fb938009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:55:09.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.022+0000 7fb931ffb640 1 -- 172.21.15.2:0/2961830202 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb938038070 con 0x7fb93c1021e0 2024-09-17T00:55:09.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.022+0000 7fb931ffb640 1 -- 172.21.15.2:0/2961830202 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb938032b50 con 0x7fb93c1021e0 2024-09-17T00:55:09.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.022+0000 7fb94364f640 1 -- 172.21.15.2:0/2961830202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c10ce30 con 0x7fb93c1021e0 2024-09-17T00:55:09.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.022+0000 7fb931ffb640 1 -- 172.21.15.2:0/2961830202 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93803ec00 con 0x7fb93c1021e0 2024-09-17T00:55:09.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.023+0000 7fb94364f640 1 -- 172.21.15.2:0/2961830202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c10d350 con 0x7fb93c1021e0 2024-09-17T00:55:09.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.024+0000 7fb94364f640 1 -- 172.21.15.2:0/2961830202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c0fd950 con 0x7fb93c1021e0 2024-09-17T00:55:09.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.024+0000 7fb931ffb640 1 -- 172.21.15.2:0/2961830202 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90809+0+0 (secure 0 0 0) 0x7fb938030020 con 0x7fb93c1021e0 2024-09-17T00:55:09.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.024+0000 7fb931ffb640 1 --2- 172.21.15.2:0/2961830202 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb92806edd0 0x7fb928071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:55:09.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.025+0000 7fb940bea640 1 --2- 172.21.15.2:0/2961830202 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb92806edd0 0x7fb928071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:55:09.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.025+0000 7fb931ffb640 1 -- 172.21.15.2:0/2961830202 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fb9380ad680 con 0x7fb93c1021e0 2024-09-17T00:55:09.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.025+0000 7fb940bea640 1 --2- 172.21.15.2:0/2961830202 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb92806edd0 0x7fb928071280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009ac0 tx=0x7fb92c008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:55:09.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.029+0000 7fb931ffb640 1 -- 172.21.15.2:0/2961830202 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb93807b880 con 0x7fb93c1021e0 2024-09-17T00:55:09.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.201+0000 7fb94364f640 1 -- 172.21.15.2:0/2961830202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fb93c1064a0 con 0x7fb93c1021e0 2024-09-17T00:55:09.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.202+0000 7fb931ffb640 1 -- 172.21.15.2:0/2961830202 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+221 (secure 0 0 0) 0x7fb9380ace30 con 0x7fb93c1021e0 2024-09-17T00:55:09.199 INFO:teuthology.orchestra.run.smithi002.stdout:# minimal ceph.conf for f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:55:09.199 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-09-17T00:55:09.200 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T00:55:09.200 INFO:teuthology.orchestra.run.smithi002.stdout: mon_host = [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-17T00:55:09.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.204+0000 7fb94364f640 1 -- 172.21.15.2:0/2961830202 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb92806edd0 msgr2=0x7fb928071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:55:09.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.204+0000 7fb94364f640 1 --2- 172.21.15.2:0/2961830202 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb92806edd0 0x7fb928071280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009ac0 tx=0x7fb92c008040 comp rx=0 tx=0).stop 2024-09-17T00:55:09.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.204+0000 7fb94364f640 1 -- 172.21.15.2:0/2961830202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb93c1021e0 msgr2=0x7fb93c112890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:55:09.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.204+0000 7fb94364f640 1 --2- 172.21.15.2:0/2961830202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb93c1021e0 0x7fb93c112890 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb938003080 tx=0x7fb938009da0 comp rx=0 tx=0).stop 2024-09-17T00:55:09.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.204+0000 7fb94364f640 1 -- 172.21.15.2:0/2961830202 shutdown_connections 2024-09-17T00:55:09.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.204+0000 7fb94364f640 1 --2- 172.21.15.2:0/2961830202 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb92806edd0 0x7fb928071280 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:09.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.204+0000 7fb94364f640 1 --2- 172.21.15.2:0/2961830202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb93c112dd0 0x7fb93c10c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:09.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.204+0000 7fb94364f640 1 --2- 172.21.15.2:0/2961830202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb93c1021e0 0x7fb93c112890 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:09.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.204+0000 7fb94364f640 1 -- 172.21.15.2:0/2961830202 >> 172.21.15.2:0/2961830202 conn(0x7fb93c0710b0 msgr2=0x7fb93c0fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:55:09.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.204+0000 7fb94364f640 1 -- 172.21.15.2:0/2961830202 shutdown_connections 2024-09-17T00:55:09.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:09.204+0000 7fb94364f640 1 -- 172.21.15.2:0/2961830202 wait complete. 2024-09-17T00:55:09.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:09.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:09.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:09.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:09.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:09.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-17T00:55:09.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-17T00:55:09.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:55:09.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:55:09.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:09.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:09.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:09.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:09.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:09.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:55:09.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T00:55:09.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:09.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:09 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2961830202' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:09.748 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-17T00:55:09.748 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:55:09.748 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T00:55:09.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:09.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:09.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:09.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:09.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:09.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-17T00:55:09.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-17T00:55:09.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:55:09.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T00:55:09.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:09.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:09.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:09.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:09.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:09.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:55:09.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T00:55:09.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:09.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:09 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/2961830202' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:09.816 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:55:09.816 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:55:09.882 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T00:55:09.883 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T00:55:09.915 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T00:55:09.915 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T00:55:09.985 INFO:tasks.cephadm:Deploying OSDs... 2024-09-17T00:55:09.986 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:55:09.986 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T00:55:10.002 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T00:55:10.002 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-09-17T00:55:10.059 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T00:55:10.059 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:55:10.060 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-17T00:55:10.060 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:55:10.060 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:55:10.060 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-17 00:54:30.034197226 +0000 2024-09-17T00:55:10.060 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-17 00:49:03.539392893 +0000 2024-09-17T00:55:10.060 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-17 00:49:03.539392893 +0000 2024-09-17T00:55:10.060 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-17 00:49:03.539392893 +0000 2024-09-17T00:55:10.060 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T00:55:10.125 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-17T00:55:10.125 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-17T00:55:10.125 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 9.2238e-05 s, 5.6 MB/s 2024-09-17T00:55:10.126 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T00:55:10.182 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-09-17T00:55:10.239 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T00:55:10.239 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:55:10.239 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-17T00:55:10.239 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:55:10.240 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:55:10.240 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-17 00:54:30.035197203 +0000 2024-09-17T00:55:10.240 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-17 00:49:03.866385534 +0000 2024-09-17T00:55:10.240 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-17 00:49:03.866385534 +0000 2024-09-17T00:55:10.240 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-17 00:49:03.866385534 +0000 2024-09-17T00:55:10.241 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T00:55:10.304 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-17T00:55:10.304 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-17T00:55:10.304 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000102832 s, 5.0 MB/s 2024-09-17T00:55:10.305 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T00:55:10.363 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-09-17T00:55:10.418 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T00:55:10.418 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:55:10.419 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-17T00:55:10.419 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:55:10.419 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:55:10.419 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-17 00:54:30.036197181 +0000 2024-09-17T00:55:10.419 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-17 00:49:04.170378691 +0000 2024-09-17T00:55:10.419 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-17 00:49:04.170378691 +0000 2024-09-17T00:55:10.419 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-17 00:49:04.170378691 +0000 2024-09-17T00:55:10.419 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T00:55:10.483 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-17T00:55:10.483 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-17T00:55:10.483 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000108506 s, 4.7 MB/s 2024-09-17T00:55:10.484 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T00:55:10.542 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-09-17T00:55:10.599 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T00:55:10.599 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:55:10.599 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-17T00:55:10.599 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:55:10.599 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:55:10.599 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-17 00:54:30.036197181 +0000 2024-09-17T00:55:10.599 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-17 00:49:04.480371715 +0000 2024-09-17T00:55:10.599 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-17 00:49:04.480371715 +0000 2024-09-17T00:55:10.599 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-17 00:49:04.480371715 +0000 2024-09-17T00:55:10.600 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T00:55:10.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:10 smithi002 ceph-mon[27650]: Reconfiguring mon.smithi002 (unknown last config time)... 2024-09-17T00:55:10.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:10 smithi002 ceph-mon[27650]: Reconfiguring daemon mon.smithi002 on smithi002 2024-09-17T00:55:10.663 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-17T00:55:10.663 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-17T00:55:10.663 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000105761 s, 4.8 MB/s 2024-09-17T00:55:10.664 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T00:55:10.721 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T00:55:10.722 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T00:55:10.742 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T00:55:10.742 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-09-17T00:55:10.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:10 smithi099 ceph-mon[34357]: Reconfiguring mon.smithi002 (unknown last config time)... 2024-09-17T00:55:10.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:10 smithi099 ceph-mon[34357]: Reconfiguring daemon mon.smithi002 on smithi002 2024-09-17T00:55:10.800 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T00:55:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:55:10.801 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-17T00:55:10.801 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:55:10.801 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:55:10.801 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-17 00:54:59.986838410 +0000 2024-09-17T00:55:10.801 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-17 00:48:59.894123544 +0000 2024-09-17T00:55:10.801 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-17 00:48:59.894123544 +0000 2024-09-17T00:55:10.801 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-17 00:48:59.894123544 +0000 2024-09-17T00:55:10.801 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T00:55:10.868 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-17T00:55:10.868 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-17T00:55:10.868 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000213937 s, 2.4 MB/s 2024-09-17T00:55:10.870 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T00:55:10.929 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-09-17T00:55:10.987 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T00:55:10.987 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:55:10.987 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-17T00:55:10.987 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:55:10.988 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:55:10.988 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-17 00:54:59.987838387 +0000 2024-09-17T00:55:10.988 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-17 00:49:00.212116346 +0000 2024-09-17T00:55:10.988 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-17 00:49:00.212116346 +0000 2024-09-17T00:55:10.988 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-17 00:49:00.212116346 +0000 2024-09-17T00:55:10.988 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T00:55:11.053 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-17T00:55:11.053 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-17T00:55:11.053 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000187113 s, 2.7 MB/s 2024-09-17T00:55:11.054 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T00:55:11.112 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-09-17T00:55:11.168 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T00:55:11.169 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:55:11.169 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-17T00:55:11.169 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:55:11.169 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:55:11.169 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-17 00:54:59.987838387 +0000 2024-09-17T00:55:11.169 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-17 00:49:00.539108943 +0000 2024-09-17T00:55:11.169 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-17 00:49:00.539108943 +0000 2024-09-17T00:55:11.169 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-17 00:49:00.539108943 +0000 2024-09-17T00:55:11.169 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T00:55:11.233 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-17T00:55:11.233 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-17T00:55:11.233 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000178707 s, 2.9 MB/s 2024-09-17T00:55:11.234 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T00:55:11.291 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-09-17T00:55:11.347 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T00:55:11.347 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T00:55:11.347 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-17T00:55:11.348 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T00:55:11.348 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T00:55:11.348 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-17 00:54:59.987838387 +0000 2024-09-17T00:55:11.348 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-17 00:49:00.880101224 +0000 2024-09-17T00:55:11.348 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-17 00:49:00.880101224 +0000 2024-09-17T00:55:11.348 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-17 00:49:00.880101224 +0000 2024-09-17T00:55:11.348 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T00:55:11.411 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-17T00:55:11.412 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-17T00:55:11.412 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000195742 s, 2.6 MB/s 2024-09-17T00:55:11.413 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T00:55:11.470 INFO:tasks.cephadm:Deploying osd.0 on smithi002 with /dev/vg_nvme/lv_4... 2024-09-17T00:55:11.470 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-17T00:55:11.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:11 smithi099 ceph-mon[34357]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:11.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:11 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:11.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:11 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:11.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:11 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.vjeexr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T00:55:11.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:11 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T00:55:11.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:11 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:11.634 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:11 smithi002 ceph-mon[27650]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:11.634 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:11 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:11.634 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:11 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:11.634 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:11 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.vjeexr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T00:55:11.635 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:11 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T00:55:11.635 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:11 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:11.906 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:55:12.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:12 smithi002 ceph-mon[27650]: Reconfiguring mgr.smithi002.vjeexr (unknown last config time)... 2024-09-17T00:55:12.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:12 smithi002 ceph-mon[27650]: Reconfiguring daemon mgr.smithi002.vjeexr on smithi002 2024-09-17T00:55:12.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:12 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:12.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:12 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:12.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:12 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T00:55:12.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:12 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:12.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:12 smithi099 ceph-mon[34357]: Reconfiguring mgr.smithi002.vjeexr (unknown last config time)... 2024-09-17T00:55:12.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:12 smithi099 ceph-mon[34357]: Reconfiguring daemon mgr.smithi002.vjeexr on smithi002 2024-09-17T00:55:12.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:12 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:12.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:12 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:12.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:12 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T00:55:12.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:12 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:13.774 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:13 smithi002 ceph-mon[27650]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:13.774 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:13 smithi002 ceph-mon[27650]: Reconfiguring crash.smithi002 (monmap changed)... 2024-09-17T00:55:13.774 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:13 smithi002 ceph-mon[27650]: Reconfiguring daemon crash.smithi002 on smithi002 2024-09-17T00:55:13.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:13 smithi099 ceph-mon[34357]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:13.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:13 smithi099 ceph-mon[34357]: Reconfiguring crash.smithi002 (monmap changed)... 2024-09-17T00:55:13.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:13 smithi099 ceph-mon[34357]: Reconfiguring daemon crash.smithi002 on smithi002 2024-09-17T00:55:14.449 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:55:14.472 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_4 2024-09-17T00:55:15.081 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:55:15.784 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:15 smithi002 ceph-mon[27650]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:15.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:15 smithi099 ceph-mon[34357]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:16.561 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:16 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:16.561 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:16 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:16.561 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:16 smithi002 ceph-mon[27650]: Reconfiguring alertmanager.smithi002 (dependencies changed)... 2024-09-17T00:55:16.561 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:16 smithi002 ceph-mon[27650]: Reconfiguring daemon alertmanager.smithi002 on smithi002 2024-09-17T00:55:16.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:16 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:16.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:16 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:16.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:16 smithi099 ceph-mon[34357]: Reconfiguring alertmanager.smithi002 (dependencies changed)... 2024-09-17T00:55:16.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:16 smithi099 ceph-mon[34357]: Reconfiguring daemon alertmanager.smithi002 on smithi002 2024-09-17T00:55:17.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.546+0000 7f0339b9e640 1 -- 172.21.15.2:0/1956398358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03340fb480 msgr2=0x7f03340fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:55:17.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.546+0000 7f0339b9e640 1 --2- 172.21.15.2:0/1956398358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03340fb480 0x7f03340fb890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f03240048d0 tx=0x7f0324009da0 comp rx=0 tx=0).stop 2024-09-17T00:55:17.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.546+0000 7f0339b9e640 1 -- 172.21.15.2:0/1956398358 shutdown_connections 2024-09-17T00:55:17.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.546+0000 7f0339b9e640 1 --2- 172.21.15.2:0/1956398358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03340fc750 0x7f03340fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:17.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.546+0000 7f0339b9e640 1 --2- 172.21.15.2:0/1956398358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03340fb480 0x7f03340fb890 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:17.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.546+0000 7f0339b9e640 1 -- 172.21.15.2:0/1956398358 >> 172.21.15.2:0/1956398358 conn(0x7f03340f6c40 msgr2=0x7f03340f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:55:17.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.546+0000 7f0339b9e640 1 -- 172.21.15.2:0/1956398358 shutdown_connections 2024-09-17T00:55:17.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.546+0000 7f0339b9e640 1 -- 172.21.15.2:0/1956398358 wait complete. 2024-09-17T00:55:17.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.546+0000 7f0339b9e640 1 Processor -- start 2024-09-17T00:55:17.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.546+0000 7f0339b9e640 1 -- start start 2024-09-17T00:55:17.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f0339b9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03340fb480 0x7f033410fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:55:17.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f0339b9e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03340fc750 0x7f0334112370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:55:17.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f0339b9e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0334066730 con 0x7f03340fb480 2024-09-17T00:55:17.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f0339b9e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03340668a0 con 0x7f03340fc750 2024-09-17T00:55:17.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f03337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03340fb480 0x7f033410fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:55:17.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f03337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03340fb480 0x7f033410fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33940/0 (socket says 172.21.15.2:33940) 2024-09-17T00:55:17.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f03337fe640 1 -- 172.21.15.2:0/653574045 learned_addr learned my addr 172.21.15.2:0/653574045 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:55:17.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f0332ffd640 1 --2- 172.21.15.2:0/653574045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03340fc750 0x7f0334112370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:55:17.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f03337fe640 1 -- 172.21.15.2:0/653574045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03340fc750 msgr2=0x7f0334112370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:55:17.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f03337fe640 1 --2- 172.21.15.2:0/653574045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03340fc750 0x7f0334112370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:17.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f03337fe640 1 -- 172.21.15.2:0/653574045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0324005040 con 0x7f03340fb480 2024-09-17T00:55:17.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f0332ffd640 1 --2- 172.21.15.2:0/653574045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03340fc750 0x7f0334112370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T00:55:17.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f03337fe640 1 --2- 172.21.15.2:0/653574045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03340fb480 0x7f033410fe20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0324003080 tx=0x7f0324009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:55:17.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f031bfff640 1 -- 172.21.15.2:0/653574045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0324038070 con 0x7f03340fb480 2024-09-17T00:55:17.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f031bfff640 1 -- 172.21.15.2:0/653574045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f032402ae90 con 0x7f03340fb480 2024-09-17T00:55:17.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f0339b9e640 1 -- 172.21.15.2:0/653574045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03341128b0 con 0x7f03340fb480 2024-09-17T00:55:17.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.547+0000 7f031bfff640 1 -- 172.21.15.2:0/653574045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0324033660 con 0x7f03340fb480 2024-09-17T00:55:17.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.548+0000 7f0339b9e640 1 -- 172.21.15.2:0/653574045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0334112e20 con 0x7f03340fb480 2024-09-17T00:55:17.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.549+0000 7f0339b9e640 1 -- 172.21.15.2:0/653574045 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03340fa8e0 con 0x7f03340fb480 2024-09-17T00:55:17.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.549+0000 7f031bfff640 1 -- 172.21.15.2:0/653574045 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90809+0+0 (secure 0 0 0) 0x7f0324030020 con 0x7f03340fb480 2024-09-17T00:55:17.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.549+0000 7f031bfff640 1 --2- 172.21.15.2:0/653574045 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f031c06ecc0 0x7f031c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:55:17.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.550+0000 7f031bfff640 1 -- 172.21.15.2:0/653574045 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f03240ad130 con 0x7f03340fb480 2024-09-17T00:55:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.550+0000 7f0332ffd640 1 --2- 172.21.15.2:0/653574045 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f031c06ecc0 0x7f031c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:55:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.550+0000 7f0332ffd640 1 --2- 172.21.15.2:0/653574045 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f031c06ecc0 0x7f031c071170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0328007fd0 tx=0x7f0328009e90 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:55:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.554+0000 7f031bfff640 1 -- 172.21.15.2:0/653574045 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f032407b3b0 con 0x7f03340fb480 2024-09-17T00:55:17.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:17.735+0000 7f0339b9e640 1 -- 172.21.15.2:0/653574045 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0334100ba0 con 0x7f031c06ecc0 2024-09-17T00:55:17.732 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:17 smithi002 ceph-mon[27650]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:17.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:17 smithi099 ceph-mon[34357]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:18.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:18 smithi002 ceph-mon[27650]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:55:18.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:18 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:55:18.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:18 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:55:18.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:18 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:18.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:18 smithi099 ceph-mon[34357]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:55:18.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:18 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:55:18.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:18 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:55:18.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:18 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:19.761 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:19 smithi002 ceph-mon[27650]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:19.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:19 smithi099 ceph-mon[34357]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:21.719 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:21 smithi002 ceph-mon[27650]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:21.719 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:55:21.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:21 smithi099 ceph-mon[34357]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:21.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:55:23.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:23 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:23.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:23 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:23.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:23 smithi002 ceph-mon[27650]: Reconfiguring grafana.smithi002 (dependencies changed)... 2024-09-17T00:55:23.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:23 smithi002 ceph-mon[27650]: Reconfiguring daemon grafana.smithi002 on smithi002 2024-09-17T00:55:23.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:23 smithi002 ceph-mon[27650]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:23.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:23 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/1426968496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89201a70-9650-4f5a-b943-c6c75fb3f689"}]: dispatch 2024-09-17T00:55:23.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:23 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/1426968496' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89201a70-9650-4f5a-b943-c6c75fb3f689"}]': finished 2024-09-17T00:55:23.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:23 smithi002 ceph-mon[27650]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T00:55:23.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:23 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:55:23.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:23 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:23.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:23 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:23.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:23 smithi099 ceph-mon[34357]: Reconfiguring grafana.smithi002 (dependencies changed)... 2024-09-17T00:55:23.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:23 smithi099 ceph-mon[34357]: Reconfiguring daemon grafana.smithi002 on smithi002 2024-09-17T00:55:23.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:23 smithi099 ceph-mon[34357]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:23.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:23 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/1426968496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89201a70-9650-4f5a-b943-c6c75fb3f689"}]: dispatch 2024-09-17T00:55:23.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:23 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/1426968496' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89201a70-9650-4f5a-b943-c6c75fb3f689"}]': finished 2024-09-17T00:55:23.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:23 smithi099 ceph-mon[34357]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T00:55:23.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:23 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:55:24.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:24 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/1021210120' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:55:24.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:24 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/1021210120' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:55:25.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:25 smithi002 ceph-mon[27650]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:25.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:25 smithi099 ceph-mon[34357]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:27.600 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:27 smithi002 ceph-mon[27650]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:27.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:27 smithi099 ceph-mon[34357]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:29.338 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:29 smithi002 ceph-mon[27650]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:29.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:29 smithi099 ceph-mon[34357]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:31.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:31 smithi002 ceph-mon[27650]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:31.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:31 smithi099 ceph-mon[34357]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:33.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:32 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:33.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:32 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:33.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:32 smithi099 ceph-mon[34357]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2024-09-17T00:55:33.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:32 smithi099 ceph-mon[34357]: Reconfiguring daemon prometheus.smithi002 on smithi002 2024-09-17T00:55:33.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:32 smithi099 ceph-mon[34357]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:33.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:32 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:33.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:32 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:33.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:32 smithi002 ceph-mon[27650]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2024-09-17T00:55:33.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:32 smithi002 ceph-mon[27650]: Reconfiguring daemon prometheus.smithi002 on smithi002 2024-09-17T00:55:33.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:32 smithi002 ceph-mon[27650]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:34.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:33 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T00:55:34.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:33 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:34.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:33 smithi099 ceph-mon[34357]: Deploying daemon osd.0 on smithi002 2024-09-17T00:55:34.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:33 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T00:55:34.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:33 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:34.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:33 smithi002 ceph-mon[27650]: Deploying daemon osd.0 on smithi002 2024-09-17T00:55:35.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:34 smithi002 ceph-mon[27650]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:35.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:34 smithi099 ceph-mon[34357]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:36.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:36 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:55:36.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:36 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:55:37.588 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:37 smithi002 ceph-mon[27650]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:37.764 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:37 smithi099 ceph-mon[34357]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:38.561 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:38 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:38.561 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:38 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:38.561 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:38 smithi002 ceph-mon[27650]: Reconfiguring crash.smithi099 (monmap changed)... 2024-09-17T00:55:38.561 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:38 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T00:55:38.561 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:38 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:38.561 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:38 smithi002 ceph-mon[27650]: Reconfiguring daemon crash.smithi099 on smithi099 2024-09-17T00:55:38.704 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:38 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:38.704 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:38 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:38.704 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:38 smithi099 ceph-mon[34357]: Reconfiguring crash.smithi099 (monmap changed)... 2024-09-17T00:55:38.704 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:38 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T00:55:38.704 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:38 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:38.704 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:38 smithi099 ceph-mon[34357]: Reconfiguring daemon crash.smithi099 on smithi099 2024-09-17T00:55:39.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:39 smithi002 ceph-mon[27650]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:39.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:39 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:39.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:39 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:39.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:39 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.vswzrb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T00:55:39.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:39 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T00:55:39.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:39 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:39.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:39 smithi099 ceph-mon[34357]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:39.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:39 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:39.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:39 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:39.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:39 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.vswzrb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T00:55:39.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:39 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T00:55:39.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:39 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:40.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:40 smithi002 ceph-mon[27650]: Reconfiguring mgr.smithi099.vswzrb (monmap changed)... 2024-09-17T00:55:40.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:40 smithi002 ceph-mon[27650]: Reconfiguring daemon mgr.smithi099.vswzrb on smithi099 2024-09-17T00:55:40.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:40 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:40.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:40 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:40.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:40 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:55:40.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:40 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T00:55:40.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:40 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:40.720 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:40 smithi099 ceph-mon[34357]: Reconfiguring mgr.smithi099.vswzrb (monmap changed)... 2024-09-17T00:55:40.721 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:40 smithi099 ceph-mon[34357]: Reconfiguring daemon mgr.smithi099.vswzrb on smithi099 2024-09-17T00:55:40.721 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:40 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:40.721 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:40 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:40.721 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:40 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T00:55:40.721 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:40 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T00:55:40.721 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:40 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:41.432 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:41 smithi099 ceph-mon[34357]: Reconfiguring mon.smithi099 (monmap changed)... 2024-09-17T00:55:41.432 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:41 smithi099 ceph-mon[34357]: Reconfiguring daemon mon.smithi099 on smithi099 2024-09-17T00:55:41.432 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:41 smithi099 ceph-mon[34357]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:41.651 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:41 smithi002 ceph-mon[27650]: Reconfiguring mon.smithi099 (monmap changed)... 2024-09-17T00:55:41.651 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:41 smithi002 ceph-mon[27650]: Reconfiguring daemon mon.smithi099 on smithi099 2024-09-17T00:55:41.651 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:41 smithi002 ceph-mon[27650]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:42.770 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:42.770 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:42.771 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T00:55:42.771 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T00:55:42.771 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T00:55:42.771 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T00:55:42.771 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:42.771 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T00:55:42.771 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T00:55:42.771 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi002.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T00:55:42.771 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi002.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T00:55:42.771 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:42.771 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:55:42.771 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:55:42.771 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi002.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T00:55:42.772 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi002.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T00:55:42.772 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:42.772 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:42.772 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:42.772 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:42.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:42.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:42.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T00:55:42.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T00:55:42.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T00:55:42.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T00:55:42.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:42.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T00:55:42.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T00:55:42.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi002.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T00:55:42.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi002.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T00:55:42.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:42.793 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:55:42.793 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T00:55:42.793 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi002.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T00:55:42.793 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi002.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T00:55:42.793 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:42.793 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:42.793 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:42.793 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:43.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:43 smithi099 ceph-mon[34357]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:43.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:43 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:43.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:43 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:43.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:43 smithi002 ceph-mon[27650]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:43.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:43 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:43.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:43 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:45.642 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:45 smithi002 ceph-mon[27650]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:45.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:45.675+0000 7f031bfff640 1 -- 172.21.15.2:0/653574045 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0334100ba0 con 0x7f031c06ecc0 2024-09-17T00:55:45.674 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 0 on host 'smithi002' 2024-09-17T00:55:45.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:45.678+0000 7f0339b9e640 1 -- 172.21.15.2:0/653574045 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f031c06ecc0 msgr2=0x7f031c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:55:45.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:45.678+0000 7f0339b9e640 1 --2- 172.21.15.2:0/653574045 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f031c06ecc0 0x7f031c071170 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0328007fd0 tx=0x7f0328009e90 comp rx=0 tx=0).stop 2024-09-17T00:55:45.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:45.678+0000 7f0339b9e640 1 -- 172.21.15.2:0/653574045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03340fb480 msgr2=0x7f033410fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:55:45.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:45.678+0000 7f0339b9e640 1 --2- 172.21.15.2:0/653574045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03340fb480 0x7f033410fe20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0324003080 tx=0x7f0324009da0 comp rx=0 tx=0).stop 2024-09-17T00:55:45.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:45.678+0000 7f0339b9e640 1 -- 172.21.15.2:0/653574045 shutdown_connections 2024-09-17T00:55:45.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:45.678+0000 7f0339b9e640 1 --2- 172.21.15.2:0/653574045 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f031c06ecc0 0x7f031c071170 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:45.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:45.678+0000 7f0339b9e640 1 --2- 172.21.15.2:0/653574045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03340fc750 0x7f0334112370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:45.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:45.678+0000 7f0339b9e640 1 --2- 172.21.15.2:0/653574045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03340fb480 0x7f033410fe20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:45.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:45.678+0000 7f0339b9e640 1 -- 172.21.15.2:0/653574045 >> 172.21.15.2:0/653574045 conn(0x7f03340f6c40 msgr2=0x7f03340f8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:55:45.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:45.678+0000 7f0339b9e640 1 -- 172.21.15.2:0/653574045 shutdown_connections 2024-09-17T00:55:45.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:45.678+0000 7f0339b9e640 1 -- 172.21.15.2:0/653574045 wait complete. 2024-09-17T00:55:45.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:45 smithi099 ceph-mon[34357]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:46.348 DEBUG:teuthology.orchestra.run.smithi002:osd.0> sudo journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.0.service 2024-09-17T00:55:46.350 INFO:tasks.cephadm:Deploying osd.1 on smithi002 with /dev/vg_nvme/lv_3... 2024-09-17T00:55:46.350 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-17T00:55:46.923 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:46 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:46.923 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:46 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:46.923 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:46 smithi002 ceph-mon[27650]: from='osd.0 [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T00:55:47.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:46 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:47.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:46 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:47.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:46 smithi099 ceph-mon[34357]: from='osd.0 [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T00:55:47.150 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:55:47.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:47 smithi002 ceph-mon[27650]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:47.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:47 smithi002 ceph-mon[27650]: from='osd.0 [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T00:55:47.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:47 smithi002 ceph-mon[27650]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T00:55:47.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:47 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:55:47.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:47 smithi002 ceph-mon[27650]: from='osd.0 [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-17T00:55:47.905 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 00:55:47 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0[45691]: 2024-09-17T00:55:47.689+0000 7fc7c9395640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T00:55:47.905 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 00:55:47 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0[45691]: 2024-09-17T00:55:47.692+0000 7fc7c41cc640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T00:55:48.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:47 smithi099 ceph-mon[34357]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:48.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:47 smithi099 ceph-mon[34357]: from='osd.0 [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T00:55:48.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:47 smithi099 ceph-mon[34357]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T00:55:48.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:47 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:55:48.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:47 smithi099 ceph-mon[34357]: from='osd.0 [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-17T00:55:48.868 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:48 smithi002 ceph-mon[27650]: from='osd.0 [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-17T00:55:48.868 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:48 smithi002 ceph-mon[27650]: osdmap e8: 1 total, 0 up, 1 in 2024-09-17T00:55:48.868 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:55:48.868 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:55:48.868 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:55:49.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:48 smithi099 ceph-mon[34357]: from='osd.0 [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-17T00:55:49.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:48 smithi099 ceph-mon[34357]: osdmap e8: 1 total, 0 up, 1 in 2024-09-17T00:55:49.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:55:49.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:55:49.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:55:49.965 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:49 smithi002 ceph-mon[27650]: purged_snaps scrub starts 2024-09-17T00:55:49.965 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:49 smithi002 ceph-mon[27650]: purged_snaps scrub ok 2024-09-17T00:55:49.965 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:49 smithi002 ceph-mon[27650]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:49.965 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:49 smithi002 ceph-mon[27650]: osd.0 [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145] boot 2024-09-17T00:55:49.965 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:49 smithi002 ceph-mon[27650]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T00:55:49.965 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:49 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:55:50.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:49 smithi099 ceph-mon[34357]: purged_snaps scrub starts 2024-09-17T00:55:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:49 smithi099 ceph-mon[34357]: purged_snaps scrub ok 2024-09-17T00:55:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:49 smithi099 ceph-mon[34357]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T00:55:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:49 smithi099 ceph-mon[34357]: osd.0 [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145] boot 2024-09-17T00:55:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:49 smithi099 ceph-mon[34357]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T00:55:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:49 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T00:55:50.536 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:55:50.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_3 2024-09-17T00:55:50.839 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:50 smithi002 ceph-mon[27650]: osdmap e10: 1 total, 1 up, 1 in 2024-09-17T00:55:50.839 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:50 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:50.839 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:50 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:51.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:50 smithi099 ceph-mon[34357]: osdmap e10: 1 total, 1 up, 1 in 2024-09-17T00:55:51.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:50 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:51.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:50 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:51.329 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:55:51.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:51 smithi002 ceph-mon[27650]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:55:51.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:55:52.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:51 smithi099 ceph-mon[34357]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:55:52.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:51 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:55:53.810 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:53 smithi002 ceph-mon[27650]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:55:54.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:53 smithi099 ceph-mon[34357]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:55:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.350+0000 7f780ee1c640 1 -- 172.21.15.2:0/1086100020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78080fb430 msgr2=0x7f78080fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:55:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.350+0000 7f780ee1c640 1 --2- 172.21.15.2:0/1086100020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78080fb430 0x7f78080fb840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0048d0 tx=0x7f77fc009da0 comp rx=0 tx=0).stop 2024-09-17T00:55:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.351+0000 7f780ee1c640 1 -- 172.21.15.2:0/1086100020 shutdown_connections 2024-09-17T00:55:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.351+0000 7f780ee1c640 1 --2- 172.21.15.2:0/1086100020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78080fc700 0x7f78080fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.351+0000 7f780ee1c640 1 --2- 172.21.15.2:0/1086100020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78080fb430 0x7f78080fb840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.351+0000 7f780ee1c640 1 -- 172.21.15.2:0/1086100020 >> 172.21.15.2:0/1086100020 conn(0x7f78080f6c10 msgr2=0x7f78080f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:55:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.351+0000 7f780ee1c640 1 -- 172.21.15.2:0/1086100020 shutdown_connections 2024-09-17T00:55:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.351+0000 7f780ee1c640 1 -- 172.21.15.2:0/1086100020 wait complete. 2024-09-17T00:55:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.351+0000 7f780ee1c640 1 Processor -- start 2024-09-17T00:55:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.351+0000 7f780ee1c640 1 -- start start 2024-09-17T00:55:54.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.352+0000 7f780ee1c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78080fb430 0x7f78080ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:55:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.352+0000 7f780ee1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78080fc700 0x7f78080fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:55:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.352+0000 7f780ee1c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78080fdfd0 con 0x7f78080fc700 2024-09-17T00:55:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.352+0000 7f780ee1c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78080fe110 con 0x7f78080fb430 2024-09-17T00:55:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.352+0000 7f7807fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78080fc700 0x7f78080fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:55:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.352+0000 7f7807fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78080fc700 0x7f78080fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41980/0 (socket says 172.21.15.2:41980) 2024-09-17T00:55:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.352+0000 7f7807fff640 1 -- 172.21.15.2:0/1557490102 learned_addr learned my addr 172.21.15.2:0/1557490102 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:55:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.352+0000 7f780cbb8640 1 --2- 172.21.15.2:0/1557490102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78080fb430 0x7f78080ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:55:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.352+0000 7f7807fff640 1 -- 172.21.15.2:0/1557490102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78080fb430 msgr2=0x7f78080ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:55:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.352+0000 7f7807fff640 1 --2- 172.21.15.2:0/1557490102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78080fb430 0x7f78080ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:55:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.352+0000 7f7807fff640 1 -- 172.21.15.2:0/1557490102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc005040 con 0x7f78080fc700 2024-09-17T00:55:54.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.352+0000 7f780cbb8640 1 --2- 172.21.15.2:0/1557490102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78080fb430 0x7f78080ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T00:55:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.352+0000 7f7807fff640 1 --2- 172.21.15.2:0/1557490102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78080fc700 0x7f78080fda40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f77f4002a50 tx=0x7f77f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:55:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.352+0000 7f78057fa640 1 -- 172.21.15.2:0/1557490102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77f4007c30 con 0x7f78080fc700 2024-09-17T00:55:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.353+0000 7f78057fa640 1 -- 172.21.15.2:0/1557490102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f77f400f040 con 0x7f78080fc700 2024-09-17T00:55:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.353+0000 7f780ee1c640 1 -- 172.21.15.2:0/1557490102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78080fe3f0 con 0x7f78080fc700 2024-09-17T00:55:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.353+0000 7f78057fa640 1 -- 172.21.15.2:0/1557490102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77f40094b0 con 0x7f78080fc700 2024-09-17T00:55:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.353+0000 7f780ee1c640 1 -- 172.21.15.2:0/1557490102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78081150b0 con 0x7f78080fc700 2024-09-17T00:55:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.354+0000 7f780ee1c640 1 -- 172.21.15.2:0/1557490102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78080fa890 con 0x7f78080fc700 2024-09-17T00:55:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.354+0000 7f78057fa640 1 -- 172.21.15.2:0/1557490102 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90809+0+0 (secure 0 0 0) 0x7f77f400dc50 con 0x7f78080fc700 2024-09-17T00:55:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.355+0000 7f78057fa640 1 --2- 172.21.15.2:0/1557490102 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f77f806ecc0 0x7f77f8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:55:54.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.355+0000 7f78057fa640 1 -- 172.21.15.2:0/1557490102 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f77f408d0b0 con 0x7f78080fc700 2024-09-17T00:55:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.355+0000 7f780cbb8640 1 --2- 172.21.15.2:0/1557490102 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f77f806ecc0 0x7f77f8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:55:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.356+0000 7f780cbb8640 1 --2- 172.21.15.2:0/1557490102 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f77f806ecc0 0x7f77f8071170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f77fc000c00 tx=0x7f77fc035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:55:54.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.360+0000 7f78057fa640 1 -- 172.21.15.2:0/1557490102 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f77f405b030 con 0x7f78080fc700 2024-09-17T00:55:54.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:55:54.540+0000 7f780ee1c640 1 -- 172.21.15.2:0/1557490102 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7808103fb0 con 0x7f77f806ecc0 2024-09-17T00:55:55.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: Detected new or changed devices on smithi002 2024-09-17T00:55:55.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:55.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:55.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:55.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: Adjusting osd_memory_target on smithi002 to 12868M 2024-09-17T00:55:55.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:55.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:55.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:55.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:55.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:55.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:55:55.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:55:55.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:55:55.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:55:55.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:55 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:55.426 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: Detected new or changed devices on smithi002 2024-09-17T00:55:55.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:55.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:55.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:55:55.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: Adjusting osd_memory_target on smithi002 to 12868M 2024-09-17T00:55:55.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:55.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:55.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:55:55.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:55.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:55:55.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:55:55.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:55:55.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:55:55.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:55:55.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:55 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:55:57.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:56 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:57.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:56 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:57.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:56 smithi002 ceph-mon[27650]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:55:57.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:56 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:57.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:56 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:55:57.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:56 smithi099 ceph-mon[34357]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:55:58.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:57 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/4272360451' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e62bb00-c559-40e9-84f3-944637772694"}]: dispatch 2024-09-17T00:55:58.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:57 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/4272360451' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e62bb00-c559-40e9-84f3-944637772694"}]': finished 2024-09-17T00:55:58.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:57 smithi002 ceph-mon[27650]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T00:55:58.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:57 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:55:58.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:57 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/4272360451' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e62bb00-c559-40e9-84f3-944637772694"}]: dispatch 2024-09-17T00:55:58.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:57 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/4272360451' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e62bb00-c559-40e9-84f3-944637772694"}]': finished 2024-09-17T00:55:58.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:57 smithi099 ceph-mon[34357]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T00:55:58.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:57 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:55:59.291 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:58 smithi002 ceph-mon[27650]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:55:59.291 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:55:58 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2791140296' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:55:59.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:58 smithi099 ceph-mon[34357]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:55:59.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:55:58 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/2791140296' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:56:00.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:00 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:00.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:00 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:00.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:00 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:00.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:00 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:00.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:00 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:01.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:00 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:01.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:00 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:01.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:00 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:01.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:00 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:01.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:00 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:01.846 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:01 smithi002 ceph-mon[27650]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:02.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:01 smithi099 ceph-mon[34357]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:03.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:03 smithi002 ceph-mon[27650]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:04.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:03 smithi099 ceph-mon[34357]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:05.967 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:05 smithi002 ceph-mon[27650]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:05.967 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:05 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T00:56:05.967 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:05 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:05.967 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:05 smithi002 ceph-mon[27650]: Deploying daemon osd.1 on smithi002 2024-09-17T00:56:06.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:05 smithi099 ceph-mon[34357]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:06.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:05 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T00:56:06.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:05 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:06.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:05 smithi099 ceph-mon[34357]: Deploying daemon osd.1 on smithi002 2024-09-17T00:56:06.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:56:07.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:56:07.859 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:07 smithi002 ceph-mon[27650]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:08.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:07 smithi099 ceph-mon[34357]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:10.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:09 smithi099 ceph-mon[34357]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:10.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:09 smithi002 ceph-mon[27650]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:10.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:10 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:10.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:10 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:10.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:10 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:11.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:10 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:11.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:10 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:11.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:10 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:11.832 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:11 smithi002 ceph-mon[27650]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:11.832 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:11 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:11.832 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:11 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:12.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:11 smithi099 ceph-mon[34357]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:12.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:11 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:12.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:11 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:13.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:13.289+0000 7f78057fa640 1 -- 172.21.15.2:0/1557490102 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7808103fb0 con 0x7f77f806ecc0 2024-09-17T00:56:13.288 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 1 on host 'smithi002' 2024-09-17T00:56:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:13.291+0000 7f780ee1c640 1 -- 172.21.15.2:0/1557490102 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f77f806ecc0 msgr2=0x7f77f8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:56:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:13.291+0000 7f780ee1c640 1 --2- 172.21.15.2:0/1557490102 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f77f806ecc0 0x7f77f8071170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f77fc000c00 tx=0x7f77fc035040 comp rx=0 tx=0).stop 2024-09-17T00:56:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:13.291+0000 7f780ee1c640 1 -- 172.21.15.2:0/1557490102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78080fc700 msgr2=0x7f78080fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:56:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:13.291+0000 7f780ee1c640 1 --2- 172.21.15.2:0/1557490102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78080fc700 0x7f78080fda40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f77f4002a50 tx=0x7f77f4004600 comp rx=0 tx=0).stop 2024-09-17T00:56:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:13.292+0000 7f780ee1c640 1 -- 172.21.15.2:0/1557490102 shutdown_connections 2024-09-17T00:56:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:13.292+0000 7f780ee1c640 1 --2- 172.21.15.2:0/1557490102 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f77f806ecc0 0x7f77f8071170 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:56:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:13.292+0000 7f780ee1c640 1 --2- 172.21.15.2:0/1557490102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78080fc700 0x7f78080fda40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:56:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:13.292+0000 7f780ee1c640 1 --2- 172.21.15.2:0/1557490102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78080fb430 0x7f78080ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:56:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:13.292+0000 7f780ee1c640 1 -- 172.21.15.2:0/1557490102 >> 172.21.15.2:0/1557490102 conn(0x7f78080f6c10 msgr2=0x7f78080655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:56:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:13.292+0000 7f780ee1c640 1 -- 172.21.15.2:0/1557490102 shutdown_connections 2024-09-17T00:56:13.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:13.292+0000 7f780ee1c640 1 -- 172.21.15.2:0/1557490102 wait complete. 2024-09-17T00:56:13.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:13 smithi002 ceph-mon[27650]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:13.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:13 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:13.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:13 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:14.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:13 smithi099 ceph-mon[34357]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:14.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:13 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:14.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:13 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:14.245 DEBUG:teuthology.orchestra.run.smithi002:osd.1> sudo journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.1.service 2024-09-17T00:56:14.248 INFO:tasks.cephadm:Deploying osd.2 on smithi002 with /dev/vg_nvme/lv_2... 2024-09-17T00:56:14.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-17T00:56:14.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:14 smithi002 ceph-mon[27650]: from='osd.1 [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T00:56:15.021 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:56:15.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:14 smithi099 ceph-mon[34357]: from='osd.1 [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T00:56:15.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:15 smithi002 ceph-mon[27650]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:15.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:15 smithi002 ceph-mon[27650]: from='osd.1 [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T00:56:15.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:15 smithi002 ceph-mon[27650]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T00:56:15.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:15 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:56:15.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:15 smithi002 ceph-mon[27650]: from='osd.1 [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-17T00:56:15.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 00:56:15 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1[53381]: 2024-09-17T00:56:15.688+0000 7f09cae46640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T00:56:15.906 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 00:56:15 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1[53381]: 2024-09-17T00:56:15.692+0000 7f09c447a640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T00:56:15.944 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:15 smithi099 ceph-mon[34357]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:15.944 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:15 smithi099 ceph-mon[34357]: from='osd.1 [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T00:56:15.944 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:15 smithi099 ceph-mon[34357]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T00:56:15.944 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:15 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:56:15.944 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:15 smithi099 ceph-mon[34357]: from='osd.1 [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-17T00:56:16.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:16 smithi002 ceph-mon[27650]: purged_snaps scrub starts 2024-09-17T00:56:16.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:16 smithi002 ceph-mon[27650]: purged_snaps scrub ok 2024-09-17T00:56:16.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:16 smithi002 ceph-mon[27650]: from='osd.1 [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-17T00:56:16.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:16 smithi002 ceph-mon[27650]: osdmap e13: 2 total, 1 up, 2 in 2024-09-17T00:56:16.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:16 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:56:16.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:16 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:56:17.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:16 smithi099 ceph-mon[34357]: purged_snaps scrub starts 2024-09-17T00:56:17.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:16 smithi099 ceph-mon[34357]: purged_snaps scrub ok 2024-09-17T00:56:17.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:16 smithi099 ceph-mon[34357]: from='osd.1 [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-17T00:56:17.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:16 smithi099 ceph-mon[34357]: osdmap e13: 2 total, 1 up, 2 in 2024-09-17T00:56:17.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:16 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:56:17.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:16 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:56:17.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:17 smithi002 ceph-mon[27650]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:17.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:17 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:56:17.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:17 smithi002 ceph-mon[27650]: osd.1 [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340] boot 2024-09-17T00:56:17.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:17 smithi002 ceph-mon[27650]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T00:56:17.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:17 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:56:18.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:17 smithi099 ceph-mon[34357]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-17T00:56:18.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:17 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:56:18.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:17 smithi099 ceph-mon[34357]: osd.1 [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340] boot 2024-09-17T00:56:18.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:17 smithi099 ceph-mon[34357]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T00:56:18.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:17 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T00:56:18.666 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:56:18.691 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_2 2024-09-17T00:56:18.998 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:18 smithi002 ceph-mon[27650]: osdmap e15: 2 total, 2 up, 2 in 2024-09-17T00:56:18.998 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:18 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:18.998 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:18 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:19.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:18 smithi099 ceph-mon[34357]: osdmap e15: 2 total, 2 up, 2 in 2024-09-17T00:56:19.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:18 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:19.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:18 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:20.026 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:19 smithi002 ceph-mon[27650]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:20.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:19 smithi099 ceph-mon[34357]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:20.208 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:56:22.015 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:21 smithi002 ceph-mon[27650]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:22.016 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:56:22.016 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:22.016 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:22.016 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:22.016 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:22.017 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:22.017 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:22.017 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:22.017 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:22.017 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:22.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:21 smithi099 ceph-mon[34357]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:22.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:56:22.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:22.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:22.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:22.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:22.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:22.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:22.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:22.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:22.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:22.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.343+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/3920172033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc00fd420 msgr2=0x7f7dc0103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:56:22.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.343+0000 7f7dc7fd3640 1 --2- 172.21.15.2:0/3920172033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc00fd420 0x7f7dc0103d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0048d0 tx=0x7f7dbc009da0 comp rx=0 tx=0).stop 2024-09-17T00:56:22.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.344+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/3920172033 shutdown_connections 2024-09-17T00:56:22.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.344+0000 7f7dc7fd3640 1 --2- 172.21.15.2:0/3920172033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc00fd420 0x7f7dc0103d90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:56:22.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.344+0000 7f7dc7fd3640 1 --2- 172.21.15.2:0/3920172033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dc00fcad0 0x7f7dc00fcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:56:22.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.344+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/3920172033 >> 172.21.15.2:0/3920172033 conn(0x7f7dc00f63a0 msgr2=0x7f7dc00f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:56:22.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.344+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/3920172033 shutdown_connections 2024-09-17T00:56:22.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.344+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/3920172033 wait complete. 2024-09-17T00:56:22.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.344+0000 7f7dc7fd3640 1 Processor -- start 2024-09-17T00:56:22.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.344+0000 7f7dc7fd3640 1 -- start start 2024-09-17T00:56:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.344+0000 7f7dc7fd3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc00fcad0 0x7f7dc010f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:56:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.344+0000 7f7dc7fd3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dc00fd420 0x7f7dc010f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:56:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.344+0000 7f7dc7fd3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc010fe80 con 0x7f7dc00fcad0 2024-09-17T00:56:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.344+0000 7f7dc7fd3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc0110650 con 0x7f7dc00fd420 2024-09-17T00:56:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.344+0000 7f7dc5d6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc00fcad0 0x7f7dc010f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:56:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.345+0000 7f7dc5d6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc00fcad0 0x7f7dc010f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33596/0 (socket says 172.21.15.2:33596) 2024-09-17T00:56:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.345+0000 7f7dc5d6f640 1 -- 172.21.15.2:0/4220317058 learned_addr learned my addr 172.21.15.2:0/4220317058 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:56:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.345+0000 7f7dc556e640 1 --2- 172.21.15.2:0/4220317058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dc00fd420 0x7f7dc010f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:56:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.345+0000 7f7dc5d6f640 1 -- 172.21.15.2:0/4220317058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dc00fd420 msgr2=0x7f7dc010f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:56:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.345+0000 7f7dc5d6f640 1 --2- 172.21.15.2:0/4220317058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dc00fd420 0x7f7dc010f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:56:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.345+0000 7f7dc5d6f640 1 -- 172.21.15.2:0/4220317058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc005040 con 0x7f7dc00fcad0 2024-09-17T00:56:22.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.345+0000 7f7dc5d6f640 1 --2- 172.21.15.2:0/4220317058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc00fcad0 0x7f7dc010f2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7db400c830 tx=0x7f7db4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:56:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.345+0000 7f7db27fc640 1 -- 172.21.15.2:0/4220317058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7db400a850 con 0x7f7dc00fcad0 2024-09-17T00:56:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.345+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/4220317058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc01108e0 con 0x7f7dc00fcad0 2024-09-17T00:56:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.345+0000 7f7db27fc640 1 -- 172.21.15.2:0/4220317058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7db400ae50 con 0x7f7dc00fcad0 2024-09-17T00:56:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.345+0000 7f7db27fc640 1 -- 172.21.15.2:0/4220317058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7db40113a0 con 0x7f7dc00fcad0 2024-09-17T00:56:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.345+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/4220317058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc0110e80 con 0x7f7dc00fcad0 2024-09-17T00:56:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.346+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/4220317058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc00fa040 con 0x7f7dc00fcad0 2024-09-17T00:56:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.347+0000 7f7db27fc640 1 -- 172.21.15.2:0/4220317058 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 90809+0+0 (secure 0 0 0) 0x7f7db4012400 con 0x7f7dc00fcad0 2024-09-17T00:56:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.347+0000 7f7db27fc640 1 --2- 172.21.15.2:0/4220317058 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f7dac06ecc0 0x7f7dac071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:56:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.347+0000 7f7db27fc640 1 -- 172.21.15.2:0/4220317058 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f7db408d6b0 con 0x7f7dc00fcad0 2024-09-17T00:56:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.347+0000 7f7dc556e640 1 --2- 172.21.15.2:0/4220317058 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f7dac06ecc0 0x7f7dac071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:56:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.348+0000 7f7dc556e640 1 --2- 172.21.15.2:0/4220317058 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f7dac06ecc0 0x7f7dac071170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc02a530 tx=0x7f7dbc009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:56:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.351+0000 7f7db27fc640 1 -- 172.21.15.2:0/4220317058 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7db405b520 con 0x7f7dc00fcad0 2024-09-17T00:56:22.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:22.527+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/4220317058 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7dc01111f0 con 0x7f7dac06ecc0 2024-09-17T00:56:23.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:22 smithi099 ceph-mon[34357]: Detected new or changed devices on smithi002 2024-09-17T00:56:23.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:22 smithi099 ceph-mon[34357]: Adjusting osd_memory_target on smithi002 to 6434M 2024-09-17T00:56:23.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:22 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:56:23.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:22 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:56:23.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:22 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:23.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:22 smithi002 ceph-mon[27650]: Detected new or changed devices on smithi002 2024-09-17T00:56:23.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:22 smithi002 ceph-mon[27650]: Adjusting osd_memory_target on smithi002 to 6434M 2024-09-17T00:56:23.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:22 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:56:23.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:22 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:56:23.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:22 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:23.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:23 smithi002 ceph-mon[27650]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:23.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:23 smithi002 ceph-mon[27650]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:24.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:23 smithi099 ceph-mon[34357]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:24.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:23 smithi099 ceph-mon[34357]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:25.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:25 smithi002 ceph-mon[27650]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:25.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:25 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3266467049' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6af863fc-14a2-4b04-959b-8a36a80657fb"}]: dispatch 2024-09-17T00:56:25.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:25 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3266467049' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6af863fc-14a2-4b04-959b-8a36a80657fb"}]': finished 2024-09-17T00:56:25.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:25 smithi002 ceph-mon[27650]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T00:56:25.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:25 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:26.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:25 smithi099 ceph-mon[34357]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:25 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3266467049' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6af863fc-14a2-4b04-959b-8a36a80657fb"}]: dispatch 2024-09-17T00:56:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:25 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3266467049' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6af863fc-14a2-4b04-959b-8a36a80657fb"}]': finished 2024-09-17T00:56:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:25 smithi099 ceph-mon[34357]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T00:56:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:25 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:26.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:26 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/1665321282' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:56:27.045 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:26 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/1665321282' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:56:28.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:27 smithi099 ceph-mon[34357]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:28.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:27 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:28.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:27 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:28.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:27 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:28.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:27 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:28.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:27 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:28.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:27 smithi002 ceph-mon[27650]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:28.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:27 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:28.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:27 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:28.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:27 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:28.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:27 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:28.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:27 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:29.992 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:29 smithi002 ceph-mon[27650]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:30.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:29 smithi099 ceph-mon[34357]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:31.972 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:31 smithi002 ceph-mon[27650]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:32.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:31 smithi099 ceph-mon[34357]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:33.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:32 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T00:56:33.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:32 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:33.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:32 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T00:56:33.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:32 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:34.013 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:33 smithi002 ceph-mon[27650]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:34.013 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:33 smithi002 ceph-mon[27650]: Deploying daemon osd.2 on smithi002 2024-09-17T00:56:34.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:33 smithi099 ceph-mon[34357]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:34.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:33 smithi099 ceph-mon[34357]: Deploying daemon osd.2 on smithi002 2024-09-17T00:56:35.882 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:35 smithi002 ceph-mon[27650]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:36.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:35 smithi099 ceph-mon[34357]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:37.013 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:36 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:56:37.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:36 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:56:37.996 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:37 smithi002 ceph-mon[27650]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:37.997 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:37.997 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:37.997 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:38.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:37 smithi099 ceph-mon[34357]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:38.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:37 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:38.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:37 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:38.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:37 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:39.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:39 smithi002 ceph-mon[27650]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:40.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:39 smithi099 ceph-mon[34357]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 2 on host 'smithi002' 2024-09-17T00:56:41.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:41.527+0000 7f7db27fc640 1 -- 172.21.15.2:0/4220317058 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7dc01111f0 con 0x7f7dac06ecc0 2024-09-17T00:56:41.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:41.529+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/4220317058 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f7dac06ecc0 msgr2=0x7f7dac071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:56:41.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:41.529+0000 7f7dc7fd3640 1 --2- 172.21.15.2:0/4220317058 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f7dac06ecc0 0x7f7dac071170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc02a530 tx=0x7f7dbc009da0 comp rx=0 tx=0).stop 2024-09-17T00:56:41.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:41.529+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/4220317058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc00fcad0 msgr2=0x7f7dc010f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:56:41.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:41.529+0000 7f7dc7fd3640 1 --2- 172.21.15.2:0/4220317058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc00fcad0 0x7f7dc010f2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7db400c830 tx=0x7f7db4004430 comp rx=0 tx=0).stop 2024-09-17T00:56:41.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:41.529+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/4220317058 shutdown_connections 2024-09-17T00:56:41.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:41.529+0000 7f7dc7fd3640 1 --2- 172.21.15.2:0/4220317058 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f7dac06ecc0 0x7f7dac071170 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:56:41.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:41.529+0000 7f7dc7fd3640 1 --2- 172.21.15.2:0/4220317058 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dc00fd420 0x7f7dc010f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:56:41.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:41.529+0000 7f7dc7fd3640 1 --2- 172.21.15.2:0/4220317058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dc00fcad0 0x7f7dc010f2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:56:41.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:41.529+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/4220317058 >> 172.21.15.2:0/4220317058 conn(0x7f7dc00f63a0 msgr2=0x7f7dc00f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:56:41.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:41.529+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/4220317058 shutdown_connections 2024-09-17T00:56:41.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:56:41.529+0000 7f7dc7fd3640 1 -- 172.21.15.2:0/4220317058 wait complete. 2024-09-17T00:56:42.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:41 smithi099 ceph-mon[34357]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:42.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:41 smithi099 ceph-mon[34357]: from='osd.2 [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T00:56:42.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:41 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:42.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:41 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:42.124 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:41 smithi002 ceph-mon[27650]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:42.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:41 smithi002 ceph-mon[27650]: from='osd.2 [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T00:56:42.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:41 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:42.125 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:41 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:42.152 DEBUG:teuthology.orchestra.run.smithi002:osd.2> sudo journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.2.service 2024-09-17T00:56:42.155 INFO:tasks.cephadm:Deploying osd.3 on smithi099 with /dev/vg_nvme/lv_4... 2024-09-17T00:56:42.155 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-17T00:56:42.404 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-17T00:56:42.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:42 smithi099 ceph-mon[34357]: from='osd.2 [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T00:56:42.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:42 smithi099 ceph-mon[34357]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T00:56:42.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:42 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:42.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:42 smithi099 ceph-mon[34357]: from='osd.2 [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-17T00:56:43.139 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:42 smithi002 ceph-mon[27650]: from='osd.2 [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T00:56:43.139 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:42 smithi002 ceph-mon[27650]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T00:56:43.139 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:42 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:43.139 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:42 smithi002 ceph-mon[27650]: from='osd.2 [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-17T00:56:43.140 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 00:56:42 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2[60611]: 2024-09-17T00:56:42.746+0000 7fde82d6d640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T00:56:43.140 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 00:56:42 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2[60611]: 2024-09-17T00:56:42.754+0000 7fde7cba2640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T00:56:44.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:43 smithi099 ceph-mon[34357]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:44.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:43 smithi099 ceph-mon[34357]: from='osd.2 [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-17T00:56:44.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:43 smithi099 ceph-mon[34357]: osdmap e18: 3 total, 2 up, 3 in 2024-09-17T00:56:44.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:43 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:44.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:43 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:44.068 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:43 smithi002 ceph-mon[27650]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:44.068 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:43 smithi002 ceph-mon[27650]: from='osd.2 [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-09-17T00:56:44.068 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:43 smithi002 ceph-mon[27650]: osdmap e18: 3 total, 2 up, 3 in 2024-09-17T00:56:44.068 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:43 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:44.068 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:43 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:44.850 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:44 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:44.850 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:44 smithi099 ceph-mon[34357]: osd.2 [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812] boot 2024-09-17T00:56:44.851 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:44 smithi099 ceph-mon[34357]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T00:56:44.851 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:44 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:44.851 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:44 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-17T00:56:44.855 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:56:44.875 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi099:vg_nvme/lv_4 2024-09-17T00:56:45.119 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-17T00:56:45.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:44 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:45.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:44 smithi002 ceph-mon[27650]: osd.2 [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812] boot 2024-09-17T00:56:45.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:44 smithi002 ceph-mon[27650]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T00:56:45.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:44 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T00:56:45.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:44 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-17T00:56:45.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:45 smithi099 ceph-mon[34357]: purged_snaps scrub starts 2024-09-17T00:56:45.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:45 smithi099 ceph-mon[34357]: purged_snaps scrub ok 2024-09-17T00:56:45.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:45 smithi099 ceph-mon[34357]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:45.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:45 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:45.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:45 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:45.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:45 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-17T00:56:45.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:45 smithi099 ceph-mon[34357]: osdmap e20: 3 total, 3 up, 3 in 2024-09-17T00:56:45.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:45 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T00:56:46.095 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:45 smithi002 ceph-mon[27650]: purged_snaps scrub starts 2024-09-17T00:56:46.096 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:45 smithi002 ceph-mon[27650]: purged_snaps scrub ok 2024-09-17T00:56:46.096 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:45 smithi002 ceph-mon[27650]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-17T00:56:46.096 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:45 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:46.096 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:45 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:46.096 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:45 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-17T00:56:46.096 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:45 smithi002 ceph-mon[27650]: osdmap e20: 3 total, 3 up, 3 in 2024-09-17T00:56:46.096 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:45 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T00:56:46.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.650+0000 7f77276c3640 1 -- 172.21.15.99:0/288878563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77200ff700 msgr2=0x7f7720101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:56:46.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.650+0000 7f77276c3640 1 --2- 172.21.15.99:0/288878563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77200ff700 0x7f7720101ae0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f77100048d0 tx=0x7f7710009da0 comp rx=0 tx=0).stop 2024-09-17T00:56:46.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.650+0000 7f77276c3640 1 -- 172.21.15.99:0/288878563 shutdown_connections 2024-09-17T00:56:46.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.650+0000 7f77276c3640 1 --2- 172.21.15.99:0/288878563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77200ff700 0x7f7720101ae0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:56:46.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.650+0000 7f77276c3640 1 --2- 172.21.15.99:0/288878563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77200666d0 0x7f77200ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:56:46.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.650+0000 7f77276c3640 1 -- 172.21.15.99:0/288878563 >> 172.21.15.99:0/288878563 conn(0x7f77200f6c10 msgr2=0x7f77200f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:56:46.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.650+0000 7f77276c3640 1 -- 172.21.15.99:0/288878563 shutdown_connections 2024-09-17T00:56:46.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.650+0000 7f77276c3640 1 -- 172.21.15.99:0/288878563 wait complete. 2024-09-17T00:56:46.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f77276c3640 1 Processor -- start 2024-09-17T00:56:46.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f77276c3640 1 -- start start 2024-09-17T00:56:46.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f77276c3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77200666d0 0x7f772010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:56:46.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f77276c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77200ff700 0x7f772010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:56:46.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f77276c3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772010dc10 con 0x7f77200ff700 2024-09-17T00:56:46.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f77276c3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772010e430 con 0x7f77200666d0 2024-09-17T00:56:46.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f772545f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77200666d0 0x7f772010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:56:46.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f772545f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77200666d0 0x7f772010d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41630/0 (socket says 172.21.15.99:41630) 2024-09-17T00:56:46.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f772545f640 1 -- 172.21.15.99:0/2490313436 learned_addr learned my addr 172.21.15.99:0/2490313436 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:56:46.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f7724c5e640 1 --2- 172.21.15.99:0/2490313436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77200ff700 0x7f772010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:56:46.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f772545f640 1 -- 172.21.15.99:0/2490313436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77200ff700 msgr2=0x7f772010d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:56:46.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f772545f640 1 --2- 172.21.15.99:0/2490313436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77200ff700 0x7f772010d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:56:46.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f772545f640 1 -- 172.21.15.99:0/2490313436 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7710005040 con 0x7f77200666d0 2024-09-17T00:56:46.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f7724c5e640 1 --2- 172.21.15.99:0/2490313436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77200ff700 0x7f772010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T00:56:46.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.651+0000 7f772545f640 1 --2- 172.21.15.99:0/2490313436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77200666d0 0x7f772010d080 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f771c002a80 tx=0x7f771c004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:56:46.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.652+0000 7f7715ffb640 1 -- 172.21.15.99:0/2490313436 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f771c007c30 con 0x7f77200666d0 2024-09-17T00:56:46.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.652+0000 7f7715ffb640 1 -- 172.21.15.99:0/2490313436 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f771c00f040 con 0x7f77200666d0 2024-09-17T00:56:46.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.652+0000 7f77276c3640 1 -- 172.21.15.99:0/2490313436 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772010e6c0 con 0x7f77200666d0 2024-09-17T00:56:46.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.652+0000 7f7715ffb640 1 -- 172.21.15.99:0/2490313436 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f771c009580 con 0x7f77200666d0 2024-09-17T00:56:46.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.652+0000 7f77276c3640 1 -- 172.21.15.99:0/2490313436 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772010ec60 con 0x7f77200666d0 2024-09-17T00:56:46.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.653+0000 7f77276c3640 1 -- 172.21.15.99:0/2490313436 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77200fa8b0 con 0x7f77200666d0 2024-09-17T00:56:46.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.653+0000 7f7715ffb640 1 -- 172.21.15.99:0/2490313436 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 90809+0+0 (secure 0 0 0) 0x7f771c00d6b0 con 0x7f77200666d0 2024-09-17T00:56:46.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.653+0000 7f7715ffb640 1 --2- 172.21.15.99:0/2490313436 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f770c06ecc0 0x7f770c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:56:46.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.654+0000 7f7715ffb640 1 -- 172.21.15.99:0/2490313436 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3228+0+0 (secure 0 0 0) 0x7f771c08d6d0 con 0x7f77200666d0 2024-09-17T00:56:46.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.654+0000 7f7724c5e640 1 --2- 172.21.15.99:0/2490313436 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f770c06ecc0 0x7f770c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:56:46.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.654+0000 7f7724c5e640 1 --2- 172.21.15.99:0/2490313436 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f770c06ecc0 0x7f770c071170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f772010ce30 tx=0x7f7710009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:56:46.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.658+0000 7f7715ffb640 1 -- 172.21.15.99:0/2490313436 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f771c05b190 con 0x7f77200666d0 2024-09-17T00:56:46.687 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 00:56:46 smithi002 sudo[62438]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T00:56:46.688 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 00:56:46 smithi002 sudo[62438]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T00:56:46.688 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 00:56:46 smithi002 sudo[62438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T00:56:46.688 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 00:56:46 smithi002 sudo[62438]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:56:46.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.820+0000 7f77276c3640 1 -- 172.21.15.99:0/2490313436 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f772010f010 con 0x7f770c06ecc0 2024-09-17T00:56:46.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:56:46.835+0000 7f7715ffb640 1 -- 172.21.15.99:0/2490313436 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f771c0576f0 con 0x7f77200666d0 2024-09-17T00:56:47.066 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:46 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T00:56:47.066 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:46 smithi002 ceph-mon[27650]: osdmap e21: 3 total, 3 up, 3 in 2024-09-17T00:56:47.066 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:46 smithi002 ceph-mon[27650]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-17T00:56:47.235 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:46 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T00:56:47.235 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:46 smithi099 ceph-mon[34357]: osdmap e21: 3 total, 3 up, 3 in 2024-09-17T00:56:47.235 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:46 smithi099 ceph-mon[34357]: pgmap v74: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-17T00:56:47.404 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 00:56:47 smithi002 sudo[63836]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T00:56:47.404 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 00:56:47 smithi002 sudo[63836]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T00:56:47.405 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 00:56:47 smithi002 sudo[63836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T00:56:47.405 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 00:56:47 smithi002 sudo[63836]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:56:47.799 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 00:56:47 smithi002 sudo[64684]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T00:56:47.799 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 00:56:47 smithi002 sudo[64684]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T00:56:47.800 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 00:56:47 smithi002 sudo[64684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T00:56:47.800 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 00:56:47 smithi002 sudo[64684]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:56:47.923 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:47 smithi099 ceph-mon[34357]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:47.923 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:47 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:56:47.923 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:47 smithi099 ceph-mon[34357]: mgrmap e19: smithi002.vjeexr(active, since 2m), standbys: smithi099.vswzrb 2024-09-17T00:56:47.923 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:47 smithi099 ceph-mon[34357]: osdmap e22: 3 total, 3 up, 3 in 2024-09-17T00:56:47.923 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:47 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:56:47.923 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:47 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:47.923 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:47 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:48.154 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 00:56:48 smithi002 sudo[64786]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T00:56:48.154 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 00:56:48 smithi002 sudo[64786]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T00:56:48.154 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 00:56:48 smithi002 sudo[64786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T00:56:48.154 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 00:56:48 smithi002 sudo[64786]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:56:48.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:47 smithi002 ceph-mon[27650]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:56:48.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:47 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:56:48.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:47 smithi002 ceph-mon[27650]: mgrmap e19: smithi002.vjeexr(active, since 2m), standbys: smithi099.vswzrb 2024-09-17T00:56:48.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:47 smithi002 ceph-mon[27650]: osdmap e22: 3 total, 3 up, 3 in 2024-09-17T00:56:48.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:47 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:56:48.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:47 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:48.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:47 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:48.779 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 00:56:48 smithi002 sudo[64874]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T00:56:48.779 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 00:56:48 smithi002 sudo[64874]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T00:56:48.779 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 00:56:48 smithi002 sudo[64874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T00:56:48.779 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 00:56:48 smithi002 sudo[64874]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:56:49.154 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 00:56:48 smithi002 sudo[64894]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T00:56:49.154 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 00:56:48 smithi002 sudo[64894]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T00:56:49.154 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 00:56:48 smithi002 sudo[64894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T00:56:49.155 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 00:56:48 smithi002 sudo[64894]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:56:49.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:48 smithi002 ceph-mon[27650]: Detected new or changed devices on smithi002 2024-09-17T00:56:49.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:49.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:49.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:49.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:49.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:49.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:48 smithi002 ceph-mon[27650]: Adjusting osd_memory_target on smithi002 to 4289M 2024-09-17T00:56:49.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:49.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:49.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:49.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:49.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:49.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:48 smithi002 ceph-mon[27650]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-17T00:56:49.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:48 smithi099 ceph-mon[34357]: Detected new or changed devices on smithi002 2024-09-17T00:56:49.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:49.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:49.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:49.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:49.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:56:49.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:48 smithi099 ceph-mon[34357]: Adjusting osd_memory_target on smithi002 to 4289M 2024-09-17T00:56:49.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:49.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:49.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:49.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:49.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:56:49.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:48 smithi099 ceph-mon[34357]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-17T00:56:49.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:49 smithi002 sudo[64977]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T00:56:49.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:49 smithi002 sudo[64977]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T00:56:49.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:49 smithi002 sudo[64977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T00:56:49.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:49 smithi002 sudo[64977]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:56:50.066 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:49 smithi002 sudo[65006]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T00:56:50.066 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:49 smithi002 sudo[65006]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T00:56:50.066 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:49 smithi002 sudo[65006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T00:56:50.066 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:49 smithi002 sudo[65006]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:56:50.319 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 sudo[37761]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T00:56:50.319 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 sudo[37761]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T00:56:50.319 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 sudo[37761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T00:56:50.319 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 sudo[37761]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:56:50.569 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 sudo[37764]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T00:56:50.570 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 sudo[37764]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T00:56:50.570 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 sudo[37764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T00:56:50.570 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 sudo[37764]: pam_unix(sudo:session): session closed for user root 2024-09-17T00:56:50.570 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 ceph-mon[34357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T00:56:50.570 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 ceph-mon[34357]: from='client.? 172.21.15.99:0/1894237830' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "204d5042-792c-413a-bf0d-33deca063a74"}]: dispatch 2024-09-17T00:56:50.571 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 ceph-mon[34357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T00:56:50.571 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T00:56:50.571 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "204d5042-792c-413a-bf0d-33deca063a74"}]: dispatch 2024-09-17T00:56:50.571 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:56:50.571 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "204d5042-792c-413a-bf0d-33deca063a74"}]': finished 2024-09-17T00:56:50.571 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 ceph-mon[34357]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T00:56:50.571 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:56:50.572 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T00:56:50.572 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:50 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:56:50.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:50 smithi002 ceph-mon[27650]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T00:56:50.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:50 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/1894237830' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "204d5042-792c-413a-bf0d-33deca063a74"}]: dispatch 2024-09-17T00:56:50.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:50 smithi002 ceph-mon[27650]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T00:56:50.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:50 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T00:56:50.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:50 smithi002 ceph-mon[27650]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "204d5042-792c-413a-bf0d-33deca063a74"}]: dispatch 2024-09-17T00:56:50.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:50 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:56:50.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:50 smithi002 ceph-mon[27650]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "204d5042-792c-413a-bf0d-33deca063a74"}]': finished 2024-09-17T00:56:50.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:50 smithi002 ceph-mon[27650]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T00:56:50.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:50 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:56:50.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:50 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T00:56:50.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:50 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T00:56:51.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:51 smithi002 ceph-mon[27650]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T00:56:51.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:51 smithi002 ceph-mon[27650]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T00:56:51.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:51 smithi002 ceph-mon[27650]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T00:56:51.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:51.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:51 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/3795030030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:56:51.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:56:51.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:51 smithi099 ceph-mon[34357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T00:56:51.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:51 smithi099 ceph-mon[34357]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T00:56:51.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:51 smithi099 ceph-mon[34357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T00:56:51.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:51 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:51.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:51 smithi099 ceph-mon[34357]: from='client.? 172.21.15.99:0/3795030030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:56:51.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:51 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:56:53.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:53 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:53.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:53 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:53.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:53 smithi002 ceph-mon[27650]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T00:56:53.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:53 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:53.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:53 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:53.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:53 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:53.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:53 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:53.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:53 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:53.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:53 smithi099 ceph-mon[34357]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T00:56:53.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:53 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:53.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:53 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:56:53.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:53 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:56:55.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:55 smithi099 ceph-mon[34357]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-17T00:56:55.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:55 smithi002 ceph-mon[27650]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-17T00:56:57.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:57 smithi099 ceph-mon[34357]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-17T00:56:57.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:57 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T00:56:57.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:57 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:57.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:57 smithi002 ceph-mon[27650]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-17T00:56:57.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:57 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T00:56:57.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:57 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:56:58.593 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:58 smithi099 ceph-mon[34357]: Deploying daemon osd.3 on smithi099 2024-09-17T00:56:58.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:58 smithi002 ceph-mon[27650]: Deploying daemon osd.3 on smithi099 2024-09-17T00:56:59.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:56:59 smithi002 ceph-mon[27650]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-17T00:56:59.675 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:56:59 smithi099 ceph-mon[34357]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-17T00:57:01.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:01 smithi099 ceph-mon[34357]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.7 KiB/s rd, 75 KiB/s wr, 5 op/s 2024-09-17T00:57:01.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:01 smithi002 ceph-mon[27650]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.7 KiB/s rd, 75 KiB/s wr, 5 op/s 2024-09-17T00:57:02.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:02.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:02.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:02.693 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:02.693 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:02.693 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:03.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:03 smithi002 ceph-mon[27650]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-17T00:57:03.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:03 smithi099 ceph-mon[34357]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-17T00:57:05.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:05 smithi002 ceph-mon[27650]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-17T00:57:05.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:05 smithi099 ceph-mon[34357]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-17T00:57:06.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:06.378+0000 7f7715ffb640 1 -- 172.21.15.99:0/2490313436 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f772010f010 con 0x7f770c06ecc0 2024-09-17T00:57:06.376 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 3 on host 'smithi099' 2024-09-17T00:57:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:06.380+0000 7f77276c3640 1 -- 172.21.15.99:0/2490313436 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f770c06ecc0 msgr2=0x7f770c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:06.380+0000 7f77276c3640 1 --2- 172.21.15.99:0/2490313436 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f770c06ecc0 0x7f770c071170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f772010ce30 tx=0x7f7710009da0 comp rx=0 tx=0).stop 2024-09-17T00:57:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:06.380+0000 7f77276c3640 1 -- 172.21.15.99:0/2490313436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77200666d0 msgr2=0x7f772010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:06.380+0000 7f77276c3640 1 --2- 172.21.15.99:0/2490313436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77200666d0 0x7f772010d080 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f771c002a80 tx=0x7f771c004570 comp rx=0 tx=0).stop 2024-09-17T00:57:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:06.380+0000 7f77276c3640 1 -- 172.21.15.99:0/2490313436 shutdown_connections 2024-09-17T00:57:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:06.380+0000 7f77276c3640 1 --2- 172.21.15.99:0/2490313436 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f770c06ecc0 0x7f770c071170 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:06.380+0000 7f77276c3640 1 --2- 172.21.15.99:0/2490313436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77200ff700 0x7f772010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:06.380+0000 7f77276c3640 1 --2- 172.21.15.99:0/2490313436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77200666d0 0x7f772010d080 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:06.380+0000 7f77276c3640 1 -- 172.21.15.99:0/2490313436 >> 172.21.15.99:0/2490313436 conn(0x7f77200f6c10 msgr2=0x7f77200f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:06.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:06.380+0000 7f77276c3640 1 -- 172.21.15.99:0/2490313436 shutdown_connections 2024-09-17T00:57:06.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:06.380+0000 7f77276c3640 1 -- 172.21.15.99:0/2490313436 wait complete. 2024-09-17T00:57:07.010 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:07.010 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:07.010 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:07.010 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:07.010 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:07.010 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:06 smithi099 ceph-mon[34357]: from='osd.3 [v2:172.21.15.99:6800/2455888957,v1:172.21.15.99:6801/2455888957]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T00:57:07.011 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:06 smithi099 ceph-mon[34357]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T00:57:07.011 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:57:07.011 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:07.011 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:07.011 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:07.034 DEBUG:teuthology.orchestra.run.smithi099:osd.3> sudo journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.3.service 2024-09-17T00:57:07.036 INFO:tasks.cephadm:Deploying osd.4 on smithi099 with /dev/vg_nvme/lv_3... 2024-09-17T00:57:07.036 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-17T00:57:07.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:07.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:07.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:07.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:07.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:07.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:06 smithi002 ceph-mon[27650]: from='osd.3 [v2:172.21.15.99:6800/2455888957,v1:172.21.15.99:6801/2455888957]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T00:57:07.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:06 smithi002 ceph-mon[27650]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T00:57:07.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:57:07.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:07.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:07.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:07.754 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-17T00:57:08.038 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:07 smithi099 ceph-mon[34357]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T00:57:08.038 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:07 smithi099 ceph-mon[34357]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T00:57:08.038 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:07 smithi099 ceph-mon[34357]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T00:57:08.038 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:07 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:57:08.038 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:07 smithi099 ceph-mon[34357]: from='osd.3 [v2:172.21.15.99:6800/2455888957,v1:172.21.15.99:6801/2455888957]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T00:57:08.038 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:07 smithi099 ceph-mon[34357]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T00:57:08.038 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 00:57:07 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3[39813]: 2024-09-17T00:57:07.759+0000 7fb674852640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T00:57:08.038 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 00:57:07 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3[39813]: 2024-09-17T00:57:07.764+0000 7fb66d685640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T00:57:08.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:07 smithi002 ceph-mon[27650]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T00:57:08.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:07 smithi002 ceph-mon[27650]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T00:57:08.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:07 smithi002 ceph-mon[27650]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T00:57:08.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:07 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:57:08.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:07 smithi002 ceph-mon[27650]: from='osd.3 [v2:172.21.15.99:6800/2455888957,v1:172.21.15.99:6801/2455888957]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T00:57:08.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:07 smithi002 ceph-mon[27650]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T00:57:08.887 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:08 smithi099 ceph-mon[34357]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-17T00:57:08.888 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:08 smithi099 ceph-mon[34357]: osdmap e25: 4 total, 3 up, 4 in 2024-09-17T00:57:08.888 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:08 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:57:08.888 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:08 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:57:08.888 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:08 smithi099 ceph-mon[34357]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T00:57:09.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:08 smithi002 ceph-mon[27650]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-17T00:57:09.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:08 smithi002 ceph-mon[27650]: osdmap e25: 4 total, 3 up, 4 in 2024-09-17T00:57:09.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:08 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:57:09.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:08 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:57:09.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:08 smithi002 ceph-mon[27650]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-17T00:57:09.937 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:09 smithi099 ceph-mon[34357]: purged_snaps scrub starts 2024-09-17T00:57:09.937 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:09 smithi099 ceph-mon[34357]: purged_snaps scrub ok 2024-09-17T00:57:09.937 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:09 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:57:09.937 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:09 smithi099 ceph-mon[34357]: osd.3 [v2:172.21.15.99:6800/2455888957,v1:172.21.15.99:6801/2455888957] boot 2024-09-17T00:57:09.937 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:09 smithi099 ceph-mon[34357]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T00:57:09.938 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:09 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:57:10.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:09 smithi002 ceph-mon[27650]: purged_snaps scrub starts 2024-09-17T00:57:10.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:09 smithi002 ceph-mon[27650]: purged_snaps scrub ok 2024-09-17T00:57:10.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:09 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:57:10.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:09 smithi002 ceph-mon[27650]: osd.3 [v2:172.21.15.99:6800/2455888957,v1:172.21.15.99:6801/2455888957] boot 2024-09-17T00:57:10.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:09 smithi002 ceph-mon[27650]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T00:57:10.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:09 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T00:57:10.662 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:57:10.682 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi099:vg_nvme/lv_3 2024-09-17T00:57:11.039 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:10 smithi099 ceph-mon[34357]: osdmap e27: 4 total, 4 up, 4 in 2024-09-17T00:57:11.039 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:10 smithi099 ceph-mon[34357]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:11.039 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:10 smithi099 ceph-mon[34357]: osdmap e28: 4 total, 4 up, 4 in 2024-09-17T00:57:11.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:10 smithi002 ceph-mon[27650]: osdmap e27: 4 total, 4 up, 4 in 2024-09-17T00:57:11.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:10 smithi002 ceph-mon[27650]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:11.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:10 smithi002 ceph-mon[27650]: osdmap e28: 4 total, 4 up, 4 in 2024-09-17T00:57:11.280 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-17T00:57:13.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.449+0000 7fd6377b9640 1 -- 172.21.15.99:0/3473377290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6300fb430 msgr2=0x7fd6300fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:13.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.449+0000 7fd6377b9640 1 --2- 172.21.15.99:0/3473377290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6300fb430 0x7fd6300fb840 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd6240048d0 tx=0x7fd624009da0 comp rx=0 tx=0).stop 2024-09-17T00:57:13.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.449+0000 7fd6377b9640 1 -- 172.21.15.99:0/3473377290 shutdown_connections 2024-09-17T00:57:13.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.449+0000 7fd6377b9640 1 --2- 172.21.15.99:0/3473377290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6300fc700 0x7fd6300fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:13.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.449+0000 7fd6377b9640 1 --2- 172.21.15.99:0/3473377290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6300fb430 0x7fd6300fb840 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:13.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.449+0000 7fd6377b9640 1 -- 172.21.15.99:0/3473377290 >> 172.21.15.99:0/3473377290 conn(0x7fd6300f6c10 msgr2=0x7fd6300f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:13.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.449+0000 7fd6377b9640 1 -- 172.21.15.99:0/3473377290 shutdown_connections 2024-09-17T00:57:13.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.449+0000 7fd6377b9640 1 -- 172.21.15.99:0/3473377290 wait complete. 2024-09-17T00:57:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.449+0000 7fd6377b9640 1 Processor -- start 2024-09-17T00:57:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.449+0000 7fd6377b9640 1 -- start start 2024-09-17T00:57:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.449+0000 7fd6377b9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6300fb430 0x7fd63010bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.449+0000 7fd6377b9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6300fc700 0x7fd63010c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.449+0000 7fd6377b9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63010d390 con 0x7fd6300fb430 2024-09-17T00:57:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.449+0000 7fd6377b9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63010d500 con 0x7fd6300fc700 2024-09-17T00:57:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.450+0000 7fd634d54640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6300fc700 0x7fd63010c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.450+0000 7fd634d54640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6300fc700 0x7fd63010c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38022/0 (socket says 172.21.15.99:38022) 2024-09-17T00:57:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.450+0000 7fd634d54640 1 -- 172.21.15.99:0/2632119613 learned_addr learned my addr 172.21.15.99:0/2632119613 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:57:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.450+0000 7fd635555640 1 --2- 172.21.15.99:0/2632119613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6300fb430 0x7fd63010bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.450+0000 7fd634d54640 1 -- 172.21.15.99:0/2632119613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6300fb430 msgr2=0x7fd63010bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.450+0000 7fd634d54640 1 --2- 172.21.15.99:0/2632119613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6300fb430 0x7fd63010bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.450+0000 7fd634d54640 1 -- 172.21.15.99:0/2632119613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd624005040 con 0x7fd6300fc700 2024-09-17T00:57:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.450+0000 7fd634d54640 1 --2- 172.21.15.99:0/2632119613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6300fc700 0x7fd63010c520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00b790 tx=0x7fd62c0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.450+0000 7fd621ffb640 1 -- 172.21.15.99:0/2632119613 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd62c00c700 con 0x7fd6300fc700 2024-09-17T00:57:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.450+0000 7fd621ffb640 1 -- 172.21.15.99:0/2632119613 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd62c00cd00 con 0x7fd6300fc700 2024-09-17T00:57:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.450+0000 7fd6377b9640 1 -- 172.21.15.99:0/2632119613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63010d7e0 con 0x7fd6300fc700 2024-09-17T00:57:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.450+0000 7fd621ffb640 1 -- 172.21.15.99:0/2632119613 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd62c015e70 con 0x7fd6300fc700 2024-09-17T00:57:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.450+0000 7fd6377b9640 1 -- 172.21.15.99:0/2632119613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63010dd00 con 0x7fd6300fc700 2024-09-17T00:57:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.451+0000 7fd6377b9640 1 -- 172.21.15.99:0/2632119613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6300fa890 con 0x7fd6300fc700 2024-09-17T00:57:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.452+0000 7fd621ffb640 1 -- 172.21.15.99:0/2632119613 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fd62c012070 con 0x7fd6300fc700 2024-09-17T00:57:13.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.452+0000 7fd621ffb640 1 --2- 172.21.15.99:0/2632119613 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd61c06ed60 0x7fd61c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:13.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.452+0000 7fd621ffb640 1 -- 172.21.15.99:0/2632119613 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3770+0+0 (secure 0 0 0) 0x7fd62c08d660 con 0x7fd6300fc700 2024-09-17T00:57:13.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.452+0000 7fd635555640 1 --2- 172.21.15.99:0/2632119613 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd61c06ed60 0x7fd61c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:13.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.453+0000 7fd635555640 1 --2- 172.21.15.99:0/2632119613 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd61c06ed60 0x7fd61c071210 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd624000c00 tx=0x7fd624009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:13.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.457+0000 7fd621ffb640 1 -- 172.21.15.99:0/2632119613 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd62c05ae20 con 0x7fd6300fc700 2024-09-17T00:57:13.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:13.619+0000 7fd6377b9640 1 -- 172.21.15.99:0/2632119613 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd63010df80 con 0x7fd61c06ed60 2024-09-17T00:57:13.617 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:13 smithi099 ceph-mon[34357]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:13.618 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:13 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:13.618 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:13 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:13.618 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:13 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:57:13.618 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:13 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:13.618 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:13 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:13.618 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:13 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:13.618 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:13 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:13.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:13 smithi002 ceph-mon[27650]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:13.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:13 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:13.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:13 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:13.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:13 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:57:13.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:13 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:13.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:13 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:13.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:13 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:13.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:13 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:14.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:14 smithi002 ceph-mon[27650]: Detected new or changed devices on smithi099 2024-09-17T00:57:14.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:14 smithi002 ceph-mon[27650]: Adjusting osd_memory_target on smithi099 to 15936M 2024-09-17T00:57:14.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:14 smithi002 ceph-mon[27650]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:57:14.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:14 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:57:14.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:14 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:57:14.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:14 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:14.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:14 smithi099 ceph-mon[34357]: Detected new or changed devices on smithi099 2024-09-17T00:57:14.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:14 smithi099 ceph-mon[34357]: Adjusting osd_memory_target on smithi099 to 15936M 2024-09-17T00:57:14.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:14 smithi099 ceph-mon[34357]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:57:14.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:14 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:57:14.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:14 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:57:14.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:14 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:15.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:15 smithi099 ceph-mon[34357]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-17T00:57:15.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:15 smithi002 ceph-mon[27650]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-17T00:57:16.536 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:16 smithi099 ceph-mon[34357]: from='client.? 172.21.15.99:0/4051945491' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2bd2bb0-ceec-4901-8709-7388aa695687"}]: dispatch 2024-09-17T00:57:16.536 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:16 smithi099 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2bd2bb0-ceec-4901-8709-7388aa695687"}]: dispatch 2024-09-17T00:57:16.536 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:16 smithi099 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2bd2bb0-ceec-4901-8709-7388aa695687"}]': finished 2024-09-17T00:57:16.536 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:16 smithi099 ceph-mon[34357]: osdmap e29: 5 total, 4 up, 5 in 2024-09-17T00:57:16.536 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:16 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:57:16.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:16 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/4051945491' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2bd2bb0-ceec-4901-8709-7388aa695687"}]: dispatch 2024-09-17T00:57:16.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:16 smithi002 ceph-mon[27650]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c2bd2bb0-ceec-4901-8709-7388aa695687"}]: dispatch 2024-09-17T00:57:16.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:16 smithi002 ceph-mon[27650]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c2bd2bb0-ceec-4901-8709-7388aa695687"}]': finished 2024-09-17T00:57:16.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:16 smithi002 ceph-mon[27650]: osdmap e29: 5 total, 4 up, 5 in 2024-09-17T00:57:16.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:16 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:57:17.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:17 smithi002 ceph-mon[27650]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-17T00:57:17.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:17 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/3800751047' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:57:17.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:17 smithi099 ceph-mon[34357]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-17T00:57:17.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:17 smithi099 ceph-mon[34357]: from='client.? 172.21.15.99:0/3800751047' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:57:19.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:19 smithi002 ceph-mon[27650]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T00:57:19.713 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:19 smithi099 ceph-mon[34357]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-17T00:57:21.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:21 smithi099 ceph-mon[34357]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-17T00:57:21.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:57:21.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:21 smithi002 ceph-mon[27650]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-17T00:57:21.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:57:23.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:23 smithi099 ceph-mon[34357]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-17T00:57:23.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:23 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T00:57:23.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:23 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:23.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:23 smithi002 ceph-mon[27650]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-17T00:57:23.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:23 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T00:57:23.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:23 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:24.487 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:24 smithi099 ceph-mon[34357]: Deploying daemon osd.4 on smithi099 2024-09-17T00:57:24.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:24 smithi002 ceph-mon[27650]: Deploying daemon osd.4 on smithi099 2024-09-17T00:57:25.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:25 smithi099 ceph-mon[34357]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:25.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:25 smithi002 ceph-mon[27650]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:27.486 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:27 smithi099 ceph-mon[34357]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:27.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:27 smithi002 ceph-mon[27650]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:28.618 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:28 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:28.618 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:28 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:28.618 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:28 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:28.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:28 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:28.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:28 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:28.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:28 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:29.429 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:29 smithi099 ceph-mon[34357]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:29.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:29 smithi002 ceph-mon[27650]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:31.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:31.173+0000 7fd621ffb640 1 -- 172.21.15.99:0/2632119613 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd63010df80 con 0x7fd61c06ed60 2024-09-17T00:57:31.171 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 4 on host 'smithi099' 2024-09-17T00:57:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:31.175+0000 7fd6377b9640 1 -- 172.21.15.99:0/2632119613 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd61c06ed60 msgr2=0x7fd61c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:31.175+0000 7fd6377b9640 1 --2- 172.21.15.99:0/2632119613 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd61c06ed60 0x7fd61c071210 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd624000c00 tx=0x7fd624009da0 comp rx=0 tx=0).stop 2024-09-17T00:57:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:31.175+0000 7fd6377b9640 1 -- 172.21.15.99:0/2632119613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6300fc700 msgr2=0x7fd63010c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:31.175+0000 7fd6377b9640 1 --2- 172.21.15.99:0/2632119613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6300fc700 0x7fd63010c520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00b790 tx=0x7fd62c0091d0 comp rx=0 tx=0).stop 2024-09-17T00:57:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:31.175+0000 7fd6377b9640 1 -- 172.21.15.99:0/2632119613 shutdown_connections 2024-09-17T00:57:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:31.175+0000 7fd6377b9640 1 --2- 172.21.15.99:0/2632119613 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd61c06ed60 0x7fd61c071210 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:31.175+0000 7fd6377b9640 1 --2- 172.21.15.99:0/2632119613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6300fc700 0x7fd63010c520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:31.175+0000 7fd6377b9640 1 --2- 172.21.15.99:0/2632119613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6300fb430 0x7fd63010bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:31.175+0000 7fd6377b9640 1 -- 172.21.15.99:0/2632119613 >> 172.21.15.99:0/2632119613 conn(0x7fd6300f6c10 msgr2=0x7fd6300f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:31.175+0000 7fd6377b9640 1 -- 172.21.15.99:0/2632119613 shutdown_connections 2024-09-17T00:57:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:31.175+0000 7fd6377b9640 1 -- 172.21.15.99:0/2632119613 wait complete. 2024-09-17T00:57:31.514 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:31 smithi099 ceph-mon[34357]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:31.514 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:31 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:31.514 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:31 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:31.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:31 smithi002 ceph-mon[27650]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:31.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:31 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:31.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:31 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:32.178 DEBUG:teuthology.orchestra.run.smithi099:osd.4> sudo journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.4.service 2024-09-17T00:57:32.180 INFO:tasks.cephadm:Deploying osd.5 on smithi099 with /dev/vg_nvme/lv_2... 2024-09-17T00:57:32.181 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-17T00:57:32.515 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-17T00:57:32.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:32 smithi099 ceph-mon[34357]: from='osd.4 [v2:172.21.15.99:6808/1239096669,v1:172.21.15.99:6809/1239096669]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T00:57:32.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:32 smithi099 ceph-mon[34357]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T00:57:32.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:32 smithi002 ceph-mon[27650]: from='osd.4 [v2:172.21.15.99:6808/1239096669,v1:172.21.15.99:6809/1239096669]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T00:57:32.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:32 smithi002 ceph-mon[27650]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T00:57:33.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:33 smithi002 ceph-mon[27650]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:33.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:33 smithi002 ceph-mon[27650]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T00:57:33.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:33 smithi002 ceph-mon[27650]: osdmap e30: 5 total, 4 up, 5 in 2024-09-17T00:57:33.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:33 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:57:33.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:33 smithi002 ceph-mon[27650]: from='osd.4 [v2:172.21.15.99:6808/1239096669,v1:172.21.15.99:6809/1239096669]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T00:57:33.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:33 smithi002 ceph-mon[27650]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T00:57:33.716 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:33 smithi099 ceph-mon[34357]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:33.717 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:33 smithi099 ceph-mon[34357]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T00:57:33.717 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:33 smithi099 ceph-mon[34357]: osdmap e30: 5 total, 4 up, 5 in 2024-09-17T00:57:33.717 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:33 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:57:33.717 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:33 smithi099 ceph-mon[34357]: from='osd.4 [v2:172.21.15.99:6808/1239096669,v1:172.21.15.99:6809/1239096669]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T00:57:33.717 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:33 smithi099 ceph-mon[34357]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T00:57:33.717 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 00:57:33 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[46622]: 2024-09-17T00:57:33.371+0000 7f7e7ec5f640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T00:57:33.717 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 00:57:33 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[46622]: 2024-09-17T00:57:33.377+0000 7f7e7626d640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T00:57:34.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:34 smithi099 ceph-mon[34357]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-17T00:57:34.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:34 smithi099 ceph-mon[34357]: osdmap e31: 5 total, 4 up, 5 in 2024-09-17T00:57:34.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:34 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:57:34.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:34 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:57:34.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:34 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:34.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:34 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:34.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:34 smithi002 ceph-mon[27650]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-17T00:57:34.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:34 smithi002 ceph-mon[27650]: osdmap e31: 5 total, 4 up, 5 in 2024-09-17T00:57:34.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:34 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:57:34.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:34 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:57:34.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:34 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:34.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:34 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:34.893 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-17T00:57:34.913 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi099:vg_nvme/lv_2 2024-09-17T00:57:35.510 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:35 smithi099 ceph-mon[34357]: purged_snaps scrub starts 2024-09-17T00:57:35.510 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:35 smithi099 ceph-mon[34357]: purged_snaps scrub ok 2024-09-17T00:57:35.510 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:35 smithi099 ceph-mon[34357]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:35.511 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:35 smithi099 ceph-mon[34357]: osd.4 [v2:172.21.15.99:6808/1239096669,v1:172.21.15.99:6809/1239096669] boot 2024-09-17T00:57:35.511 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:35 smithi099 ceph-mon[34357]: osdmap e32: 5 total, 5 up, 5 in 2024-09-17T00:57:35.511 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:35 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:57:35.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:35 smithi002 ceph-mon[27650]: purged_snaps scrub starts 2024-09-17T00:57:35.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:35 smithi002 ceph-mon[27650]: purged_snaps scrub ok 2024-09-17T00:57:35.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:35 smithi002 ceph-mon[27650]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-17T00:57:35.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:35 smithi002 ceph-mon[27650]: osd.4 [v2:172.21.15.99:6808/1239096669,v1:172.21.15.99:6809/1239096669] boot 2024-09-17T00:57:35.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:35 smithi002 ceph-mon[27650]: osdmap e32: 5 total, 5 up, 5 in 2024-09-17T00:57:35.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:35 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T00:57:36.276 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-17T00:57:36.650 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:36 smithi099 ceph-mon[34357]: osdmap e33: 5 total, 5 up, 5 in 2024-09-17T00:57:36.650 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:36 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:57:36.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:36 smithi002 ceph-mon[27650]: osdmap e33: 5 total, 5 up, 5 in 2024-09-17T00:57:36.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:36 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:57:37.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:37 smithi002 ceph-mon[27650]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:57:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:57:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:38.008 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:37 smithi099 ceph-mon[34357]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:38.008 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:37 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:38.009 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:37 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:38.009 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:37 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:57:38.009 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:37 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:57:38.009 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:37 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:38.009 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:37 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:38.009 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:37 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:38.009 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:37 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:38.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.543+0000 7f6d970e4640 1 -- 172.21.15.99:0/1036592041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d900fc520 msgr2=0x7f6d900fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:38.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.543+0000 7f6d970e4640 1 --2- 172.21.15.99:0/1036592041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d900fc520 0x7f6d900fc930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009c50 tx=0x7f6d80004d10 comp rx=0 tx=0).stop 2024-09-17T00:57:38.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.543+0000 7f6d970e4640 1 -- 172.21.15.99:0/1036592041 shutdown_connections 2024-09-17T00:57:38.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.543+0000 7f6d970e4640 1 --2- 172.21.15.99:0/1036592041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d900fd7f0 0x7f6d900fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:38.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.543+0000 7f6d970e4640 1 --2- 172.21.15.99:0/1036592041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d900fc520 0x7f6d900fc930 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:38.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.543+0000 7f6d970e4640 1 -- 172.21.15.99:0/1036592041 >> 172.21.15.99:0/1036592041 conn(0x7f6d900f7ce0 msgr2=0x7f6d900fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:38.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.543+0000 7f6d970e4640 1 -- 172.21.15.99:0/1036592041 shutdown_connections 2024-09-17T00:57:38.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.543+0000 7f6d970e4640 1 -- 172.21.15.99:0/1036592041 wait complete. 2024-09-17T00:57:38.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.543+0000 7f6d970e4640 1 Processor -- start 2024-09-17T00:57:38.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.543+0000 7f6d970e4640 1 -- start start 2024-09-17T00:57:38.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d970e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d900fc520 0x7f6d90071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:38.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d970e4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d900fd7f0 0x7f6d9006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:38.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d970e4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9006fff0 con 0x7f6d900fc520 2024-09-17T00:57:38.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d970e4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d90070130 con 0x7f6d900fd7f0 2024-09-17T00:57:38.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d8ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d900fd7f0 0x7f6d9006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:38.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d8ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d900fd7f0 0x7f6d9006fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38860/0 (socket says 172.21.15.99:38860) 2024-09-17T00:57:38.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d8ffff640 1 -- 172.21.15.99:0/647987958 learned_addr learned my addr 172.21.15.99:0/647987958 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:57:38.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d94e80640 1 --2- 172.21.15.99:0/647987958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d900fc520 0x7f6d90071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:38.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d8ffff640 1 -- 172.21.15.99:0/647987958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d900fc520 msgr2=0x7f6d90071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:38.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d8ffff640 1 --2- 172.21.15.99:0/647987958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d900fc520 0x7f6d90071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:38.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d8ffff640 1 -- 172.21.15.99:0/647987958 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d800098b0 con 0x7f6d900fd7f0 2024-09-17T00:57:38.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d94e80640 1 --2- 172.21.15.99:0/647987958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d900fc520 0x7f6d90071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T00:57:38.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d8ffff640 1 --2- 172.21.15.99:0/647987958 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d900fd7f0 0x7f6d9006fa60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800c810 tx=0x7f6d780043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:38.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d8d7fa640 1 -- 172.21.15.99:0/647987958 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d7800a820 con 0x7f6d900fd7f0 2024-09-17T00:57:38.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d8d7fa640 1 -- 172.21.15.99:0/647987958 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6d7800ae20 con 0x7f6d900fd7f0 2024-09-17T00:57:38.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d8d7fa640 1 -- 172.21.15.99:0/647987958 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d780115c0 con 0x7f6d900fd7f0 2024-09-17T00:57:38.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d970e4640 1 -- 172.21.15.99:0/647987958 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d90070410 con 0x7f6d900fd7f0 2024-09-17T00:57:38.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.544+0000 7f6d970e4640 1 -- 172.21.15.99:0/647987958 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d901150a0 con 0x7f6d900fd7f0 2024-09-17T00:57:38.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.545+0000 7f6d970e4640 1 -- 172.21.15.99:0/647987958 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d900fb980 con 0x7f6d900fd7f0 2024-09-17T00:57:38.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.546+0000 7f6d8d7fa640 1 -- 172.21.15.99:0/647987958 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f6d78012840 con 0x7f6d900fd7f0 2024-09-17T00:57:38.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.546+0000 7f6d8d7fa640 1 --2- 172.21.15.99:0/647987958 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f6d7c06ed60 0x7f6d7c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:38.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.547+0000 7f6d8d7fa640 1 -- 172.21.15.99:0/647987958 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f6d7808e240 con 0x7f6d900fd7f0 2024-09-17T00:57:38.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.547+0000 7f6d94e80640 1 --2- 172.21.15.99:0/647987958 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f6d7c06ed60 0x7f6d7c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:38.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.547+0000 7f6d94e80640 1 --2- 172.21.15.99:0/647987958 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f6d7c06ed60 0x7f6d7c071210 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d80000f80 tx=0x7f6d80004d10 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:38.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.552+0000 7f6d8d7fa640 1 -- 172.21.15.99:0/647987958 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6d7805b3d0 con 0x7f6d900fd7f0 2024-09-17T00:57:38.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:38.715+0000 7f6d970e4640 1 -- 172.21.15.99:0/647987958 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d90101c00 con 0x7f6d7c06ed60 2024-09-17T00:57:38.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:38 smithi099 ceph-mon[34357]: Detected new or changed devices on smithi099 2024-09-17T00:57:38.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:38 smithi099 ceph-mon[34357]: Adjusting osd_memory_target on smithi099 to 7968M 2024-09-17T00:57:38.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:38 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:38.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:38 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:38.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:38 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:38.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:38 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:38.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:38 smithi002 ceph-mon[27650]: Detected new or changed devices on smithi099 2024-09-17T00:57:38.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:38 smithi002 ceph-mon[27650]: Adjusting osd_memory_target on smithi099 to 7968M 2024-09-17T00:57:38.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:38 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:38.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:38 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:38.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:38 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:57:38.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:38 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:39.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:39 smithi099 ceph-mon[34357]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:39.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:39 smithi099 ceph-mon[34357]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:57:39.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:39 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:57:39.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:39 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:57:39.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:39 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:40.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:39 smithi002 ceph-mon[27650]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:40.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:39 smithi002 ceph-mon[27650]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:57:40.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:39 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T00:57:40.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:39 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T00:57:40.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:39 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:42.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:41 smithi099 ceph-mon[34357]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:42.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:41 smithi099 ceph-mon[34357]: from='client.? 172.21.15.99:0/3289797844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "465fe479-4e53-44c2-b681-f67bb3b553c3"}]: dispatch 2024-09-17T00:57:42.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:41 smithi099 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "465fe479-4e53-44c2-b681-f67bb3b553c3"}]: dispatch 2024-09-17T00:57:42.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:41 smithi099 ceph-mon[34357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "465fe479-4e53-44c2-b681-f67bb3b553c3"}]': finished 2024-09-17T00:57:42.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:41 smithi099 ceph-mon[34357]: osdmap e34: 6 total, 5 up, 6 in 2024-09-17T00:57:42.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:41 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:57:42.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:41 smithi099 ceph-mon[34357]: from='client.? 172.21.15.99:0/3403554656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:57:42.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:41 smithi002 ceph-mon[27650]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:42.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:41 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/3289797844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "465fe479-4e53-44c2-b681-f67bb3b553c3"}]: dispatch 2024-09-17T00:57:42.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:41 smithi002 ceph-mon[27650]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "465fe479-4e53-44c2-b681-f67bb3b553c3"}]: dispatch 2024-09-17T00:57:42.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:41 smithi002 ceph-mon[27650]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "465fe479-4e53-44c2-b681-f67bb3b553c3"}]': finished 2024-09-17T00:57:42.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:41 smithi002 ceph-mon[27650]: osdmap e34: 6 total, 5 up, 6 in 2024-09-17T00:57:42.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:41 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:57:42.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:41 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/3403554656' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T00:57:44.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:43 smithi099 ceph-mon[34357]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:44.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:43 smithi002 ceph-mon[27650]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:45.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:45 smithi099 ceph-mon[34357]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:46.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:45 smithi002 ceph-mon[27650]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:48.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:47 smithi099 ceph-mon[34357]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:48.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:47 smithi002 ceph-mon[27650]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:49.010 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T00:57:49.010 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:48 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:49.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T00:57:49.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:48 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:57:49.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:49 smithi099 ceph-mon[34357]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:49.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:49 smithi099 ceph-mon[34357]: Deploying daemon osd.5 on smithi099 2024-09-17T00:57:50.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:49 smithi002 ceph-mon[27650]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:50.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:49 smithi002 ceph-mon[27650]: Deploying daemon osd.5 on smithi099 2024-09-17T00:57:51.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:51 smithi099 ceph-mon[34357]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:51.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:51 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:57:52.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:51 smithi002 ceph-mon[27650]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:52.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:57:53.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:53 smithi099 ceph-mon[34357]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:53.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:53 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:53.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:53 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:53.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:53 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:54.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:53 smithi002 ceph-mon[27650]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:54.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:53 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:57:54.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:53 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:54.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:53 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:55.943 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:55 smithi099 ceph-mon[34357]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:56.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:55 smithi002 ceph-mon[27650]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:57.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:57.162+0000 7f6d8d7fa640 1 -- 172.21.15.99:0/647987958 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6d90101c00 con 0x7f6d7c06ed60 2024-09-17T00:57:57.161 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 5 on host 'smithi099' 2024-09-17T00:57:57.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:57.164+0000 7f6d970e4640 1 -- 172.21.15.99:0/647987958 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f6d7c06ed60 msgr2=0x7f6d7c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:57.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:57.164+0000 7f6d970e4640 1 --2- 172.21.15.99:0/647987958 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f6d7c06ed60 0x7f6d7c071210 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d80000f80 tx=0x7f6d80004d10 comp rx=0 tx=0).stop 2024-09-17T00:57:57.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:57.164+0000 7f6d970e4640 1 -- 172.21.15.99:0/647987958 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d900fd7f0 msgr2=0x7f6d9006fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:57.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:57.164+0000 7f6d970e4640 1 --2- 172.21.15.99:0/647987958 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d900fd7f0 0x7f6d9006fa60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800c810 tx=0x7f6d780043c0 comp rx=0 tx=0).stop 2024-09-17T00:57:57.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:57.165+0000 7f6d970e4640 1 -- 172.21.15.99:0/647987958 shutdown_connections 2024-09-17T00:57:57.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:57.165+0000 7f6d970e4640 1 --2- 172.21.15.99:0/647987958 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f6d7c06ed60 0x7f6d7c071210 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:57.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:57.165+0000 7f6d970e4640 1 --2- 172.21.15.99:0/647987958 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d900fd7f0 0x7f6d9006fa60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:57.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:57.165+0000 7f6d970e4640 1 --2- 172.21.15.99:0/647987958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d900fc520 0x7f6d90071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:57.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:57.165+0000 7f6d970e4640 1 -- 172.21.15.99:0/647987958 >> 172.21.15.99:0/647987958 conn(0x7f6d900f7ce0 msgr2=0x7f6d900f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:57.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:57.165+0000 7f6d970e4640 1 -- 172.21.15.99:0/647987958 shutdown_connections 2024-09-17T00:57:57.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:57:57.165+0000 7f6d970e4640 1 -- 172.21.15.99:0/647987958 wait complete. 2024-09-17T00:57:57.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:57 smithi099 ceph-mon[34357]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:57.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:57 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:57.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:57 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:57.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:57 smithi099 ceph-mon[34357]: from='osd.5 [v2:172.21.15.99:6816/4041287024,v1:172.21.15.99:6817/4041287024]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T00:57:57.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:57 smithi099 ceph-mon[34357]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T00:57:57.931 DEBUG:teuthology.orchestra.run.smithi099:osd.5> sudo journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.5.service 2024-09-17T00:57:57.933 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-17T00:57:57.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T00:57:57.963 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:57 smithi002 ceph-mon[27650]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:57.963 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:57 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:57.964 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:57 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:57.964 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:57 smithi002 ceph-mon[27650]: from='osd.5 [v2:172.21.15.99:6816/4041287024,v1:172.21.15.99:6817/4041287024]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T00:57:57.964 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:57 smithi002 ceph-mon[27650]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T00:57:58.205 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:57:59.477 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:59 smithi099 ceph-mon[34357]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T00:57:59.477 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:59 smithi099 ceph-mon[34357]: osdmap e35: 6 total, 5 up, 6 in 2024-09-17T00:57:59.477 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:59 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:57:59.477 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:59 smithi099 ceph-mon[34357]: from='osd.5 [v2:172.21.15.99:6816/4041287024,v1:172.21.15.99:6817/4041287024]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T00:57:59.477 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:59 smithi099 ceph-mon[34357]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T00:57:59.477 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:59 smithi099 ceph-mon[34357]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:59.477 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:59 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:59.477 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:57:59 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:59.478 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 00:57:59 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[53032]: 2024-09-17T00:57:59.170+0000 7ff5fe9b7640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T00:57:59.478 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 00:57:59 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[53032]: 2024-09-17T00:57:59.177+0000 7ff5f8fed640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T00:57:59.482 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:59 smithi002 ceph-mon[27650]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T00:57:59.482 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:59 smithi002 ceph-mon[27650]: osdmap e35: 6 total, 5 up, 6 in 2024-09-17T00:57:59.482 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:59 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:57:59.482 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:59 smithi002 ceph-mon[27650]: from='osd.5 [v2:172.21.15.99:6816/4041287024,v1:172.21.15.99:6817/4041287024]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T00:57:59.482 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:59 smithi002 ceph-mon[27650]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T00:57:59.482 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:59 smithi002 ceph-mon[27650]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:57:59.482 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:59 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:59.482 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:57:59 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:57:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.959+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/840741471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980fc550 msgr2=0x7fbc980fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.959+0000 7fbc9f9a2640 1 --2- 172.21.15.2:0/840741471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980fc550 0x7fbc980fc960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbc900048d0 tx=0x7fbc90009da0 comp rx=0 tx=0).stop 2024-09-17T00:57:59.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.960+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/840741471 shutdown_connections 2024-09-17T00:57:59.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.960+0000 7fbc9f9a2640 1 --2- 172.21.15.2:0/840741471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc980fd820 0x7fbc980fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:59.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.960+0000 7fbc9f9a2640 1 --2- 172.21.15.2:0/840741471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980fc550 0x7fbc980fc960 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:59.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.960+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/840741471 >> 172.21.15.2:0/840741471 conn(0x7fbc980f7d30 msgr2=0x7fbc980fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:57:59.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.960+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/840741471 shutdown_connections 2024-09-17T00:57:59.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.960+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/840741471 wait complete. 2024-09-17T00:57:59.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.960+0000 7fbc9f9a2640 1 Processor -- start 2024-09-17T00:57:59.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.960+0000 7fbc9f9a2640 1 -- start start 2024-09-17T00:57:59.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc9f9a2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc980fc550 0x7fbc98071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:59.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc9f9a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980fd820 0x7fbc9806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:59.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc9f9a2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9806fff0 con 0x7fbc980fd820 2024-09-17T00:57:59.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc9f9a2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc98070130 con 0x7fbc980fc550 2024-09-17T00:57:59.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc9cf3d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980fd820 0x7fbc9806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:59.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc9cf3d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980fd820 0x7fbc9806fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45756/0 (socket says 172.21.15.2:45756) 2024-09-17T00:57:59.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc9cf3d640 1 -- 172.21.15.2:0/3888803445 learned_addr learned my addr 172.21.15.2:0/3888803445 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:57:59.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc9d73e640 1 --2- 172.21.15.2:0/3888803445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc980fc550 0x7fbc98071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:59.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc9cf3d640 1 -- 172.21.15.2:0/3888803445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc980fc550 msgr2=0x7fbc98071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:57:59.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc9cf3d640 1 --2- 172.21.15.2:0/3888803445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc980fc550 0x7fbc98071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:57:59.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc9cf3d640 1 -- 172.21.15.2:0/3888803445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc90005040 con 0x7fbc980fd820 2024-09-17T00:57:59.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc9cf3d640 1 --2- 172.21.15.2:0/3888803445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980fd820 0x7fbc9806fa60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c002a50 tx=0x7fbc8c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:59.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc95ffb640 1 -- 172.21.15.2:0/3888803445 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc8c007c30 con 0x7fbc980fd820 2024-09-17T00:57:59.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/3888803445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc98070410 con 0x7fbc980fd820 2024-09-17T00:57:59.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc95ffb640 1 -- 172.21.15.2:0/3888803445 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbc8c00f040 con 0x7fbc980fd820 2024-09-17T00:57:59.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc95ffb640 1 -- 172.21.15.2:0/3888803445 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc8c00da10 con 0x7fbc980fd820 2024-09-17T00:57:59.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.962+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/3888803445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc981150d0 con 0x7fbc980fd820 2024-09-17T00:57:59.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.964+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/3888803445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc980fb9b0 con 0x7fbc980fd820 2024-09-17T00:57:59.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.964+0000 7fbc95ffb640 1 -- 172.21.15.2:0/3888803445 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fbc8c00dc80 con 0x7fbc980fd820 2024-09-17T00:57:59.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.965+0000 7fbc95ffb640 1 --2- 172.21.15.2:0/3888803445 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fbc8006ed60 0x7fbc80071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:57:59.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.965+0000 7fbc95ffb640 1 -- 172.21.15.2:0/3888803445 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4354+0+0 (secure 0 0 0) 0x7fbc8c08d4f0 con 0x7fbc980fd820 2024-09-17T00:57:59.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.965+0000 7fbc9d73e640 1 --2- 172.21.15.2:0/3888803445 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fbc8006ed60 0x7fbc80071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:57:59.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.965+0000 7fbc9d73e640 1 --2- 172.21.15.2:0/3888803445 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fbc8006ed60 0x7fbc80071210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc90000c00 tx=0x7fbc90035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:57:59.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:57:59.969+0000 7fbc95ffb640 1 -- 172.21.15.2:0/3888803445 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbc8c04d2a0 con 0x7fbc980fd820 2024-09-17T00:58:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:00.143+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/3888803445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fbc98115300 con 0x7fbc980fd820 2024-09-17T00:58:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:00.144+0000 7fbc95ffb640 1 -- 172.21.15.2:0/3888803445 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7fbc8c05abd0 con 0x7fbc980fd820 2024-09-17T00:58:00.141 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:58:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:00.146+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/3888803445 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fbc8006ed60 msgr2=0x7fbc80071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:00.146+0000 7fbc9f9a2640 1 --2- 172.21.15.2:0/3888803445 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fbc8006ed60 0x7fbc80071210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc90000c00 tx=0x7fbc90035040 comp rx=0 tx=0).stop 2024-09-17T00:58:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:00.146+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/3888803445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980fd820 msgr2=0x7fbc9806fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:00.146+0000 7fbc9f9a2640 1 --2- 172.21.15.2:0/3888803445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980fd820 0x7fbc9806fa60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c002a50 tx=0x7fbc8c004600 comp rx=0 tx=0).stop 2024-09-17T00:58:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:00.146+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/3888803445 shutdown_connections 2024-09-17T00:58:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:00.146+0000 7fbc9f9a2640 1 --2- 172.21.15.2:0/3888803445 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fbc8006ed60 0x7fbc80071210 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:00.146+0000 7fbc9f9a2640 1 --2- 172.21.15.2:0/3888803445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc980fd820 0x7fbc9806fa60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:00.146+0000 7fbc9f9a2640 1 --2- 172.21.15.2:0/3888803445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc980fc550 0x7fbc98071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:00.147+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/3888803445 >> 172.21.15.2:0/3888803445 conn(0x7fbc980f7d30 msgr2=0x7fbc980f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:00.147+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/3888803445 shutdown_connections 2024-09-17T00:58:00.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:00.147+0000 7fbc9f9a2640 1 -- 172.21.15.2:0/3888803445 wait complete. 2024-09-17T00:58:00.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:00 smithi002 ceph-mon[27650]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-17T00:58:00.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:00 smithi002 ceph-mon[27650]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T00:58:00.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:00 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:58:00.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:00 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:58:00.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:00 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3888803445' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T00:58:00.494 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:00 smithi099 ceph-mon[34357]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-17T00:58:00.494 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:00 smithi099 ceph-mon[34357]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T00:58:00.494 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:00 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:58:00.494 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:00 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:58:00.494 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:00 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3888803445' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T00:58:00.957 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1726534654,"num_in_osds":6,"osd_in_since":1726534661,"num_remapped_pgs":0} 2024-09-17T00:58:01.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:01 smithi002 ceph-mon[27650]: purged_snaps scrub starts 2024-09-17T00:58:01.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:01 smithi002 ceph-mon[27650]: purged_snaps scrub ok 2024-09-17T00:58:01.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:01 smithi002 ceph-mon[27650]: osd.5 [v2:172.21.15.99:6816/4041287024,v1:172.21.15.99:6817/4041287024] boot 2024-09-17T00:58:01.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:01 smithi002 ceph-mon[27650]: osdmap e37: 6 total, 6 up, 6 in 2024-09-17T00:58:01.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:01 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:58:01.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:01 smithi002 ceph-mon[27650]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:58:01.503 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:01 smithi099 ceph-mon[34357]: purged_snaps scrub starts 2024-09-17T00:58:01.503 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:01 smithi099 ceph-mon[34357]: purged_snaps scrub ok 2024-09-17T00:58:01.503 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:01 smithi099 ceph-mon[34357]: osd.5 [v2:172.21.15.99:6816/4041287024,v1:172.21.15.99:6817/4041287024] boot 2024-09-17T00:58:01.503 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:01 smithi099 ceph-mon[34357]: osdmap e37: 6 total, 6 up, 6 in 2024-09-17T00:58:01.504 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:01 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T00:58:01.504 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:01 smithi099 ceph-mon[34357]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-17T00:58:01.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T00:58:02.227 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:02.349 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:02 smithi002 ceph-mon[27650]: osdmap e38: 6 total, 6 up, 6 in 2024-09-17T00:58:02.350 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:58:02.350 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:58:02.350 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:58:02.350 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:58:02.350 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:58:02.350 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:58:02.350 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:02.350 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:02.350 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:58:02.350 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:02.350 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:02.350 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:02.350 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:58:02.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:02 smithi099 ceph-mon[34357]: osdmap e38: 6 total, 6 up, 6 in 2024-09-17T00:58:02.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:58:02.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:58:02.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:58:02.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:58:02.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T00:58:02.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:58:02.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:02.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:02.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:58:02.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:58:02.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:58:02.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:58:02.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:58:03.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:03 smithi002 ceph-mon[27650]: Detected new or changed devices on smithi099 2024-09-17T00:58:03.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:03 smithi002 ceph-mon[27650]: Adjusting osd_memory_target on smithi099 to 5312M 2024-09-17T00:58:03.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:03 smithi002 ceph-mon[27650]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:03.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:03 smithi099 ceph-mon[34357]: Detected new or changed devices on smithi099 2024-09-17T00:58:03.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:03 smithi099 ceph-mon[34357]: Adjusting osd_memory_target on smithi099 to 5312M 2024-09-17T00:58:03.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:03 smithi099 ceph-mon[34357]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:03.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.962+0000 7f8b4bace640 1 -- 172.21.15.2:0/4148105683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440fb480 msgr2=0x7f8b440fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:03.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.962+0000 7f8b4bace640 1 --2- 172.21.15.2:0/4148105683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440fb480 0x7f8b440fb890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8b400048d0 tx=0x7f8b40009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:03.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.962+0000 7f8b4bace640 1 -- 172.21.15.2:0/4148105683 shutdown_connections 2024-09-17T00:58:03.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.962+0000 7f8b4bace640 1 --2- 172.21.15.2:0/4148105683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b440fc750 0x7f8b440fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:03.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.962+0000 7f8b4bace640 1 --2- 172.21.15.2:0/4148105683 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440fb480 0x7f8b440fb890 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:03.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.962+0000 7f8b4bace640 1 -- 172.21.15.2:0/4148105683 >> 172.21.15.2:0/4148105683 conn(0x7f8b440f6c40 msgr2=0x7f8b440f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:03.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.962+0000 7f8b4bace640 1 -- 172.21.15.2:0/4148105683 shutdown_connections 2024-09-17T00:58:03.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.962+0000 7f8b4bace640 1 -- 172.21.15.2:0/4148105683 wait complete. 2024-09-17T00:58:03.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.963+0000 7f8b4bace640 1 Processor -- start 2024-09-17T00:58:03.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.963+0000 7f8b4bace640 1 -- start start 2024-09-17T00:58:03.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.963+0000 7f8b4bace640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440fb480 0x7f8b4410bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:03.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.963+0000 7f8b4bace640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b440fc750 0x7f8b4410c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:03.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.963+0000 7f8b4bace640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4410cb70 con 0x7f8b440fb480 2024-09-17T00:58:03.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.963+0000 7f8b4bace640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4410d390 con 0x7f8b440fc750 2024-09-17T00:58:03.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.963+0000 7f8b4986a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440fb480 0x7f8b4410bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:03.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.963+0000 7f8b4986a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440fb480 0x7f8b4410bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48480/0 (socket says 172.21.15.2:48480) 2024-09-17T00:58:03.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.963+0000 7f8b4986a640 1 -- 172.21.15.2:0/123310206 learned_addr learned my addr 172.21.15.2:0/123310206 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:03.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.963+0000 7f8b49069640 1 --2- 172.21.15.2:0/123310206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b440fc750 0x7f8b4410c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:03.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.963+0000 7f8b4986a640 1 -- 172.21.15.2:0/123310206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b440fc750 msgr2=0x7f8b4410c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:03.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.963+0000 7f8b4986a640 1 --2- 172.21.15.2:0/123310206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b440fc750 0x7f8b4410c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:03.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.963+0000 7f8b4986a640 1 -- 172.21.15.2:0/123310206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b40005040 con 0x7f8b440fb480 2024-09-17T00:58:03.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.964+0000 7f8b4986a640 1 --2- 172.21.15.2:0/123310206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440fb480 0x7f8b4410bfe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8b40000c00 tx=0x7f8b40009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:03.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.964+0000 7f8b3a7fc640 1 -- 172.21.15.2:0/123310206 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b40038070 con 0x7f8b440fb480 2024-09-17T00:58:03.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.964+0000 7f8b3a7fc640 1 -- 172.21.15.2:0/123310206 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8b4002ae90 con 0x7f8b440fb480 2024-09-17T00:58:03.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.964+0000 7f8b4bace640 1 -- 172.21.15.2:0/123310206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4410d5c0 con 0x7f8b440fb480 2024-09-17T00:58:03.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.964+0000 7f8b3a7fc640 1 -- 172.21.15.2:0/123310206 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b4003d420 con 0x7f8b440fb480 2024-09-17T00:58:03.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.964+0000 7f8b4bace640 1 -- 172.21.15.2:0/123310206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4410db00 con 0x7f8b440fb480 2024-09-17T00:58:03.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.965+0000 7f8b4bace640 1 -- 172.21.15.2:0/123310206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b440fa8e0 con 0x7f8b440fb480 2024-09-17T00:58:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.966+0000 7f8b3a7fc640 1 -- 172.21.15.2:0/123310206 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f8b40030020 con 0x7f8b440fb480 2024-09-17T00:58:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.966+0000 7f8b3a7fc640 1 --2- 172.21.15.2:0/123310206 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8b3006ed60 0x7f8b30071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.966+0000 7f8b3a7fc640 1 -- 172.21.15.2:0/123310206 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8b400ae530 con 0x7f8b440fb480 2024-09-17T00:58:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.966+0000 7f8b49069640 1 --2- 172.21.15.2:0/123310206 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8b3006ed60 0x7f8b30071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:03.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.967+0000 7f8b49069640 1 --2- 172.21.15.2:0/123310206 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8b3006ed60 0x7f8b30071210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b4410bd90 tx=0x7f8b34009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:03.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:03.971+0000 7f8b3a7fc640 1 -- 172.21.15.2:0/123310206 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8b4007ba10 con 0x7f8b440fb480 2024-09-17T00:58:04.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:04.134+0000 7f8b4bace640 1 -- 172.21.15.2:0/123310206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f8b4404b720 con 0x7f8b440fb480 2024-09-17T00:58:04.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:04.135+0000 7f8b3a7fc640 1 -- 172.21.15.2:0/123310206 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f8b4007b3b0 con 0x7f8b440fb480 2024-09-17T00:58:04.132 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:58:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:04.136+0000 7f8b4bace640 1 -- 172.21.15.2:0/123310206 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8b3006ed60 msgr2=0x7f8b30071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:04.136+0000 7f8b4bace640 1 --2- 172.21.15.2:0/123310206 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8b3006ed60 0x7f8b30071210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b4410bd90 tx=0x7f8b34009040 comp rx=0 tx=0).stop 2024-09-17T00:58:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:04.136+0000 7f8b4bace640 1 -- 172.21.15.2:0/123310206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440fb480 msgr2=0x7f8b4410bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:04.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:04.136+0000 7f8b4bace640 1 --2- 172.21.15.2:0/123310206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440fb480 0x7f8b4410bfe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8b40000c00 tx=0x7f8b40009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:04.137+0000 7f8b4bace640 1 -- 172.21.15.2:0/123310206 shutdown_connections 2024-09-17T00:58:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:04.137+0000 7f8b4bace640 1 --2- 172.21.15.2:0/123310206 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8b3006ed60 0x7f8b30071210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:04.137+0000 7f8b4bace640 1 --2- 172.21.15.2:0/123310206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b440fc750 0x7f8b4410c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:04.137+0000 7f8b4bace640 1 --2- 172.21.15.2:0/123310206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b440fb480 0x7f8b4410bfe0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:04.137+0000 7f8b4bace640 1 -- 172.21.15.2:0/123310206 >> 172.21.15.2:0/123310206 conn(0x7f8b440f6c40 msgr2=0x7f8b440f8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:04.137+0000 7f8b4bace640 1 -- 172.21.15.2:0/123310206 shutdown_connections 2024-09-17T00:58:04.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:04.137+0000 7f8b4bace640 1 -- 172.21.15.2:0/123310206 wait complete. 2024-09-17T00:58:04.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:04 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/123310206' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T00:58:04.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:04 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/123310206' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T00:58:04.724 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1726534680,"num_in_osds":6,"osd_in_since":1726534661,"num_remapped_pgs":0} 2024-09-17T00:58:04.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T00:58:04.982 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:05.354 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:05 smithi002 ceph-mon[27650]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:05.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:05 smithi099 ceph-mon[34357]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:06.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:58:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.624+0000 7fb3d850e640 1 -- 172.21.15.2:0/2281409962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d0102f20 msgr2=0x7fb3d00fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.624+0000 7fb3d850e640 1 --2- 172.21.15.2:0/2281409962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d0102f20 0x7fb3d00fc5e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb3c00048d0 tx=0x7fb3c0009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.624+0000 7fb3d850e640 1 -- 172.21.15.2:0/2281409962 shutdown_connections 2024-09-17T00:58:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.624+0000 7fb3d850e640 1 --2- 172.21.15.2:0/2281409962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d0102f20 0x7fb3d00fc5e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.624+0000 7fb3d850e640 1 --2- 172.21.15.2:0/2281409962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d0102580 0x7fb3d0102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.624+0000 7fb3d850e640 1 -- 172.21.15.2:0/2281409962 >> 172.21.15.2:0/2281409962 conn(0x7fb3d00f81a0 msgr2=0x7fb3d00fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.624+0000 7fb3d850e640 1 -- 172.21.15.2:0/2281409962 shutdown_connections 2024-09-17T00:58:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.624+0000 7fb3d850e640 1 -- 172.21.15.2:0/2281409962 wait complete. 2024-09-17T00:58:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d850e640 1 Processor -- start 2024-09-17T00:58:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d850e640 1 -- start start 2024-09-17T00:58:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d850e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d0102580 0x7fb3d006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d850e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d0102f20 0x7fb3d006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d850e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d0070490 con 0x7fb3d0102580 2024-09-17T00:58:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d850e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d0070600 con 0x7fb3d0102f20 2024-09-17T00:58:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d62aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d0102580 0x7fb3d006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d62aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d0102580 0x7fb3d006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48506/0 (socket says 172.21.15.2:48506) 2024-09-17T00:58:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d62aa640 1 -- 172.21.15.2:0/4047486713 learned_addr learned my addr 172.21.15.2:0/4047486713 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d5aa9640 1 --2- 172.21.15.2:0/4047486713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d0102f20 0x7fb3d006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d62aa640 1 -- 172.21.15.2:0/4047486713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d0102f20 msgr2=0x7fb3d006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d62aa640 1 --2- 172.21.15.2:0/4047486713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d0102f20 0x7fb3d006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d62aa640 1 -- 172.21.15.2:0/4047486713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c0005040 con 0x7fb3d0102580 2024-09-17T00:58:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d5aa9640 1 --2- 172.21.15.2:0/4047486713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d0102f20 0x7fb3d006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T00:58:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.625+0000 7fb3d62aa640 1 --2- 172.21.15.2:0/4047486713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d0102580 0x7fb3d006fa10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc002a50 tx=0x7fb3cc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.626+0000 7fb3c6ffd640 1 -- 172.21.15.2:0/4047486713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3cc007c30 con 0x7fb3d0102580 2024-09-17T00:58:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.626+0000 7fb3c6ffd640 1 -- 172.21.15.2:0/4047486713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb3cc00f040 con 0x7fb3d0102580 2024-09-17T00:58:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.626+0000 7fb3d850e640 1 -- 172.21.15.2:0/4047486713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d0070890 con 0x7fb3d0102580 2024-09-17T00:58:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.626+0000 7fb3c6ffd640 1 -- 172.21.15.2:0/4047486713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3cc00da90 con 0x7fb3d0102580 2024-09-17T00:58:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.626+0000 7fb3d850e640 1 -- 172.21.15.2:0/4047486713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d01198c0 con 0x7fb3d0102580 2024-09-17T00:58:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.627+0000 7fb3d850e640 1 -- 172.21.15.2:0/4047486713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d00fdd00 con 0x7fb3d0102580 2024-09-17T00:58:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.627+0000 7fb3c6ffd640 1 -- 172.21.15.2:0/4047486713 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fb3cc00dd00 con 0x7fb3d0102580 2024-09-17T00:58:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.628+0000 7fb3c6ffd640 1 --2- 172.21.15.2:0/4047486713 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb3bc06ed60 0x7fb3bc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.628+0000 7fb3c6ffd640 1 -- 172.21.15.2:0/4047486713 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb3cc08d700 con 0x7fb3d0102580 2024-09-17T00:58:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.628+0000 7fb3d5aa9640 1 --2- 172.21.15.2:0/4047486713 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb3bc06ed60 0x7fb3bc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.629+0000 7fb3d5aa9640 1 --2- 172.21.15.2:0/4047486713 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb3bc06ed60 0x7fb3bc071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0000c00 tx=0x7fb3c0035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:06.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.632+0000 7fb3c6ffd640 1 -- 172.21.15.2:0/4047486713 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb3cc04d2a0 con 0x7fb3d0102580 2024-09-17T00:58:06.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:58:06.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.797+0000 7fb3d850e640 1 -- 172.21.15.2:0/4047486713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3d00fbda0 con 0x7fb3d0102580 2024-09-17T00:58:06.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.798+0000 7fb3c6ffd640 1 -- 172.21.15.2:0/4047486713 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11009 (secure 0 0 0) 0x7fb3cc05ab60 con 0x7fb3d0102580 2024-09-17T00:58:06.795 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:58:06.795 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":38,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","created":"2024-09-17T00:52:36.851622+0000","modified":"2024-09-17T00:58:01.173429+0000","last_up_change":"2024-09-17T00:58:00.167361+0000","last_in_change":"2024-09-17T00:57:41.064225+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T00:56:44.767272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"89201a70-9650-4f5a-b943-c6c75fb3f689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1937150145},{"type":"v1","addr":"172.21.15.2:6803","nonce":1937150145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1937150145},{"type":"v1","addr":"172.21.15.2:6805","nonce":1937150145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1937150145},{"type":"v1","addr":"172.21.15.2:6809","nonce":1937150145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1937150145},{"type":"v1","addr":"172.21.15.2:6807","nonce":1937150145}]},"public_addr":"172.21.15.2:6803/1937150145","cluster_addr":"172.21.15.2:6805/1937150145","heartbeat_back_addr":"172.21.15.2:6809/1937150145","heartbeat_front_addr":"172.21.15.2:6807/1937150145","state":["exists","up"]},{"osd":1,"uuid":"8e62bb00-c559-40e9-84f3-944637772694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3467957340},{"type":"v1","addr":"172.21.15.2:6811","nonce":3467957340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3467957340},{"type":"v1","addr":"172.21.15.2:6813","nonce":3467957340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3467957340},{"type":"v1","addr":"172.21.15.2:6817","nonce":3467957340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3467957340},{"type":"v1","addr":"172.21.15.2:6815","nonce":3467957340}]},"public_addr":"172.21.15.2:6811/3467957340","cluster_addr":"172.21.15.2:6813/3467957340","heartbeat_back_addr":"172.21.15.2:6817/3467957340","heartbeat_front_addr":"172.21.15.2:6815/3467957340","state":["exists","up"]},{"osd":2,"uuid":"6af863fc-14a2-4b04-959b-8a36a80657fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2404856812},{"type":"v1","addr":"172.21.15.2:6819","nonce":2404856812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2404856812},{"type":"v1","addr":"172.21.15.2:6821","nonce":2404856812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2404856812},{"type":"v1","addr":"172.21.15.2:6825","nonce":2404856812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2404856812},{"type":"v1","addr":"172.21.15.2:6823","nonce":2404856812}]},"public_addr":"172.21.15.2:6819/2404856812","cluster_addr":"172.21.15.2:6821/2404856812","heartbeat_back_addr":"172.21.15.2:6825/2404856812","heartbeat_front_addr":"172.21.15.2:6823/2404856812","state":["exists","up"]},{"osd":3,"uuid":"204d5042-792c-413a-bf0d-33deca063a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2455888957},{"type":"v1","addr":"172.21.15.99:6801","nonce":2455888957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2455888957},{"type":"v1","addr":"172.21.15.99:6803","nonce":2455888957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2455888957},{"type":"v1","addr":"172.21.15.99:6807","nonce":2455888957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2455888957},{"type":"v1","addr":"172.21.15.99:6805","nonce":2455888957}]},"public_addr":"172.21.15.99:6801/2455888957","cluster_addr":"172.21.15.99:6803/2455888957","heartbeat_back_addr":"172.21.15.99:6807/2455888957","heartbeat_front_addr":"172.21.15.99:6805/2455888957","state":["exists","up"]},{"osd":4,"uuid":"c2bd2bb0-ceec-4901-8709-7388aa695687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1239096669},{"type":"v1","addr":"172.21.15.99:6809","nonce":1239096669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1239096669},{"type":"v1","addr":"172.21.15.99:6811","nonce":1239096669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1239096669},{"type":"v1","addr":"172.21.15.99:6815","nonce":1239096669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1239096669},{"type":"v1","addr":"172.21.15.99:6813","nonce":1239096669}]},"public_addr":"172.21.15.99:6809/1239096669","cluster_addr":"172.21.15.99:6811/1239096669","heartbeat_back_addr":"172.21.15.99:6815/1239096669","heartbeat_front_addr":"172.21.15.99:6813/1239096669","state":["exists","up"]},{"osd":5,"uuid":"465fe479-4e53-44c2-b681-f67bb3b553c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4041287024},{"type":"v1","addr":"172.21.15.99:6817","nonce":4041287024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":4041287024},{"type":"v1","addr":"172.21.15.99:6819","nonce":4041287024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":4041287024},{"type":"v1","addr":"172.21.15.99:6823","nonce":4041287024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4041287024},{"type":"v1","addr":"172.21.15.99:6821","nonce":4041287024}]},"public_addr":"172.21.15.99:6817/4041287024","cluster_addr":"172.21.15.99:6819/4041287024","heartbeat_back_addr":"172.21.15.99:6823/4041287024","heartbeat_front_addr":"172.21.15.99:6821/4041287024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:55:47.121317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:56:14.656746+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:56:42.506800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:57:06.952247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:57:32.969868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:57:58.236837+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/157433590":"2024-09-18T00:54:36.242935+0000","172.21.15.2:6801/2191872617":"2024-09-18T00:54:36.242935+0000","172.21.15.2:0/3770177876":"2024-09-18T00:53:35.657108+0000","172.21.15.2:0/2597867872":"2024-09-18T00:53:05.759479+0000","172.21.15.2:6801/3082534604":"2024-09-18T00:53:35.657108+0000","172.21.15.2:6800/1951809935":"2024-09-18T00:53:05.759479+0000","172.21.15.2:6801/1951809935":"2024-09-18T00:53:05.759479+0000","172.21.15.2:0/2687394772":"2024-09-18T00:53:05.759479+0000","172.21.15.2:0/2244315938":"2024-09-18T00:53:05.759479+0000","172.21.15.2:0/1006642018":"2024-09-18T00:54:36.242935+0000","172.21.15.2:0/4008124108":"2024-09-18T00:53:35.657108+0000","172.21.15.2:6800/3082534604":"2024-09-18T00:53:35.657108+0000","172.21.15.2:0/2143800566":"2024-09-18T00:53:35.657108+0000","172.21.15.2:6800/2191872617":"2024-09-18T00:54:36.242935+0000","172.21.15.2:0/4221926423":"2024-09-18T00:54:36.242935+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T00:58:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.800+0000 7fb3d850e640 1 -- 172.21.15.2:0/4047486713 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb3bc06ed60 msgr2=0x7fb3bc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.800+0000 7fb3d850e640 1 --2- 172.21.15.2:0/4047486713 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb3bc06ed60 0x7fb3bc071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0000c00 tx=0x7fb3c0035040 comp rx=0 tx=0).stop 2024-09-17T00:58:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.800+0000 7fb3d850e640 1 -- 172.21.15.2:0/4047486713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d0102580 msgr2=0x7fb3d006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.800+0000 7fb3d850e640 1 --2- 172.21.15.2:0/4047486713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d0102580 0x7fb3d006fa10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc002a50 tx=0x7fb3cc004600 comp rx=0 tx=0).stop 2024-09-17T00:58:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.800+0000 7fb3d850e640 1 -- 172.21.15.2:0/4047486713 shutdown_connections 2024-09-17T00:58:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.800+0000 7fb3d850e640 1 --2- 172.21.15.2:0/4047486713 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb3bc06ed60 0x7fb3bc071210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.800+0000 7fb3d850e640 1 --2- 172.21.15.2:0/4047486713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d0102f20 0x7fb3d006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.800+0000 7fb3d850e640 1 --2- 172.21.15.2:0/4047486713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb3d0102580 0x7fb3d006fa10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.800+0000 7fb3d850e640 1 -- 172.21.15.2:0/4047486713 >> 172.21.15.2:0/4047486713 conn(0x7fb3d00f81a0 msgr2=0x7fb3d00f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.800+0000 7fb3d850e640 1 -- 172.21.15.2:0/4047486713 shutdown_connections 2024-09-17T00:58:06.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:06.800+0000 7fb3d850e640 1 -- 172.21.15.2:0/4047486713 wait complete. 2024-09-17T00:58:07.590 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:07 smithi002 ceph-mon[27650]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:07.590 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:07 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/4047486713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:58:07.619 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T00:56:44.767272+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-17T00:58:07.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-17T00:58:07.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:07 smithi099 ceph-mon[34357]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:07.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:07 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/4047486713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:58:07.878 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:09.602 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:09 smithi002 ceph-mon[27650]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.613+0000 7ff4e676c640 1 -- 172.21.15.2:0/2636320418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e0102550 msgr2=0x7ff4e0102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.613+0000 7ff4e676c640 1 --2- 172.21.15.2:0/2636320418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e0102550 0x7ff4e0102920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00048d0 tx=0x7ff4d0009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.613+0000 7ff4e676c640 1 -- 172.21.15.2:0/2636320418 shutdown_connections 2024-09-17T00:58:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.613+0000 7ff4e676c640 1 --2- 172.21.15.2:0/2636320418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e0102ef0 0x7ff4e00fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.613+0000 7ff4e676c640 1 --2- 172.21.15.2:0/2636320418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e0102550 0x7ff4e0102920 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.613+0000 7ff4e676c640 1 -- 172.21.15.2:0/2636320418 >> 172.21.15.2:0/2636320418 conn(0x7ff4e00f80f0 msgr2=0x7ff4e00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.613+0000 7ff4e676c640 1 -- 172.21.15.2:0/2636320418 shutdown_connections 2024-09-17T00:58:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.613+0000 7ff4e676c640 1 -- 172.21.15.2:0/2636320418 wait complete. 2024-09-17T00:58:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.613+0000 7ff4e676c640 1 Processor -- start 2024-09-17T00:58:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.613+0000 7ff4e676c640 1 -- start start 2024-09-17T00:58:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4e676c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e0102550 0x7ff4e0113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4e676c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e0102ef0 0x7ff4e0113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4e676c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e0114100 con 0x7ff4e0102ef0 2024-09-17T00:58:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4e676c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e010d510 con 0x7ff4e0102550 2024-09-17T00:58:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e0102ef0 0x7ff4e0113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4d7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e0102ef0 0x7ff4e0113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48514/0 (socket says 172.21.15.2:48514) 2024-09-17T00:58:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4d7fff640 1 -- 172.21.15.2:0/366608939 learned_addr learned my addr 172.21.15.2:0/366608939 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4dffff640 1 --2- 172.21.15.2:0/366608939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e0102550 0x7ff4e0113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4d7fff640 1 -- 172.21.15.2:0/366608939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e0102550 msgr2=0x7ff4e0113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4d7fff640 1 --2- 172.21.15.2:0/366608939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e0102550 0x7ff4e0113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4d7fff640 1 -- 172.21.15.2:0/366608939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0005040 con 0x7ff4e0102ef0 2024-09-17T00:58:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4dffff640 1 --2- 172.21.15.2:0/366608939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e0102550 0x7ff4e0113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T00:58:09.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4d7fff640 1 --2- 172.21.15.2:0/366608939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e0102ef0 0x7ff4e0113ab0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8002870 tx=0x7ff4c8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4dd7fa640 1 -- 172.21.15.2:0/366608939 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4c8007c30 con 0x7ff4e0102ef0 2024-09-17T00:58:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4dd7fa640 1 -- 172.21.15.2:0/366608939 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff4c800f040 con 0x7ff4e0102ef0 2024-09-17T00:58:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4e676c640 1 -- 172.21.15.2:0/366608939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e010d7f0 con 0x7ff4e0102ef0 2024-09-17T00:58:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4dd7fa640 1 -- 172.21.15.2:0/366608939 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4c8009640 con 0x7ff4e0102ef0 2024-09-17T00:58:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.614+0000 7ff4e676c640 1 -- 172.21.15.2:0/366608939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e010dd10 con 0x7ff4e0102ef0 2024-09-17T00:58:09.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.615+0000 7ff4e676c640 1 -- 172.21.15.2:0/366608939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e00fdcd0 con 0x7ff4e0102ef0 2024-09-17T00:58:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.616+0000 7ff4dd7fa640 1 -- 172.21.15.2:0/366608939 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7ff4c80097a0 con 0x7ff4e0102ef0 2024-09-17T00:58:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.617+0000 7ff4dd7fa640 1 --2- 172.21.15.2:0/366608939 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff4cc06ed60 0x7ff4cc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.617+0000 7ff4dd7fa640 1 -- 172.21.15.2:0/366608939 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff4c808dc70 con 0x7ff4e0102ef0 2024-09-17T00:58:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.617+0000 7ff4dffff640 1 --2- 172.21.15.2:0/366608939 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff4cc06ed60 0x7ff4cc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:09.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.617+0000 7ff4dffff640 1 --2- 172.21.15.2:0/366608939 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff4cc06ed60 0x7ff4cc071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000b020 tx=0x7ff4d0009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:09.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.621+0000 7ff4dd7fa640 1 -- 172.21.15.2:0/366608939 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff4c805b150 con 0x7ff4e0102ef0 2024-09-17T00:58:09.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.787+0000 7ff4e676c640 1 -- 172.21.15.2:0/366608939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4e01095a0 con 0x7ff4e0102ef0 2024-09-17T00:58:09.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.787+0000 7ff4dd7fa640 1 -- 172.21.15.2:0/366608939 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4c805aaf0 con 0x7ff4e0102ef0 2024-09-17T00:58:09.784 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-17T00:58:09.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.789+0000 7ff4e676c640 1 -- 172.21.15.2:0/366608939 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff4cc06ed60 msgr2=0x7ff4cc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:09.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.789+0000 7ff4e676c640 1 --2- 172.21.15.2:0/366608939 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff4cc06ed60 0x7ff4cc071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000b020 tx=0x7ff4d0009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:09.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.789+0000 7ff4e676c640 1 -- 172.21.15.2:0/366608939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e0102ef0 msgr2=0x7ff4e0113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:09.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.789+0000 7ff4e676c640 1 --2- 172.21.15.2:0/366608939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e0102ef0 0x7ff4e0113ab0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8002870 tx=0x7ff4c8004600 comp rx=0 tx=0).stop 2024-09-17T00:58:09.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.789+0000 7ff4e676c640 1 -- 172.21.15.2:0/366608939 shutdown_connections 2024-09-17T00:58:09.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.789+0000 7ff4e676c640 1 --2- 172.21.15.2:0/366608939 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff4cc06ed60 0x7ff4cc071210 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:09.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.789+0000 7ff4e676c640 1 --2- 172.21.15.2:0/366608939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4e0102ef0 0x7ff4e0113ab0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:09.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.789+0000 7ff4e676c640 1 --2- 172.21.15.2:0/366608939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4e0102550 0x7ff4e0113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:09.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.789+0000 7ff4e676c640 1 -- 172.21.15.2:0/366608939 >> 172.21.15.2:0/366608939 conn(0x7ff4e00f80f0 msgr2=0x7ff4e00f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:09.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.789+0000 7ff4e676c640 1 -- 172.21.15.2:0/366608939 shutdown_connections 2024-09-17T00:58:09.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:09.789+0000 7ff4e676c640 1 -- 172.21.15.2:0/366608939 wait complete. 2024-09-17T00:58:09.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:09 smithi099 ceph-mon[34357]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:10.497 INFO:tasks.cephadm:Setting up client nodes... 2024-09-17T00:58:10.497 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T00:58:10.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:10 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/366608939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T00:58:10.761 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:10.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:10 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/366608939' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T00:58:11.507 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:11 smithi002 ceph-mon[27650]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:11.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:11 smithi099 ceph-mon[34357]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:12.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.360+0000 7f8c3404d640 1 -- 172.21.15.2:0/2368505972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c2c0fd820 msgr2=0x7f8c2c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.360+0000 7f8c3404d640 1 --2- 172.21.15.2:0/2368505972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c2c0fd820 0x7f8c2c0fdc90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0048d0 tx=0x7f8c1c009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.360+0000 7f8c3404d640 1 -- 172.21.15.2:0/2368505972 shutdown_connections 2024-09-17T00:58:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.360+0000 7f8c3404d640 1 --2- 172.21.15.2:0/2368505972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c2c0fd820 0x7f8c2c0fdc90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.360+0000 7f8c3404d640 1 --2- 172.21.15.2:0/2368505972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c2c0fc550 0x7f8c2c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.360+0000 7f8c3404d640 1 -- 172.21.15.2:0/2368505972 >> 172.21.15.2:0/2368505972 conn(0x7f8c2c0f7d10 msgr2=0x7f8c2c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.360+0000 7f8c3404d640 1 -- 172.21.15.2:0/2368505972 shutdown_connections 2024-09-17T00:58:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.360+0000 7f8c3404d640 1 -- 172.21.15.2:0/2368505972 wait complete. 2024-09-17T00:58:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.361+0000 7f8c3404d640 1 Processor -- start 2024-09-17T00:58:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.361+0000 7f8c3404d640 1 -- start start 2024-09-17T00:58:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.361+0000 7f8c3404d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c2c0fc550 0x7f8c2c10d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:12.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.361+0000 7f8c3404d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c2c0fd820 0x7f8c2c10d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.361+0000 7f8c3404d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c10e4a0 con 0x7f8c2c0fd820 2024-09-17T00:58:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.361+0000 7f8c3404d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c10e610 con 0x7f8c2c0fc550 2024-09-17T00:58:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.361+0000 7f8c315e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c2c0fd820 0x7f8c2c10d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.361+0000 7f8c315e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c2c0fd820 0x7f8c2c10d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53748/0 (socket says 172.21.15.2:53748) 2024-09-17T00:58:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.361+0000 7f8c315e8640 1 -- 172.21.15.2:0/3398843216 learned_addr learned my addr 172.21.15.2:0/3398843216 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.361+0000 7f8c31de9640 1 --2- 172.21.15.2:0/3398843216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c2c0fc550 0x7f8c2c10d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.361+0000 7f8c315e8640 1 -- 172.21.15.2:0/3398843216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c2c0fc550 msgr2=0x7f8c2c10d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.361+0000 7f8c315e8640 1 --2- 172.21.15.2:0/3398843216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c2c0fc550 0x7f8c2c10d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.361+0000 7f8c315e8640 1 -- 172.21.15.2:0/3398843216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c005040 con 0x7f8c2c0fd820 2024-09-17T00:58:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.362+0000 7f8c315e8640 1 --2- 172.21.15.2:0/3398843216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c2c0fd820 0x7f8c2c10d630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c003080 tx=0x7f8c1c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.362+0000 7f8c227fc640 1 -- 172.21.15.2:0/3398843216 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c1c038070 con 0x7f8c2c0fd820 2024-09-17T00:58:12.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.362+0000 7f8c227fc640 1 -- 172.21.15.2:0/3398843216 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8c1c009800 con 0x7f8c2c0fd820 2024-09-17T00:58:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.362+0000 7f8c227fc640 1 -- 172.21.15.2:0/3398843216 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c1c033660 con 0x7f8c2c0fd820 2024-09-17T00:58:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.362+0000 7f8c3404d640 1 -- 172.21.15.2:0/3398843216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c10e890 con 0x7f8c2c0fd820 2024-09-17T00:58:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.362+0000 7f8c3404d640 1 -- 172.21.15.2:0/3398843216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c10ed00 con 0x7f8c2c0fd820 2024-09-17T00:58:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.363+0000 7f8c3404d640 1 -- 172.21.15.2:0/3398843216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2c0fb9b0 con 0x7f8c2c0fd820 2024-09-17T00:58:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.363+0000 7f8c227fc640 1 -- 172.21.15.2:0/3398843216 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f8c1c030020 con 0x7f8c2c0fd820 2024-09-17T00:58:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.364+0000 7f8c227fc640 1 --2- 172.21.15.2:0/3398843216 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8c1806ed50 0x7f8c18071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.364+0000 7f8c227fc640 1 -- 172.21.15.2:0/3398843216 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8c1c0adf40 con 0x7f8c2c0fd820 2024-09-17T00:58:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.364+0000 7f8c31de9640 1 --2- 172.21.15.2:0/3398843216 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8c1806ed50 0x7f8c18071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.364+0000 7f8c31de9640 1 --2- 172.21.15.2:0/3398843216 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8c1806ed50 0x7f8c18071200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009b50 tx=0x7f8c28009120 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.368+0000 7f8c227fc640 1 -- 172.21.15.2:0/3398843216 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8c1c07b450 con 0x7f8c2c0fd820 2024-09-17T00:58:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.591+0000 7f8c3404d640 1 -- 172.21.15.2:0/3398843216 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f8c2c04b720 con 0x7f8c2c0fd820 2024-09-17T00:58:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.595+0000 7f8c227fc640 1 -- 172.21.15.2:0/3398843216 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f8c1c07adf0 con 0x7f8c2c0fd820 2024-09-17T00:58:12.593 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-09-17T00:58:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAk1OhmKlRUIxAAkSaey+wIwCWQCLVk9XhLdQ== 2024-09-17T00:58:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.597+0000 7f8c3404d640 1 -- 172.21.15.2:0/3398843216 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8c1806ed50 msgr2=0x7f8c18071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.597+0000 7f8c3404d640 1 --2- 172.21.15.2:0/3398843216 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8c1806ed50 0x7f8c18071200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009b50 tx=0x7f8c28009120 comp rx=0 tx=0).stop 2024-09-17T00:58:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.597+0000 7f8c3404d640 1 -- 172.21.15.2:0/3398843216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c2c0fd820 msgr2=0x7f8c2c10d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.597+0000 7f8c3404d640 1 --2- 172.21.15.2:0/3398843216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c2c0fd820 0x7f8c2c10d630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c003080 tx=0x7f8c1c009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.597+0000 7f8c3404d640 1 -- 172.21.15.2:0/3398843216 shutdown_connections 2024-09-17T00:58:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.597+0000 7f8c3404d640 1 --2- 172.21.15.2:0/3398843216 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8c1806ed50 0x7f8c18071200 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.597+0000 7f8c3404d640 1 --2- 172.21.15.2:0/3398843216 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c2c0fd820 0x7f8c2c10d630 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.597+0000 7f8c3404d640 1 --2- 172.21.15.2:0/3398843216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c2c0fc550 0x7f8c2c10d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.597+0000 7f8c3404d640 1 -- 172.21.15.2:0/3398843216 >> 172.21.15.2:0/3398843216 conn(0x7f8c2c0f7d10 msgr2=0x7f8c2c0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.597+0000 7f8c3404d640 1 -- 172.21.15.2:0/3398843216 shutdown_connections 2024-09-17T00:58:12.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:12.597+0000 7f8c3404d640 1 -- 172.21.15.2:0/3398843216 wait complete. 2024-09-17T00:58:13.195 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:58:13.195 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-17T00:58:13.195 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T00:58:13.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T00:58:13.492 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-17T00:58:13.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:13 smithi099 ceph-mon[34357]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:13.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:13 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3398843216' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:58:13.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:13 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3398843216' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T00:58:13.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:13 smithi002 ceph-mon[27650]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:13.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:13 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3398843216' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:58:13.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:13 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3398843216' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T00:58:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.001+0000 7f99d4ce9640 1 -- 172.21.15.99:0/4137592601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d00fe530 msgr2=0x7f99d00fa690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.001+0000 7f99d4ce9640 1 --2- 172.21.15.99:0/4137592601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d00fe530 0x7f99d00fa690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f99c40048d0 tx=0x7f99c4009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.001+0000 7f99d4ce9640 1 -- 172.21.15.99:0/4137592601 shutdown_connections 2024-09-17T00:58:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.001+0000 7f99d4ce9640 1 --2- 172.21.15.99:0/4137592601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d00fe530 0x7f99d00fa690 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.001+0000 7f99d4ce9640 1 --2- 172.21.15.99:0/4137592601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d00fdbe0 0x7f99d00fdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.001+0000 7f99d4ce9640 1 -- 172.21.15.99:0/4137592601 >> 172.21.15.99:0/4137592601 conn(0x7f99d00f63c0 msgr2=0x7f99d00f8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.001+0000 7f99d4ce9640 1 -- 172.21.15.99:0/4137592601 shutdown_connections 2024-09-17T00:58:15.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.001+0000 7f99d4ce9640 1 -- 172.21.15.99:0/4137592601 wait complete. 2024-09-17T00:58:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99d4ce9640 1 Processor -- start 2024-09-17T00:58:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99d4ce9640 1 -- start start 2024-09-17T00:58:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99d4ce9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d00fdbe0 0x7f99d010d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99d4ce9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d00fe530 0x7f99d010d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99d4ce9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d010dc70 con 0x7f99d00fe530 2024-09-17T00:58:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99d4ce9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d010e490 con 0x7f99d00fdbe0 2024-09-17T00:58:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99ce59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d00fdbe0 0x7f99d010d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99ce59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d00fdbe0 0x7f99d010d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46732/0 (socket says 172.21.15.99:46732) 2024-09-17T00:58:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99ce59c640 1 -- 172.21.15.99:0/3093950149 learned_addr learned my addr 172.21.15.99:0/3093950149 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-17T00:58:15.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99cdd9b640 1 --2- 172.21.15.99:0/3093950149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d00fe530 0x7f99d010d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99ce59c640 1 -- 172.21.15.99:0/3093950149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d00fe530 msgr2=0x7f99d010d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99ce59c640 1 --2- 172.21.15.99:0/3093950149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d00fe530 0x7f99d010d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99ce59c640 1 -- 172.21.15.99:0/3093950149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c4005040 con 0x7f99d00fdbe0 2024-09-17T00:58:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99cdd9b640 1 --2- 172.21.15.99:0/3093950149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d00fe530 0x7f99d010d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T00:58:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99ce59c640 1 --2- 172.21.15.99:0/3093950149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d00fdbe0 0x7f99d010d0e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f99c0002a50 tx=0x7f99c0004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.002+0000 7f99beffd640 1 -- 172.21.15.99:0/3093950149 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99c0007c30 con 0x7f99d00fdbe0 2024-09-17T00:58:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.003+0000 7f99d4ce9640 1 -- 172.21.15.99:0/3093950149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d010e720 con 0x7f99d00fdbe0 2024-09-17T00:58:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.003+0000 7f99beffd640 1 -- 172.21.15.99:0/3093950149 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f99c000f040 con 0x7f99d00fdbe0 2024-09-17T00:58:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.003+0000 7f99beffd640 1 -- 172.21.15.99:0/3093950149 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99c000db50 con 0x7f99d00fdbe0 2024-09-17T00:58:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.003+0000 7f99d4ce9640 1 -- 172.21.15.99:0/3093950149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d010ecc0 con 0x7f99d00fdbe0 2024-09-17T00:58:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.004+0000 7f99d4ce9640 1 -- 172.21.15.99:0/3093950149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d00fa080 con 0x7f99d00fdbe0 2024-09-17T00:58:15.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.004+0000 7f99beffd640 1 -- 172.21.15.99:0/3093950149 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f99c000dcb0 con 0x7f99d00fdbe0 2024-09-17T00:58:15.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.004+0000 7f99beffd640 1 --2- 172.21.15.99:0/3093950149 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f99b806ed60 0x7f99b8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:15.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.004+0000 7f99beffd640 1 -- 172.21.15.99:0/3093950149 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f99c008dda0 con 0x7f99d00fdbe0 2024-09-17T00:58:15.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.005+0000 7f99cdd9b640 1 --2- 172.21.15.99:0/3093950149 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f99b806ed60 0x7f99b8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:15.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.005+0000 7f99cdd9b640 1 --2- 172.21.15.99:0/3093950149 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f99b806ed60 0x7f99b8071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f99d010ce90 tx=0x7f99c4035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:15.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.009+0000 7f99beffd640 1 -- 172.21.15.99:0/3093950149 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f99c005b200 con 0x7f99d00fdbe0 2024-09-17T00:58:15.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.230+0000 7f99d4ce9640 1 -- 172.21.15.99:0/3093950149 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f99d0105110 con 0x7f99d00fdbe0 2024-09-17T00:58:15.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.235+0000 7f99beffd640 1 -- 172.21.15.99:0/3093950149 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f99c005aba0 con 0x7f99d00fdbe0 2024-09-17T00:58:15.232 INFO:teuthology.orchestra.run.smithi099.stdout:[client.1] 2024-09-17T00:58:15.233 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAn1OhmnEPUDRAAjwnW4JnkfTaoMlNOecG/6Q== 2024-09-17T00:58:15.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.237+0000 7f99d4ce9640 1 -- 172.21.15.99:0/3093950149 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f99b806ed60 msgr2=0x7f99b8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:15.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.237+0000 7f99d4ce9640 1 --2- 172.21.15.99:0/3093950149 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f99b806ed60 0x7f99b8071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f99d010ce90 tx=0x7f99c4035040 comp rx=0 tx=0).stop 2024-09-17T00:58:15.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.237+0000 7f99d4ce9640 1 -- 172.21.15.99:0/3093950149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d00fdbe0 msgr2=0x7f99d010d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:15.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.237+0000 7f99d4ce9640 1 --2- 172.21.15.99:0/3093950149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d00fdbe0 0x7f99d010d0e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f99c0002a50 tx=0x7f99c0004600 comp rx=0 tx=0).stop 2024-09-17T00:58:15.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.237+0000 7f99d4ce9640 1 -- 172.21.15.99:0/3093950149 shutdown_connections 2024-09-17T00:58:15.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.237+0000 7f99d4ce9640 1 --2- 172.21.15.99:0/3093950149 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f99b806ed60 0x7f99b8071210 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:15.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.237+0000 7f99d4ce9640 1 --2- 172.21.15.99:0/3093950149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d00fe530 0x7f99d010d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:15.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.237+0000 7f99d4ce9640 1 --2- 172.21.15.99:0/3093950149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d00fdbe0 0x7f99d010d0e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:15.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.237+0000 7f99d4ce9640 1 -- 172.21.15.99:0/3093950149 >> 172.21.15.99:0/3093950149 conn(0x7f99d00f63c0 msgr2=0x7f99d00f7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:15.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.237+0000 7f99d4ce9640 1 -- 172.21.15.99:0/3093950149 shutdown_connections 2024-09-17T00:58:15.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T00:58:15.237+0000 7f99d4ce9640 1 -- 172.21.15.99:0/3093950149 wait complete. 2024-09-17T00:58:15.649 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:15 smithi099 ceph-mon[34357]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:15.649 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:15 smithi099 ceph-mon[34357]: from='client.? 172.21.15.99:0/3093950149' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:58:15.649 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:15 smithi099 ceph-mon[34357]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:58:15.649 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:15 smithi099 ceph-mon[34357]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T00:58:15.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:15 smithi002 ceph-mon[27650]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:15.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:15 smithi002 ceph-mon[27650]: from='client.? 172.21.15.99:0/3093950149' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:58:15.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:15 smithi002 ceph-mon[27650]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T00:58:15.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:15 smithi002 ceph-mon[27650]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T00:58:15.898 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T00:58:15.899 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-17T00:58:15.899 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T00:58:15.937 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T00:58:15.937 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-17T00:58:15.937 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-17T00:58:16.206 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:17.629 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:17 smithi002 ceph-mon[27650]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:17.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:17 smithi099 ceph-mon[34357]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.858+0000 7fec9c020640 1 -- 172.21.15.2:0/1587524986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec940fd760 msgr2=0x7fec940fdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.858+0000 7fec9c020640 1 --2- 172.21.15.2:0/1587524986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec940fd760 0x7fec940fdb30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fec840048d0 tx=0x7fec84009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.858+0000 7fec9c020640 1 -- 172.21.15.2:0/1587524986 shutdown_connections 2024-09-17T00:58:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.858+0000 7fec9c020640 1 --2- 172.21.15.2:0/1587524986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940fe100 0x7fec941065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.858+0000 7fec9c020640 1 --2- 172.21.15.2:0/1587524986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec940fd760 0x7fec940fdb30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.858+0000 7fec9c020640 1 -- 172.21.15.2:0/1587524986 >> 172.21.15.2:0/1587524986 conn(0x7fec940f7030 msgr2=0x7fec940f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.858+0000 7fec9c020640 1 -- 172.21.15.2:0/1587524986 shutdown_connections 2024-09-17T00:58:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.858+0000 7fec9c020640 1 -- 172.21.15.2:0/1587524986 wait complete. 2024-09-17T00:58:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.859+0000 7fec9c020640 1 Processor -- start 2024-09-17T00:58:17.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.859+0000 7fec9c020640 1 -- start start 2024-09-17T00:58:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.859+0000 7fec9c020640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940fd760 0x7fec94113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.859+0000 7fec9c020640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec940fe100 0x7fec94113870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.859+0000 7fec9c020640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec94113e70 con 0x7fec940fe100 2024-09-17T00:58:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.859+0000 7fec9c020640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9410d2b0 con 0x7fec940fd760 2024-09-17T00:58:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.859+0000 7fec995bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec940fe100 0x7fec94113870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.859+0000 7fec995bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec940fe100 0x7fec94113870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53760/0 (socket says 172.21.15.2:53760) 2024-09-17T00:58:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.859+0000 7fec995bb640 1 -- 172.21.15.2:0/2410559109 learned_addr learned my addr 172.21.15.2:0/2410559109 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.859+0000 7fec99dbc640 1 --2- 172.21.15.2:0/2410559109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940fd760 0x7fec94113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.859+0000 7fec995bb640 1 -- 172.21.15.2:0/2410559109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940fd760 msgr2=0x7fec94113330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.859+0000 7fec995bb640 1 --2- 172.21.15.2:0/2410559109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940fd760 0x7fec94113330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.859+0000 7fec995bb640 1 -- 172.21.15.2:0/2410559109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec84005040 con 0x7fec940fe100 2024-09-17T00:58:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.860+0000 7fec995bb640 1 --2- 172.21.15.2:0/2410559109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec940fe100 0x7fec94113870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c760 tx=0x7fec880043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:17.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.860+0000 7fec927fc640 1 -- 172.21.15.2:0/2410559109 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec88012810 con 0x7fec940fe100 2024-09-17T00:58:17.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.860+0000 7fec927fc640 1 -- 172.21.15.2:0/2410559109 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fec88012e10 con 0x7fec940fe100 2024-09-17T00:58:17.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.860+0000 7fec9c020640 1 -- 172.21.15.2:0/2410559109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9410d590 con 0x7fec940fe100 2024-09-17T00:58:17.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.860+0000 7fec927fc640 1 -- 172.21.15.2:0/2410559109 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec8800a320 con 0x7fec940fe100 2024-09-17T00:58:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.860+0000 7fec9c020640 1 -- 172.21.15.2:0/2410559109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9410db30 con 0x7fec940fe100 2024-09-17T00:58:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.861+0000 7fec9c020640 1 -- 172.21.15.2:0/2410559109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec940fac90 con 0x7fec940fe100 2024-09-17T00:58:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.861+0000 7fec927fc640 1 -- 172.21.15.2:0/2410559109 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fec88011380 con 0x7fec940fe100 2024-09-17T00:58:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.862+0000 7fec927fc640 1 --2- 172.21.15.2:0/2410559109 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fec7c06ed60 0x7fec7c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.862+0000 7fec927fc640 1 -- 172.21.15.2:0/2410559109 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fec8808e130 con 0x7fec940fe100 2024-09-17T00:58:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.862+0000 7fec99dbc640 1 --2- 172.21.15.2:0/2410559109 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fec7c06ed60 0x7fec7c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.862+0000 7fec99dbc640 1 --2- 172.21.15.2:0/2410559109 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fec7c06ed60 0x7fec7c071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fec84009ac0 tx=0x7fec84035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:17.866+0000 7fec927fc640 1 -- 172.21.15.2:0/2410559109 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fec8805b610 con 0x7fec940fe100 2024-09-17T00:58:18.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:18.073+0000 7fec9c020640 1 -- 172.21.15.2:0/2410559109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fec9410e9a0 con 0x7fec940fe100 2024-09-17T00:58:18.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:18.076+0000 7fec927fc640 1 -- 172.21.15.2:0/2410559109 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+176703 (secure 0 0 0) 0x7fec880030b0 con 0x7fec940fe100 2024-09-17T00:58:18.077 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:58:18.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:18.078+0000 7fec9c020640 1 -- 172.21.15.2:0/2410559109 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fec7c06ed60 msgr2=0x7fec7c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:18.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:18.078+0000 7fec9c020640 1 --2- 172.21.15.2:0/2410559109 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fec7c06ed60 0x7fec7c071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fec84009ac0 tx=0x7fec84035040 comp rx=0 tx=0).stop 2024-09-17T00:58:18.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:18.078+0000 7fec9c020640 1 -- 172.21.15.2:0/2410559109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec940fe100 msgr2=0x7fec94113870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:18.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:18.078+0000 7fec9c020640 1 --2- 172.21.15.2:0/2410559109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec940fe100 0x7fec94113870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c760 tx=0x7fec880043c0 comp rx=0 tx=0).stop 2024-09-17T00:58:18.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:18.078+0000 7fec9c020640 1 -- 172.21.15.2:0/2410559109 shutdown_connections 2024-09-17T00:58:18.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:18.078+0000 7fec9c020640 1 --2- 172.21.15.2:0/2410559109 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fec7c06ed60 0x7fec7c071210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:18.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:18.078+0000 7fec9c020640 1 --2- 172.21.15.2:0/2410559109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec940fe100 0x7fec94113870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:18.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:18.078+0000 7fec9c020640 1 --2- 172.21.15.2:0/2410559109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940fd760 0x7fec94113330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:18.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:18.078+0000 7fec9c020640 1 -- 172.21.15.2:0/2410559109 >> 172.21.15.2:0/2410559109 conn(0x7fec940f7030 msgr2=0x7fec940f8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:18.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:18.079+0000 7fec9c020640 1 -- 172.21.15.2:0/2410559109 shutdown_connections 2024-09-17T00:58:18.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:18.079+0000 7fec9c020640 1 -- 172.21.15.2:0/2410559109 wait complete. 2024-09-17T00:58:18.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:18 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2410559109' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T00:58:18.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:18 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/2410559109' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T00:58:18.911 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"flags":0,"active_gid":14204,"active_name":"smithi002.vjeexr","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1697208540},{"type":"v1","addr":"172.21.15.2:6801","nonce":1697208540}]},"active_addr":"172.21.15.2:6801/1697208540","active_change":"2024-09-17T00:54:36.243035+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14224,"name":"smithi099.vswzrb","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.2:8443/","prometheus":"http://172.21.15.2:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":2200948522}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":1094288545}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3115391478}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":179641311}]}]} 2024-09-17T00:58:18.917 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-17T00:58:18.917 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-17T00:58:18.917 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T00:58:19.182 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:19.642 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:19 smithi002 ceph-mon[27650]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:19.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:19 smithi099 ceph-mon[34357]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:20.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.801+0000 7fc9314e8640 1 -- 172.21.15.2:0/3546916126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc92c1015a0 msgr2=0x7fc92c101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:20.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.801+0000 7fc9314e8640 1 --2- 172.21.15.2:0/3546916126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc92c1015a0 0x7fc92c101970 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0048d0 tx=0x7fc91c009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:20.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.801+0000 7fc9314e8640 1 -- 172.21.15.2:0/3546916126 shutdown_connections 2024-09-17T00:58:20.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.801+0000 7fc9314e8640 1 --2- 172.21.15.2:0/3546916126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc92c101f40 0x7fc92c0fb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:20.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.801+0000 7fc9314e8640 1 --2- 172.21.15.2:0/3546916126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc92c1015a0 0x7fc92c101970 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:20.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.801+0000 7fc9314e8640 1 -- 172.21.15.2:0/3546916126 >> 172.21.15.2:0/3546916126 conn(0x7fc92c0f7030 msgr2=0x7fc92c0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:20.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.801+0000 7fc9314e8640 1 -- 172.21.15.2:0/3546916126 shutdown_connections 2024-09-17T00:58:20.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.801+0000 7fc9314e8640 1 -- 172.21.15.2:0/3546916126 wait complete. 2024-09-17T00:58:20.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.802+0000 7fc9314e8640 1 Processor -- start 2024-09-17T00:58:20.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.802+0000 7fc9314e8640 1 -- start start 2024-09-17T00:58:20.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.802+0000 7fc9314e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc92c1015a0 0x7fc92c113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:20.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.802+0000 7fc9314e8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc92c101f40 0x7fc92c113870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:20.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.802+0000 7fc9314e8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c113e70 con 0x7fc92c1015a0 2024-09-17T00:58:20.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.802+0000 7fc9314e8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c10d2b0 con 0x7fc92c101f40 2024-09-17T00:58:20.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.802+0000 7fc92affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc92c1015a0 0x7fc92c113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:20.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.802+0000 7fc92affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc92c1015a0 0x7fc92c113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48820/0 (socket says 172.21.15.2:48820) 2024-09-17T00:58:20.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.802+0000 7fc92affd640 1 -- 172.21.15.2:0/252812966 learned_addr learned my addr 172.21.15.2:0/252812966 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:20.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.802+0000 7fc92a7fc640 1 --2- 172.21.15.2:0/252812966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc92c101f40 0x7fc92c113870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:20.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.802+0000 7fc92affd640 1 -- 172.21.15.2:0/252812966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc92c101f40 msgr2=0x7fc92c113870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:20.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.803+0000 7fc92affd640 1 --2- 172.21.15.2:0/252812966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc92c101f40 0x7fc92c113870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:20.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.803+0000 7fc92affd640 1 -- 172.21.15.2:0/252812966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c005040 con 0x7fc92c1015a0 2024-09-17T00:58:20.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.803+0000 7fc92affd640 1 --2- 172.21.15.2:0/252812966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc92c1015a0 0x7fc92c113330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc91c003080 tx=0x7fc91c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:20.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.803+0000 7fc9137fe640 1 -- 172.21.15.2:0/252812966 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc91c038070 con 0x7fc92c1015a0 2024-09-17T00:58:20.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.803+0000 7fc9314e8640 1 -- 172.21.15.2:0/252812966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92c10d530 con 0x7fc92c1015a0 2024-09-17T00:58:20.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.803+0000 7fc9137fe640 1 -- 172.21.15.2:0/252812966 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc91c0097e0 con 0x7fc92c1015a0 2024-09-17T00:58:20.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.803+0000 7fc9137fe640 1 -- 172.21.15.2:0/252812966 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc91c03d420 con 0x7fc92c1015a0 2024-09-17T00:58:20.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.803+0000 7fc9314e8640 1 -- 172.21.15.2:0/252812966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92c10da70 con 0x7fc92c1015a0 2024-09-17T00:58:20.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.804+0000 7fc9314e8640 1 -- 172.21.15.2:0/252812966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92c0fac90 con 0x7fc92c1015a0 2024-09-17T00:58:20.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.805+0000 7fc9137fe640 1 -- 172.21.15.2:0/252812966 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fc91c030020 con 0x7fc92c1015a0 2024-09-17T00:58:20.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.805+0000 7fc9137fe640 1 --2- 172.21.15.2:0/252812966 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc91406ed60 0x7fc914071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:20.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.805+0000 7fc92a7fc640 1 --2- 172.21.15.2:0/252812966 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc91406ed60 0x7fc914071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:20.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.805+0000 7fc9137fe640 1 -- 172.21.15.2:0/252812966 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc91c0ae370 con 0x7fc92c1015a0 2024-09-17T00:58:20.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.806+0000 7fc92a7fc640 1 --2- 172.21.15.2:0/252812966 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc91406ed60 0x7fc914071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc92c10ebf0 tx=0x7fc920009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:20.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.809+0000 7fc9137fe640 1 -- 172.21.15.2:0/252812966 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc91c07b7d0 con 0x7fc92c1015a0 2024-09-17T00:58:20.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.975+0000 7fc9314e8640 1 -- 172.21.15.2:0/252812966 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc92c10e9a0 con 0x7fc92c1015a0 2024-09-17T00:58:20.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.975+0000 7fc9137fe640 1 -- 172.21.15.2:0/252812966 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11009 (secure 0 0 0) 0x7fc91c07b170 con 0x7fc92c1015a0 2024-09-17T00:58:20.974 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:58:20.974 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":38,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","created":"2024-09-17T00:52:36.851622+0000","modified":"2024-09-17T00:58:01.173429+0000","last_up_change":"2024-09-17T00:58:00.167361+0000","last_in_change":"2024-09-17T00:57:41.064225+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T00:56:44.767272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"89201a70-9650-4f5a-b943-c6c75fb3f689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1937150145},{"type":"v1","addr":"172.21.15.2:6803","nonce":1937150145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1937150145},{"type":"v1","addr":"172.21.15.2:6805","nonce":1937150145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1937150145},{"type":"v1","addr":"172.21.15.2:6809","nonce":1937150145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1937150145},{"type":"v1","addr":"172.21.15.2:6807","nonce":1937150145}]},"public_addr":"172.21.15.2:6803/1937150145","cluster_addr":"172.21.15.2:6805/1937150145","heartbeat_back_addr":"172.21.15.2:6809/1937150145","heartbeat_front_addr":"172.21.15.2:6807/1937150145","state":["exists","up"]},{"osd":1,"uuid":"8e62bb00-c559-40e9-84f3-944637772694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3467957340},{"type":"v1","addr":"172.21.15.2:6811","nonce":3467957340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3467957340},{"type":"v1","addr":"172.21.15.2:6813","nonce":3467957340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3467957340},{"type":"v1","addr":"172.21.15.2:6817","nonce":3467957340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3467957340},{"type":"v1","addr":"172.21.15.2:6815","nonce":3467957340}]},"public_addr":"172.21.15.2:6811/3467957340","cluster_addr":"172.21.15.2:6813/3467957340","heartbeat_back_addr":"172.21.15.2:6817/3467957340","heartbeat_front_addr":"172.21.15.2:6815/3467957340","state":["exists","up"]},{"osd":2,"uuid":"6af863fc-14a2-4b04-959b-8a36a80657fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2404856812},{"type":"v1","addr":"172.21.15.2:6819","nonce":2404856812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2404856812},{"type":"v1","addr":"172.21.15.2:6821","nonce":2404856812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2404856812},{"type":"v1","addr":"172.21.15.2:6825","nonce":2404856812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2404856812},{"type":"v1","addr":"172.21.15.2:6823","nonce":2404856812}]},"public_addr":"172.21.15.2:6819/2404856812","cluster_addr":"172.21.15.2:6821/2404856812","heartbeat_back_addr":"172.21.15.2:6825/2404856812","heartbeat_front_addr":"172.21.15.2:6823/2404856812","state":["exists","up"]},{"osd":3,"uuid":"204d5042-792c-413a-bf0d-33deca063a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2455888957},{"type":"v1","addr":"172.21.15.99:6801","nonce":2455888957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2455888957},{"type":"v1","addr":"172.21.15.99:6803","nonce":2455888957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2455888957},{"type":"v1","addr":"172.21.15.99:6807","nonce":2455888957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2455888957},{"type":"v1","addr":"172.21.15.99:6805","nonce":2455888957}]},"public_addr":"172.21.15.99:6801/2455888957","cluster_addr":"172.21.15.99:6803/2455888957","heartbeat_back_addr":"172.21.15.99:6807/2455888957","heartbeat_front_addr":"172.21.15.99:6805/2455888957","state":["exists","up"]},{"osd":4,"uuid":"c2bd2bb0-ceec-4901-8709-7388aa695687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1239096669},{"type":"v1","addr":"172.21.15.99:6809","nonce":1239096669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1239096669},{"type":"v1","addr":"172.21.15.99:6811","nonce":1239096669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1239096669},{"type":"v1","addr":"172.21.15.99:6815","nonce":1239096669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1239096669},{"type":"v1","addr":"172.21.15.99:6813","nonce":1239096669}]},"public_addr":"172.21.15.99:6809/1239096669","cluster_addr":"172.21.15.99:6811/1239096669","heartbeat_back_addr":"172.21.15.99:6815/1239096669","heartbeat_front_addr":"172.21.15.99:6813/1239096669","state":["exists","up"]},{"osd":5,"uuid":"465fe479-4e53-44c2-b681-f67bb3b553c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4041287024},{"type":"v1","addr":"172.21.15.99:6817","nonce":4041287024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":4041287024},{"type":"v1","addr":"172.21.15.99:6819","nonce":4041287024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":4041287024},{"type":"v1","addr":"172.21.15.99:6823","nonce":4041287024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4041287024},{"type":"v1","addr":"172.21.15.99:6821","nonce":4041287024}]},"public_addr":"172.21.15.99:6817/4041287024","cluster_addr":"172.21.15.99:6819/4041287024","heartbeat_back_addr":"172.21.15.99:6823/4041287024","heartbeat_front_addr":"172.21.15.99:6821/4041287024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:55:47.121317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:56:14.656746+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:56:42.506800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:57:06.952247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:57:32.969868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:57:58.236837+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/157433590":"2024-09-18T00:54:36.242935+0000","172.21.15.2:6801/2191872617":"2024-09-18T00:54:36.242935+0000","172.21.15.2:0/3770177876":"2024-09-18T00:53:35.657108+0000","172.21.15.2:0/2597867872":"2024-09-18T00:53:05.759479+0000","172.21.15.2:6801/3082534604":"2024-09-18T00:53:35.657108+0000","172.21.15.2:6800/1951809935":"2024-09-18T00:53:05.759479+0000","172.21.15.2:6801/1951809935":"2024-09-18T00:53:05.759479+0000","172.21.15.2:0/2687394772":"2024-09-18T00:53:05.759479+0000","172.21.15.2:0/2244315938":"2024-09-18T00:53:05.759479+0000","172.21.15.2:0/1006642018":"2024-09-18T00:54:36.242935+0000","172.21.15.2:0/4008124108":"2024-09-18T00:53:35.657108+0000","172.21.15.2:6800/3082534604":"2024-09-18T00:53:35.657108+0000","172.21.15.2:0/2143800566":"2024-09-18T00:53:35.657108+0000","172.21.15.2:6800/2191872617":"2024-09-18T00:54:36.242935+0000","172.21.15.2:0/4221926423":"2024-09-18T00:54:36.242935+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T00:58:20.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.977+0000 7fc9314e8640 1 -- 172.21.15.2:0/252812966 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc91406ed60 msgr2=0x7fc914071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:20.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.977+0000 7fc9314e8640 1 --2- 172.21.15.2:0/252812966 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc91406ed60 0x7fc914071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc92c10ebf0 tx=0x7fc920009040 comp rx=0 tx=0).stop 2024-09-17T00:58:20.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.977+0000 7fc9314e8640 1 -- 172.21.15.2:0/252812966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc92c1015a0 msgr2=0x7fc92c113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:20.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.977+0000 7fc9314e8640 1 --2- 172.21.15.2:0/252812966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc92c1015a0 0x7fc92c113330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc91c003080 tx=0x7fc91c009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:20.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.977+0000 7fc9314e8640 1 -- 172.21.15.2:0/252812966 shutdown_connections 2024-09-17T00:58:20.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.977+0000 7fc9314e8640 1 --2- 172.21.15.2:0/252812966 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc91406ed60 0x7fc914071210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:20.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.977+0000 7fc9314e8640 1 --2- 172.21.15.2:0/252812966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc92c101f40 0x7fc92c113870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:20.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.977+0000 7fc9314e8640 1 --2- 172.21.15.2:0/252812966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc92c1015a0 0x7fc92c113330 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:20.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.977+0000 7fc9314e8640 1 -- 172.21.15.2:0/252812966 >> 172.21.15.2:0/252812966 conn(0x7fc92c0f7030 msgr2=0x7fc92c065a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:20.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.978+0000 7fc9314e8640 1 -- 172.21.15.2:0/252812966 shutdown_connections 2024-09-17T00:58:20.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:20.978+0000 7fc9314e8640 1 -- 172.21.15.2:0/252812966 wait complete. 2024-09-17T00:58:21.607 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-17T00:58:21.608 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T00:58:21.632 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:21 smithi002 ceph-mon[27650]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:21.632 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:21 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/252812966' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:58:21.632 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:58:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:21 smithi099 ceph-mon[34357]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:21 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/252812966' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:58:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:58:21.863 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:23.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.429+0000 7f0b669eb640 1 -- 172.21.15.2:0/1530501218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b600fd410 msgr2=0x7f0b600fd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:23.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.429+0000 7f0b669eb640 1 --2- 172.21.15.2:0/1530501218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b600fd410 0x7f0b600fd7e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b500048d0 tx=0x7f0b50009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:23.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.429+0000 7f0b669eb640 1 -- 172.21.15.2:0/1530501218 shutdown_connections 2024-09-17T00:58:23.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.429+0000 7f0b669eb640 1 --2- 172.21.15.2:0/1530501218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b600fac80 0x7f0b600fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.429+0000 7f0b669eb640 1 --2- 172.21.15.2:0/1530501218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b600fd410 0x7f0b600fd7e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.429+0000 7f0b669eb640 1 -- 172.21.15.2:0/1530501218 >> 172.21.15.2:0/1530501218 conn(0x7f0b60070ce0 msgr2=0x7f0b600710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.429+0000 7f0b669eb640 1 -- 172.21.15.2:0/1530501218 shutdown_connections 2024-09-17T00:58:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.429+0000 7f0b669eb640 1 -- 172.21.15.2:0/1530501218 wait complete. 2024-09-17T00:58:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.430+0000 7f0b669eb640 1 Processor -- start 2024-09-17T00:58:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.430+0000 7f0b669eb640 1 -- start start 2024-09-17T00:58:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.430+0000 7f0b669eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b600fac80 0x7f0b60115390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:23.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.430+0000 7f0b669eb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b600fd410 0x7f0b601158d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.430+0000 7f0b669eb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b60115ed0 con 0x7f0b600fac80 2024-09-17T00:58:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.430+0000 7f0b669eb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6010f310 con 0x7f0b600fd410 2024-09-17T00:58:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.431+0000 7f0b5ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b600fac80 0x7f0b60115390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.431+0000 7f0b5ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b600fac80 0x7f0b60115390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48826/0 (socket says 172.21.15.2:48826) 2024-09-17T00:58:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.431+0000 7f0b5ffff640 1 -- 172.21.15.2:0/3607696997 learned_addr learned my addr 172.21.15.2:0/3607696997 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.431+0000 7f0b5ffff640 1 -- 172.21.15.2:0/3607696997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b600fd410 msgr2=0x7f0b601158d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:23.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.431+0000 7f0b5f7fe640 1 --2- 172.21.15.2:0/3607696997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b600fd410 0x7f0b601158d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:23.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.431+0000 7f0b5ffff640 1 --2- 172.21.15.2:0/3607696997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b600fd410 0x7f0b601158d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:23.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.431+0000 7f0b5ffff640 1 -- 172.21.15.2:0/3607696997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b50005040 con 0x7f0b600fac80 2024-09-17T00:58:23.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.431+0000 7f0b5f7fe640 1 --2- 172.21.15.2:0/3607696997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b600fd410 0x7f0b601158d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T00:58:23.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.431+0000 7f0b5ffff640 1 --2- 172.21.15.2:0/3607696997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b600fac80 0x7f0b60115390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0b50003080 tx=0x7f0b50009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:23.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.431+0000 7f0b5cff9640 1 -- 172.21.15.2:0/3607696997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b50038070 con 0x7f0b600fac80 2024-09-17T00:58:23.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.431+0000 7f0b669eb640 1 -- 172.21.15.2:0/3607696997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6010f590 con 0x7f0b600fac80 2024-09-17T00:58:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.431+0000 7f0b5cff9640 1 -- 172.21.15.2:0/3607696997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0b500097e0 con 0x7f0b600fac80 2024-09-17T00:58:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.431+0000 7f0b5cff9640 1 -- 172.21.15.2:0/3607696997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b5003d420 con 0x7f0b600fac80 2024-09-17T00:58:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.431+0000 7f0b669eb640 1 -- 172.21.15.2:0/3607696997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6010fad0 con 0x7f0b600fac80 2024-09-17T00:58:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.432+0000 7f0b669eb640 1 -- 172.21.15.2:0/3607696997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b600fbc90 con 0x7f0b600fac80 2024-09-17T00:58:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.433+0000 7f0b5cff9640 1 -- 172.21.15.2:0/3607696997 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f0b50030020 con 0x7f0b600fac80 2024-09-17T00:58:23.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.433+0000 7f0b5cff9640 1 --2- 172.21.15.2:0/3607696997 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f0b4806ed60 0x7f0b48071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:23.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.433+0000 7f0b5cff9640 1 -- 172.21.15.2:0/3607696997 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0b500ae370 con 0x7f0b600fac80 2024-09-17T00:58:23.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.433+0000 7f0b5f7fe640 1 --2- 172.21.15.2:0/3607696997 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f0b4806ed60 0x7f0b48071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:23.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.434+0000 7f0b5f7fe640 1 --2- 172.21.15.2:0/3607696997 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f0b4806ed60 0x7f0b48071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0b60110c50 tx=0x7f0b54009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:23.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.437+0000 7f0b5cff9640 1 -- 172.21.15.2:0/3607696997 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0b5007b850 con 0x7f0b600fac80 2024-09-17T00:58:23.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.603+0000 7f0b669eb640 1 -- 172.21.15.2:0/3607696997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b60074c00 con 0x7f0b600fac80 2024-09-17T00:58:23.602 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:23 smithi002 ceph-mon[27650]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:23.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.604+0000 7f0b5cff9640 1 -- 172.21.15.2:0/3607696997 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11009 (secure 0 0 0) 0x7f0b5007b1f0 con 0x7f0b600fac80 2024-09-17T00:58:23.603 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:58:23.603 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":38,"fsid":"f8e82564-748e-11ef-bceb-c7b262605968","created":"2024-09-17T00:52:36.851622+0000","modified":"2024-09-17T00:58:01.173429+0000","last_up_change":"2024-09-17T00:58:00.167361+0000","last_in_change":"2024-09-17T00:57:41.064225+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T00:56:44.767272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"89201a70-9650-4f5a-b943-c6c75fb3f689","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1937150145},{"type":"v1","addr":"172.21.15.2:6803","nonce":1937150145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1937150145},{"type":"v1","addr":"172.21.15.2:6805","nonce":1937150145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1937150145},{"type":"v1","addr":"172.21.15.2:6809","nonce":1937150145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1937150145},{"type":"v1","addr":"172.21.15.2:6807","nonce":1937150145}]},"public_addr":"172.21.15.2:6803/1937150145","cluster_addr":"172.21.15.2:6805/1937150145","heartbeat_back_addr":"172.21.15.2:6809/1937150145","heartbeat_front_addr":"172.21.15.2:6807/1937150145","state":["exists","up"]},{"osd":1,"uuid":"8e62bb00-c559-40e9-84f3-944637772694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3467957340},{"type":"v1","addr":"172.21.15.2:6811","nonce":3467957340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3467957340},{"type":"v1","addr":"172.21.15.2:6813","nonce":3467957340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3467957340},{"type":"v1","addr":"172.21.15.2:6817","nonce":3467957340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3467957340},{"type":"v1","addr":"172.21.15.2:6815","nonce":3467957340}]},"public_addr":"172.21.15.2:6811/3467957340","cluster_addr":"172.21.15.2:6813/3467957340","heartbeat_back_addr":"172.21.15.2:6817/3467957340","heartbeat_front_addr":"172.21.15.2:6815/3467957340","state":["exists","up"]},{"osd":2,"uuid":"6af863fc-14a2-4b04-959b-8a36a80657fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2404856812},{"type":"v1","addr":"172.21.15.2:6819","nonce":2404856812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2404856812},{"type":"v1","addr":"172.21.15.2:6821","nonce":2404856812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2404856812},{"type":"v1","addr":"172.21.15.2:6825","nonce":2404856812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":2404856812},{"type":"v1","addr":"172.21.15.2:6823","nonce":2404856812}]},"public_addr":"172.21.15.2:6819/2404856812","cluster_addr":"172.21.15.2:6821/2404856812","heartbeat_back_addr":"172.21.15.2:6825/2404856812","heartbeat_front_addr":"172.21.15.2:6823/2404856812","state":["exists","up"]},{"osd":3,"uuid":"204d5042-792c-413a-bf0d-33deca063a74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2455888957},{"type":"v1","addr":"172.21.15.99:6801","nonce":2455888957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2455888957},{"type":"v1","addr":"172.21.15.99:6803","nonce":2455888957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2455888957},{"type":"v1","addr":"172.21.15.99:6807","nonce":2455888957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2455888957},{"type":"v1","addr":"172.21.15.99:6805","nonce":2455888957}]},"public_addr":"172.21.15.99:6801/2455888957","cluster_addr":"172.21.15.99:6803/2455888957","heartbeat_back_addr":"172.21.15.99:6807/2455888957","heartbeat_front_addr":"172.21.15.99:6805/2455888957","state":["exists","up"]},{"osd":4,"uuid":"c2bd2bb0-ceec-4901-8709-7388aa695687","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":1239096669},{"type":"v1","addr":"172.21.15.99:6809","nonce":1239096669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1239096669},{"type":"v1","addr":"172.21.15.99:6811","nonce":1239096669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1239096669},{"type":"v1","addr":"172.21.15.99:6815","nonce":1239096669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1239096669},{"type":"v1","addr":"172.21.15.99:6813","nonce":1239096669}]},"public_addr":"172.21.15.99:6809/1239096669","cluster_addr":"172.21.15.99:6811/1239096669","heartbeat_back_addr":"172.21.15.99:6815/1239096669","heartbeat_front_addr":"172.21.15.99:6813/1239096669","state":["exists","up"]},{"osd":5,"uuid":"465fe479-4e53-44c2-b681-f67bb3b553c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4041287024},{"type":"v1","addr":"172.21.15.99:6817","nonce":4041287024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":4041287024},{"type":"v1","addr":"172.21.15.99:6819","nonce":4041287024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":4041287024},{"type":"v1","addr":"172.21.15.99:6823","nonce":4041287024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4041287024},{"type":"v1","addr":"172.21.15.99:6821","nonce":4041287024}]},"public_addr":"172.21.15.99:6817/4041287024","cluster_addr":"172.21.15.99:6819/4041287024","heartbeat_back_addr":"172.21.15.99:6823/4041287024","heartbeat_front_addr":"172.21.15.99:6821/4041287024","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:55:47.121317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:56:14.656746+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:56:42.506800+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:57:06.952247+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:57:32.969868+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T00:57:58.236837+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/157433590":"2024-09-18T00:54:36.242935+0000","172.21.15.2:6801/2191872617":"2024-09-18T00:54:36.242935+0000","172.21.15.2:0/3770177876":"2024-09-18T00:53:35.657108+0000","172.21.15.2:0/2597867872":"2024-09-18T00:53:05.759479+0000","172.21.15.2:6801/3082534604":"2024-09-18T00:53:35.657108+0000","172.21.15.2:6800/1951809935":"2024-09-18T00:53:05.759479+0000","172.21.15.2:6801/1951809935":"2024-09-18T00:53:05.759479+0000","172.21.15.2:0/2687394772":"2024-09-18T00:53:05.759479+0000","172.21.15.2:0/2244315938":"2024-09-18T00:53:05.759479+0000","172.21.15.2:0/1006642018":"2024-09-18T00:54:36.242935+0000","172.21.15.2:0/4008124108":"2024-09-18T00:53:35.657108+0000","172.21.15.2:6800/3082534604":"2024-09-18T00:53:35.657108+0000","172.21.15.2:0/2143800566":"2024-09-18T00:53:35.657108+0000","172.21.15.2:6800/2191872617":"2024-09-18T00:54:36.242935+0000","172.21.15.2:0/4221926423":"2024-09-18T00:54:36.242935+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T00:58:23.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.606+0000 7f0b669eb640 1 -- 172.21.15.2:0/3607696997 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f0b4806ed60 msgr2=0x7f0b48071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:23.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.606+0000 7f0b669eb640 1 --2- 172.21.15.2:0/3607696997 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f0b4806ed60 0x7f0b48071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0b60110c50 tx=0x7f0b54009040 comp rx=0 tx=0).stop 2024-09-17T00:58:23.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.606+0000 7f0b669eb640 1 -- 172.21.15.2:0/3607696997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b600fac80 msgr2=0x7f0b60115390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:23.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.606+0000 7f0b669eb640 1 --2- 172.21.15.2:0/3607696997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b600fac80 0x7f0b60115390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0b50003080 tx=0x7f0b50009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:23.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.606+0000 7f0b669eb640 1 -- 172.21.15.2:0/3607696997 shutdown_connections 2024-09-17T00:58:23.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.606+0000 7f0b669eb640 1 --2- 172.21.15.2:0/3607696997 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f0b4806ed60 0x7f0b48071210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:23.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.606+0000 7f0b669eb640 1 --2- 172.21.15.2:0/3607696997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b600fd410 0x7f0b601158d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:23.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.606+0000 7f0b669eb640 1 --2- 172.21.15.2:0/3607696997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b600fac80 0x7f0b60115390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:23.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.606+0000 7f0b669eb640 1 -- 172.21.15.2:0/3607696997 >> 172.21.15.2:0/3607696997 conn(0x7f0b60070ce0 msgr2=0x7f0b600f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:23.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.606+0000 7f0b669eb640 1 -- 172.21.15.2:0/3607696997 shutdown_connections 2024-09-17T00:58:23.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:23.606+0000 7f0b669eb640 1 -- 172.21.15.2:0/3607696997 wait complete. 2024-09-17T00:58:23.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:23 smithi099 ceph-mon[34357]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:24.451 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-17T00:58:24.451 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-17T00:58:24.451 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-17T00:58:24.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-17T00:58:24.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-17T00:58:24.453 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-17T00:58:24.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:24 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3607696997' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:58:24.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:24 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3607696997' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T00:58:24.809 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:24.815 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:25.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:25 smithi002 ceph-mon[27650]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:25.789 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:25 smithi099 ceph-mon[34357]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:27.623 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:27 smithi002 ceph-mon[27650]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:27.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:27 smithi099 ceph-mon[34357]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:27.998 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:28.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.558+0000 7fa648a87640 1 -- 172.21.15.2:0/4170397070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6440fb4d0 msgr2=0x7fa6440fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.558+0000 7fa648a87640 1 --2- 172.21.15.2:0/4170397070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6440fb4d0 0x7fa6440fb940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa6380048d0 tx=0x7fa638009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.558+0000 7fa648a87640 1 -- 172.21.15.2:0/4170397070 shutdown_connections 2024-09-17T00:58:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.558+0000 7fa648a87640 1 --2- 172.21.15.2:0/4170397070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6440fb4d0 0x7fa6440fb940 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.558+0000 7fa648a87640 1 --2- 172.21.15.2:0/4170397070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa644101510 0x7fa6441018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.558+0000 7fa648a87640 1 -- 172.21.15.2:0/4170397070 >> 172.21.15.2:0/4170397070 conn(0x7fa6440f7090 msgr2=0x7fa6440f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.558+0000 7fa648a87640 1 -- 172.21.15.2:0/4170397070 shutdown_connections 2024-09-17T00:58:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.558+0000 7fa648a87640 1 -- 172.21.15.2:0/4170397070 wait complete. 2024-09-17T00:58:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.558+0000 7fa648a87640 1 Processor -- start 2024-09-17T00:58:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.558+0000 7fa648a87640 1 -- start start 2024-09-17T00:58:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa648a87640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6440fb4d0 0x7fa644113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa648a87640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa644101510 0x7fa6441136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa648a87640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa644113cd0 con 0x7fa644101510 2024-09-17T00:58:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa648a87640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64410d110 con 0x7fa6440fb4d0 2024-09-17T00:58:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa641d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa644101510 0x7fa6441136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa641d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa644101510 0x7fa6441136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48834/0 (socket says 172.21.15.2:48834) 2024-09-17T00:58:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa641d9b640 1 -- 172.21.15.2:0/3155373502 learned_addr learned my addr 172.21.15.2:0/3155373502 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa64259c640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6440fb4d0 0x7fa644113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa641d9b640 1 -- 172.21.15.2:0/3155373502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6440fb4d0 msgr2=0x7fa644113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa641d9b640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6440fb4d0 0x7fa644113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa641d9b640 1 -- 172.21.15.2:0/3155373502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa638005040 con 0x7fa644101510 2024-09-17T00:58:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa641d9b640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa644101510 0x7fa6441136d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa638000c00 tx=0x7fa638009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa632ffd640 1 -- 172.21.15.2:0/3155373502 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa638038070 con 0x7fa644101510 2024-09-17T00:58:28.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa632ffd640 1 -- 172.21.15.2:0/3155373502 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa63802ade0 con 0x7fa644101510 2024-09-17T00:58:28.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.559+0000 7fa648a87640 1 -- 172.21.15.2:0/3155373502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64410d390 con 0x7fa644101510 2024-09-17T00:58:28.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.560+0000 7fa648a87640 1 -- 172.21.15.2:0/3155373502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64410d8d0 con 0x7fa644101510 2024-09-17T00:58:28.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.560+0000 7fa632ffd640 1 -- 172.21.15.2:0/3155373502 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa63802c7e0 con 0x7fa644101510 2024-09-17T00:58:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.560+0000 7fa648a87640 1 -- 172.21.15.2:0/3155373502 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa64410dec0 con 0x7fa644101510 2024-09-17T00:58:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.561+0000 7fa632ffd640 1 -- 172.21.15.2:0/3155373502 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fa638030020 con 0x7fa644101510 2024-09-17T00:58:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.562+0000 7fa632ffd640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fa62c06ed60 0x7fa62c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.562+0000 7fa632ffd640 1 -- 172.21.15.2:0/3155373502 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa6380ada20 con 0x7fa644101510 2024-09-17T00:58:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.562+0000 7fa64259c640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fa62c06ed60 0x7fa62c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.562+0000 7fa632ffd640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.99:6800/2455888957,v1:172.21.15.99:6801/2455888957] conn(0x7fa62c074ae0 0x7fa62c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.562+0000 7fa632ffd640 1 -- 172.21.15.2:0/3155373502 --> [v2:172.21.15.99:6800/2455888957,v1:172.21.15.99:6801/2455888957] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa62c0775a0 con 0x7fa62c074ae0 2024-09-17T00:58:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.562+0000 7fa632ffd640 1 -- 172.21.15.2:0/3155373502 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6380b2220 con 0x7fa644101510 2024-09-17T00:58:28.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.562+0000 7fa642d9d640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.99:6800/2455888957,v1:172.21.15.99:6801/2455888957] conn(0x7fa62c074ae0 0x7fa62c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:28.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.562+0000 7fa64259c640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fa62c06ed60 0x7fa62c071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa634007fd0 tx=0x7fa634009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:28.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.563+0000 7fa642d9d640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.99:6800/2455888957,v1:172.21.15.99:6801/2455888957] conn(0x7fa62c074ae0 0x7fa62c076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:28.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.563+0000 7fa632ffd640 1 -- 172.21.15.2:0/3155373502 <== osd.3 v2:172.21.15.99:6800/2455888957 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fa62c0775a0 con 0x7fa62c074ae0 2024-09-17T00:58:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.576+0000 7fa648a87640 1 -- 172.21.15.2:0/3155373502 --> [v2:172.21.15.99:6800/2455888957,v1:172.21.15.99:6801/2455888957] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa6440f7db0 con 0x7fa62c074ae0 2024-09-17T00:58:28.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.577+0000 7fa632ffd640 1 -- 172.21.15.2:0/3155373502 <== osd.3 v2:172.21.15.99:6800/2455888957 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa6440f7db0 con 0x7fa62c074ae0 2024-09-17T00:58:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.577+0000 7fa648a87640 1 -- 172.21.15.2:0/3155373502 >> [v2:172.21.15.99:6800/2455888957,v1:172.21.15.99:6801/2455888957] conn(0x7fa62c074ae0 msgr2=0x7fa62c076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.577+0000 7fa648a87640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.99:6800/2455888957,v1:172.21.15.99:6801/2455888957] conn(0x7fa62c074ae0 0x7fa62c076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.577+0000 7fa648a87640 1 -- 172.21.15.2:0/3155373502 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fa62c06ed60 msgr2=0x7fa62c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.577+0000 7fa648a87640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fa62c06ed60 0x7fa62c071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa634007fd0 tx=0x7fa634009040 comp rx=0 tx=0).stop 2024-09-17T00:58:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.577+0000 7fa648a87640 1 -- 172.21.15.2:0/3155373502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa644101510 msgr2=0x7fa6441136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.577+0000 7fa648a87640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa644101510 0x7fa6441136d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa638000c00 tx=0x7fa638009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.578+0000 7fa648a87640 1 -- 172.21.15.2:0/3155373502 shutdown_connections 2024-09-17T00:58:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.578+0000 7fa648a87640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.99:6800/2455888957,v1:172.21.15.99:6801/2455888957] conn(0x7fa62c074ae0 0x7fa62c076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.578+0000 7fa648a87640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fa62c06ed60 0x7fa62c071210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.578+0000 7fa648a87640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa644101510 0x7fa6441136d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:28.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.578+0000 7fa648a87640 1 --2- 172.21.15.2:0/3155373502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6440fb4d0 0x7fa644113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:28.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.578+0000 7fa648a87640 1 -- 172.21.15.2:0/3155373502 >> 172.21.15.2:0/3155373502 conn(0x7fa6440f7090 msgr2=0x7fa6440f7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:28.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.578+0000 7fa648a87640 1 -- 172.21.15.2:0/3155373502 shutdown_connections 2024-09-17T00:58:28.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:28.578+0000 7fa648a87640 1 -- 172.21.15.2:0/3155373502 wait complete. 2024-09-17T00:58:29.637 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:29 smithi002 ceph-mon[27650]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:29.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:29 smithi099 ceph-mon[34357]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:31.607 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:31 smithi002 ceph-mon[27650]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:31.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.690+0000 7f2a90f2e640 1 -- 172.21.15.2:0/293699043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c064fc0 msgr2=0x7f2a8c065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:31.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.690+0000 7f2a90f2e640 1 --2- 172.21.15.2:0/293699043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c064fc0 0x7f2a8c065430 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2a740048d0 tx=0x7f2a74009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.690+0000 7f2a90f2e640 1 -- 172.21.15.2:0/293699043 shutdown_connections 2024-09-17T00:58:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.690+0000 7f2a90f2e640 1 --2- 172.21.15.2:0/293699043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c064fc0 0x7f2a8c065430 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.690+0000 7f2a90f2e640 1 --2- 172.21.15.2:0/293699043 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a8c0fe460 0x7f2a8c0fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.690+0000 7f2a90f2e640 1 -- 172.21.15.2:0/293699043 >> 172.21.15.2:0/293699043 conn(0x7f2a8c0723b0 msgr2=0x7f2a8c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.690+0000 7f2a90f2e640 1 -- 172.21.15.2:0/293699043 shutdown_connections 2024-09-17T00:58:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.690+0000 7f2a90f2e640 1 -- 172.21.15.2:0/293699043 wait complete. 2024-09-17T00:58:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.691+0000 7f2a90f2e640 1 Processor -- start 2024-09-17T00:58:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.691+0000 7f2a90f2e640 1 -- start start 2024-09-17T00:58:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.691+0000 7f2a90f2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c064fc0 0x7f2a8c113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.691+0000 7f2a90f2e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a8c0fe460 0x7f2a8c113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.691+0000 7f2a90f2e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c113e00 con 0x7f2a8c064fc0 2024-09-17T00:58:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.691+0000 7f2a90f2e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c10d1b0 con 0x7f2a8c0fe460 2024-09-17T00:58:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.691+0000 7f2a8a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c064fc0 0x7f2a8c113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.691+0000 7f2a8a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c064fc0 0x7f2a8c113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33550/0 (socket says 172.21.15.2:33550) 2024-09-17T00:58:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.691+0000 7f2a8a59c640 1 -- 172.21.15.2:0/1512200914 learned_addr learned my addr 172.21.15.2:0/1512200914 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.691+0000 7f2a89d9b640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a8c0fe460 0x7f2a8c113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.691+0000 7f2a8a59c640 1 -- 172.21.15.2:0/1512200914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a8c0fe460 msgr2=0x7f2a8c113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.691+0000 7f2a8a59c640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a8c0fe460 0x7f2a8c113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.691+0000 7f2a8a59c640 1 -- 172.21.15.2:0/1512200914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a74005040 con 0x7f2a8c064fc0 2024-09-17T00:58:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.691+0000 7f2a8a59c640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c064fc0 0x7f2a8c113230 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00b790 tx=0x7f2a7c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.692+0000 7f2a82ffd640 1 -- 172.21.15.2:0/1512200914 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a7c00c700 con 0x7f2a8c064fc0 2024-09-17T00:58:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.692+0000 7f2a90f2e640 1 -- 172.21.15.2:0/1512200914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8c10d490 con 0x7f2a8c064fc0 2024-09-17T00:58:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.692+0000 7f2a82ffd640 1 -- 172.21.15.2:0/1512200914 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2a7c00cd00 con 0x7f2a8c064fc0 2024-09-17T00:58:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.692+0000 7f2a82ffd640 1 -- 172.21.15.2:0/1512200914 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a7c015e70 con 0x7f2a8c064fc0 2024-09-17T00:58:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.692+0000 7f2a90f2e640 1 -- 172.21.15.2:0/1512200914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8c10d980 con 0x7f2a8c064fc0 2024-09-17T00:58:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.693+0000 7f2a90f2e640 1 -- 172.21.15.2:0/1512200914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a8c10dec0 con 0x7f2a8c064fc0 2024-09-17T00:58:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.693+0000 7f2a82ffd640 1 -- 172.21.15.2:0/1512200914 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f2a7c012070 con 0x7f2a8c064fc0 2024-09-17T00:58:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.694+0000 7f2a82ffd640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2a7806ed60 0x7f2a78071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.694+0000 7f2a82ffd640 1 -- 172.21.15.2:0/1512200914 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2a7c08d9c0 con 0x7f2a8c064fc0 2024-09-17T00:58:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.694+0000 7f2a89d9b640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2a7806ed60 0x7f2a78071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.694+0000 7f2a82ffd640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.99:6808/1239096669,v1:172.21.15.99:6809/1239096669] conn(0x7f2a78074ae0 0x7f2a78076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.694+0000 7f2a82ffd640 1 -- 172.21.15.2:0/1512200914 --> [v2:172.21.15.99:6808/1239096669,v1:172.21.15.99:6809/1239096669] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a780775a0 con 0x7f2a78074ae0 2024-09-17T00:58:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.694+0000 7f2a82ffd640 1 -- 172.21.15.2:0/1512200914 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a7c092220 con 0x7f2a8c064fc0 2024-09-17T00:58:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.694+0000 7f2a8ad9d640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.99:6808/1239096669,v1:172.21.15.99:6809/1239096669] conn(0x7f2a78074ae0 0x7f2a78076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.694+0000 7f2a89d9b640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2a7806ed60 0x7f2a78071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c072e00 tx=0x7f2a74035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.695+0000 7f2a8ad9d640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.99:6808/1239096669,v1:172.21.15.99:6809/1239096669] conn(0x7f2a78074ae0 0x7f2a78076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.695+0000 7f2a82ffd640 1 -- 172.21.15.2:0/1512200914 <== osd.4 v2:172.21.15.99:6808/1239096669 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2a780775a0 con 0x7f2a78074ae0 2024-09-17T00:58:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.708+0000 7f2a90f2e640 1 -- 172.21.15.2:0/1512200914 --> [v2:172.21.15.99:6808/1239096669,v1:172.21.15.99:6809/1239096669] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2a8c10e030 con 0x7f2a78074ae0 2024-09-17T00:58:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.708+0000 7f2a82ffd640 1 -- 172.21.15.2:0/1512200914 <== osd.4 v2:172.21.15.99:6808/1239096669 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2a8c10e030 con 0x7f2a78074ae0 2024-09-17T00:58:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.709+0000 7f2a90f2e640 1 -- 172.21.15.2:0/1512200914 >> [v2:172.21.15.99:6808/1239096669,v1:172.21.15.99:6809/1239096669] conn(0x7f2a78074ae0 msgr2=0x7f2a78076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.709+0000 7f2a90f2e640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.99:6808/1239096669,v1:172.21.15.99:6809/1239096669] conn(0x7f2a78074ae0 0x7f2a78076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:31.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.709+0000 7f2a90f2e640 1 -- 172.21.15.2:0/1512200914 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2a7806ed60 msgr2=0x7f2a78071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.709+0000 7f2a90f2e640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2a7806ed60 0x7f2a78071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c072e00 tx=0x7f2a74035040 comp rx=0 tx=0).stop 2024-09-17T00:58:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.709+0000 7f2a90f2e640 1 -- 172.21.15.2:0/1512200914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c064fc0 msgr2=0x7f2a8c113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.709+0000 7f2a90f2e640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c064fc0 0x7f2a8c113230 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00b790 tx=0x7f2a7c0091d0 comp rx=0 tx=0).stop 2024-09-17T00:58:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.709+0000 7f2a90f2e640 1 -- 172.21.15.2:0/1512200914 shutdown_connections 2024-09-17T00:58:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.709+0000 7f2a90f2e640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.99:6808/1239096669,v1:172.21.15.99:6809/1239096669] conn(0x7f2a78074ae0 0x7f2a78076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.709+0000 7f2a90f2e640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2a7806ed60 0x7f2a78071210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.709+0000 7f2a90f2e640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a8c0fe460 0x7f2a8c113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.709+0000 7f2a90f2e640 1 --2- 172.21.15.2:0/1512200914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a8c064fc0 0x7f2a8c113230 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.709+0000 7f2a90f2e640 1 -- 172.21.15.2:0/1512200914 >> 172.21.15.2:0/1512200914 conn(0x7f2a8c0723b0 msgr2=0x7f2a8c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:31.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.709+0000 7f2a90f2e640 1 -- 172.21.15.2:0/1512200914 shutdown_connections 2024-09-17T00:58:31.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:31.709+0000 7f2a90f2e640 1 -- 172.21.15.2:0/1512200914 wait complete. 2024-09-17T00:58:31.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:31 smithi099 ceph-mon[34357]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:32.421 INFO:teuthology.orchestra.run.smithi002.stdout:137438953486 2024-09-17T00:58:32.422 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-17T00:58:33.296 INFO:teuthology.orchestra.run.smithi002.stdout:111669149714 2024-09-17T00:58:33.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-17T00:58:33.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:33 smithi002 ceph-mon[27650]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:33.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:33 smithi099 ceph-mon[34357]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:34.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.636+0000 7f734e4f8640 1 -- 172.21.15.2:0/605733546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480fe460 msgr2=0x7f73480fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:34.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.636+0000 7f734e4f8640 1 --2- 172.21.15.2:0/605733546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480fe460 0x7f73480fe830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f73380048d0 tx=0x7f7338009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:34.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.637+0000 7f734e4f8640 1 -- 172.21.15.2:0/605733546 shutdown_connections 2024-09-17T00:58:34.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.637+0000 7f734e4f8640 1 --2- 172.21.15.2:0/605733546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7348064fc0 0x7f7348065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:34.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.637+0000 7f734e4f8640 1 --2- 172.21.15.2:0/605733546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480fe460 0x7f73480fe830 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:34.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.637+0000 7f734e4f8640 1 -- 172.21.15.2:0/605733546 >> 172.21.15.2:0/605733546 conn(0x7f73480723b0 msgr2=0x7f73480727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:34.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.637+0000 7f734e4f8640 1 -- 172.21.15.2:0/605733546 shutdown_connections 2024-09-17T00:58:34.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.637+0000 7f734e4f8640 1 -- 172.21.15.2:0/605733546 wait complete. 2024-09-17T00:58:34.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.637+0000 7f734e4f8640 1 Processor -- start 2024-09-17T00:58:34.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.637+0000 7f734e4f8640 1 -- start start 2024-09-17T00:58:34.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.638+0000 7f734e4f8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7348064fc0 0x7f7348113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:34.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.638+0000 7f734e4f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480fe460 0x7f73481136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:34.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.638+0000 7f734e4f8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7348113cd0 con 0x7f73480fe460 2024-09-17T00:58:34.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.638+0000 7f734e4f8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734810d110 con 0x7f7348064fc0 2024-09-17T00:58:34.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.638+0000 7f73477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480fe460 0x7f73481136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:34.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.638+0000 7f73477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480fe460 0x7f73481136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33572/0 (socket says 172.21.15.2:33572) 2024-09-17T00:58:34.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.638+0000 7f73477fe640 1 -- 172.21.15.2:0/2983331714 learned_addr learned my addr 172.21.15.2:0/2983331714 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:34.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.638+0000 7f7347fff640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7348064fc0 0x7f7348113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:34.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.638+0000 7f73477fe640 1 -- 172.21.15.2:0/2983331714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7348064fc0 msgr2=0x7f7348113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:34.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.638+0000 7f73477fe640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7348064fc0 0x7f7348113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:34.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.638+0000 7f73477fe640 1 -- 172.21.15.2:0/2983331714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7338005040 con 0x7f73480fe460 2024-09-17T00:58:34.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.638+0000 7f73477fe640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480fe460 0x7f73481136d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f733c002a80 tx=0x7f733c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:34.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.639+0000 7f7344ff9640 1 -- 172.21.15.2:0/2983331714 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f733c007c30 con 0x7f73480fe460 2024-09-17T00:58:34.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.639+0000 7f734e4f8640 1 -- 172.21.15.2:0/2983331714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734810d3f0 con 0x7f73480fe460 2024-09-17T00:58:34.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.639+0000 7f734e4f8640 1 -- 172.21.15.2:0/2983331714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734810d910 con 0x7f73480fe460 2024-09-17T00:58:34.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.639+0000 7f7344ff9640 1 -- 172.21.15.2:0/2983331714 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f733c00f040 con 0x7f73480fe460 2024-09-17T00:58:34.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.639+0000 7f7344ff9640 1 -- 172.21.15.2:0/2983331714 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f733c00dab0 con 0x7f73480fe460 2024-09-17T00:58:34.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.640+0000 7f734e4f8640 1 -- 172.21.15.2:0/2983331714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7334000fd0 con 0x7f73480fe460 2024-09-17T00:58:34.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.641+0000 7f7344ff9640 1 -- 172.21.15.2:0/2983331714 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f733c00dcf0 con 0x7f73480fe460 2024-09-17T00:58:34.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.641+0000 7f7344ff9640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f733006ed60 0x7f7330071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:34.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.641+0000 7f7344ff9640 1 -- 172.21.15.2:0/2983331714 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f733c08d530 con 0x7f73480fe460 2024-09-17T00:58:34.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.641+0000 7f7347fff640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f733006ed60 0x7f7330071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:34.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.641+0000 7f7344ff9640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812] conn(0x7f7330074ae0 0x7f7330076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:34.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.641+0000 7f7344ff9640 1 -- 172.21.15.2:0/2983331714 --> [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73300775a0 con 0x7f7330074ae0 2024-09-17T00:58:34.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.641+0000 7f7344ff9640 1 -- 172.21.15.2:0/2983331714 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f733c08fb80 con 0x7f73480fe460 2024-09-17T00:58:34.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.642+0000 7f734ca95640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812] conn(0x7f7330074ae0 0x7f7330076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:34.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.642+0000 7f7347fff640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f733006ed60 0x7f7330071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7338009ac0 tx=0x7f7338035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:34.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.642+0000 7f734ca95640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812] conn(0x7f7330074ae0 0x7f7330076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:34.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.643+0000 7f7344ff9640 1 -- 172.21.15.2:0/2983331714 <== osd.2 v2:172.21.15.2:6818/2404856812 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f73300775a0 con 0x7f7330074ae0 2024-09-17T00:58:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.656+0000 7f734e4f8640 1 -- 172.21.15.2:0/2983331714 --> [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7334002ca0 con 0x7f7330074ae0 2024-09-17T00:58:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f7344ff9640 1 -- 172.21.15.2:0/2983331714 <== osd.2 v2:172.21.15.2:6818/2404856812 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7334002ca0 con 0x7f7330074ae0 2024-09-17T00:58:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f734e4f8640 1 -- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812] conn(0x7f7330074ae0 msgr2=0x7f7330076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f734e4f8640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812] conn(0x7f7330074ae0 0x7f7330076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f734e4f8640 1 -- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f733006ed60 msgr2=0x7f7330071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f734e4f8640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f733006ed60 0x7f7330071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7338009ac0 tx=0x7f7338035040 comp rx=0 tx=0).stop 2024-09-17T00:58:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f734e4f8640 1 -- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480fe460 msgr2=0x7f73481136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f734e4f8640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480fe460 0x7f73481136d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f733c002a80 tx=0x7f733c004600 comp rx=0 tx=0).stop 2024-09-17T00:58:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f734e4f8640 1 -- 172.21.15.2:0/2983331714 shutdown_connections 2024-09-17T00:58:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f734e4f8640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:6818/2404856812,v1:172.21.15.2:6819/2404856812] conn(0x7f7330074ae0 0x7f7330076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f734e4f8640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f733006ed60 0x7f7330071210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f734e4f8640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73480fe460 0x7f73481136d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f734e4f8640 1 --2- 172.21.15.2:0/2983331714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7348064fc0 0x7f7348113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f734e4f8640 1 -- 172.21.15.2:0/2983331714 >> 172.21.15.2:0/2983331714 conn(0x7f73480723b0 msgr2=0x7f7348105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f734e4f8640 1 -- 172.21.15.2:0/2983331714 shutdown_connections 2024-09-17T00:58:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.657+0000 7f734e4f8640 1 -- 172.21.15.2:0/2983331714 wait complete. 2024-09-17T00:58:35.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.137+0000 7f322b885640 1 -- 172.21.15.2:0/422813323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3224064fc0 msgr2=0x7f3224065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:35.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.137+0000 7f322b885640 1 --2- 172.21.15.2:0/422813323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3224064fc0 0x7f3224065430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3218009c50 tx=0x7f3218004d10 comp rx=0 tx=0).stop 2024-09-17T00:58:35.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.137+0000 7f322b885640 1 -- 172.21.15.2:0/422813323 shutdown_connections 2024-09-17T00:58:35.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.137+0000 7f322b885640 1 --2- 172.21.15.2:0/422813323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3224064fc0 0x7f3224065430 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.137+0000 7f322b885640 1 --2- 172.21.15.2:0/422813323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32240fe460 0x7f32240fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.137+0000 7f322b885640 1 -- 172.21.15.2:0/422813323 >> 172.21.15.2:0/422813323 conn(0x7f32240723b0 msgr2=0x7f32240727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.138+0000 7f322b885640 1 -- 172.21.15.2:0/422813323 shutdown_connections 2024-09-17T00:58:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.138+0000 7f322b885640 1 -- 172.21.15.2:0/422813323 wait complete. 2024-09-17T00:58:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.138+0000 7f322b885640 1 Processor -- start 2024-09-17T00:58:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.138+0000 7f322b885640 1 -- start start 2024-09-17T00:58:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.138+0000 7f322b885640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3224064fc0 0x7f32241131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.138+0000 7f322b885640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32240fe460 0x7f3224113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.138+0000 7f322b885640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3224113d10 con 0x7f32240fe460 2024-09-17T00:58:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.138+0000 7f322b885640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322410d1a0 con 0x7f3224064fc0 2024-09-17T00:58:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.138+0000 7f3228e20640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32240fe460 0x7f3224113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.138+0000 7f3228e20640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32240fe460 0x7f3224113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33594/0 (socket says 172.21.15.2:33594) 2024-09-17T00:58:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.138+0000 7f3228e20640 1 -- 172.21.15.2:0/1283581980 learned_addr learned my addr 172.21.15.2:0/1283581980 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:35.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.138+0000 7f3229621640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3224064fc0 0x7f32241131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.139+0000 7f3228e20640 1 -- 172.21.15.2:0/1283581980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3224064fc0 msgr2=0x7f32241131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.139+0000 7f3228e20640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3224064fc0 0x7f32241131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.139+0000 7f3228e20640 1 -- 172.21.15.2:0/1283581980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32180098b0 con 0x7f32240fe460 2024-09-17T00:58:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.139+0000 7f3228e20640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32240fe460 0x7f3224113710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3218004750 tx=0x7f3218004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.139+0000 7f3221ffb640 1 -- 172.21.15.2:0/1283581980 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3218009540 con 0x7f32240fe460 2024-09-17T00:58:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.139+0000 7f322b885640 1 -- 172.21.15.2:0/1283581980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322410d420 con 0x7f32240fe460 2024-09-17T00:58:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.139+0000 7f3221ffb640 1 -- 172.21.15.2:0/1283581980 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f32180096a0 con 0x7f32240fe460 2024-09-17T00:58:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.139+0000 7f3221ffb640 1 -- 172.21.15.2:0/1283581980 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f321803d960 con 0x7f32240fe460 2024-09-17T00:58:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.139+0000 7f322b885640 1 -- 172.21.15.2:0/1283581980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322410d9c0 con 0x7f32240fe460 2024-09-17T00:58:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.140+0000 7f322b885640 1 -- 172.21.15.2:0/1283581980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f322410dea0 con 0x7f32240fe460 2024-09-17T00:58:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.141+0000 7f3221ffb640 1 -- 172.21.15.2:0/1283581980 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f321802f030 con 0x7f32240fe460 2024-09-17T00:58:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.141+0000 7f3221ffb640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f320c06ed50 0x7f320c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.141+0000 7f3221ffb640 1 -- 172.21.15.2:0/1283581980 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f32180aed10 con 0x7f32240fe460 2024-09-17T00:58:35.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.141+0000 7f3229621640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f320c06ed50 0x7f320c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:35.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.142+0000 7f3221ffb640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145] conn(0x7f320c074ad0 0x7f320c076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:35.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.142+0000 7f3221ffb640 1 -- 172.21.15.2:0/1283581980 --> [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f320c077590 con 0x7f320c074ad0 2024-09-17T00:58:35.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.142+0000 7f3221ffb640 1 -- 172.21.15.2:0/1283581980 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32180b4310 con 0x7f32240fe460 2024-09-17T00:58:35.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.142+0000 7f3229e22640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145] conn(0x7f320c074ad0 0x7f320c076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:35.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.142+0000 7f3229621640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f320c06ed50 0x7f320c071200 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3214004ed0 tx=0x7f321400b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:35.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.142+0000 7f3229e22640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145] conn(0x7f320c074ad0 0x7f320c076ee0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:35.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.143+0000 7f3221ffb640 1 -- 172.21.15.2:0/1283581980 <== osd.0 v2:172.21.15.2:6802/1937150145 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f320c077590 con 0x7f320c074ad0 2024-09-17T00:58:35.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.156+0000 7f322b885640 1 -- 172.21.15.2:0/1283581980 --> [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3224106e10 con 0x7f320c074ad0 2024-09-17T00:58:35.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.156+0000 7f3221ffb640 1 -- 172.21.15.2:0/1283581980 <== osd.0 v2:172.21.15.2:6802/1937150145 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3224106e10 con 0x7f320c074ad0 2024-09-17T00:58:35.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.157+0000 7f322b885640 1 -- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145] conn(0x7f320c074ad0 msgr2=0x7f320c076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:35.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.157+0000 7f322b885640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145] conn(0x7f320c074ad0 0x7f320c076ee0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.157+0000 7f322b885640 1 -- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f320c06ed50 msgr2=0x7f320c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:35.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.157+0000 7f322b885640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f320c06ed50 0x7f320c071200 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3214004ed0 tx=0x7f321400b040 comp rx=0 tx=0).stop 2024-09-17T00:58:35.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.157+0000 7f322b885640 1 -- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32240fe460 msgr2=0x7f3224113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.157+0000 7f322b885640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32240fe460 0x7f3224113710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3218004750 tx=0x7f3218004d10 comp rx=0 tx=0).stop 2024-09-17T00:58:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.157+0000 7f322b885640 1 -- 172.21.15.2:0/1283581980 shutdown_connections 2024-09-17T00:58:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.157+0000 7f322b885640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:6802/1937150145,v1:172.21.15.2:6803/1937150145] conn(0x7f320c074ad0 0x7f320c076ee0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.157+0000 7f322b885640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f320c06ed50 0x7f320c071200 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.157+0000 7f322b885640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32240fe460 0x7f3224113710 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.157+0000 7f322b885640 1 --2- 172.21.15.2:0/1283581980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3224064fc0 0x7f32241131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.157+0000 7f322b885640 1 -- 172.21.15.2:0/1283581980 >> 172.21.15.2:0/1283581980 conn(0x7f32240723b0 msgr2=0x7f32241053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.157+0000 7f322b885640 1 -- 172.21.15.2:0/1283581980 shutdown_connections 2024-09-17T00:58:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:35.157+0000 7f322b885640 1 -- 172.21.15.2:0/1283581980 wait complete. 2024-09-17T00:58:35.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:35 smithi002 ceph-mon[27650]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:35.778 INFO:teuthology.orchestra.run.smithi002.stdout:38654705701 2024-09-17T00:58:35.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-17T00:58:35.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:35 smithi099 ceph-mon[34357]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:35.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.821+0000 7fb7890d0640 1 -- 172.21.15.2:0/2609031689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7840fe460 msgr2=0x7fb7840fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:35.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.821+0000 7fb7890d0640 1 --2- 172.21.15.2:0/2609031689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7840fe460 0x7fb7840fe830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb7740048d0 tx=0x7fb774009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.821+0000 7fb7890d0640 1 -- 172.21.15.2:0/2609031689 shutdown_connections 2024-09-17T00:58:35.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.821+0000 7fb7890d0640 1 --2- 172.21.15.2:0/2609031689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb784064fc0 0x7fb784065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.821+0000 7fb7890d0640 1 --2- 172.21.15.2:0/2609031689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7840fe460 0x7fb7840fe830 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.821+0000 7fb7890d0640 1 -- 172.21.15.2:0/2609031689 >> 172.21.15.2:0/2609031689 conn(0x7fb7840723b0 msgr2=0x7fb7840727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.821+0000 7fb7890d0640 1 -- 172.21.15.2:0/2609031689 shutdown_connections 2024-09-17T00:58:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.821+0000 7fb7890d0640 1 -- 172.21.15.2:0/2609031689 wait complete. 2024-09-17T00:58:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.822+0000 7fb7890d0640 1 Processor -- start 2024-09-17T00:58:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.822+0000 7fb7890d0640 1 -- start start 2024-09-17T00:58:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.822+0000 7fb7890d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb784064fc0 0x7fb784113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.822+0000 7fb7890d0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7840fe460 0x7fb784113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.822+0000 7fb7890d0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb784113dd0 con 0x7fb784064fc0 2024-09-17T00:58:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.822+0000 7fb7890d0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78410d180 con 0x7fb7840fe460 2024-09-17T00:58:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.822+0000 7fb782d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb784064fc0 0x7fb784113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.822+0000 7fb782d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb784064fc0 0x7fb784113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33588/0 (socket says 172.21.15.2:33588) 2024-09-17T00:58:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.822+0000 7fb782d9d640 1 -- 172.21.15.2:0/3687402859 learned_addr learned my addr 172.21.15.2:0/3687402859 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.823+0000 7fb77a59c640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7840fe460 0x7fb784113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.823+0000 7fb782d9d640 1 -- 172.21.15.2:0/3687402859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7840fe460 msgr2=0x7fb784113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.823+0000 7fb782d9d640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7840fe460 0x7fb784113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.823+0000 7fb782d9d640 1 -- 172.21.15.2:0/3687402859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774005040 con 0x7fb784064fc0 2024-09-17T00:58:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.823+0000 7fb782d9d640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb784064fc0 0x7fb784113200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb774003080 tx=0x7fb774009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.823+0000 7fb77bfff640 1 -- 172.21.15.2:0/3687402859 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb774038070 con 0x7fb784064fc0 2024-09-17T00:58:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.823+0000 7fb7890d0640 1 -- 172.21.15.2:0/3687402859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78410d400 con 0x7fb784064fc0 2024-09-17T00:58:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.823+0000 7fb77bfff640 1 -- 172.21.15.2:0/3687402859 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb7740097e0 con 0x7fb784064fc0 2024-09-17T00:58:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.823+0000 7fb77bfff640 1 -- 172.21.15.2:0/3687402859 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb77403d420 con 0x7fb784064fc0 2024-09-17T00:58:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.823+0000 7fb7890d0640 1 -- 172.21.15.2:0/3687402859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78410d8c0 con 0x7fb784064fc0 2024-09-17T00:58:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.824+0000 7fb7890d0640 1 -- 172.21.15.2:0/3687402859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb78410dda0 con 0x7fb784064fc0 2024-09-17T00:58:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.824+0000 7fb77bfff640 1 -- 172.21.15.2:0/3687402859 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fb774030020 con 0x7fb784064fc0 2024-09-17T00:58:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.825+0000 7fb77bfff640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb77006ed60 0x7fb770071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.825+0000 7fb77bfff640 1 -- 172.21.15.2:0/3687402859 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb7740ae470 con 0x7fb784064fc0 2024-09-17T00:58:35.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.825+0000 7fb77a59c640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb77006ed60 0x7fb770071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:35.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.825+0000 7fb77bfff640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.99:6816/4041287024,v1:172.21.15.99:6817/4041287024] conn(0x7fb770074ae0 0x7fb770076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:35.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.825+0000 7fb77bfff640 1 -- 172.21.15.2:0/3687402859 --> [v2:172.21.15.99:6816/4041287024,v1:172.21.15.99:6817/4041287024] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7700775a0 con 0x7fb770074ae0 2024-09-17T00:58:35.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.825+0000 7fb77bfff640 1 -- 172.21.15.2:0/3687402859 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7740b0a60 con 0x7fb784064fc0 2024-09-17T00:58:35.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.825+0000 7fb77a59c640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb77006ed60 0x7fb770071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb76c006fd0 tx=0x7fb76c008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:35.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.825+0000 7fb78359e640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.99:6816/4041287024,v1:172.21.15.99:6817/4041287024] conn(0x7fb770074ae0 0x7fb770076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:35.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.826+0000 7fb78359e640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.99:6816/4041287024,v1:172.21.15.99:6817/4041287024] conn(0x7fb770074ae0 0x7fb770076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:35.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.827+0000 7fb77bfff640 1 -- 172.21.15.2:0/3687402859 <== osd.5 v2:172.21.15.99:6816/4041287024 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb7700775a0 con 0x7fb770074ae0 2024-09-17T00:58:35.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.839+0000 7fb7890d0640 1 -- 172.21.15.2:0/3687402859 --> [v2:172.21.15.99:6816/4041287024,v1:172.21.15.99:6817/4041287024] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb7840fdcf0 con 0x7fb770074ae0 2024-09-17T00:58:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.839+0000 7fb77bfff640 1 -- 172.21.15.2:0/3687402859 <== osd.5 v2:172.21.15.99:6816/4041287024 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb7840fdcf0 con 0x7fb770074ae0 2024-09-17T00:58:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.840+0000 7fb7890d0640 1 -- 172.21.15.2:0/3687402859 >> [v2:172.21.15.99:6816/4041287024,v1:172.21.15.99:6817/4041287024] conn(0x7fb770074ae0 msgr2=0x7fb770076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.840+0000 7fb7890d0640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.99:6816/4041287024,v1:172.21.15.99:6817/4041287024] conn(0x7fb770074ae0 0x7fb770076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.840+0000 7fb7890d0640 1 -- 172.21.15.2:0/3687402859 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb77006ed60 msgr2=0x7fb770071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.840+0000 7fb7890d0640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb77006ed60 0x7fb770071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb76c006fd0 tx=0x7fb76c008040 comp rx=0 tx=0).stop 2024-09-17T00:58:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.840+0000 7fb7890d0640 1 -- 172.21.15.2:0/3687402859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb784064fc0 msgr2=0x7fb784113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.840+0000 7fb7890d0640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb784064fc0 0x7fb784113200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb774003080 tx=0x7fb774009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.840+0000 7fb7890d0640 1 -- 172.21.15.2:0/3687402859 shutdown_connections 2024-09-17T00:58:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.840+0000 7fb7890d0640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.99:6816/4041287024,v1:172.21.15.99:6817/4041287024] conn(0x7fb770074ae0 0x7fb770076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.840+0000 7fb7890d0640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb77006ed60 0x7fb770071210 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.840+0000 7fb7890d0640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7840fe460 0x7fb784113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.840+0000 7fb7890d0640 1 --2- 172.21.15.2:0/3687402859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb784064fc0 0x7fb784113200 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.840+0000 7fb7890d0640 1 -- 172.21.15.2:0/3687402859 >> 172.21.15.2:0/3687402859 conn(0x7fb7840723b0 msgr2=0x7fb784105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:35.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.840+0000 7fb7890d0640 1 -- 172.21.15.2:0/3687402859 shutdown_connections 2024-09-17T00:58:35.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:34.840+0000 7fb7890d0640 1 -- 172.21.15.2:0/3687402859 wait complete. 2024-09-17T00:58:36.068 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:36.524 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:36 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:58:36.549 INFO:teuthology.orchestra.run.smithi002.stdout:158913789961 2024-09-17T00:58:36.550 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-17T00:58:36.596 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:36.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:36 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:58:37.290 INFO:teuthology.orchestra.run.smithi002.stdout:81604378649 2024-09-17T00:58:37.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-17T00:58:37.520 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:37 smithi002 ceph-mon[27650]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:37.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:37 smithi099 ceph-mon[34357]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:39.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.363+0000 7fb54dc6a640 1 -- 172.21.15.2:0/4033665982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb548102620 msgr2=0x7fb5481029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.363+0000 7fb54dc6a640 1 --2- 172.21.15.2:0/4033665982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb548102620 0x7fb5481029f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb538009c50 tx=0x7fb538004d10 comp rx=0 tx=0).stop 2024-09-17T00:58:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.363+0000 7fb54dc6a640 1 -- 172.21.15.2:0/4033665982 shutdown_connections 2024-09-17T00:58:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.363+0000 7fb54dc6a640 1 --2- 172.21.15.2:0/4033665982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480fac80 0x7fb5480fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.363+0000 7fb54dc6a640 1 --2- 172.21.15.2:0/4033665982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb548102620 0x7fb5481029f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.363+0000 7fb54dc6a640 1 -- 172.21.15.2:0/4033665982 >> 172.21.15.2:0/4033665982 conn(0x7fb548070ce0 msgr2=0x7fb5480710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.363+0000 7fb54dc6a640 1 -- 172.21.15.2:0/4033665982 shutdown_connections 2024-09-17T00:58:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.363+0000 7fb54dc6a640 1 -- 172.21.15.2:0/4033665982 wait complete. 2024-09-17T00:58:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.364+0000 7fb54dc6a640 1 Processor -- start 2024-09-17T00:58:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.364+0000 7fb54dc6a640 1 -- start start 2024-09-17T00:58:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.364+0000 7fb54dc6a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480fac80 0x7fb5480fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:39.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.364+0000 7fb54dc6a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb548102620 0x7fb5480fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.364+0000 7fb54dc6a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5480fdc10 con 0x7fb548102620 2024-09-17T00:58:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.364+0000 7fb54dc6a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5480fdd80 con 0x7fb5480fac80 2024-09-17T00:58:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.364+0000 7fb546ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb548102620 0x7fb5480fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.364+0000 7fb546ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb548102620 0x7fb5480fc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33624/0 (socket says 172.21.15.2:33624) 2024-09-17T00:58:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.364+0000 7fb546ffd640 1 -- 172.21.15.2:0/1432409919 learned_addr learned my addr 172.21.15.2:0/1432409919 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.364+0000 7fb5477fe640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480fac80 0x7fb5480fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.365+0000 7fb546ffd640 1 -- 172.21.15.2:0/1432409919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480fac80 msgr2=0x7fb5480fbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.365+0000 7fb546ffd640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480fac80 0x7fb5480fbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.365+0000 7fb546ffd640 1 -- 172.21.15.2:0/1432409919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5380098b0 con 0x7fb548102620 2024-09-17T00:58:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.365+0000 7fb546ffd640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb548102620 0x7fb5480fc3a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00c830 tx=0x7fb53c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.365+0000 7fb52ffff640 1 -- 172.21.15.2:0/1432409919 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb53c00a850 con 0x7fb548102620 2024-09-17T00:58:39.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.365+0000 7fb52ffff640 1 -- 172.21.15.2:0/1432409919 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb53c00ae50 con 0x7fb548102620 2024-09-17T00:58:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.365+0000 7fb54dc6a640 1 -- 172.21.15.2:0/1432409919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5480fc9a0 con 0x7fb548102620 2024-09-17T00:58:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.365+0000 7fb52ffff640 1 -- 172.21.15.2:0/1432409919 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb53c0113a0 con 0x7fb548102620 2024-09-17T00:58:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.365+0000 7fb54dc6a640 1 -- 172.21.15.2:0/1432409919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54811de60 con 0x7fb548102620 2024-09-17T00:58:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.366+0000 7fb54dc6a640 1 -- 172.21.15.2:0/1432409919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb548106d50 con 0x7fb548102620 2024-09-17T00:58:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.366+0000 7fb52ffff640 1 -- 172.21.15.2:0/1432409919 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fb53c012400 con 0x7fb548102620 2024-09-17T00:58:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.367+0000 7fb52ffff640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb53006ed60 0x7fb530071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.367+0000 7fb52ffff640 1 -- 172.21.15.2:0/1432409919 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb53c08dfe0 con 0x7fb548102620 2024-09-17T00:58:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.367+0000 7fb5477fe640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb53006ed60 0x7fb530071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.367+0000 7fb52ffff640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340] conn(0x7fb530074ae0 0x7fb530076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.367+0000 7fb52ffff640 1 -- 172.21.15.2:0/1432409919 --> [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5300775a0 con 0x7fb530074ae0 2024-09-17T00:58:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.367+0000 7fb52ffff640 1 -- 172.21.15.2:0/1432409919 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb53c090540 con 0x7fb548102620 2024-09-17T00:58:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.367+0000 7fb547fff640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340] conn(0x7fb530074ae0 0x7fb530076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.367+0000 7fb5477fe640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb53006ed60 0x7fb530071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb538009c20 tx=0x7fb538004d10 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:39.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.368+0000 7fb547fff640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340] conn(0x7fb530074ae0 0x7fb530076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:39.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.368+0000 7fb52ffff640 1 -- 172.21.15.2:0/1432409919 <== osd.1 v2:172.21.15.2:6810/3467957340 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb5300775a0 con 0x7fb530074ae0 2024-09-17T00:58:39.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.382+0000 7fb54dc6a640 1 -- 172.21.15.2:0/1432409919 --> [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb5480657b0 con 0x7fb530074ae0 2024-09-17T00:58:39.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.383+0000 7fb52ffff640 1 -- 172.21.15.2:0/1432409919 <== osd.1 v2:172.21.15.2:6810/3467957340 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb5480657b0 con 0x7fb530074ae0 2024-09-17T00:58:39.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.383+0000 7fb54dc6a640 1 -- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340] conn(0x7fb530074ae0 msgr2=0x7fb530076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:39.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.383+0000 7fb54dc6a640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340] conn(0x7fb530074ae0 0x7fb530076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.383+0000 7fb54dc6a640 1 -- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb53006ed60 msgr2=0x7fb530071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:39.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.383+0000 7fb54dc6a640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb53006ed60 0x7fb530071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb538009c20 tx=0x7fb538004d10 comp rx=0 tx=0).stop 2024-09-17T00:58:39.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.383+0000 7fb54dc6a640 1 -- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb548102620 msgr2=0x7fb5480fc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:39.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.383+0000 7fb54dc6a640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb548102620 0x7fb5480fc3a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00c830 tx=0x7fb53c004430 comp rx=0 tx=0).stop 2024-09-17T00:58:39.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.384+0000 7fb54dc6a640 1 -- 172.21.15.2:0/1432409919 shutdown_connections 2024-09-17T00:58:39.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.384+0000 7fb54dc6a640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:6810/3467957340,v1:172.21.15.2:6811/3467957340] conn(0x7fb530074ae0 0x7fb530076ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.384+0000 7fb54dc6a640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fb53006ed60 0x7fb530071210 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb538009c20 tx=0x7fb538004d10 comp rx=0 tx=0).stop 2024-09-17T00:58:39.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.384+0000 7fb54dc6a640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb548102620 0x7fb5480fc3a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.384+0000 7fb54dc6a640 1 --2- 172.21.15.2:0/1432409919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5480fac80 0x7fb5480fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.384+0000 7fb54dc6a640 1 -- 172.21.15.2:0/1432409919 >> 172.21.15.2:0/1432409919 conn(0x7fb548070ce0 msgr2=0x7fb548105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:39.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.384+0000 7fb54dc6a640 1 -- 172.21.15.2:0/1432409919 shutdown_connections 2024-09-17T00:58:39.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.384+0000 7fb54dc6a640 1 -- 172.21.15.2:0/1432409919 wait complete. 2024-09-17T00:58:39.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:39 smithi002 ceph-mon[27650]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:39.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:39 smithi099 ceph-mon[34357]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:39.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.854+0000 7f48210bc640 1 -- 172.21.15.2:0/2469016226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f481c101490 msgr2=0x7f481c101860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:39.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.854+0000 7f48210bc640 1 --2- 172.21.15.2:0/2469016226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f481c101490 0x7f481c101860 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f480c0048d0 tx=0x7f480c009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.855+0000 7f48210bc640 1 -- 172.21.15.2:0/2469016226 shutdown_connections 2024-09-17T00:58:39.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.855+0000 7f48210bc640 1 --2- 172.21.15.2:0/2469016226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f481c0fb470 0x7f481c0fb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.855+0000 7f48210bc640 1 --2- 172.21.15.2:0/2469016226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f481c101490 0x7f481c101860 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.855+0000 7f48210bc640 1 -- 172.21.15.2:0/2469016226 >> 172.21.15.2:0/2469016226 conn(0x7f481c071450 msgr2=0x7f481c071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:39.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.855+0000 7f48210bc640 1 -- 172.21.15.2:0/2469016226 shutdown_connections 2024-09-17T00:58:39.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.855+0000 7f48210bc640 1 -- 172.21.15.2:0/2469016226 wait complete. 2024-09-17T00:58:39.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.856+0000 7f48210bc640 1 Processor -- start 2024-09-17T00:58:39.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.856+0000 7f48210bc640 1 -- start start 2024-09-17T00:58:39.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.856+0000 7f48210bc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f481c0fb470 0x7f481c113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:39.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.856+0000 7f48210bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f481c101490 0x7f481c113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:39.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.856+0000 7f48210bc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c113e10 con 0x7f481c101490 2024-09-17T00:58:39.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.856+0000 7f48210bc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c10d1c0 con 0x7f481c0fb470 2024-09-17T00:58:39.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.856+0000 7f481a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f481c101490 0x7f481c113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:39.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.857+0000 7f481a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f481c101490 0x7f481c113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33646/0 (socket says 172.21.15.2:33646) 2024-09-17T00:58:39.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.857+0000 7f481a59c640 1 -- 172.21.15.2:0/1470336976 learned_addr learned my addr 172.21.15.2:0/1470336976 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.857+0000 7f481ad9d640 1 --2- 172.21.15.2:0/1470336976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f481c0fb470 0x7f481c113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.857+0000 7f481a59c640 1 -- 172.21.15.2:0/1470336976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f481c0fb470 msgr2=0x7f481c113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.857+0000 7f481a59c640 1 --2- 172.21.15.2:0/1470336976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f481c0fb470 0x7f481c113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.857+0000 7f481a59c640 1 -- 172.21.15.2:0/1470336976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c005040 con 0x7f481c101490 2024-09-17T00:58:39.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.858+0000 7f481a59c640 1 --2- 172.21.15.2:0/1470336976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f481c101490 0x7f481c113780 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f481000b790 tx=0x7f48100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.859+0000 7f48037fe640 1 -- 172.21.15.2:0/1470336976 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f481000c700 con 0x7f481c101490 2024-09-17T00:58:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.859+0000 7f48037fe640 1 -- 172.21.15.2:0/1470336976 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f481000cd00 con 0x7f481c101490 2024-09-17T00:58:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.859+0000 7f48037fe640 1 -- 172.21.15.2:0/1470336976 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4810015e80 con 0x7f481c101490 2024-09-17T00:58:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.859+0000 7f48210bc640 1 -- 172.21.15.2:0/1470336976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481c10d440 con 0x7f481c101490 2024-09-17T00:58:39.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.859+0000 7f48210bc640 1 -- 172.21.15.2:0/1470336976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481c10d910 con 0x7f481c101490 2024-09-17T00:58:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.860+0000 7f48210bc640 1 -- 172.21.15.2:0/1470336976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481c0fcb50 con 0x7f481c101490 2024-09-17T00:58:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.863+0000 7f48037fe640 1 -- 172.21.15.2:0/1470336976 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f4810012070 con 0x7f481c101490 2024-09-17T00:58:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.864+0000 7f48037fe640 1 --2- 172.21.15.2:0/1470336976 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f480406ee20 0x7f48040712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.864+0000 7f48037fe640 1 -- 172.21.15.2:0/1470336976 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f481008db10 con 0x7f481c101490 2024-09-17T00:58:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.864+0000 7f481ad9d640 1 --2- 172.21.15.2:0/1470336976 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f480406ee20 0x7f48040712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.865+0000 7f481ad9d640 1 --2- 172.21.15.2:0/1470336976 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f480406ee20 0x7f48040712d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f480c032430 tx=0x7f480c035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:39.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:39.868+0000 7f48037fe640 1 -- 172.21.15.2:0/1470336976 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f481005b090 con 0x7f481c101490 2024-09-17T00:58:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:40.037+0000 7f48210bc640 1 -- 172.21.15.2:0/1470336976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f481c05ed70 con 0x7f481c101490 2024-09-17T00:58:40.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:40.038+0000 7f48037fe640 1 -- 172.21.15.2:0/1470336976 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f481005aa30 con 0x7f481c101490 2024-09-17T00:58:40.036 INFO:teuthology.orchestra.run.smithi002.stdout:137438953487 2024-09-17T00:58:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:40.040+0000 7f48210bc640 1 -- 172.21.15.2:0/1470336976 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f480406ee20 msgr2=0x7f48040712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:40.040+0000 7f48210bc640 1 --2- 172.21.15.2:0/1470336976 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f480406ee20 0x7f48040712d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f480c032430 tx=0x7f480c035040 comp rx=0 tx=0).stop 2024-09-17T00:58:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:40.040+0000 7f48210bc640 1 -- 172.21.15.2:0/1470336976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f481c101490 msgr2=0x7f481c113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:40.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:40.040+0000 7f48210bc640 1 --2- 172.21.15.2:0/1470336976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f481c101490 0x7f481c113780 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f481000b790 tx=0x7f48100091d0 comp rx=0 tx=0).stop 2024-09-17T00:58:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:40.040+0000 7f48210bc640 1 -- 172.21.15.2:0/1470336976 shutdown_connections 2024-09-17T00:58:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:40.040+0000 7f48210bc640 1 --2- 172.21.15.2:0/1470336976 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f480406ee20 0x7f48040712d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:40.040+0000 7f48210bc640 1 --2- 172.21.15.2:0/1470336976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f481c101490 0x7f481c113780 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:40.040+0000 7f48210bc640 1 --2- 172.21.15.2:0/1470336976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f481c0fb470 0x7f481c113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:40.040+0000 7f48210bc640 1 -- 172.21.15.2:0/1470336976 >> 172.21.15.2:0/1470336976 conn(0x7f481c071450 msgr2=0x7f481c0f9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:40.040+0000 7f48210bc640 1 -- 172.21.15.2:0/1470336976 shutdown_connections 2024-09-17T00:58:40.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:40.040+0000 7f48210bc640 1 -- 172.21.15.2:0/1470336976 wait complete. 2024-09-17T00:58:40.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:40 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/1470336976' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T00:58:40.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:40 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/1470336976' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T00:58:41.201 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953486 got 137438953487 for osd.4 2024-09-17T00:58:41.201 DEBUG:teuthology.parallel:result is None 2024-09-17T00:58:41.430 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:41 smithi002 ceph-mon[27650]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:41.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:41 smithi099 ceph-mon[34357]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:60129542176 2024-09-17T00:58:43.084 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-17T00:58:43.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.239+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3815104078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b80fcf80 msgr2=0x7ff7b80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:43.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.239+0000 7ff7bce6d640 1 --2- 172.21.15.2:0/3815104078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b80fcf80 0x7ff7b80fd3d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00048d0 tx=0x7ff7a0009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.239+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3815104078 shutdown_connections 2024-09-17T00:58:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.239+0000 7ff7bce6d640 1 --2- 172.21.15.2:0/3815104078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b80fcf80 0x7ff7b80fd3d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.239+0000 7ff7bce6d640 1 --2- 172.21.15.2:0/3815104078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b80fb810 0x7ff7b80fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.239+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3815104078 >> 172.21.15.2:0/3815104078 conn(0x7ff7b80723b0 msgr2=0x7ff7b80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.239+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3815104078 shutdown_connections 2024-09-17T00:58:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.239+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3815104078 wait complete. 2024-09-17T00:58:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.239+0000 7ff7bce6d640 1 Processor -- start 2024-09-17T00:58:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.240+0000 7ff7bce6d640 1 -- start start 2024-09-17T00:58:43.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.240+0000 7ff7bce6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b80fb810 0x7ff7b8113150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:43.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.240+0000 7ff7bce6d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b80fcf80 0x7ff7b8113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.240+0000 7ff7bce6d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b8113c90 con 0x7ff7b80fb810 2024-09-17T00:58:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.240+0000 7ff7bce6d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b810d0d0 con 0x7ff7b80fcf80 2024-09-17T00:58:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.240+0000 7ff7b659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b80fb810 0x7ff7b8113150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.240+0000 7ff7b659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b80fb810 0x7ff7b8113150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59718/0 (socket says 172.21.15.2:59718) 2024-09-17T00:58:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.240+0000 7ff7b659c640 1 -- 172.21.15.2:0/3613686946 learned_addr learned my addr 172.21.15.2:0/3613686946 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.240+0000 7ff7affff640 1 --2- 172.21.15.2:0/3613686946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b80fcf80 0x7ff7b8113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.240+0000 7ff7b659c640 1 -- 172.21.15.2:0/3613686946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b80fcf80 msgr2=0x7ff7b8113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.240+0000 7ff7b659c640 1 --2- 172.21.15.2:0/3613686946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b80fcf80 0x7ff7b8113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.240+0000 7ff7b659c640 1 -- 172.21.15.2:0/3613686946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a0005040 con 0x7ff7b80fb810 2024-09-17T00:58:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.240+0000 7ff7b659c640 1 --2- 172.21.15.2:0/3613686946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b80fb810 0x7ff7b8113150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800c790 tx=0x7ff7a80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.241+0000 7ff7aeffd640 1 -- 172.21.15.2:0/3613686946 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a800a820 con 0x7ff7b80fb810 2024-09-17T00:58:43.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.241+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3613686946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b810d3b0 con 0x7ff7b80fb810 2024-09-17T00:58:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.241+0000 7ff7aeffd640 1 -- 172.21.15.2:0/3613686946 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff7a800ae20 con 0x7ff7b80fb810 2024-09-17T00:58:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.241+0000 7ff7aeffd640 1 -- 172.21.15.2:0/3613686946 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a80113a0 con 0x7ff7b80fb810 2024-09-17T00:58:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.241+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3613686946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b810d920 con 0x7ff7b80fb810 2024-09-17T00:58:43.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.242+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3613686946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b80fcbc0 con 0x7ff7b80fb810 2024-09-17T00:58:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.242+0000 7ff7aeffd640 1 -- 172.21.15.2:0/3613686946 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7ff7a8012400 con 0x7ff7b80fb810 2024-09-17T00:58:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.243+0000 7ff7aeffd640 1 --2- 172.21.15.2:0/3613686946 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff7a406ed60 0x7ff7a4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.243+0000 7ff7aeffd640 1 -- 172.21.15.2:0/3613686946 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff7a808df90 con 0x7ff7b80fb810 2024-09-17T00:58:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.243+0000 7ff7affff640 1 --2- 172.21.15.2:0/3613686946 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff7a406ed60 0x7ff7a4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:43.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.244+0000 7ff7affff640 1 --2- 172.21.15.2:0/3613686946 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff7a406ed60 0x7ff7a4071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8072890 tx=0x7ff7a0035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:43.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.247+0000 7ff7aeffd640 1 -- 172.21.15.2:0/3613686946 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff7a805b470 con 0x7ff7b80fb810 2024-09-17T00:58:43.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.418+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3613686946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff7b804b720 con 0x7ff7b80fb810 2024-09-17T00:58:43.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.418+0000 7ff7aeffd640 1 -- 172.21.15.2:0/3613686946 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7a805ae10 con 0x7ff7b80fb810 2024-09-17T00:58:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:111669149717 2024-09-17T00:58:43.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.420+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3613686946 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff7a406ed60 msgr2=0x7ff7a4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.420+0000 7ff7bce6d640 1 --2- 172.21.15.2:0/3613686946 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff7a406ed60 0x7ff7a4071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8072890 tx=0x7ff7a0035040 comp rx=0 tx=0).stop 2024-09-17T00:58:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.420+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3613686946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b80fb810 msgr2=0x7ff7b8113150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.420+0000 7ff7bce6d640 1 --2- 172.21.15.2:0/3613686946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b80fb810 0x7ff7b8113150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800c790 tx=0x7ff7a80043c0 comp rx=0 tx=0).stop 2024-09-17T00:58:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.420+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3613686946 shutdown_connections 2024-09-17T00:58:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.420+0000 7ff7bce6d640 1 --2- 172.21.15.2:0/3613686946 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff7a406ed60 0x7ff7a4071210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.420+0000 7ff7bce6d640 1 --2- 172.21.15.2:0/3613686946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7b80fcf80 0x7ff7b8113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.420+0000 7ff7bce6d640 1 --2- 172.21.15.2:0/3613686946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7b80fb810 0x7ff7b8113150 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.420+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3613686946 >> 172.21.15.2:0/3613686946 conn(0x7ff7b80723b0 msgr2=0x7ff7b8101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.420+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3613686946 shutdown_connections 2024-09-17T00:58:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:43.420+0000 7ff7bce6d640 1 -- 172.21.15.2:0/3613686946 wait complete. 2024-09-17T00:58:43.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:43 smithi002 ceph-mon[27650]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:43.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:43 smithi099 ceph-mon[34357]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:44.131 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149714 got 111669149717 for osd.3 2024-09-17T00:58:44.131 DEBUG:teuthology.parallel:result is None 2024-09-17T00:58:44.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:44 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3613686946' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T00:58:44.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:44 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3613686946' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T00:58:45.487 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:45.694 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:45 smithi099 ceph-mon[34357]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:45.710 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:45 smithi002 ceph-mon[27650]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:46.630 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:46 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/1505638950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T00:58:46.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:46 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/1505638950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T00:58:47.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.378+0000 7f06aa307640 1 -- 172.21.15.2:0/1445012816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06a4102620 msgr2=0x7f06a41029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:47.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.378+0000 7f06aa307640 1 --2- 172.21.15.2:0/1445012816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06a4102620 0x7f06a41029f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06940048d0 tx=0x7f0694009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:47.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.378+0000 7f06aa307640 1 -- 172.21.15.2:0/1445012816 shutdown_connections 2024-09-17T00:58:47.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.378+0000 7f06aa307640 1 --2- 172.21.15.2:0/1445012816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a40fac80 0x7f06a40fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:47.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.378+0000 7f06aa307640 1 --2- 172.21.15.2:0/1445012816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06a4102620 0x7f06a41029f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:47.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.378+0000 7f06aa307640 1 -- 172.21.15.2:0/1445012816 >> 172.21.15.2:0/1445012816 conn(0x7f06a4070ce0 msgr2=0x7f06a40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:47.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.378+0000 7f06aa307640 1 -- 172.21.15.2:0/1445012816 shutdown_connections 2024-09-17T00:58:47.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.378+0000 7f06aa307640 1 -- 172.21.15.2:0/1445012816 wait complete. 2024-09-17T00:58:47.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.379+0000 7f06aa307640 1 Processor -- start 2024-09-17T00:58:47.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.379+0000 7f06aa307640 1 -- start start 2024-09-17T00:58:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.379+0000 7f06aa307640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a40fac80 0x7f06a41131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.379+0000 7f06aa307640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06a4102620 0x7f06a4113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.379+0000 7f06aa307640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a4113d10 con 0x7f06a4102620 2024-09-17T00:58:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.379+0000 7f06aa307640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a410d150 con 0x7f06a40fac80 2024-09-17T00:58:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.379+0000 7f06a37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06a4102620 0x7f06a4113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.379+0000 7f06a37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06a4102620 0x7f06a4113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59758/0 (socket says 172.21.15.2:59758) 2024-09-17T00:58:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.379+0000 7f06a37fe640 1 -- 172.21.15.2:0/2406029967 learned_addr learned my addr 172.21.15.2:0/2406029967 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.379+0000 7f06a3fff640 1 --2- 172.21.15.2:0/2406029967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a40fac80 0x7f06a41131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.380+0000 7f06a37fe640 1 -- 172.21.15.2:0/2406029967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a40fac80 msgr2=0x7f06a41131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.380+0000 7f06a37fe640 1 --2- 172.21.15.2:0/2406029967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a40fac80 0x7f06a41131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:47.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.380+0000 7f06a37fe640 1 -- 172.21.15.2:0/2406029967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0694005040 con 0x7f06a4102620 2024-09-17T00:58:47.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.380+0000 7f06a37fe640 1 --2- 172.21.15.2:0/2406029967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06a4102620 0x7f06a4113710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0698002a80 tx=0x7f0698004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:47.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.380+0000 7f06a0ff9640 1 -- 172.21.15.2:0/2406029967 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0698007c30 con 0x7f06a4102620 2024-09-17T00:58:47.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.380+0000 7f06a0ff9640 1 -- 172.21.15.2:0/2406029967 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f069800f040 con 0x7f06a4102620 2024-09-17T00:58:47.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.380+0000 7f06aa307640 1 -- 172.21.15.2:0/2406029967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a410d430 con 0x7f06a4102620 2024-09-17T00:58:47.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.380+0000 7f06a0ff9640 1 -- 172.21.15.2:0/2406029967 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f069800dab0 con 0x7f06a4102620 2024-09-17T00:58:47.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.380+0000 7f06aa307640 1 -- 172.21.15.2:0/2406029967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a410d950 con 0x7f06a4102620 2024-09-17T00:58:47.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.381+0000 7f06aa307640 1 -- 172.21.15.2:0/2406029967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a40657b0 con 0x7f06a4102620 2024-09-17T00:58:47.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.382+0000 7f06a0ff9640 1 -- 172.21.15.2:0/2406029967 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f069800dc10 con 0x7f06a4102620 2024-09-17T00:58:47.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.382+0000 7f06a0ff9640 1 --2- 172.21.15.2:0/2406029967 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f068c06ed60 0x7f068c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:47.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.382+0000 7f06a0ff9640 1 -- 172.21.15.2:0/2406029967 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f069808d5f0 con 0x7f06a4102620 2024-09-17T00:58:47.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.382+0000 7f06a3fff640 1 --2- 172.21.15.2:0/2406029967 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f068c06ed60 0x7f068c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:47.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.383+0000 7f06a3fff640 1 --2- 172.21.15.2:0/2406029967 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f068c06ed60 0x7f068c071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0694009ac0 tx=0x7f0694035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:47.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.387+0000 7f06a0ff9640 1 -- 172.21.15.2:0/2406029967 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f069805ab80 con 0x7f06a4102620 2024-09-17T00:58:47.479 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:47 smithi002 ceph-mon[27650]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:47.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.555+0000 7f06aa307640 1 -- 172.21.15.2:0/2406029967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f06a41095a0 con 0x7f06a4102620 2024-09-17T00:58:47.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.555+0000 7f06a0ff9640 1 -- 172.21.15.2:0/2406029967 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f069805a520 con 0x7f06a4102620 2024-09-17T00:58:47.552 INFO:teuthology.orchestra.run.smithi002.stdout:38654705703 2024-09-17T00:58:47.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.557+0000 7f06aa307640 1 -- 172.21.15.2:0/2406029967 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f068c06ed60 msgr2=0x7f068c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:47.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.557+0000 7f06aa307640 1 --2- 172.21.15.2:0/2406029967 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f068c06ed60 0x7f068c071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0694009ac0 tx=0x7f0694035040 comp rx=0 tx=0).stop 2024-09-17T00:58:47.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.557+0000 7f06aa307640 1 -- 172.21.15.2:0/2406029967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06a4102620 msgr2=0x7f06a4113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:47.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.557+0000 7f06aa307640 1 --2- 172.21.15.2:0/2406029967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06a4102620 0x7f06a4113710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0698002a80 tx=0x7f0698004600 comp rx=0 tx=0).stop 2024-09-17T00:58:47.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.557+0000 7f06aa307640 1 -- 172.21.15.2:0/2406029967 shutdown_connections 2024-09-17T00:58:47.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.557+0000 7f06aa307640 1 --2- 172.21.15.2:0/2406029967 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f068c06ed60 0x7f068c071210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:47.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.557+0000 7f06aa307640 1 --2- 172.21.15.2:0/2406029967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06a4102620 0x7f06a4113710 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:47.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.557+0000 7f06aa307640 1 --2- 172.21.15.2:0/2406029967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06a40fac80 0x7f06a41131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:47.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.557+0000 7f06aa307640 1 -- 172.21.15.2:0/2406029967 >> 172.21.15.2:0/2406029967 conn(0x7f06a4070ce0 msgr2=0x7f06a4105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:47.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.557+0000 7f06aa307640 1 -- 172.21.15.2:0/2406029967 shutdown_connections 2024-09-17T00:58:47.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.557+0000 7f06aa307640 1 -- 172.21.15.2:0/2406029967 wait complete. 2024-09-17T00:58:47.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:47 smithi099 ceph-mon[34357]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:47.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.977+0000 7f71c7551640 1 -- 172.21.15.2:0/909978699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c00fd590 msgr2=0x7f71c00fd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:47.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.977+0000 7f71c7551640 1 --2- 172.21.15.2:0/909978699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c00fd590 0x7f71c00fd960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f71bc004900 tx=0x7f71bc009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:47.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.977+0000 7f71c7551640 1 -- 172.21.15.2:0/909978699 shutdown_connections 2024-09-17T00:58:47.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.977+0000 7f71c7551640 1 --2- 172.21.15.2:0/909978699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c00fdf30 0x7f71c0106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:47.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.977+0000 7f71c7551640 1 --2- 172.21.15.2:0/909978699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c00fd590 0x7f71c00fd960 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:47.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.977+0000 7f71c7551640 1 -- 172.21.15.2:0/909978699 >> 172.21.15.2:0/909978699 conn(0x7f71c00f7090 msgr2=0x7f71c00f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:47.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.977+0000 7f71c7551640 1 -- 172.21.15.2:0/909978699 shutdown_connections 2024-09-17T00:58:47.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.977+0000 7f71c7551640 1 -- 172.21.15.2:0/909978699 wait complete. 2024-09-17T00:58:47.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.978+0000 7f71c7551640 1 Processor -- start 2024-09-17T00:58:47.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.978+0000 7f71c7551640 1 -- start start 2024-09-17T00:58:47.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.978+0000 7f71c7551640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c00fd590 0x7f71c00fb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:47.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.978+0000 7f71c7551640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c00fdf30 0x7f71c00fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:47.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.978+0000 7f71c7551640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c00fbed0 con 0x7f71c00fd590 2024-09-17T00:58:47.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.978+0000 7f71c7551640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c00fc040 con 0x7f71c00fdf30 2024-09-17T00:58:47.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.978+0000 7f71c52ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c00fd590 0x7f71c00fb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:47.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.978+0000 7f71c52ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c00fd590 0x7f71c00fb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59782/0 (socket says 172.21.15.2:59782) 2024-09-17T00:58:47.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.978+0000 7f71c52ed640 1 -- 172.21.15.2:0/1105696878 learned_addr learned my addr 172.21.15.2:0/1105696878 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:47.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.978+0000 7f71c4aec640 1 --2- 172.21.15.2:0/1105696878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c00fdf30 0x7f71c00fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:47.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.978+0000 7f71c52ed640 1 -- 172.21.15.2:0/1105696878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c00fdf30 msgr2=0x7f71c00fb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:47.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.978+0000 7f71c52ed640 1 --2- 172.21.15.2:0/1105696878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c00fdf30 0x7f71c00fb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:47.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.978+0000 7f71c52ed640 1 -- 172.21.15.2:0/1105696878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc005040 con 0x7f71c00fd590 2024-09-17T00:58:47.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.979+0000 7f71c52ed640 1 --2- 172.21.15.2:0/1105696878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c00fd590 0x7f71c00fb450 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f71bc004960 tx=0x7f71bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:47.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.979+0000 7f71b5ffb640 1 -- 172.21.15.2:0/1105696878 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71bc038070 con 0x7f71c00fd590 2024-09-17T00:58:47.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.979+0000 7f71b5ffb640 1 -- 172.21.15.2:0/1105696878 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f71bc008ed0 con 0x7f71c00fd590 2024-09-17T00:58:47.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.979+0000 7f71c7551640 1 -- 172.21.15.2:0/1105696878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c00fc270 con 0x7f71c00fd590 2024-09-17T00:58:47.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.979+0000 7f71b5ffb640 1 -- 172.21.15.2:0/1105696878 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71bc0095a0 con 0x7f71c00fd590 2024-09-17T00:58:47.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.979+0000 7f71c7551640 1 -- 172.21.15.2:0/1105696878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c01198f0 con 0x7f71c00fd590 2024-09-17T00:58:47.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.980+0000 7f71c7551640 1 -- 172.21.15.2:0/1105696878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c00662d0 con 0x7f71c00fd590 2024-09-17T00:58:47.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.981+0000 7f71b5ffb640 1 -- 172.21.15.2:0/1105696878 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f71bc030020 con 0x7f71c00fd590 2024-09-17T00:58:47.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.981+0000 7f71b5ffb640 1 --2- 172.21.15.2:0/1105696878 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f71ac06ed60 0x7f71ac071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:47.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.981+0000 7f71b5ffb640 1 -- 172.21.15.2:0/1105696878 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f71bc0adce0 con 0x7f71c00fd590 2024-09-17T00:58:47.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.981+0000 7f71c4aec640 1 --2- 172.21.15.2:0/1105696878 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f71ac06ed60 0x7f71ac071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:47.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.982+0000 7f71c4aec640 1 --2- 172.21.15.2:0/1105696878 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f71ac06ed60 0x7f71ac071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f71c00fcd90 tx=0x7f71b0009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:47.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:47.985+0000 7f71b5ffb640 1 -- 172.21.15.2:0/1105696878 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f71bc07b1c0 con 0x7f71c00fd590 2024-09-17T00:58:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.175+0000 7fe4ee440640 1 -- 172.21.15.2:0/3022100136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4e80fac80 msgr2=0x7fe4e80fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.175+0000 7fe4ee440640 1 --2- 172.21.15.2:0/3022100136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4e80fac80 0x7fe4e80fb0f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00048d0 tx=0x7fe4d0009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.175+0000 7fe4ee440640 1 -- 172.21.15.2:0/3022100136 shutdown_connections 2024-09-17T00:58:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.175+0000 7fe4ee440640 1 --2- 172.21.15.2:0/3022100136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4e80fac80 0x7fe4e80fb0f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.175+0000 7fe4ee440640 1 --2- 172.21.15.2:0/3022100136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4e8102620 0x7fe4e81029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.175+0000 7fe4ee440640 1 -- 172.21.15.2:0/3022100136 >> 172.21.15.2:0/3022100136 conn(0x7fe4e8070ce0 msgr2=0x7fe4e80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.175+0000 7fe4ee440640 1 -- 172.21.15.2:0/3022100136 shutdown_connections 2024-09-17T00:58:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.175+0000 7fe4ee440640 1 -- 172.21.15.2:0/3022100136 wait complete. 2024-09-17T00:58:48.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.176+0000 7fe4ee440640 1 Processor -- start 2024-09-17T00:58:48.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.176+0000 7fe4ee440640 1 -- start start 2024-09-17T00:58:48.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.176+0000 7fe4ee440640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4e80fac80 0x7fe4e8113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:48.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.176+0000 7fe4ee440640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4e8102620 0x7fe4e81136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:48.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.176+0000 7fe4ee440640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e8113cd0 con 0x7fe4e80fac80 2024-09-17T00:58:48.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.176+0000 7fe4ee440640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e810d110 con 0x7fe4e8102620 2024-09-17T00:58:48.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.176+0000 7fe4e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4e80fac80 0x7fe4e8113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:48.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.176+0000 7fe4e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4e80fac80 0x7fe4e8113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59742/0 (socket says 172.21.15.2:59742) 2024-09-17T00:58:48.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.176+0000 7fe4e7fff640 1 -- 172.21.15.2:0/1505638950 learned_addr learned my addr 172.21.15.2:0/1505638950 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:48.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.176+0000 7fe4dffff640 1 --2- 172.21.15.2:0/1505638950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4e8102620 0x7fe4e81136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:48.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.176+0000 7fe4e7fff640 1 -- 172.21.15.2:0/1505638950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4e8102620 msgr2=0x7fe4e81136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:48.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.177+0000 7fe4e7fff640 1 --2- 172.21.15.2:0/1505638950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4e8102620 0x7fe4e81136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:48.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.177+0000 7fe4e7fff640 1 -- 172.21.15.2:0/1505638950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d0005040 con 0x7fe4e80fac80 2024-09-17T00:58:48.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.177+0000 7fe4e7fff640 1 --2- 172.21.15.2:0/1505638950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4e80fac80 0x7fe4e8113190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8002a80 tx=0x7fe4d8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.177+0000 7fe4e57fa640 1 -- 172.21.15.2:0/1505638950 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4d8007c30 con 0x7fe4e80fac80 2024-09-17T00:58:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.177+0000 7fe4ee440640 1 -- 172.21.15.2:0/1505638950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e810d3f0 con 0x7fe4e80fac80 2024-09-17T00:58:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.177+0000 7fe4e57fa640 1 -- 172.21.15.2:0/1505638950 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe4d800f040 con 0x7fe4e80fac80 2024-09-17T00:58:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.177+0000 7fe4e57fa640 1 -- 172.21.15.2:0/1505638950 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4d800dad0 con 0x7fe4e80fac80 2024-09-17T00:58:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.177+0000 7fe4ee440640 1 -- 172.21.15.2:0/1505638950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e810d960 con 0x7fe4e80fac80 2024-09-17T00:58:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.178+0000 7fe4ee440640 1 -- 172.21.15.2:0/1505638950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e8065790 con 0x7fe4e80fac80 2024-09-17T00:58:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.179+0000 7fe4e57fa640 1 -- 172.21.15.2:0/1505638950 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fe4d800dc30 con 0x7fe4e80fac80 2024-09-17T00:58:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.179+0000 7fe4e57fa640 1 --2- 172.21.15.2:0/1505638950 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fe4d406ed60 0x7fe4d4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.179+0000 7fe4dffff640 1 --2- 172.21.15.2:0/1505638950 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fe4d406ed60 0x7fe4d4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:48.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.179+0000 7fe4e57fa640 1 -- 172.21.15.2:0/1505638950 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe4d808dc90 con 0x7fe4e80fac80 2024-09-17T00:58:48.105 INFO:teuthology.orchestra.run.smithi002.stdout:81604378651 2024-09-17T00:58:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.180+0000 7fe4dffff640 1 --2- 172.21.15.2:0/1505638950 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fe4d406ed60 0x7fe4d4071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009ac0 tx=0x7fe4d0035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.183+0000 7fe4e57fa640 1 -- 172.21.15.2:0/1505638950 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe4d805b0f0 con 0x7fe4e80fac80 2024-09-17T00:58:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.353+0000 7fe4ee440640 1 -- 172.21.15.2:0/1505638950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe4e804b720 con 0x7fe4e80fac80 2024-09-17T00:58:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.353+0000 7fe4e57fa640 1 -- 172.21.15.2:0/1505638950 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe4d805aa90 con 0x7fe4e80fac80 2024-09-17T00:58:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.355+0000 7fe4ee440640 1 -- 172.21.15.2:0/1505638950 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fe4d406ed60 msgr2=0x7fe4d4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.355+0000 7fe4ee440640 1 --2- 172.21.15.2:0/1505638950 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fe4d406ed60 0x7fe4d4071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009ac0 tx=0x7fe4d0035040 comp rx=0 tx=0).stop 2024-09-17T00:58:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.355+0000 7fe4ee440640 1 -- 172.21.15.2:0/1505638950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4e80fac80 msgr2=0x7fe4e8113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.355+0000 7fe4ee440640 1 --2- 172.21.15.2:0/1505638950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4e80fac80 0x7fe4e8113190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8002a80 tx=0x7fe4d8004570 comp rx=0 tx=0).stop 2024-09-17T00:58:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.355+0000 7fe4ee440640 1 -- 172.21.15.2:0/1505638950 shutdown_connections 2024-09-17T00:58:48.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.355+0000 7fe4ee440640 1 --2- 172.21.15.2:0/1505638950 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fe4d406ed60 0x7fe4d4071210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:48.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.355+0000 7fe4ee440640 1 --2- 172.21.15.2:0/1505638950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4e8102620 0x7fe4e81136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:48.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.355+0000 7fe4ee440640 1 --2- 172.21.15.2:0/1505638950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4e80fac80 0x7fe4e8113190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:48.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.355+0000 7fe4ee440640 1 -- 172.21.15.2:0/1505638950 >> 172.21.15.2:0/1505638950 conn(0x7fe4e8070ce0 msgr2=0x7fe4e80f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:48.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.355+0000 7fe4ee440640 1 -- 172.21.15.2:0/1505638950 shutdown_connections 2024-09-17T00:58:48.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:46.355+0000 7fe4ee440640 1 -- 172.21.15.2:0/1505638950 wait complete. 2024-09-17T00:58:48.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:48.162+0000 7f71c7551640 1 -- 172.21.15.2:0/1105696878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f71c00fac90 con 0x7f71c00fd590 2024-09-17T00:58:48.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:48.162+0000 7f71b5ffb640 1 -- 172.21.15.2:0/1105696878 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f71bc07ab60 con 0x7f71c00fd590 2024-09-17T00:58:48.159 INFO:teuthology.orchestra.run.smithi002.stdout:60129542177 2024-09-17T00:58:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:48.164+0000 7f71c7551640 1 -- 172.21.15.2:0/1105696878 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f71ac06ed60 msgr2=0x7f71ac071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:48.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:48.164+0000 7f71c7551640 1 --2- 172.21.15.2:0/1105696878 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f71ac06ed60 0x7f71ac071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f71c00fcd90 tx=0x7f71b0009040 comp rx=0 tx=0).stop 2024-09-17T00:58:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:48.164+0000 7f71c7551640 1 -- 172.21.15.2:0/1105696878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c00fd590 msgr2=0x7f71c00fb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:48.164+0000 7f71c7551640 1 --2- 172.21.15.2:0/1105696878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c00fd590 0x7f71c00fb450 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f71bc004960 tx=0x7f71bc009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:48.164+0000 7f71c7551640 1 -- 172.21.15.2:0/1105696878 shutdown_connections 2024-09-17T00:58:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:48.164+0000 7f71c7551640 1 --2- 172.21.15.2:0/1105696878 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f71ac06ed60 0x7f71ac071210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:48.164+0000 7f71c7551640 1 --2- 172.21.15.2:0/1105696878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71c00fdf30 0x7f71c00fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:48.164+0000 7f71c7551640 1 --2- 172.21.15.2:0/1105696878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71c00fd590 0x7f71c00fb450 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:48.164+0000 7f71c7551640 1 -- 172.21.15.2:0/1105696878 >> 172.21.15.2:0/1105696878 conn(0x7f71c00f7090 msgr2=0x7f71c00f8620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:48.164+0000 7f71c7551640 1 -- 172.21.15.2:0/1105696878 shutdown_connections 2024-09-17T00:58:48.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:48.164+0000 7f71c7551640 1 -- 172.21.15.2:0/1105696878 wait complete. 2024-09-17T00:58:48.732 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:48 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2406029967' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T00:58:48.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:48 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/1105696878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T00:58:48.762 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378649 got 81604378651 for osd.2 2024-09-17T00:58:48.762 DEBUG:teuthology.parallel:result is None 2024-09-17T00:58:48.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:48 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/2406029967' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T00:58:48.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:48 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/1105696878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T00:58:49.722 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:49 smithi002 ceph-mon[27650]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:49.750 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705701 got 38654705703 for osd.0 2024-09-17T00:58:49.751 DEBUG:teuthology.parallel:result is None 2024-09-17T00:58:49.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:49 smithi099 ceph-mon[34357]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:50.449 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542176 got 60129542177 for osd.1 2024-09-17T00:58:50.449 DEBUG:teuthology.parallel:result is None 2024-09-17T00:58:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.948+0000 7f5ee394b640 1 -- 172.21.15.2:0/689347311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5edc102580 msgr2=0x7f5edc102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.948+0000 7f5ee394b640 1 --2- 172.21.15.2:0/689347311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5edc102580 0x7f5edc102950 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009c50 tx=0x7f5ed8004d10 comp rx=0 tx=0).stop 2024-09-17T00:58:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.948+0000 7f5ee394b640 1 -- 172.21.15.2:0/689347311 shutdown_connections 2024-09-17T00:58:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.948+0000 7f5ee394b640 1 --2- 172.21.15.2:0/689347311 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5edc102f20 0x7f5edc0fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.948+0000 7f5ee394b640 1 --2- 172.21.15.2:0/689347311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5edc102580 0x7f5edc102950 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.948+0000 7f5ee394b640 1 -- 172.21.15.2:0/689347311 >> 172.21.15.2:0/689347311 conn(0x7f5edc0f81a0 msgr2=0x7f5edc0fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.949+0000 7f5ee394b640 1 -- 172.21.15.2:0/689347311 shutdown_connections 2024-09-17T00:58:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.949+0000 7f5ee394b640 1 -- 172.21.15.2:0/689347311 wait complete. 2024-09-17T00:58:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.949+0000 7f5ee394b640 1 Processor -- start 2024-09-17T00:58:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.949+0000 7f5ee394b640 1 -- start start 2024-09-17T00:58:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.949+0000 7f5ee394b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5edc102580 0x7f5edc1131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.949+0000 7f5ee394b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5edc102f20 0x7f5edc113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.949+0000 7f5ee394b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc113d10 con 0x7f5edc102f20 2024-09-17T00:58:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.949+0000 7f5ee394b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc10d150 con 0x7f5edc102580 2024-09-17T00:58:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.949+0000 7f5ee0ee6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5edc102f20 0x7f5edc113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.949+0000 7f5ee0ee6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5edc102f20 0x7f5edc113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49364/0 (socket says 172.21.15.2:49364) 2024-09-17T00:58:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.949+0000 7f5ee0ee6640 1 -- 172.21.15.2:0/649343286 learned_addr learned my addr 172.21.15.2:0/649343286 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.950+0000 7f5ee16e7640 1 --2- 172.21.15.2:0/649343286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5edc102580 0x7f5edc1131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.950+0000 7f5ee0ee6640 1 -- 172.21.15.2:0/649343286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5edc102580 msgr2=0x7f5edc1131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.950+0000 7f5ee0ee6640 1 --2- 172.21.15.2:0/649343286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5edc102580 0x7f5edc1131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.950+0000 7f5ee0ee6640 1 -- 172.21.15.2:0/649343286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed80098b0 con 0x7f5edc102f20 2024-09-17T00:58:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.950+0000 7f5ee0ee6640 1 --2- 172.21.15.2:0/649343286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5edc102f20 0x7f5edc113710 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009af0 tx=0x7f5ecc004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.950+0000 7f5ed1ffb640 1 -- 172.21.15.2:0/649343286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ecc007c30 con 0x7f5edc102f20 2024-09-17T00:58:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.950+0000 7f5ed1ffb640 1 -- 172.21.15.2:0/649343286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5ecc00f040 con 0x7f5edc102f20 2024-09-17T00:58:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.950+0000 7f5ee394b640 1 -- 172.21.15.2:0/649343286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc10d430 con 0x7f5edc102f20 2024-09-17T00:58:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.950+0000 7f5ed1ffb640 1 -- 172.21.15.2:0/649343286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ecc0094b0 con 0x7f5edc102f20 2024-09-17T00:58:50.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.950+0000 7f5ee394b640 1 -- 172.21.15.2:0/649343286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc10d9d0 con 0x7f5edc102f20 2024-09-17T00:58:50.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.951+0000 7f5ee394b640 1 -- 172.21.15.2:0/649343286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5edc0fdd00 con 0x7f5edc102f20 2024-09-17T00:58:50.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.952+0000 7f5ed1ffb640 1 -- 172.21.15.2:0/649343286 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f5ecc009730 con 0x7f5edc102f20 2024-09-17T00:58:50.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.952+0000 7f5ed1ffb640 1 --2- 172.21.15.2:0/649343286 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f5ec806ed60 0x7f5ec8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:50.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.952+0000 7f5ed1ffb640 1 -- 172.21.15.2:0/649343286 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5ecc08ddb0 con 0x7f5edc102f20 2024-09-17T00:58:50.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.952+0000 7f5ee16e7640 1 --2- 172.21.15.2:0/649343286 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f5ec806ed60 0x7f5ec8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:50.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.953+0000 7f5ee16e7640 1 --2- 172.21.15.2:0/649343286 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f5ec806ed60 0x7f5ec8071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009c20 tx=0x7f5ed8004d10 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:50.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:50.956+0000 7f5ed1ffb640 1 -- 172.21.15.2:0/649343286 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5ecc05b210 con 0x7f5edc102f20 2024-09-17T00:58:51.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:51.122+0000 7f5ee394b640 1 -- 172.21.15.2:0/649343286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5edc0fbda0 con 0x7f5edc102f20 2024-09-17T00:58:51.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:51.123+0000 7f5ed1ffb640 1 -- 172.21.15.2:0/649343286 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ecc05abb0 con 0x7f5edc102f20 2024-09-17T00:58:51.120 INFO:teuthology.orchestra.run.smithi002.stdout:158913789964 2024-09-17T00:58:51.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:51.125+0000 7f5ee394b640 1 -- 172.21.15.2:0/649343286 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f5ec806ed60 msgr2=0x7f5ec8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:51.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:51.125+0000 7f5ee394b640 1 --2- 172.21.15.2:0/649343286 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f5ec806ed60 0x7f5ec8071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009c20 tx=0x7f5ed8004d10 comp rx=0 tx=0).stop 2024-09-17T00:58:51.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:51.125+0000 7f5ee394b640 1 -- 172.21.15.2:0/649343286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5edc102f20 msgr2=0x7f5edc113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:51.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:51.125+0000 7f5ee394b640 1 --2- 172.21.15.2:0/649343286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5edc102f20 0x7f5edc113710 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009af0 tx=0x7f5ecc004570 comp rx=0 tx=0).stop 2024-09-17T00:58:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:51.125+0000 7f5ee394b640 1 -- 172.21.15.2:0/649343286 shutdown_connections 2024-09-17T00:58:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:51.125+0000 7f5ee394b640 1 --2- 172.21.15.2:0/649343286 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f5ec806ed60 0x7f5ec8071210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:51.125+0000 7f5ee394b640 1 --2- 172.21.15.2:0/649343286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5edc102f20 0x7f5edc113710 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:51.125+0000 7f5ee394b640 1 --2- 172.21.15.2:0/649343286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5edc102580 0x7f5edc1131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:51.125+0000 7f5ee394b640 1 -- 172.21.15.2:0/649343286 >> 172.21.15.2:0/649343286 conn(0x7f5edc0f81a0 msgr2=0x7f5edc0f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:51.125+0000 7f5ee394b640 1 -- 172.21.15.2:0/649343286 shutdown_connections 2024-09-17T00:58:51.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:51.125+0000 7f5ee394b640 1 -- 172.21.15.2:0/649343286 wait complete. 2024-09-17T00:58:51.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:51 smithi002 ceph-mon[27650]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:51.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:51 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/649343286' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T00:58:51.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:58:51.760 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789961 got 158913789964 for osd.5 2024-09-17T00:58:51.761 DEBUG:teuthology.parallel:result is None 2024-09-17T00:58:51.761 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-17T00:58:51.761 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T00:58:51.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:51 smithi099 ceph-mon[34357]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:51.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:51 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/649343286' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T00:58:51.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:51 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:58:52.017 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:53.505 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:53 smithi002 ceph-mon[27650]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:53.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.728+0000 7f78a9d01640 1 -- 172.21.15.2:0/2292555349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a4102620 msgr2=0x7f78a41029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:53.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.728+0000 7f78a9d01640 1 --2- 172.21.15.2:0/2292555349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a4102620 0x7f78a41029f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f78940048d0 tx=0x7f7894009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:53.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.728+0000 7f78a9d01640 1 -- 172.21.15.2:0/2292555349 shutdown_connections 2024-09-17T00:58:53.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.728+0000 7f78a9d01640 1 --2- 172.21.15.2:0/2292555349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a40fac80 0x7f78a40fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:53.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.728+0000 7f78a9d01640 1 --2- 172.21.15.2:0/2292555349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a4102620 0x7f78a41029f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:53.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.728+0000 7f78a9d01640 1 -- 172.21.15.2:0/2292555349 >> 172.21.15.2:0/2292555349 conn(0x7f78a4070ce0 msgr2=0x7f78a40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:53.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.728+0000 7f78a9d01640 1 -- 172.21.15.2:0/2292555349 shutdown_connections 2024-09-17T00:58:53.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.728+0000 7f78a9d01640 1 -- 172.21.15.2:0/2292555349 wait complete. 2024-09-17T00:58:53.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.728+0000 7f78a9d01640 1 Processor -- start 2024-09-17T00:58:53.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f78a9d01640 1 -- start start 2024-09-17T00:58:53.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f78a9d01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a40fac80 0x7f78a41131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:53.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f78a9d01640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a4102620 0x7f78a4113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:53.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f78a9d01640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4113d00 con 0x7f78a40fac80 2024-09-17T00:58:53.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f78a9d01640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a410d140 con 0x7f78a4102620 2024-09-17T00:58:53.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f78a37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a40fac80 0x7f78a41131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:53.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f78a37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a40fac80 0x7f78a41131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49378/0 (socket says 172.21.15.2:49378) 2024-09-17T00:58:53.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f78a37fe640 1 -- 172.21.15.2:0/3859053914 learned_addr learned my addr 172.21.15.2:0/3859053914 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:53.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f78a37fe640 1 -- 172.21.15.2:0/3859053914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a4102620 msgr2=0x7f78a4113700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:53.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f78a37fe640 1 --2- 172.21.15.2:0/3859053914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a4102620 0x7f78a4113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:53.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f78a37fe640 1 -- 172.21.15.2:0/3859053914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7894005040 con 0x7f78a40fac80 2024-09-17T00:58:53.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f78a37fe640 1 --2- 172.21.15.2:0/3859053914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a40fac80 0x7f78a41131c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7894003080 tx=0x7f7894009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:53.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f788bfff640 1 -- 172.21.15.2:0/3859053914 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7894038070 con 0x7f78a40fac80 2024-09-17T00:58:53.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f788bfff640 1 -- 172.21.15.2:0/3859053914 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f78940097e0 con 0x7f78a40fac80 2024-09-17T00:58:53.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f78a9d01640 1 -- 172.21.15.2:0/3859053914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a410d3c0 con 0x7f78a40fac80 2024-09-17T00:58:53.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f788bfff640 1 -- 172.21.15.2:0/3859053914 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f789403d420 con 0x7f78a40fac80 2024-09-17T00:58:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.729+0000 7f78a9d01640 1 -- 172.21.15.2:0/3859053914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a410d900 con 0x7f78a40fac80 2024-09-17T00:58:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.730+0000 7f78a9d01640 1 -- 172.21.15.2:0/3859053914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a40657b0 con 0x7f78a40fac80 2024-09-17T00:58:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.731+0000 7f788bfff640 1 -- 172.21.15.2:0/3859053914 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f7894030020 con 0x7f78a40fac80 2024-09-17T00:58:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.731+0000 7f788bfff640 1 --2- 172.21.15.2:0/3859053914 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f788c06ed60 0x7f788c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.731+0000 7f788bfff640 1 -- 172.21.15.2:0/3859053914 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f78940ae370 con 0x7f78a40fac80 2024-09-17T00:58:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.731+0000 7f78a2ffd640 1 --2- 172.21.15.2:0/3859053914 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f788c06ed60 0x7f788c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:53.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.732+0000 7f78a2ffd640 1 --2- 172.21.15.2:0/3859053914 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f788c06ed60 0x7f788c071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f78a410ea80 tx=0x7f7898007cb0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:53.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.736+0000 7f788bfff640 1 -- 172.21.15.2:0/3859053914 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f789407b850 con 0x7f78a40fac80 2024-09-17T00:58:53.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:53 smithi099 ceph-mon[34357]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:53.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.896+0000 7f78a9d01640 1 -- 172.21.15.2:0/3859053914 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78a4109590 con 0x7f788c06ed60 2024-09-17T00:58:53.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.897+0000 7f788bfff640 1 -- 172.21.15.2:0/3859053914 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27914 (secure 0 0 0) 0x7f78a4109590 con 0x7f788c06ed60 2024-09-17T00:58:53.894 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:58:53.895 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-17T00:58:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.899+0000 7f78a9d01640 1 -- 172.21.15.2:0/3859053914 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f788c06ed60 msgr2=0x7f788c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.899+0000 7f78a9d01640 1 --2- 172.21.15.2:0/3859053914 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f788c06ed60 0x7f788c071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f78a410ea80 tx=0x7f7898007cb0 comp rx=0 tx=0).stop 2024-09-17T00:58:53.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.899+0000 7f78a9d01640 1 -- 172.21.15.2:0/3859053914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a40fac80 msgr2=0x7f78a41131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.899+0000 7f78a9d01640 1 --2- 172.21.15.2:0/3859053914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a40fac80 0x7f78a41131c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7894003080 tx=0x7f7894009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.899+0000 7f78a9d01640 1 -- 172.21.15.2:0/3859053914 shutdown_connections 2024-09-17T00:58:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.899+0000 7f78a9d01640 1 --2- 172.21.15.2:0/3859053914 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f788c06ed60 0x7f788c071210 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.899+0000 7f78a9d01640 1 --2- 172.21.15.2:0/3859053914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78a4102620 0x7f78a4113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.899+0000 7f78a9d01640 1 --2- 172.21.15.2:0/3859053914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78a40fac80 0x7f78a41131c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.899+0000 7f78a9d01640 1 -- 172.21.15.2:0/3859053914 >> 172.21.15.2:0/3859053914 conn(0x7f78a4070ce0 msgr2=0x7f78a4105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.899+0000 7f78a9d01640 1 -- 172.21.15.2:0/3859053914 shutdown_connections 2024-09-17T00:58:53.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:53.899+0000 7f78a9d01640 1 -- 172.21.15.2:0/3859053914 wait complete. 2024-09-17T00:58:54.617 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-17T00:58:52.290784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787936,"kb_used_data":3780,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682976,"statfs":{"total":575970213888,"available":574139367424,"internally_reserved":0,"allocated":3870720,"data_stored":2558100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002132"},"pg_stats":[{"pgid":"1.0","version":"23'72","reported_seq":130,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T00:58:01.087918+0000","last_change":"2024-09-17T00:57:34.372407+0000","last_active":"2024-09-17T00:58:01.087918+0000","last_peered":"2024-09-17T00:58:01.087918+0000","last_clean":"2024-09-17T00:58:01.087918+0000","last_became_active":"2024-09-17T00:57:34.372126+0000","last_became_peered":"2024-09-17T00:57:34.372126+0000","last_unstale":"2024-09-17T00:58:01.087918+0000","last_undegraded":"2024-09-17T00:58:01.087918+0000","last_fullsized":"2024-09-17T00:58:01.087918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T00:56:44.817411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T00:56:44.817411+0000","last_clean_scrub_stamp":"2024-09-17T00:56:44.817411+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:13:19.534756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]}]},{"osd":4,"up_from":32,"seq":137438953490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447452,"statfs":{"total":95995035648,"available":95690190848,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:58:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.495}]},{"osd":1,"last update":"Tue Sep 17 00:58:38 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.54100000000000004}]},{"osd":2,"last update":"Tue Sep 17 00:58:38 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Sep 17 00:58:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.31}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.35199999999999998}]},{"osd":1,"last update":"Tue Sep 17 00:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.41099999999999998}]},{"osd":2,"last update":"Tue Sep 17 00:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.42399999999999999}]},{"osd":4,"last update":"Tue Sep 17 00:58:35 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447452,"statfs":{"total":95995035648,"available":95690190848,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:58:48 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.35299999999999998,"15min":0.35699999999999998},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48499999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.372,"15min":0.378},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.247}]},{"osd":1,"last update":"Tue Sep 17 00:58:48 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.377,"15min":0.38300000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.48699999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.27500000000000002}]},{"osd":3,"last update":"Tue Sep 17 00:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.5}]},{"osd":4,"last update":"Tue Sep 17 00:58:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:58:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35299999999999998,"15min":0.35399999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.48799999999999999,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35499999999999998,"15min":0.35399999999999998},"min":{"1min":0.23499999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.498,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.45900000000000002}]},{"osd":2,"last update":"Tue Sep 17 00:58:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.53600000000000003,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.55300000000000005,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.47699999999999998}]},{"osd":3,"last update":"Tue Sep 17 00:58:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.59099999999999997}]},{"osd":4,"last update":"Tue Sep 17 00:58:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 00:58:24 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.315,"15min":0.309},"min":{"1min":0.249,"5min":0.185,"15min":0.185},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.377},{"interface":"front","average":{"1min":0.378,"5min":0.318,"15min":0.308},"min":{"1min":0.23599999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.39800000000000002}]},{"osd":2,"last update":"Tue Sep 17 00:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.41999999999999998}]},{"osd":3,"last update":"Tue Sep 17 00:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.877},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.84599999999999997}]},{"osd":4,"last update":"Tue Sep 17 00:58:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T00:58:54.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T00:58:54.874 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:55.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:55 smithi002 ceph-mon[27650]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T00:58:55.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:55 smithi002 ceph-mon[27650]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:55.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:55 smithi099 ceph-mon[34357]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T00:58:55.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:55 smithi099 ceph-mon[34357]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:56.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.501+0000 7f2cb9770640 1 -- 172.21.15.2:0/3120271848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb4102f20 msgr2=0x7f2cb40fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:56.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.501+0000 7f2cb9770640 1 --2- 172.21.15.2:0/3120271848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb4102f20 0x7f2cb40fc5e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80048d0 tx=0x7f2ca8009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:56.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.501+0000 7f2cb9770640 1 -- 172.21.15.2:0/3120271848 shutdown_connections 2024-09-17T00:58:56.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.501+0000 7f2cb9770640 1 --2- 172.21.15.2:0/3120271848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb4102f20 0x7f2cb40fc5e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.501+0000 7f2cb9770640 1 --2- 172.21.15.2:0/3120271848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb4102580 0x7f2cb4102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.501+0000 7f2cb9770640 1 -- 172.21.15.2:0/3120271848 >> 172.21.15.2:0/3120271848 conn(0x7f2cb40f81a0 msgr2=0x7f2cb40fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.501+0000 7f2cb9770640 1 -- 172.21.15.2:0/3120271848 shutdown_connections 2024-09-17T00:58:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.501+0000 7f2cb9770640 1 -- 172.21.15.2:0/3120271848 wait complete. 2024-09-17T00:58:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.502+0000 7f2cb9770640 1 Processor -- start 2024-09-17T00:58:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.502+0000 7f2cb9770640 1 -- start start 2024-09-17T00:58:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.502+0000 7f2cb9770640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb4102580 0x7f2cb406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.502+0000 7f2cb9770640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb4102f20 0x7f2cb406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.502+0000 7f2cb9770640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4070520 con 0x7f2cb4102f20 2024-09-17T00:58:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.502+0000 7f2cb9770640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4070690 con 0x7f2cb4102580 2024-09-17T00:58:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.502+0000 7f2cb27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb4102f20 0x7f2cb406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.502+0000 7f2cb27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb4102f20 0x7f2cb406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49410/0 (socket says 172.21.15.2:49410) 2024-09-17T00:58:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.503+0000 7f2cb27fc640 1 -- 172.21.15.2:0/1621123580 learned_addr learned my addr 172.21.15.2:0/1621123580 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.503+0000 7f2cb2ffd640 1 --2- 172.21.15.2:0/1621123580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb4102580 0x7f2cb406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.503+0000 7f2cb27fc640 1 -- 172.21.15.2:0/1621123580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb4102580 msgr2=0x7f2cb406fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.503+0000 7f2cb27fc640 1 --2- 172.21.15.2:0/1621123580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb4102580 0x7f2cb406fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.503+0000 7f2cb27fc640 1 -- 172.21.15.2:0/1621123580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca8005040 con 0x7f2cb4102f20 2024-09-17T00:58:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.503+0000 7f2cb2ffd640 1 --2- 172.21.15.2:0/1621123580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb4102580 0x7f2cb406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T00:58:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.503+0000 7f2cb27fc640 1 --2- 172.21.15.2:0/1621123580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb4102f20 0x7f2cb406ff50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8003080 tx=0x7f2ca8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.503+0000 7f2c9b7fe640 1 -- 172.21.15.2:0/1621123580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ca8038070 con 0x7f2cb4102f20 2024-09-17T00:58:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.503+0000 7f2c9b7fe640 1 -- 172.21.15.2:0/1621123580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2ca8009760 con 0x7f2cb4102f20 2024-09-17T00:58:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.503+0000 7f2cb9770640 1 -- 172.21.15.2:0/1621123580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb4119590 con 0x7f2cb4102f20 2024-09-17T00:58:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.503+0000 7f2c9b7fe640 1 -- 172.21.15.2:0/1621123580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ca803d420 con 0x7f2cb4102f20 2024-09-17T00:58:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.503+0000 7f2cb9770640 1 -- 172.21.15.2:0/1621123580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb4119910 con 0x7f2cb4102f20 2024-09-17T00:58:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.504+0000 7f2cb9770640 1 -- 172.21.15.2:0/1621123580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb40fdd00 con 0x7f2cb4102f20 2024-09-17T00:58:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.505+0000 7f2c9b7fe640 1 -- 172.21.15.2:0/1621123580 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f2ca8030020 con 0x7f2cb4102f20 2024-09-17T00:58:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.505+0000 7f2c9b7fe640 1 --2- 172.21.15.2:0/1621123580 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2c9c06ed50 0x7f2c9c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.505+0000 7f2c9b7fe640 1 -- 172.21.15.2:0/1621123580 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2ca80ae230 con 0x7f2cb4102f20 2024-09-17T00:58:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.505+0000 7f2cb2ffd640 1 --2- 172.21.15.2:0/1621123580 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2c9c06ed50 0x7f2c9c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.506+0000 7f2cb2ffd640 1 --2- 172.21.15.2:0/1621123580 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2c9c06ed50 0x7f2c9c071200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009a80 tx=0x7f2ca4008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.509+0000 7f2c9b7fe640 1 -- 172.21.15.2:0/1621123580 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2ca807b710 con 0x7f2cb4102f20 2024-09-17T00:58:56.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.669+0000 7f2cb9770640 1 -- 172.21.15.2:0/1621123580 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2cb41096b0 con 0x7f2c9c06ed50 2024-09-17T00:58:56.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.670+0000 7f2c9b7fe640 1 -- 172.21.15.2:0/1621123580 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27959 (secure 0 0 0) 0x7f2ca400d850 con 0x7f2c9c06ed50 2024-09-17T00:58:56.667 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:58:56.668 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-17T00:58:56.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.672+0000 7f2cb9770640 1 -- 172.21.15.2:0/1621123580 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2c9c06ed50 msgr2=0x7f2c9c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:56.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.672+0000 7f2cb9770640 1 --2- 172.21.15.2:0/1621123580 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2c9c06ed50 0x7f2c9c071200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009a80 tx=0x7f2ca4008040 comp rx=0 tx=0).stop 2024-09-17T00:58:56.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.672+0000 7f2cb9770640 1 -- 172.21.15.2:0/1621123580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb4102f20 msgr2=0x7f2cb406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:56.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.672+0000 7f2cb9770640 1 --2- 172.21.15.2:0/1621123580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb4102f20 0x7f2cb406ff50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8003080 tx=0x7f2ca8009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:56.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.672+0000 7f2cb9770640 1 -- 172.21.15.2:0/1621123580 shutdown_connections 2024-09-17T00:58:56.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.672+0000 7f2cb9770640 1 --2- 172.21.15.2:0/1621123580 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2c9c06ed50 0x7f2c9c071200 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:56.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.672+0000 7f2cb9770640 1 --2- 172.21.15.2:0/1621123580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cb4102f20 0x7f2cb406ff50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:56.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.672+0000 7f2cb9770640 1 --2- 172.21.15.2:0/1621123580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb4102580 0x7f2cb406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:56.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.672+0000 7f2cb9770640 1 -- 172.21.15.2:0/1621123580 >> 172.21.15.2:0/1621123580 conn(0x7f2cb40f81a0 msgr2=0x7f2cb40f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:56.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.672+0000 7f2cb9770640 1 -- 172.21.15.2:0/1621123580 shutdown_connections 2024-09-17T00:58:56.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:56.672+0000 7f2cb9770640 1 -- 172.21.15.2:0/1621123580 wait complete. 2024-09-17T00:58:57.324 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-17T00:58:56.291481+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787936,"kb_used_data":3780,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682976,"statfs":{"total":575970213888,"available":574139367424,"internally_reserved":0,"allocated":3870720,"data_stored":2558100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002185"},"pg_stats":[{"pgid":"1.0","version":"23'72","reported_seq":130,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T00:58:01.087918+0000","last_change":"2024-09-17T00:57:34.372407+0000","last_active":"2024-09-17T00:58:01.087918+0000","last_peered":"2024-09-17T00:58:01.087918+0000","last_clean":"2024-09-17T00:58:01.087918+0000","last_became_active":"2024-09-17T00:57:34.372126+0000","last_became_peered":"2024-09-17T00:57:34.372126+0000","last_unstale":"2024-09-17T00:58:01.087918+0000","last_undegraded":"2024-09-17T00:58:01.087918+0000","last_fullsized":"2024-09-17T00:58:01.087918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T00:56:44.817411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T00:56:44.817411+0000","last_clean_scrub_stamp":"2024-09-17T00:56:44.817411+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:13:19.534756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]}]},{"osd":4,"up_from":32,"seq":137438953491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447452,"statfs":{"total":95995035648,"available":95690190848,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:58:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.497},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42999999999999999}]},{"osd":1,"last update":"Tue Sep 17 00:58:38 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.57099999999999995}]},{"osd":2,"last update":"Tue Sep 17 00:58:38 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.50800000000000001}]},{"osd":3,"last update":"Tue Sep 17 00:58:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.26500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.46000000000000002}]},{"osd":1,"last update":"Tue Sep 17 00:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.45200000000000001}]},{"osd":2,"last update":"Tue Sep 17 00:58:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.501},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.55300000000000005}]},{"osd":4,"last update":"Tue Sep 17 00:58:35 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.434}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378654,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297700,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447452,"statfs":{"total":95995035648,"available":95690190848,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:58:48 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.35299999999999998,"15min":0.35699999999999998},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48499999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.313},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.372,"15min":0.378},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.27300000000000002}]},{"osd":1,"last update":"Tue Sep 17 00:58:48 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.377,"15min":0.38300000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.48699999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.29599999999999999}]},{"osd":3,"last update":"Tue Sep 17 00:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54900000000000004}]},{"osd":4,"last update":"Tue Sep 17 00:58:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 00:58:20 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35299999999999998,"15min":0.35399999999999998},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.48799999999999999,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.35499999999999998,"15min":0.35399999999999998},"min":{"1min":0.23499999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.498,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.28000000000000003}]},{"osd":2,"last update":"Tue Sep 17 00:58:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.53600000000000003,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.55300000000000005,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.252}]},{"osd":3,"last update":"Tue Sep 17 00:58:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.63400000000000001}]},{"osd":4,"last update":"Tue Sep 17 00:58:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 00:58:24 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.315,"15min":0.309},"min":{"1min":0.249,"5min":0.185,"15min":0.185},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.222},{"interface":"front","average":{"1min":0.378,"5min":0.318,"15min":0.308},"min":{"1min":0.23599999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.26100000000000001}]},{"osd":2,"last update":"Tue Sep 17 00:58:51 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.46999999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.40300000000000002,"15min":0.40799999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.27700000000000002}]},{"osd":3,"last update":"Tue Sep 17 00:58:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.623},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.63400000000000001}]},{"osd":4,"last update":"Tue Sep 17 00:58:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T00:58:57.325 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-17T00:58:57.325 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T00:58:57.325 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-17T00:58:57.325 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-17T00:58:57.581 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:58:57.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:57 smithi002 ceph-mon[27650]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:57.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:57 smithi002 ceph-mon[27650]: from='client.14410 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T00:58:57.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:57 smithi099 ceph-mon[34357]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:57.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:57 smithi099 ceph-mon[34357]: from='client.14410 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T00:58:59.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.189+0000 7f3f06067640 1 -- 172.21.15.2:0/1333625348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f00102550 msgr2=0x7f3f00102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:59.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.189+0000 7f3f06067640 1 --2- 172.21.15.2:0/1333625348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f00102550 0x7f3f00102920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00048d0 tx=0x7f3ef0009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:59.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.190+0000 7f3f06067640 1 -- 172.21.15.2:0/1333625348 shutdown_connections 2024-09-17T00:58:59.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.190+0000 7f3f06067640 1 --2- 172.21.15.2:0/1333625348 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f00102ef0 0x7f3f000fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:59.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.190+0000 7f3f06067640 1 --2- 172.21.15.2:0/1333625348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f00102550 0x7f3f00102920 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:59.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.190+0000 7f3f06067640 1 -- 172.21.15.2:0/1333625348 >> 172.21.15.2:0/1333625348 conn(0x7f3f000f80f0 msgr2=0x7f3f000fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:59.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.190+0000 7f3f06067640 1 -- 172.21.15.2:0/1333625348 shutdown_connections 2024-09-17T00:58:59.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.190+0000 7f3f06067640 1 -- 172.21.15.2:0/1333625348 wait complete. 2024-09-17T00:58:59.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.190+0000 7f3f06067640 1 Processor -- start 2024-09-17T00:58:59.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.190+0000 7f3f06067640 1 -- start start 2024-09-17T00:58:59.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.191+0000 7f3f06067640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f00102550 0x7f3f001135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:59.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.191+0000 7f3f06067640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f00102ef0 0x7f3f00113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:59.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.191+0000 7f3f06067640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f001141d0 con 0x7f3f00102550 2024-09-17T00:58:59.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.191+0000 7f3f06067640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0010d550 con 0x7f3f00102ef0 2024-09-17T00:58:59.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.191+0000 7f3eff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f00102550 0x7f3f001135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:59.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.191+0000 7f3eff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f00102550 0x7f3f001135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49430/0 (socket says 172.21.15.2:49430) 2024-09-17T00:58:59.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.191+0000 7f3eff7fe640 1 -- 172.21.15.2:0/921106166 learned_addr learned my addr 172.21.15.2:0/921106166 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:58:59.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.191+0000 7f3ef6ffd640 1 --2- 172.21.15.2:0/921106166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f00102ef0 0x7f3f00113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:59.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.191+0000 7f3eff7fe640 1 -- 172.21.15.2:0/921106166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f00102ef0 msgr2=0x7f3f00113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:59.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.191+0000 7f3eff7fe640 1 --2- 172.21.15.2:0/921106166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f00102ef0 0x7f3f00113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:59.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.191+0000 7f3eff7fe640 1 -- 172.21.15.2:0/921106166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef0005040 con 0x7f3f00102550 2024-09-17T00:58:59.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.191+0000 7f3eff7fe640 1 --2- 172.21.15.2:0/921106166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f00102550 0x7f3f001135b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0000c00 tx=0x7f3ef0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:59.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.191+0000 7f3efcff9640 1 -- 172.21.15.2:0/921106166 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ef0038070 con 0x7f3f00102550 2024-09-17T00:58:59.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.192+0000 7f3f06067640 1 -- 172.21.15.2:0/921106166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0010d780 con 0x7f3f00102550 2024-09-17T00:58:59.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.192+0000 7f3efcff9640 1 -- 172.21.15.2:0/921106166 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ef003daf0 con 0x7f3f00102550 2024-09-17T00:58:59.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.192+0000 7f3efcff9640 1 -- 172.21.15.2:0/921106166 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ef0033b20 con 0x7f3f00102550 2024-09-17T00:58:59.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.192+0000 7f3f06067640 1 -- 172.21.15.2:0/921106166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0010dca0 con 0x7f3f00102550 2024-09-17T00:58:59.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.193+0000 7f3f06067640 1 -- 172.21.15.2:0/921106166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f000fdcd0 con 0x7f3f00102550 2024-09-17T00:58:59.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.193+0000 7f3efcff9640 1 -- 172.21.15.2:0/921106166 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f3ef0030020 con 0x7f3f00102550 2024-09-17T00:58:59.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.194+0000 7f3efcff9640 1 --2- 172.21.15.2:0/921106166 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f3eec06ed60 0x7f3eec071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:58:59.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.194+0000 7f3efcff9640 1 -- 172.21.15.2:0/921106166 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3ef00ae190 con 0x7f3f00102550 2024-09-17T00:58:59.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.194+0000 7f3ef6ffd640 1 --2- 172.21.15.2:0/921106166 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f3eec06ed60 0x7f3eec071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:58:59.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.194+0000 7f3ef6ffd640 1 --2- 172.21.15.2:0/921106166 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f3eec06ed60 0x7f3eec071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8006fd0 tx=0x7f3ee8008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:58:59.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.198+0000 7f3efcff9640 1 -- 172.21.15.2:0/921106166 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3ef007b550 con 0x7f3f00102550 2024-09-17T00:58:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.394+0000 7f3f06067640 1 -- 172.21.15.2:0/921106166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3f0010ec20 con 0x7f3f00102550 2024-09-17T00:58:59.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.395+0000 7f3efcff9640 1 -- 172.21.15.2:0/921106166 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3ef00ace60 con 0x7f3f00102550 2024-09-17T00:58:59.392 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:58:59.392 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T00:58:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.397+0000 7f3f06067640 1 -- 172.21.15.2:0/921106166 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f3eec06ed60 msgr2=0x7f3eec071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.397+0000 7f3f06067640 1 --2- 172.21.15.2:0/921106166 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f3eec06ed60 0x7f3eec071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8006fd0 tx=0x7f3ee8008040 comp rx=0 tx=0).stop 2024-09-17T00:58:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.397+0000 7f3f06067640 1 -- 172.21.15.2:0/921106166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f00102550 msgr2=0x7f3f001135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:58:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.397+0000 7f3f06067640 1 --2- 172.21.15.2:0/921106166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f00102550 0x7f3f001135b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0000c00 tx=0x7f3ef0009da0 comp rx=0 tx=0).stop 2024-09-17T00:58:59.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.397+0000 7f3f06067640 1 -- 172.21.15.2:0/921106166 shutdown_connections 2024-09-17T00:58:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.397+0000 7f3f06067640 1 --2- 172.21.15.2:0/921106166 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f3eec06ed60 0x7f3eec071210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.397+0000 7f3f06067640 1 --2- 172.21.15.2:0/921106166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f00102ef0 0x7f3f00113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.397+0000 7f3f06067640 1 --2- 172.21.15.2:0/921106166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f00102550 0x7f3f001135b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:58:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.397+0000 7f3f06067640 1 -- 172.21.15.2:0/921106166 >> 172.21.15.2:0/921106166 conn(0x7f3f000f80f0 msgr2=0x7f3f000f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:58:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.397+0000 7f3f06067640 1 -- 172.21.15.2:0/921106166 shutdown_connections 2024-09-17T00:58:59.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:58:59.397+0000 7f3f06067640 1 -- 172.21.15.2:0/921106166 wait complete. 2024-09-17T00:58:59.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:59 smithi002 ceph-mon[27650]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:59.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:58:59 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/921106166' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T00:58:59.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:59 smithi099 ceph-mon[34357]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:58:59.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:58:59 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/921106166' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T00:59:00.025 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-17T00:59:00.025 INFO:tasks.cephadm:Setup complete, yielding 2024-09-17T00:59:00.025 INFO:teuthology.run_tasks:Running task print... 2024-09-17T00:59:00.033 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-09-17T00:59:00.033 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T00:59:00.257 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T00:59:00.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-17T00:59:00.517 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:01.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:01 smithi002 ceph-mon[27650]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:01.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:01 smithi099 ceph-mon[34357]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.230+0000 7f96f4f82640 1 -- 172.21.15.2:0/3882084893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f00fc6f0 msgr2=0x7f96f00fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.230+0000 7f96f4f82640 1 --2- 172.21.15.2:0/3882084893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f00fc6f0 0x7f96f00fcb60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f96d80048d0 tx=0x7f96d8009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96f4f82640 1 -- 172.21.15.2:0/3882084893 shutdown_connections 2024-09-17T00:59:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96f4f82640 1 --2- 172.21.15.2:0/3882084893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f00fc6f0 0x7f96f00fcb60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96f4f82640 1 --2- 172.21.15.2:0/3882084893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96f00fb420 0x7f96f00fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96f4f82640 1 -- 172.21.15.2:0/3882084893 >> 172.21.15.2:0/3882084893 conn(0x7f96f00f6c00 msgr2=0x7f96f00f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96f4f82640 1 -- 172.21.15.2:0/3882084893 shutdown_connections 2024-09-17T00:59:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96f4f82640 1 -- 172.21.15.2:0/3882084893 wait complete. 2024-09-17T00:59:02.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96f4f82640 1 Processor -- start 2024-09-17T00:59:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96f4f82640 1 -- start start 2024-09-17T00:59:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96f4f82640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96f00fb420 0x7f96f010d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96f4f82640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f00fc6f0 0x7f96f010d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96f4f82640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f010dc70 con 0x7f96f00fc6f0 2024-09-17T00:59:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96f4f82640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f010e440 con 0x7f96f00fb420 2024-09-17T00:59:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96edd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f00fc6f0 0x7f96f010d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96edd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f00fc6f0 0x7f96f010d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52476/0 (socket says 172.21.15.2:52476) 2024-09-17T00:59:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.231+0000 7f96edd9b640 1 -- 172.21.15.2:0/684818614 learned_addr learned my addr 172.21.15.2:0/684818614 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.232+0000 7f96ee59c640 1 --2- 172.21.15.2:0/684818614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96f00fb420 0x7f96f010d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.232+0000 7f96edd9b640 1 -- 172.21.15.2:0/684818614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96f00fb420 msgr2=0x7f96f010d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.232+0000 7f96edd9b640 1 --2- 172.21.15.2:0/684818614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96f00fb420 0x7f96f010d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.232+0000 7f96edd9b640 1 -- 172.21.15.2:0/684818614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d8005040 con 0x7f96f00fc6f0 2024-09-17T00:59:02.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.232+0000 7f96edd9b640 1 --2- 172.21.15.2:0/684818614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f00fc6f0 0x7f96f010d620 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f96d80043d0 tx=0x7f96d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.232+0000 7f96e6ffd640 1 -- 172.21.15.2:0/684818614 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96d8038070 con 0x7f96f00fc6f0 2024-09-17T00:59:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.232+0000 7f96e6ffd640 1 -- 172.21.15.2:0/684818614 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f96d802ae90 con 0x7f96f00fc6f0 2024-09-17T00:59:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.232+0000 7f96f4f82640 1 -- 172.21.15.2:0/684818614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f010e670 con 0x7f96f00fc6f0 2024-09-17T00:59:02.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.232+0000 7f96e6ffd640 1 -- 172.21.15.2:0/684818614 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96d803e670 con 0x7f96f00fc6f0 2024-09-17T00:59:02.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.232+0000 7f96f4f82640 1 -- 172.21.15.2:0/684818614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f010ec10 con 0x7f96f00fc6f0 2024-09-17T00:59:02.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.233+0000 7f96f4f82640 1 -- 172.21.15.2:0/684818614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f00fa880 con 0x7f96f00fc6f0 2024-09-17T00:59:02.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.234+0000 7f96e6ffd640 1 -- 172.21.15.2:0/684818614 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f96d8030020 con 0x7f96f00fc6f0 2024-09-17T00:59:02.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.235+0000 7f96e6ffd640 1 --2- 172.21.15.2:0/684818614 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f96dc06ed60 0x7f96dc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:02.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.235+0000 7f96e6ffd640 1 -- 172.21.15.2:0/684818614 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f96d80adf40 con 0x7f96f00fc6f0 2024-09-17T00:59:02.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.235+0000 7f96ee59c640 1 --2- 172.21.15.2:0/684818614 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f96dc06ed60 0x7f96dc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:02.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.236+0000 7f96ee59c640 1 --2- 172.21.15.2:0/684818614 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f96dc06ed60 0x7f96dc071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f96e0007fd0 tx=0x7f96e0009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:02.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.239+0000 7f96e6ffd640 1 -- 172.21.15.2:0/684818614 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f96d807b4d0 con 0x7f96f00fc6f0 2024-09-17T00:59:02.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.418+0000 7f96f4f82640 1 -- 172.21.15.2:0/684818614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f96f004b720 con 0x7f96f00fc6f0 2024-09-17T00:59:02.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.423+0000 7f96e6ffd640 1 -- 172.21.15.2:0/684818614 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f96d807ae70 con 0x7f96f00fc6f0 2024-09-17T00:59:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.425+0000 7f96f4f82640 1 -- 172.21.15.2:0/684818614 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f96dc06ed60 msgr2=0x7f96dc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.425+0000 7f96f4f82640 1 --2- 172.21.15.2:0/684818614 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f96dc06ed60 0x7f96dc071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f96e0007fd0 tx=0x7f96e0009040 comp rx=0 tx=0).stop 2024-09-17T00:59:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.425+0000 7f96f4f82640 1 -- 172.21.15.2:0/684818614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f00fc6f0 msgr2=0x7f96f010d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.425+0000 7f96f4f82640 1 --2- 172.21.15.2:0/684818614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f00fc6f0 0x7f96f010d620 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f96d80043d0 tx=0x7f96d8009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.425+0000 7f96f4f82640 1 -- 172.21.15.2:0/684818614 shutdown_connections 2024-09-17T00:59:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.425+0000 7f96f4f82640 1 --2- 172.21.15.2:0/684818614 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f96dc06ed60 0x7f96dc071210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:02.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.425+0000 7f96f4f82640 1 --2- 172.21.15.2:0/684818614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f00fc6f0 0x7f96f010d620 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:02.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.425+0000 7f96f4f82640 1 --2- 172.21.15.2:0/684818614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96f00fb420 0x7f96f010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:02.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.425+0000 7f96f4f82640 1 -- 172.21.15.2:0/684818614 >> 172.21.15.2:0/684818614 conn(0x7f96f00f6c00 msgr2=0x7f96f0065f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:02.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.425+0000 7f96f4f82640 1 -- 172.21.15.2:0/684818614 shutdown_connections 2024-09-17T00:59:02.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:02.425+0000 7f96f4f82640 1 -- 172.21.15.2:0/684818614 wait complete. 2024-09-17T00:59:02.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:02 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:59:02.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:02 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/684818614' entity='client.admin' 2024-09-17T00:59:02.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:02 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:59:02.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:02 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/684818614' entity='client.admin' 2024-09-17T00:59:03.041 INFO:teuthology.run_tasks:Running task print... 2024-09-17T00:59:03.050 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-17T00:59:03.050 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T00:59:03.152 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T00:59:03.152 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-17T00:59:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:03.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:03 smithi002 ceph-mon[27650]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:03.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:03 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:03.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:03 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:03.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:03 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:03.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:03 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:59:03.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:03 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:03.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:03 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:03.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:03 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:03.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:03 smithi099 ceph-mon[34357]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:03.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:03 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:03.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:03 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:03.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:03 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:03.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:03 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:59:03.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:03 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:03.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:03 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:03.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:03 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:05.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.119+0000 7f32872d8640 1 -- 172.21.15.2:0/632917704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800fd7f0 msgr2=0x7f32800fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:05.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.119+0000 7f32872d8640 1 --2- 172.21.15.2:0/632917704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800fd7f0 0x7f32800fdc60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f32740048d0 tx=0x7f3274009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:05.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.119+0000 7f32872d8640 1 -- 172.21.15.2:0/632917704 shutdown_connections 2024-09-17T00:59:05.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.119+0000 7f32872d8640 1 --2- 172.21.15.2:0/632917704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800fd7f0 0x7f32800fdc60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:05.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.119+0000 7f32872d8640 1 --2- 172.21.15.2:0/632917704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32800fc520 0x7f32800fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:05.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.119+0000 7f32872d8640 1 -- 172.21.15.2:0/632917704 >> 172.21.15.2:0/632917704 conn(0x7f32800f7ce0 msgr2=0x7f32800fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:05.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.119+0000 7f32872d8640 1 -- 172.21.15.2:0/632917704 shutdown_connections 2024-09-17T00:59:05.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.119+0000 7f32872d8640 1 -- 172.21.15.2:0/632917704 wait complete. 2024-09-17T00:59:05.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.120+0000 7f32872d8640 1 Processor -- start 2024-09-17T00:59:05.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.120+0000 7f32872d8640 1 -- start start 2024-09-17T00:59:05.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.120+0000 7f32872d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800fc520 0x7f3280071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:05.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.120+0000 7f32872d8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32800fd7f0 0x7f328006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:05.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.120+0000 7f32872d8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3280070080 con 0x7f32800fc520 2024-09-17T00:59:05.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.120+0000 7f32872d8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32800701c0 con 0x7f32800fd7f0 2024-09-17T00:59:05.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.120+0000 7f3285074640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800fc520 0x7f3280071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:05.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.120+0000 7f3285074640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800fc520 0x7f3280071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52498/0 (socket says 172.21.15.2:52498) 2024-09-17T00:59:05.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.120+0000 7f3285074640 1 -- 172.21.15.2:0/1832689980 learned_addr learned my addr 172.21.15.2:0/1832689980 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:05.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.120+0000 7f3284873640 1 --2- 172.21.15.2:0/1832689980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32800fd7f0 0x7f328006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:05.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.120+0000 7f3285074640 1 -- 172.21.15.2:0/1832689980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32800fd7f0 msgr2=0x7f328006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:05.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.120+0000 7f3285074640 1 --2- 172.21.15.2:0/1832689980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32800fd7f0 0x7f328006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:05.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.120+0000 7f3285074640 1 -- 172.21.15.2:0/1832689980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3274005040 con 0x7f32800fc520 2024-09-17T00:59:05.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.120+0000 7f3285074640 1 --2- 172.21.15.2:0/1832689980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800fc520 0x7f3280071570 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f327c00b790 tx=0x7f327c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:05.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.121+0000 7f3271ffb640 1 -- 172.21.15.2:0/1832689980 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327c00c700 con 0x7f32800fc520 2024-09-17T00:59:05.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.121+0000 7f3271ffb640 1 -- 172.21.15.2:0/1832689980 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f327c00cd00 con 0x7f32800fc520 2024-09-17T00:59:05.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.121+0000 7f32872d8640 1 -- 172.21.15.2:0/1832689980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32800704a0 con 0x7f32800fc520 2024-09-17T00:59:05.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.121+0000 7f3271ffb640 1 -- 172.21.15.2:0/1832689980 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327c015e70 con 0x7f32800fc520 2024-09-17T00:59:05.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.121+0000 7f32872d8640 1 -- 172.21.15.2:0/1832689980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3280115130 con 0x7f32800fc520 2024-09-17T00:59:05.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.122+0000 7f32872d8640 1 -- 172.21.15.2:0/1832689980 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32800fb980 con 0x7f32800fc520 2024-09-17T00:59:05.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.122+0000 7f3271ffb640 1 -- 172.21.15.2:0/1832689980 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f327c012070 con 0x7f32800fc520 2024-09-17T00:59:05.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.123+0000 7f3271ffb640 1 --2- 172.21.15.2:0/1832689980 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f326c06ed60 0x7f326c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:05.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.123+0000 7f3271ffb640 1 -- 172.21.15.2:0/1832689980 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f327c08d930 con 0x7f32800fc520 2024-09-17T00:59:05.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.123+0000 7f3284873640 1 --2- 172.21.15.2:0/1832689980 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f326c06ed60 0x7f326c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:05.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.123+0000 7f3284873640 1 --2- 172.21.15.2:0/1832689980 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f326c06ed60 0x7f326c071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3274007ac0 tx=0x7f3274035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:05.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.127+0000 7f3271ffb640 1 -- 172.21.15.2:0/1832689980 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f327c05ae10 con 0x7f32800fc520 2024-09-17T00:59:05.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.303+0000 7f32872d8640 1 -- 172.21.15.2:0/1832689980 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3280101c40 con 0x7f326c06ed60 2024-09-17T00:59:05.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.304+0000 7f3271ffb640 1 -- 172.21.15.2:0/1832689980 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f3280101c40 con 0x7f326c06ed60 2024-09-17T00:59:05.302 INFO:teuthology.orchestra.run.smithi002.stdout:Backend: cephadm 2024-09-17T00:59:05.303 INFO:teuthology.orchestra.run.smithi002.stdout:Available: Yes 2024-09-17T00:59:05.303 INFO:teuthology.orchestra.run.smithi002.stdout:Paused: No 2024-09-17T00:59:05.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.306+0000 7f32872d8640 1 -- 172.21.15.2:0/1832689980 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f326c06ed60 msgr2=0x7f326c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:05.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.306+0000 7f32872d8640 1 --2- 172.21.15.2:0/1832689980 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f326c06ed60 0x7f326c071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3274007ac0 tx=0x7f3274035040 comp rx=0 tx=0).stop 2024-09-17T00:59:05.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.306+0000 7f32872d8640 1 -- 172.21.15.2:0/1832689980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800fc520 msgr2=0x7f3280071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:05.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.306+0000 7f32872d8640 1 --2- 172.21.15.2:0/1832689980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800fc520 0x7f3280071570 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f327c00b790 tx=0x7f327c0091d0 comp rx=0 tx=0).stop 2024-09-17T00:59:05.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.306+0000 7f32872d8640 1 -- 172.21.15.2:0/1832689980 shutdown_connections 2024-09-17T00:59:05.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.306+0000 7f32872d8640 1 --2- 172.21.15.2:0/1832689980 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f326c06ed60 0x7f326c071210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:05.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.306+0000 7f32872d8640 1 --2- 172.21.15.2:0/1832689980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32800fd7f0 0x7f328006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:05.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.306+0000 7f32872d8640 1 --2- 172.21.15.2:0/1832689980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800fc520 0x7f3280071570 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:05.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.306+0000 7f32872d8640 1 -- 172.21.15.2:0/1832689980 >> 172.21.15.2:0/1832689980 conn(0x7f32800f7ce0 msgr2=0x7f32800f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:05.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.307+0000 7f32872d8640 1 -- 172.21.15.2:0/1832689980 shutdown_connections 2024-09-17T00:59:05.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:05.307+0000 7f32872d8640 1 -- 172.21.15.2:0/1832689980 wait complete. 2024-09-17T00:59:05.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:05 smithi002 ceph-mon[27650]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:05.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:05 smithi099 ceph-mon[34357]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:06.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-17T00:59:06.327 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:06.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:06 smithi002 ceph-mon[27650]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:06.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:59:06.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:06 smithi099 ceph-mon[34357]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:06.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:59:07.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:07 smithi002 ceph-mon[27650]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:07.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:07 smithi099 ceph-mon[34357]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:07.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.955+0000 7f95a4c35640 1 -- 172.21.15.2:0/2426585015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a00fc740 msgr2=0x7f95a00fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.955+0000 7f95a4c35640 1 --2- 172.21.15.2:0/2426585015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a00fc740 0x7f95a00fcbb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f95880048d0 tx=0x7f9588009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.955+0000 7f95a4c35640 1 -- 172.21.15.2:0/2426585015 shutdown_connections 2024-09-17T00:59:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.955+0000 7f95a4c35640 1 --2- 172.21.15.2:0/2426585015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a00fc740 0x7f95a00fcbb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.955+0000 7f95a4c35640 1 --2- 172.21.15.2:0/2426585015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a00fb470 0x7f95a00fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.955+0000 7f95a4c35640 1 -- 172.21.15.2:0/2426585015 >> 172.21.15.2:0/2426585015 conn(0x7f95a00f6c10 msgr2=0x7f95a00f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.955+0000 7f95a4c35640 1 -- 172.21.15.2:0/2426585015 shutdown_connections 2024-09-17T00:59:07.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.955+0000 7f95a4c35640 1 -- 172.21.15.2:0/2426585015 wait complete. 2024-09-17T00:59:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.956+0000 7f95a4c35640 1 Processor -- start 2024-09-17T00:59:07.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.956+0000 7f95a4c35640 1 -- start start 2024-09-17T00:59:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.956+0000 7f95a4c35640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a00fb470 0x7f95a00ff590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.956+0000 7f95a4c35640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a00fc740 0x7f95a00fda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.956+0000 7f95a4c35640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a00fe010 con 0x7f95a00fb470 2024-09-17T00:59:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.956+0000 7f95a4c35640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a00fe150 con 0x7f95a00fc740 2024-09-17T00:59:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.956+0000 7f959e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a00fb470 0x7f95a00ff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.956+0000 7f959e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a00fb470 0x7f95a00ff590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52516/0 (socket says 172.21.15.2:52516) 2024-09-17T00:59:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.956+0000 7f959e59c640 1 -- 172.21.15.2:0/102804259 learned_addr learned my addr 172.21.15.2:0/102804259 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.956+0000 7f9597fff640 1 --2- 172.21.15.2:0/102804259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a00fc740 0x7f95a00fda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.956+0000 7f959e59c640 1 -- 172.21.15.2:0/102804259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a00fc740 msgr2=0x7f95a00fda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.956+0000 7f959e59c640 1 --2- 172.21.15.2:0/102804259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a00fc740 0x7f95a00fda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:07.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.956+0000 7f959e59c640 1 -- 172.21.15.2:0/102804259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9588005040 con 0x7f95a00fb470 2024-09-17T00:59:07.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.956+0000 7f959e59c640 1 --2- 172.21.15.2:0/102804259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a00fb470 0x7f95a00ff590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f959000c790 tx=0x7f95900043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:07.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.957+0000 7f9596ffd640 1 -- 172.21.15.2:0/102804259 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959000a820 con 0x7f95a00fb470 2024-09-17T00:59:07.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.957+0000 7f9596ffd640 1 -- 172.21.15.2:0/102804259 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f959000ae20 con 0x7f95a00fb470 2024-09-17T00:59:07.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.957+0000 7f95a4c35640 1 -- 172.21.15.2:0/102804259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a00fe430 con 0x7f95a00fb470 2024-09-17T00:59:07.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.957+0000 7f9596ffd640 1 -- 172.21.15.2:0/102804259 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95900113a0 con 0x7f95a00fb470 2024-09-17T00:59:07.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.957+0000 7f95a4c35640 1 -- 172.21.15.2:0/102804259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a0115140 con 0x7f95a00fb470 2024-09-17T00:59:07.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.958+0000 7f95a4c35640 1 -- 172.21.15.2:0/102804259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a00fa8d0 con 0x7f95a00fb470 2024-09-17T00:59:07.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.958+0000 7f9596ffd640 1 -- 172.21.15.2:0/102804259 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f9590012400 con 0x7f95a00fb470 2024-09-17T00:59:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.959+0000 7f9596ffd640 1 --2- 172.21.15.2:0/102804259 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f958c06ed60 0x7f958c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.959+0000 7f9596ffd640 1 -- 172.21.15.2:0/102804259 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f959008def0 con 0x7f95a00fb470 2024-09-17T00:59:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.959+0000 7f9597fff640 1 --2- 172.21.15.2:0/102804259 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f958c06ed60 0x7f958c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:07.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.959+0000 7f9597fff640 1 --2- 172.21.15.2:0/102804259 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f958c06ed60 0x7f958c071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9588007ac0 tx=0x7f9588035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:07.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:07.963+0000 7f9596ffd640 1 -- 172.21.15.2:0/102804259 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f959005b470 con 0x7f95a00fb470 2024-09-17T00:59:08.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:08.135+0000 7f95a4c35640 1 -- 172.21.15.2:0/102804259 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f95a0103fd0 con 0x7f958c06ed60 2024-09-17T00:59:08.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:08.143+0000 7f9596ffd640 1 -- 172.21.15.2:0/102804259 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2826 (secure 0 0 0) 0x7f95a0103fd0 con 0x7f958c06ed60 2024-09-17T00:59:08.141 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T00:59:08.141 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (3m) 2m ago 5m 27.7M - 0.25.0 c8568f914cd2 225a4094fd9c 2024-09-17T00:59:08.142 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (5m) 2m ago 5m 6903k - 17.2.7-1635-g4a704134 f22ead590bad 53b003b1ad6f 2024-09-17T00:59:08.142 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (4m) 69s ago 4m 6891k - 17.2.7-1635-g4a704134 f22ead590bad 6ec40439e9b5 2024-09-17T00:59:08.142 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (3m) 2m ago 4m 80.1M - 9.4.7 954c08fa6188 68fde0ccaa6c 2024-09-17T00:59:08.142 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:9283,8765,8443 running (6m) 2m ago 6m 441M - 17.2.7-1635-g4a704134 f22ead590bad 6f10e41396cd 2024-09-17T00:59:08.142 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283 running (4m) 69s ago 4m 399M - 17.2.7-1635-g4a704134 f22ead590bad d88571dad10b 2024-09-17T00:59:08.142 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (6m) 2m ago 6m 43.3M 2048M 17.2.7-1635-g4a704134 f22ead590bad 08b932b41bfa 2024-09-17T00:59:08.142 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (4m) 69s ago 4m 38.3M 2048M 17.2.7-1635-g4a704134 f22ead590bad 1c9583d52c94 2024-09-17T00:59:08.142 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (5m) 2m ago 5m 16.0M - 1.5.0 0da6a335fe13 175a7378d3e6 2024-09-17T00:59:08.142 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (4m) 69s ago 4m 16.2M - 1.5.0 0da6a335fe13 7c4fe7150f28 2024-09-17T00:59:08.142 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (3m) 2m ago 3m 40.3M 4289M 17.2.7-1635-g4a704134 f22ead590bad 720f74f40752 2024-09-17T00:59:08.142 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (2m) 2m ago 2m 38.4M 4289M 17.2.7-1635-g4a704134 f22ead590bad 629defddb38c 2024-09-17T00:59:08.142 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (2m) 2m ago 2m 41.0M 4289M 17.2.7-1635-g4a704134 f22ead590bad 5dff1cf9fc56 2024-09-17T00:59:08.143 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (2m) 69s ago 2m 38.2M 5312M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T00:59:08.143 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (100s) 69s ago 100s 39.7M 5312M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T00:59:08.143 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (75s) 69s ago 74s 13.9M 5312M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T00:59:08.143 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (3m) 2m ago 4m 37.8M - 2.43.0 a07b618ecd1d 4c4de4cca2fc 2024-09-17T00:59:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:08.145+0000 7f95a4c35640 1 -- 172.21.15.2:0/102804259 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f958c06ed60 msgr2=0x7f958c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:08.145+0000 7f95a4c35640 1 --2- 172.21.15.2:0/102804259 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f958c06ed60 0x7f958c071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9588007ac0 tx=0x7f9588035040 comp rx=0 tx=0).stop 2024-09-17T00:59:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:08.145+0000 7f95a4c35640 1 -- 172.21.15.2:0/102804259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a00fb470 msgr2=0x7f95a00ff590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:08.145+0000 7f95a4c35640 1 --2- 172.21.15.2:0/102804259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a00fb470 0x7f95a00ff590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f959000c790 tx=0x7f95900043c0 comp rx=0 tx=0).stop 2024-09-17T00:59:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:08.145+0000 7f95a4c35640 1 -- 172.21.15.2:0/102804259 shutdown_connections 2024-09-17T00:59:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:08.145+0000 7f95a4c35640 1 --2- 172.21.15.2:0/102804259 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f958c06ed60 0x7f958c071210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:08.145+0000 7f95a4c35640 1 --2- 172.21.15.2:0/102804259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95a00fc740 0x7f95a00fda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:08.145+0000 7f95a4c35640 1 --2- 172.21.15.2:0/102804259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a00fb470 0x7f95a00ff590 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:08.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:08.145+0000 7f95a4c35640 1 -- 172.21.15.2:0/102804259 >> 172.21.15.2:0/102804259 conn(0x7f95a00f6c10 msgr2=0x7f95a0066160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:08.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:08.145+0000 7f95a4c35640 1 -- 172.21.15.2:0/102804259 shutdown_connections 2024-09-17T00:59:08.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:08.146+0000 7f95a4c35640 1 -- 172.21.15.2:0/102804259 wait complete. 2024-09-17T00:59:08.787 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-17T00:59:09.050 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:09.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:09 smithi099 ceph-mon[34357]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:09.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:09 smithi099 ceph-mon[34357]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:09.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:09 smithi002 ceph-mon[27650]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:09.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:09 smithi002 ceph-mon[27650]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:10.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.754+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/4269701483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc0fc750 msgr2=0x7fbdcc0fcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:10.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.754+0000 7fbdd3a2c640 1 --2- 172.21.15.2:0/4269701483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc0fc750 0x7fbdcc0fcbc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00048d0 tx=0x7fbdc0009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:10.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.754+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/4269701483 shutdown_connections 2024-09-17T00:59:10.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.754+0000 7fbdd3a2c640 1 --2- 172.21.15.2:0/4269701483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc0fc750 0x7fbdcc0fcbc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:10.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.754+0000 7fbdd3a2c640 1 --2- 172.21.15.2:0/4269701483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdcc0fb480 0x7fbdcc0fb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:10.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.754+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/4269701483 >> 172.21.15.2:0/4269701483 conn(0x7fbdcc0f6c40 msgr2=0x7fbdcc0f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:10.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.755+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/4269701483 shutdown_connections 2024-09-17T00:59:10.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.755+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/4269701483 wait complete. 2024-09-17T00:59:10.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.755+0000 7fbdd3a2c640 1 Processor -- start 2024-09-17T00:59:10.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.755+0000 7fbdd3a2c640 1 -- start start 2024-09-17T00:59:10.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.755+0000 7fbdd3a2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc0fb480 0x7fbdcc10d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.756+0000 7fbdd17c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc0fb480 0x7fbdcc10d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.756+0000 7fbdd17c8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc0fb480 0x7fbdcc10d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41516/0 (socket says 172.21.15.2:41516) 2024-09-17T00:59:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.756+0000 7fbdd3a2c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdcc0fc750 0x7fbdcc10d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.756+0000 7fbdd17c8640 1 -- 172.21.15.2:0/3016669823 learned_addr learned my addr 172.21.15.2:0/3016669823 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.756+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/3016669823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc10dc90 con 0x7fbdcc0fb480 2024-09-17T00:59:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.756+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/3016669823 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc10e4b0 con 0x7fbdcc0fc750 2024-09-17T00:59:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.756+0000 7fbdd17c8640 1 -- 172.21.15.2:0/3016669823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdcc0fc750 msgr2=0x7fbdcc10d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.756+0000 7fbdd17c8640 1 --2- 172.21.15.2:0/3016669823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdcc0fc750 0x7fbdcc10d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.756+0000 7fbdd17c8640 1 -- 172.21.15.2:0/3016669823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc0005040 con 0x7fbdcc0fb480 2024-09-17T00:59:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.756+0000 7fbdd17c8640 1 --2- 172.21.15.2:0/3016669823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc0fb480 0x7fbdcc10d100 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8002a80 tx=0x7fbdc8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:10.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.756+0000 7fbdbdffb640 1 -- 172.21.15.2:0/3016669823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdc8007c30 con 0x7fbdcc0fb480 2024-09-17T00:59:10.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.756+0000 7fbdbdffb640 1 -- 172.21.15.2:0/3016669823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbdc800f040 con 0x7fbdcc0fb480 2024-09-17T00:59:10.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.756+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/3016669823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdcc10e740 con 0x7fbdcc0fb480 2024-09-17T00:59:10.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.756+0000 7fbdbdffb640 1 -- 172.21.15.2:0/3016669823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdc8009530 con 0x7fbdcc0fb480 2024-09-17T00:59:10.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.757+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/3016669823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdcc10ec60 con 0x7fbdcc0fb480 2024-09-17T00:59:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.758+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/3016669823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdcc0fa8e0 con 0x7fbdcc0fb480 2024-09-17T00:59:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.758+0000 7fbdbdffb640 1 -- 172.21.15.2:0/3016669823 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fbdc80097a0 con 0x7fbdcc0fb480 2024-09-17T00:59:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.758+0000 7fbdbdffb640 1 --2- 172.21.15.2:0/3016669823 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fbdb806ed60 0x7fbdb8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.759+0000 7fbdd0fc7640 1 --2- 172.21.15.2:0/3016669823 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fbdb806ed60 0x7fbdb8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.759+0000 7fbdbdffb640 1 -- 172.21.15.2:0/3016669823 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbdc808d800 con 0x7fbdcc0fb480 2024-09-17T00:59:10.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.759+0000 7fbdd0fc7640 1 --2- 172.21.15.2:0/3016669823 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fbdb806ed60 0x7fbdb8071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbdc002a530 tx=0x7fbdc0009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:10.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.763+0000 7fbdbdffb640 1 -- 172.21.15.2:0/3016669823 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbdc804d2a0 con 0x7fbdcc0fb480 2024-09-17T00:59:10.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.931+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/3016669823 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdcc10ee80 con 0x7fbdb806ed60 2024-09-17T00:59:10.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.935+0000 7fbdbdffb640 1 -- 172.21.15.2:0/3016669823 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1152 (secure 0 0 0) 0x7fbdcc10ee80 con 0x7fbdb806ed60 2024-09-17T00:59:10.933 INFO:teuthology.orchestra.run.smithi002.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-17T00:59:10.934 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-17T00:59:10.934 INFO:teuthology.orchestra.run.smithi002.stdout:crash 2/2 2m ago 5m * 2024-09-17T00:59:10.934 INFO:teuthology.orchestra.run.smithi002.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-17T00:59:10.934 INFO:teuthology.orchestra.run.smithi002.stdout:mgr 2/2 2m ago 5m count:2 2024-09-17T00:59:10.934 INFO:teuthology.orchestra.run.smithi002.stdout:mon 2/2 2m ago 4m smithi002:172.21.15.2=smithi002;smithi099:172.21.15.99=smithi099;count:2 2024-09-17T00:59:10.934 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-17T00:59:10.934 INFO:teuthology.orchestra.run.smithi002.stdout:osd 6 2m ago - 2024-09-17T00:59:10.934 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-17T00:59:10.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.937+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/3016669823 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fbdb806ed60 msgr2=0x7fbdb8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:10.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.937+0000 7fbdd3a2c640 1 --2- 172.21.15.2:0/3016669823 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fbdb806ed60 0x7fbdb8071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbdc002a530 tx=0x7fbdc0009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.937+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/3016669823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc0fb480 msgr2=0x7fbdcc10d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.937+0000 7fbdd3a2c640 1 --2- 172.21.15.2:0/3016669823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc0fb480 0x7fbdcc10d100 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8002a80 tx=0x7fbdc8004600 comp rx=0 tx=0).stop 2024-09-17T00:59:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.937+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/3016669823 shutdown_connections 2024-09-17T00:59:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.937+0000 7fbdd3a2c640 1 --2- 172.21.15.2:0/3016669823 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fbdb806ed60 0x7fbdb8071210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.937+0000 7fbdd3a2c640 1 --2- 172.21.15.2:0/3016669823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdcc0fc750 0x7fbdcc10d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.937+0000 7fbdd3a2c640 1 --2- 172.21.15.2:0/3016669823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdcc0fb480 0x7fbdcc10d100 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.937+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/3016669823 >> 172.21.15.2:0/3016669823 conn(0x7fbdcc0f6c40 msgr2=0x7fbdcc066120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.937+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/3016669823 shutdown_connections 2024-09-17T00:59:10.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:10.937+0000 7fbdd3a2c640 1 -- 172.21.15.2:0/3016669823 wait complete. 2024-09-17T00:59:11.565 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:11 smithi002 ceph-mon[27650]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:11.592 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-17T00:59:11.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:11 smithi099 ceph-mon[34357]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:11.850 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:12.483 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:12 smithi002 ceph-mon[27650]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:12.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:12 smithi099 ceph-mon[34357]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:13.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.400+0000 7f347c2a1640 1 -- 172.21.15.2:0/1156156758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34740ff750 msgr2=0x7f3474101b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:13.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.400+0000 7f347c2a1640 1 --2- 172.21.15.2:0/1156156758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34740ff750 0x7f3474101b30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f34640048d0 tx=0x7f3464009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:13.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.400+0000 7f347c2a1640 1 -- 172.21.15.2:0/1156156758 shutdown_connections 2024-09-17T00:59:13.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.400+0000 7f347c2a1640 1 --2- 172.21.15.2:0/1156156758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34740ff750 0x7f3474101b30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:13.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.400+0000 7f347c2a1640 1 --2- 172.21.15.2:0/1156156758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3474066690 0x7f34740ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:13.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.400+0000 7f347c2a1640 1 -- 172.21.15.2:0/1156156758 >> 172.21.15.2:0/1156156758 conn(0x7f34740f6c40 msgr2=0x7f34740f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:13.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.400+0000 7f347c2a1640 1 -- 172.21.15.2:0/1156156758 shutdown_connections 2024-09-17T00:59:13.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.401+0000 7f347c2a1640 1 -- 172.21.15.2:0/1156156758 wait complete. 2024-09-17T00:59:13.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.401+0000 7f347c2a1640 1 Processor -- start 2024-09-17T00:59:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.401+0000 7f347c2a1640 1 -- start start 2024-09-17T00:59:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.401+0000 7f347c2a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3474066690 0x7f34740fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.401+0000 7f347c2a1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34740ff750 0x7f34740fb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.401+0000 7f347c2a1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34740fb6e0 con 0x7f3474066690 2024-09-17T00:59:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.401+0000 7f347c2a1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34740fb820 con 0x7f34740ff750 2024-09-17T00:59:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.401+0000 7f347a03d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3474066690 0x7f34740fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.401+0000 7f347a03d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3474066690 0x7f34740fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41524/0 (socket says 172.21.15.2:41524) 2024-09-17T00:59:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.401+0000 7f347a03d640 1 -- 172.21.15.2:0/124727031 learned_addr learned my addr 172.21.15.2:0/124727031 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.402+0000 7f347983c640 1 --2- 172.21.15.2:0/124727031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34740ff750 0x7f34740fb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.402+0000 7f347a03d640 1 -- 172.21.15.2:0/124727031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34740ff750 msgr2=0x7f34740fb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.402+0000 7f347a03d640 1 --2- 172.21.15.2:0/124727031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34740ff750 0x7f34740fb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.402+0000 7f347a03d640 1 -- 172.21.15.2:0/124727031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464005040 con 0x7f3474066690 2024-09-17T00:59:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.402+0000 7f347a03d640 1 --2- 172.21.15.2:0/124727031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3474066690 0x7f34740fcbd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f347000b580 tx=0x7f34700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.402+0000 7f346affd640 1 -- 172.21.15.2:0/124727031 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f347000f570 con 0x7f3474066690 2024-09-17T00:59:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.402+0000 7f346affd640 1 -- 172.21.15.2:0/124727031 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f347000fb70 con 0x7f3474066690 2024-09-17T00:59:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.402+0000 7f347c2a1640 1 -- 172.21.15.2:0/124727031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34740fbb00 con 0x7f3474066690 2024-09-17T00:59:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.402+0000 7f346affd640 1 -- 172.21.15.2:0/124727031 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3470010d40 con 0x7f3474066690 2024-09-17T00:59:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.402+0000 7f347c2a1640 1 -- 172.21.15.2:0/124727031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3474115280 con 0x7f3474066690 2024-09-17T00:59:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.403+0000 7f347c2a1640 1 -- 172.21.15.2:0/124727031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34740fa8e0 con 0x7f3474066690 2024-09-17T00:59:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.404+0000 7f346affd640 1 -- 172.21.15.2:0/124727031 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f347000fce0 con 0x7f3474066690 2024-09-17T00:59:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.404+0000 7f346affd640 1 --2- 172.21.15.2:0/124727031 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f346006ed60 0x7f3460071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.404+0000 7f347983c640 1 --2- 172.21.15.2:0/124727031 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f346006ed60 0x7f3460071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.404+0000 7f346affd640 1 -- 172.21.15.2:0/124727031 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f347008dc50 con 0x7f3474066690 2024-09-17T00:59:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.405+0000 7f347983c640 1 --2- 172.21.15.2:0/124727031 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f346006ed60 0x7f3460071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3464007ac0 tx=0x7f3464035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.409+0000 7f346affd640 1 -- 172.21.15.2:0/124727031 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f347005b1d0 con 0x7f3474066690 2024-09-17T00:59:13.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.582+0000 7f347c2a1640 1 -- 172.21.15.2:0/124727031 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f34740f8780 con 0x7f346006ed60 2024-09-17T00:59:13.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.583+0000 7f346affd640 1 -- 172.21.15.2:0/124727031 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+145 (secure 0 0 0) 0x7f34740f8780 con 0x7f346006ed60 2024-09-17T00:59:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:HOST ADDR LABELS STATUS 2024-09-17T00:59:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 172.21.15.2 2024-09-17T00:59:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:smithi099 172.21.15.99 2024-09-17T00:59:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:2 hosts in cluster 2024-09-17T00:59:13.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.585+0000 7f347c2a1640 1 -- 172.21.15.2:0/124727031 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f346006ed60 msgr2=0x7f3460071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.585+0000 7f347c2a1640 1 --2- 172.21.15.2:0/124727031 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f346006ed60 0x7f3460071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3464007ac0 tx=0x7f3464035040 comp rx=0 tx=0).stop 2024-09-17T00:59:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.585+0000 7f347c2a1640 1 -- 172.21.15.2:0/124727031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3474066690 msgr2=0x7f34740fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.585+0000 7f347c2a1640 1 --2- 172.21.15.2:0/124727031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3474066690 0x7f34740fcbd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f347000b580 tx=0x7f34700091a0 comp rx=0 tx=0).stop 2024-09-17T00:59:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.585+0000 7f347c2a1640 1 -- 172.21.15.2:0/124727031 shutdown_connections 2024-09-17T00:59:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.585+0000 7f347c2a1640 1 --2- 172.21.15.2:0/124727031 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f346006ed60 0x7f3460071210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.585+0000 7f347c2a1640 1 --2- 172.21.15.2:0/124727031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34740ff750 0x7f34740fb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.585+0000 7f347c2a1640 1 --2- 172.21.15.2:0/124727031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3474066690 0x7f34740fcbd0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.585+0000 7f347c2a1640 1 -- 172.21.15.2:0/124727031 >> 172.21.15.2:0/124727031 conn(0x7f34740f6c40 msgr2=0x7f34740f7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.585+0000 7f347c2a1640 1 -- 172.21.15.2:0/124727031 shutdown_connections 2024-09-17T00:59:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:13.585+0000 7f347c2a1640 1 -- 172.21.15.2:0/124727031 wait complete. 2024-09-17T00:59:13.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:13 smithi099 ceph-mon[34357]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:13.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:13 smithi002 ceph-mon[27650]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:14.217 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-17T00:59:14.479 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:14.717 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:14 smithi002 ceph-mon[27650]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:14.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:14 smithi099 ceph-mon[34357]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:15.570 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:15 smithi002 ceph-mon[27650]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:15.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:15 smithi099 ceph-mon[34357]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.070+0000 7f87d0211640 1 -- 172.21.15.2:0/251172205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c80fc3a0 msgr2=0x7f87c80fc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.070+0000 7f87d0211640 1 --2- 172.21.15.2:0/251172205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c80fc3a0 0x7f87c80fc810 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f87c40048d0 tx=0x7f87c4009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.070+0000 7f87d0211640 1 -- 172.21.15.2:0/251172205 shutdown_connections 2024-09-17T00:59:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.070+0000 7f87d0211640 1 --2- 172.21.15.2:0/251172205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c80fc3a0 0x7f87c80fc810 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.070+0000 7f87d0211640 1 --2- 172.21.15.2:0/251172205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87c80fba50 0x7f87c80fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.070+0000 7f87d0211640 1 -- 172.21.15.2:0/251172205 >> 172.21.15.2:0/251172205 conn(0x7f87c80f63a0 msgr2=0x7f87c80f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.071+0000 7f87d0211640 1 -- 172.21.15.2:0/251172205 shutdown_connections 2024-09-17T00:59:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.071+0000 7f87d0211640 1 -- 172.21.15.2:0/251172205 wait complete. 2024-09-17T00:59:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.071+0000 7f87d0211640 1 Processor -- start 2024-09-17T00:59:16.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.071+0000 7f87d0211640 1 -- start start 2024-09-17T00:59:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.071+0000 7f87d0211640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c80fba50 0x7f87c810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.071+0000 7f87d0211640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87c80fc3a0 0x7f87c810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.071+0000 7f87d0211640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c810dc00 con 0x7f87c80fba50 2024-09-17T00:59:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.071+0000 7f87d0211640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c810e420 con 0x7f87c80fc3a0 2024-09-17T00:59:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.071+0000 7f87cdfad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c80fba50 0x7f87c810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.071+0000 7f87cdfad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c80fba50 0x7f87c810d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41536/0 (socket says 172.21.15.2:41536) 2024-09-17T00:59:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.071+0000 7f87cdfad640 1 -- 172.21.15.2:0/1818057416 learned_addr learned my addr 172.21.15.2:0/1818057416 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.072+0000 7f87cd7ac640 1 --2- 172.21.15.2:0/1818057416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87c80fc3a0 0x7f87c810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.072+0000 7f87cdfad640 1 -- 172.21.15.2:0/1818057416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87c80fc3a0 msgr2=0x7f87c810d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.072+0000 7f87cdfad640 1 --2- 172.21.15.2:0/1818057416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87c80fc3a0 0x7f87c810d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.072+0000 7f87cdfad640 1 -- 172.21.15.2:0/1818057416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c4005040 con 0x7f87c80fba50 2024-09-17T00:59:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.072+0000 7f87cd7ac640 1 --2- 172.21.15.2:0/1818057416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87c80fc3a0 0x7f87c810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T00:59:16.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.072+0000 7f87cdfad640 1 --2- 172.21.15.2:0/1818057416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c80fba50 0x7f87c810d070 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00c810 tx=0x7f87bc0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.072+0000 7f87ba7fc640 1 -- 172.21.15.2:0/1818057416 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87bc00a820 con 0x7f87c80fba50 2024-09-17T00:59:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.072+0000 7f87ba7fc640 1 -- 172.21.15.2:0/1818057416 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f87bc00ae20 con 0x7f87c80fba50 2024-09-17T00:59:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.072+0000 7f87d0211640 1 -- 172.21.15.2:0/1818057416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c810e6b0 con 0x7f87c80fba50 2024-09-17T00:59:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.072+0000 7f87ba7fc640 1 -- 172.21.15.2:0/1818057416 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87bc011380 con 0x7f87c80fba50 2024-09-17T00:59:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.072+0000 7f87d0211640 1 -- 172.21.15.2:0/1818057416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c810ec50 con 0x7f87c80fba50 2024-09-17T00:59:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.073+0000 7f87d0211640 1 -- 172.21.15.2:0/1818057416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c80fa040 con 0x7f87c80fba50 2024-09-17T00:59:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.074+0000 7f87ba7fc640 1 -- 172.21.15.2:0/1818057416 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f87bc012420 con 0x7f87c80fba50 2024-09-17T00:59:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.074+0000 7f87ba7fc640 1 --2- 172.21.15.2:0/1818057416 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f87b406ed60 0x7f87b4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.074+0000 7f87ba7fc640 1 -- 172.21.15.2:0/1818057416 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f87bc08e420 con 0x7f87c80fba50 2024-09-17T00:59:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.074+0000 7f87cd7ac640 1 --2- 172.21.15.2:0/1818057416 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f87b406ed60 0x7f87b4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:16.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.075+0000 7f87cd7ac640 1 --2- 172.21.15.2:0/1818057416 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f87b406ed60 0x7f87b4071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f87c400b020 tx=0x7f87c4009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:16.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.078+0000 7f87ba7fc640 1 -- 172.21.15.2:0/1818057416 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f87bc05b9c0 con 0x7f87c80fba50 2024-09-17T00:59:16.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.249+0000 7f87d0211640 1 -- 172.21.15.2:0/1818057416 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f87c8104020 con 0x7f87b406ed60 2024-09-17T00:59:16.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.251+0000 7f87ba7fc640 1 -- 172.21.15.2:0/1818057416 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f87c402ab20 con 0x7f87b406ed60 2024-09-17T00:59:16.249 INFO:teuthology.orchestra.run.smithi002.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-17T00:59:16.249 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EV480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-17T00:59:16.250 INFO:teuthology.orchestra.run.smithi002.stdout:smithi099 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040101400BGN 372G No 74s ago Has a FileSystem, LVM detected 2024-09-17T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.253+0000 7f87d0211640 1 -- 172.21.15.2:0/1818057416 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f87b406ed60 msgr2=0x7f87b4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.253+0000 7f87d0211640 1 --2- 172.21.15.2:0/1818057416 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f87b406ed60 0x7f87b4071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f87c400b020 tx=0x7f87c4009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.253+0000 7f87d0211640 1 -- 172.21.15.2:0/1818057416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c80fba50 msgr2=0x7f87c810d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.253+0000 7f87d0211640 1 --2- 172.21.15.2:0/1818057416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c80fba50 0x7f87c810d070 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00c810 tx=0x7f87bc0043c0 comp rx=0 tx=0).stop 2024-09-17T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.253+0000 7f87d0211640 1 -- 172.21.15.2:0/1818057416 shutdown_connections 2024-09-17T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.253+0000 7f87d0211640 1 --2- 172.21.15.2:0/1818057416 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f87b406ed60 0x7f87b4071210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.253+0000 7f87d0211640 1 --2- 172.21.15.2:0/1818057416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87c80fc3a0 0x7f87c810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.253+0000 7f87d0211640 1 --2- 172.21.15.2:0/1818057416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87c80fba50 0x7f87c810d070 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.253+0000 7f87d0211640 1 -- 172.21.15.2:0/1818057416 >> 172.21.15.2:0/1818057416 conn(0x7f87c80f63a0 msgr2=0x7f87c80fad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.253+0000 7f87d0211640 1 -- 172.21.15.2:0/1818057416 shutdown_connections 2024-09-17T00:59:16.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:16.253+0000 7f87d0211640 1 -- 172.21.15.2:0/1818057416 wait complete. 2024-09-17T00:59:16.855 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T00:59:16.865 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T00:59:16.865 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-17T00:59:17.121 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:17.572 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:17 smithi002 ceph-mon[27650]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:17.573 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:17 smithi002 ceph-mon[27650]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:17.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:17 smithi099 ceph-mon[34357]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:17.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:17 smithi099 ceph-mon[34357]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:18.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.794+0000 7f6943926640 1 -- 172.21.15.2:0/2148329074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c066690 msgr2=0x7f693c0ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:18.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.794+0000 7f6943926640 1 --2- 172.21.15.2:0/2148329074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c066690 0x7f693c0ff210 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6938009c50 tx=0x7f6938004d10 comp rx=0 tx=0).stop 2024-09-17T00:59:18.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.794+0000 7f6943926640 1 -- 172.21.15.2:0/2148329074 shutdown_connections 2024-09-17T00:59:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.794+0000 7f6943926640 1 --2- 172.21.15.2:0/2148329074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f693c0ff750 0x7f693c101b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.794+0000 7f6943926640 1 --2- 172.21.15.2:0/2148329074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c066690 0x7f693c0ff210 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.794+0000 7f6943926640 1 -- 172.21.15.2:0/2148329074 >> 172.21.15.2:0/2148329074 conn(0x7f693c0f6c40 msgr2=0x7f693c0f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.794+0000 7f6943926640 1 -- 172.21.15.2:0/2148329074 shutdown_connections 2024-09-17T00:59:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.794+0000 7f6943926640 1 -- 172.21.15.2:0/2148329074 wait complete. 2024-09-17T00:59:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.795+0000 7f6943926640 1 Processor -- start 2024-09-17T00:59:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.795+0000 7f6943926640 1 -- start start 2024-09-17T00:59:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.795+0000 7f6943926640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c066690 0x7f693c10d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.795+0000 7f6943926640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f693c0ff750 0x7f693c10d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.795+0000 7f6943926640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c10dd10 con 0x7f693c066690 2024-09-17T00:59:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.795+0000 7f6943926640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c10e4e0 con 0x7f693c0ff750 2024-09-17T00:59:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.795+0000 7f69416c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c066690 0x7f693c10d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:18.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.795+0000 7f69416c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c066690 0x7f693c10d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41566/0 (socket says 172.21.15.2:41566) 2024-09-17T00:59:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.795+0000 7f69416c2640 1 -- 172.21.15.2:0/3354912504 learned_addr learned my addr 172.21.15.2:0/3354912504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.795+0000 7f6940ec1640 1 --2- 172.21.15.2:0/3354912504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f693c0ff750 0x7f693c10d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.795+0000 7f69416c2640 1 -- 172.21.15.2:0/3354912504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f693c0ff750 msgr2=0x7f693c10d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.796+0000 7f69416c2640 1 --2- 172.21.15.2:0/3354912504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f693c0ff750 0x7f693c10d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.796+0000 7f69416c2640 1 -- 172.21.15.2:0/3354912504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69380098b0 con 0x7f693c066690 2024-09-17T00:59:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.796+0000 7f6940ec1640 1 --2- 172.21.15.2:0/3354912504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f693c0ff750 0x7f693c10d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T00:59:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.796+0000 7f69416c2640 1 --2- 172.21.15.2:0/3354912504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c066690 0x7f693c10d180 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6938000f80 tx=0x7f6938004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.796+0000 7f692dffb640 1 -- 172.21.15.2:0/3354912504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6938009710 con 0x7f693c066690 2024-09-17T00:59:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.796+0000 7f6943926640 1 -- 172.21.15.2:0/3354912504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693c10e710 con 0x7f693c066690 2024-09-17T00:59:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.796+0000 7f692dffb640 1 -- 172.21.15.2:0/3354912504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6938032b10 con 0x7f693c066690 2024-09-17T00:59:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.796+0000 7f692dffb640 1 -- 172.21.15.2:0/3354912504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f693803db30 con 0x7f693c066690 2024-09-17T00:59:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.796+0000 7f6943926640 1 -- 172.21.15.2:0/3354912504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693c10ecb0 con 0x7f693c066690 2024-09-17T00:59:18.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.797+0000 7f6943926640 1 -- 172.21.15.2:0/3354912504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693c0fa8e0 con 0x7f693c066690 2024-09-17T00:59:18.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.798+0000 7f692dffb640 1 -- 172.21.15.2:0/3354912504 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f693802f030 con 0x7f693c066690 2024-09-17T00:59:18.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.798+0000 7f692dffb640 1 --2- 172.21.15.2:0/3354912504 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f692806ed60 0x7f6928071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:18.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.798+0000 7f692dffb640 1 -- 172.21.15.2:0/3354912504 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f69380af0e0 con 0x7f693c066690 2024-09-17T00:59:18.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.798+0000 7f6940ec1640 1 --2- 172.21.15.2:0/3354912504 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f692806ed60 0x7f6928071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:18.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.799+0000 7f6940ec1640 1 --2- 172.21.15.2:0/3354912504 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f692806ed60 0x7f6928071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6930007fd0 tx=0x7f6930009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:18.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.803+0000 7f692dffb640 1 -- 172.21.15.2:0/3354912504 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f693807c540 con 0x7f693c066690 2024-09-17T00:59:18.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:18.991+0000 7f6943926640 1 -- 172.21.15.2:0/3354912504 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f693c10efe0 con 0x7f692806ed60 2024-09-17T00:59:19.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:19 smithi099 ceph-mon[34357]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:19.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:19 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-17T00:59:19.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:19 smithi002 ceph-mon[27650]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:19.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:19 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-17T00:59:20.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:20.510+0000 7f692dffb640 1 -- 172.21.15.2:0/3354912504 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f693c10efe0 con 0x7f692806ed60 2024-09-17T00:59:20.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:20.515+0000 7f6943926640 1 -- 172.21.15.2:0/3354912504 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f692806ed60 msgr2=0x7f6928071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:20.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:20.515+0000 7f6943926640 1 --2- 172.21.15.2:0/3354912504 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f692806ed60 0x7f6928071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6930007fd0 tx=0x7f6930009040 comp rx=0 tx=0).stop 2024-09-17T00:59:20.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:20.515+0000 7f6943926640 1 -- 172.21.15.2:0/3354912504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c066690 msgr2=0x7f693c10d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:20.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:20.515+0000 7f6943926640 1 --2- 172.21.15.2:0/3354912504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c066690 0x7f693c10d180 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6938000f80 tx=0x7f6938004d10 comp rx=0 tx=0).stop 2024-09-17T00:59:20.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:20.515+0000 7f6943926640 1 -- 172.21.15.2:0/3354912504 shutdown_connections 2024-09-17T00:59:20.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:20.515+0000 7f6943926640 1 --2- 172.21.15.2:0/3354912504 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f692806ed60 0x7f6928071210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:20.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:20.515+0000 7f6943926640 1 --2- 172.21.15.2:0/3354912504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f693c0ff750 0x7f693c10d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:20.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:20.515+0000 7f6943926640 1 --2- 172.21.15.2:0/3354912504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f693c066690 0x7f693c10d180 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:20.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:20.515+0000 7f6943926640 1 -- 172.21.15.2:0/3354912504 >> 172.21.15.2:0/3354912504 conn(0x7f693c0f6c40 msgr2=0x7f693c0f7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:20.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:20.515+0000 7f6943926640 1 -- 172.21.15.2:0/3354912504 shutdown_connections 2024-09-17T00:59:20.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:20.515+0000 7f6943926640 1 -- 172.21.15.2:0/3354912504 wait complete. 2024-09-17T00:59:20.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:20 smithi099 ceph-mon[34357]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:20.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:20 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-17T00:59:20.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:20 smithi099 ceph-mon[34357]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T00:59:20.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:20 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-17T00:59:20.859 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:20 smithi002 ceph-mon[27650]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T00:59:20.860 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:20 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-17T00:59:20.860 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:20 smithi002 ceph-mon[27650]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T00:59:20.860 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:20 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-17T00:59:20.860 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:20 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[27646]: 2024-09-17T00:59:20.484+0000 7fa9ceed9640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T00:59:21.158 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T00:59:21.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: pgmap v169: 33 pgs: 17 creating+peering, 1 active+clean, 15 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:21.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T00:59:21.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-17T00:59:21.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T00:59:21.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-17T00:59:21.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T00:59:21.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T00:59:21.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T00:59:21.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-17T00:59:21.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: fsmap cephfs:0 2024-09-17T00:59:21.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: Saving service mds.cephfs spec with placement count:4 2024-09-17T00:59:21.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:21.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:59:21.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:21.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:21.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:21.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.zmrgxd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T00:59:21.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.zmrgxd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T00:59:21.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:21.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: Deploying daemon mds.cephfs.smithi002.zmrgxd on smithi002 2024-09-17T00:59:21.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:21.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:59:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: pgmap v169: 33 pgs: 17 creating+peering, 1 active+clean, 15 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T00:59:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-17T00:59:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T00:59:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-17T00:59:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T00:59:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T00:59:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T00:59:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-17T00:59:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: fsmap cephfs:0 2024-09-17T00:59:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: Saving service mds.cephfs spec with placement count:4 2024-09-17T00:59:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:59:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.zmrgxd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T00:59:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.zmrgxd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T00:59:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: Deploying daemon mds.cephfs.smithi002.zmrgxd on smithi002 2024-09-17T00:59:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:21.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:59:22.061 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:22.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:22 smithi099 ceph-mon[34357]: osdmap e42: 6 total, 6 up, 6 in 2024-09-17T00:59:22.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:22 smithi002 ceph-mon[27650]: osdmap e42: 6 total, 6 up, 6 in 2024-09-17T00:59:23.496 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:23 smithi002 ceph-mon[27650]: pgmap v173: 65 pgs: 28 creating+peering, 6 active+clean, 31 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:23.496 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:23 smithi002 ceph-mon[27650]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-17T00:59:23.496 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:23 smithi002 ceph-mon[27650]: osdmap e43: 6 total, 6 up, 6 in 2024-09-17T00:59:23.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:23 smithi099 ceph-mon[34357]: pgmap v173: 65 pgs: 28 creating+peering, 6 active+clean, 31 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:23.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:23 smithi099 ceph-mon[34357]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-17T00:59:23.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:23 smithi099 ceph-mon[34357]: osdmap e43: 6 total, 6 up, 6 in 2024-09-17T00:59:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.317+0000 7fa326aa1640 1 -- 172.21.15.2:0/3019876557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3200fb430 msgr2=0x7fa3200fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.317+0000 7fa326aa1640 1 --2- 172.21.15.2:0/3019876557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3200fb430 0x7fa3200fb840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0048d0 tx=0x7fa31c009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.317+0000 7fa326aa1640 1 -- 172.21.15.2:0/3019876557 shutdown_connections 2024-09-17T00:59:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.317+0000 7fa326aa1640 1 --2- 172.21.15.2:0/3019876557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3200fc700 0x7fa3200fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.317+0000 7fa326aa1640 1 --2- 172.21.15.2:0/3019876557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3200fb430 0x7fa3200fb840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:24.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.317+0000 7fa326aa1640 1 -- 172.21.15.2:0/3019876557 >> 172.21.15.2:0/3019876557 conn(0x7fa3200f6c10 msgr2=0x7fa3200f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.317+0000 7fa326aa1640 1 -- 172.21.15.2:0/3019876557 shutdown_connections 2024-09-17T00:59:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.317+0000 7fa326aa1640 1 -- 172.21.15.2:0/3019876557 wait complete. 2024-09-17T00:59:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.318+0000 7fa326aa1640 1 Processor -- start 2024-09-17T00:59:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.318+0000 7fa326aa1640 1 -- start start 2024-09-17T00:59:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.318+0000 7fa326aa1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3200fb430 0x7fa3200ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.318+0000 7fa326aa1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3200fc700 0x7fa3200fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.318+0000 7fa326aa1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200fdfd0 con 0x7fa3200fb430 2024-09-17T00:59:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.318+0000 7fa326aa1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200fe110 con 0x7fa3200fc700 2024-09-17T00:59:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.318+0000 7fa32483d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3200fb430 0x7fa3200ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.318+0000 7fa32483d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3200fb430 0x7fa3200ff550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35718/0 (socket says 172.21.15.2:35718) 2024-09-17T00:59:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.318+0000 7fa32483d640 1 -- 172.21.15.2:0/722682538 learned_addr learned my addr 172.21.15.2:0/722682538 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.319+0000 7fa317fff640 1 --2- 172.21.15.2:0/722682538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3200fc700 0x7fa3200fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:24.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.319+0000 7fa32483d640 1 -- 172.21.15.2:0/722682538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3200fc700 msgr2=0x7fa3200fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.319+0000 7fa32483d640 1 --2- 172.21.15.2:0/722682538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3200fc700 0x7fa3200fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.319+0000 7fa32483d640 1 -- 172.21.15.2:0/722682538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c005040 con 0x7fa3200fb430 2024-09-17T00:59:24.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.319+0000 7fa32483d640 1 --2- 172.21.15.2:0/722682538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3200fb430 0x7fa3200ff550 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0043d0 tx=0x7fa31c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.319+0000 7fa3157fa640 1 -- 172.21.15.2:0/722682538 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa31c038070 con 0x7fa3200fb430 2024-09-17T00:59:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.319+0000 7fa326aa1640 1 -- 172.21.15.2:0/722682538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3200fe390 con 0x7fa3200fb430 2024-09-17T00:59:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.319+0000 7fa3157fa640 1 -- 172.21.15.2:0/722682538 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa31c02ae90 con 0x7fa3200fb430 2024-09-17T00:59:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.319+0000 7fa3157fa640 1 -- 172.21.15.2:0/722682538 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa31c03e670 con 0x7fa3200fb430 2024-09-17T00:59:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.319+0000 7fa326aa1640 1 -- 172.21.15.2:0/722682538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3201150d0 con 0x7fa3200fb430 2024-09-17T00:59:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.321+0000 7fa326aa1640 1 -- 172.21.15.2:0/722682538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3200fa890 con 0x7fa3200fb430 2024-09-17T00:59:24.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.321+0000 7fa3157fa640 1 -- 172.21.15.2:0/722682538 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fa31c030020 con 0x7fa3200fb430 2024-09-17T00:59:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.321+0000 7fa3157fa640 1 --2- 172.21.15.2:0/722682538 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fa30806ed60 0x7fa308071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.322+0000 7fa3157fa640 1 -- 172.21.15.2:0/722682538 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa31c0ae3a0 con 0x7fa3200fb430 2024-09-17T00:59:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.322+0000 7fa317fff640 1 --2- 172.21.15.2:0/722682538 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fa30806ed60 0x7fa308071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:24.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.322+0000 7fa317fff640 1 --2- 172.21.15.2:0/722682538 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fa30806ed60 0x7fa308071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa310004ed0 tx=0x7fa31000b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:24.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.326+0000 7fa3157fa640 1 -- 172.21.15.2:0/722682538 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa31c07b570 con 0x7fa3200fb430 2024-09-17T00:59:24.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.529+0000 7fa326aa1640 1 -- 172.21.15.2:0/722682538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa320103ef0 con 0x7fa3200fb430 2024-09-17T00:59:24.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.529+0000 7fa3157fa640 1 -- 172.21.15.2:0/722682538 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fa31c07af10 con 0x7fa3200fb430 2024-09-17T00:59:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:e2 2024-09-17T00:59:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T00:59:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T00:59:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-17T00:59:24.528 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:59:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-17T00:59:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-17T00:59:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 2 2024-09-17T00:59:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T00:59:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-17T00:59:20.485696+0000 2024-09-17T00:59:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-17T00:59:20.485758+0000 2024-09-17T00:59:24.528 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-17T00:59:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-17T00:59:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-17T00:59:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-17T00:59:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-17T00:59:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-17T00:59:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-17T00:59:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 0 2024-09-17T00:59:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T00:59:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2024-09-17T00:59:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:in 2024-09-17T00:59:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:up {} 2024-09-17T00:59:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-17T00:59:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-17T00:59:24.529 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-17T00:59:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-17T00:59:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-17T00:59:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data disabled 2024-09-17T00:59:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-17T00:59:24.530 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 0 2024-09-17T00:59:24.530 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:59:24.530 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:59:24.531 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2024-09-17T00:59:24.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.531+0000 7fa326aa1640 1 -- 172.21.15.2:0/722682538 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fa30806ed60 msgr2=0x7fa308071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:24.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.531+0000 7fa326aa1640 1 --2- 172.21.15.2:0/722682538 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fa30806ed60 0x7fa308071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa310004ed0 tx=0x7fa31000b040 comp rx=0 tx=0).stop 2024-09-17T00:59:24.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.531+0000 7fa326aa1640 1 -- 172.21.15.2:0/722682538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3200fb430 msgr2=0x7fa3200ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:24.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.531+0000 7fa326aa1640 1 --2- 172.21.15.2:0/722682538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3200fb430 0x7fa3200ff550 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0043d0 tx=0x7fa31c009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:24.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.531+0000 7fa326aa1640 1 -- 172.21.15.2:0/722682538 shutdown_connections 2024-09-17T00:59:24.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.531+0000 7fa326aa1640 1 --2- 172.21.15.2:0/722682538 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fa30806ed60 0x7fa308071210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:24.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.531+0000 7fa326aa1640 1 --2- 172.21.15.2:0/722682538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3200fc700 0x7fa3200fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:24.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.531+0000 7fa326aa1640 1 --2- 172.21.15.2:0/722682538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3200fb430 0x7fa3200ff550 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:24.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.531+0000 7fa326aa1640 1 -- 172.21.15.2:0/722682538 >> 172.21.15.2:0/722682538 conn(0x7fa3200f6c10 msgr2=0x7fa3200655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:24.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.531+0000 7fa326aa1640 1 -- 172.21.15.2:0/722682538 shutdown_connections 2024-09-17T00:59:24.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:24.531+0000 7fa326aa1640 1 -- 172.21.15.2:0/722682538 wait complete. 2024-09-17T00:59:25.186 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T00:59:25.196 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T00:59:25.196 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-17T00:59:25.468 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:25.589 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:25 smithi002 ceph-mon[27650]: pgmap v175: 65 pgs: 28 creating+peering, 18 active+clean, 19 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:25.589 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:25 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/722682538' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T00:59:25.589 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:25 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:25.590 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:25 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:25.590 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:25 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:25.590 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:25 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.hgawhu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T00:59:25.590 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:25 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.hgawhu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T00:59:25.590 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:25 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:25.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:25 smithi099 ceph-mon[34357]: pgmap v175: 65 pgs: 28 creating+peering, 18 active+clean, 19 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:25.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:25 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/722682538' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T00:59:25.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:25 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:25.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:25 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:25.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:25 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:25.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:25 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.hgawhu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T00:59:25.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:25 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.hgawhu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T00:59:25.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:25 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:26.551 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:26 smithi002 ceph-mon[27650]: Deploying daemon mds.cephfs.smithi099.hgawhu on smithi099 2024-09-17T00:59:26.551 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:26 smithi002 ceph-mon[27650]: mds.? [v2:172.21.15.2:6826/2460632811,v1:172.21.15.2:6827/2460632811] up:boot 2024-09-17T00:59:26.551 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:26 smithi002 ceph-mon[27650]: daemon mds.cephfs.smithi002.zmrgxd assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-17T00:59:26.551 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:26 smithi002 ceph-mon[27650]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T00:59:26.551 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:26 smithi002 ceph-mon[27650]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T00:59:26.551 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:26 smithi002 ceph-mon[27650]: Cluster is now healthy 2024-09-17T00:59:26.551 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:26 smithi002 ceph-mon[27650]: fsmap cephfs:0 1 up:standby 2024-09-17T00:59:26.551 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:26 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T00:59:26.551 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:26 smithi002 ceph-mon[27650]: fsmap cephfs:1 {0=cephfs.smithi002.zmrgxd=up:creating} 2024-09-17T00:59:26.552 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:26 smithi002 ceph-mon[27650]: daemon mds.cephfs.smithi002.zmrgxd is now active in filesystem cephfs as rank 0 2024-09-17T00:59:26.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:26 smithi099 ceph-mon[34357]: Deploying daemon mds.cephfs.smithi099.hgawhu on smithi099 2024-09-17T00:59:26.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:26 smithi099 ceph-mon[34357]: mds.? [v2:172.21.15.2:6826/2460632811,v1:172.21.15.2:6827/2460632811] up:boot 2024-09-17T00:59:26.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:26 smithi099 ceph-mon[34357]: daemon mds.cephfs.smithi002.zmrgxd assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-17T00:59:26.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:26 smithi099 ceph-mon[34357]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T00:59:26.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:26 smithi099 ceph-mon[34357]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T00:59:26.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:26 smithi099 ceph-mon[34357]: Cluster is now healthy 2024-09-17T00:59:26.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:26 smithi099 ceph-mon[34357]: fsmap cephfs:0 1 up:standby 2024-09-17T00:59:26.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:26 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T00:59:26.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:26 smithi099 ceph-mon[34357]: fsmap cephfs:1 {0=cephfs.smithi002.zmrgxd=up:creating} 2024-09-17T00:59:26.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:26 smithi099 ceph-mon[34357]: daemon mds.cephfs.smithi002.zmrgxd is now active in filesystem cephfs as rank 0 2024-09-17T00:59:27.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.006+0000 7f9a9998d640 1 -- 172.21.15.2:0/479874300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a940fd7f0 msgr2=0x7f9a940fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.006+0000 7f9a9998d640 1 --2- 172.21.15.2:0/479874300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a940fd7f0 0x7f9a940fdc60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0048d0 tx=0x7f9a7c009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.006+0000 7f9a9998d640 1 -- 172.21.15.2:0/479874300 shutdown_connections 2024-09-17T00:59:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.006+0000 7f9a9998d640 1 --2- 172.21.15.2:0/479874300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a940fd7f0 0x7f9a940fdc60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.006+0000 7f9a9998d640 1 --2- 172.21.15.2:0/479874300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a940fc520 0x7f9a940fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.006+0000 7f9a9998d640 1 -- 172.21.15.2:0/479874300 >> 172.21.15.2:0/479874300 conn(0x7f9a940f7ce0 msgr2=0x7f9a940fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.006+0000 7f9a9998d640 1 -- 172.21.15.2:0/479874300 shutdown_connections 2024-09-17T00:59:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.006+0000 7f9a9998d640 1 -- 172.21.15.2:0/479874300 wait complete. 2024-09-17T00:59:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.006+0000 7f9a9998d640 1 Processor -- start 2024-09-17T00:59:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.006+0000 7f9a9998d640 1 -- start start 2024-09-17T00:59:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a9998d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a940fc520 0x7f9a9410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a9998d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a940fd7f0 0x7f9a9410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:27.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a9998d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9410e490 con 0x7f9a940fd7f0 2024-09-17T00:59:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a9998d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9410e600 con 0x7f9a940fc520 2024-09-17T00:59:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a927fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a940fd7f0 0x7f9a9410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a927fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a940fd7f0 0x7f9a9410d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35736/0 (socket says 172.21.15.2:35736) 2024-09-17T00:59:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a927fc640 1 -- 172.21.15.2:0/3191464632 learned_addr learned my addr 172.21.15.2:0/3191464632 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a92ffd640 1 --2- 172.21.15.2:0/3191464632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a940fc520 0x7f9a9410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a927fc640 1 -- 172.21.15.2:0/3191464632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a940fc520 msgr2=0x7f9a9410d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a927fc640 1 --2- 172.21.15.2:0/3191464632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a940fc520 0x7f9a9410d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a927fc640 1 -- 172.21.15.2:0/3191464632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c005040 con 0x7f9a940fd7f0 2024-09-17T00:59:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a927fc640 1 --2- 172.21.15.2:0/3191464632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a940fd7f0 0x7f9a9410d620 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c003080 tx=0x7f9a7c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a8b7fe640 1 -- 172.21.15.2:0/3191464632 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a7c038070 con 0x7f9a940fd7f0 2024-09-17T00:59:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a8b7fe640 1 -- 172.21.15.2:0/3191464632 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9a7c02abd0 con 0x7f9a940fd7f0 2024-09-17T00:59:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a9998d640 1 -- 172.21.15.2:0/3191464632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9410e880 con 0x7f9a940fd7f0 2024-09-17T00:59:27.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a8b7fe640 1 -- 172.21.15.2:0/3191464632 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a7c03e670 con 0x7f9a940fd7f0 2024-09-17T00:59:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.007+0000 7f9a9998d640 1 -- 172.21.15.2:0/3191464632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9410eda0 con 0x7f9a940fd7f0 2024-09-17T00:59:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.008+0000 7f9a9998d640 1 -- 172.21.15.2:0/3191464632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a940fb980 con 0x7f9a940fd7f0 2024-09-17T00:59:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.009+0000 7f9a8b7fe640 1 -- 172.21.15.2:0/3191464632 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f9a7c030020 con 0x7f9a940fd7f0 2024-09-17T00:59:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.009+0000 7f9a8b7fe640 1 --2- 172.21.15.2:0/3191464632 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9a8006ed60 0x7f9a80071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.010+0000 7f9a92ffd640 1 --2- 172.21.15.2:0/3191464632 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9a8006ed60 0x7f9a80071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.010+0000 7f9a8b7fe640 1 -- 172.21.15.2:0/3191464632 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9a7c0ae580 con 0x7f9a940fd7f0 2024-09-17T00:59:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.010+0000 7f9a92ffd640 1 --2- 172.21.15.2:0/3191464632 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9a8006ed60 0x7f9a80071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009b50 tx=0x7f9a8c009120 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:27.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.014+0000 7f9a8b7fe640 1 -- 172.21.15.2:0/3191464632 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9a7c07b6b0 con 0x7f9a940fd7f0 2024-09-17T00:59:27.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.213+0000 7f9a9998d640 1 -- 172.21.15.2:0/3191464632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f9a9410efc0 con 0x7f9a940fd7f0 2024-09-17T00:59:27.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.515+0000 7f9a8b7fe640 1 -- 172.21.15.2:0/3191464632 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f9a7c07b050 con 0x7f9a940fd7f0 2024-09-17T00:59:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.517+0000 7f9a9998d640 1 -- 172.21.15.2:0/3191464632 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9a8006ed60 msgr2=0x7f9a80071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.517+0000 7f9a9998d640 1 --2- 172.21.15.2:0/3191464632 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9a8006ed60 0x7f9a80071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009b50 tx=0x7f9a8c009120 comp rx=0 tx=0).stop 2024-09-17T00:59:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.518+0000 7f9a9998d640 1 -- 172.21.15.2:0/3191464632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a940fd7f0 msgr2=0x7f9a9410d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.518+0000 7f9a9998d640 1 --2- 172.21.15.2:0/3191464632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a940fd7f0 0x7f9a9410d620 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c003080 tx=0x7f9a7c009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.518+0000 7f9a9998d640 1 -- 172.21.15.2:0/3191464632 shutdown_connections 2024-09-17T00:59:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.518+0000 7f9a9998d640 1 --2- 172.21.15.2:0/3191464632 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9a8006ed60 0x7f9a80071210 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.518+0000 7f9a9998d640 1 --2- 172.21.15.2:0/3191464632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a940fd7f0 0x7f9a9410d620 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.518+0000 7f9a9998d640 1 --2- 172.21.15.2:0/3191464632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a940fc520 0x7f9a9410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.518+0000 7f9a9998d640 1 -- 172.21.15.2:0/3191464632 >> 172.21.15.2:0/3191464632 conn(0x7f9a940f7ce0 msgr2=0x7f9a940f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.518+0000 7f9a9998d640 1 -- 172.21.15.2:0/3191464632 shutdown_connections 2024-09-17T00:59:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:27.518+0000 7f9a9998d640 1 -- 172.21.15.2:0/3191464632 wait complete. 2024-09-17T00:59:27.620 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:27 smithi099 ceph-mon[34357]: pgmap v176: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:27.621 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:27 smithi099 ceph-mon[34357]: mds.? [v2:172.21.15.2:6826/2460632811,v1:172.21.15.2:6827/2460632811] up:active 2024-09-17T00:59:27.621 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:27 smithi099 ceph-mon[34357]: fsmap cephfs:1 {0=cephfs.smithi002.zmrgxd=up:active} 2024-09-17T00:59:27.621 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:27 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3191464632' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-17T00:59:27.807 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:27 smithi002 ceph-mon[27650]: pgmap v176: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-17T00:59:27.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:27 smithi002 ceph-mon[27650]: mds.? [v2:172.21.15.2:6826/2460632811,v1:172.21.15.2:6827/2460632811] up:active 2024-09-17T00:59:27.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:27 smithi002 ceph-mon[27650]: fsmap cephfs:1 {0=cephfs.smithi002.zmrgxd=up:active} 2024-09-17T00:59:27.808 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:27 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3191464632' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-17T00:59:28.254 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T00:59:28.266 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T00:59:28.266 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-17T00:59:28.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:28 smithi002 ceph-mon[27650]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T00:59:28.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:28 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3191464632' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-17T00:59:28.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:28 smithi002 ceph-mon[27650]: fsmap cephfs:1 {0=cephfs.smithi002.zmrgxd=up:active} 2024-09-17T00:59:28.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:28 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:28.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:28 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:28.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:28 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:28.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:28 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.fmyyzz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T00:59:28.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:28 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.fmyyzz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T00:59:28.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:28 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:28.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:28 smithi099 ceph-mon[34357]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T00:59:28.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:28 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3191464632' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-17T00:59:28.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:28 smithi099 ceph-mon[34357]: fsmap cephfs:1 {0=cephfs.smithi002.zmrgxd=up:active} 2024-09-17T00:59:28.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:28 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:28.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:28 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:28.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:28 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:28.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:28 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.fmyyzz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T00:59:28.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:28 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.fmyyzz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T00:59:28.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:28 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:29.025 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:29.716 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:29 smithi002 ceph-mon[27650]: Deploying daemon mds.cephfs.smithi002.fmyyzz on smithi002 2024-09-17T00:59:29.716 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:29 smithi002 ceph-mon[27650]: pgmap v177: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 262 B/s wr, 0 op/s 2024-09-17T00:59:29.716 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:29 smithi002 ceph-mon[27650]: mds.? [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] up:boot 2024-09-17T00:59:29.716 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:29 smithi002 ceph-mon[27650]: daemon mds.cephfs.smithi099.hgawhu assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-17T00:59:29.716 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:29 smithi002 ceph-mon[27650]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T00:59:29.716 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:29 smithi002 ceph-mon[27650]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T00:59:29.716 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:29 smithi002 ceph-mon[27650]: fsmap cephfs:1 {0=cephfs.smithi002.zmrgxd=up:active} 1 up:standby 2024-09-17T00:59:29.716 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:29 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.hgawhu"}]: dispatch 2024-09-17T00:59:29.716 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:29 smithi002 ceph-mon[27650]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:creating} 2024-09-17T00:59:29.716 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:29 smithi002 ceph-mon[27650]: daemon mds.cephfs.smithi099.hgawhu is now active in filesystem cephfs as rank 1 2024-09-17T00:59:29.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:29 smithi099 ceph-mon[34357]: Deploying daemon mds.cephfs.smithi002.fmyyzz on smithi002 2024-09-17T00:59:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:29 smithi099 ceph-mon[34357]: pgmap v177: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 262 B/s wr, 0 op/s 2024-09-17T00:59:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:29 smithi099 ceph-mon[34357]: mds.? [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] up:boot 2024-09-17T00:59:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:29 smithi099 ceph-mon[34357]: daemon mds.cephfs.smithi099.hgawhu assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-17T00:59:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:29 smithi099 ceph-mon[34357]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T00:59:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:29 smithi099 ceph-mon[34357]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T00:59:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:29 smithi099 ceph-mon[34357]: fsmap cephfs:1 {0=cephfs.smithi002.zmrgxd=up:active} 1 up:standby 2024-09-17T00:59:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:29 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.hgawhu"}]: dispatch 2024-09-17T00:59:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:29 smithi099 ceph-mon[34357]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:creating} 2024-09-17T00:59:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:29 smithi099 ceph-mon[34357]: daemon mds.cephfs.smithi099.hgawhu is now active in filesystem cephfs as rank 1 2024-09-17T00:59:30.732 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:30 smithi002 ceph-mon[27650]: mds.? [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] up:active 2024-09-17T00:59:30.732 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:30 smithi002 ceph-mon[27650]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:active} 2024-09-17T00:59:30.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:30 smithi099 ceph-mon[34357]: mds.? [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] up:active 2024-09-17T00:59:30.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:30 smithi099 ceph-mon[34357]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:active} 2024-09-17T00:59:31.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.197+0000 7fc1a69ca640 1 -- 172.21.15.2:0/4249185703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a00fd7f0 msgr2=0x7fc1a00fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:31.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.197+0000 7fc1a69ca640 1 --2- 172.21.15.2:0/4249185703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a00fd7f0 0x7fc1a00fdc60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc1940048d0 tx=0x7fc194009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:31.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.197+0000 7fc1a69ca640 1 -- 172.21.15.2:0/4249185703 shutdown_connections 2024-09-17T00:59:31.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.197+0000 7fc1a69ca640 1 --2- 172.21.15.2:0/4249185703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a00fd7f0 0x7fc1a00fdc60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:31.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.197+0000 7fc1a69ca640 1 --2- 172.21.15.2:0/4249185703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1a00fc520 0x7fc1a00fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:31.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.197+0000 7fc1a69ca640 1 -- 172.21.15.2:0/4249185703 >> 172.21.15.2:0/4249185703 conn(0x7fc1a00f7ce0 msgr2=0x7fc1a00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:31.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.197+0000 7fc1a69ca640 1 -- 172.21.15.2:0/4249185703 shutdown_connections 2024-09-17T00:59:31.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.197+0000 7fc1a69ca640 1 -- 172.21.15.2:0/4249185703 wait complete. 2024-09-17T00:59:31.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.198+0000 7fc1a69ca640 1 Processor -- start 2024-09-17T00:59:31.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.198+0000 7fc1a69ca640 1 -- start start 2024-09-17T00:59:31.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.198+0000 7fc1a69ca640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1a00fc520 0x7fc1a0071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:31.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.198+0000 7fc1a69ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a00fd7f0 0x7fc1a006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:31.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc1a69ca640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a006fff0 con 0x7fc1a00fd7f0 2024-09-17T00:59:31.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc1a69ca640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a0070130 con 0x7fc1a00fc520 2024-09-17T00:59:31.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc19f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a00fd7f0 0x7fc1a006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:31.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc19f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a00fd7f0 0x7fc1a006fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46800/0 (socket says 172.21.15.2:46800) 2024-09-17T00:59:31.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc19f7fe640 1 -- 172.21.15.2:0/2345392764 learned_addr learned my addr 172.21.15.2:0/2345392764 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:31.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc19ffff640 1 --2- 172.21.15.2:0/2345392764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1a00fc520 0x7fc1a0071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:31.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc19f7fe640 1 -- 172.21.15.2:0/2345392764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1a00fc520 msgr2=0x7fc1a0071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:31.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc19f7fe640 1 --2- 172.21.15.2:0/2345392764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1a00fc520 0x7fc1a0071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:31.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc19f7fe640 1 -- 172.21.15.2:0/2345392764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc194005040 con 0x7fc1a00fd7f0 2024-09-17T00:59:31.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc19ffff640 1 --2- 172.21.15.2:0/2345392764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1a00fc520 0x7fc1a0071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T00:59:31.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc19f7fe640 1 --2- 172.21.15.2:0/2345392764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a00fd7f0 0x7fc1a006fa60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc194003080 tx=0x7fc194009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:31.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc19cff9640 1 -- 172.21.15.2:0/2345392764 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc194038070 con 0x7fc1a00fd7f0 2024-09-17T00:59:31.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc19cff9640 1 -- 172.21.15.2:0/2345392764 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc19402abd0 con 0x7fc1a00fd7f0 2024-09-17T00:59:31.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc19cff9640 1 -- 172.21.15.2:0/2345392764 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc19403e670 con 0x7fc1a00fd7f0 2024-09-17T00:59:31.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.199+0000 7fc1a69ca640 1 -- 172.21.15.2:0/2345392764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a00703b0 con 0x7fc1a00fd7f0 2024-09-17T00:59:31.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.200+0000 7fc1a69ca640 1 -- 172.21.15.2:0/2345392764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a01150b0 con 0x7fc1a00fd7f0 2024-09-17T00:59:31.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.201+0000 7fc1a69ca640 1 -- 172.21.15.2:0/2345392764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a00fb980 con 0x7fc1a00fd7f0 2024-09-17T00:59:31.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.201+0000 7fc19cff9640 1 -- 172.21.15.2:0/2345392764 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fc194030020 con 0x7fc1a00fd7f0 2024-09-17T00:59:31.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.202+0000 7fc19cff9640 1 --2- 172.21.15.2:0/2345392764 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc18806ed60 0x7fc188071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:31.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.202+0000 7fc19cff9640 1 -- 172.21.15.2:0/2345392764 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc1940ae580 con 0x7fc1a00fd7f0 2024-09-17T00:59:31.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.202+0000 7fc19ffff640 1 --2- 172.21.15.2:0/2345392764 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc18806ed60 0x7fc188071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:31.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.202+0000 7fc19ffff640 1 --2- 172.21.15.2:0/2345392764 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc18806ed60 0x7fc188071210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0071320 tx=0x7fc190009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:31.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.206+0000 7fc19cff9640 1 -- 172.21.15.2:0/2345392764 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc19407b6b0 con 0x7fc1a00fd7f0 2024-09-17T00:59:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:31.416+0000 7fc1a69ca640 1 -- 172.21.15.2:0/2345392764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fc1a0104f30 con 0x7fc1a00fd7f0 2024-09-17T00:59:31.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:31 smithi002 ceph-mon[27650]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 7 op/s 2024-09-17T00:59:31.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:31 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:31.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:31 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2345392764' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-17T00:59:32.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:31 smithi099 ceph-mon[34357]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 7 op/s 2024-09-17T00:59:32.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:31 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:32.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:31 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/2345392764' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-17T00:59:32.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:32.321+0000 7fc19cff9640 1 -- 172.21.15.2:0/2345392764 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v10) v1 ==== 121+0+0 (secure 0 0 0) 0x7fc19407b050 con 0x7fc1a00fd7f0 2024-09-17T00:59:32.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:32.323+0000 7fc1a69ca640 1 -- 172.21.15.2:0/2345392764 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc18806ed60 msgr2=0x7fc188071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:32.323+0000 7fc1a69ca640 1 --2- 172.21.15.2:0/2345392764 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc18806ed60 0x7fc188071210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0071320 tx=0x7fc190009040 comp rx=0 tx=0).stop 2024-09-17T00:59:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:32.323+0000 7fc1a69ca640 1 -- 172.21.15.2:0/2345392764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a00fd7f0 msgr2=0x7fc1a006fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:32.323+0000 7fc1a69ca640 1 --2- 172.21.15.2:0/2345392764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a00fd7f0 0x7fc1a006fa60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc194003080 tx=0x7fc194009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:32.324+0000 7fc1a69ca640 1 -- 172.21.15.2:0/2345392764 shutdown_connections 2024-09-17T00:59:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:32.324+0000 7fc1a69ca640 1 --2- 172.21.15.2:0/2345392764 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fc18806ed60 0x7fc188071210 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:32.324+0000 7fc1a69ca640 1 --2- 172.21.15.2:0/2345392764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a00fd7f0 0x7fc1a006fa60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:32.324+0000 7fc1a69ca640 1 --2- 172.21.15.2:0/2345392764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1a00fc520 0x7fc1a0071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:32.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:32.324+0000 7fc1a69ca640 1 -- 172.21.15.2:0/2345392764 >> 172.21.15.2:0/2345392764 conn(0x7fc1a00f7ce0 msgr2=0x7fc1a00f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:32.324+0000 7fc1a69ca640 1 -- 172.21.15.2:0/2345392764 shutdown_connections 2024-09-17T00:59:32.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:32.324+0000 7fc1a69ca640 1 -- 172.21.15.2:0/2345392764 wait complete. 2024-09-17T00:59:32.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:32.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:32.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:32.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.heckcd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T00:59:32.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.heckcd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T00:59:32.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:32.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: Deploying daemon mds.cephfs.smithi099.heckcd on smithi099 2024-09-17T00:59:32.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-09-17T00:59:32.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T00:59:32.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: Cluster is now healthy 2024-09-17T00:59:32.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2345392764' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-17T00:59:32.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: mds.? [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] up:boot 2024-09-17T00:59:32.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby 2024-09-17T00:59:32.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.fmyyzz"}]: dispatch 2024-09-17T00:59:32.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:32 smithi002 ceph-mon[27650]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby-replay 2024-09-17T00:59:32.953 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T00:59:32.969 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T00:59:32.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-17T00:59:33.231 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:33.290 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:33.291 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:33.291 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:33.291 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.heckcd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T00:59:33.291 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.heckcd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T00:59:33.291 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:33.291 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: Deploying daemon mds.cephfs.smithi099.heckcd on smithi099 2024-09-17T00:59:33.291 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-09-17T00:59:33.291 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T00:59:33.291 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: Cluster is now healthy 2024-09-17T00:59:33.291 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/2345392764' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-17T00:59:33.291 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: mds.? [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] up:boot 2024-09-17T00:59:33.291 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby 2024-09-17T00:59:33.291 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.fmyyzz"}]: dispatch 2024-09-17T00:59:33.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:32 smithi099 ceph-mon[34357]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby-replay 2024-09-17T00:59:34.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.817+0000 7fafb3547640 1 -- 172.21.15.2:0/1668161597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafac0fd7f0 msgr2=0x7fafac0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:34.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.817+0000 7fafb3547640 1 --2- 172.21.15.2:0/1668161597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafac0fd7f0 0x7fafac0fdc60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fafa00048d0 tx=0x7fafa0009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:34.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.817+0000 7fafb3547640 1 -- 172.21.15.2:0/1668161597 shutdown_connections 2024-09-17T00:59:34.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.817+0000 7fafb3547640 1 --2- 172.21.15.2:0/1668161597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafac0fd7f0 0x7fafac0fdc60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:34.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.817+0000 7fafb3547640 1 --2- 172.21.15.2:0/1668161597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0fc520 0x7fafac0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:34.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.817+0000 7fafb3547640 1 -- 172.21.15.2:0/1668161597 >> 172.21.15.2:0/1668161597 conn(0x7fafac0f7ce0 msgr2=0x7fafac0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:34.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.817+0000 7fafb3547640 1 -- 172.21.15.2:0/1668161597 shutdown_connections 2024-09-17T00:59:34.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.817+0000 7fafb3547640 1 -- 172.21.15.2:0/1668161597 wait complete. 2024-09-17T00:59:34.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.818+0000 7fafb3547640 1 Processor -- start 2024-09-17T00:59:34.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.818+0000 7fafb3547640 1 -- start start 2024-09-17T00:59:34.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.818+0000 7fafb3547640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafac0fc520 0x7fafac071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.818+0000 7fafb3547640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0fd7f0 0x7fafac06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.818+0000 7fafb3547640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac06fff0 con 0x7fafac0fc520 2024-09-17T00:59:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.818+0000 7fafb3547640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac070130 con 0x7fafac0fd7f0 2024-09-17T00:59:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.818+0000 7fafb12e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafac0fc520 0x7fafac071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.818+0000 7fafb12e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafac0fc520 0x7fafac071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46842/0 (socket says 172.21.15.2:46842) 2024-09-17T00:59:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.818+0000 7fafb12e3640 1 -- 172.21.15.2:0/3046233375 learned_addr learned my addr 172.21.15.2:0/3046233375 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.818+0000 7fafb0ae2640 1 --2- 172.21.15.2:0/3046233375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0fd7f0 0x7fafac06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.818+0000 7fafb12e3640 1 -- 172.21.15.2:0/3046233375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0fd7f0 msgr2=0x7fafac06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.818+0000 7fafb12e3640 1 --2- 172.21.15.2:0/3046233375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0fd7f0 0x7fafac06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.818+0000 7fafb12e3640 1 -- 172.21.15.2:0/3046233375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa0005040 con 0x7fafac0fc520 2024-09-17T00:59:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.818+0000 7fafb12e3640 1 --2- 172.21.15.2:0/3046233375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafac0fc520 0x7fafac071570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fafa800eb70 tx=0x7fafa800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.819+0000 7faf9dffb640 1 -- 172.21.15.2:0/3046233375 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafa8007c30 con 0x7fafac0fc520 2024-09-17T00:59:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.819+0000 7faf9dffb640 1 -- 172.21.15.2:0/3046233375 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fafa800f040 con 0x7fafac0fc520 2024-09-17T00:59:34.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.819+0000 7fafb3547640 1 -- 172.21.15.2:0/3046233375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafac0703b0 con 0x7fafac0fc520 2024-09-17T00:59:34.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.819+0000 7faf9dffb640 1 -- 172.21.15.2:0/3046233375 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafa800ca60 con 0x7fafac0fc520 2024-09-17T00:59:34.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.819+0000 7fafb3547640 1 -- 172.21.15.2:0/3046233375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafac1150a0 con 0x7fafac0fc520 2024-09-17T00:59:34.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.820+0000 7fafb3547640 1 -- 172.21.15.2:0/3046233375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafac0fb980 con 0x7fafac0fc520 2024-09-17T00:59:34.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.820+0000 7faf9dffb640 1 -- 172.21.15.2:0/3046233375 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fafa800cbc0 con 0x7fafac0fc520 2024-09-17T00:59:34.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.821+0000 7faf9dffb640 1 --2- 172.21.15.2:0/3046233375 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7faf9806ed60 0x7faf98071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:34.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.821+0000 7fafb0ae2640 1 --2- 172.21.15.2:0/3046233375 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7faf9806ed60 0x7faf98071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:34.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.821+0000 7faf9dffb640 1 -- 172.21.15.2:0/3046233375 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fafa808de50 con 0x7fafac0fc520 2024-09-17T00:59:34.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.821+0000 7fafb0ae2640 1 --2- 172.21.15.2:0/3046233375 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7faf9806ed60 0x7faf98071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fafa0004540 tx=0x7fafa0035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:34.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:34.825+0000 7faf9dffb640 1 -- 172.21.15.2:0/3046233375 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fafa805b0e0 con 0x7fafac0fc520 2024-09-17T00:59:35.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:35.049+0000 7fafb3547640 1 -- 172.21.15.2:0/3046233375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fafac04b720 con 0x7fafac0fc520 2024-09-17T00:59:35.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:35.467+0000 7faf9dffb640 1 -- 172.21.15.2:0/3046233375 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v14) v1 ==== 168+0+0 (secure 0 0 0) 0x7fafa80190d0 con 0x7fafac0fc520 2024-09-17T00:59:35.464 INFO:teuthology.orchestra.run.smithi002.stderr:inline data enabled 2024-09-17T00:59:35.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:35.469+0000 7fafb3547640 1 -- 172.21.15.2:0/3046233375 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7faf9806ed60 msgr2=0x7faf98071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:35.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:35.469+0000 7fafb3547640 1 --2- 172.21.15.2:0/3046233375 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7faf9806ed60 0x7faf98071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fafa0004540 tx=0x7fafa0035040 comp rx=0 tx=0).stop 2024-09-17T00:59:35.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:35.469+0000 7fafb3547640 1 -- 172.21.15.2:0/3046233375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafac0fc520 msgr2=0x7fafac071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:35.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:35.469+0000 7fafb3547640 1 --2- 172.21.15.2:0/3046233375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafac0fc520 0x7fafac071570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fafa800eb70 tx=0x7fafa800b040 comp rx=0 tx=0).stop 2024-09-17T00:59:35.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:35.469+0000 7fafb3547640 1 -- 172.21.15.2:0/3046233375 shutdown_connections 2024-09-17T00:59:35.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:35.469+0000 7fafb3547640 1 --2- 172.21.15.2:0/3046233375 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7faf9806ed60 0x7faf98071210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:35.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:35.469+0000 7fafb3547640 1 --2- 172.21.15.2:0/3046233375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0fd7f0 0x7fafac06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:35.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:35.469+0000 7fafb3547640 1 --2- 172.21.15.2:0/3046233375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafac0fc520 0x7fafac071570 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:35.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:35.469+0000 7fafb3547640 1 -- 172.21.15.2:0/3046233375 >> 172.21.15.2:0/3046233375 conn(0x7fafac0f7ce0 msgr2=0x7fafac0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:35.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:35.469+0000 7fafb3547640 1 -- 172.21.15.2:0/3046233375 shutdown_connections 2024-09-17T00:59:35.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:35.469+0000 7fafb3547640 1 -- 172.21.15.2:0/3046233375 wait complete. 2024-09-17T00:59:35.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:35 smithi002 ceph-mon[27650]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 86 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-17T00:59:35.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:35 smithi002 ceph-mon[27650]: mds.? [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] up:boot 2024-09-17T00:59:35.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:35 smithi002 ceph-mon[27650]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T00:59:35.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:35 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T00:59:35.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:35 smithi002 ceph-mon[27650]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T00:59:35.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:35 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:35.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:35 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:35.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:35 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:35.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:35 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:35.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:35 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:35.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:35 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:59:35.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:35 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3046233375' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T00:59:35.787 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:35 smithi099 ceph-mon[34357]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 86 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-17T00:59:35.787 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:35 smithi099 ceph-mon[34357]: mds.? [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] up:boot 2024-09-17T00:59:35.787 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:35 smithi099 ceph-mon[34357]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T00:59:35.787 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:35 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T00:59:35.787 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:35 smithi099 ceph-mon[34357]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T00:59:35.787 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:35 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:35.788 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:35 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:35.788 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:35 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:35.788 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:35 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:35.788 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:35 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:35.788 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:35 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:59:35.788 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:35 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3046233375' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T00:59:36.411 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T00:59:36.421 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T00:59:36.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T00:59:36.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:36 smithi002 ceph-mon[27650]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-17T00:59:36.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:36 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3046233375' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T00:59:36.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:36 smithi002 ceph-mon[27650]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T00:59:36.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:36 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:36.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:36 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:59:36.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:36 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:36.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:36 smithi099 ceph-mon[34357]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-17T00:59:36.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:36 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3046233375' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T00:59:36.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:36 smithi099 ceph-mon[34357]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T00:59:36.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:36 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:36.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:36 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:59:36.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:36 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:37.235 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:37.781 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:37 smithi002 ceph-mon[27650]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-17T00:59:37.781 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:37 smithi002 ceph-mon[27650]: mds.? [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] up:standby-replay 2024-09-17T00:59:37.781 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:37 smithi002 ceph-mon[27650]: Dropping low affinity active daemon mds.cephfs.smithi002.zmrgxd in favor of higher affinity standby. 2024-09-17T00:59:37.781 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:37 smithi002 ceph-mon[27650]: Replacing daemon mds.cephfs.smithi002.zmrgxd as rank 0 with standby daemon mds.cephfs.smithi002.fmyyzz 2024-09-17T00:59:37.781 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:37 smithi002 ceph-mon[27650]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T00:59:37.782 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:37 smithi002 ceph-mon[27650]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T00:59:37.782 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:37 smithi002 ceph-mon[27650]: osdmap e44: 6 total, 6 up, 6 in 2024-09-17T00:59:37.782 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:37 smithi002 ceph-mon[27650]: fsmap cephfs:2/2 {0=cephfs.smithi002.fmyyzz=up:replay,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby-replay 2024-09-17T00:59:37.782 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:37.782 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:37 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:37.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:37 smithi099 ceph-mon[34357]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-17T00:59:37.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:37 smithi099 ceph-mon[34357]: mds.? [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] up:standby-replay 2024-09-17T00:59:37.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:37 smithi099 ceph-mon[34357]: Dropping low affinity active daemon mds.cephfs.smithi002.zmrgxd in favor of higher affinity standby. 2024-09-17T00:59:37.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:37 smithi099 ceph-mon[34357]: Replacing daemon mds.cephfs.smithi002.zmrgxd as rank 0 with standby daemon mds.cephfs.smithi002.fmyyzz 2024-09-17T00:59:37.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:37 smithi099 ceph-mon[34357]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T00:59:37.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:37 smithi099 ceph-mon[34357]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T00:59:37.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:37 smithi099 ceph-mon[34357]: osdmap e44: 6 total, 6 up, 6 in 2024-09-17T00:59:37.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:37 smithi099 ceph-mon[34357]: fsmap cephfs:2/2 {0=cephfs.smithi002.fmyyzz=up:replay,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby-replay 2024-09-17T00:59:37.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:37 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:37.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:37 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:38.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:38 smithi002 ceph-mon[27650]: mds.? [v2:172.21.15.2:6826/2986470392,v1:172.21.15.2:6827/2986470392] up:boot 2024-09-17T00:59:38.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:38 smithi002 ceph-mon[27650]: mds.? [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] up:active 2024-09-17T00:59:38.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:38 smithi002 ceph-mon[27650]: mds.? [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] up:resolve 2024-09-17T00:59:38.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:38 smithi002 ceph-mon[27650]: fsmap cephfs:2/2 {0=cephfs.smithi002.fmyyzz=up:resolve,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T00:59:38.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:38 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T00:59:38.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:38 smithi099 ceph-mon[34357]: mds.? [v2:172.21.15.2:6826/2986470392,v1:172.21.15.2:6827/2986470392] up:boot 2024-09-17T00:59:38.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:38 smithi099 ceph-mon[34357]: mds.? [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] up:active 2024-09-17T00:59:38.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:38 smithi099 ceph-mon[34357]: mds.? [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] up:resolve 2024-09-17T00:59:38.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:38 smithi099 ceph-mon[34357]: fsmap cephfs:2/2 {0=cephfs.smithi002.fmyyzz=up:resolve,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T00:59:38.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:38 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T00:59:39.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:39 smithi002 ceph-mon[27650]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-17T00:59:39.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:39 smithi002 ceph-mon[27650]: mds.? [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] up:reconnect 2024-09-17T00:59:39.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:39 smithi002 ceph-mon[27650]: mds.? [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] up:standby-replay 2024-09-17T00:59:39.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:39 smithi002 ceph-mon[27650]: fsmap cephfs:2/2 {0=cephfs.smithi002.fmyyzz=up:reconnect,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T00:59:39.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:39 smithi099 ceph-mon[34357]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-17T00:59:39.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:39 smithi099 ceph-mon[34357]: mds.? [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] up:reconnect 2024-09-17T00:59:39.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:39 smithi099 ceph-mon[34357]: mds.? [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] up:standby-replay 2024-09-17T00:59:39.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:39 smithi099 ceph-mon[34357]: fsmap cephfs:2/2 {0=cephfs.smithi002.fmyyzz=up:reconnect,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T00:59:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.099+0000 7ffb903b5640 1 -- 172.21.15.2:0/3648848175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb880fb480 msgr2=0x7ffb880fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.099+0000 7ffb903b5640 1 --2- 172.21.15.2:0/3648848175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb880fb480 0x7ffb880fb890 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb840048d0 tx=0x7ffb84009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.099+0000 7ffb903b5640 1 -- 172.21.15.2:0/3648848175 shutdown_connections 2024-09-17T00:59:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.099+0000 7ffb903b5640 1 --2- 172.21.15.2:0/3648848175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb880fc750 0x7ffb880fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.099+0000 7ffb903b5640 1 --2- 172.21.15.2:0/3648848175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb880fb480 0x7ffb880fb890 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:40.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.099+0000 7ffb903b5640 1 -- 172.21.15.2:0/3648848175 >> 172.21.15.2:0/3648848175 conn(0x7ffb880f6c40 msgr2=0x7ffb880f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.099+0000 7ffb903b5640 1 -- 172.21.15.2:0/3648848175 shutdown_connections 2024-09-17T00:59:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.100+0000 7ffb903b5640 1 -- 172.21.15.2:0/3648848175 wait complete. 2024-09-17T00:59:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.100+0000 7ffb903b5640 1 Processor -- start 2024-09-17T00:59:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.100+0000 7ffb903b5640 1 -- start start 2024-09-17T00:59:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.100+0000 7ffb903b5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb880fb480 0x7ffb8810fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.100+0000 7ffb903b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb880fc750 0x7ffb88112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.100+0000 7ffb903b5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88066790 con 0x7ffb880fc750 2024-09-17T00:59:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.100+0000 7ffb903b5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88066900 con 0x7ffb880fb480 2024-09-17T00:59:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.100+0000 7ffb8d950640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb880fc750 0x7ffb88112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.101+0000 7ffb8d950640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb880fc750 0x7ffb88112310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46888/0 (socket says 172.21.15.2:46888) 2024-09-17T00:59:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.101+0000 7ffb8d950640 1 -- 172.21.15.2:0/3484070449 learned_addr learned my addr 172.21.15.2:0/3484070449 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.101+0000 7ffb8e151640 1 --2- 172.21.15.2:0/3484070449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb880fb480 0x7ffb8810fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.101+0000 7ffb8d950640 1 -- 172.21.15.2:0/3484070449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb880fb480 msgr2=0x7ffb8810fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:40.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.101+0000 7ffb8d950640 1 --2- 172.21.15.2:0/3484070449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb880fb480 0x7ffb8810fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.101+0000 7ffb8d950640 1 -- 172.21.15.2:0/3484070449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb84005040 con 0x7ffb880fc750 2024-09-17T00:59:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.101+0000 7ffb8d950640 1 --2- 172.21.15.2:0/3484070449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb880fc750 0x7ffb88112310 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800c790 tx=0x7ffb780043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.101+0000 7ffb7effd640 1 -- 172.21.15.2:0/3484070449 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7800a7a0 con 0x7ffb880fc750 2024-09-17T00:59:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.101+0000 7ffb7effd640 1 -- 172.21.15.2:0/3484070449 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffb7800ada0 con 0x7ffb880fc750 2024-09-17T00:59:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.101+0000 7ffb7effd640 1 -- 172.21.15.2:0/3484070449 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb780113a0 con 0x7ffb880fc750 2024-09-17T00:59:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.101+0000 7ffb903b5640 1 -- 172.21.15.2:0/3484070449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb88112910 con 0x7ffb880fc750 2024-09-17T00:59:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.101+0000 7ffb903b5640 1 -- 172.21.15.2:0/3484070449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb88112e30 con 0x7ffb880fc750 2024-09-17T00:59:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.102+0000 7ffb903b5640 1 -- 172.21.15.2:0/3484070449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb880fa8e0 con 0x7ffb880fc750 2024-09-17T00:59:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.103+0000 7ffb7effd640 1 -- 172.21.15.2:0/3484070449 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7ffb7800a900 con 0x7ffb880fc750 2024-09-17T00:59:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.104+0000 7ffb7effd640 1 --2- 172.21.15.2:0/3484070449 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ffb7406ed50 0x7ffb74071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.104+0000 7ffb8e151640 1 --2- 172.21.15.2:0/3484070449 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ffb7406ed50 0x7ffb74071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.104+0000 7ffb7effd640 1 -- 172.21.15.2:0/3484070449 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ffb7808e280 con 0x7ffb880fc750 2024-09-17T00:59:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.104+0000 7ffb8e151640 1 --2- 172.21.15.2:0/3484070449 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ffb7406ed50 0x7ffb74071200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffb84000c00 tx=0x7ffb84035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.108+0000 7ffb7effd640 1 -- 172.21.15.2:0/3484070449 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffb7805b3d0 con 0x7ffb880fc750 2024-09-17T00:59:40.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.311+0000 7ffb903b5640 1 -- 172.21.15.2:0/3484070449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb88103ea0 con 0x7ffb880fc750 2024-09-17T00:59:40.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.312+0000 7ffb7effd640 1 -- 172.21.15.2:0/3484070449 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1836 (secure 0 0 0) 0x7ffb7805ad70 con 0x7ffb880fc750 2024-09-17T00:59:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:e19 2024-09-17T00:59:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T00:59:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T00:59:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-17T00:59:40.309 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:59:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-17T00:59:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-17T00:59:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 19 2024-09-17T00:59:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T00:59:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-17T00:59:20.485696+0000 2024-09-17T00:59:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-17T00:59:39.478054+0000 2024-09-17T00:59:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-17T00:59:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-17T00:59:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-17T00:59:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-17T00:59:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-17T00:59:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-17T00:59:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-17T00:59:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 44 2024-09-17T00:59:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T00:59:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2024-09-17T00:59:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2024-09-17T00:59:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=14464,1=24269} 2024-09-17T00:59:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-17T00:59:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-17T00:59:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-17T00:59:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-17T00:59:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-17T00:59:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-17T00:59:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-17T00:59:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-17T00:59:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.fmyyzz{0:14464} state up:rejoin seq 5 join_fscid=1 addr [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T00:59:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.hgawhu{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T00:59:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.heckcd{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T00:59:40.312 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:59:40.312 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:59:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-17T00:59:40.312 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:59:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.zmrgxd{-1:24287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/2986470392,v1:172.21.15.2:6827/2986470392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T00:59:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2024-09-17T00:59:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.314+0000 7ffb903b5640 1 -- 172.21.15.2:0/3484070449 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ffb7406ed50 msgr2=0x7ffb74071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.314+0000 7ffb903b5640 1 --2- 172.21.15.2:0/3484070449 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ffb7406ed50 0x7ffb74071200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffb84000c00 tx=0x7ffb84035040 comp rx=0 tx=0).stop 2024-09-17T00:59:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.314+0000 7ffb903b5640 1 -- 172.21.15.2:0/3484070449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb880fc750 msgr2=0x7ffb88112310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.314+0000 7ffb903b5640 1 --2- 172.21.15.2:0/3484070449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb880fc750 0x7ffb88112310 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800c790 tx=0x7ffb780043c0 comp rx=0 tx=0).stop 2024-09-17T00:59:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.314+0000 7ffb903b5640 1 -- 172.21.15.2:0/3484070449 shutdown_connections 2024-09-17T00:59:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.314+0000 7ffb903b5640 1 --2- 172.21.15.2:0/3484070449 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ffb7406ed50 0x7ffb74071200 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.314+0000 7ffb903b5640 1 --2- 172.21.15.2:0/3484070449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb880fc750 0x7ffb88112310 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.314+0000 7ffb903b5640 1 --2- 172.21.15.2:0/3484070449 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb880fb480 0x7ffb8810fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.314+0000 7ffb903b5640 1 -- 172.21.15.2:0/3484070449 >> 172.21.15.2:0/3484070449 conn(0x7ffb880f6c40 msgr2=0x7ffb880f8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:40.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.314+0000 7ffb903b5640 1 -- 172.21.15.2:0/3484070449 shutdown_connections 2024-09-17T00:59:40.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:40.314+0000 7ffb903b5640 1 -- 172.21.15.2:0/3484070449 wait complete. 2024-09-17T00:59:40.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:40 smithi099 ceph-mon[34357]: mds.? [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] up:rejoin 2024-09-17T00:59:40.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:40 smithi099 ceph-mon[34357]: fsmap cephfs:2/2 {0=cephfs.smithi002.fmyyzz=up:rejoin,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T00:59:40.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:40 smithi099 ceph-mon[34357]: daemon mds.cephfs.smithi002.fmyyzz is now active in filesystem cephfs as rank 0 2024-09-17T00:59:40.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:40 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3484070449' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T00:59:40.883 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:40 smithi002 ceph-mon[27650]: mds.? [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] up:rejoin 2024-09-17T00:59:40.883 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:40 smithi002 ceph-mon[27650]: fsmap cephfs:2/2 {0=cephfs.smithi002.fmyyzz=up:rejoin,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T00:59:40.883 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:40 smithi002 ceph-mon[27650]: daemon mds.cephfs.smithi002.fmyyzz is now active in filesystem cephfs as rank 0 2024-09-17T00:59:40.883 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:40 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3484070449' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T00:59:41.196 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-17T00:59:41.594 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:41.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:41 smithi099 ceph-mon[34357]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-17T00:59:41.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:41 smithi099 ceph-mon[34357]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T00:59:41.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:41 smithi099 ceph-mon[34357]: mds.? [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] up:active 2024-09-17T00:59:41.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:41 smithi099 ceph-mon[34357]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T00:59:41.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:41 smithi099 ceph-mon[34357]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T00:59:41.871 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:41 smithi002 ceph-mon[27650]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-17T00:59:41.871 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:41 smithi002 ceph-mon[27650]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T00:59:41.872 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:41 smithi002 ceph-mon[27650]: mds.? [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] up:active 2024-09-17T00:59:41.872 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:41 smithi002 ceph-mon[27650]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T00:59:41.872 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:41 smithi002 ceph-mon[27650]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T00:59:43.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.206+0000 7f272e6d9640 1 -- 172.21.15.2:0/4045473271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27280fc550 msgr2=0x7f27280fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.206+0000 7f272e6d9640 1 --2- 172.21.15.2:0/4045473271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27280fc550 0x7f27280fc960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f27180048d0 tx=0x7f2718009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.206+0000 7f272e6d9640 1 -- 172.21.15.2:0/4045473271 shutdown_connections 2024-09-17T00:59:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.206+0000 7f272e6d9640 1 --2- 172.21.15.2:0/4045473271 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27280fd820 0x7f27280fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.206+0000 7f272e6d9640 1 --2- 172.21.15.2:0/4045473271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27280fc550 0x7f27280fc960 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.206+0000 7f272e6d9640 1 -- 172.21.15.2:0/4045473271 >> 172.21.15.2:0/4045473271 conn(0x7f27280f7d30 msgr2=0x7f27280fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.206+0000 7f272e6d9640 1 -- 172.21.15.2:0/4045473271 shutdown_connections 2024-09-17T00:59:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.206+0000 7f272e6d9640 1 -- 172.21.15.2:0/4045473271 wait complete. 2024-09-17T00:59:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.206+0000 7f272e6d9640 1 Processor -- start 2024-09-17T00:59:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f272e6d9640 1 -- start start 2024-09-17T00:59:43.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f272e6d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27280fc550 0x7f2728071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f272e6d9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27280fd820 0x7f272806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f272e6d9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272806fff0 con 0x7f27280fc550 2024-09-17T00:59:43.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f272e6d9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2728070130 con 0x7f27280fd820 2024-09-17T00:59:43.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f2727fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27280fc550 0x7f2728071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:43.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f2727fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27280fc550 0x7f2728071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55508/0 (socket says 172.21.15.2:55508) 2024-09-17T00:59:43.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f2727fff640 1 -- 172.21.15.2:0/137009246 learned_addr learned my addr 172.21.15.2:0/137009246 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:43.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f271ffff640 1 --2- 172.21.15.2:0/137009246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27280fd820 0x7f272806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:43.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f2727fff640 1 -- 172.21.15.2:0/137009246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27280fd820 msgr2=0x7f272806fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:43.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f2727fff640 1 --2- 172.21.15.2:0/137009246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27280fd820 0x7f272806fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:43.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f2727fff640 1 -- 172.21.15.2:0/137009246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2718005040 con 0x7f27280fc550 2024-09-17T00:59:43.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f2727fff640 1 --2- 172.21.15.2:0/137009246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27280fc550 0x7f2728071570 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2718003080 tx=0x7f2718009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:43.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f27257fa640 1 -- 172.21.15.2:0/137009246 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2718038070 con 0x7f27280fc550 2024-09-17T00:59:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f27257fa640 1 -- 172.21.15.2:0/137009246 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f271802abd0 con 0x7f27280fc550 2024-09-17T00:59:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f27257fa640 1 -- 172.21.15.2:0/137009246 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f271803e670 con 0x7f27280fc550 2024-09-17T00:59:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.207+0000 7f272e6d9640 1 -- 172.21.15.2:0/137009246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27280703b0 con 0x7f27280fc550 2024-09-17T00:59:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.208+0000 7f272e6d9640 1 -- 172.21.15.2:0/137009246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27281150e0 con 0x7f27280fc550 2024-09-17T00:59:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.209+0000 7f272e6d9640 1 -- 172.21.15.2:0/137009246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27280fb9b0 con 0x7f27280fc550 2024-09-17T00:59:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.209+0000 7f27257fa640 1 -- 172.21.15.2:0/137009246 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f2718030020 con 0x7f27280fc550 2024-09-17T00:59:43.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.210+0000 7f27257fa640 1 --2- 172.21.15.2:0/137009246 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f271406ed60 0x7f2714071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:43.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.210+0000 7f271ffff640 1 --2- 172.21.15.2:0/137009246 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f271406ed60 0x7f2714071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:43.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.210+0000 7f27257fa640 1 -- 172.21.15.2:0/137009246 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f27180ae470 con 0x7f27280fc550 2024-09-17T00:59:43.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.210+0000 7f271ffff640 1 --2- 172.21.15.2:0/137009246 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f271406ed60 0x7f2714071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2710007fd0 tx=0x7f2710009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:43.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.214+0000 7f27257fa640 1 -- 172.21.15.2:0/137009246 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f271807b670 con 0x7f27280fc550 2024-09-17T00:59:43.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.419+0000 7f272e6d9640 1 -- 172.21.15.2:0/137009246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f272804b720 con 0x7f27280fc550 2024-09-17T00:59:43.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.419+0000 7f27257fa640 1 -- 172.21.15.2:0/137009246 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4710 (secure 0 0 0) 0x7f271807b010 con 0x7f27280fc550 2024-09-17T00:59:43.417 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2024-09-17T00:59:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.421+0000 7f272e6d9640 1 -- 172.21.15.2:0/137009246 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f271406ed60 msgr2=0x7f2714071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.421+0000 7f272e6d9640 1 --2- 172.21.15.2:0/137009246 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f271406ed60 0x7f2714071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2710007fd0 tx=0x7f2710009040 comp rx=0 tx=0).stop 2024-09-17T00:59:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.421+0000 7f272e6d9640 1 -- 172.21.15.2:0/137009246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27280fc550 msgr2=0x7f2728071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:43.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.421+0000 7f272e6d9640 1 --2- 172.21.15.2:0/137009246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27280fc550 0x7f2728071570 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2718003080 tx=0x7f2718009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:43.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.421+0000 7f272e6d9640 1 -- 172.21.15.2:0/137009246 shutdown_connections 2024-09-17T00:59:43.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.421+0000 7f272e6d9640 1 --2- 172.21.15.2:0/137009246 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f271406ed60 0x7f2714071210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:43.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.421+0000 7f272e6d9640 1 --2- 172.21.15.2:0/137009246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27280fd820 0x7f272806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:43.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.421+0000 7f272e6d9640 1 --2- 172.21.15.2:0/137009246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27280fc550 0x7f2728071570 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:43.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.421+0000 7f272e6d9640 1 -- 172.21.15.2:0/137009246 >> 172.21.15.2:0/137009246 conn(0x7f27280f7d30 msgr2=0x7f27280f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:43.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.421+0000 7f272e6d9640 1 -- 172.21.15.2:0/137009246 shutdown_connections 2024-09-17T00:59:43.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:43.421+0000 7f272e6d9640 1 -- 172.21.15.2:0/137009246 wait complete. 2024-09-17T00:59:43.428 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T00:59:43.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:43 smithi099 ceph-mon[34357]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 409 B/s wr, 5 op/s 2024-09-17T00:59:43.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:43 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:43.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:43 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:43.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:43 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:43.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:43 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:43.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:43 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:43.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:43 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:59:43.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:43 smithi002 ceph-mon[27650]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 409 B/s wr, 5 op/s 2024-09-17T00:59:43.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:43 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:43.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:43 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:43.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:43 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:43.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:43 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:43.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:43 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:43.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:43 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T00:59:44.482 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:44 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/137009246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T00:59:44.510 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-17T00:59:44.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:44 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/137009246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T00:59:45.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:45 smithi002 ceph-mon[27650]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.4 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-17T00:59:45.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:45 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:45.814 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:45 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:46.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:45 smithi099 ceph-mon[34357]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.4 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-17T00:59:46.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:45 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:46.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:45 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:46.061 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:47.818 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:47 smithi002 ceph-mon[27650]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-17T00:59:48.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:47 smithi099 ceph-mon[34357]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-17T00:59:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f4868bf3640 1 -- 172.21.15.2:0/1685492157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48640fb2f0 msgr2=0x7f4864101b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f4868bf3640 1 --2- 172.21.15.2:0/1685492157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48640fb2f0 0x7f4864101b40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f48580048d0 tx=0x7f4858009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f4868bf3640 1 -- 172.21.15.2:0/1685492157 shutdown_connections 2024-09-17T00:59:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f4868bf3640 1 --2- 172.21.15.2:0/1685492157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48640fb2f0 0x7f4864101b40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f4868bf3640 1 --2- 172.21.15.2:0/1685492157 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48640fa9a0 0x7f48640fadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f4868bf3640 1 -- 172.21.15.2:0/1685492157 >> 172.21.15.2:0/1685492157 conn(0x7f48640f63a0 msgr2=0x7f48640f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f4868bf3640 1 -- 172.21.15.2:0/1685492157 shutdown_connections 2024-09-17T00:59:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f4868bf3640 1 -- 172.21.15.2:0/1685492157 wait complete. 2024-09-17T00:59:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f4868bf3640 1 Processor -- start 2024-09-17T00:59:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f4868bf3640 1 -- start start 2024-09-17T00:59:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f4868bf3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48640fa9a0 0x7f486410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f4868bf3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48640fb2f0 0x7f486410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f4868bf3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486410dc30 con 0x7f48640fa9a0 2024-09-17T00:59:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f4868bf3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486410e450 con 0x7f48640fb2f0 2024-09-17T00:59:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.993+0000 7f486259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48640fa9a0 0x7f486410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.994+0000 7f486259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48640fa9a0 0x7f486410d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55528/0 (socket says 172.21.15.2:55528) 2024-09-17T00:59:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.994+0000 7f486259c640 1 -- 172.21.15.2:0/1516181169 learned_addr learned my addr 172.21.15.2:0/1516181169 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.994+0000 7f4861d9b640 1 --2- 172.21.15.2:0/1516181169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48640fb2f0 0x7f486410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.994+0000 7f486259c640 1 -- 172.21.15.2:0/1516181169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48640fb2f0 msgr2=0x7f486410d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.994+0000 7f486259c640 1 --2- 172.21.15.2:0/1516181169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48640fb2f0 0x7f486410d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.994+0000 7f486259c640 1 -- 172.21.15.2:0/1516181169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4858005040 con 0x7f48640fa9a0 2024-09-17T00:59:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.994+0000 7f486259c640 1 --2- 172.21.15.2:0/1516181169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48640fa9a0 0x7f486410d0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4854002a50 tx=0x7f4854004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.994+0000 7f4852ffd640 1 -- 172.21.15.2:0/1516181169 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4854007c30 con 0x7f48640fa9a0 2024-09-17T00:59:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.994+0000 7f4852ffd640 1 -- 172.21.15.2:0/1516181169 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f485400f040 con 0x7f48640fa9a0 2024-09-17T00:59:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.994+0000 7f4868bf3640 1 -- 172.21.15.2:0/1516181169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486410e6e0 con 0x7f48640fa9a0 2024-09-17T00:59:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.994+0000 7f4852ffd640 1 -- 172.21.15.2:0/1516181169 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f485400da10 con 0x7f48640fa9a0 2024-09-17T00:59:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.994+0000 7f4868bf3640 1 -- 172.21.15.2:0/1516181169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486410ec50 con 0x7f48640fa9a0 2024-09-17T00:59:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.995+0000 7f4868bf3640 1 -- 172.21.15.2:0/1516181169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48640fa040 con 0x7f48640fa9a0 2024-09-17T00:59:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.996+0000 7f4852ffd640 1 -- 172.21.15.2:0/1516181169 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f485400dc80 con 0x7f48640fa9a0 2024-09-17T00:59:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.996+0000 7f4852ffd640 1 --2- 172.21.15.2:0/1516181169 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f484c06ed60 0x7f484c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.997+0000 7f4852ffd640 1 -- 172.21.15.2:0/1516181169 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f485408da30 con 0x7f48640fa9a0 2024-09-17T00:59:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.997+0000 7f4861d9b640 1 --2- 172.21.15.2:0/1516181169 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f484c06ed60 0x7f484c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:48.997+0000 7f4861d9b640 1 --2- 172.21.15.2:0/1516181169 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f484c06ed60 0x7f484c071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4858000c00 tx=0x7f4858035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:49.001+0000 7f4852ffd640 1 -- 172.21.15.2:0/1516181169 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f485404d2a0 con 0x7f48640fa9a0 2024-09-17T00:59:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:49.278+0000 7f4868bf3640 1 -- 172.21.15.2:0/1516181169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f486404b720 con 0x7f48640fa9a0 2024-09-17T00:59:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:49.279+0000 7f4852ffd640 1 -- 172.21.15.2:0/1516181169 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v21) v1 ==== 78+0+100 (secure 0 0 0) 0x7f485405abd0 con 0x7f48640fa9a0 2024-09-17T00:59:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:49.281+0000 7f4868bf3640 1 -- 172.21.15.2:0/1516181169 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f484c06ed60 msgr2=0x7f484c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:49.281+0000 7f4868bf3640 1 --2- 172.21.15.2:0/1516181169 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f484c06ed60 0x7f484c071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4858000c00 tx=0x7f4858035040 comp rx=0 tx=0).stop 2024-09-17T00:59:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:49.281+0000 7f4868bf3640 1 -- 172.21.15.2:0/1516181169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48640fa9a0 msgr2=0x7f486410d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:49.281+0000 7f4868bf3640 1 --2- 172.21.15.2:0/1516181169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48640fa9a0 0x7f486410d0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4854002a50 tx=0x7f4854004600 comp rx=0 tx=0).stop 2024-09-17T00:59:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:49.281+0000 7f4868bf3640 1 -- 172.21.15.2:0/1516181169 shutdown_connections 2024-09-17T00:59:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:49.281+0000 7f4868bf3640 1 --2- 172.21.15.2:0/1516181169 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f484c06ed60 0x7f484c071210 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:49.281+0000 7f4868bf3640 1 --2- 172.21.15.2:0/1516181169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48640fb2f0 0x7f486410d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:49.281+0000 7f4868bf3640 1 --2- 172.21.15.2:0/1516181169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48640fa9a0 0x7f486410d0a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:49.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:49.281+0000 7f4868bf3640 1 -- 172.21.15.2:0/1516181169 >> 172.21.15.2:0/1516181169 conn(0x7f48640f63a0 msgr2=0x7f48640ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:49.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:49.281+0000 7f4868bf3640 1 -- 172.21.15.2:0/1516181169 shutdown_connections 2024-09-17T00:59:49.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:49.281+0000 7f4868bf3640 1 -- 172.21.15.2:0/1516181169 wait complete. 2024-09-17T00:59:49.288 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T00:59:49.872 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:49 smithi002 ceph-mon[27650]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-17T00:59:49.872 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:49 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:49.872 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:49 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:49.872 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:49 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:49.872 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:49 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:49.872 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:49 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:49.873 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:49 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/1516181169' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-17T00:59:49.898 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-17T00:59:49.910 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-17T00:59:50.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:49 smithi099 ceph-mon[34357]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-17T00:59:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:49 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:49 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:49 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T00:59:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:49 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T00:59:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:49 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T00:59:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:49 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/1516181169' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-17T00:59:50.170 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:51.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.789+0000 7fd11be5c640 1 -- 172.21.15.2:0/912539057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd114102ed0 msgr2=0x7fd1140fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:51.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.789+0000 7fd11be5c640 1 --2- 172.21.15.2:0/912539057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd114102ed0 0x7fd1140fc590 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd1040048d0 tx=0x7fd104009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:51.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.789+0000 7fd11be5c640 1 -- 172.21.15.2:0/912539057 shutdown_connections 2024-09-17T00:59:51.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.789+0000 7fd11be5c640 1 --2- 172.21.15.2:0/912539057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd114102ed0 0x7fd1140fc590 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:51.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.789+0000 7fd11be5c640 1 --2- 172.21.15.2:0/912539057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd114102530 0x7fd114102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:51.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.789+0000 7fd11be5c640 1 -- 172.21.15.2:0/912539057 >> 172.21.15.2:0/912539057 conn(0x7fd1140f80f0 msgr2=0x7fd1140fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:51.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.789+0000 7fd11be5c640 1 -- 172.21.15.2:0/912539057 shutdown_connections 2024-09-17T00:59:51.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.789+0000 7fd11be5c640 1 -- 172.21.15.2:0/912539057 wait complete. 2024-09-17T00:59:51.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.790+0000 7fd11be5c640 1 Processor -- start 2024-09-17T00:59:51.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.790+0000 7fd11be5c640 1 -- start start 2024-09-17T00:59:51.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.790+0000 7fd11be5c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd114102530 0x7fd1141131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:51.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.790+0000 7fd11be5c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd114102ed0 0x7fd114113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:51.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.790+0000 7fd11be5c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd114113d30 con 0x7fd114102530 2024-09-17T00:59:51.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.790+0000 7fd11be5c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11410d170 con 0x7fd114102ed0 2024-09-17T00:59:51.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.790+0000 7fd119bf8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd114102530 0x7fd1141131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:51.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.790+0000 7fd119bf8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd114102530 0x7fd1141131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38372/0 (socket says 172.21.15.2:38372) 2024-09-17T00:59:51.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.790+0000 7fd119bf8640 1 -- 172.21.15.2:0/767011596 learned_addr learned my addr 172.21.15.2:0/767011596 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:51.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.790+0000 7fd1193f7640 1 --2- 172.21.15.2:0/767011596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd114102ed0 0x7fd114113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:51.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.790+0000 7fd119bf8640 1 -- 172.21.15.2:0/767011596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd114102ed0 msgr2=0x7fd114113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:51.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.790+0000 7fd119bf8640 1 --2- 172.21.15.2:0/767011596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd114102ed0 0x7fd114113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:51.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.790+0000 7fd119bf8640 1 -- 172.21.15.2:0/767011596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd104005040 con 0x7fd114102530 2024-09-17T00:59:51.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.791+0000 7fd119bf8640 1 --2- 172.21.15.2:0/767011596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd114102530 0x7fd1141131f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd110002a50 tx=0x7fd110004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:51.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.791+0000 7fd10a7fc640 1 -- 172.21.15.2:0/767011596 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd110007c30 con 0x7fd114102530 2024-09-17T00:59:51.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.791+0000 7fd10a7fc640 1 -- 172.21.15.2:0/767011596 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd11000f040 con 0x7fd114102530 2024-09-17T00:59:51.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.791+0000 7fd11be5c640 1 -- 172.21.15.2:0/767011596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11410d450 con 0x7fd114102530 2024-09-17T00:59:51.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.791+0000 7fd10a7fc640 1 -- 172.21.15.2:0/767011596 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd11000da10 con 0x7fd114102530 2024-09-17T00:59:51.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.791+0000 7fd11be5c640 1 -- 172.21.15.2:0/767011596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11410d9c0 con 0x7fd114102530 2024-09-17T00:59:51.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.792+0000 7fd11be5c640 1 -- 172.21.15.2:0/767011596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1140fdcb0 con 0x7fd114102530 2024-09-17T00:59:51.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.793+0000 7fd10a7fc640 1 -- 172.21.15.2:0/767011596 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fd11000dc80 con 0x7fd114102530 2024-09-17T00:59:51.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.793+0000 7fd10a7fc640 1 --2- 172.21.15.2:0/767011596 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd10006ed60 0x7fd100071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:51.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.793+0000 7fd1193f7640 1 --2- 172.21.15.2:0/767011596 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd10006ed60 0x7fd100071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:51.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.793+0000 7fd10a7fc640 1 -- 172.21.15.2:0/767011596 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd11008da30 con 0x7fd114102530 2024-09-17T00:59:51.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.793+0000 7fd1193f7640 1 --2- 172.21.15.2:0/767011596 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd10006ed60 0x7fd100071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd1040048a0 tx=0x7fd104035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:51.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.797+0000 7fd10a7fc640 1 -- 172.21.15.2:0/767011596 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd11004d2a0 con 0x7fd114102530 2024-09-17T00:59:51.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:51 smithi002 ceph-mon[27650]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-17T00:59:51.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:59:51.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.999+0000 7fd11be5c640 1 -- 172.21.15.2:0/767011596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd114109590 con 0x7fd114102530 2024-09-17T00:59:51.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:51.999+0000 7fd10a7fc640 1 -- 172.21.15.2:0/767011596 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4710 (secure 0 0 0) 0x7fd11005abd0 con 0x7fd114102530 2024-09-17T00:59:51.997 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T00:59:51.998 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T00:59:40.489463+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi002.fmyyzz","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6829/1494631266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1494631266},{"type":"v1","addr":"172.21.15.2:6829","nonce":1494631266}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi099.hgawhu","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6825/4057317500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4057317500},{"type":"v1","addr":"172.21.15.99:6825","nonce":4057317500}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24279":{"gid":24279,"name":"cephfs.smithi099.heckcd","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.99:6827/689359372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":689359372},{"type":"v1","addr":"172.21.15.99:6827","nonce":689359372}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24287":{"gid":24287,"name":"cephfs.smithi002.zmrgxd","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6827/2986470392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2986470392},{"type":"v1","addr":"172.21.15.2:6827","nonce":2986470392}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-09-17T00:59:51.998 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 21 2024-09-17T00:59:51.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:52.001+0000 7fd11be5c640 1 -- 172.21.15.2:0/767011596 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd10006ed60 msgr2=0x7fd100071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:51.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:52.001+0000 7fd11be5c640 1 --2- 172.21.15.2:0/767011596 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd10006ed60 0x7fd100071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd1040048a0 tx=0x7fd104035040 comp rx=0 tx=0).stop 2024-09-17T00:59:51.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:52.001+0000 7fd11be5c640 1 -- 172.21.15.2:0/767011596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd114102530 msgr2=0x7fd1141131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:51.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:52.001+0000 7fd11be5c640 1 --2- 172.21.15.2:0/767011596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd114102530 0x7fd1141131f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd110002a50 tx=0x7fd110004600 comp rx=0 tx=0).stop 2024-09-17T00:59:52.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:52.001+0000 7fd11be5c640 1 -- 172.21.15.2:0/767011596 shutdown_connections 2024-09-17T00:59:52.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:52.001+0000 7fd11be5c640 1 --2- 172.21.15.2:0/767011596 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd10006ed60 0x7fd100071210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:52.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:52.001+0000 7fd11be5c640 1 --2- 172.21.15.2:0/767011596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd114102ed0 0x7fd114113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:52.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:52.001+0000 7fd11be5c640 1 --2- 172.21.15.2:0/767011596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd114102530 0x7fd1141131f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:52.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:52.001+0000 7fd11be5c640 1 -- 172.21.15.2:0/767011596 >> 172.21.15.2:0/767011596 conn(0x7fd1140f80f0 msgr2=0x7fd1140f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:52.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:52.001+0000 7fd11be5c640 1 -- 172.21.15.2:0/767011596 shutdown_connections 2024-09-17T00:59:52.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:52.001+0000 7fd11be5c640 1 -- 172.21.15.2:0/767011596 wait complete. 2024-09-17T00:59:52.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:51 smithi099 ceph-mon[34357]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-17T00:59:52.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:51 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T00:59:52.689 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 21, 'max_mds': 2, 'flags': 50} 2024-09-17T00:59:52.689 INFO:teuthology.run_tasks:Running task kclient... 2024-09-17T00:59:52.717 INFO:tasks.kclient:Mounting kernel clients... 2024-09-17T00:59:52.717 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-17T00:59:52.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T00:59:52.717 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-17T00:59:52.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T00:59:52.737 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-17T00:59:52.808 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-09-17T00:59:52.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T00:59:52.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T00:59:52.810 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-17T00:59:52.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T00:59:52.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-09-17T00:59:52.906 INFO:teuthology.orchestra.run.smithi099.stderr:Cannot find device "ceph-brx" 2024-09-17T00:59:52.907 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T00:59:52.908 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-17T00:59:52.908 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T00:59:52.908 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T00:59:52.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-17T00:59:52.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:52 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/767011596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T00:59:53.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:52 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/767011596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T00:59:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:54.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:53 smithi099 ceph-mon[34357]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-17T00:59:54.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:53 smithi002 ceph-mon[27650]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-17T00:59:54.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.814+0000 7fcfeef17640 1 -- 172.21.15.2:0/2746133811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe81015a0 msgr2=0x7fcfe8101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:54.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.814+0000 7fcfeef17640 1 --2- 172.21.15.2:0/2746133811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe81015a0 0x7fcfe8101970 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80048d0 tx=0x7fcfd8009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:54.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.814+0000 7fcfeef17640 1 -- 172.21.15.2:0/2746133811 shutdown_connections 2024-09-17T00:59:54.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.814+0000 7fcfeef17640 1 --2- 172.21.15.2:0/2746133811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfe8101f40 0x7fcfe80fb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:54.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.814+0000 7fcfeef17640 1 --2- 172.21.15.2:0/2746133811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe81015a0 0x7fcfe8101970 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:54.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.814+0000 7fcfeef17640 1 -- 172.21.15.2:0/2746133811 >> 172.21.15.2:0/2746133811 conn(0x7fcfe80f7030 msgr2=0x7fcfe80f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:54.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.814+0000 7fcfeef17640 1 -- 172.21.15.2:0/2746133811 shutdown_connections 2024-09-17T00:59:54.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.814+0000 7fcfeef17640 1 -- 172.21.15.2:0/2746133811 wait complete. 2024-09-17T00:59:54.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.815+0000 7fcfeef17640 1 Processor -- start 2024-09-17T00:59:54.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.815+0000 7fcfeef17640 1 -- start start 2024-09-17T00:59:54.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.815+0000 7fcfeef17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe81015a0 0x7fcfe810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:54.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.815+0000 7fcfeef17640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfe8101f40 0x7fcfe810c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:54.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.815+0000 7fcfeef17640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe810cb90 con 0x7fcfe81015a0 2024-09-17T00:59:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.815+0000 7fcfeef17640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe810ccd0 con 0x7fcfe8101f40 2024-09-17T00:59:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.816+0000 7fcfeccb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe81015a0 0x7fcfe810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.816+0000 7fcfeccb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe81015a0 0x7fcfe810c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38380/0 (socket says 172.21.15.2:38380) 2024-09-17T00:59:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.816+0000 7fcfeccb3640 1 -- 172.21.15.2:0/3735914904 learned_addr learned my addr 172.21.15.2:0/3735914904 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.816+0000 7fcfe7fff640 1 --2- 172.21.15.2:0/3735914904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfe8101f40 0x7fcfe810c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.816+0000 7fcfeccb3640 1 -- 172.21.15.2:0/3735914904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfe8101f40 msgr2=0x7fcfe810c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.816+0000 7fcfeccb3640 1 --2- 172.21.15.2:0/3735914904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfe8101f40 0x7fcfe810c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.816+0000 7fcfeccb3640 1 -- 172.21.15.2:0/3735914904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd8005040 con 0x7fcfe81015a0 2024-09-17T00:59:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.816+0000 7fcfeccb3640 1 --2- 172.21.15.2:0/3735914904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe81015a0 0x7fcfe810c110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8003080 tx=0x7fcfd8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.816+0000 7fcfe57fa640 1 -- 172.21.15.2:0/3735914904 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd8038070 con 0x7fcfe81015a0 2024-09-17T00:59:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.816+0000 7fcfe57fa640 1 -- 172.21.15.2:0/3735914904 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcfd80097e0 con 0x7fcfe81015a0 2024-09-17T00:59:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.816+0000 7fcfe57fa640 1 -- 172.21.15.2:0/3735914904 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd803d420 con 0x7fcfe81015a0 2024-09-17T00:59:54.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.816+0000 7fcfeef17640 1 -- 172.21.15.2:0/3735914904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe810cf50 con 0x7fcfe81015a0 2024-09-17T00:59:54.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.816+0000 7fcfeef17640 1 -- 172.21.15.2:0/3735914904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe8119a50 con 0x7fcfe81015a0 2024-09-17T00:59:54.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.817+0000 7fcfeef17640 1 -- 172.21.15.2:0/3735914904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe80fac90 con 0x7fcfe81015a0 2024-09-17T00:59:54.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.818+0000 7fcfe57fa640 1 -- 172.21.15.2:0/3735914904 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fcfd8030020 con 0x7fcfe81015a0 2024-09-17T00:59:54.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.818+0000 7fcfe57fa640 1 --2- 172.21.15.2:0/3735914904 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fcfd006ed60 0x7fcfd0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:54.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.818+0000 7fcfe57fa640 1 -- 172.21.15.2:0/3735914904 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcfd80ae710 con 0x7fcfe81015a0 2024-09-17T00:59:54.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.818+0000 7fcfe7fff640 1 --2- 172.21.15.2:0/3735914904 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fcfd006ed60 0x7fcfd0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:54.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.819+0000 7fcfe7fff640 1 --2- 172.21.15.2:0/3735914904 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fcfd006ed60 0x7fcfd0071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8066500 tx=0x7fcfdc009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:54.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:54.822+0000 7fcfe57fa640 1 -- 172.21.15.2:0/3735914904 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcfd807b860 con 0x7fcfe81015a0 2024-09-17T00:59:55.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55.023+0000 7fcfeef17640 1 -- 172.21.15.2:0/3735914904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcfe80fcc10 con 0x7fcfe81015a0 2024-09-17T00:59:55.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55.024+0000 7fcfe57fa640 1 -- 172.21.15.2:0/3735914904 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+83 (secure 0 0 0) 0x7fcfd807b200 con 0x7fcfe81015a0 2024-09-17T00:59:55.022 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-17T00:59:55.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55.026+0000 7fcfeef17640 1 -- 172.21.15.2:0/3735914904 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fcfd006ed60 msgr2=0x7fcfd0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:55.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55.026+0000 7fcfeef17640 1 --2- 172.21.15.2:0/3735914904 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fcfd006ed60 0x7fcfd0071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8066500 tx=0x7fcfdc009040 comp rx=0 tx=0).stop 2024-09-17T00:59:55.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55.026+0000 7fcfeef17640 1 -- 172.21.15.2:0/3735914904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe81015a0 msgr2=0x7fcfe810c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:55.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55.026+0000 7fcfeef17640 1 --2- 172.21.15.2:0/3735914904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe81015a0 0x7fcfe810c110 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8003080 tx=0x7fcfd8009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:55.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55.026+0000 7fcfeef17640 1 -- 172.21.15.2:0/3735914904 shutdown_connections 2024-09-17T00:59:55.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55.026+0000 7fcfeef17640 1 --2- 172.21.15.2:0/3735914904 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fcfd006ed60 0x7fcfd0071210 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:55.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55.026+0000 7fcfeef17640 1 --2- 172.21.15.2:0/3735914904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfe8101f40 0x7fcfe810c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:55.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55.026+0000 7fcfeef17640 1 --2- 172.21.15.2:0/3735914904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe81015a0 0x7fcfe810c110 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:55.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55.026+0000 7fcfeef17640 1 -- 172.21.15.2:0/3735914904 >> 172.21.15.2:0/3735914904 conn(0x7fcfe80f7030 msgr2=0x7fcfe80f80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:55.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55.026+0000 7fcfeef17640 1 -- 172.21.15.2:0/3735914904 shutdown_connections 2024-09-17T00:59:55.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55.026+0000 7fcfeef17640 1 -- 172.21.15.2:0/3735914904 wait complete. 2024-09-17T00:59:55.673 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T00:59:55.673 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T00:59:55.673 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-09-17T00:59:55.673 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T00:59:55.673 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T00:59:55.673 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T00:59:55.673 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T00:59:55.673 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T00:59:55.673 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T00:59:55.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T00:59:55.673 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-09-17T00:59:55.732 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T00:59:55.732 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T00:59:55.732 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T00:59:55.732 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-17T00:59:55.732 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-09-17T00:59:55.733 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-17T00:59:55.733 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T00:59:55.733 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-09-17T00:59:55.733 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-09-17T00:59:55.733 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T00:59:55.733 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-09-17T00:59:55.733 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-09-17T00:59:55.733 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T00:59:55.733 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-09-17T00:59:55.733 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-09-17T00:59:55.733 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T00:59:55.733 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42316sec preferred_lft 42316sec 2024-09-17T00:59:55.733 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-17T00:59:55.733 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-17T00:59:55.734 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T00:59:55.734 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-09-17T00:59:55.734 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-09-17T00:59:55.734 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T00:59:55.734 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T00:59:55.734 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-17T00:59:55.734 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-09-17T00:59:55.735 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-09-17T00:59:55.735 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-09-17T00:59:55.735 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T00:59:55.735 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-17T00:59:55.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T00:59:55.896 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:55 smithi002 ceph-mon[27650]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-17T00:59:55.896 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:55 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3735914904' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T00:59:55.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T00:59:55.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T00:59:55.952 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T00:59:55.979 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-09-17T00:59:55.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T00:59:55.981 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-09-17T00:59:56.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:55 smithi099 ceph-mon[34357]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-17T00:59:56.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:55 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3735914904' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T00:59:56.050 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-09-17T00:59:56.050 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T00:59:56.050 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T00:59:56.050 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T00:59:56.050 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T00:59:56.050 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T00:59:56.051 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-17T00:59:56.051 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T00:59:56.051 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T00:59:56.051 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T00:59:56.051 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-17T00:59:56.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T00:59:56.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T00:59:56.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T00:59:56.394 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-17T00:59:56.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T00:59:56.410 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-09-17T00:59:56.466 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T00:59:56.466 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-17T00:59:56.466 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T00:59:56.466 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T00:59:56.467 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-17T00:59:56.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T00:59:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T00:59:56.586 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T00:59:56.586 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T00:59:56.586 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-17T00:59:56.586 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T00:59:56.586 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T00:59:56.586 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T00:59:56.586 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T00:59:56.587 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T00:59:56.587 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-17T00:59:56.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T00:59:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T00:59:56.718 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T00:59:56.718 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-17T00:59:56.719 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-09-17T00:59:56.719 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T00:59:56.719 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-17T00:59:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T00:59:56.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T00:59:56.799 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T00:59:56.799 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T00:59:56.814 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T00:59:56.814 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T00:59:56.815 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T00:59:56.871 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T00:59:56.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T00:59:56.871 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T00:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T00:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T00:59:56.977 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2024-09-17T00:59:57.105 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T00:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T00:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2024-09-17T00:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.99:3300" 2024-09-17T00:59:57.106 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T00:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T00:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T00:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2024-09-17T00:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.99:3300" 2024-09-17T00:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T00:59:57.111 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.99:6789" 2024-09-17T00:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.99:6789:/ 2024-09-17T00:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f8e82564-748e-11ef-bceb-c7b262605968" will pass to kernel 2024-09-17T00:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T00:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-09-17T00:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T00:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T00:59:57.112 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T00:59:57.114 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T00:59:57.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T00:59:57.114 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T00:59:57.140 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T00:59:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T00:59:57.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T00:59:57.243 INFO:teuthology.orchestra.run.smithi002.stdout:client24303 2024-09-17T00:59:57.243 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T00:59:57.243 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T00:59:57.261 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T00:59:57.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T00:59:57.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T00:59:57.362 INFO:teuthology.orchestra.run.smithi002.stdout:client24303 2024-09-17T00:59:57.362 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T00:59:57.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T00:59:57.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T00:59:57.425 INFO:teuthology.orchestra.run.smithi002.stdout:client24303 2024-09-17T00:59:57.426 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f8e82564-748e-11ef-bceb-c7b262605968.client24303/status') 2024-09-17T00:59:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T00:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout:instance: client.24303 (3)172.21.15.2:0/3269658118 2024-09-17T00:59:57.488 INFO:teuthology.orchestra.run.smithi002.stdout:blocklisted: false 2024-09-17T00:59:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records in 2024-09-17T00:59:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records out 2024-09-17T00:59:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:70 bytes copied, 2.352e-05 s, 3.0 MB/s 2024-09-17T00:59:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T00:59:57.496 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-17T00:59:57.496 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T00:59:57.496 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T00:59:57.497 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-17T00:59:57.754 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T00:59:57.876 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:57 smithi002 ceph-mon[27650]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.1 KiB/s rd, 7 op/s 2024-09-17T00:59:58.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:57 smithi099 ceph-mon[34357]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.1 KiB/s rd, 7 op/s 2024-09-17T00:59:59.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.382+0000 7f5cb7e76640 1 -- 172.21.15.2:0/1993113879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb00fac80 msgr2=0x7f5cb00fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:59.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.382+0000 7f5cb7e76640 1 --2- 172.21.15.2:0/1993113879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb00fac80 0x7f5cb00fb0f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00048d0 tx=0x7f5ca0009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:59.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.382+0000 7f5cb7e76640 1 -- 172.21.15.2:0/1993113879 shutdown_connections 2024-09-17T00:59:59.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.382+0000 7f5cb7e76640 1 --2- 172.21.15.2:0/1993113879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb00fac80 0x7f5cb00fb0f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:59.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.382+0000 7f5cb7e76640 1 --2- 172.21.15.2:0/1993113879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cb0102620 0x7f5cb01029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:59.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.382+0000 7f5cb7e76640 1 -- 172.21.15.2:0/1993113879 >> 172.21.15.2:0/1993113879 conn(0x7f5cb0070ce0 msgr2=0x7f5cb00710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:59.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.382+0000 7f5cb7e76640 1 -- 172.21.15.2:0/1993113879 shutdown_connections 2024-09-17T00:59:59.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.382+0000 7f5cb7e76640 1 -- 172.21.15.2:0/1993113879 wait complete. 2024-09-17T00:59:59.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.383+0000 7f5cb7e76640 1 Processor -- start 2024-09-17T00:59:59.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.383+0000 7f5cb7e76640 1 -- start start 2024-09-17T00:59:59.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.383+0000 7f5cb7e76640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cb00fac80 0x7f5cb01131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:59.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.383+0000 7f5cb7e76640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb0102620 0x7f5cb0113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:59.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.383+0000 7f5cb7e76640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb0113d20 con 0x7f5cb0102620 2024-09-17T00:59:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.383+0000 7f5cb7e76640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb010d160 con 0x7f5cb00fac80 2024-09-17T00:59:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.383+0000 7f5cb5411640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb0102620 0x7f5cb0113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.383+0000 7f5cb5411640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb0102620 0x7f5cb0113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38392/0 (socket says 172.21.15.2:38392) 2024-09-17T00:59:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.383+0000 7f5cb5411640 1 -- 172.21.15.2:0/208623837 learned_addr learned my addr 172.21.15.2:0/208623837 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T00:59:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.384+0000 7f5cb5c12640 1 --2- 172.21.15.2:0/208623837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cb00fac80 0x7f5cb01131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.384+0000 7f5cb5411640 1 -- 172.21.15.2:0/208623837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cb00fac80 msgr2=0x7f5cb01131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.384+0000 7f5cb5411640 1 --2- 172.21.15.2:0/208623837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cb00fac80 0x7f5cb01131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.384+0000 7f5cb5411640 1 -- 172.21.15.2:0/208623837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca0005040 con 0x7f5cb0102620 2024-09-17T00:59:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.384+0000 7f5cb5411640 1 --2- 172.21.15.2:0/208623837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb0102620 0x7f5cb0113720 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0003080 tx=0x7f5ca0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.384+0000 7f5ca67fc640 1 -- 172.21.15.2:0/208623837 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ca0038070 con 0x7f5cb0102620 2024-09-17T00:59:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.384+0000 7f5ca67fc640 1 -- 172.21.15.2:0/208623837 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5ca00097e0 con 0x7f5cb0102620 2024-09-17T00:59:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.384+0000 7f5cb7e76640 1 -- 172.21.15.2:0/208623837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb010d3e0 con 0x7f5cb0102620 2024-09-17T00:59:59.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.384+0000 7f5ca67fc640 1 -- 172.21.15.2:0/208623837 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ca003d420 con 0x7f5cb0102620 2024-09-17T00:59:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.384+0000 7f5cb7e76640 1 -- 172.21.15.2:0/208623837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb010d920 con 0x7f5cb0102620 2024-09-17T00:59:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.385+0000 7f5cb7e76640 1 -- 172.21.15.2:0/208623837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb00657b0 con 0x7f5cb0102620 2024-09-17T00:59:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.386+0000 7f5ca67fc640 1 -- 172.21.15.2:0/208623837 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f5ca0030020 con 0x7f5cb0102620 2024-09-17T00:59:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.386+0000 7f5ca67fc640 1 --2- 172.21.15.2:0/208623837 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f5c9c06ed60 0x7f5c9c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T00:59:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.386+0000 7f5ca67fc640 1 -- 172.21.15.2:0/208623837 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5ca00ae800 con 0x7f5cb0102620 2024-09-17T00:59:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.386+0000 7f5cb5c12640 1 --2- 172.21.15.2:0/208623837 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f5c9c06ed60 0x7f5c9c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T00:59:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.387+0000 7f5cb5c12640 1 --2- 172.21.15.2:0/208623837 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f5c9c06ed60 0x7f5c9c071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0041d0 tx=0x7f5cac009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T00:59:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.391+0000 7f5ca67fc640 1 -- 172.21.15.2:0/208623837 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5ca007b8d0 con 0x7f5cb0102620 2024-09-17T00:59:59.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.591+0000 7f5cb7e76640 1 -- 172.21.15.2:0/208623837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5cb0109590 con 0x7f5cb0102620 2024-09-17T00:59:59.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.591+0000 7f5ca67fc640 1 -- 172.21.15.2:0/208623837 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+83 (secure 0 0 0) 0x7f5ca007b270 con 0x7f5cb0102620 2024-09-17T00:59:59.590 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-17T00:59:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.594+0000 7f5cb7e76640 1 -- 172.21.15.2:0/208623837 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f5c9c06ed60 msgr2=0x7f5c9c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.594+0000 7f5cb7e76640 1 --2- 172.21.15.2:0/208623837 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f5c9c06ed60 0x7f5c9c071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0041d0 tx=0x7f5cac009040 comp rx=0 tx=0).stop 2024-09-17T00:59:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.594+0000 7f5cb7e76640 1 -- 172.21.15.2:0/208623837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb0102620 msgr2=0x7f5cb0113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T00:59:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.594+0000 7f5cb7e76640 1 --2- 172.21.15.2:0/208623837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb0102620 0x7f5cb0113720 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0003080 tx=0x7f5ca0009da0 comp rx=0 tx=0).stop 2024-09-17T00:59:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.594+0000 7f5cb7e76640 1 -- 172.21.15.2:0/208623837 shutdown_connections 2024-09-17T00:59:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.594+0000 7f5cb7e76640 1 --2- 172.21.15.2:0/208623837 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f5c9c06ed60 0x7f5c9c071210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.594+0000 7f5cb7e76640 1 --2- 172.21.15.2:0/208623837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5cb0102620 0x7f5cb0113720 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.594+0000 7f5cb7e76640 1 --2- 172.21.15.2:0/208623837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cb00fac80 0x7f5cb01131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T00:59:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.594+0000 7f5cb7e76640 1 -- 172.21.15.2:0/208623837 >> 172.21.15.2:0/208623837 conn(0x7f5cb0070ce0 msgr2=0x7f5cb0105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T00:59:59.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.594+0000 7f5cb7e76640 1 -- 172.21.15.2:0/208623837 shutdown_connections 2024-09-17T00:59:59.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T00:59:59.594+0000 7f5cb7e76640 1 -- 172.21.15.2:0/208623837 wait complete. 2024-09-17T00:59:59.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:59 smithi002 ceph-mon[27650]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T00:59:59.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 00:59:59 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/208623837' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T01:00:00.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:59 smithi099 ceph-mon[34357]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:00:00.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 00:59:59 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/208623837' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T01:00:00.243 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T01:00:00.243 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:00:00.243 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-17T01:00:00.243 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T01:00:00.243 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T01:00:00.244 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T01:00:00.244 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T01:00:00.244 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:00:00.244 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T01:00:00.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:00:00.244 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-17T01:00:00.263 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:00:00.263 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:00:00.263 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:00:00.264 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:00:00.264 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-17T01:00:00.264 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:00:00.264 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:00:00.264 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:00:00.264 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-09-17T01:00:00.264 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:00:00.264 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:00:00.264 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-09-17T01:00:00.264 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:00:00.264 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:00:00.264 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:00:00.264 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:00:00.265 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T01:00:00.265 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42323sec preferred_lft 42323sec 2024-09-17T01:00:00.265 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-17T01:00:00.265 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:00:00.265 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T01:00:00.265 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:00:00.265 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-17T01:00:00.265 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add name ceph-brx type bridge 2024-09-17T01:00:00.265 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr flush dev ceph-brx 2024-09-17T01:00:00.265 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set ceph-brx up 2024-09-17T01:00:00.265 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T01:00:00.266 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-17T01:00:00.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:00:00.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:00:00.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:00:00.561 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:00:00.585 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-17T01:00:00.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:00:00.587 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-17T01:00:00.661 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-17T01:00:00.661 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:00:00.661 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T01:00:00.662 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T01:00:00.662 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:00:00.662 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:00:00.662 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-17T01:00:00.662 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T01:00:00.663 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T01:00:00.663 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T01:00:00.663 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-17T01:00:00.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:00:00.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:00 smithi002 ceph-mon[27650]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:00:00.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:00 smithi002 ceph-mon[27650]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:00:00.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:00 smithi002 ceph-mon[27650]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:00:00.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:00:00.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:00:00.944 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-17T01:00:00.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:00:00.960 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2024-09-17T01:00:01.006 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:00 smithi099 ceph-mon[34357]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:00:01.006 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:00 smithi099 ceph-mon[34357]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:00:01.006 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:00 smithi099 ceph-mon[34357]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:00:01.015 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:00:01.015 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-17T01:00:01.016 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:00:01.016 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T01:00:01.016 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-17T01:00:01.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:00:01.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:00:01.136 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T01:00:01.136 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:00:01.136 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-17T01:00:01.136 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T01:00:01.136 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T01:00:01.136 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T01:00:01.137 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T01:00:01.137 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T01:00:01.137 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-17T01:00:01.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:00:01.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:00:01.276 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:00:01.276 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-17T01:00:01.276 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-09-17T01:00:01.276 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T01:00:01.276 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-17T01:00:01.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:00:01.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:00:01.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:00:01.352 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T01:00:01.367 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T01:00:01.367 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:00:01.367 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T01:00:01.423 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:00:01.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:00:01.423 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T01:00:01.515 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T01:00:01.516 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T01:00:01.516 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-09-17T01:00:01.641 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T01:00:01.641 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T01:00:01.641 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-09-17T01:00:01.641 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.99:3300" 2024-09-17T01:00:01.641 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:00:01.645 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T01:00:01.646 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T01:00:01.646 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-09-17T01:00:01.646 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.99:3300" 2024-09-17T01:00:01.646 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:00:01.646 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.99:6789" 2024-09-17T01:00:01.646 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.99:6789:/ 2024-09-17T01:00:01.646 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f8e82564-748e-11ef-bceb-c7b262605968" will pass to kernel 2024-09-17T01:00:01.646 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T01:00:01.646 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:00:01.647 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:00:01.647 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:00:01.647 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:00:01.648 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:00:01.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:00:01.649 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T01:00:01.713 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:00:01.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:00:01.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:00:01.768 INFO:teuthology.orchestra.run.smithi099.stdout:client14500 2024-09-17T01:00:01.768 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T01:00:01.769 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:00:01.785 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:00:01.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:00:01.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:00:01.880 INFO:teuthology.orchestra.run.smithi099.stdout:client14500 2024-09-17T01:00:01.880 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:00:01.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:01 smithi002 ceph-mon[27650]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-17T01:00:01.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:00:01.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:00:01.935 INFO:teuthology.orchestra.run.smithi099.stdout:client14500 2024-09-17T01:00:01.936 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f8e82564-748e-11ef-bceb-c7b262605968.client14500/status') 2024-09-17T01:00:01.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:00:01.991 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:01 smithi099 ceph-mon[34357]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-17T01:00:01.994 INFO:teuthology.orchestra.run.smithi099.stdout:instance: client.14500 (3)172.21.15.99:0/839646600 2024-09-17T01:00:01.994 INFO:teuthology.orchestra.run.smithi099.stdout:blocklisted: false 2024-09-17T01:00:01.994 INFO:teuthology.orchestra.run.smithi099.stderr:0+1 records in 2024-09-17T01:00:01.994 INFO:teuthology.orchestra.run.smithi099.stderr:0+1 records out 2024-09-17T01:00:01.994 INFO:teuthology.orchestra.run.smithi099.stderr:70 bytes copied, 2.4413e-05 s, 2.9 MB/s 2024-09-17T01:00:01.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-17T01:00:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:00:02.001 INFO:teuthology.run_tasks:Running task print... 2024-09-17T01:00:02.011 INFO:teuthology.task.print:**** done client 2024-09-17T01:00:02.011 INFO:teuthology.run_tasks:Running task parallel... 2024-09-17T01:00:02.206 INFO:teuthology.task.parallel:starting parallel... 2024-09-17T01:00:02.206 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-17T01:00:02.207 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T01:00:02.207 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T01:00:02.207 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-17T01:00:02.208 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-17T01:00:02.208 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-17T01:00:02.212 INFO:tasks.workunit:Pulling workunits from ref e20bff7d16f5b09c58ead9548e8cf98cf87ee227 2024-09-17T01:00:02.212 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-17T01:00:02.213 INFO:tasks.workunit:timeout=3h 2024-09-17T01:00:02.213 INFO:tasks.workunit:cleanup=True 2024-09-17T01:00:02.213 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-17T01:00:02.236 INFO:teuthology.orchestra.run.smithi002.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-17T01:00:02.237 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-17T01:00:02.237 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 7ah/122d Inode: 1 Links: 2 2024-09-17T01:00:02.237 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:00:02.237 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-17T01:00:02.237 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T01:00:02.237 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-17 00:59:25.509177078 +0000 2024-09-17T01:00:02.237 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-17 00:59:57.140682903 +0000 2024-09-17T01:00:02.237 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-17 00:59:25.509177078 +0000 2024-09-17T01:00:02.237 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-17T01:00:02.237 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-17T01:00:02.309 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-17T01:00:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-17T01:00:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-17T01:00:02.326 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 75h/117d Inode: 1 Links: 3 2024-09-17T01:00:02.326 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:00:02.326 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-17T01:00:02.327 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T01:00:02.327 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-17 01:00:02.305564906 +0000 2024-09-17T01:00:02.327 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-17 01:00:02.305564906 +0000 2024-09-17T01:00:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-17 00:59:25.509177078 +0000 2024-09-17T01:00:02.327 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-17T01:00:02.327 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-17T01:00:02.398 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e20bff7d16f5b09c58ead9548e8cf98cf87ee227 2024-09-17T01:00:02.398 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout e20bff7d16f5b09c58ead9548e8cf98cf87ee227 2024-09-17T01:00:02.415 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-17T01:00:02.454 INFO:tasks.workunit.client.1.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-17T01:00:02.491 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:00:03.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:03 smithi002 ceph-mon[27650]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-17T01:00:03.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.984+0000 7f7833ace640 1 -- 172.21.15.2:0/2808589055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0fc700 msgr2=0x7f782c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:03.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.984+0000 7f7833ace640 1 --2- 172.21.15.2:0/2808589055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0fc700 0x7f782c0fcb70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f781c0048d0 tx=0x7f781c009da0 comp rx=0 tx=0).stop 2024-09-17T01:00:03.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.984+0000 7f7833ace640 1 -- 172.21.15.2:0/2808589055 shutdown_connections 2024-09-17T01:00:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.984+0000 7f7833ace640 1 --2- 172.21.15.2:0/2808589055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0fc700 0x7f782c0fcb70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.984+0000 7f7833ace640 1 --2- 172.21.15.2:0/2808589055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c0fb430 0x7f782c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.984+0000 7f7833ace640 1 -- 172.21.15.2:0/2808589055 >> 172.21.15.2:0/2808589055 conn(0x7f782c0f6c10 msgr2=0x7f782c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.984+0000 7f7833ace640 1 -- 172.21.15.2:0/2808589055 shutdown_connections 2024-09-17T01:00:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.984+0000 7f7833ace640 1 -- 172.21.15.2:0/2808589055 wait complete. 2024-09-17T01:00:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.985+0000 7f7833ace640 1 Processor -- start 2024-09-17T01:00:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.985+0000 7f7833ace640 1 -- start start 2024-09-17T01:00:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.985+0000 7f7833ace640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c0fb430 0x7f782c10fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.985+0000 7f7833ace640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0fc700 0x7f782c1122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.985+0000 7f7833ace640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c065c60 con 0x7f782c0fc700 2024-09-17T01:00:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.985+0000 7f7833ace640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c065dd0 con 0x7f782c0fb430 2024-09-17T01:00:03.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.985+0000 7f7831069640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0fc700 0x7f782c1122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.985+0000 7f7831069640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0fc700 0x7f782c1122d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36592/0 (socket says 172.21.15.2:36592) 2024-09-17T01:00:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.985+0000 7f7831069640 1 -- 172.21.15.2:0/3280241850 learned_addr learned my addr 172.21.15.2:0/3280241850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:00:03.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.985+0000 7f783186a640 1 --2- 172.21.15.2:0/3280241850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c0fb430 0x7f782c10fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.985+0000 7f7831069640 1 -- 172.21.15.2:0/3280241850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c0fb430 msgr2=0x7f782c10fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.985+0000 7f7831069640 1 --2- 172.21.15.2:0/3280241850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c0fb430 0x7f782c10fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.985+0000 7f7831069640 1 -- 172.21.15.2:0/3280241850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c005040 con 0x7f782c0fc700 2024-09-17T01:00:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.986+0000 7f7831069640 1 --2- 172.21.15.2:0/3280241850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0fc700 0x7f782c1122d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f781c003080 tx=0x7f781c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.986+0000 7f78227fc640 1 -- 172.21.15.2:0/3280241850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f781c038070 con 0x7f782c0fc700 2024-09-17T01:00:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.986+0000 7f78227fc640 1 -- 172.21.15.2:0/3280241850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f781c02abd0 con 0x7f782c0fc700 2024-09-17T01:00:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.986+0000 7f78227fc640 1 -- 172.21.15.2:0/3280241850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f781c03e670 con 0x7f782c0fc700 2024-09-17T01:00:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.986+0000 7f7833ace640 1 -- 172.21.15.2:0/3280241850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c112810 con 0x7f782c0fc700 2024-09-17T01:00:03.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.986+0000 7f7833ace640 1 -- 172.21.15.2:0/3280241850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c112d80 con 0x7f782c0fc700 2024-09-17T01:00:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.987+0000 7f7833ace640 1 -- 172.21.15.2:0/3280241850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c0fa890 con 0x7f782c0fc700 2024-09-17T01:00:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.987+0000 7f78227fc640 1 -- 172.21.15.2:0/3280241850 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f781c030020 con 0x7f782c0fc700 2024-09-17T01:00:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.988+0000 7f78227fc640 1 --2- 172.21.15.2:0/3280241850 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f781806ed60 0x7f7818071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.988+0000 7f78227fc640 1 -- 172.21.15.2:0/3280241850 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f781c0ae440 con 0x7f782c0fc700 2024-09-17T01:00:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.988+0000 7f783186a640 1 --2- 172.21.15.2:0/3280241850 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f781806ed60 0x7f7818071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:03.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.988+0000 7f783186a640 1 --2- 172.21.15.2:0/3280241850 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f781806ed60 0x7f7818071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f78280041d0 tx=0x7f7828004330 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:03.992+0000 7f78227fc640 1 -- 172.21.15.2:0/3280241850 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f781c07b640 con 0x7f782c0fc700 2024-09-17T01:00:04.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:03 smithi099 ceph-mon[34357]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-17T01:00:04.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:04.155+0000 7f7833ace640 1 -- 172.21.15.2:0/3280241850 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f782c04b720 con 0x7f782c0fc700 2024-09-17T01:00:04.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:04.155+0000 7f78227fc640 1 -- 172.21.15.2:0/3280241850 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f781c07afe0 con 0x7f782c0fc700 2024-09-17T01:00:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:04.157+0000 7f7833ace640 1 -- 172.21.15.2:0/3280241850 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f781806ed60 msgr2=0x7f7818071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:04.157+0000 7f7833ace640 1 --2- 172.21.15.2:0/3280241850 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f781806ed60 0x7f7818071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f78280041d0 tx=0x7f7828004330 comp rx=0 tx=0).stop 2024-09-17T01:00:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:04.157+0000 7f7833ace640 1 -- 172.21.15.2:0/3280241850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0fc700 msgr2=0x7f782c1122d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:04.157+0000 7f7833ace640 1 --2- 172.21.15.2:0/3280241850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0fc700 0x7f782c1122d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f781c003080 tx=0x7f781c009da0 comp rx=0 tx=0).stop 2024-09-17T01:00:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:04.158+0000 7f7833ace640 1 -- 172.21.15.2:0/3280241850 shutdown_connections 2024-09-17T01:00:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:04.158+0000 7f7833ace640 1 --2- 172.21.15.2:0/3280241850 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f781806ed60 0x7f7818071210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:04.158+0000 7f7833ace640 1 --2- 172.21.15.2:0/3280241850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0fc700 0x7f782c1122d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:04.158+0000 7f7833ace640 1 --2- 172.21.15.2:0/3280241850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c0fb430 0x7f782c10fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:04.158+0000 7f7833ace640 1 -- 172.21.15.2:0/3280241850 >> 172.21.15.2:0/3280241850 conn(0x7f782c0f6c10 msgr2=0x7f782c0f8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:04.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:04.158+0000 7f7833ace640 1 -- 172.21.15.2:0/3280241850 shutdown_connections 2024-09-17T01:00:04.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:04.158+0000 7f7833ace640 1 -- 172.21.15.2:0/3280241850 wait complete. 2024-09-17T01:00:04.780 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-17T01:00:05.082 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:00:06.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:05 smithi099 ceph-mon[34357]: pgmap v196: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-17T01:00:06.101 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:05 smithi002 ceph-mon[27650]: pgmap v196: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-17T01:00:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.625+0000 7fe89e0ae640 1 -- 172.21.15.2:0/3604902782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8980fd7f0 msgr2=0x7fe8980fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.625+0000 7fe89e0ae640 1 --2- 172.21.15.2:0/3604902782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8980fd7f0 0x7fe8980fdc60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe8800048d0 tx=0x7fe880009da0 comp rx=0 tx=0).stop 2024-09-17T01:00:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.625+0000 7fe89e0ae640 1 -- 172.21.15.2:0/3604902782 shutdown_connections 2024-09-17T01:00:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.625+0000 7fe89e0ae640 1 --2- 172.21.15.2:0/3604902782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8980fd7f0 0x7fe8980fdc60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.625+0000 7fe89e0ae640 1 --2- 172.21.15.2:0/3604902782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8980fc520 0x7fe8980fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.625+0000 7fe89e0ae640 1 -- 172.21.15.2:0/3604902782 >> 172.21.15.2:0/3604902782 conn(0x7fe8980f7ce0 msgr2=0x7fe8980fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.625+0000 7fe89e0ae640 1 -- 172.21.15.2:0/3604902782 shutdown_connections 2024-09-17T01:00:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.625+0000 7fe89e0ae640 1 -- 172.21.15.2:0/3604902782 wait complete. 2024-09-17T01:00:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.625+0000 7fe89e0ae640 1 Processor -- start 2024-09-17T01:00:06.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.626+0000 7fe89e0ae640 1 -- start start 2024-09-17T01:00:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.626+0000 7fe89e0ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8980fc520 0x7fe89810d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.626+0000 7fe89e0ae640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8980fd7f0 0x7fe89810d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.626+0000 7fe89e0ae640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89810dbf0 con 0x7fe8980fc520 2024-09-17T01:00:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.626+0000 7fe89e0ae640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89810e410 con 0x7fe8980fd7f0 2024-09-17T01:00:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.626+0000 7fe8977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8980fc520 0x7fe89810d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.626+0000 7fe8977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8980fc520 0x7fe89810d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36610/0 (socket says 172.21.15.2:36610) 2024-09-17T01:00:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.626+0000 7fe8977fe640 1 -- 172.21.15.2:0/4263176971 learned_addr learned my addr 172.21.15.2:0/4263176971 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:00:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.626+0000 7fe896ffd640 1 --2- 172.21.15.2:0/4263176971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8980fd7f0 0x7fe89810d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.626+0000 7fe8977fe640 1 -- 172.21.15.2:0/4263176971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8980fd7f0 msgr2=0x7fe89810d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.626+0000 7fe8977fe640 1 --2- 172.21.15.2:0/4263176971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8980fd7f0 0x7fe89810d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.626+0000 7fe8977fe640 1 -- 172.21.15.2:0/4263176971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe880005040 con 0x7fe8980fc520 2024-09-17T01:00:06.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.627+0000 7fe8977fe640 1 --2- 172.21.15.2:0/4263176971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8980fc520 0x7fe89810d060 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe88800cae0 tx=0x7fe888007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.627+0000 7fe88ffff640 1 -- 172.21.15.2:0/4263176971 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe88800ab00 con 0x7fe8980fc520 2024-09-17T01:00:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.627+0000 7fe89e0ae640 1 -- 172.21.15.2:0/4263176971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89810e6a0 con 0x7fe8980fc520 2024-09-17T01:00:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.627+0000 7fe88ffff640 1 -- 172.21.15.2:0/4263176971 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe88800ac60 con 0x7fe8980fc520 2024-09-17T01:00:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.627+0000 7fe88ffff640 1 -- 172.21.15.2:0/4263176971 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8880115e0 con 0x7fe8980fc520 2024-09-17T01:00:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.627+0000 7fe89e0ae640 1 -- 172.21.15.2:0/4263176971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89810ec40 con 0x7fe8980fc520 2024-09-17T01:00:06.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.628+0000 7fe89e0ae640 1 -- 172.21.15.2:0/4263176971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8980fb980 con 0x7fe8980fc520 2024-09-17T01:00:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.628+0000 7fe88ffff640 1 -- 172.21.15.2:0/4263176971 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fe8880129e0 con 0x7fe8980fc520 2024-09-17T01:00:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.629+0000 7fe88ffff640 1 --2- 172.21.15.2:0/4263176971 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fe88406ed60 0x7fe884071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.629+0000 7fe88ffff640 1 -- 172.21.15.2:0/4263176971 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe88808ea90 con 0x7fe8980fc520 2024-09-17T01:00:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.629+0000 7fe896ffd640 1 --2- 172.21.15.2:0/4263176971 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fe88406ed60 0x7fe884071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.629+0000 7fe896ffd640 1 --2- 172.21.15.2:0/4263176971 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fe88406ed60 0x7fe884071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe880007ac0 tx=0x7fe880035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:06.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.633+0000 7fe88ffff640 1 -- 172.21.15.2:0/4263176971 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe88805bb60 con 0x7fe8980fc520 2024-09-17T01:00:06.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.805+0000 7fe89e0ae640 1 -- 172.21.15.2:0/4263176971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fe89804b720 con 0x7fe8980fc520 2024-09-17T01:00:06.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.805+0000 7fe88ffff640 1 -- 172.21.15.2:0/4263176971 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fe88805b500 con 0x7fe8980fc520 2024-09-17T01:00:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.807+0000 7fe89e0ae640 1 -- 172.21.15.2:0/4263176971 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fe88406ed60 msgr2=0x7fe884071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.807+0000 7fe89e0ae640 1 --2- 172.21.15.2:0/4263176971 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fe88406ed60 0x7fe884071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe880007ac0 tx=0x7fe880035040 comp rx=0 tx=0).stop 2024-09-17T01:00:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.807+0000 7fe89e0ae640 1 -- 172.21.15.2:0/4263176971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8980fc520 msgr2=0x7fe89810d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.807+0000 7fe89e0ae640 1 --2- 172.21.15.2:0/4263176971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8980fc520 0x7fe89810d060 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe88800cae0 tx=0x7fe888007e50 comp rx=0 tx=0).stop 2024-09-17T01:00:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.807+0000 7fe89e0ae640 1 -- 172.21.15.2:0/4263176971 shutdown_connections 2024-09-17T01:00:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.807+0000 7fe89e0ae640 1 --2- 172.21.15.2:0/4263176971 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fe88406ed60 0x7fe884071210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.807+0000 7fe89e0ae640 1 --2- 172.21.15.2:0/4263176971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8980fd7f0 0x7fe89810d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.807+0000 7fe89e0ae640 1 --2- 172.21.15.2:0/4263176971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8980fc520 0x7fe89810d060 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.807+0000 7fe89e0ae640 1 -- 172.21.15.2:0/4263176971 >> 172.21.15.2:0/4263176971 conn(0x7fe8980f7ce0 msgr2=0x7fe8980f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.808+0000 7fe89e0ae640 1 -- 172.21.15.2:0/4263176971 shutdown_connections 2024-09-17T01:00:06.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:06.808+0000 7fe89e0ae640 1 -- 172.21.15.2:0/4263176971 wait complete. 2024-09-17T01:00:07.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:07.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:07.631 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-17T01:00:07.895 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:00:07.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:07 smithi002 ceph-mon[27650]: pgmap v197: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-17T01:00:08.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:07 smithi099 ceph-mon[34357]: pgmap v197: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-17T01:00:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.475+0000 7faf4bb42640 1 -- 172.21.15.2:0/2868020227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440fcad0 msgr2=0x7faf440fcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.475+0000 7faf4bb42640 1 --2- 172.21.15.2:0/2868020227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440fcad0 0x7faf440fcee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faf400048d0 tx=0x7faf40009da0 comp rx=0 tx=0).stop 2024-09-17T01:00:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.475+0000 7faf4bb42640 1 -- 172.21.15.2:0/2868020227 shutdown_connections 2024-09-17T01:00:09.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.475+0000 7faf4bb42640 1 --2- 172.21.15.2:0/2868020227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf440fd420 0x7faf44103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.475+0000 7faf4bb42640 1 --2- 172.21.15.2:0/2868020227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440fcad0 0x7faf440fcee0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.475+0000 7faf4bb42640 1 -- 172.21.15.2:0/2868020227 >> 172.21.15.2:0/2868020227 conn(0x7faf440f63a0 msgr2=0x7faf440f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.476+0000 7faf4bb42640 1 -- 172.21.15.2:0/2868020227 shutdown_connections 2024-09-17T01:00:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.476+0000 7faf4bb42640 1 -- 172.21.15.2:0/2868020227 wait complete. 2024-09-17T01:00:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.476+0000 7faf4bb42640 1 Processor -- start 2024-09-17T01:00:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.476+0000 7faf4bb42640 1 -- start start 2024-09-17T01:00:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.476+0000 7faf4bb42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440fcad0 0x7faf4410f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.476+0000 7faf4bb42640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf440fd420 0x7faf4410f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.476+0000 7faf4bb42640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf44110690 con 0x7faf440fcad0 2024-09-17T01:00:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.476+0000 7faf4bb42640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf44110800 con 0x7faf440fd420 2024-09-17T01:00:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.476+0000 7faf498de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440fcad0 0x7faf4410f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:09.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.476+0000 7faf498de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440fcad0 0x7faf4410f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36626/0 (socket says 172.21.15.2:36626) 2024-09-17T01:00:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.476+0000 7faf498de640 1 -- 172.21.15.2:0/3398845462 learned_addr learned my addr 172.21.15.2:0/3398845462 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:00:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.477+0000 7faf490dd640 1 --2- 172.21.15.2:0/3398845462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf440fd420 0x7faf4410f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.477+0000 7faf498de640 1 -- 172.21.15.2:0/3398845462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf440fd420 msgr2=0x7faf4410f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.477+0000 7faf498de640 1 --2- 172.21.15.2:0/3398845462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf440fd420 0x7faf4410f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.477+0000 7faf498de640 1 -- 172.21.15.2:0/3398845462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf40005040 con 0x7faf440fcad0 2024-09-17T01:00:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.477+0000 7faf498de640 1 --2- 172.21.15.2:0/3398845462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440fcad0 0x7faf4410f2e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faf40003080 tx=0x7faf40009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.477+0000 7faf3a7fc640 1 -- 172.21.15.2:0/3398845462 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf40038070 con 0x7faf440fcad0 2024-09-17T01:00:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.477+0000 7faf4bb42640 1 -- 172.21.15.2:0/3398845462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf44110a80 con 0x7faf440fcad0 2024-09-17T01:00:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.477+0000 7faf3a7fc640 1 -- 172.21.15.2:0/3398845462 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faf4002abd0 con 0x7faf440fcad0 2024-09-17T01:00:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.477+0000 7faf3a7fc640 1 -- 172.21.15.2:0/3398845462 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf4003e670 con 0x7faf440fcad0 2024-09-17T01:00:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.477+0000 7faf4bb42640 1 -- 172.21.15.2:0/3398845462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf44110fa0 con 0x7faf440fcad0 2024-09-17T01:00:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.478+0000 7faf4bb42640 1 -- 172.21.15.2:0/3398845462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf44107a10 con 0x7faf440fcad0 2024-09-17T01:00:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.479+0000 7faf3a7fc640 1 -- 172.21.15.2:0/3398845462 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7faf40030020 con 0x7faf440fcad0 2024-09-17T01:00:09.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.479+0000 7faf3a7fc640 1 --2- 172.21.15.2:0/3398845462 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7faf3006ed60 0x7faf30071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.479+0000 7faf3a7fc640 1 -- 172.21.15.2:0/3398845462 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7faf400ae5e0 con 0x7faf440fcad0 2024-09-17T01:00:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.479+0000 7faf490dd640 1 --2- 172.21.15.2:0/3398845462 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7faf3006ed60 0x7faf30071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.480+0000 7faf490dd640 1 --2- 172.21.15.2:0/3398845462 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7faf3006ed60 0x7faf30071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faf4410f090 tx=0x7faf34008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:09.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.483+0000 7faf3a7fc640 1 -- 172.21.15.2:0/3398845462 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7faf4007b6b0 con 0x7faf440fcad0 2024-09-17T01:00:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.651+0000 7faf4bb42640 1 -- 172.21.15.2:0/3398845462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7faf440fa040 con 0x7faf440fcad0 2024-09-17T01:00:09.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.652+0000 7faf3a7fc640 1 -- 172.21.15.2:0/3398845462 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7faf4007b050 con 0x7faf440fcad0 2024-09-17T01:00:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.654+0000 7faf4bb42640 1 -- 172.21.15.2:0/3398845462 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7faf3006ed60 msgr2=0x7faf30071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.654+0000 7faf4bb42640 1 --2- 172.21.15.2:0/3398845462 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7faf3006ed60 0x7faf30071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faf4410f090 tx=0x7faf34008040 comp rx=0 tx=0).stop 2024-09-17T01:00:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.654+0000 7faf4bb42640 1 -- 172.21.15.2:0/3398845462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440fcad0 msgr2=0x7faf4410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.654+0000 7faf4bb42640 1 --2- 172.21.15.2:0/3398845462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440fcad0 0x7faf4410f2e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faf40003080 tx=0x7faf40009da0 comp rx=0 tx=0).stop 2024-09-17T01:00:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.654+0000 7faf4bb42640 1 -- 172.21.15.2:0/3398845462 shutdown_connections 2024-09-17T01:00:09.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.654+0000 7faf4bb42640 1 --2- 172.21.15.2:0/3398845462 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7faf3006ed60 0x7faf30071210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:09.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.654+0000 7faf4bb42640 1 --2- 172.21.15.2:0/3398845462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf440fd420 0x7faf4410f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:09.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.654+0000 7faf4bb42640 1 --2- 172.21.15.2:0/3398845462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440fcad0 0x7faf4410f2e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:09.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.654+0000 7faf4bb42640 1 -- 172.21.15.2:0/3398845462 >> 172.21.15.2:0/3398845462 conn(0x7faf440f63a0 msgr2=0x7faf440f67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:09.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.654+0000 7faf4bb42640 1 -- 172.21.15.2:0/3398845462 shutdown_connections 2024-09-17T01:00:09.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:09.654+0000 7faf4bb42640 1 -- 172.21.15.2:0/3398845462 wait complete. 2024-09-17T01:00:09.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:09 smithi002 ceph-mon[27650]: pgmap v198: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-17T01:00:10.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:09 smithi099 ceph-mon[34357]: pgmap v198: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-17T01:00:10.403 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-17T01:00:10.664 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:00:11.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:11 smithi099 ceph-mon[34357]: pgmap v199: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-17T01:00:12.090 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:11 smithi002 ceph-mon[27650]: pgmap v199: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-17T01:00:12.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.294+0000 7f6dbed42640 1 -- 172.21.15.2:0/512195343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db80fc550 msgr2=0x7f6db80fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.294+0000 7f6dbed42640 1 --2- 172.21.15.2:0/512195343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db80fc550 0x7f6db80fc960 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0048d0 tx=0x7f6dac009da0 comp rx=0 tx=0).stop 2024-09-17T01:00:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.294+0000 7f6dbed42640 1 -- 172.21.15.2:0/512195343 shutdown_connections 2024-09-17T01:00:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.294+0000 7f6dbed42640 1 --2- 172.21.15.2:0/512195343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6db80fd820 0x7f6db80fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.294+0000 7f6dbed42640 1 --2- 172.21.15.2:0/512195343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db80fc550 0x7f6db80fc960 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.294+0000 7f6dbed42640 1 -- 172.21.15.2:0/512195343 >> 172.21.15.2:0/512195343 conn(0x7f6db80f7d30 msgr2=0x7f6db80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.294+0000 7f6dbed42640 1 -- 172.21.15.2:0/512195343 shutdown_connections 2024-09-17T01:00:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.294+0000 7f6dbed42640 1 -- 172.21.15.2:0/512195343 wait complete. 2024-09-17T01:00:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.295+0000 7f6dbed42640 1 Processor -- start 2024-09-17T01:00:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.295+0000 7f6dbed42640 1 -- start start 2024-09-17T01:00:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.295+0000 7f6dbed42640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6db80fc550 0x7f6db8071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:12.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.295+0000 7f6dbed42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db80fd820 0x7f6db806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:12.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.295+0000 7f6dbed42640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db8070080 con 0x7f6db80fd820 2024-09-17T01:00:12.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.295+0000 7f6dbed42640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db80701c0 con 0x7f6db80fc550 2024-09-17T01:00:12.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.296+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db80fd820 0x7f6db806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:12.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.296+0000 7f6db7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db80fd820 0x7f6db806fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43554/0 (socket says 172.21.15.2:43554) 2024-09-17T01:00:12.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.296+0000 7f6db7fff640 1 -- 172.21.15.2:0/1375846881 learned_addr learned my addr 172.21.15.2:0/1375846881 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:00:12.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.296+0000 7f6dbcade640 1 --2- 172.21.15.2:0/1375846881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6db80fc550 0x7f6db8071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:12.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.296+0000 7f6db7fff640 1 -- 172.21.15.2:0/1375846881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6db80fc550 msgr2=0x7f6db8071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:12.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.296+0000 7f6db7fff640 1 --2- 172.21.15.2:0/1375846881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6db80fc550 0x7f6db8071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:12.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.296+0000 7f6db7fff640 1 -- 172.21.15.2:0/1375846881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac005040 con 0x7f6db80fd820 2024-09-17T01:00:12.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.296+0000 7f6db7fff640 1 --2- 172.21.15.2:0/1375846881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db80fd820 0x7f6db806fa60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6da400b790 tx=0x7f6da40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:12.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.296+0000 7f6db57fa640 1 -- 172.21.15.2:0/1375846881 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6da400c700 con 0x7f6db80fd820 2024-09-17T01:00:12.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.296+0000 7f6db57fa640 1 -- 172.21.15.2:0/1375846881 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6da400cd00 con 0x7f6db80fd820 2024-09-17T01:00:12.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.296+0000 7f6dbed42640 1 -- 172.21.15.2:0/1375846881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db80704a0 con 0x7f6db80fd820 2024-09-17T01:00:12.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.296+0000 7f6db57fa640 1 -- 172.21.15.2:0/1375846881 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6da4015e80 con 0x7f6db80fd820 2024-09-17T01:00:12.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.296+0000 7f6dbed42640 1 -- 172.21.15.2:0/1375846881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db8115150 con 0x7f6db80fd820 2024-09-17T01:00:12.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.297+0000 7f6dbed42640 1 -- 172.21.15.2:0/1375846881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db80fb9b0 con 0x7f6db80fd820 2024-09-17T01:00:12.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.298+0000 7f6db57fa640 1 -- 172.21.15.2:0/1375846881 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f6da4012070 con 0x7f6db80fd820 2024-09-17T01:00:12.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.298+0000 7f6db57fa640 1 --2- 172.21.15.2:0/1375846881 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f6da806ed60 0x7f6da8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:12.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.298+0000 7f6db57fa640 1 -- 172.21.15.2:0/1375846881 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6da408daf0 con 0x7f6db80fd820 2024-09-17T01:00:12.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.299+0000 7f6dbcade640 1 --2- 172.21.15.2:0/1375846881 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f6da806ed60 0x7f6da8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:12.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.299+0000 7f6dbcade640 1 --2- 172.21.15.2:0/1375846881 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f6da806ed60 0x7f6da8071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6dac000c00 tx=0x7f6dac035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:12.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.303+0000 7f6db57fa640 1 -- 172.21.15.2:0/1375846881 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6da405ab20 con 0x7f6db80fd820 2024-09-17T01:00:12.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:12.484+0000 7f6dbed42640 1 -- 172.21.15.2:0/1375846881 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f6db8101c80 con 0x7f6da806ed60 2024-09-17T01:00:14.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:13 smithi099 ceph-mon[34357]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T01:00:14.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:13 smithi099 ceph-mon[34357]: from='client.14516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:00:14.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:13 smithi002 ceph-mon[27650]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T01:00:14.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:13 smithi002 ceph-mon[27650]: from='client.14516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:00:16.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:15 smithi099 ceph-mon[34357]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T01:00:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:15 smithi002 ceph-mon[27650]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T01:00:18.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:17 smithi099 ceph-mon[34357]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-17T01:00:18.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:17 smithi002 ceph-mon[27650]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-17T01:00:20.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:19 smithi099 ceph-mon[34357]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-17T01:00:20.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:19 smithi002 ceph-mon[27650]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-17T01:00:22.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:21 smithi099 ceph-mon[34357]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:00:22.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:22.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:21 smithi002 ceph-mon[27650]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:00:22.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:24.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:23 smithi099 ceph-mon[34357]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:00:24.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:23 smithi002 ceph-mon[27650]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:00:26.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:25 smithi099 ceph-mon[34357]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:00:26.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:25 smithi002 ceph-mon[27650]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:00:28.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:27 smithi099 ceph-mon[34357]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:00:28.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:27 smithi002 ceph-mon[27650]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:00:30.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:29 smithi099 ceph-mon[34357]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:00:30.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:29 smithi002 ceph-mon[27650]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:00:32.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:31 smithi099 ceph-mon[34357]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:00:32.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:31 smithi002 ceph-mon[27650]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:00:34.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:33 smithi099 ceph-mon[34357]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:00:34.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:33 smithi002 ceph-mon[27650]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:00:36.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:35 smithi099 ceph-mon[34357]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:00:36.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:35 smithi002 ceph-mon[27650]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:00:37.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:36 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:37.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:36 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:38.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:37 smithi099 ceph-mon[34357]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:00:38.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:37 smithi002 ceph-mon[27650]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:00:40.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:39 smithi099 ceph-mon[34357]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-17T01:00:40.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:39 smithi002 ceph-mon[27650]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-17T01:00:42.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:41 smithi099 ceph-mon[34357]: pgmap v214: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-17T01:00:42.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:41 smithi002 ceph-mon[27650]: pgmap v214: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-17T01:00:44.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:43 smithi099 ceph-mon[34357]: pgmap v215: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-17T01:00:44.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:43 smithi002 ceph-mon[27650]: pgmap v215: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-17T01:00:46.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:45 smithi002 ceph-mon[27650]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-17T01:00:46.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:45 smithi099 ceph-mon[34357]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-17T01:00:48.093 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:47 smithi099 ceph-mon[34357]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-17T01:00:48.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:47 smithi002 ceph-mon[27650]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-17T01:00:50.066 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:49 smithi099 ceph-mon[34357]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-17T01:00:50.066 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:49 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:00:50.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:49 smithi002 ceph-mon[27650]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-17T01:00:50.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:49 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:00:51.109 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:50 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:51.109 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:50 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:00:51.110 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:50 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:00:51.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:50 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:51.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:50 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:00:51.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:50 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:00:52.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:51 smithi002 ceph-mon[27650]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-17T01:00:52.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:52.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:51 smithi099 ceph-mon[34357]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-17T01:00:52.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:51 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:00:52.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:52.513+0000 7f6db57fa640 1 -- 172.21.15.2:0/1375846881 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f6db8101c80 con 0x7f6da806ed60 2024-09-17T01:00:52.512 INFO:teuthology.orchestra.run.smithi002.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:00:52.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:52.515+0000 7f6dbed42640 1 -- 172.21.15.2:0/1375846881 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f6da806ed60 msgr2=0x7f6da8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:52.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:52.515+0000 7f6dbed42640 1 --2- 172.21.15.2:0/1375846881 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f6da806ed60 0x7f6da8071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6dac000c00 tx=0x7f6dac035040 comp rx=0 tx=0).stop 2024-09-17T01:00:52.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:52.516+0000 7f6dbed42640 1 -- 172.21.15.2:0/1375846881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db80fd820 msgr2=0x7f6db806fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:52.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:52.516+0000 7f6dbed42640 1 --2- 172.21.15.2:0/1375846881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db80fd820 0x7f6db806fa60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6da400b790 tx=0x7f6da40091d0 comp rx=0 tx=0).stop 2024-09-17T01:00:52.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:52.516+0000 7f6dbed42640 1 -- 172.21.15.2:0/1375846881 shutdown_connections 2024-09-17T01:00:52.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:52.516+0000 7f6dbed42640 1 --2- 172.21.15.2:0/1375846881 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f6da806ed60 0x7f6da8071210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:52.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:52.516+0000 7f6dbed42640 1 --2- 172.21.15.2:0/1375846881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6db80fd820 0x7f6db806fa60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:52.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:52.516+0000 7f6dbed42640 1 --2- 172.21.15.2:0/1375846881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6db80fc550 0x7f6db8071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:52.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:52.516+0000 7f6dbed42640 1 -- 172.21.15.2:0/1375846881 >> 172.21.15.2:0/1375846881 conn(0x7f6db80f7d30 msgr2=0x7f6db80f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:52.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:52.516+0000 7f6dbed42640 1 -- 172.21.15.2:0/1375846881 shutdown_connections 2024-09-17T01:00:52.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:52.516+0000 7f6dbed42640 1 -- 172.21.15.2:0/1375846881 wait complete. 2024-09-17T01:00:53.357 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-17T01:00:53.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:53 smithi002 ceph-mon[27650]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-17T01:00:53.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:53 smithi002 ceph-mon[27650]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:00:53.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:53 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:00:53.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:53 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:00:53.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:53 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:53.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:53 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:00:53.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:53 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:00:53.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:53 smithi002 ceph-mon[27650]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:00:53.756 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:00:53.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:53 smithi099 ceph-mon[34357]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-17T01:00:53.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:53 smithi099 ceph-mon[34357]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:00:53.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:53 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:00:53.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:53 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:00:53.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:53 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:00:53.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:53 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:00:53.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:53 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:00:53.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:53 smithi099 ceph-mon[34357]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:00:55.777 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:55 smithi002 ceph-mon[27650]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-17T01:00:55.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:55 smithi099 ceph-mon[34357]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-17T01:00:55.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.898+0000 7efe0c1c3640 1 -- 172.21.15.2:0/614732023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe04101ae0 msgr2=0x7efe04103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:55.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.898+0000 7efe0c1c3640 1 --2- 172.21.15.2:0/614732023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe04101ae0 0x7efe04103ec0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efdf40048d0 tx=0x7efdf4009da0 comp rx=0 tx=0).stop 2024-09-17T01:00:55.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.899+0000 7efe0c1c3640 1 -- 172.21.15.2:0/614732023 shutdown_connections 2024-09-17T01:00:55.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.899+0000 7efe0c1c3640 1 --2- 172.21.15.2:0/614732023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe04101ae0 0x7efe04103ec0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:55.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.899+0000 7efe0c1c3640 1 --2- 172.21.15.2:0/614732023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe04065be0 0x7efe041015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:55.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.899+0000 7efe0c1c3640 1 -- 172.21.15.2:0/614732023 >> 172.21.15.2:0/614732023 conn(0x7efe040f6c10 msgr2=0x7efe040f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:55.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.899+0000 7efe0c1c3640 1 -- 172.21.15.2:0/614732023 shutdown_connections 2024-09-17T01:00:55.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.899+0000 7efe0c1c3640 1 -- 172.21.15.2:0/614732023 wait complete. 2024-09-17T01:00:55.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.900+0000 7efe0c1c3640 1 Processor -- start 2024-09-17T01:00:55.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.900+0000 7efe0c1c3640 1 -- start start 2024-09-17T01:00:55.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.900+0000 7efe0c1c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe04065be0 0x7efe0410f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.901+0000 7efe0c1c3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe04101ae0 0x7efe0410f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.901+0000 7efe0c1c3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0410fdd0 con 0x7efe04065be0 2024-09-17T01:00:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.901+0000 7efe0c1c3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe041105f0 con 0x7efe04101ae0 2024-09-17T01:00:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.901+0000 7efe09f5f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe04065be0 0x7efe0410f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.901+0000 7efe09f5f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe04065be0 0x7efe0410f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34288/0 (socket says 172.21.15.2:34288) 2024-09-17T01:00:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.901+0000 7efe09f5f640 1 -- 172.21.15.2:0/2176007220 learned_addr learned my addr 172.21.15.2:0/2176007220 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:00:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.901+0000 7efe0975e640 1 --2- 172.21.15.2:0/2176007220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe04101ae0 0x7efe0410f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.901+0000 7efe0975e640 1 -- 172.21.15.2:0/2176007220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe04065be0 msgr2=0x7efe0410f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.901+0000 7efe0975e640 1 --2- 172.21.15.2:0/2176007220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe04065be0 0x7efe0410f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.901+0000 7efe0975e640 1 -- 172.21.15.2:0/2176007220 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe00005040 con 0x7efe04101ae0 2024-09-17T01:00:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.901+0000 7efe09f5f640 1 --2- 172.21.15.2:0/2176007220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe04065be0 0x7efe0410f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:00:55.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.902+0000 7efe0975e640 1 --2- 172.21.15.2:0/2176007220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe04101ae0 0x7efe0410f780 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efdf402a5e0 tx=0x7efdf4009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:55.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.902+0000 7efdfa7fc640 1 -- 172.21.15.2:0/2176007220 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdf4038070 con 0x7efe04101ae0 2024-09-17T01:00:55.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.902+0000 7efdfa7fc640 1 -- 172.21.15.2:0/2176007220 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efdf4032d30 con 0x7efe04101ae0 2024-09-17T01:00:55.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.902+0000 7efdfa7fc640 1 -- 172.21.15.2:0/2176007220 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdf403eb00 con 0x7efe04101ae0 2024-09-17T01:00:55.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.902+0000 7efe0c1c3640 1 -- 172.21.15.2:0/2176007220 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf4005040 con 0x7efe04101ae0 2024-09-17T01:00:55.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.902+0000 7efe0c1c3640 1 -- 172.21.15.2:0/2176007220 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe04110b40 con 0x7efe04101ae0 2024-09-17T01:00:55.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.903+0000 7efe0c1c3640 1 -- 172.21.15.2:0/2176007220 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe040fa890 con 0x7efe04101ae0 2024-09-17T01:00:55.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.904+0000 7efdfa7fc640 1 -- 172.21.15.2:0/2176007220 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7efdf4030020 con 0x7efe04101ae0 2024-09-17T01:00:55.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.905+0000 7efdfa7fc640 1 --2- 172.21.15.2:0/2176007220 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7efdf006ed60 0x7efdf0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:55.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.905+0000 7efe09f5f640 1 --2- 172.21.15.2:0/2176007220 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7efdf006ed60 0x7efdf0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:55.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.905+0000 7efdfa7fc640 1 -- 172.21.15.2:0/2176007220 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7efdf40ae670 con 0x7efe04101ae0 2024-09-17T01:00:55.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.906+0000 7efe09f5f640 1 --2- 172.21.15.2:0/2176007220 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7efdf006ed60 0x7efdf0071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efe000041d0 tx=0x7efe0000b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:55.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:55.913+0000 7efdfa7fc640 1 -- 172.21.15.2:0/2176007220 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efdf407b760 con 0x7efe04101ae0 2024-09-17T01:00:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.272+0000 7efe0c1c3640 1 -- 172.21.15.2:0/2176007220 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe04110f20 con 0x7efdf006ed60 2024-09-17T01:00:56.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.274+0000 7efdfa7fc640 1 -- 172.21.15.2:0/2176007220 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7efe04110f20 con 0x7efdf006ed60 2024-09-17T01:00:56.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.276+0000 7efe0c1c3640 1 -- 172.21.15.2:0/2176007220 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7efdf006ed60 msgr2=0x7efdf0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:56.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.276+0000 7efe0c1c3640 1 --2- 172.21.15.2:0/2176007220 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7efdf006ed60 0x7efdf0071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efe000041d0 tx=0x7efe0000b040 comp rx=0 tx=0).stop 2024-09-17T01:00:56.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.276+0000 7efe0c1c3640 1 -- 172.21.15.2:0/2176007220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe04101ae0 msgr2=0x7efe0410f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:56.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.276+0000 7efe0c1c3640 1 --2- 172.21.15.2:0/2176007220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe04101ae0 0x7efe0410f780 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efdf402a5e0 tx=0x7efdf4009da0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.277+0000 7efe0c1c3640 1 -- 172.21.15.2:0/2176007220 shutdown_connections 2024-09-17T01:00:56.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.277+0000 7efe0c1c3640 1 --2- 172.21.15.2:0/2176007220 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7efdf006ed60 0x7efdf0071210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.277+0000 7efe0c1c3640 1 --2- 172.21.15.2:0/2176007220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe04101ae0 0x7efe0410f780 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.277+0000 7efe0c1c3640 1 --2- 172.21.15.2:0/2176007220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe04065be0 0x7efe0410f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.277+0000 7efe0c1c3640 1 -- 172.21.15.2:0/2176007220 >> 172.21.15.2:0/2176007220 conn(0x7efe040f6c10 msgr2=0x7efe040f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:56.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.277+0000 7efe0c1c3640 1 -- 172.21.15.2:0/2176007220 shutdown_connections 2024-09-17T01:00:56.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.277+0000 7efe0c1c3640 1 -- 172.21.15.2:0/2176007220 wait complete. 2024-09-17T01:00:56.286 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:00:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.406+0000 7ff1927ba640 1 -- 172.21.15.2:0/34887470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c065c40 msgr2=0x7ff18c0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.406+0000 7ff1927ba640 1 --2- 172.21.15.2:0/34887470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c065c40 0x7ff18c0ff140 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0048d0 tx=0x7ff17c009da0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.407+0000 7ff1927ba640 1 -- 172.21.15.2:0/34887470 shutdown_connections 2024-09-17T01:00:56.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.407+0000 7ff1927ba640 1 --2- 172.21.15.2:0/34887470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff18c0ff680 0x7ff18c101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.407+0000 7ff1927ba640 1 --2- 172.21.15.2:0/34887470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c065c40 0x7ff18c0ff140 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.407+0000 7ff1927ba640 1 -- 172.21.15.2:0/34887470 >> 172.21.15.2:0/34887470 conn(0x7ff18c0f6c10 msgr2=0x7ff18c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.407+0000 7ff1927ba640 1 -- 172.21.15.2:0/34887470 shutdown_connections 2024-09-17T01:00:56.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.407+0000 7ff1927ba640 1 -- 172.21.15.2:0/34887470 wait complete. 2024-09-17T01:00:56.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.407+0000 7ff1927ba640 1 Processor -- start 2024-09-17T01:00:56.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.408+0000 7ff1927ba640 1 -- start start 2024-09-17T01:00:56.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.408+0000 7ff1927ba640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff18c065c40 0x7ff18c10d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:56.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.408+0000 7ff1927ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0ff680 0x7ff18c10d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:56.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.408+0000 7ff1927ba640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c10dca0 con 0x7ff18c0ff680 2024-09-17T01:00:56.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.408+0000 7ff1927ba640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c10e470 con 0x7ff18c065c40 2024-09-17T01:00:56.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.408+0000 7ff18b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0ff680 0x7ff18c10d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:56.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.408+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff18c065c40 0x7ff18c10d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:56.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.408+0000 7ff18bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff18c065c40 0x7ff18c10d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.2:43282/0 (socket says 172.21.15.2:43282) 2024-09-17T01:00:56.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.408+0000 7ff18bfff640 1 -- 172.21.15.2:0/401687618 learned_addr learned my addr 172.21.15.2:0/401687618 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:00:56.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.409+0000 7ff18b7fe640 1 -- 172.21.15.2:0/401687618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff18c065c40 msgr2=0x7ff18c10d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:56.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.409+0000 7ff18b7fe640 1 --2- 172.21.15.2:0/401687618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff18c065c40 0x7ff18c10d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.409+0000 7ff18b7fe640 1 -- 172.21.15.2:0/401687618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c005040 con 0x7ff18c0ff680 2024-09-17T01:00:56.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.409+0000 7ff18bfff640 1 --2- 172.21.15.2:0/401687618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff18c065c40 0x7ff18c10d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:00:56.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.409+0000 7ff18b7fe640 1 --2- 172.21.15.2:0/401687618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0ff680 0x7ff18c10d650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff18000eb40 tx=0x7ff18000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:56.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.409+0000 7ff188ff9640 1 -- 172.21.15.2:0/401687618 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff180007c30 con 0x7ff18c0ff680 2024-09-17T01:00:56.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.409+0000 7ff188ff9640 1 -- 172.21.15.2:0/401687618 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff18000f040 con 0x7ff18c0ff680 2024-09-17T01:00:56.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.410+0000 7ff1927ba640 1 -- 172.21.15.2:0/401687618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c10e6a0 con 0x7ff18c0ff680 2024-09-17T01:00:56.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.410+0000 7ff1927ba640 1 -- 172.21.15.2:0/401687618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c10ec40 con 0x7ff18c0ff680 2024-09-17T01:00:56.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.410+0000 7ff188ff9640 1 -- 172.21.15.2:0/401687618 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1800094b0 con 0x7ff18c0ff680 2024-09-17T01:00:56.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.412+0000 7ff1927ba640 1 -- 172.21.15.2:0/401687618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c0fa890 con 0x7ff18c0ff680 2024-09-17T01:00:56.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.412+0000 7ff188ff9640 1 -- 172.21.15.2:0/401687618 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7ff18000cc40 con 0x7ff18c0ff680 2024-09-17T01:00:56.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.413+0000 7ff188ff9640 1 --2- 172.21.15.2:0/401687618 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff17406ed60 0x7ff174071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:56.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.413+0000 7ff18bfff640 1 --2- 172.21.15.2:0/401687618 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff17406ed60 0x7ff174071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:56.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.413+0000 7ff188ff9640 1 -- 172.21.15.2:0/401687618 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff18008de30 con 0x7ff18c0ff680 2024-09-17T01:00:56.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.414+0000 7ff18bfff640 1 --2- 172.21.15.2:0/401687618 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff17406ed60 0x7ff174071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff17c000c00 tx=0x7ff17c035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:56.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.421+0000 7ff188ff9640 1 -- 172.21.15.2:0/401687618 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff18005ab50 con 0x7ff18c0ff680 2024-09-17T01:00:56.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.710+0000 7ff1927ba640 1 -- 172.21.15.2:0/401687618 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff18c10efc0 con 0x7ff17406ed60 2024-09-17T01:00:56.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.711+0000 7ff188ff9640 1 -- 172.21.15.2:0/401687618 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7ff18c10efc0 con 0x7ff17406ed60 2024-09-17T01:00:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.714+0000 7ff1927ba640 1 -- 172.21.15.2:0/401687618 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff17406ed60 msgr2=0x7ff174071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.714+0000 7ff1927ba640 1 --2- 172.21.15.2:0/401687618 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff17406ed60 0x7ff174071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff17c000c00 tx=0x7ff17c035040 comp rx=0 tx=0).stop 2024-09-17T01:00:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.714+0000 7ff1927ba640 1 -- 172.21.15.2:0/401687618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0ff680 msgr2=0x7ff18c10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.714+0000 7ff1927ba640 1 --2- 172.21.15.2:0/401687618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0ff680 0x7ff18c10d650 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff18000eb40 tx=0x7ff18000b040 comp rx=0 tx=0).stop 2024-09-17T01:00:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.714+0000 7ff1927ba640 1 -- 172.21.15.2:0/401687618 shutdown_connections 2024-09-17T01:00:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.714+0000 7ff1927ba640 1 --2- 172.21.15.2:0/401687618 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7ff17406ed60 0x7ff174071210 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.714+0000 7ff1927ba640 1 --2- 172.21.15.2:0/401687618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0ff680 0x7ff18c10d650 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.714+0000 7ff1927ba640 1 --2- 172.21.15.2:0/401687618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff18c065c40 0x7ff18c10d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.714+0000 7ff1927ba640 1 -- 172.21.15.2:0/401687618 >> 172.21.15.2:0/401687618 conn(0x7ff18c0f6c10 msgr2=0x7ff18c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.714+0000 7ff1927ba640 1 -- 172.21.15.2:0/401687618 shutdown_connections 2024-09-17T01:00:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.714+0000 7ff1927ba640 1 -- 172.21.15.2:0/401687618 wait complete. 2024-09-17T01:00:56.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.800+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1226266155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101ac0 msgr2=0x7f8abc103ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:56.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.800+0000 7f8ac3a4e640 1 --2- 172.21.15.2:0/1226266155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101ac0 0x7f8abc103ea0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0048d0 tx=0x7f8aac009da0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.800+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1226266155 shutdown_connections 2024-09-17T01:00:56.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.800+0000 7f8ac3a4e640 1 --2- 172.21.15.2:0/1226266155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101ac0 0x7f8abc103ea0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.800+0000 7f8ac3a4e640 1 --2- 172.21.15.2:0/1226266155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8abc065c00 0x7f8abc101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.800+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1226266155 >> 172.21.15.2:0/1226266155 conn(0x7f8abc0f6c10 msgr2=0x7f8abc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.800+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1226266155 shutdown_connections 2024-09-17T01:00:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.800+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1226266155 wait complete. 2024-09-17T01:00:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.801+0000 7f8ac3a4e640 1 Processor -- start 2024-09-17T01:00:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.801+0000 7f8ac3a4e640 1 -- start start 2024-09-17T01:00:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.801+0000 7f8ac3a4e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8abc065c00 0x7f8abc10f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.801+0000 7f8ac3a4e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101ac0 0x7f8abc10f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.801+0000 7f8ac3a4e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc10fde0 con 0x7f8abc101ac0 2024-09-17T01:00:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.801+0000 7f8ac3a4e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc110590 con 0x7f8abc065c00 2024-09-17T01:00:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.801+0000 7f8ac0fe9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101ac0 0x7f8abc10f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.801+0000 7f8ac0fe9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101ac0 0x7f8abc10f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34316/0 (socket says 172.21.15.2:34316) 2024-09-17T01:00:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.801+0000 7f8ac0fe9640 1 -- 172.21.15.2:0/1266127020 learned_addr learned my addr 172.21.15.2:0/1266127020 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:00:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.801+0000 7f8ac17ea640 1 --2- 172.21.15.2:0/1266127020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8abc065c00 0x7f8abc10f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:56.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.802+0000 7f8ac0fe9640 1 -- 172.21.15.2:0/1266127020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8abc065c00 msgr2=0x7f8abc10f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.802+0000 7f8ac0fe9640 1 --2- 172.21.15.2:0/1266127020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8abc065c00 0x7f8abc10f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.802+0000 7f8ac0fe9640 1 -- 172.21.15.2:0/1266127020 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac005040 con 0x7f8abc101ac0 2024-09-17T01:00:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.802+0000 7f8ac0fe9640 1 --2- 172.21.15.2:0/1266127020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101ac0 0x7f8abc10f790 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0094d0 tx=0x7f8aac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.802+0000 7f8ab1ffb640 1 -- 172.21.15.2:0/1266127020 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8aac038070 con 0x7f8abc101ac0 2024-09-17T01:00:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.802+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1266127020 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc1107c0 con 0x7f8abc101ac0 2024-09-17T01:00:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.802+0000 7f8ab1ffb640 1 -- 172.21.15.2:0/1266127020 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8aac02ae80 con 0x7f8abc101ac0 2024-09-17T01:00:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.802+0000 7f8ab1ffb640 1 -- 172.21.15.2:0/1266127020 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8aac03e670 con 0x7f8abc101ac0 2024-09-17T01:00:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.803+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1266127020 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc110d60 con 0x7f8abc101ac0 2024-09-17T01:00:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.804+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1266127020 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc0fa890 con 0x7f8abc101ac0 2024-09-17T01:00:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.805+0000 7f8ab1ffb640 1 -- 172.21.15.2:0/1266127020 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f8aac030020 con 0x7f8abc101ac0 2024-09-17T01:00:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.805+0000 7f8ab1ffb640 1 --2- 172.21.15.2:0/1266127020 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8aa806ed60 0x7f8aa8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.805+0000 7f8ab1ffb640 1 -- 172.21.15.2:0/1266127020 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8aac0ae2e0 con 0x7f8abc101ac0 2024-09-17T01:00:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.805+0000 7f8ac17ea640 1 --2- 172.21.15.2:0/1266127020 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8aa806ed60 0x7f8aa8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:56.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.806+0000 7f8ac17ea640 1 --2- 172.21.15.2:0/1266127020 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8aa806ed60 0x7f8aa8071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009af0 tx=0x7f8ab800b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:56.814+0000 7f8ab1ffb640 1 -- 172.21.15.2:0/1266127020 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8aac07b460 con 0x7f8abc101ac0 2024-09-17T01:00:57.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.162+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1266127020 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8abc111030 con 0x7f8aa806ed60 2024-09-17T01:00:57.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.178+0000 7f8ab1ffb640 1 -- 172.21.15.2:0/1266127020 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8abc111030 con 0x7f8aa806ed60 2024-09-17T01:00:57.175 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:00:57.176 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (5m) 67s ago 6m 26.6M - 0.25.0 c8568f914cd2 225a4094fd9c 2024-09-17T01:00:57.176 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (7m) 67s ago 7m 6903k - 17.2.7-1635-g4a704134 f22ead590bad 53b003b1ad6f 2024-09-17T01:00:57.176 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (6m) 72s ago 6m 6891k - 17.2.7-1635-g4a704134 f22ead590bad 6ec40439e9b5 2024-09-17T01:00:57.176 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (5m) 67s ago 6m 83.7M - 9.4.7 954c08fa6188 68fde0ccaa6c 2024-09-17T01:00:57.176 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (85s) 67s ago 85s 15.1M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:00:57.176 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (92s) 67s ago 91s 11.9M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:00:57.176 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (83s) 72s ago 82s 15.2M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:00:57.176 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (89s) 72s ago 89s 17.3M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:00:57.176 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:9283,8765,8443 running (8m) 67s ago 8m 449M - 17.2.7-1635-g4a704134 f22ead590bad 6f10e41396cd 2024-09-17T01:00:57.176 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283 running (6m) 72s ago 6m 400M - 17.2.7-1635-g4a704134 f22ead590bad d88571dad10b 2024-09-17T01:00:57.177 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (8m) 67s ago 8m 43.0M 2048M 17.2.7-1635-g4a704134 f22ead590bad 08b932b41bfa 2024-09-17T01:00:57.177 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (5m) 72s ago 5m 33.4M 2048M 17.2.7-1635-g4a704134 f22ead590bad 1c9583d52c94 2024-09-17T01:00:57.177 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (6m) 67s ago 6m 16.4M - 1.5.0 0da6a335fe13 175a7378d3e6 2024-09-17T01:00:57.177 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (6m) 72s ago 6m 17.1M - 1.5.0 0da6a335fe13 7c4fe7150f28 2024-09-17T01:00:57.177 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (5m) 67s ago 5m 47.4M 4289M 17.2.7-1635-g4a704134 f22ead590bad 720f74f40752 2024-09-17T01:00:57.177 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (4m) 67s ago 4m 46.5M 4289M 17.2.7-1635-g4a704134 f22ead590bad 629defddb38c 2024-09-17T01:00:57.177 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (4m) 67s ago 4m 46.4M 4289M 17.2.7-1635-g4a704134 f22ead590bad 5dff1cf9fc56 2024-09-17T01:00:57.177 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (3m) 72s ago 3m 43.7M 5312M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:00:57.177 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (3m) 72s ago 3m 44.8M 5312M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:00:57.177 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (3m) 72s ago 3m 44.9M 5312M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:00:57.177 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (5m) 67s ago 6m 53.8M - 2.43.0 a07b618ecd1d 4c4de4cca2fc 2024-09-17T01:00:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.181+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1266127020 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8aa806ed60 msgr2=0x7f8aa8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.181+0000 7f8ac3a4e640 1 --2- 172.21.15.2:0/1266127020 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8aa806ed60 0x7f8aa8071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009af0 tx=0x7f8ab800b040 comp rx=0 tx=0).stop 2024-09-17T01:00:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.181+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1266127020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101ac0 msgr2=0x7f8abc10f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.181+0000 7f8ac3a4e640 1 --2- 172.21.15.2:0/1266127020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101ac0 0x7f8abc10f790 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0094d0 tx=0x7f8aac009da0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.181+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1266127020 shutdown_connections 2024-09-17T01:00:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.181+0000 7f8ac3a4e640 1 --2- 172.21.15.2:0/1266127020 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f8aa806ed60 0x7f8aa8071210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.181+0000 7f8ac3a4e640 1 --2- 172.21.15.2:0/1266127020 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8abc101ac0 0x7f8abc10f790 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.181+0000 7f8ac3a4e640 1 --2- 172.21.15.2:0/1266127020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8abc065c00 0x7f8abc10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.181+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1266127020 >> 172.21.15.2:0/1266127020 conn(0x7f8abc0f6c10 msgr2=0x7f8abc0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.181+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1266127020 shutdown_connections 2024-09-17T01:00:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.181+0000 7f8ac3a4e640 1 -- 172.21.15.2:0/1266127020 wait complete. 2024-09-17T01:00:57.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.303+0000 7f9d0808a640 1 -- 172.21.15.2:0/1511951126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d000fc540 msgr2=0x7f9d000fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:57.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.303+0000 7f9d0808a640 1 --2- 172.21.15.2:0/1511951126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d000fc540 0x7f9d000fc950 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0048d0 tx=0x7f9cfc009da0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.303+0000 7f9d0808a640 1 -- 172.21.15.2:0/1511951126 shutdown_connections 2024-09-17T01:00:57.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.303+0000 7f9d0808a640 1 --2- 172.21.15.2:0/1511951126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d000fd810 0x7f9d000fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.303+0000 7f9d0808a640 1 --2- 172.21.15.2:0/1511951126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d000fc540 0x7f9d000fc950 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.303+0000 7f9d0808a640 1 -- 172.21.15.2:0/1511951126 >> 172.21.15.2:0/1511951126 conn(0x7f9d000f7ce0 msgr2=0x7f9d000fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:57.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.303+0000 7f9d0808a640 1 -- 172.21.15.2:0/1511951126 shutdown_connections 2024-09-17T01:00:57.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.303+0000 7f9d0808a640 1 -- 172.21.15.2:0/1511951126 wait complete. 2024-09-17T01:00:57.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.304+0000 7f9d0808a640 1 Processor -- start 2024-09-17T01:00:57.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.304+0000 7f9d0808a640 1 -- start start 2024-09-17T01:00:57.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.304+0000 7f9d0808a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d000fc540 0x7f9d0010f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.304+0000 7f9d0808a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d000fd810 0x7f9d0010f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.304+0000 7f9d0808a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0010fe50 con 0x7f9d000fd810 2024-09-17T01:00:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.304+0000 7f9d0808a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d00110670 con 0x7f9d000fc540 2024-09-17T01:00:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.304+0000 7f9d05625640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d000fd810 0x7f9d0010f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.304+0000 7f9d05625640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d000fd810 0x7f9d0010f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34330/0 (socket says 172.21.15.2:34330) 2024-09-17T01:00:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.304+0000 7f9d05625640 1 -- 172.21.15.2:0/3087130827 learned_addr learned my addr 172.21.15.2:0/3087130827 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:00:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.304+0000 7f9d05e26640 1 --2- 172.21.15.2:0/3087130827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d000fc540 0x7f9d0010f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.305+0000 7f9d05625640 1 -- 172.21.15.2:0/3087130827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d000fc540 msgr2=0x7f9d0010f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.305+0000 7f9d05625640 1 --2- 172.21.15.2:0/3087130827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d000fc540 0x7f9d0010f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.305+0000 7f9d05625640 1 -- 172.21.15.2:0/3087130827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc005040 con 0x7f9d000fd810 2024-09-17T01:00:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.305+0000 7f9d05625640 1 --2- 172.21.15.2:0/3087130827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d000fd810 0x7f9d0010f800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000eb70 tx=0x7f9cf000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.305+0000 7f9cf67fc640 1 -- 172.21.15.2:0/3087130827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cf0007c30 con 0x7f9d000fd810 2024-09-17T01:00:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.305+0000 7f9cf67fc640 1 -- 172.21.15.2:0/3087130827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9cf000f040 con 0x7f9d000fd810 2024-09-17T01:00:57.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.305+0000 7f9d0808a640 1 -- 172.21.15.2:0/3087130827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d001108a0 con 0x7f9d000fd810 2024-09-17T01:00:57.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.306+0000 7f9cf67fc640 1 -- 172.21.15.2:0/3087130827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cf00094e0 con 0x7f9d000fd810 2024-09-17T01:00:57.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.306+0000 7f9d0808a640 1 -- 172.21.15.2:0/3087130827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d00110e40 con 0x7f9d000fd810 2024-09-17T01:00:57.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.307+0000 7f9d0808a640 1 -- 172.21.15.2:0/3087130827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d000fb9a0 con 0x7f9d000fd810 2024-09-17T01:00:57.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.309+0000 7f9cf67fc640 1 -- 172.21.15.2:0/3087130827 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f9cf0009640 con 0x7f9d000fd810 2024-09-17T01:00:57.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.310+0000 7f9cf67fc640 1 --2- 172.21.15.2:0/3087130827 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9cec06ebe0 0x7f9cec071090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:57.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.310+0000 7f9d05e26640 1 --2- 172.21.15.2:0/3087130827 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9cec06ebe0 0x7f9cec071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:57.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.310+0000 7f9d05e26640 1 --2- 172.21.15.2:0/3087130827 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9cec06ebe0 0x7f9cec071090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009ac0 tx=0x7f9cfc035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:57.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.311+0000 7f9cf67fc640 1 -- 172.21.15.2:0/3087130827 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9cf008da90 con 0x7f9d000fd810 2024-09-17T01:00:57.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.313+0000 7f9cf67fc640 1 -- 172.21.15.2:0/3087130827 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9cf005ac70 con 0x7f9d000fd810 2024-09-17T01:00:57.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.547+0000 7f9d0808a640 1 -- 172.21.15.2:0/3087130827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9d0004b720 con 0x7f9d000fd810 2024-09-17T01:00:57.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.548+0000 7f9cf67fc640 1 -- 172.21.15.2:0/3087130827 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f9cf005a610 con 0x7f9d000fd810 2024-09-17T01:00:57.545 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:00:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:00:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T01:00:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:00:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:00:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T01:00:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:00:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:00:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T01:00:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:00:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:00:57.546 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:00:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:00:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:00:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 14 2024-09-17T01:00:57.547 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:00:57.547 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:00:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.551+0000 7f9d0808a640 1 -- 172.21.15.2:0/3087130827 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9cec06ebe0 msgr2=0x7f9cec071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.551+0000 7f9d0808a640 1 --2- 172.21.15.2:0/3087130827 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9cec06ebe0 0x7f9cec071090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009ac0 tx=0x7f9cfc035040 comp rx=0 tx=0).stop 2024-09-17T01:00:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.551+0000 7f9d0808a640 1 -- 172.21.15.2:0/3087130827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d000fd810 msgr2=0x7f9d0010f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.551+0000 7f9d0808a640 1 --2- 172.21.15.2:0/3087130827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d000fd810 0x7f9d0010f800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000eb70 tx=0x7f9cf000b040 comp rx=0 tx=0).stop 2024-09-17T01:00:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.551+0000 7f9d0808a640 1 -- 172.21.15.2:0/3087130827 shutdown_connections 2024-09-17T01:00:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.551+0000 7f9d0808a640 1 --2- 172.21.15.2:0/3087130827 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f9cec06ebe0 0x7f9cec071090 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.551+0000 7f9d0808a640 1 --2- 172.21.15.2:0/3087130827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d000fd810 0x7f9d0010f800 secure :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000eb70 tx=0x7f9cf000b040 comp rx=0 tx=0).stop 2024-09-17T01:00:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.551+0000 7f9d0808a640 1 --2- 172.21.15.2:0/3087130827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d000fc540 0x7f9d0010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.551+0000 7f9d0808a640 1 -- 172.21.15.2:0/3087130827 >> 172.21.15.2:0/3087130827 conn(0x7f9d000f7ce0 msgr2=0x7f9d000f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:57.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.552+0000 7f9d0808a640 1 -- 172.21.15.2:0/3087130827 shutdown_connections 2024-09-17T01:00:57.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.552+0000 7f9d0808a640 1 -- 172.21.15.2:0/3087130827 wait complete. 2024-09-17T01:00:57.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.636+0000 7f4f414b9640 1 -- 172.21.15.2:0/4268286671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f3c0ff680 msgr2=0x7f4f3c101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:57.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.636+0000 7f4f414b9640 1 --2- 172.21.15.2:0/4268286671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f3c0ff680 0x7f4f3c101a60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4f300048d0 tx=0x7f4f30009da0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.637+0000 7f4f414b9640 1 -- 172.21.15.2:0/4268286671 shutdown_connections 2024-09-17T01:00:57.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.637+0000 7f4f414b9640 1 --2- 172.21.15.2:0/4268286671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f3c0ff680 0x7f4f3c101a60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.637+0000 7f4f414b9640 1 --2- 172.21.15.2:0/4268286671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f3c065c40 0x7f4f3c0ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.637+0000 7f4f414b9640 1 -- 172.21.15.2:0/4268286671 >> 172.21.15.2:0/4268286671 conn(0x7f4f3c0f6c10 msgr2=0x7f4f3c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:57.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.637+0000 7f4f414b9640 1 -- 172.21.15.2:0/4268286671 shutdown_connections 2024-09-17T01:00:57.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.637+0000 7f4f414b9640 1 -- 172.21.15.2:0/4268286671 wait complete. 2024-09-17T01:00:57.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.638+0000 7f4f414b9640 1 Processor -- start 2024-09-17T01:00:57.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.638+0000 7f4f414b9640 1 -- start start 2024-09-17T01:00:57.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.638+0000 7f4f414b9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f3c065c40 0x7f4f3c0fcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:57.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.638+0000 7f4f414b9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f3c0ff680 0x7f4f3c0fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:57.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.638+0000 7f4f414b9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c110cb0 con 0x7f4f3c065c40 2024-09-17T01:00:57.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.638+0000 7f4f414b9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c110e20 con 0x7f4f3c0ff680 2024-09-17T01:00:57.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.639+0000 7f4f3affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f3c065c40 0x7f4f3c0fcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:57.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.639+0000 7f4f3a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f3c0ff680 0x7f4f3c0fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:57.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.639+0000 7f4f3a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f3c0ff680 0x7f4f3c0fb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.2:43366/0 (socket says 172.21.15.2:43366) 2024-09-17T01:00:57.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.639+0000 7f4f3a7fc640 1 -- 172.21.15.2:0/465742412 learned_addr learned my addr 172.21.15.2:0/465742412 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:00:57.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.640+0000 7f4f3affd640 1 -- 172.21.15.2:0/465742412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f3c0ff680 msgr2=0x7f4f3c0fb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:57.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.640+0000 7f4f3affd640 1 --2- 172.21.15.2:0/465742412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f3c0ff680 0x7f4f3c0fb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.640+0000 7f4f3affd640 1 -- 172.21.15.2:0/465742412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f30005040 con 0x7f4f3c065c40 2024-09-17T01:00:57.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.640+0000 7f4f3affd640 1 --2- 172.21.15.2:0/465742412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f3c065c40 0x7f4f3c0fcae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0659a0 tx=0x7f4f2c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:57.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.643+0000 7f4f237fe640 1 -- 172.21.15.2:0/465742412 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f2c007c30 con 0x7f4f3c065c40 2024-09-17T01:00:57.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.643+0000 7f4f414b9640 1 -- 172.21.15.2:0/465742412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3c0fb5e0 con 0x7f4f3c065c40 2024-09-17T01:00:57.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.643+0000 7f4f414b9640 1 -- 172.21.15.2:0/465742412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c0fbb30 con 0x7f4f3c065c40 2024-09-17T01:00:57.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.643+0000 7f4f237fe640 1 -- 172.21.15.2:0/465742412 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4f2c00f040 con 0x7f4f3c065c40 2024-09-17T01:00:57.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.643+0000 7f4f237fe640 1 -- 172.21.15.2:0/465742412 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f2c00caf0 con 0x7f4f3c065c40 2024-09-17T01:00:57.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.644+0000 7f4f414b9640 1 -- 172.21.15.2:0/465742412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f28005240 con 0x7f4f3c065c40 2024-09-17T01:00:57.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.645+0000 7f4f237fe640 1 -- 172.21.15.2:0/465742412 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f4f2c009640 con 0x7f4f3c065c40 2024-09-17T01:00:57.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.646+0000 7f4f237fe640 1 --2- 172.21.15.2:0/465742412 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f4f2406ed60 0x7f4f24071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:00:57.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.646+0000 7f4f237fe640 1 -- 172.21.15.2:0/465742412 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4f2c08e390 con 0x7f4f3c065c40 2024-09-17T01:00:57.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.647+0000 7f4f3a7fc640 1 --2- 172.21.15.2:0/465742412 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f4f2406ed60 0x7f4f24071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:00:57.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.648+0000 7f4f3a7fc640 1 --2- 172.21.15.2:0/465742412 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f4f2406ed60 0x7f4f24071210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f30007ac0 tx=0x7f4f30035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:00:57.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.650+0000 7f4f237fe640 1 -- 172.21.15.2:0/465742412 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4f2c05b460 con 0x7f4f3c065c40 2024-09-17T01:00:57.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:57 smithi002 ceph-mon[27650]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:00:57.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:57 smithi002 ceph-mon[27650]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:00:57.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:57 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:00:57.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:57 smithi002 ceph-mon[27650]: Upgrade: Target is version 19.1.1-330-gc2ddf972 (unknown) 2024-09-17T01:00:57.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:57 smithi002 ceph-mon[27650]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, digests ['quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3'] 2024-09-17T01:00:57.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:57 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:00:57.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:57 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:00:57.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:57 smithi002 ceph-mon[27650]: Upgrade: Need to upgrade myself (mgr.smithi002.vjeexr) 2024-09-17T01:00:57.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:57 smithi002 ceph-mon[27650]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:00:57.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:57 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3087130827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:00:57.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.930+0000 7f4f414b9640 1 -- 172.21.15.2:0/465742412 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f28000bf0 con 0x7f4f2406ed60 2024-09-17T01:00:57.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.931+0000 7f4f237fe640 1 -- 172.21.15.2:0/465742412 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f4f28000bf0 con 0x7f4f2406ed60 2024-09-17T01:00:57.928 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:00:57.928 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:00:57.928 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:00:57.928 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-17T01:00:57.928 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2024-09-17T01:00:57.928 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "0/2 daemons upgraded", 2024-09-17T01:00:57.928 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 image on host smithi099", 2024-09-17T01:00:57.929 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:00:57.929 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:00:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.933+0000 7f4f414b9640 1 -- 172.21.15.2:0/465742412 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f4f2406ed60 msgr2=0x7f4f24071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.934+0000 7f4f414b9640 1 --2- 172.21.15.2:0/465742412 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f4f2406ed60 0x7f4f24071210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4f30007ac0 tx=0x7f4f30035040 comp rx=0 tx=0).stop 2024-09-17T01:00:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.934+0000 7f4f414b9640 1 -- 172.21.15.2:0/465742412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f3c065c40 msgr2=0x7f4f3c0fcae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:00:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.934+0000 7f4f414b9640 1 --2- 172.21.15.2:0/465742412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f3c065c40 0x7f4f3c0fcae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0659a0 tx=0x7f4f2c00b040 comp rx=0 tx=0).stop 2024-09-17T01:00:57.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.934+0000 7f4f414b9640 1 -- 172.21.15.2:0/465742412 shutdown_connections 2024-09-17T01:00:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.934+0000 7f4f414b9640 1 --2- 172.21.15.2:0/465742412 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f4f2406ed60 0x7f4f24071210 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.934+0000 7f4f414b9640 1 --2- 172.21.15.2:0/465742412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f3c0ff680 0x7f4f3c0fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.934+0000 7f4f414b9640 1 --2- 172.21.15.2:0/465742412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f3c065c40 0x7f4f3c0fcae0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:00:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.934+0000 7f4f414b9640 1 -- 172.21.15.2:0/465742412 >> 172.21.15.2:0/465742412 conn(0x7f4f3c0f6c10 msgr2=0x7f4f3c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:00:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.934+0000 7f4f414b9640 1 -- 172.21.15.2:0/465742412 shutdown_connections 2024-09-17T01:00:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:00:57.934+0000 7f4f414b9640 1 -- 172.21.15.2:0/465742412 wait complete. 2024-09-17T01:00:58.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:57 smithi099 ceph-mon[34357]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:00:58.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:57 smithi099 ceph-mon[34357]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:00:58.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:57 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:00:58.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:57 smithi099 ceph-mon[34357]: Upgrade: Target is version 19.1.1-330-gc2ddf972 (unknown) 2024-09-17T01:00:58.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:57 smithi099 ceph-mon[34357]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, digests ['quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3'] 2024-09-17T01:00:58.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:57 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:00:58.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:57 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:00:58.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:57 smithi099 ceph-mon[34357]: Upgrade: Need to upgrade myself (mgr.smithi002.vjeexr) 2024-09-17T01:00:58.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:57 smithi099 ceph-mon[34357]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:00:58.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:57 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3087130827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:00:58.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:58 smithi002 ceph-mon[27650]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 on smithi099 2024-09-17T01:00:58.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:58 smithi002 ceph-mon[27650]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:00:59.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:58 smithi099 ceph-mon[34357]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 on smithi099 2024-09-17T01:00:59.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:58 smithi099 ceph-mon[34357]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:00:59.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:59 smithi002 ceph-mon[27650]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:00:59.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:00:59 smithi002 ceph-mon[27650]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:01:00.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:59 smithi099 ceph-mon[34357]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:00.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:00:59 smithi099 ceph-mon[34357]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:01:01.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:01 smithi099 ceph-mon[34357]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:01:01.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:01 smithi002 ceph-mon[27650]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:01:03.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:03 smithi002 ceph-mon[27650]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:01:04.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:03 smithi099 ceph-mon[34357]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:01:05.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:05 smithi002 ceph-mon[27650]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:01:06.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:05 smithi099 ceph-mon[34357]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:01:06.882 INFO:tasks.workunit.client.1.smithi099.stderr:Updating files: 95% (12316/12893) Updating files: 96% (12378/12893) Updating files: 97% (12507/12893) Updating files: 98% (12636/12893) Updating files: 99% (12765/12893) Updating files: 100% (12893/12893) Updating files: 100% (12893/12893), done. 2024-09-17T01:01:06.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:06 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:07.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:06 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:07.832 INFO:tasks.workunit.client.1.smithi099.stderr:Note: switching to 'e20bff7d16f5b09c58ead9548e8cf98cf87ee227'. 2024-09-17T01:01:07.832 INFO:tasks.workunit.client.1.smithi099.stderr: 2024-09-17T01:01:07.832 INFO:tasks.workunit.client.1.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T01:01:07.832 INFO:tasks.workunit.client.1.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T01:01:07.832 INFO:tasks.workunit.client.1.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T01:01:07.833 INFO:tasks.workunit.client.1.smithi099.stderr: 2024-09-17T01:01:07.833 INFO:tasks.workunit.client.1.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T01:01:07.833 INFO:tasks.workunit.client.1.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T01:01:07.833 INFO:tasks.workunit.client.1.smithi099.stderr: 2024-09-17T01:01:07.833 INFO:tasks.workunit.client.1.smithi099.stderr: git switch -c 2024-09-17T01:01:07.833 INFO:tasks.workunit.client.1.smithi099.stderr: 2024-09-17T01:01:07.833 INFO:tasks.workunit.client.1.smithi099.stderr:Or undo this operation with: 2024-09-17T01:01:07.833 INFO:tasks.workunit.client.1.smithi099.stderr: 2024-09-17T01:01:07.833 INFO:tasks.workunit.client.1.smithi099.stderr: git switch - 2024-09-17T01:01:07.833 INFO:tasks.workunit.client.1.smithi099.stderr: 2024-09-17T01:01:07.833 INFO:tasks.workunit.client.1.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T01:01:07.833 INFO:tasks.workunit.client.1.smithi099.stderr: 2024-09-17T01:01:07.833 INFO:tasks.workunit.client.1.smithi099.stderr:HEAD is now at e20bff7d16f Merge pull request #59722 from aaSharma14/wip-67990-squid 2024-09-17T01:01:07.838 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-17T01:01:07.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:07 smithi002 ceph-mon[27650]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:01:07.937 INFO:tasks.workunit.client.1.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T01:01:07.939 INFO:tasks.workunit.client.1.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-17T01:01:07.939 INFO:tasks.workunit.client.1.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T01:01:08.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:07 smithi099 ceph-mon[34357]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:01:08.642 INFO:tasks.workunit.client.1.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T01:01:08.712 INFO:tasks.workunit.client.1.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T01:01:08.752 INFO:tasks.workunit.client.1.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-17T01:01:08.754 INFO:tasks.workunit.client.1.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-17T01:01:08.754 INFO:tasks.workunit.client.1.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T01:01:08.795 INFO:tasks.workunit.client.1.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-17T01:01:08.798 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T01:01:08.799 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-17T01:01:08.815 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-17T01:01:08.816 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-17T01:01:08.816 DEBUG:teuthology.orchestra.run.smithi099:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e20bff7d16f5b09c58ead9548e8cf98cf87ee227 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-17T01:01:08.877 INFO:tasks.workunit.client.1.smithi099.stderr:+ mkdir -p fsstress 2024-09-17T01:01:08.879 INFO:tasks.workunit.client.1.smithi099.stderr:+ pushd fsstress 2024-09-17T01:01:08.879 INFO:tasks.workunit.client.1.smithi099.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:01:08.879 INFO:tasks.workunit.client.1.smithi099.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-17T01:01:09.397 INFO:tasks.workunit.client.1.smithi099.stderr:+ tar xzf ltp-full.tgz 2024-09-17T01:01:10.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:09 smithi099 ceph-mon[34357]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:01:10.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:09 smithi002 ceph-mon[27650]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:01:12.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:11 smithi099 ceph-mon[34357]: pgmap v229: 65 pgs: 65 active+clean; 602 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-17T01:01:12.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:11 smithi002 ceph-mon[27650]: pgmap v229: 65 pgs: 65 active+clean; 602 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-17T01:01:12.398 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 88% (11431/12893) Updating files: 89% (11475/12893) Updating files: 90% (11604/12893) Updating files: 91% (11733/12893) Updating files: 92% (11862/12893) Updating files: 93% (11991/12893) Updating files: 94% (12120/12893) Updating files: 95% (12249/12893) Updating files: 96% (12378/12893) Updating files: 97% (12507/12893) Updating files: 98% (12636/12893) Updating files: 99% (12765/12893) Updating files: 100% (12893/12893) Updating files: 100% (12893/12893), done. 2024-09-17T01:01:13.187 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to 'e20bff7d16f5b09c58ead9548e8cf98cf87ee227'. 2024-09-17T01:01:13.187 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-17T01:01:13.188 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T01:01:13.188 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T01:01:13.188 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T01:01:13.188 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-17T01:01:13.188 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T01:01:13.188 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T01:01:13.188 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-17T01:01:13.188 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-09-17T01:01:13.189 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-17T01:01:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-09-17T01:01:13.189 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-17T01:01:13.189 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-09-17T01:01:13.189 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-17T01:01:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T01:01:13.189 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-17T01:01:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at e20bff7d16f Merge pull request #59722 from aaSharma14/wip-67990-squid 2024-09-17T01:01:13.192 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-17T01:01:13.234 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T01:01:13.236 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T01:01:13.236 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T01:01:14.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:13 smithi099 ceph-mon[34357]: pgmap v230: 65 pgs: 65 active+clean; 602 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-17T01:01:14.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:13 smithi002 ceph-mon[27650]: pgmap v230: 65 pgs: 65 active+clean; 602 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-17T01:01:16.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:15 smithi099 ceph-mon[34357]: pgmap v231: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 344 KiB/s rd, 356 KiB/s wr, 4 op/s 2024-09-17T01:01:16.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:15 smithi002 ceph-mon[27650]: pgmap v231: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 344 KiB/s rd, 356 KiB/s wr, 4 op/s 2024-09-17T01:01:18.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:17 smithi099 ceph-mon[34357]: pgmap v232: 65 pgs: 65 active+clean; 38 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 271 op/s 2024-09-17T01:01:18.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:17 smithi002 ceph-mon[27650]: pgmap v232: 65 pgs: 65 active+clean; 38 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 271 op/s 2024-09-17T01:01:18.942 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:18 smithi099 ceph-mon[34357]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T01:01:19.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:18 smithi002 ceph-mon[27650]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T01:01:19.952 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:19 smithi099 ceph-mon[34357]: pgmap v233: 65 pgs: 65 active+clean; 47 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 326 op/s 2024-09-17T01:01:19.960 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T01:01:20.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:19 smithi002 ceph-mon[27650]: pgmap v233: 65 pgs: 65 active+clean; 47 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 326 op/s 2024-09-17T01:01:20.229 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T01:01:20.311 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T01:01:20.312 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T01:01:20.312 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T01:01:20.437 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T01:01:20.441 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T01:01:20.441 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-17T01:01:20.499 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-17T01:01:20.500 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-17T01:01:20.500 DEBUG:teuthology.orchestra.run.smithi002:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e20bff7d16f5b09c58ead9548e8cf98cf87ee227 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-17T01:01:20.565 INFO:tasks.workunit.client.0.smithi002.stderr:+ mkdir -p fsstress 2024-09-17T01:01:20.567 INFO:tasks.workunit.client.0.smithi002.stderr:+ pushd fsstress 2024-09-17T01:01:20.568 INFO:tasks.workunit.client.0.smithi002.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:01:20.568 INFO:tasks.workunit.client.0.smithi002.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-17T01:01:21.246 INFO:tasks.workunit.client.0.smithi002.stderr:+ tar xzf ltp-full.tgz 2024-09-17T01:01:22.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:21 smithi099 ceph-mon[34357]: pgmap v234: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 357 op/s 2024-09-17T01:01:22.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:21 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:22.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:21 smithi002 ceph-mon[27650]: pgmap v234: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 357 op/s 2024-09-17T01:01:22.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:21 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:24.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:23 smithi099 ceph-mon[34357]: pgmap v235: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 356 op/s 2024-09-17T01:01:24.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:23 smithi002 ceph-mon[27650]: pgmap v235: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 356 op/s 2024-09-17T01:01:26.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:25 smithi099 ceph-mon[34357]: pgmap v236: 65 pgs: 65 active+clean; 66 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 357 op/s 2024-09-17T01:01:26.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:25 smithi002 ceph-mon[27650]: pgmap v236: 65 pgs: 65 active+clean; 66 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 5.7 MiB/s wr, 357 op/s 2024-09-17T01:01:28.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:27 smithi099 ceph-mon[34357]: pgmap v237: 65 pgs: 65 active+clean; 78 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 6.3 MiB/s wr, 368 op/s 2024-09-17T01:01:28.047 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:27 smithi002 ceph-mon[27650]: pgmap v237: 65 pgs: 65 active+clean; 78 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.4 MiB/s rd, 6.3 MiB/s wr, 368 op/s 2024-09-17T01:01:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.048+0000 7fd4b29be640 1 -- 172.21.15.2:0/468748715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac0fc700 msgr2=0x7fd4ac0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.048+0000 7fd4b29be640 1 --2- 172.21.15.2:0/468748715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac0fc700 0x7fd4ac0fcb70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00048d0 tx=0x7fd4a0009da0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.049+0000 7fd4b29be640 1 -- 172.21.15.2:0/468748715 shutdown_connections 2024-09-17T01:01:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.049+0000 7fd4b29be640 1 --2- 172.21.15.2:0/468748715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac0fc700 0x7fd4ac0fcb70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.049+0000 7fd4b29be640 1 --2- 172.21.15.2:0/468748715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4ac0fb430 0x7fd4ac0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.049+0000 7fd4b29be640 1 -- 172.21.15.2:0/468748715 >> 172.21.15.2:0/468748715 conn(0x7fd4ac0f6c10 msgr2=0x7fd4ac0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.049+0000 7fd4b29be640 1 -- 172.21.15.2:0/468748715 shutdown_connections 2024-09-17T01:01:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.049+0000 7fd4b29be640 1 -- 172.21.15.2:0/468748715 wait complete. 2024-09-17T01:01:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.050+0000 7fd4b29be640 1 Processor -- start 2024-09-17T01:01:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.050+0000 7fd4b29be640 1 -- start start 2024-09-17T01:01:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.050+0000 7fd4b29be640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4ac0fb430 0x7fd4ac10f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.050+0000 7fd4b29be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac0fc700 0x7fd4ac10f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.050+0000 7fd4b29be640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac10fe30 con 0x7fd4ac0fc700 2024-09-17T01:01:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.050+0000 7fd4b29be640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac110650 con 0x7fd4ac0fb430 2024-09-17T01:01:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.050+0000 7fd4abfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4ac0fb430 0x7fd4ac10f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.050+0000 7fd4abfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4ac0fb430 0x7fd4ac10f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.2:44600/0 (socket says 172.21.15.2:44600) 2024-09-17T01:01:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.050+0000 7fd4abfff640 1 -- 172.21.15.2:0/151349246 learned_addr learned my addr 172.21.15.2:0/151349246 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:01:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.050+0000 7fd4ab7fe640 1 --2- 172.21.15.2:0/151349246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac0fc700 0x7fd4ac10f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.051+0000 7fd4abfff640 1 -- 172.21.15.2:0/151349246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac0fc700 msgr2=0x7fd4ac10f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.051+0000 7fd4abfff640 1 --2- 172.21.15.2:0/151349246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac0fc700 0x7fd4ac10f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.051+0000 7fd4abfff640 1 -- 172.21.15.2:0/151349246 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a0005040 con 0x7fd4ac0fb430 2024-09-17T01:01:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.051+0000 7fd4abfff640 1 --2- 172.21.15.2:0/151349246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4ac0fb430 0x7fd4ac10f2a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00eb70 tx=0x7fd49c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.051+0000 7fd4a8ff9640 1 -- 172.21.15.2:0/151349246 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd49c007c30 con 0x7fd4ac0fb430 2024-09-17T01:01:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.051+0000 7fd4a8ff9640 1 -- 172.21.15.2:0/151349246 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd49c00f040 con 0x7fd4ac0fb430 2024-09-17T01:01:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.051+0000 7fd4a8ff9640 1 -- 172.21.15.2:0/151349246 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd49c009420 con 0x7fd4ac0fb430 2024-09-17T01:01:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.051+0000 7fd4b29be640 1 -- 172.21.15.2:0/151349246 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac110880 con 0x7fd4ac0fb430 2024-09-17T01:01:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.052+0000 7fd4b29be640 1 -- 172.21.15.2:0/151349246 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac110e20 con 0x7fd4ac0fb430 2024-09-17T01:01:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.053+0000 7fd4b29be640 1 -- 172.21.15.2:0/151349246 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac0fa890 con 0x7fd4ac0fb430 2024-09-17T01:01:28.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.054+0000 7fd4a8ff9640 1 -- 172.21.15.2:0/151349246 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fd49c0095a0 con 0x7fd4ac0fb430 2024-09-17T01:01:28.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.054+0000 7fd4a8ff9640 1 --2- 172.21.15.2:0/151349246 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd49406ed50 0x7fd494071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:28.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.054+0000 7fd4a8ff9640 1 -- 172.21.15.2:0/151349246 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd49c08de60 con 0x7fd4ac0fb430 2024-09-17T01:01:28.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.055+0000 7fd4ab7fe640 1 --2- 172.21.15.2:0/151349246 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd49406ed50 0x7fd494071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:28.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.055+0000 7fd4ab7fe640 1 --2- 172.21.15.2:0/151349246 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd49406ed50 0x7fd494071200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac10f050 tx=0x7fd4a0035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:28.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.060+0000 7fd4a8ff9640 1 -- 172.21.15.2:0/151349246 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd49c05b120 con 0x7fd4ac0fb430 2024-09-17T01:01:28.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.279+0000 7fd4b29be640 1 -- 172.21.15.2:0/151349246 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4ac1111a0 con 0x7fd49406ed50 2024-09-17T01:01:28.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.281+0000 7fd4a8ff9640 1 -- 172.21.15.2:0/151349246 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fd4ac1111a0 con 0x7fd49406ed50 2024-09-17T01:01:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.283+0000 7fd4b29be640 1 -- 172.21.15.2:0/151349246 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd49406ed50 msgr2=0x7fd494071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.283+0000 7fd4b29be640 1 --2- 172.21.15.2:0/151349246 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd49406ed50 0x7fd494071200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac10f050 tx=0x7fd4a0035040 comp rx=0 tx=0).stop 2024-09-17T01:01:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.283+0000 7fd4b29be640 1 -- 172.21.15.2:0/151349246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4ac0fb430 msgr2=0x7fd4ac10f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.283+0000 7fd4b29be640 1 --2- 172.21.15.2:0/151349246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4ac0fb430 0x7fd4ac10f2a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00eb70 tx=0x7fd49c00b040 comp rx=0 tx=0).stop 2024-09-17T01:01:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.283+0000 7fd4b29be640 1 -- 172.21.15.2:0/151349246 shutdown_connections 2024-09-17T01:01:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.283+0000 7fd4b29be640 1 --2- 172.21.15.2:0/151349246 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fd49406ed50 0x7fd494071200 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.283+0000 7fd4b29be640 1 --2- 172.21.15.2:0/151349246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ac0fc700 0x7fd4ac10f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.283+0000 7fd4b29be640 1 --2- 172.21.15.2:0/151349246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4ac0fb430 0x7fd4ac10f2a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.283+0000 7fd4b29be640 1 -- 172.21.15.2:0/151349246 >> 172.21.15.2:0/151349246 conn(0x7fd4ac0f6c10 msgr2=0x7fd4ac0f8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.284+0000 7fd4b29be640 1 -- 172.21.15.2:0/151349246 shutdown_connections 2024-09-17T01:01:28.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.284+0000 7fd4b29be640 1 -- 172.21.15.2:0/151349246 wait complete. 2024-09-17T01:01:28.292 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:01:28.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.375+0000 7f947b0cc640 1 -- 172.21.15.2:0/2892837047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94740ff680 msgr2=0x7f9474101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:28.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.375+0000 7f947b0cc640 1 --2- 172.21.15.2:0/2892837047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94740ff680 0x7f9474101a60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f94600048d0 tx=0x7f9460009da0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.375+0000 7f947b0cc640 1 -- 172.21.15.2:0/2892837047 shutdown_connections 2024-09-17T01:01:28.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.375+0000 7f947b0cc640 1 --2- 172.21.15.2:0/2892837047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94740ff680 0x7f9474101a60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.375+0000 7f947b0cc640 1 --2- 172.21.15.2:0/2892837047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9474065c40 0x7f94740ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.375+0000 7f947b0cc640 1 -- 172.21.15.2:0/2892837047 >> 172.21.15.2:0/2892837047 conn(0x7f94740f6c10 msgr2=0x7f94740f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:28.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.376+0000 7f947b0cc640 1 -- 172.21.15.2:0/2892837047 shutdown_connections 2024-09-17T01:01:28.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.376+0000 7f947b0cc640 1 -- 172.21.15.2:0/2892837047 wait complete. 2024-09-17T01:01:28.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.376+0000 7f947b0cc640 1 Processor -- start 2024-09-17T01:01:28.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.376+0000 7f947b0cc640 1 -- start start 2024-09-17T01:01:28.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.377+0000 7f947b0cc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9474065c40 0x7f947410d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:28.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.377+0000 7f947b0cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94740ff680 0x7f947410d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:28.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.377+0000 7f947b0cc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947410dc00 con 0x7f94740ff680 2024-09-17T01:01:28.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.377+0000 7f947b0cc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947410e420 con 0x7f9474065c40 2024-09-17T01:01:28.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.377+0000 7f9473fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94740ff680 0x7f947410d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:28.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.377+0000 7f9478e68640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9474065c40 0x7f947410d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:28.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.377+0000 7f9473fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94740ff680 0x7f947410d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43076/0 (socket says 172.21.15.2:43076) 2024-09-17T01:01:28.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.377+0000 7f9473fff640 1 -- 172.21.15.2:0/1335914472 learned_addr learned my addr 172.21.15.2:0/1335914472 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:01:28.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.377+0000 7f9478e68640 1 -- 172.21.15.2:0/1335914472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94740ff680 msgr2=0x7f947410d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:28.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.377+0000 7f9478e68640 1 --2- 172.21.15.2:0/1335914472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94740ff680 0x7f947410d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.378+0000 7f9478e68640 1 -- 172.21.15.2:0/1335914472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460005040 con 0x7f9474065c40 2024-09-17T01:01:28.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.378+0000 7f9473fff640 1 --2- 172.21.15.2:0/1335914472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94740ff680 0x7f947410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:01:28.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.378+0000 7f9478e68640 1 --2- 172.21.15.2:0/1335914472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9474065c40 0x7f947410d070 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f94740659a0 tx=0x7f946800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:28.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.378+0000 7f94717fa640 1 -- 172.21.15.2:0/1335914472 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9468007c30 con 0x7f9474065c40 2024-09-17T01:01:28.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.378+0000 7f94717fa640 1 -- 172.21.15.2:0/1335914472 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f946800f040 con 0x7f9474065c40 2024-09-17T01:01:28.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.378+0000 7f947b0cc640 1 -- 172.21.15.2:0/1335914472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947410e6b0 con 0x7f9474065c40 2024-09-17T01:01:28.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.378+0000 7f94717fa640 1 -- 172.21.15.2:0/1335914472 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f946800ca70 con 0x7f9474065c40 2024-09-17T01:01:28.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.378+0000 7f947b0cc640 1 -- 172.21.15.2:0/1335914472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947410ec50 con 0x7f9474065c40 2024-09-17T01:01:28.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.379+0000 7f947b0cc640 1 -- 172.21.15.2:0/1335914472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94740fa890 con 0x7f9474065c40 2024-09-17T01:01:28.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.380+0000 7f94717fa640 1 -- 172.21.15.2:0/1335914472 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f946800cbf0 con 0x7f9474065c40 2024-09-17T01:01:28.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.380+0000 7f94717fa640 1 --2- 172.21.15.2:0/1335914472 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f946406ed60 0x7f9464071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:28.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.380+0000 7f94717fa640 1 -- 172.21.15.2:0/1335914472 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f946808e2a0 con 0x7f9474065c40 2024-09-17T01:01:28.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.380+0000 7f9473fff640 1 --2- 172.21.15.2:0/1335914472 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f946406ed60 0x7f9464071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:28.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.381+0000 7f9473fff640 1 --2- 172.21.15.2:0/1335914472 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f946406ed60 0x7f9464071210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f947410ce20 tx=0x7f9460035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:28.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.386+0000 7f94717fa640 1 -- 172.21.15.2:0/1335914472 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f946805b350 con 0x7f9474065c40 2024-09-17T01:01:28.416 INFO:tasks.workunit.client.1.smithi099.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-17T01:01:28.442 INFO:tasks.workunit.client.1.smithi099.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:01:28.442 INFO:tasks.workunit.client.1.smithi099.stderr:+ make 2024-09-17T01:01:28.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.585+0000 7f947b0cc640 1 -- 172.21.15.2:0/1335914472 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f947410f0b0 con 0x7f946406ed60 2024-09-17T01:01:28.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.586+0000 7f94717fa640 1 -- 172.21.15.2:0/1335914472 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f947410f0b0 con 0x7f946406ed60 2024-09-17T01:01:28.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.588+0000 7f947b0cc640 1 -- 172.21.15.2:0/1335914472 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f946406ed60 msgr2=0x7f9464071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:28.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.588+0000 7f947b0cc640 1 --2- 172.21.15.2:0/1335914472 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f946406ed60 0x7f9464071210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f947410ce20 tx=0x7f9460035040 comp rx=0 tx=0).stop 2024-09-17T01:01:28.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.588+0000 7f947b0cc640 1 -- 172.21.15.2:0/1335914472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9474065c40 msgr2=0x7f947410d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:28.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.588+0000 7f947b0cc640 1 --2- 172.21.15.2:0/1335914472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9474065c40 0x7f947410d070 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f94740659a0 tx=0x7f946800b040 comp rx=0 tx=0).stop 2024-09-17T01:01:28.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.588+0000 7f947b0cc640 1 -- 172.21.15.2:0/1335914472 shutdown_connections 2024-09-17T01:01:28.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.588+0000 7f947b0cc640 1 --2- 172.21.15.2:0/1335914472 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f946406ed60 0x7f9464071210 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.588+0000 7f947b0cc640 1 --2- 172.21.15.2:0/1335914472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94740ff680 0x7f947410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.588+0000 7f947b0cc640 1 --2- 172.21.15.2:0/1335914472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9474065c40 0x7f947410d070 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.588+0000 7f947b0cc640 1 -- 172.21.15.2:0/1335914472 >> 172.21.15.2:0/1335914472 conn(0x7f94740f6c10 msgr2=0x7f94740f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:28.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.589+0000 7f947b0cc640 1 -- 172.21.15.2:0/1335914472 shutdown_connections 2024-09-17T01:01:28.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.589+0000 7f947b0cc640 1 -- 172.21.15.2:0/1335914472 wait complete. 2024-09-17T01:01:28.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.687+0000 7feb3474a640 1 -- 172.21.15.2:0/1658216035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb2c0fd830 msgr2=0x7feb2c0fdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.688+0000 7feb3474a640 1 --2- 172.21.15.2:0/1658216035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb2c0fd830 0x7feb2c0fdca0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7feb200048d0 tx=0x7feb20009da0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.688+0000 7feb3474a640 1 -- 172.21.15.2:0/1658216035 shutdown_connections 2024-09-17T01:01:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.688+0000 7feb3474a640 1 --2- 172.21.15.2:0/1658216035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb2c0fd830 0x7feb2c0fdca0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.688+0000 7feb3474a640 1 --2- 172.21.15.2:0/1658216035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb2c0fc560 0x7feb2c0fc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.688+0000 7feb3474a640 1 -- 172.21.15.2:0/1658216035 >> 172.21.15.2:0/1658216035 conn(0x7feb2c0f7d40 msgr2=0x7feb2c0fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.688+0000 7feb3474a640 1 -- 172.21.15.2:0/1658216035 shutdown_connections 2024-09-17T01:01:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.688+0000 7feb3474a640 1 -- 172.21.15.2:0/1658216035 wait complete. 2024-09-17T01:01:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.688+0000 7feb3474a640 1 Processor -- start 2024-09-17T01:01:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.689+0000 7feb3474a640 1 -- start start 2024-09-17T01:01:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.689+0000 7feb3474a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb2c0fc560 0x7feb2c10d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.689+0000 7feb3474a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb2c0fd830 0x7feb2c10d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.689+0000 7feb3474a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c10dc60 con 0x7feb2c0fc560 2024-09-17T01:01:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.689+0000 7feb3474a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c10e430 con 0x7feb2c0fd830 2024-09-17T01:01:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.689+0000 7feb324e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb2c0fc560 0x7feb2c10d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.689+0000 7feb324e6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb2c0fc560 0x7feb2c10d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43102/0 (socket says 172.21.15.2:43102) 2024-09-17T01:01:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.689+0000 7feb324e6640 1 -- 172.21.15.2:0/1325252725 learned_addr learned my addr 172.21.15.2:0/1325252725 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:01:28.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.689+0000 7feb31ce5640 1 --2- 172.21.15.2:0/1325252725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb2c0fd830 0x7feb2c10d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:28.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.689+0000 7feb324e6640 1 -- 172.21.15.2:0/1325252725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb2c0fd830 msgr2=0x7feb2c10d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:28.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.689+0000 7feb324e6640 1 --2- 172.21.15.2:0/1325252725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb2c0fd830 0x7feb2c10d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.689+0000 7feb324e6640 1 -- 172.21.15.2:0/1325252725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb20005040 con 0x7feb2c0fc560 2024-09-17T01:01:28.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.689+0000 7feb324e6640 1 --2- 172.21.15.2:0/1325252725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb2c0fc560 0x7feb2c10d0d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00ece0 tx=0x7feb1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:28.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.690+0000 7feb2affd640 1 -- 172.21.15.2:0/1325252725 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb1c00ee40 con 0x7feb2c0fc560 2024-09-17T01:01:28.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.690+0000 7feb2affd640 1 -- 172.21.15.2:0/1325252725 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feb1c00f040 con 0x7feb2c0fc560 2024-09-17T01:01:28.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.690+0000 7feb3474a640 1 -- 172.21.15.2:0/1325252725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2c10e6c0 con 0x7feb2c0fc560 2024-09-17T01:01:28.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.690+0000 7feb2affd640 1 -- 172.21.15.2:0/1325252725 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb1c009580 con 0x7feb2c0fc560 2024-09-17T01:01:28.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.690+0000 7feb3474a640 1 -- 172.21.15.2:0/1325252725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2c10ec60 con 0x7feb2c0fc560 2024-09-17T01:01:28.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.691+0000 7feb3474a640 1 -- 172.21.15.2:0/1325252725 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2c0fb9c0 con 0x7feb2c0fc560 2024-09-17T01:01:28.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.692+0000 7feb2affd640 1 -- 172.21.15.2:0/1325252725 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7feb1c00ccc0 con 0x7feb2c0fc560 2024-09-17T01:01:28.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.692+0000 7feb2affd640 1 --2- 172.21.15.2:0/1325252725 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7feb1406ed60 0x7feb14071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:28.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.692+0000 7feb2affd640 1 -- 172.21.15.2:0/1325252725 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7feb1c08e820 con 0x7feb2c0fc560 2024-09-17T01:01:28.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.692+0000 7feb31ce5640 1 --2- 172.21.15.2:0/1325252725 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7feb1406ed60 0x7feb14071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:28.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.693+0000 7feb31ce5640 1 --2- 172.21.15.2:0/1325252725 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7feb1406ed60 0x7feb14071210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feb20007ac0 tx=0x7feb20035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:28.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.698+0000 7feb2affd640 1 -- 172.21.15.2:0/1325252725 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7feb1c05b8f0 con 0x7feb2c0fc560 2024-09-17T01:01:28.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.873+0000 7feb3474a640 1 -- 172.21.15.2:0/1325252725 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feb2c10efb0 con 0x7feb1406ed60 2024-09-17T01:01:28.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.883+0000 7feb2affd640 1 -- 172.21.15.2:0/1325252725 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7feb2c10efb0 con 0x7feb1406ed60 2024-09-17T01:01:28.882 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:01:28.882 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (6m) 99s ago 7m 26.6M - 0.25.0 c8568f914cd2 225a4094fd9c 2024-09-17T01:01:28.882 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (7m) 99s ago 7m 6903k - 17.2.7-1635-g4a704134 f22ead590bad 53b003b1ad6f 2024-09-17T01:01:28.882 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (6m) 104s ago 6m 6891k - 17.2.7-1635-g4a704134 f22ead590bad 6ec40439e9b5 2024-09-17T01:01:28.882 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (5m) 99s ago 7m 83.7M - 9.4.7 954c08fa6188 68fde0ccaa6c 2024-09-17T01:01:28.882 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (117s) 99s ago 117s 15.1M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:01:28.882 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (2m) 99s ago 2m 11.9M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:01:28.883 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (114s) 104s ago 114s 15.2M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:01:28.883 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (2m) 104s ago 2m 17.3M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:01:28.883 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:9283,8765,8443 running (8m) 99s ago 8m 449M - 17.2.7-1635-g4a704134 f22ead590bad 6f10e41396cd 2024-09-17T01:01:28.883 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283 running (6m) 104s ago 6m 400M - 17.2.7-1635-g4a704134 f22ead590bad d88571dad10b 2024-09-17T01:01:28.883 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (8m) 99s ago 8m 43.0M 2048M 17.2.7-1635-g4a704134 f22ead590bad 08b932b41bfa 2024-09-17T01:01:28.883 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (6m) 104s ago 6m 33.4M 2048M 17.2.7-1635-g4a704134 f22ead590bad 1c9583d52c94 2024-09-17T01:01:28.883 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (7m) 99s ago 7m 16.4M - 1.5.0 0da6a335fe13 175a7378d3e6 2024-09-17T01:01:28.884 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (6m) 104s ago 6m 17.1M - 1.5.0 0da6a335fe13 7c4fe7150f28 2024-09-17T01:01:28.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (5m) 99s ago 5m 47.4M 4289M 17.2.7-1635-g4a704134 f22ead590bad 720f74f40752 2024-09-17T01:01:28.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (5m) 99s ago 5m 46.5M 4289M 17.2.7-1635-g4a704134 f22ead590bad 629defddb38c 2024-09-17T01:01:28.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (4m) 99s ago 4m 46.4M 4289M 17.2.7-1635-g4a704134 f22ead590bad 5dff1cf9fc56 2024-09-17T01:01:28.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (4m) 104s ago 4m 43.7M 5312M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:01:28.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (4m) 104s ago 4m 44.8M 5312M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:01:28.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (3m) 104s ago 3m 44.9M 5312M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:01:28.885 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (5m) 99s ago 6m 53.8M - 2.43.0 a07b618ecd1d 4c4de4cca2fc 2024-09-17T01:01:28.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.885+0000 7feb3474a640 1 -- 172.21.15.2:0/1325252725 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7feb1406ed60 msgr2=0x7feb14071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.885+0000 7feb3474a640 1 --2- 172.21.15.2:0/1325252725 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7feb1406ed60 0x7feb14071210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feb20007ac0 tx=0x7feb20035040 comp rx=0 tx=0).stop 2024-09-17T01:01:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.885+0000 7feb3474a640 1 -- 172.21.15.2:0/1325252725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb2c0fc560 msgr2=0x7feb2c10d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.885+0000 7feb3474a640 1 --2- 172.21.15.2:0/1325252725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb2c0fc560 0x7feb2c10d0d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00ece0 tx=0x7feb1c00b040 comp rx=0 tx=0).stop 2024-09-17T01:01:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.885+0000 7feb3474a640 1 -- 172.21.15.2:0/1325252725 shutdown_connections 2024-09-17T01:01:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.885+0000 7feb3474a640 1 --2- 172.21.15.2:0/1325252725 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7feb1406ed60 0x7feb14071210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.885+0000 7feb3474a640 1 --2- 172.21.15.2:0/1325252725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb2c0fd830 0x7feb2c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.885+0000 7feb3474a640 1 --2- 172.21.15.2:0/1325252725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb2c0fc560 0x7feb2c10d0d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.885+0000 7feb3474a640 1 -- 172.21.15.2:0/1325252725 >> 172.21.15.2:0/1325252725 conn(0x7feb2c0f7d40 msgr2=0x7feb2c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:28.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.885+0000 7feb3474a640 1 -- 172.21.15.2:0/1325252725 shutdown_connections 2024-09-17T01:01:28.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.886+0000 7feb3474a640 1 -- 172.21.15.2:0/1325252725 wait complete. 2024-09-17T01:01:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.968+0000 7fabb1095640 1 -- 172.21.15.2:0/2118310655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabac0fb430 msgr2=0x7fabac0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.968+0000 7fabb1095640 1 --2- 172.21.15.2:0/2118310655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabac0fb430 0x7fabac0fb840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0048d0 tx=0x7fab9c009da0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.968+0000 7fabb1095640 1 -- 172.21.15.2:0/2118310655 shutdown_connections 2024-09-17T01:01:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.968+0000 7fabb1095640 1 --2- 172.21.15.2:0/2118310655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabac0fc700 0x7fabac0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.968+0000 7fabb1095640 1 --2- 172.21.15.2:0/2118310655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabac0fb430 0x7fabac0fb840 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.968+0000 7fabb1095640 1 -- 172.21.15.2:0/2118310655 >> 172.21.15.2:0/2118310655 conn(0x7fabac0f6c10 msgr2=0x7fabac0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.969+0000 7fabb1095640 1 -- 172.21.15.2:0/2118310655 shutdown_connections 2024-09-17T01:01:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.969+0000 7fabb1095640 1 -- 172.21.15.2:0/2118310655 wait complete. 2024-09-17T01:01:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.969+0000 7fabb1095640 1 Processor -- start 2024-09-17T01:01:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.969+0000 7fabb1095640 1 -- start start 2024-09-17T01:01:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.969+0000 7fabb1095640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabac0fb430 0x7fabac0ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.969+0000 7fabb1095640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabac0fc700 0x7fabac0fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.969+0000 7fabb1095640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac0fdfd0 con 0x7fabac0fc700 2024-09-17T01:01:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.969+0000 7fabb1095640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac0fe110 con 0x7fabac0fb430 2024-09-17T01:01:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.970+0000 7fabaa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabac0fc700 0x7fabac0fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.970+0000 7fabaa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabac0fc700 0x7fabac0fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43126/0 (socket says 172.21.15.2:43126) 2024-09-17T01:01:28.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.970+0000 7fabaa59c640 1 -- 172.21.15.2:0/3131502344 learned_addr learned my addr 172.21.15.2:0/3131502344 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:01:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.970+0000 7fabaad9d640 1 --2- 172.21.15.2:0/3131502344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabac0fb430 0x7fabac0ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.970+0000 7fabaad9d640 1 -- 172.21.15.2:0/3131502344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabac0fc700 msgr2=0x7fabac0fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.970+0000 7fabaad9d640 1 --2- 172.21.15.2:0/3131502344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabac0fc700 0x7fabac0fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.970+0000 7fabaad9d640 1 -- 172.21.15.2:0/3131502344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c005040 con 0x7fabac0fb430 2024-09-17T01:01:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.970+0000 7fabaa59c640 1 --2- 172.21.15.2:0/3131502344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabac0fc700 0x7fabac0fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:01:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.970+0000 7fabaad9d640 1 --2- 172.21.15.2:0/3131502344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabac0fb430 0x7fabac0ff550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fab9c02a530 tx=0x7fab9c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.970+0000 7fab937fe640 1 -- 172.21.15.2:0/3131502344 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab9c038070 con 0x7fabac0fb430 2024-09-17T01:01:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.971+0000 7fab937fe640 1 -- 172.21.15.2:0/3131502344 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fab9c02ae90 con 0x7fabac0fb430 2024-09-17T01:01:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.971+0000 7fabb1095640 1 -- 172.21.15.2:0/3131502344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabac0fe390 con 0x7fabac0fb430 2024-09-17T01:01:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.971+0000 7fab937fe640 1 -- 172.21.15.2:0/3131502344 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab9c03e670 con 0x7fabac0fb430 2024-09-17T01:01:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.971+0000 7fabb1095640 1 -- 172.21.15.2:0/3131502344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabac1150d0 con 0x7fabac0fb430 2024-09-17T01:01:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.972+0000 7fabb1095640 1 -- 172.21.15.2:0/3131502344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabac0fa890 con 0x7fabac0fb430 2024-09-17T01:01:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.972+0000 7fab937fe640 1 -- 172.21.15.2:0/3131502344 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fab9c030020 con 0x7fabac0fb430 2024-09-17T01:01:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.973+0000 7fab937fe640 1 --2- 172.21.15.2:0/3131502344 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fab9406ed60 0x7fab94071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.973+0000 7fab937fe640 1 -- 172.21.15.2:0/3131502344 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fab9c0ae190 con 0x7fabac0fb430 2024-09-17T01:01:28.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.973+0000 7fabaa59c640 1 --2- 172.21.15.2:0/3131502344 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fab9406ed60 0x7fab94071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:28.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.974+0000 7fabaa59c640 1 --2- 172.21.15.2:0/3131502344 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fab9406ed60 0x7fab94071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faba0007e60 tx=0x7faba000b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:28.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:28.977+0000 7fab937fe640 1 -- 172.21.15.2:0/3131502344 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fab9c07b3a0 con 0x7fabac0fb430 2024-09-17T01:01:28.994 INFO:tasks.workunit.client.1.smithi099.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-17T01:01:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.313+0000 7fabb1095640 1 -- 172.21.15.2:0/3131502344 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fabac103f50 con 0x7fabac0fb430 2024-09-17T01:01:29.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.313+0000 7fab937fe640 1 -- 172.21.15.2:0/3131502344 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7fab9c07ad40 con 0x7fabac0fb430 2024-09-17T01:01:29.312 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:01:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:01:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T01:01:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:01:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:01:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T01:01:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:01:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:01:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T01:01:29.312 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:01:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:01:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:01:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:01:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:01:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 14 2024-09-17T01:01:29.313 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:01:29.313 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:01:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.316+0000 7fabb1095640 1 -- 172.21.15.2:0/3131502344 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fab9406ed60 msgr2=0x7fab94071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:29.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.316+0000 7fabb1095640 1 --2- 172.21.15.2:0/3131502344 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fab9406ed60 0x7fab94071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faba0007e60 tx=0x7faba000b040 comp rx=0 tx=0).stop 2024-09-17T01:01:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.316+0000 7fabb1095640 1 -- 172.21.15.2:0/3131502344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabac0fb430 msgr2=0x7fabac0ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.316+0000 7fabb1095640 1 --2- 172.21.15.2:0/3131502344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabac0fb430 0x7fabac0ff550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fab9c02a530 tx=0x7fab9c009da0 comp rx=0 tx=0).stop 2024-09-17T01:01:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.316+0000 7fabb1095640 1 -- 172.21.15.2:0/3131502344 shutdown_connections 2024-09-17T01:01:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.316+0000 7fabb1095640 1 --2- 172.21.15.2:0/3131502344 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fab9406ed60 0x7fab94071210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.316+0000 7fabb1095640 1 --2- 172.21.15.2:0/3131502344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabac0fc700 0x7fabac0fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.316+0000 7fabb1095640 1 --2- 172.21.15.2:0/3131502344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabac0fb430 0x7fabac0ff550 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.316+0000 7fabb1095640 1 -- 172.21.15.2:0/3131502344 >> 172.21.15.2:0/3131502344 conn(0x7fabac0f6c10 msgr2=0x7fabac0655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.316+0000 7fabb1095640 1 -- 172.21.15.2:0/3131502344 shutdown_connections 2024-09-17T01:01:29.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.316+0000 7fabb1095640 1 -- 172.21.15.2:0/3131502344 wait complete. 2024-09-17T01:01:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.410+0000 7f7475a9c640 1 -- 172.21.15.2:0/1654724356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74700fd7f0 msgr2=0x7f74700fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:29.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.410+0000 7f7475a9c640 1 --2- 172.21.15.2:0/1654724356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74700fd7f0 0x7f74700fdc60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f74640048d0 tx=0x7f7464009da0 comp rx=0 tx=0).stop 2024-09-17T01:01:29.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.411+0000 7f7475a9c640 1 -- 172.21.15.2:0/1654724356 shutdown_connections 2024-09-17T01:01:29.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.411+0000 7f7475a9c640 1 --2- 172.21.15.2:0/1654724356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74700fd7f0 0x7f74700fdc60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:29.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.411+0000 7f7475a9c640 1 --2- 172.21.15.2:0/1654724356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74700fc520 0x7f74700fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:29.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.411+0000 7f7475a9c640 1 -- 172.21.15.2:0/1654724356 >> 172.21.15.2:0/1654724356 conn(0x7f74700f7ce0 msgr2=0x7f74700fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:29.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.411+0000 7f7475a9c640 1 -- 172.21.15.2:0/1654724356 shutdown_connections 2024-09-17T01:01:29.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.411+0000 7f7475a9c640 1 -- 172.21.15.2:0/1654724356 wait complete. 2024-09-17T01:01:29.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.411+0000 7f7475a9c640 1 Processor -- start 2024-09-17T01:01:29.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.411+0000 7f7475a9c640 1 -- start start 2024-09-17T01:01:29.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.412+0000 7f7475a9c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74700fc520 0x7f7470071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:29.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.412+0000 7f7475a9c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74700fd7f0 0x7f747006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:29.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.412+0000 7f7475a9c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747006fff0 con 0x7f74700fc520 2024-09-17T01:01:29.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.412+0000 7f7475a9c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7470070130 con 0x7f74700fd7f0 2024-09-17T01:01:29.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.412+0000 7f746f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74700fc520 0x7f7470071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:29.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.412+0000 7f746f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74700fc520 0x7f7470071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43148/0 (socket says 172.21.15.2:43148) 2024-09-17T01:01:29.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.412+0000 7f746effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74700fd7f0 0x7f747006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:29.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.412+0000 7f746f7fe640 1 -- 172.21.15.2:0/3014516310 learned_addr learned my addr 172.21.15.2:0/3014516310 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:01:29.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.412+0000 7f746f7fe640 1 -- 172.21.15.2:0/3014516310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74700fd7f0 msgr2=0x7f747006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:29.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.412+0000 7f746f7fe640 1 --2- 172.21.15.2:0/3014516310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74700fd7f0 0x7f747006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:29.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.412+0000 7f746f7fe640 1 -- 172.21.15.2:0/3014516310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7464005040 con 0x7f74700fc520 2024-09-17T01:01:29.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.412+0000 7f746f7fe640 1 --2- 172.21.15.2:0/3014516310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74700fc520 0x7f7470071570 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7460002a80 tx=0x7f7460004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:29.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.413+0000 7f7457fff640 1 -- 172.21.15.2:0/3014516310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7460007c30 con 0x7f74700fc520 2024-09-17T01:01:29.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.413+0000 7f7457fff640 1 -- 172.21.15.2:0/3014516310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f746000f040 con 0x7f74700fc520 2024-09-17T01:01:29.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.413+0000 7f7475a9c640 1 -- 172.21.15.2:0/3014516310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7470070410 con 0x7f74700fc520 2024-09-17T01:01:29.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.413+0000 7f7457fff640 1 -- 172.21.15.2:0/3014516310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f746000dab0 con 0x7f74700fc520 2024-09-17T01:01:29.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.413+0000 7f7475a9c640 1 -- 172.21.15.2:0/3014516310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74701150b0 con 0x7f74700fc520 2024-09-17T01:01:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.414+0000 7f7457fff640 1 -- 172.21.15.2:0/3014516310 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f746000dc10 con 0x7f74700fc520 2024-09-17T01:01:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.414+0000 7f7475a9c640 1 -- 172.21.15.2:0/3014516310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74700fb980 con 0x7f74700fc520 2024-09-17T01:01:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.415+0000 7f7457fff640 1 --2- 172.21.15.2:0/3014516310 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f745806ed50 0x7f7458071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.415+0000 7f7457fff640 1 -- 172.21.15.2:0/3014516310 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f746008d980 con 0x7f74700fc520 2024-09-17T01:01:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.415+0000 7f746effd640 1 --2- 172.21.15.2:0/3014516310 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f745806ed50 0x7f7458071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:29.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.416+0000 7f746effd640 1 --2- 172.21.15.2:0/3014516310 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f745806ed50 0x7f7458071200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7464000c00 tx=0x7f7464035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:29.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.419+0000 7f7457fff640 1 -- 172.21.15.2:0/3014516310 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f746005ab80 con 0x7f74700fc520 2024-09-17T01:01:29.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.696+0000 7f7475a9c640 1 -- 172.21.15.2:0/3014516310 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7470101c10 con 0x7f745806ed50 2024-09-17T01:01:29.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.697+0000 7f7457fff640 1 -- 172.21.15.2:0/3014516310 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f7470101c10 con 0x7f745806ed50 2024-09-17T01:01:29.695 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:01:29.695 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:01:29.695 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:01:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-17T01:01:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2024-09-17T01:01:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "0/2 daemons upgraded", 2024-09-17T01:01:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 image on host smithi099", 2024-09-17T01:01:29.696 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:01:29.696 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:01:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.699+0000 7f7475a9c640 1 -- 172.21.15.2:0/3014516310 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f745806ed50 msgr2=0x7f7458071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.699+0000 7f7475a9c640 1 --2- 172.21.15.2:0/3014516310 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f745806ed50 0x7f7458071200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7464000c00 tx=0x7f7464035040 comp rx=0 tx=0).stop 2024-09-17T01:01:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.699+0000 7f7475a9c640 1 -- 172.21.15.2:0/3014516310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74700fc520 msgr2=0x7f7470071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.699+0000 7f7475a9c640 1 --2- 172.21.15.2:0/3014516310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74700fc520 0x7f7470071570 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7460002a80 tx=0x7f7460004600 comp rx=0 tx=0).stop 2024-09-17T01:01:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.699+0000 7f7475a9c640 1 -- 172.21.15.2:0/3014516310 shutdown_connections 2024-09-17T01:01:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.699+0000 7f7475a9c640 1 --2- 172.21.15.2:0/3014516310 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f745806ed50 0x7f7458071200 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.699+0000 7f7475a9c640 1 --2- 172.21.15.2:0/3014516310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74700fd7f0 0x7f747006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.699+0000 7f7475a9c640 1 --2- 172.21.15.2:0/3014516310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74700fc520 0x7f7470071570 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.699+0000 7f7475a9c640 1 -- 172.21.15.2:0/3014516310 >> 172.21.15.2:0/3014516310 conn(0x7f74700f7ce0 msgr2=0x7f74700f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.700+0000 7f7475a9c640 1 -- 172.21.15.2:0/3014516310 shutdown_connections 2024-09-17T01:01:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:29.700+0000 7f7475a9c640 1 -- 172.21.15.2:0/3014516310 wait complete. 2024-09-17T01:01:30.023 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:29 smithi002 ceph-mon[27650]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:30.023 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:29 smithi002 ceph-mon[27650]: pgmap v238: 65 pgs: 65 active+clean; 83 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 3.9 MiB/s wr, 141 op/s 2024-09-17T01:01:30.023 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:29 smithi002 ceph-mon[27650]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:30.023 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:29 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3131502344' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:01:30.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:29 smithi099 ceph-mon[34357]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:30.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:29 smithi099 ceph-mon[34357]: pgmap v238: 65 pgs: 65 active+clean; 83 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 3.9 MiB/s wr, 141 op/s 2024-09-17T01:01:30.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:29 smithi099 ceph-mon[34357]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:30.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:29 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3131502344' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:01:30.493 INFO:tasks.workunit.client.1.smithi099.stderr:++ readlink -f fsstress 2024-09-17T01:01:30.493 INFO:tasks.workunit.client.1.smithi099.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-17T01:01:30.493 INFO:tasks.workunit.client.1.smithi099.stderr:+ popd 2024-09-17T01:01:30.494 INFO:tasks.workunit.client.1.smithi099.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:01:30.494 INFO:tasks.workunit.client.1.smithi099.stderr:+ popd 2024-09-17T01:01:30.494 INFO:tasks.workunit.client.1.smithi099.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:01:30.494 INFO:tasks.workunit.client.1.smithi099.stderr:++ mktemp -d -p . 2024-09-17T01:01:30.495 INFO:tasks.workunit.client.1.smithi099.stderr:+ T=./tmp.v6Bl8uyJF8 2024-09-17T01:01:30.495 INFO:tasks.workunit.client.1.smithi099.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.v6Bl8uyJF8 -l 1 -n 1000 -p 10 -v 2024-09-17T01:01:30.496 INFO:tasks.workunit.client.1.smithi099.stdout:seed = 1726969090 2024-09-17T01:01:30.498 INFO:tasks.workunit.client.1.smithi099.stdout:0/0: dwrite - no filename 2024-09-17T01:01:30.499 INFO:tasks.workunit.client.1.smithi099.stdout:1/0: getdents . 0 2024-09-17T01:01:30.499 INFO:tasks.workunit.client.1.smithi099.stdout:0/1: mknod c0 0 2024-09-17T01:01:30.501 INFO:tasks.workunit.client.1.smithi099.stdout:1/1: mkdir d0 0 2024-09-17T01:01:30.501 INFO:tasks.workunit.client.1.smithi099.stdout:1/2: dread - no filename 2024-09-17T01:01:30.502 INFO:tasks.workunit.client.1.smithi099.stdout:0/2: rename c0 to c1 0 2024-09-17T01:01:30.502 INFO:tasks.workunit.client.1.smithi099.stdout:0/3: dread - no filename 2024-09-17T01:01:30.503 INFO:tasks.workunit.client.1.smithi099.stdout:2/0: creat f0 x:0 0 0 2024-09-17T01:01:30.504 INFO:tasks.workunit.client.1.smithi099.stdout:1/3: symlink d0/l1 0 2024-09-17T01:01:30.504 INFO:tasks.workunit.client.1.smithi099.stdout:1/4: dread - no filename 2024-09-17T01:01:30.504 INFO:tasks.workunit.client.1.smithi099.stdout:1/5: dwrite - no filename 2024-09-17T01:01:30.504 INFO:tasks.workunit.client.1.smithi099.stdout:1/6: chown d0/l1 19486158 1 2024-09-17T01:01:30.505 INFO:tasks.workunit.client.1.smithi099.stdout:0/4: symlink l2 0 2024-09-17T01:01:30.505 INFO:tasks.workunit.client.1.smithi099.stdout:0/5: readlink l2 0 2024-09-17T01:01:30.505 INFO:tasks.workunit.client.1.smithi099.stdout:0/6: rmdir - no directory 2024-09-17T01:01:30.506 INFO:tasks.workunit.client.1.smithi099.stdout:4/0: rename - no filename 2024-09-17T01:01:30.506 INFO:tasks.workunit.client.1.smithi099.stdout:4/1: rmdir - no directory 2024-09-17T01:01:30.506 INFO:tasks.workunit.client.1.smithi099.stdout:4/2: dwrite - no filename 2024-09-17T01:01:30.506 INFO:tasks.workunit.client.1.smithi099.stdout:4/3: dread - no filename 2024-09-17T01:01:30.507 INFO:tasks.workunit.client.1.smithi099.stdout:3/0: mknod c0 0 2024-09-17T01:01:30.507 INFO:tasks.workunit.client.1.smithi099.stdout:3/1: dread - no filename 2024-09-17T01:01:30.507 INFO:tasks.workunit.client.1.smithi099.stdout:3/2: dwrite - no filename 2024-09-17T01:01:30.508 INFO:tasks.workunit.client.1.smithi099.stdout:1/7: mkdir d0/d2 0 2024-09-17T01:01:30.510 INFO:tasks.workunit.client.1.smithi099.stdout:0/7: creat f3 x:0 0 0 2024-09-17T01:01:30.510 INFO:tasks.workunit.client.1.smithi099.stdout:0/8: rmdir - no directory 2024-09-17T01:01:30.510 INFO:tasks.workunit.client.1.smithi099.stdout:0/9: write f3 [359813,14397] 0 2024-09-17T01:01:30.510 INFO:tasks.workunit.client.1.smithi099.stdout:0/10: creat f4 x:0 0 0 2024-09-17T01:01:30.512 INFO:tasks.workunit.client.1.smithi099.stdout:4/4: symlink l0 0 2024-09-17T01:01:30.514 INFO:tasks.workunit.client.1.smithi099.stdout:3/3: creat f1 x:0 0 0 2024-09-17T01:01:30.514 INFO:tasks.workunit.client.1.smithi099.stdout:3/4: creat f2 x:0 0 0 2024-09-17T01:01:30.514 INFO:tasks.workunit.client.1.smithi099.stdout:3/5: dread - f2 zero size 2024-09-17T01:01:30.514 INFO:tasks.workunit.client.1.smithi099.stdout:3/6: write f1 [258895,13045] 0 2024-09-17T01:01:30.515 INFO:tasks.workunit.client.1.smithi099.stdout:1/8: creat d0/d2/f3 x:0 0 0 2024-09-17T01:01:30.519 INFO:tasks.workunit.client.1.smithi099.stdout:5/0: creat f0 x:0 0 0 2024-09-17T01:01:30.519 INFO:tasks.workunit.client.1.smithi099.stdout:5/1: creat f1 x:0 0 0 2024-09-17T01:01:30.520 INFO:tasks.workunit.client.1.smithi099.stdout:0/11: rename f4 to f5 0 2024-09-17T01:01:30.520 INFO:tasks.workunit.client.1.smithi099.stdout:0/12: dread - f5 zero size 2024-09-17T01:01:30.521 INFO:tasks.workunit.client.1.smithi099.stdout:7/0: dwrite - no filename 2024-09-17T01:01:30.521 INFO:tasks.workunit.client.1.smithi099.stdout:7/1: getdents . 0 2024-09-17T01:01:30.521 INFO:tasks.workunit.client.1.smithi099.stdout:7/2: chown . 658400 1 2024-09-17T01:01:30.522 INFO:tasks.workunit.client.1.smithi099.stdout:7/3: chown . 1734 1 2024-09-17T01:01:30.522 INFO:tasks.workunit.client.1.smithi099.stdout:7/4: truncate - no filename 2024-09-17T01:01:30.522 INFO:tasks.workunit.client.1.smithi099.stdout:7/5: truncate - no filename 2024-09-17T01:01:30.522 INFO:tasks.workunit.client.1.smithi099.stdout:7/6: write - no filename 2024-09-17T01:01:30.522 INFO:tasks.workunit.client.1.smithi099.stdout:7/7: dread - no filename 2024-09-17T01:01:30.522 INFO:tasks.workunit.client.1.smithi099.stdout:7/8: write - no filename 2024-09-17T01:01:30.522 INFO:tasks.workunit.client.1.smithi099.stdout:7/9: unlink - no file 2024-09-17T01:01:30.522 INFO:tasks.workunit.client.1.smithi099.stdout:7/10: truncate - no filename 2024-09-17T01:01:30.522 INFO:tasks.workunit.client.1.smithi099.stdout:7/11: unlink - no file 2024-09-17T01:01:30.522 INFO:tasks.workunit.client.1.smithi099.stdout:7/12: write - no filename 2024-09-17T01:01:30.522 INFO:tasks.workunit.client.1.smithi099.stdout:7/13: fsync - no filename 2024-09-17T01:01:30.522 INFO:tasks.workunit.client.1.smithi099.stdout:7/14: truncate - no filename 2024-09-17T01:01:30.522 INFO:tasks.workunit.client.1.smithi099.stdout:7/15: getdents . 0 2024-09-17T01:01:30.523 INFO:tasks.workunit.client.1.smithi099.stdout:7/16: chown . 31 1 2024-09-17T01:01:30.523 INFO:tasks.workunit.client.1.smithi099.stdout:7/17: write - no filename 2024-09-17T01:01:30.523 INFO:tasks.workunit.client.1.smithi099.stdout:6/0: creat f0 x:0 0 0 2024-09-17T01:01:30.524 INFO:tasks.workunit.client.1.smithi099.stdout:2/1: dwrite f0 [0,4194304] 0 2024-09-17T01:01:30.524 INFO:tasks.workunit.client.1.smithi099.stdout:2/2: fdatasync f0 0 2024-09-17T01:01:30.525 INFO:tasks.workunit.client.1.smithi099.stdout:0/13: unlink l2 0 2024-09-17T01:01:30.529 INFO:tasks.workunit.client.1.smithi099.stdout:8/0: dwrite - no filename 2024-09-17T01:01:30.529 INFO:tasks.workunit.client.1.smithi099.stdout:8/1: chown . 181137963 1 2024-09-17T01:01:30.529 INFO:tasks.workunit.client.1.smithi099.stdout:8/2: dread - no filename 2024-09-17T01:01:30.529 INFO:tasks.workunit.client.1.smithi099.stdout:8/3: rmdir - no directory 2024-09-17T01:01:30.529 INFO:tasks.workunit.client.1.smithi099.stdout:8/4: truncate - no filename 2024-09-17T01:01:30.529 INFO:tasks.workunit.client.1.smithi099.stdout:8/5: write - no filename 2024-09-17T01:01:30.529 INFO:tasks.workunit.client.1.smithi099.stdout:8/6: unlink - no file 2024-09-17T01:01:30.529 INFO:tasks.workunit.client.1.smithi099.stdout:8/7: fsync - no filename 2024-09-17T01:01:30.530 INFO:tasks.workunit.client.1.smithi099.stdout:7/18: mknod c0 0 2024-09-17T01:01:30.530 INFO:tasks.workunit.client.1.smithi099.stdout:7/19: chown c0 5124 1 2024-09-17T01:01:30.532 INFO:tasks.workunit.client.1.smithi099.stdout:6/1: rename f0 to f1 0 2024-09-17T01:01:30.532 INFO:tasks.workunit.client.1.smithi099.stdout:6/2: dread - f1 zero size 2024-09-17T01:01:30.538 INFO:tasks.workunit.client.1.smithi099.stdout:0/14: symlink l6 0 2024-09-17T01:01:30.538 INFO:tasks.workunit.client.1.smithi099.stdout:0/15: truncate f5 262279 0 2024-09-17T01:01:30.543 INFO:tasks.workunit.client.1.smithi099.stdout:9/0: rename - no filename 2024-09-17T01:01:30.545 INFO:tasks.workunit.client.1.smithi099.stdout:7/20: mkdir d1 0 2024-09-17T01:01:30.548 INFO:tasks.workunit.client.1.smithi099.stdout:9/1: creat f0 x:0 0 0 2024-09-17T01:01:30.548 INFO:tasks.workunit.client.1.smithi099.stdout:9/2: chown f0 82178 1 2024-09-17T01:01:30.552 INFO:tasks.workunit.client.1.smithi099.stdout:7/21: creat d1/f2 x:0 0 0 2024-09-17T01:01:30.553 INFO:tasks.workunit.client.1.smithi099.stdout:9/3: mknod c1 0 2024-09-17T01:01:30.553 INFO:tasks.workunit.client.1.smithi099.stdout:9/4: write f0 [39816,12290] 0 2024-09-17T01:01:30.553 INFO:tasks.workunit.client.1.smithi099.stdout:9/5: readlink - no filename 2024-09-17T01:01:30.997 INFO:tasks.workunit.client.1.smithi099.stdout:5/2: dwrite f1 [0,4194304] 0 2024-09-17T01:01:30.997 INFO:tasks.workunit.client.1.smithi099.stdout:5/3: chown f1 511999599 1 2024-09-17T01:01:31.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:30 smithi099 ceph-mon[34357]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:31.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:30 smithi099 ceph-mon[34357]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:31.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:30 smithi002 ceph-mon[27650]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:31.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:30 smithi002 ceph-mon[27650]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:01:31.705 INFO:tasks.workunit.client.1.smithi099.stdout:0/16: dread f3 [0,4194304] 0 2024-09-17T01:01:31.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:31 smithi099 ceph-mon[34357]: pgmap v239: 65 pgs: 65 active+clean; 106 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 5.0 MiB/s wr, 206 op/s 2024-09-17T01:01:31.946 INFO:tasks.workunit.client.1.smithi099.stdout:3/7: dwrite f1 [0,4194304] 0 2024-09-17T01:01:32.013 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:31 smithi002 ceph-mon[27650]: pgmap v239: 65 pgs: 65 active+clean; 106 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 5.0 MiB/s wr, 206 op/s 2024-09-17T01:01:32.230 INFO:tasks.workunit.client.1.smithi099.stdout:6/3: rename f1 to f2 0 2024-09-17T01:01:32.230 INFO:tasks.workunit.client.1.smithi099.stdout:6/4: stat f2 0 2024-09-17T01:01:32.230 INFO:tasks.workunit.client.1.smithi099.stdout:6/5: dread - f2 zero size 2024-09-17T01:01:32.237 INFO:tasks.workunit.client.1.smithi099.stdout:9/6: getdents . 0 2024-09-17T01:01:32.237 INFO:tasks.workunit.client.1.smithi099.stdout:9/7: chown f0 45944 1 2024-09-17T01:01:32.253 INFO:tasks.workunit.client.1.smithi099.stdout:2/3: dwrite f0 [4194304,4194304] 0 2024-09-17T01:01:32.255 INFO:tasks.workunit.client.1.smithi099.stdout:6/6: dwrite f2 [0,4194304] 0 2024-09-17T01:01:34.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:33 smithi099 ceph-mon[34357]: pgmap v240: 65 pgs: 65 active+clean; 128 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 349 op/s 2024-09-17T01:01:34.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:33 smithi002 ceph-mon[27650]: pgmap v240: 65 pgs: 65 active+clean; 128 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 349 op/s 2024-09-17T01:01:35.838 INFO:tasks.workunit.client.1.smithi099.stdout:9/8: mknod c2 0 2024-09-17T01:01:35.840 INFO:tasks.workunit.client.1.smithi099.stdout:2/4: symlink l1 0 2024-09-17T01:01:35.842 INFO:tasks.workunit.client.1.smithi099.stdout:6/7: symlink l3 0 2024-09-17T01:01:35.843 INFO:tasks.workunit.client.1.smithi099.stdout:5/4: getdents . 0 2024-09-17T01:01:35.845 INFO:tasks.workunit.client.1.smithi099.stdout:3/8: rename f1 to f3 0 2024-09-17T01:01:35.846 INFO:tasks.workunit.client.1.smithi099.stdout:2/5: mkdir d2 0 2024-09-17T01:01:35.847 INFO:tasks.workunit.client.1.smithi099.stdout:6/8: symlink l4 0 2024-09-17T01:01:35.848 INFO:tasks.workunit.client.1.smithi099.stdout:5/5: mkdir d2 0 2024-09-17T01:01:35.849 INFO:tasks.workunit.client.1.smithi099.stdout:2/6: creat d2/f3 x:0 0 0 2024-09-17T01:01:35.849 INFO:tasks.workunit.client.1.smithi099.stdout:2/7: dread - d2/f3 zero size 2024-09-17T01:01:35.849 INFO:tasks.workunit.client.1.smithi099.stdout:2/8: creat d2/f4 x:0 0 0 2024-09-17T01:01:35.850 INFO:tasks.workunit.client.1.smithi099.stdout:6/9: symlink l5 0 2024-09-17T01:01:35.851 INFO:tasks.workunit.client.1.smithi099.stdout:5/6: creat d2/f3 x:0 0 0 2024-09-17T01:01:35.852 INFO:tasks.workunit.client.1.smithi099.stdout:5/7: fdatasync d2/f3 0 2024-09-17T01:01:35.852 INFO:tasks.workunit.client.1.smithi099.stdout:5/8: read - d2/f3 zero size 2024-09-17T01:01:35.852 INFO:tasks.workunit.client.1.smithi099.stdout:5/9: rename d2 to d2/d4 22 2024-09-17T01:01:35.854 INFO:tasks.workunit.client.1.smithi099.stdout:6/10: symlink l6 0 2024-09-17T01:01:35.857 INFO:tasks.workunit.client.1.smithi099.stdout:5/10: rename f1 to d2/f5 0 2024-09-17T01:01:35.857 INFO:tasks.workunit.client.1.smithi099.stdout:5/11: write d2/f3 [407479,48965] 0 2024-09-17T01:01:35.857 INFO:tasks.workunit.client.1.smithi099.stdout:5/12: creat d2/f6 x:0 0 0 2024-09-17T01:01:35.860 INFO:tasks.workunit.client.1.smithi099.stdout:5/13: rename d2/f6 to d2/f7 0 2024-09-17T01:01:35.870 INFO:tasks.workunit.client.1.smithi099.stdout:6/11: read f2 [1873860,125863] 0 2024-09-17T01:01:35.881 INFO:tasks.workunit.client.1.smithi099.stdout:2/9: dwrite d2/f3 [0,4194304] 0 2024-09-17T01:01:35.886 INFO:tasks.workunit.client.1.smithi099.stdout:3/9: dwrite f3 [0,4194304] 0 2024-09-17T01:01:35.897 INFO:tasks.workunit.client.1.smithi099.stdout:2/10: dwrite f0 [0,4194304] 0 2024-09-17T01:01:36.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:35 smithi099 ceph-mon[34357]: pgmap v241: 65 pgs: 65 active+clean; 148 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 7.2 MiB/s wr, 432 op/s 2024-09-17T01:01:36.116 INFO:tasks.workunit.client.1.smithi099.stdout:3/10: write f3 [4824928,13914] 0 2024-09-17T01:01:36.116 INFO:tasks.workunit.client.1.smithi099.stdout:3/11: dread - f2 zero size 2024-09-17T01:01:36.126 INFO:tasks.workunit.client.1.smithi099.stdout:3/12: dread f3 [0,4194304] 0 2024-09-17T01:01:36.127 INFO:tasks.workunit.client.1.smithi099.stdout:3/13: symlink l4 0 2024-09-17T01:01:36.128 INFO:tasks.workunit.client.1.smithi099.stdout:3/14: rename l4 to l5 0 2024-09-17T01:01:36.128 INFO:tasks.workunit.client.1.smithi099.stdout:3/15: chown f3 127 1 2024-09-17T01:01:36.128 INFO:tasks.workunit.client.1.smithi099.stdout:3/16: stat f3 0 2024-09-17T01:01:36.129 INFO:tasks.workunit.client.1.smithi099.stdout:3/17: creat f6 x:0 0 0 2024-09-17T01:01:36.129 INFO:tasks.workunit.client.1.smithi099.stdout:3/18: fdatasync f2 0 2024-09-17T01:01:36.142 INFO:tasks.workunit.client.1.smithi099.stdout:3/19: dwrite f2 [0,4194304] 0 2024-09-17T01:01:36.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:35 smithi002 ceph-mon[27650]: pgmap v241: 65 pgs: 65 active+clean; 148 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 7.2 MiB/s wr, 432 op/s 2024-09-17T01:01:36.189 INFO:tasks.workunit.client.1.smithi099.stdout:9/9: getdents . 0 2024-09-17T01:01:36.189 INFO:tasks.workunit.client.1.smithi099.stdout:9/10: truncate f0 102922 0 2024-09-17T01:01:36.191 INFO:tasks.workunit.client.1.smithi099.stdout:9/11: symlink l3 0 2024-09-17T01:01:36.193 INFO:tasks.workunit.client.1.smithi099.stdout:6/12: truncate f2 677835 0 2024-09-17T01:01:36.203 INFO:tasks.workunit.client.1.smithi099.stdout:5/14: rmdir d2 39 2024-09-17T01:01:36.205 INFO:tasks.workunit.client.1.smithi099.stdout:5/15: mkdir d2/d8 0 2024-09-17T01:01:36.206 INFO:tasks.workunit.client.1.smithi099.stdout:2/11: truncate f0 7773554 0 2024-09-17T01:01:36.207 INFO:tasks.workunit.client.1.smithi099.stdout:5/16: truncate f0 999462 0 2024-09-17T01:01:36.212 INFO:tasks.workunit.client.1.smithi099.stdout:2/12: write d2/f3 [1982073,89793] 0 2024-09-17T01:01:36.218 INFO:tasks.workunit.client.1.smithi099.stdout:2/13: rename l1 to d2/l5 0 2024-09-17T01:01:36.218 INFO:tasks.workunit.client.1.smithi099.stdout:2/14: fdatasync f0 0 2024-09-17T01:01:36.222 INFO:tasks.workunit.client.1.smithi099.stdout:2/15: mkdir d2/d6 0 2024-09-17T01:01:36.225 INFO:tasks.workunit.client.1.smithi099.stdout:5/17: dwrite d2/f5 [0,4194304] 0 2024-09-17T01:01:36.226 INFO:tasks.workunit.client.1.smithi099.stdout:5/18: truncate d2/f3 878247 0 2024-09-17T01:01:36.226 INFO:tasks.workunit.client.1.smithi099.stdout:5/19: chown d2/f7 9 1 2024-09-17T01:01:36.226 INFO:tasks.workunit.client.1.smithi099.stdout:5/20: chown d2/d8 12250 1 2024-09-17T01:01:36.226 INFO:tasks.workunit.client.1.smithi099.stdout:5/21: getdents d2/d8 0 2024-09-17T01:01:36.226 INFO:tasks.workunit.client.1.smithi099.stdout:3/20: rename l5 to l7 0 2024-09-17T01:01:36.228 INFO:tasks.workunit.client.1.smithi099.stdout:5/22: creat d2/f9 x:0 0 0 2024-09-17T01:01:36.228 INFO:tasks.workunit.client.1.smithi099.stdout:5/23: creat d2/fa x:0 0 0 2024-09-17T01:01:36.228 INFO:tasks.workunit.client.1.smithi099.stdout:5/24: dread - d2/fa zero size 2024-09-17T01:01:36.228 INFO:tasks.workunit.client.1.smithi099.stdout:5/25: write d2/fa [272340,91010] 0 2024-09-17T01:01:36.229 INFO:tasks.workunit.client.1.smithi099.stdout:5/26: dread f0 [0,4194304] 0 2024-09-17T01:01:36.232 INFO:tasks.workunit.client.1.smithi099.stdout:5/27: creat d2/d8/fb x:0 0 0 2024-09-17T01:01:36.233 INFO:tasks.workunit.client.1.smithi099.stdout:3/21: write f2 [981777,118615] 0 2024-09-17T01:01:36.235 INFO:tasks.workunit.client.1.smithi099.stdout:5/28: mkdir d2/dc 0 2024-09-17T01:01:36.238 INFO:tasks.workunit.client.1.smithi099.stdout:6/13: rename f2 to f7 0 2024-09-17T01:01:36.238 INFO:tasks.workunit.client.1.smithi099.stdout:6/14: write f7 [821802,128721] 0 2024-09-17T01:01:36.238 INFO:tasks.workunit.client.1.smithi099.stdout:6/15: readlink l4 0 2024-09-17T01:01:36.241 INFO:tasks.workunit.client.1.smithi099.stdout:5/29: mknod d2/d8/cd 0 2024-09-17T01:01:36.241 INFO:tasks.workunit.client.1.smithi099.stdout:5/30: chown d2/f7 245626 1 2024-09-17T01:01:36.241 INFO:tasks.workunit.client.1.smithi099.stdout:6/16: mknod c8 0 2024-09-17T01:01:36.242 INFO:tasks.workunit.client.1.smithi099.stdout:6/17: truncate f7 1183332 0 2024-09-17T01:01:36.243 INFO:tasks.workunit.client.1.smithi099.stdout:5/31: dread d2/f3 [0,4194304] 0 2024-09-17T01:01:36.245 INFO:tasks.workunit.client.1.smithi099.stdout:5/32: symlink d2/d8/le 0 2024-09-17T01:01:36.332 INFO:tasks.workunit.client.1.smithi099.stdout:3/22: dwrite f6 [0,4194304] 0 2024-09-17T01:01:36.336 INFO:tasks.workunit.client.1.smithi099.stdout:2/16: write f0 [1897778,61199] 0 2024-09-17T01:01:36.337 INFO:tasks.workunit.client.1.smithi099.stdout:5/33: dread d2/fa [0,4194304] 0 2024-09-17T01:01:36.339 INFO:tasks.workunit.client.1.smithi099.stdout:3/23: link f6 f8 0 2024-09-17T01:01:36.345 INFO:tasks.workunit.client.1.smithi099.stdout:2/17: rmdir d2/d6 0 2024-09-17T01:01:36.345 INFO:tasks.workunit.client.1.smithi099.stdout:2/18: chown f0 48961 1 2024-09-17T01:01:36.345 INFO:tasks.workunit.client.1.smithi099.stdout:2/19: write d2/f3 [5212986,16936] 0 2024-09-17T01:01:36.345 INFO:tasks.workunit.client.1.smithi099.stdout:2/20: write d2/f4 [449510,68970] 0 2024-09-17T01:01:36.345 INFO:tasks.workunit.client.1.smithi099.stdout:2/21: chown d2 5270569 1 2024-09-17T01:01:36.345 INFO:tasks.workunit.client.1.smithi099.stdout:2/22: fsync f0 0 2024-09-17T01:01:36.345 INFO:tasks.workunit.client.1.smithi099.stdout:5/34: rename d2/f9 to d2/dc/ff 0 2024-09-17T01:01:36.346 INFO:tasks.workunit.client.1.smithi099.stdout:3/24: mkdir d9 0 2024-09-17T01:01:36.346 INFO:tasks.workunit.client.1.smithi099.stdout:3/25: write f3 [5775909,12414] 0 2024-09-17T01:01:36.346 INFO:tasks.workunit.client.1.smithi099.stdout:3/26: stat f3 0 2024-09-17T01:01:36.347 INFO:tasks.workunit.client.1.smithi099.stdout:3/27: chown f2 420516 1 2024-09-17T01:01:36.347 INFO:tasks.workunit.client.1.smithi099.stdout:3/28: chown f2 0 1 2024-09-17T01:01:36.350 INFO:tasks.workunit.client.1.smithi099.stdout:2/23: mkdir d2/d7 0 2024-09-17T01:01:36.351 INFO:tasks.workunit.client.1.smithi099.stdout:5/35: unlink d2/d8/cd 0 2024-09-17T01:01:36.351 INFO:tasks.workunit.client.1.smithi099.stdout:5/36: creat d2/d8/f10 x:0 0 0 2024-09-17T01:01:36.355 INFO:tasks.workunit.client.1.smithi099.stdout:3/29: mknod d9/ca 0 2024-09-17T01:01:36.356 INFO:tasks.workunit.client.1.smithi099.stdout:2/24: mkdir d2/d8 0 2024-09-17T01:01:36.359 INFO:tasks.workunit.client.1.smithi099.stdout:5/37: write d2/f5 [452732,5851] 0 2024-09-17T01:01:36.359 INFO:tasks.workunit.client.1.smithi099.stdout:5/38: write d2/f5 [1869180,28621] 0 2024-09-17T01:01:36.361 INFO:tasks.workunit.client.1.smithi099.stdout:3/30: write f8 [3083208,54553] 0 2024-09-17T01:01:36.362 INFO:tasks.workunit.client.1.smithi099.stdout:3/31: truncate f3 5797488 0 2024-09-17T01:01:36.364 INFO:tasks.workunit.client.1.smithi099.stdout:5/39: rename d2/d8/le to d2/dc/l11 0 2024-09-17T01:01:36.365 INFO:tasks.workunit.client.1.smithi099.stdout:2/25: dread f0 [4194304,4194304] 0 2024-09-17T01:01:36.368 INFO:tasks.workunit.client.1.smithi099.stdout:2/26: mkdir d2/d9 0 2024-09-17T01:01:36.372 INFO:tasks.workunit.client.1.smithi099.stdout:2/27: rename d2/l5 to d2/d7/la 0 2024-09-17T01:01:36.372 INFO:tasks.workunit.client.1.smithi099.stdout:2/28: truncate d2/f4 815106 0 2024-09-17T01:01:36.372 INFO:tasks.workunit.client.1.smithi099.stdout:2/29: write d2/f4 [1600106,35130] 0 2024-09-17T01:01:36.372 INFO:tasks.workunit.client.1.smithi099.stdout:2/30: write d2/f4 [1730868,8481] 0 2024-09-17T01:01:36.372 INFO:tasks.workunit.client.1.smithi099.stdout:2/31: chown d2/f3 833782 1 2024-09-17T01:01:36.375 INFO:tasks.workunit.client.1.smithi099.stdout:2/32: mknod d2/cb 0 2024-09-17T01:01:36.375 INFO:tasks.workunit.client.1.smithi099.stdout:2/33: chown d2/f4 32161094 1 2024-09-17T01:01:36.379 INFO:tasks.workunit.client.1.smithi099.stdout:2/34: mknod d2/d8/cc 0 2024-09-17T01:01:36.385 INFO:tasks.workunit.client.1.smithi099.stdout:5/40: dwrite d2/d8/f10 [0,4194304] 0 2024-09-17T01:01:36.385 INFO:tasks.workunit.client.1.smithi099.stdout:3/32: dwrite f8 [0,4194304] 0 2024-09-17T01:01:36.407 INFO:tasks.workunit.client.1.smithi099.stdout:2/35: dwrite d2/f3 [0,4194304] 0 2024-09-17T01:01:36.407 INFO:tasks.workunit.client.1.smithi099.stdout:3/33: dwrite f2 [0,4194304] 0 2024-09-17T01:01:36.416 INFO:tasks.workunit.client.1.smithi099.stdout:3/34: write f6 [1953015,47519] 0 2024-09-17T01:01:36.416 INFO:tasks.workunit.client.1.smithi099.stdout:3/35: chown c0 34461503 1 2024-09-17T01:01:36.418 INFO:tasks.workunit.client.1.smithi099.stdout:2/36: dwrite d2/f3 [0,4194304] 0 2024-09-17T01:01:36.422 INFO:tasks.workunit.client.1.smithi099.stdout:2/37: link d2/cb d2/d8/cd 0 2024-09-17T01:01:36.425 INFO:tasks.workunit.client.1.smithi099.stdout:2/38: creat d2/d7/fe x:0 0 0 2024-09-17T01:01:36.431 INFO:tasks.workunit.client.1.smithi099.stdout:3/36: dwrite f6 [0,4194304] 0 2024-09-17T01:01:36.438 INFO:tasks.workunit.client.1.smithi099.stdout:3/37: write f2 [1460266,46083] 0 2024-09-17T01:01:36.442 INFO:tasks.workunit.client.1.smithi099.stdout:3/38: dread f3 [4194304,4194304] 0 2024-09-17T01:01:36.444 INFO:tasks.workunit.client.1.smithi099.stdout:3/39: mknod d9/cb 0 2024-09-17T01:01:36.446 INFO:tasks.workunit.client.1.smithi099.stdout:3/40: mkdir d9/dc 0 2024-09-17T01:01:36.448 INFO:tasks.workunit.client.1.smithi099.stdout:3/41: creat d9/dc/fd x:0 0 0 2024-09-17T01:01:36.515 INFO:tasks.workunit.client.1.smithi099.stdout:5/41: getdents d2/dc 0 2024-09-17T01:01:36.518 INFO:tasks.workunit.client.1.smithi099.stdout:5/42: symlink d2/dc/l12 0 2024-09-17T01:01:36.518 INFO:tasks.workunit.client.1.smithi099.stdout:5/43: chown d2 230532306 1 2024-09-17T01:01:36.519 INFO:tasks.workunit.client.1.smithi099.stdout:5/44: dread f0 [0,4194304] 0 2024-09-17T01:01:36.519 INFO:tasks.workunit.client.1.smithi099.stdout:5/45: readlink d2/dc/l12 0 2024-09-17T01:01:36.524 INFO:tasks.workunit.client.1.smithi099.stdout:5/46: mknod d2/d8/c13 0 2024-09-17T01:01:36.529 INFO:tasks.workunit.client.1.smithi099.stdout:5/47: mkdir d2/dc/d14 0 2024-09-17T01:01:36.536 INFO:tasks.workunit.client.1.smithi099.stdout:5/48: write d2/d8/f10 [1172031,55112] 0 2024-09-17T01:01:36.541 INFO:tasks.workunit.client.1.smithi099.stdout:5/49: dread d2/d8/f10 [0,4194304] 0 2024-09-17T01:01:36.543 INFO:tasks.workunit.client.1.smithi099.stdout:5/50: dread d2/f3 [0,4194304] 0 2024-09-17T01:01:36.543 INFO:tasks.workunit.client.1.smithi099.stdout:5/51: write d2/f5 [2401145,107962] 0 2024-09-17T01:01:36.543 INFO:tasks.workunit.client.1.smithi099.stdout:5/52: fsync d2/f3 0 2024-09-17T01:01:36.559 INFO:tasks.workunit.client.1.smithi099.stdout:5/53: dwrite d2/dc/ff [0,4194304] 0 2024-09-17T01:01:36.560 INFO:tasks.workunit.client.1.smithi099.stdout:5/54: write d2/f7 [737177,129200] 0 2024-09-17T01:01:36.560 INFO:tasks.workunit.client.1.smithi099.stdout:5/55: creat d2/d8/f15 x:0 0 0 2024-09-17T01:01:36.560 INFO:tasks.workunit.client.1.smithi099.stdout:5/56: fdatasync d2/d8/fb 0 2024-09-17T01:01:36.575 INFO:tasks.workunit.client.1.smithi099.stdout:2/39: rmdir d2 39 2024-09-17T01:01:36.579 INFO:tasks.workunit.client.1.smithi099.stdout:5/57: dwrite d2/f5 [0,4194304] 0 2024-09-17T01:01:36.594 INFO:tasks.workunit.client.1.smithi099.stdout:5/58: dwrite f0 [0,4194304] 0 2024-09-17T01:01:36.610 INFO:tasks.workunit.client.1.smithi099.stdout:5/59: dwrite d2/d8/fb [0,4194304] 0 2024-09-17T01:01:36.610 INFO:tasks.workunit.client.1.smithi099.stdout:5/60: fdatasync d2/f3 0 2024-09-17T01:01:36.610 INFO:tasks.workunit.client.1.smithi099.stdout:5/61: chown d2/d8/f10 272151742 1 2024-09-17T01:01:36.614 INFO:tasks.workunit.client.1.smithi099.stdout:5/62: creat d2/dc/d14/f16 x:0 0 0 2024-09-17T01:01:36.618 INFO:tasks.workunit.client.1.smithi099.stdout:5/63: mkdir d2/dc/d17 0 2024-09-17T01:01:36.624 INFO:tasks.workunit.client.1.smithi099.stdout:5/64: dread d2/d8/fb [0,4194304] 0 2024-09-17T01:01:36.759 INFO:tasks.workunit.client.1.smithi099.stdout:5/65: dwrite d2/d8/fb [4194304,4194304] 0 2024-09-17T01:01:36.759 INFO:tasks.workunit.client.1.smithi099.stdout:5/66: chown d2 56 1 2024-09-17T01:01:36.759 INFO:tasks.workunit.client.1.smithi099.stdout:5/67: dread - d2/dc/d14/f16 zero size 2024-09-17T01:01:36.767 INFO:tasks.workunit.client.1.smithi099.stdout:5/68: dread d2/d8/fb [4194304,4194304] 0 2024-09-17T01:01:36.768 INFO:tasks.workunit.client.1.smithi099.stdout:5/69: write d2/d8/f15 [435751,27891] 0 2024-09-17T01:01:36.775 INFO:tasks.workunit.client.1.smithi099.stdout:5/70: write d2/dc/ff [3335378,86895] 0 2024-09-17T01:01:36.779 INFO:tasks.workunit.client.1.smithi099.stdout:5/71: link d2/fa d2/f18 0 2024-09-17T01:01:36.784 INFO:tasks.workunit.client.1.smithi099.stdout:5/72: mkdir d2/dc/d14/d19 0 2024-09-17T01:01:36.784 INFO:tasks.workunit.client.1.smithi099.stdout:5/73: chown d2 24612 1 2024-09-17T01:01:36.784 INFO:tasks.workunit.client.1.smithi099.stdout:5/74: chown d2/dc/d17 1 1 2024-09-17T01:01:36.785 INFO:tasks.workunit.client.1.smithi099.stdout:5/75: fsync d2/f7 0 2024-09-17T01:01:36.790 INFO:tasks.workunit.client.1.smithi099.stdout:5/76: symlink d2/d8/l1a 0 2024-09-17T01:01:36.792 INFO:tasks.workunit.client.1.smithi099.stdout:5/77: read d2/f7 [349621,126851] 0 2024-09-17T01:01:36.792 INFO:tasks.workunit.client.1.smithi099.stdout:5/78: creat d2/f1b x:0 0 0 2024-09-17T01:01:36.792 INFO:tasks.workunit.client.1.smithi099.stdout:5/79: truncate d2/f18 1269053 0 2024-09-17T01:01:36.792 INFO:tasks.workunit.client.1.smithi099.stdout:5/80: write d2/f1b [518562,110050] 0 2024-09-17T01:01:37.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:36 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:37.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:36 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:38.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:37 smithi099 ceph-mon[34357]: pgmap v242: 65 pgs: 65 active+clean; 200 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 829 op/s 2024-09-17T01:01:38.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:37 smithi002 ceph-mon[27650]: pgmap v242: 65 pgs: 65 active+clean; 200 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 829 op/s 2024-09-17T01:01:40.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:39 smithi099 ceph-mon[34357]: pgmap v243: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 4.4 MiB/s rd, 13 MiB/s wr, 875 op/s 2024-09-17T01:01:40.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:39 smithi002 ceph-mon[27650]: pgmap v243: 65 pgs: 65 active+clean; 213 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 4.4 MiB/s rd, 13 MiB/s wr, 875 op/s 2024-09-17T01:01:42.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:41 smithi099 ceph-mon[34357]: pgmap v244: 65 pgs: 65 active+clean; 242 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.4 MiB/s rd, 16 MiB/s wr, 1.04k op/s 2024-09-17T01:01:42.134 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:41 smithi002 ceph-mon[27650]: pgmap v244: 65 pgs: 65 active+clean; 242 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.4 MiB/s rd, 16 MiB/s wr, 1.04k op/s 2024-09-17T01:01:44.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:43 smithi099 ceph-mon[34357]: pgmap v245: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 8.3 MiB/s rd, 16 MiB/s wr, 1.04k op/s 2024-09-17T01:01:44.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:43 smithi002 ceph-mon[27650]: pgmap v245: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 8.3 MiB/s rd, 16 MiB/s wr, 1.04k op/s 2024-09-17T01:01:44.408 INFO:tasks.workunit.client.0.smithi002.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-17T01:01:44.408 INFO:tasks.workunit.client.0.smithi002.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:01:44.409 INFO:tasks.workunit.client.0.smithi002.stderr:+ make 2024-09-17T01:01:44.470 INFO:tasks.workunit.client.0.smithi002.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-17T01:01:44.737 INFO:tasks.workunit.client.0.smithi002.stderr:++ readlink -f fsstress 2024-09-17T01:01:44.738 INFO:tasks.workunit.client.0.smithi002.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-17T01:01:44.738 INFO:tasks.workunit.client.0.smithi002.stderr:+ popd 2024-09-17T01:01:44.738 INFO:tasks.workunit.client.0.smithi002.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:01:44.739 INFO:tasks.workunit.client.0.smithi002.stderr:+ popd 2024-09-17T01:01:44.739 INFO:tasks.workunit.client.0.smithi002.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:01:44.739 INFO:tasks.workunit.client.0.smithi002.stderr:++ mktemp -d -p . 2024-09-17T01:01:44.740 INFO:tasks.workunit.client.0.smithi002.stderr:+ T=./tmp.mACipHsvjA 2024-09-17T01:01:44.740 INFO:tasks.workunit.client.0.smithi002.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.mACipHsvjA -l 1 -n 1000 -p 10 -v 2024-09-17T01:01:44.742 INFO:tasks.workunit.client.0.smithi002.stdout:seed = 1726199197 2024-09-17T01:01:44.745 INFO:tasks.workunit.client.0.smithi002.stdout:0/0: write - no filename 2024-09-17T01:01:44.745 INFO:tasks.workunit.client.0.smithi002.stdout:0/1: write - no filename 2024-09-17T01:01:44.746 INFO:tasks.workunit.client.0.smithi002.stdout:1/0: getdents . 0 2024-09-17T01:01:44.746 INFO:tasks.workunit.client.0.smithi002.stdout:1/1: getdents . 0 2024-09-17T01:01:44.747 INFO:tasks.workunit.client.0.smithi002.stdout:0/2: symlink l0 0 2024-09-17T01:01:44.747 INFO:tasks.workunit.client.0.smithi002.stdout:0/3: write - no filename 2024-09-17T01:01:44.747 INFO:tasks.workunit.client.0.smithi002.stdout:0/4: write - no filename 2024-09-17T01:01:44.748 INFO:tasks.workunit.client.0.smithi002.stdout:2/0: truncate - no filename 2024-09-17T01:01:44.748 INFO:tasks.workunit.client.0.smithi002.stdout:2/1: write - no filename 2024-09-17T01:01:44.748 INFO:tasks.workunit.client.0.smithi002.stdout:2/2: fsync - no filename 2024-09-17T01:01:44.749 INFO:tasks.workunit.client.0.smithi002.stdout:2/3: rename - no filename 2024-09-17T01:01:44.749 INFO:tasks.workunit.client.0.smithi002.stdout:2/4: chown . 12189990 1 2024-09-17T01:01:44.749 INFO:tasks.workunit.client.0.smithi002.stdout:2/5: rename - no filename 2024-09-17T01:01:44.749 INFO:tasks.workunit.client.0.smithi002.stdout:2/6: rename - no filename 2024-09-17T01:01:44.749 INFO:tasks.workunit.client.0.smithi002.stdout:2/7: stat - no entries 2024-09-17T01:01:44.749 INFO:tasks.workunit.client.0.smithi002.stdout:2/8: dread - no filename 2024-09-17T01:01:44.749 INFO:tasks.workunit.client.0.smithi002.stdout:2/9: truncate - no filename 2024-09-17T01:01:44.749 INFO:tasks.workunit.client.0.smithi002.stdout:2/10: write - no filename 2024-09-17T01:01:44.749 INFO:tasks.workunit.client.0.smithi002.stdout:2/11: write - no filename 2024-09-17T01:01:44.749 INFO:tasks.workunit.client.0.smithi002.stdout:1/2: creat f0 x:0 0 0 2024-09-17T01:01:44.750 INFO:tasks.workunit.client.0.smithi002.stdout:0/5: creat f1 x:0 0 0 2024-09-17T01:01:44.752 INFO:tasks.workunit.client.0.smithi002.stdout:2/12: symlink l0 0 2024-09-17T01:01:44.753 INFO:tasks.workunit.client.0.smithi002.stdout:1/3: rename f0 to f1 0 2024-09-17T01:01:44.753 INFO:tasks.workunit.client.0.smithi002.stdout:1/4: fdatasync f1 0 2024-09-17T01:01:44.754 INFO:tasks.workunit.client.0.smithi002.stdout:4/0: chown . 89 1 2024-09-17T01:01:44.754 INFO:tasks.workunit.client.0.smithi002.stdout:4/1: readlink - no filename 2024-09-17T01:01:44.754 INFO:tasks.workunit.client.0.smithi002.stdout:4/2: write - no filename 2024-09-17T01:01:44.755 INFO:tasks.workunit.client.0.smithi002.stdout:3/0: mkdir d0 0 2024-09-17T01:01:44.755 INFO:tasks.workunit.client.0.smithi002.stdout:3/1: dread - no filename 2024-09-17T01:01:44.755 INFO:tasks.workunit.client.0.smithi002.stdout:3/2: dread - no filename 2024-09-17T01:01:44.755 INFO:tasks.workunit.client.0.smithi002.stdout:3/3: read - no filename 2024-09-17T01:01:44.755 INFO:tasks.workunit.client.0.smithi002.stdout:3/4: dwrite - no filename 2024-09-17T01:01:44.755 INFO:tasks.workunit.client.0.smithi002.stdout:3/5: write - no filename 2024-09-17T01:01:44.755 INFO:tasks.workunit.client.0.smithi002.stdout:3/6: rename d0 to d0/d1 22 2024-09-17T01:01:44.755 INFO:tasks.workunit.client.0.smithi002.stdout:3/7: truncate - no filename 2024-09-17T01:01:44.756 INFO:tasks.workunit.client.0.smithi002.stdout:3/8: unlink - no file 2024-09-17T01:01:44.756 INFO:tasks.workunit.client.0.smithi002.stdout:3/9: link - no file 2024-09-17T01:01:44.756 INFO:tasks.workunit.client.0.smithi002.stdout:2/13: creat f1 x:0 0 0 2024-09-17T01:01:44.757 INFO:tasks.workunit.client.0.smithi002.stdout:1/5: mknod c2 0 2024-09-17T01:01:44.757 INFO:tasks.workunit.client.0.smithi002.stdout:1/6: read - f1 zero size 2024-09-17T01:01:44.758 INFO:tasks.workunit.client.0.smithi002.stdout:1/7: truncate f1 535776 0 2024-09-17T01:01:44.758 INFO:tasks.workunit.client.0.smithi002.stdout:1/8: truncate f1 1278097 0 2024-09-17T01:01:44.758 INFO:tasks.workunit.client.0.smithi002.stdout:1/9: dread f1 [0,4194304] 0 2024-09-17T01:01:44.760 INFO:tasks.workunit.client.0.smithi002.stdout:4/3: creat f0 x:0 0 0 2024-09-17T01:01:44.761 INFO:tasks.workunit.client.0.smithi002.stdout:3/10: mknod d0/c2 0 2024-09-17T01:01:44.763 INFO:tasks.workunit.client.0.smithi002.stdout:2/14: unlink f1 0 2024-09-17T01:01:44.763 INFO:tasks.workunit.client.0.smithi002.stdout:2/15: read - no filename 2024-09-17T01:01:44.763 INFO:tasks.workunit.client.0.smithi002.stdout:2/16: dread - no filename 2024-09-17T01:01:44.763 INFO:tasks.workunit.client.0.smithi002.stdout:2/17: chown l0 8767 1 2024-09-17T01:01:44.763 INFO:tasks.workunit.client.0.smithi002.stdout:2/18: rmdir - no directory 2024-09-17T01:01:44.763 INFO:tasks.workunit.client.0.smithi002.stdout:2/19: chown l0 35 1 2024-09-17T01:01:44.767 INFO:tasks.workunit.client.0.smithi002.stdout:0/6: dwrite f1 [0,4194304] 0 2024-09-17T01:01:44.768 INFO:tasks.workunit.client.0.smithi002.stdout:5/0: creat f0 x:0 0 0 2024-09-17T01:01:44.768 INFO:tasks.workunit.client.0.smithi002.stdout:5/1: dread - f0 zero size 2024-09-17T01:01:44.768 INFO:tasks.workunit.client.0.smithi002.stdout:5/2: chown f0 1068555477 1 2024-09-17T01:01:44.769 INFO:tasks.workunit.client.0.smithi002.stdout:4/4: symlink l1 0 2024-09-17T01:01:44.773 INFO:tasks.workunit.client.0.smithi002.stdout:2/20: rename l0 to l2 0 2024-09-17T01:01:44.774 INFO:tasks.workunit.client.0.smithi002.stdout:7/0: unlink - no file 2024-09-17T01:01:44.775 INFO:tasks.workunit.client.0.smithi002.stdout:7/1: dread - no filename 2024-09-17T01:01:44.775 INFO:tasks.workunit.client.0.smithi002.stdout:7/2: dwrite - no filename 2024-09-17T01:01:44.776 INFO:tasks.workunit.client.0.smithi002.stdout:6/0: creat f0 x:0 0 0 2024-09-17T01:01:44.784 INFO:tasks.workunit.client.0.smithi002.stdout:5/3: link f0 f1 0 2024-09-17T01:01:44.784 INFO:tasks.workunit.client.0.smithi002.stdout:5/4: rmdir - no directory 2024-09-17T01:01:44.784 INFO:tasks.workunit.client.0.smithi002.stdout:5/5: write f0 [5035,13476] 0 2024-09-17T01:01:44.786 INFO:tasks.workunit.client.0.smithi002.stdout:4/5: mknod c2 0 2024-09-17T01:01:44.789 INFO:tasks.workunit.client.0.smithi002.stdout:8/0: readlink - no filename 2024-09-17T01:01:44.789 INFO:tasks.workunit.client.0.smithi002.stdout:8/1: stat - no entries 2024-09-17T01:01:44.789 INFO:tasks.workunit.client.0.smithi002.stdout:8/2: link - no file 2024-09-17T01:01:44.791 INFO:tasks.workunit.client.0.smithi002.stdout:7/3: creat f0 x:0 0 0 2024-09-17T01:01:44.791 INFO:tasks.workunit.client.0.smithi002.stdout:7/4: write f0 [761529,38741] 0 2024-09-17T01:01:44.791 INFO:tasks.workunit.client.0.smithi002.stdout:7/5: write f0 [1067380,34038] 0 2024-09-17T01:01:44.792 INFO:tasks.workunit.client.0.smithi002.stdout:6/1: dwrite f0 [0,4194304] 0 2024-09-17T01:01:44.795 INFO:tasks.workunit.client.0.smithi002.stdout:4/6: link f0 f3 0 2024-09-17T01:01:44.795 INFO:tasks.workunit.client.0.smithi002.stdout:4/7: rmdir - no directory 2024-09-17T01:01:44.795 INFO:tasks.workunit.client.0.smithi002.stdout:4/8: write f3 [234906,22939] 0 2024-09-17T01:01:44.795 INFO:tasks.workunit.client.0.smithi002.stdout:4/9: creat f4 x:0 0 0 2024-09-17T01:01:44.795 INFO:tasks.workunit.client.0.smithi002.stdout:4/10: rmdir - no directory 2024-09-17T01:01:44.799 INFO:tasks.workunit.client.0.smithi002.stdout:8/3: creat f0 x:0 0 0 2024-09-17T01:01:44.799 INFO:tasks.workunit.client.0.smithi002.stdout:8/4: write f0 [794672,63392] 0 2024-09-17T01:01:44.800 INFO:tasks.workunit.client.0.smithi002.stdout:7/6: mkdir d1 0 2024-09-17T01:01:44.801 INFO:tasks.workunit.client.0.smithi002.stdout:7/7: write f0 [1847159,26725] 0 2024-09-17T01:01:44.801 INFO:tasks.workunit.client.0.smithi002.stdout:7/8: chown f0 10762300 1 2024-09-17T01:01:44.801 INFO:tasks.workunit.client.0.smithi002.stdout:6/2: write f0 [127520,129060] 0 2024-09-17T01:01:44.801 INFO:tasks.workunit.client.0.smithi002.stdout:6/3: chown f0 77 1 2024-09-17T01:01:44.806 INFO:tasks.workunit.client.0.smithi002.stdout:4/11: unlink l1 0 2024-09-17T01:01:44.806 INFO:tasks.workunit.client.0.smithi002.stdout:4/12: creat f5 x:0 0 0 2024-09-17T01:01:44.807 INFO:tasks.workunit.client.0.smithi002.stdout:4/13: dread - f5 zero size 2024-09-17T01:01:44.807 INFO:tasks.workunit.client.0.smithi002.stdout:4/14: chown c2 617 1 2024-09-17T01:01:44.807 INFO:tasks.workunit.client.0.smithi002.stdout:5/6: dwrite f1 [0,4194304] 0 2024-09-17T01:01:44.807 INFO:tasks.workunit.client.0.smithi002.stdout:9/0: creat f0 x:0 0 0 2024-09-17T01:01:44.808 INFO:tasks.workunit.client.0.smithi002.stdout:9/1: chown f0 1089209 1 2024-09-17T01:01:44.808 INFO:tasks.workunit.client.0.smithi002.stdout:9/2: chown f0 1153786 1 2024-09-17T01:01:44.808 INFO:tasks.workunit.client.0.smithi002.stdout:9/3: chown f0 2043852 1 2024-09-17T01:01:44.809 INFO:tasks.workunit.client.0.smithi002.stdout:6/4: dread f0 [0,4194304] 0 2024-09-17T01:01:44.809 INFO:tasks.workunit.client.0.smithi002.stdout:7/9: mkdir d1/d2 0 2024-09-17T01:01:44.810 INFO:tasks.workunit.client.0.smithi002.stdout:7/10: write f0 [155522,3863] 0 2024-09-17T01:01:44.813 INFO:tasks.workunit.client.0.smithi002.stdout:4/15: rename c2 to c6 0 2024-09-17T01:01:44.813 INFO:tasks.workunit.client.0.smithi002.stdout:6/5: dread f0 [0,4194304] 0 2024-09-17T01:01:44.815 INFO:tasks.workunit.client.0.smithi002.stdout:7/11: dread f0 [0,4194304] 0 2024-09-17T01:01:44.817 INFO:tasks.workunit.client.0.smithi002.stdout:5/7: mkdir d2 0 2024-09-17T01:01:44.817 INFO:tasks.workunit.client.0.smithi002.stdout:4/16: dread f0 [0,4194304] 0 2024-09-17T01:01:44.820 INFO:tasks.workunit.client.0.smithi002.stdout:9/4: mknod c1 0 2024-09-17T01:01:44.820 INFO:tasks.workunit.client.0.smithi002.stdout:9/5: write f0 [749717,29589] 0 2024-09-17T01:01:44.820 INFO:tasks.workunit.client.0.smithi002.stdout:9/6: rmdir - no directory 2024-09-17T01:01:44.825 INFO:tasks.workunit.client.0.smithi002.stdout:5/8: creat d2/f3 x:0 0 0 2024-09-17T01:01:44.826 INFO:tasks.workunit.client.0.smithi002.stdout:4/17: mkdir d7 0 2024-09-17T01:01:44.830 INFO:tasks.workunit.client.0.smithi002.stdout:4/18: mkdir d7/d8 0 2024-09-17T01:01:44.830 INFO:tasks.workunit.client.0.smithi002.stdout:4/19: chown f3 10 1 2024-09-17T01:01:44.834 INFO:tasks.workunit.client.0.smithi002.stdout:4/20: rmdir d7/d8 0 2024-09-17T01:01:44.834 INFO:tasks.workunit.client.0.smithi002.stdout:4/21: readlink - no filename 2024-09-17T01:01:44.838 INFO:tasks.workunit.client.0.smithi002.stdout:4/22: creat d7/f9 x:0 0 0 2024-09-17T01:01:44.854 INFO:tasks.workunit.client.0.smithi002.stdout:7/12: dwrite f0 [0,4194304] 0 2024-09-17T01:01:44.860 INFO:tasks.workunit.client.0.smithi002.stdout:7/13: link f0 d1/f3 0 2024-09-17T01:01:44.865 INFO:tasks.workunit.client.0.smithi002.stdout:7/14: rmdir d1/d2 0 2024-09-17T01:01:44.875 INFO:tasks.workunit.client.0.smithi002.stdout:7/15: creat d1/f4 x:0 0 0 2024-09-17T01:01:44.878 INFO:tasks.workunit.client.0.smithi002.stdout:1/10: fsync f1 0 2024-09-17T01:01:44.884 INFO:tasks.workunit.client.0.smithi002.stdout:3/11: getdents d0 0 2024-09-17T01:01:44.902 INFO:tasks.workunit.client.0.smithi002.stdout:7/16: unlink d1/f4 0 2024-09-17T01:01:44.907 INFO:tasks.workunit.client.0.smithi002.stdout:2/21: getdents . 0 2024-09-17T01:01:44.907 INFO:tasks.workunit.client.0.smithi002.stdout:2/22: chown l2 381 1 2024-09-17T01:01:44.907 INFO:tasks.workunit.client.0.smithi002.stdout:2/23: dwrite - no filename 2024-09-17T01:01:44.907 INFO:tasks.workunit.client.0.smithi002.stdout:2/24: truncate - no filename 2024-09-17T01:01:44.918 INFO:tasks.workunit.client.0.smithi002.stdout:0/7: truncate f1 2317411 0 2024-09-17T01:01:44.965 INFO:tasks.workunit.client.0.smithi002.stdout:2/25: creat f3 x:0 0 0 2024-09-17T01:01:44.976 INFO:tasks.workunit.client.0.smithi002.stdout:6/6: truncate f0 1477282 0 2024-09-17T01:01:44.976 INFO:tasks.workunit.client.0.smithi002.stdout:6/7: creat f1 x:0 0 0 2024-09-17T01:01:45.024 INFO:tasks.workunit.client.0.smithi002.stdout:5/9: dread f1 [0,4194304] 0 2024-09-17T01:01:45.108 INFO:tasks.workunit.client.0.smithi002.stdout:6/8: mkdir d2 0 2024-09-17T01:01:45.108 INFO:tasks.workunit.client.0.smithi002.stdout:6/9: stat f1 0 2024-09-17T01:01:45.311 INFO:tasks.workunit.client.0.smithi002.stdout:2/26: symlink l4 0 2024-09-17T01:01:45.409 INFO:tasks.workunit.client.0.smithi002.stdout:4/23: dwrite d7/f9 [0,4194304] 0 2024-09-17T01:01:45.464 INFO:tasks.workunit.client.0.smithi002.stdout:8/5: truncate f0 476497 0 2024-09-17T01:01:45.494 INFO:tasks.workunit.client.0.smithi002.stdout:0/8: fsync f1 0 2024-09-17T01:01:45.503 INFO:tasks.workunit.client.0.smithi002.stdout:0/9: dread f1 [0,4194304] 0 2024-09-17T01:01:45.507 INFO:tasks.workunit.client.0.smithi002.stdout:2/27: fsync f3 0 2024-09-17T01:01:45.540 INFO:tasks.workunit.client.0.smithi002.stdout:6/10: mknod d2/c3 0 2024-09-17T01:01:45.540 INFO:tasks.workunit.client.0.smithi002.stdout:6/11: write f0 [1824595,107586] 0 2024-09-17T01:01:45.540 INFO:tasks.workunit.client.0.smithi002.stdout:6/12: truncate f1 692190 0 2024-09-17T01:01:45.540 INFO:tasks.workunit.client.0.smithi002.stdout:6/13: write f0 [2810632,20464] 0 2024-09-17T01:01:45.557 INFO:tasks.workunit.client.0.smithi002.stdout:7/17: dwrite d1/f3 [0,4194304] 0 2024-09-17T01:01:45.557 INFO:tasks.workunit.client.0.smithi002.stdout:7/18: creat d1/f5 x:0 0 0 2024-09-17T01:01:45.568 INFO:tasks.workunit.client.0.smithi002.stdout:6/14: dread f0 [0,4194304] 0 2024-09-17T01:01:45.829 INFO:tasks.workunit.client.0.smithi002.stdout:5/10: truncate f1 2968609 0 2024-09-17T01:01:45.910 INFO:tasks.workunit.client.0.smithi002.stdout:0/10: rename l0 to l2 0 2024-09-17T01:01:45.914 INFO:tasks.workunit.client.0.smithi002.stdout:2/28: chown l2 322 1 2024-09-17T01:01:45.914 INFO:tasks.workunit.client.0.smithi002.stdout:2/29: truncate f3 875988 0 2024-09-17T01:01:45.929 INFO:tasks.workunit.client.0.smithi002.stdout:7/19: rename d1/f3 to d1/f6 0 2024-09-17T01:01:45.935 INFO:tasks.workunit.client.0.smithi002.stdout:6/15: creat d2/f4 x:0 0 0 2024-09-17T01:01:45.936 INFO:tasks.workunit.client.0.smithi002.stdout:8/6: getdents . 0 2024-09-17T01:01:45.937 INFO:tasks.workunit.client.0.smithi002.stdout:0/11: mknod c3 0 2024-09-17T01:01:45.937 INFO:tasks.workunit.client.0.smithi002.stdout:8/7: dread f0 [0,4194304] 0 2024-09-17T01:01:45.938 INFO:tasks.workunit.client.0.smithi002.stdout:7/20: mknod d1/c7 0 2024-09-17T01:01:45.938 INFO:tasks.workunit.client.0.smithi002.stdout:7/21: chown d1/c7 6 1 2024-09-17T01:01:45.938 INFO:tasks.workunit.client.0.smithi002.stdout:7/22: write d1/f5 [362591,49833] 0 2024-09-17T01:01:45.938 INFO:tasks.workunit.client.0.smithi002.stdout:7/23: creat d1/f8 x:0 0 0 2024-09-17T01:01:45.939 INFO:tasks.workunit.client.0.smithi002.stdout:0/12: read f1 [715834,84986] 0 2024-09-17T01:01:45.939 INFO:tasks.workunit.client.0.smithi002.stdout:5/11: getdents d2 0 2024-09-17T01:01:45.941 INFO:tasks.workunit.client.0.smithi002.stdout:7/24: unlink d1/c7 0 2024-09-17T01:01:45.942 INFO:tasks.workunit.client.0.smithi002.stdout:7/25: write d1/f5 [299668,37055] 0 2024-09-17T01:01:45.943 INFO:tasks.workunit.client.0.smithi002.stdout:7/26: symlink d1/l9 0 2024-09-17T01:01:45.949 INFO:tasks.workunit.client.0.smithi002.stdout:7/27: read d1/f6 [2826524,66701] 0 2024-09-17T01:01:45.949 INFO:tasks.workunit.client.0.smithi002.stdout:7/28: write d1/f8 [583273,65816] 0 2024-09-17T01:01:45.949 INFO:tasks.workunit.client.0.smithi002.stdout:7/29: chown d1/f5 85 1 2024-09-17T01:01:45.949 INFO:tasks.workunit.client.0.smithi002.stdout:7/30: symlink d1/la 0 2024-09-17T01:01:46.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:45 smithi099 ceph-mon[34357]: pgmap v246: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 8.3 MiB/s rd, 15 MiB/s wr, 872 op/s 2024-09-17T01:01:46.104 INFO:tasks.workunit.client.0.smithi002.stdout:5/12: dread f0 [0,4194304] 0 2024-09-17T01:01:46.105 INFO:tasks.workunit.client.0.smithi002.stdout:5/13: fdatasync f0 0 2024-09-17T01:01:46.105 INFO:tasks.workunit.client.0.smithi002.stdout:5/14: creat d2/f4 x:0 0 0 2024-09-17T01:01:46.106 INFO:tasks.workunit.client.0.smithi002.stdout:5/15: mknod d2/c5 0 2024-09-17T01:01:46.107 INFO:tasks.workunit.client.0.smithi002.stdout:5/16: readlink - no filename 2024-09-17T01:01:46.114 INFO:tasks.workunit.client.0.smithi002.stdout:4/24: write d7/f9 [5059967,10084] 0 2024-09-17T01:01:46.114 INFO:tasks.workunit.client.0.smithi002.stdout:4/25: chown d7 2884 1 2024-09-17T01:01:46.117 INFO:tasks.workunit.client.0.smithi002.stdout:4/26: mknod d7/ca 0 2024-09-17T01:01:46.117 INFO:tasks.workunit.client.0.smithi002.stdout:4/27: dread - f4 zero size 2024-09-17T01:01:46.118 INFO:tasks.workunit.client.0.smithi002.stdout:4/28: rename d7/f9 to d7/fb 0 2024-09-17T01:01:46.122 INFO:tasks.workunit.client.0.smithi002.stdout:5/17: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:01:46.122 INFO:tasks.workunit.client.0.smithi002.stdout:5/18: creat d2/f6 x:0 0 0 2024-09-17T01:01:46.140 INFO:tasks.workunit.client.0.smithi002.stdout:0/13: unlink l2 0 2024-09-17T01:01:46.142 INFO:tasks.workunit.client.0.smithi002.stdout:0/14: link f1 f4 0 2024-09-17T01:01:46.143 INFO:tasks.workunit.client.0.smithi002.stdout:0/15: symlink l5 0 2024-09-17T01:01:46.147 INFO:tasks.workunit.client.0.smithi002.stdout:0/16: dread f4 [0,4194304] 0 2024-09-17T01:01:46.147 INFO:tasks.workunit.client.0.smithi002.stdout:0/17: chown f4 1341 1 2024-09-17T01:01:46.152 INFO:tasks.workunit.client.0.smithi002.stdout:6/16: rmdir d2 39 2024-09-17T01:01:46.152 INFO:tasks.workunit.client.0.smithi002.stdout:6/17: write d2/f4 [396307,10406] 0 2024-09-17T01:01:46.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:45 smithi002 ceph-mon[27650]: pgmap v246: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 8.3 MiB/s rd, 15 MiB/s wr, 872 op/s 2024-09-17T01:01:46.157 INFO:tasks.workunit.client.0.smithi002.stdout:6/18: fsync d2/f4 0 2024-09-17T01:01:46.157 INFO:tasks.workunit.client.0.smithi002.stdout:4/29: rmdir d7 39 2024-09-17T01:01:46.158 INFO:tasks.workunit.client.0.smithi002.stdout:6/19: mknod d2/c5 0 2024-09-17T01:01:46.160 INFO:tasks.workunit.client.0.smithi002.stdout:4/30: rename d7/fb to d7/fc 0 2024-09-17T01:01:46.185 INFO:tasks.workunit.client.0.smithi002.stdout:6/20: dwrite f1 [0,4194304] 0 2024-09-17T01:01:46.186 INFO:tasks.workunit.client.0.smithi002.stdout:6/21: mkdir d2/d6 0 2024-09-17T01:01:46.202 INFO:tasks.workunit.client.0.smithi002.stdout:6/22: dwrite f1 [0,4194304] 0 2024-09-17T01:01:46.396 INFO:tasks.workunit.client.0.smithi002.stdout:6/23: truncate d2/f4 363807 0 2024-09-17T01:01:46.396 INFO:tasks.workunit.client.0.smithi002.stdout:0/18: dwrite f4 [0,4194304] 0 2024-09-17T01:01:46.397 INFO:tasks.workunit.client.0.smithi002.stdout:0/19: stat f4 0 2024-09-17T01:01:46.397 INFO:tasks.workunit.client.0.smithi002.stdout:5/19: dwrite d2/f4 [4194304,4194304] 0 2024-09-17T01:01:46.397 INFO:tasks.workunit.client.0.smithi002.stdout:5/20: write d2/f6 [244268,119500] 0 2024-09-17T01:01:46.397 INFO:tasks.workunit.client.0.smithi002.stdout:5/21: write d2/f6 [1336258,99551] 0 2024-09-17T01:01:46.397 INFO:tasks.workunit.client.0.smithi002.stdout:5/22: fsync d2/f3 0 2024-09-17T01:01:46.398 INFO:tasks.workunit.client.0.smithi002.stdout:4/31: getdents d7 0 2024-09-17T01:01:46.398 INFO:tasks.workunit.client.0.smithi002.stdout:4/32: chown f3 44 1 2024-09-17T01:01:46.398 INFO:tasks.workunit.client.0.smithi002.stdout:6/24: write f1 [4476941,36625] 0 2024-09-17T01:01:46.399 INFO:tasks.workunit.client.0.smithi002.stdout:0/20: symlink l6 0 2024-09-17T01:01:46.401 INFO:tasks.workunit.client.0.smithi002.stdout:5/23: mkdir d2/d7 0 2024-09-17T01:01:46.403 INFO:tasks.workunit.client.0.smithi002.stdout:4/33: rename f5 to d7/fd 0 2024-09-17T01:01:46.403 INFO:tasks.workunit.client.0.smithi002.stdout:4/34: dread - f4 zero size 2024-09-17T01:01:46.404 INFO:tasks.workunit.client.0.smithi002.stdout:6/25: link d2/c3 d2/d6/c7 0 2024-09-17T01:01:46.404 INFO:tasks.workunit.client.0.smithi002.stdout:6/26: readlink - no filename 2024-09-17T01:01:46.406 INFO:tasks.workunit.client.0.smithi002.stdout:0/21: symlink l7 0 2024-09-17T01:01:46.410 INFO:tasks.workunit.client.0.smithi002.stdout:6/27: symlink d2/d6/l8 0 2024-09-17T01:01:46.412 INFO:tasks.workunit.client.0.smithi002.stdout:5/24: dread d2/f4 [4194304,4194304] 0 2024-09-17T01:01:46.416 INFO:tasks.workunit.client.0.smithi002.stdout:5/25: rmdir d2/d7 0 2024-09-17T01:01:46.416 INFO:tasks.workunit.client.0.smithi002.stdout:5/26: dread - d2/f3 zero size 2024-09-17T01:01:46.417 INFO:tasks.workunit.client.0.smithi002.stdout:5/27: creat d2/f8 x:0 0 0 2024-09-17T01:01:46.417 INFO:tasks.workunit.client.0.smithi002.stdout:5/28: stat d2/f8 0 2024-09-17T01:01:46.425 INFO:tasks.workunit.client.0.smithi002.stdout:4/35: dwrite f3 [0,4194304] 0 2024-09-17T01:01:46.426 INFO:tasks.workunit.client.0.smithi002.stdout:4/36: getdents d7 0 2024-09-17T01:01:46.427 INFO:tasks.workunit.client.0.smithi002.stdout:4/37: mkdir d7/de 0 2024-09-17T01:01:46.427 INFO:tasks.workunit.client.0.smithi002.stdout:4/38: write f4 [300989,75112] 0 2024-09-17T01:01:46.428 INFO:tasks.workunit.client.0.smithi002.stdout:4/39: write f4 [792028,80979] 0 2024-09-17T01:01:46.428 INFO:tasks.workunit.client.0.smithi002.stdout:4/40: write f4 [1493526,34886] 0 2024-09-17T01:01:46.432 INFO:tasks.workunit.client.0.smithi002.stdout:4/41: getdents d7 0 2024-09-17T01:01:46.433 INFO:tasks.workunit.client.0.smithi002.stdout:4/42: symlink d7/lf 0 2024-09-17T01:01:46.434 INFO:tasks.workunit.client.0.smithi002.stdout:4/43: stat c6 0 2024-09-17T01:01:46.440 INFO:tasks.workunit.client.0.smithi002.stdout:4/44: dread f0 [0,4194304] 0 2024-09-17T01:01:46.442 INFO:tasks.workunit.client.0.smithi002.stdout:4/45: unlink d7/fc 0 2024-09-17T01:01:46.442 INFO:tasks.workunit.client.0.smithi002.stdout:4/46: dread - d7/fd zero size 2024-09-17T01:01:46.446 INFO:tasks.workunit.client.0.smithi002.stdout:6/28: dwrite f1 [4194304,4194304] 0 2024-09-17T01:01:46.447 INFO:tasks.workunit.client.0.smithi002.stdout:5/29: dwrite f0 [0,4194304] 0 2024-09-17T01:01:46.448 INFO:tasks.workunit.client.0.smithi002.stdout:6/29: dread d2/f4 [0,4194304] 0 2024-09-17T01:01:46.448 INFO:tasks.workunit.client.0.smithi002.stdout:6/30: chown d2 545 1 2024-09-17T01:01:46.449 INFO:tasks.workunit.client.0.smithi002.stdout:5/30: rename d2/f8 to d2/f9 0 2024-09-17T01:01:46.449 INFO:tasks.workunit.client.0.smithi002.stdout:5/31: creat d2/fa x:0 0 0 2024-09-17T01:01:46.449 INFO:tasks.workunit.client.0.smithi002.stdout:5/32: chown d2/f9 14253 1 2024-09-17T01:01:46.450 INFO:tasks.workunit.client.0.smithi002.stdout:6/31: symlink d2/d6/l9 0 2024-09-17T01:01:46.453 INFO:tasks.workunit.client.0.smithi002.stdout:6/32: unlink f0 0 2024-09-17T01:01:46.453 INFO:tasks.workunit.client.0.smithi002.stdout:6/33: chown d2/d6 5 1 2024-09-17T01:01:46.454 INFO:tasks.workunit.client.0.smithi002.stdout:6/34: mknod d2/d6/ca 0 2024-09-17T01:01:46.461 INFO:tasks.workunit.client.0.smithi002.stdout:4/47: dwrite f0 [0,4194304] 0 2024-09-17T01:01:46.463 INFO:tasks.workunit.client.0.smithi002.stdout:4/48: link d7/ca d7/de/c10 0 2024-09-17T01:01:46.463 INFO:tasks.workunit.client.0.smithi002.stdout:6/35: write f1 [2954942,28011] 0 2024-09-17T01:01:46.463 INFO:tasks.workunit.client.0.smithi002.stdout:6/36: write f1 [3362949,86798] 0 2024-09-17T01:01:46.464 INFO:tasks.workunit.client.0.smithi002.stdout:4/49: mknod d7/c11 0 2024-09-17T01:01:46.467 INFO:tasks.workunit.client.0.smithi002.stdout:5/33: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:01:46.473 INFO:tasks.workunit.client.0.smithi002.stdout:4/50: rmdir d7 39 2024-09-17T01:01:46.473 INFO:tasks.workunit.client.0.smithi002.stdout:4/51: readlink d7/lf 0 2024-09-17T01:01:46.481 INFO:tasks.workunit.client.0.smithi002.stdout:4/52: dread f0 [0,4194304] 0 2024-09-17T01:01:46.481 INFO:tasks.workunit.client.0.smithi002.stdout:6/37: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:01:46.485 INFO:tasks.workunit.client.0.smithi002.stdout:5/34: dwrite f1 [0,4194304] 0 2024-09-17T01:01:46.485 INFO:tasks.workunit.client.0.smithi002.stdout:5/35: truncate d2/f9 74726 0 2024-09-17T01:01:46.486 INFO:tasks.workunit.client.0.smithi002.stdout:4/53: write f0 [1905718,81914] 0 2024-09-17T01:01:46.486 INFO:tasks.workunit.client.0.smithi002.stdout:5/36: dread d2/f9 [0,4194304] 0 2024-09-17T01:01:47.053 INFO:tasks.workunit.client.0.smithi002.stdout:6/38: link d2/c3 d2/d6/cb 0 2024-09-17T01:01:47.053 INFO:tasks.workunit.client.0.smithi002.stdout:6/39: chown d2/d6 14236622 1 2024-09-17T01:01:47.055 INFO:tasks.workunit.client.0.smithi002.stdout:4/54: creat d7/f12 x:0 0 0 2024-09-17T01:01:47.060 INFO:tasks.workunit.client.0.smithi002.stdout:6/40: dread d2/f4 [0,4194304] 0 2024-09-17T01:01:47.100 INFO:tasks.workunit.client.0.smithi002.stdout:4/55: rmdir d7/de 39 2024-09-17T01:01:47.104 INFO:tasks.workunit.client.0.smithi002.stdout:6/41: mkdir d2/dc 0 2024-09-17T01:01:47.106 INFO:tasks.workunit.client.0.smithi002.stdout:6/42: mknod d2/dc/cd 0 2024-09-17T01:01:47.108 INFO:tasks.workunit.client.0.smithi002.stdout:6/43: mknod d2/d6/ce 0 2024-09-17T01:01:47.118 INFO:tasks.workunit.client.0.smithi002.stdout:4/56: dwrite f0 [0,4194304] 0 2024-09-17T01:01:47.120 INFO:tasks.workunit.client.0.smithi002.stdout:4/57: unlink f3 0 2024-09-17T01:01:47.123 INFO:tasks.workunit.client.0.smithi002.stdout:4/58: mknod d7/de/c13 0 2024-09-17T01:01:47.124 INFO:tasks.workunit.client.0.smithi002.stdout:5/37: truncate f1 2806672 0 2024-09-17T01:01:47.124 INFO:tasks.workunit.client.0.smithi002.stdout:5/38: fsync d2/fa 0 2024-09-17T01:01:47.126 INFO:tasks.workunit.client.0.smithi002.stdout:6/44: getdents d2/dc 0 2024-09-17T01:01:47.129 INFO:tasks.workunit.client.0.smithi002.stdout:6/45: fdatasync f1 0 2024-09-17T01:01:47.129 INFO:tasks.workunit.client.0.smithi002.stdout:6/46: fdatasync d2/f4 0 2024-09-17T01:01:47.131 INFO:tasks.workunit.client.0.smithi002.stdout:6/47: unlink d2/d6/l8 0 2024-09-17T01:01:47.136 INFO:tasks.workunit.client.0.smithi002.stdout:6/48: dread d2/f4 [0,4194304] 0 2024-09-17T01:01:47.140 INFO:tasks.workunit.client.0.smithi002.stdout:6/49: dread d2/f4 [0,4194304] 0 2024-09-17T01:01:47.141 INFO:tasks.workunit.client.0.smithi002.stdout:6/50: symlink d2/dc/lf 0 2024-09-17T01:01:47.143 INFO:tasks.workunit.client.0.smithi002.stdout:6/51: rename d2/d6/c7 to d2/c10 0 2024-09-17T01:01:47.146 INFO:tasks.workunit.client.0.smithi002.stdout:6/52: write d2/f4 [466634,91776] 0 2024-09-17T01:01:47.146 INFO:tasks.workunit.client.0.smithi002.stdout:6/53: readlink d2/d6/l9 0 2024-09-17T01:01:47.147 INFO:tasks.workunit.client.0.smithi002.stdout:6/54: write f1 [2777649,68261] 0 2024-09-17T01:01:47.148 INFO:tasks.workunit.client.0.smithi002.stdout:4/59: dwrite d7/f12 [0,4194304] 0 2024-09-17T01:01:47.148 INFO:tasks.workunit.client.0.smithi002.stdout:4/60: write d7/fd [550209,33008] 0 2024-09-17T01:01:47.149 INFO:tasks.workunit.client.0.smithi002.stdout:5/39: dwrite f1 [0,4194304] 0 2024-09-17T01:01:47.151 INFO:tasks.workunit.client.0.smithi002.stdout:5/40: symlink d2/lb 0 2024-09-17T01:01:47.151 INFO:tasks.workunit.client.0.smithi002.stdout:5/41: chown d2/f4 4897 1 2024-09-17T01:01:47.151 INFO:tasks.workunit.client.0.smithi002.stdout:5/42: mkdir d2/dc 0 2024-09-17T01:01:47.154 INFO:tasks.workunit.client.1.smithi099.stdout:3/42: sync 2024-09-17T01:01:47.154 INFO:tasks.workunit.client.1.smithi099.stdout:3/43: chown l7 36 1 2024-09-17T01:01:47.154 INFO:tasks.workunit.client.1.smithi099.stdout:3/44: fsync f2 0 2024-09-17T01:01:47.154 INFO:tasks.workunit.client.1.smithi099.stdout:2/40: sync 2024-09-17T01:01:47.155 INFO:tasks.workunit.client.1.smithi099.stdout:4/5: sync 2024-09-17T01:01:47.155 INFO:tasks.workunit.client.1.smithi099.stdout:0/17: sync 2024-09-17T01:01:47.155 INFO:tasks.workunit.client.1.smithi099.stdout:4/6: truncate - no filename 2024-09-17T01:01:47.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/8: sync 2024-09-17T01:01:47.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/9: rename - no filename 2024-09-17T01:01:47.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/10: write - no filename 2024-09-17T01:01:47.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/11: getdents . 0 2024-09-17T01:01:47.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/12: dread - no filename 2024-09-17T01:01:47.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/13: chown . 35934387 1 2024-09-17T01:01:47.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/14: rmdir - no directory 2024-09-17T01:01:47.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/15: dwrite - no filename 2024-09-17T01:01:47.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/16: dread - no filename 2024-09-17T01:01:47.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/17: dread - no filename 2024-09-17T01:01:47.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/18: getdents . 0 2024-09-17T01:01:47.156 INFO:tasks.workunit.client.1.smithi099.stdout:8/19: write - no filename 2024-09-17T01:01:47.156 INFO:tasks.workunit.client.1.smithi099.stdout:8/20: rename - no filename 2024-09-17T01:01:47.156 INFO:tasks.workunit.client.1.smithi099.stdout:8/21: stat - no entries 2024-09-17T01:01:47.156 INFO:tasks.workunit.client.1.smithi099.stdout:8/22: read - no filename 2024-09-17T01:01:47.156 INFO:tasks.workunit.client.1.smithi099.stdout:8/23: write - no filename 2024-09-17T01:01:47.156 INFO:tasks.workunit.client.1.smithi099.stdout:1/9: sync 2024-09-17T01:01:47.157 INFO:tasks.workunit.client.1.smithi099.stdout:6/18: sync 2024-09-17T01:01:47.157 INFO:tasks.workunit.client.1.smithi099.stdout:9/12: sync 2024-09-17T01:01:47.157 INFO:tasks.workunit.client.1.smithi099.stdout:3/45: mknod d9/ce 0 2024-09-17T01:01:47.157 INFO:tasks.workunit.client.1.smithi099.stdout:5/81: sync 2024-09-17T01:01:47.157 INFO:tasks.workunit.client.1.smithi099.stdout:7/22: sync 2024-09-17T01:01:47.157 INFO:tasks.workunit.client.1.smithi099.stdout:0/18: creat f7 x:0 0 0 2024-09-17T01:01:47.157 INFO:tasks.workunit.client.0.smithi002.stdout:6/55: dread f1 [4194304,4194304] 0 2024-09-17T01:01:47.158 INFO:tasks.workunit.client.1.smithi099.stdout:4/7: creat f1 x:0 0 0 2024-09-17T01:01:47.158 INFO:tasks.workunit.client.1.smithi099.stdout:4/8: creat f2 x:0 0 0 2024-09-17T01:01:47.158 INFO:tasks.workunit.client.1.smithi099.stdout:4/9: write f2 [780359,128436] 0 2024-09-17T01:01:47.158 INFO:tasks.workunit.client.1.smithi099.stdout:4/10: truncate f1 19400 0 2024-09-17T01:01:47.160 INFO:tasks.workunit.client.1.smithi099.stdout:6/19: dread f7 [0,4194304] 0 2024-09-17T01:01:47.160 INFO:tasks.workunit.client.1.smithi099.stdout:9/13: link f0 f4 0 2024-09-17T01:01:47.160 INFO:tasks.workunit.client.1.smithi099.stdout:6/20: read f7 [924197,84937] 0 2024-09-17T01:01:47.161 INFO:tasks.workunit.client.1.smithi099.stdout:3/46: symlink d9/lf 0 2024-09-17T01:01:47.161 INFO:tasks.workunit.client.0.smithi002.stdout:6/56: fsync d2/f4 0 2024-09-17T01:01:47.161 INFO:tasks.workunit.client.0.smithi002.stdout:6/57: readlink d2/dc/lf 0 2024-09-17T01:01:47.161 INFO:tasks.workunit.client.1.smithi099.stdout:7/23: mknod d1/c3 0 2024-09-17T01:01:47.165 INFO:tasks.workunit.client.1.smithi099.stdout:0/19: unlink c1 0 2024-09-17T01:01:47.165 INFO:tasks.workunit.client.1.smithi099.stdout:0/20: fdatasync f5 0 2024-09-17T01:01:47.165 INFO:tasks.workunit.client.1.smithi099.stdout:0/21: dread - f7 zero size 2024-09-17T01:01:47.166 INFO:tasks.workunit.client.1.smithi099.stdout:9/14: symlink l5 0 2024-09-17T01:01:47.167 INFO:tasks.workunit.client.0.smithi002.stdout:6/58: dread d2/f4 [0,4194304] 0 2024-09-17T01:01:47.167 INFO:tasks.workunit.client.1.smithi099.stdout:6/21: mknod c9 0 2024-09-17T01:01:47.169 INFO:tasks.workunit.client.0.smithi002.stdout:6/59: link d2/c3 d2/c11 0 2024-09-17T01:01:47.170 INFO:tasks.workunit.client.1.smithi099.stdout:6/22: creat fa x:0 0 0 2024-09-17T01:01:47.170 INFO:tasks.workunit.client.0.smithi002.stdout:4/61: write d7/f12 [3851274,101886] 0 2024-09-17T01:01:47.171 INFO:tasks.workunit.client.1.smithi099.stdout:9/15: read f4 [29301,93220] 0 2024-09-17T01:01:47.171 INFO:tasks.workunit.client.1.smithi099.stdout:6/23: rename l5 to lb 0 2024-09-17T01:01:47.171 INFO:tasks.workunit.client.1.smithi099.stdout:6/24: dread - fa zero size 2024-09-17T01:01:47.171 INFO:tasks.workunit.client.1.smithi099.stdout:9/16: rename f0 to f6 0 2024-09-17T01:01:47.172 INFO:tasks.workunit.client.1.smithi099.stdout:6/25: mkdir dc 0 2024-09-17T01:01:47.172 INFO:tasks.workunit.client.0.smithi002.stdout:6/60: rename d2/d6/cb to d2/d6/c12 0 2024-09-17T01:01:47.189 INFO:tasks.workunit.client.0.smithi002.stdout:5/43: dwrite f0 [0,4194304] 0 2024-09-17T01:01:47.189 INFO:tasks.workunit.client.0.smithi002.stdout:5/44: write d2/fa [964627,105004] 0 2024-09-17T01:01:47.189 INFO:tasks.workunit.client.0.smithi002.stdout:5/45: chown d2/f6 413641 1 2024-09-17T01:01:47.189 INFO:tasks.workunit.client.0.smithi002.stdout:5/46: truncate d2/f9 925133 0 2024-09-17T01:01:47.191 INFO:tasks.workunit.client.0.smithi002.stdout:4/62: creat d7/f14 x:0 0 0 2024-09-17T01:01:47.192 INFO:tasks.workunit.client.0.smithi002.stdout:4/63: truncate d7/f14 258163 0 2024-09-17T01:01:47.192 INFO:tasks.workunit.client.0.smithi002.stdout:4/64: chown d7/ca 177496751 1 2024-09-17T01:01:47.192 INFO:tasks.workunit.client.0.smithi002.stdout:4/65: write d7/fd [1566626,2425] 0 2024-09-17T01:01:47.192 INFO:tasks.workunit.client.1.smithi099.stdout:5/82: dwrite f0 [4194304,4194304] 0 2024-09-17T01:01:47.192 INFO:tasks.workunit.client.1.smithi099.stdout:5/83: write d2/dc/ff [538493,10352] 0 2024-09-17T01:01:47.194 INFO:tasks.workunit.client.1.smithi099.stdout:5/84: symlink d2/dc/d17/l1c 0 2024-09-17T01:01:47.197 INFO:tasks.workunit.client.1.smithi099.stdout:4/11: dread f2 [0,4194304] 0 2024-09-17T01:01:47.198 INFO:tasks.workunit.client.1.smithi099.stdout:4/12: getdents . 0 2024-09-17T01:01:47.200 INFO:tasks.workunit.client.1.smithi099.stdout:4/13: symlink l3 0 2024-09-17T01:01:47.201 INFO:tasks.workunit.client.1.smithi099.stdout:6/26: dwrite fa [0,4194304] 0 2024-09-17T01:01:47.202 INFO:tasks.workunit.client.1.smithi099.stdout:1/10: dwrite d0/d2/f3 [0,4194304] 0 2024-09-17T01:01:47.205 INFO:tasks.workunit.client.1.smithi099.stdout:6/27: rename l4 to dc/ld 0 2024-09-17T01:01:47.206 INFO:tasks.workunit.client.0.smithi002.stdout:6/61: dwrite f1 [4194304,4194304] 0 2024-09-17T01:01:47.209 INFO:tasks.workunit.client.1.smithi099.stdout:1/11: symlink d0/d2/l4 0 2024-09-17T01:01:47.218 INFO:tasks.workunit.client.1.smithi099.stdout:1/12: dread d0/d2/f3 [0,4194304] 0 2024-09-17T01:01:47.218 INFO:tasks.workunit.client.1.smithi099.stdout:1/13: chown d0/d2/f3 1064 1 2024-09-17T01:01:47.221 INFO:tasks.workunit.client.1.smithi099.stdout:6/28: getdents dc 0 2024-09-17T01:01:47.222 INFO:tasks.workunit.client.1.smithi099.stdout:6/29: creat dc/fe x:0 0 0 2024-09-17T01:01:47.224 INFO:tasks.workunit.client.1.smithi099.stdout:6/30: creat dc/ff x:0 0 0 2024-09-17T01:01:47.225 INFO:tasks.workunit.client.1.smithi099.stdout:3/47: rmdir d9 39 2024-09-17T01:01:47.226 INFO:tasks.workunit.client.1.smithi099.stdout:3/48: creat d9/f10 x:0 0 0 2024-09-17T01:01:47.226 INFO:tasks.workunit.client.1.smithi099.stdout:3/49: chown d9/f10 0 1 2024-09-17T01:01:47.226 INFO:tasks.workunit.client.1.smithi099.stdout:1/14: rmdir d0 39 2024-09-17T01:01:47.227 INFO:tasks.workunit.client.1.smithi099.stdout:1/15: readlink d0/d2/l4 0 2024-09-17T01:01:47.227 INFO:tasks.workunit.client.1.smithi099.stdout:1/16: truncate d0/d2/f3 684455 0 2024-09-17T01:01:47.228 INFO:tasks.workunit.client.1.smithi099.stdout:1/17: mkdir d0/d2/d5 0 2024-09-17T01:01:47.230 INFO:tasks.workunit.client.0.smithi002.stdout:5/47: dwrite f0 [0,4194304] 0 2024-09-17T01:01:47.230 INFO:tasks.workunit.client.0.smithi002.stdout:5/48: getdents d2/dc 0 2024-09-17T01:01:47.231 INFO:tasks.workunit.client.1.smithi099.stdout:9/17: dwrite f4 [0,4194304] 0 2024-09-17T01:01:47.231 INFO:tasks.workunit.client.1.smithi099.stdout:4/14: dwrite f2 [0,4194304] 0 2024-09-17T01:01:47.233 INFO:tasks.workunit.client.1.smithi099.stdout:0/22: dwrite f5 [0,4194304] 0 2024-09-17T01:01:47.233 INFO:tasks.workunit.client.1.smithi099.stdout:0/23: dread - f7 zero size 2024-09-17T01:01:47.233 INFO:tasks.workunit.client.1.smithi099.stdout:0/24: truncate f5 4479985 0 2024-09-17T01:01:47.233 INFO:tasks.workunit.client.1.smithi099.stdout:0/25: chown f3 2 1 2024-09-17T01:01:47.233 INFO:tasks.workunit.client.1.smithi099.stdout:0/26: creat f8 x:0 0 0 2024-09-17T01:01:47.236 INFO:tasks.workunit.client.1.smithi099.stdout:9/18: link l5 l7 0 2024-09-17T01:01:47.239 INFO:tasks.workunit.client.1.smithi099.stdout:5/85: dwrite f0 [0,4194304] 0 2024-09-17T01:01:47.247 INFO:tasks.workunit.client.1.smithi099.stdout:4/15: write f2 [1790178,115930] 0 2024-09-17T01:01:47.249 INFO:tasks.workunit.client.1.smithi099.stdout:5/86: write d2/f18 [931706,91544] 0 2024-09-17T01:01:47.250 INFO:tasks.workunit.client.1.smithi099.stdout:3/50: dwrite f2 [0,4194304] 0 2024-09-17T01:01:47.250 INFO:tasks.workunit.client.1.smithi099.stdout:3/51: fdatasync f8 0 2024-09-17T01:01:47.251 INFO:tasks.workunit.client.1.smithi099.stdout:1/18: dread d0/d2/f3 [0,4194304] 0 2024-09-17T01:01:47.251 INFO:tasks.workunit.client.1.smithi099.stdout:5/87: symlink d2/d8/l1d 0 2024-09-17T01:01:47.252 INFO:tasks.workunit.client.1.smithi099.stdout:1/19: write d0/d2/f3 [1057658,125901] 0 2024-09-17T01:01:47.252 INFO:tasks.workunit.client.1.smithi099.stdout:6/31: dwrite f7 [0,4194304] 0 2024-09-17T01:01:47.252 INFO:tasks.workunit.client.1.smithi099.stdout:6/32: chown c9 3 1 2024-09-17T01:01:47.253 INFO:tasks.workunit.client.1.smithi099.stdout:6/33: truncate dc/fe 212906 0 2024-09-17T01:01:47.253 INFO:tasks.workunit.client.1.smithi099.stdout:6/34: chown c8 7651126 1 2024-09-17T01:01:47.255 INFO:tasks.workunit.client.1.smithi099.stdout:5/88: symlink d2/dc/l1e 0 2024-09-17T01:01:47.255 INFO:tasks.workunit.client.1.smithi099.stdout:6/35: rmdir dc 39 2024-09-17T01:01:47.257 INFO:tasks.workunit.client.1.smithi099.stdout:5/89: mknod d2/dc/d14/c1f 0 2024-09-17T01:01:47.260 INFO:tasks.workunit.client.1.smithi099.stdout:6/36: rename c9 to dc/c10 0 2024-09-17T01:01:47.260 INFO:tasks.workunit.client.1.smithi099.stdout:6/37: chown lb 86 1 2024-09-17T01:01:47.260 INFO:tasks.workunit.client.1.smithi099.stdout:6/38: chown c8 2 1 2024-09-17T01:01:47.260 INFO:tasks.workunit.client.1.smithi099.stdout:6/39: truncate dc/fe 794043 0 2024-09-17T01:01:47.260 INFO:tasks.workunit.client.1.smithi099.stdout:6/40: read dc/fe [569965,64570] 0 2024-09-17T01:01:47.261 INFO:tasks.workunit.client.1.smithi099.stdout:0/27: dwrite f7 [0,4194304] 0 2024-09-17T01:01:47.261 INFO:tasks.workunit.client.1.smithi099.stdout:0/28: creat f9 x:0 0 0 2024-09-17T01:01:47.264 INFO:tasks.workunit.client.1.smithi099.stdout:0/29: mkdir da 0 2024-09-17T01:01:47.264 INFO:tasks.workunit.client.1.smithi099.stdout:0/30: mknod da/cb 0 2024-09-17T01:01:47.266 INFO:tasks.workunit.client.1.smithi099.stdout:0/31: rename f3 to da/fc 0 2024-09-17T01:01:47.266 INFO:tasks.workunit.client.1.smithi099.stdout:0/32: write da/fc [472164,105314] 0 2024-09-17T01:01:47.270 INFO:tasks.workunit.client.1.smithi099.stdout:9/19: dwrite f6 [4194304,4194304] 0 2024-09-17T01:01:47.271 INFO:tasks.workunit.client.1.smithi099.stdout:4/16: dwrite f1 [0,4194304] 0 2024-09-17T01:01:47.271 INFO:tasks.workunit.client.1.smithi099.stdout:0/33: fdatasync da/fc 0 2024-09-17T01:01:47.272 INFO:tasks.workunit.client.1.smithi099.stdout:0/34: fsync f8 0 2024-09-17T01:01:47.273 INFO:tasks.workunit.client.1.smithi099.stdout:0/35: mknod da/cd 0 2024-09-17T01:01:47.273 INFO:tasks.workunit.client.1.smithi099.stdout:4/17: symlink l4 0 2024-09-17T01:01:47.274 INFO:tasks.workunit.client.1.smithi099.stdout:0/36: creat da/fe x:0 0 0 2024-09-17T01:01:47.274 INFO:tasks.workunit.client.1.smithi099.stdout:3/52: write f8 [171976,11201] 0 2024-09-17T01:01:47.276 INFO:tasks.workunit.client.1.smithi099.stdout:3/53: mknod d9/c11 0 2024-09-17T01:01:47.276 INFO:tasks.workunit.client.1.smithi099.stdout:6/41: read f7 [3095874,8911] 0 2024-09-17T01:01:47.277 INFO:tasks.workunit.client.1.smithi099.stdout:4/18: link l3 l5 0 2024-09-17T01:01:47.277 INFO:tasks.workunit.client.1.smithi099.stdout:5/90: dwrite d2/f3 [0,4194304] 0 2024-09-17T01:01:47.279 INFO:tasks.workunit.client.1.smithi099.stdout:3/54: stat l7 0 2024-09-17T01:01:47.280 INFO:tasks.workunit.client.1.smithi099.stdout:9/20: dread f6 [4194304,4194304] 0 2024-09-17T01:01:47.280 INFO:tasks.workunit.client.1.smithi099.stdout:9/21: fdatasync f6 0 2024-09-17T01:01:47.280 INFO:tasks.workunit.client.1.smithi099.stdout:9/22: stat c2 0 2024-09-17T01:01:47.280 INFO:tasks.workunit.client.1.smithi099.stdout:4/19: stat l5 0 2024-09-17T01:01:47.280 INFO:tasks.workunit.client.1.smithi099.stdout:4/20: chown l4 15 1 2024-09-17T01:01:47.283 INFO:tasks.workunit.client.1.smithi099.stdout:5/91: creat d2/dc/d14/f20 x:0 0 0 2024-09-17T01:01:47.284 INFO:tasks.workunit.client.1.smithi099.stdout:1/20: dwrite d0/d2/f3 [0,4194304] 0 2024-09-17T01:01:47.285 INFO:tasks.workunit.client.1.smithi099.stdout:9/23: mknod c8 0 2024-09-17T01:01:47.287 INFO:tasks.workunit.client.1.smithi099.stdout:4/21: creat f6 x:0 0 0 2024-09-17T01:01:47.288 INFO:tasks.workunit.client.1.smithi099.stdout:6/42: dread fa [0,4194304] 0 2024-09-17T01:01:47.288 INFO:tasks.workunit.client.1.smithi099.stdout:6/43: chown f7 166350 1 2024-09-17T01:01:47.288 INFO:tasks.workunit.client.1.smithi099.stdout:6/44: fsync fa 0 2024-09-17T01:01:47.288 INFO:tasks.workunit.client.1.smithi099.stdout:6/45: read f7 [2399471,96931] 0 2024-09-17T01:01:47.290 INFO:tasks.workunit.client.1.smithi099.stdout:5/92: creat d2/dc/d14/d19/f21 x:0 0 0 2024-09-17T01:01:47.290 INFO:tasks.workunit.client.1.smithi099.stdout:3/55: dread f8 [0,4194304] 0 2024-09-17T01:01:47.290 INFO:tasks.workunit.client.1.smithi099.stdout:3/56: creat d9/f12 x:0 0 0 2024-09-17T01:01:47.290 INFO:tasks.workunit.client.1.smithi099.stdout:3/57: fsync f8 0 2024-09-17T01:01:47.292 INFO:tasks.workunit.client.1.smithi099.stdout:1/21: read d0/d2/f3 [3743105,128590] 0 2024-09-17T01:01:47.293 INFO:tasks.workunit.client.1.smithi099.stdout:5/93: creat d2/f22 x:0 0 0 2024-09-17T01:01:47.293 INFO:tasks.workunit.client.1.smithi099.stdout:5/94: write d2/fa [2286604,82629] 0 2024-09-17T01:01:47.294 INFO:tasks.workunit.client.1.smithi099.stdout:3/58: symlink d9/dc/l13 0 2024-09-17T01:01:47.295 INFO:tasks.workunit.client.1.smithi099.stdout:6/46: mknod dc/c11 0 2024-09-17T01:01:47.295 INFO:tasks.workunit.client.1.smithi099.stdout:1/22: symlink d0/d2/d5/l6 0 2024-09-17T01:01:47.295 INFO:tasks.workunit.client.1.smithi099.stdout:1/23: fdatasync d0/d2/f3 0 2024-09-17T01:01:47.296 INFO:tasks.workunit.client.1.smithi099.stdout:6/47: mknod dc/c12 0 2024-09-17T01:01:47.301 INFO:tasks.workunit.client.1.smithi099.stdout:1/24: dread d0/d2/f3 [0,4194304] 0 2024-09-17T01:01:47.303 INFO:tasks.workunit.client.1.smithi099.stdout:1/25: rename d0/d2/f3 to d0/d2/f7 0 2024-09-17T01:01:47.305 INFO:tasks.workunit.client.1.smithi099.stdout:4/22: dread f1 [0,4194304] 0 2024-09-17T01:01:47.306 INFO:tasks.workunit.client.1.smithi099.stdout:5/95: dread d2/f1b [0,4194304] 0 2024-09-17T01:01:47.306 INFO:tasks.workunit.client.1.smithi099.stdout:5/96: stat d2/f7 0 2024-09-17T01:01:47.306 INFO:tasks.workunit.client.1.smithi099.stdout:9/24: dwrite f4 [4194304,4194304] 0 2024-09-17T01:01:47.306 INFO:tasks.workunit.client.1.smithi099.stdout:9/25: stat c8 0 2024-09-17T01:01:47.307 INFO:tasks.workunit.client.1.smithi099.stdout:5/97: mknod d2/dc/d14/c23 0 2024-09-17T01:01:47.307 INFO:tasks.workunit.client.1.smithi099.stdout:5/98: dread - d2/dc/d14/f16 zero size 2024-09-17T01:01:47.308 INFO:tasks.workunit.client.1.smithi099.stdout:9/26: mknod c9 0 2024-09-17T01:01:47.309 INFO:tasks.workunit.client.1.smithi099.stdout:5/99: symlink d2/d8/l24 0 2024-09-17T01:01:47.309 INFO:tasks.workunit.client.1.smithi099.stdout:5/100: fsync d2/d8/fb 0 2024-09-17T01:01:47.311 INFO:tasks.workunit.client.1.smithi099.stdout:9/27: mkdir da 0 2024-09-17T01:01:47.312 INFO:tasks.workunit.client.1.smithi099.stdout:6/48: getdents dc 0 2024-09-17T01:01:47.314 INFO:tasks.workunit.client.1.smithi099.stdout:1/26: getdents d0/d2 0 2024-09-17T01:01:47.315 INFO:tasks.workunit.client.1.smithi099.stdout:1/27: mkdir d0/d8 0 2024-09-17T01:01:47.317 INFO:tasks.workunit.client.1.smithi099.stdout:6/49: dread fa [0,4194304] 0 2024-09-17T01:01:47.317 INFO:tasks.workunit.client.1.smithi099.stdout:6/50: chown dc/c11 8 1 2024-09-17T01:01:47.317 INFO:tasks.workunit.client.1.smithi099.stdout:6/51: write dc/fe [1368517,59833] 0 2024-09-17T01:01:47.317 INFO:tasks.workunit.client.1.smithi099.stdout:6/52: chown dc 7 1 2024-09-17T01:01:47.318 INFO:tasks.workunit.client.1.smithi099.stdout:6/53: symlink dc/l13 0 2024-09-17T01:01:47.321 INFO:tasks.workunit.client.1.smithi099.stdout:6/54: fdatasync dc/fe 0 2024-09-17T01:01:47.322 INFO:tasks.workunit.client.1.smithi099.stdout:6/55: symlink dc/l14 0 2024-09-17T01:01:47.323 INFO:tasks.workunit.client.1.smithi099.stdout:6/56: link dc/ld dc/l15 0 2024-09-17T01:01:47.327 INFO:tasks.workunit.client.1.smithi099.stdout:6/57: write fa [677238,105148] 0 2024-09-17T01:01:47.333 INFO:tasks.workunit.client.1.smithi099.stdout:5/101: dwrite d2/dc/d14/f16 [0,4194304] 0 2024-09-17T01:01:47.333 INFO:tasks.workunit.client.1.smithi099.stdout:1/28: dread d0/d2/f7 [0,4194304] 0 2024-09-17T01:01:47.335 INFO:tasks.workunit.client.1.smithi099.stdout:1/29: mkdir d0/d2/d9 0 2024-09-17T01:01:47.336 INFO:tasks.workunit.client.1.smithi099.stdout:3/59: dwrite f3 [4194304,4194304] 0 2024-09-17T01:01:47.337 INFO:tasks.workunit.client.1.smithi099.stdout:6/58: dread f7 [0,4194304] 0 2024-09-17T01:01:47.337 INFO:tasks.workunit.client.1.smithi099.stdout:6/59: chown dc/l15 350522446 1 2024-09-17T01:01:47.337 INFO:tasks.workunit.client.1.smithi099.stdout:1/30: truncate d0/d2/f7 3557726 0 2024-09-17T01:01:47.340 INFO:tasks.workunit.client.1.smithi099.stdout:5/102: rmdir d2 39 2024-09-17T01:01:47.341 INFO:tasks.workunit.client.1.smithi099.stdout:5/103: mknod d2/c25 0 2024-09-17T01:01:47.342 INFO:tasks.workunit.client.1.smithi099.stdout:9/28: dwrite f4 [4194304,4194304] 0 2024-09-17T01:01:47.343 INFO:tasks.workunit.client.1.smithi099.stdout:5/104: mkdir d2/d26 0 2024-09-17T01:01:47.343 INFO:tasks.workunit.client.1.smithi099.stdout:5/105: chown d2/dc/d17 5465829 1 2024-09-17T01:01:47.343 INFO:tasks.workunit.client.1.smithi099.stdout:5/106: fdatasync d2/f7 0 2024-09-17T01:01:47.345 INFO:tasks.workunit.client.1.smithi099.stdout:3/60: truncate f3 32510 0 2024-09-17T01:01:47.345 INFO:tasks.workunit.client.1.smithi099.stdout:3/61: creat d9/f14 x:0 0 0 2024-09-17T01:01:47.348 INFO:tasks.workunit.client.1.smithi099.stdout:3/62: mkdir d9/d15 0 2024-09-17T01:01:47.348 INFO:tasks.workunit.client.1.smithi099.stdout:3/63: write f6 [1561834,53047] 0 2024-09-17T01:01:47.348 INFO:tasks.workunit.client.1.smithi099.stdout:3/64: chown d9/c11 29 1 2024-09-17T01:01:47.348 INFO:tasks.workunit.client.1.smithi099.stdout:3/65: stat d9/dc/l13 0 2024-09-17T01:01:47.349 INFO:tasks.workunit.client.1.smithi099.stdout:3/66: mknod d9/d15/c16 0 2024-09-17T01:01:47.350 INFO:tasks.workunit.client.1.smithi099.stdout:3/67: creat d9/dc/f17 x:0 0 0 2024-09-17T01:01:47.351 INFO:tasks.workunit.client.1.smithi099.stdout:9/29: write f6 [7189112,100200] 0 2024-09-17T01:01:47.351 INFO:tasks.workunit.client.1.smithi099.stdout:3/68: unlink d9/f14 0 2024-09-17T01:01:47.352 INFO:tasks.workunit.client.1.smithi099.stdout:9/30: symlink da/lb 0 2024-09-17T01:01:47.353 INFO:tasks.workunit.client.1.smithi099.stdout:9/31: stat c9 0 2024-09-17T01:01:47.357 INFO:tasks.workunit.client.1.smithi099.stdout:5/107: dwrite d2/f18 [0,4194304] 0 2024-09-17T01:01:47.357 INFO:tasks.workunit.client.1.smithi099.stdout:3/69: fdatasync f8 0 2024-09-17T01:01:47.358 INFO:tasks.workunit.client.1.smithi099.stdout:5/108: creat d2/d26/f27 x:0 0 0 2024-09-17T01:01:47.359 INFO:tasks.workunit.client.1.smithi099.stdout:3/70: mkdir d9/d15/d18 0 2024-09-17T01:01:47.368 INFO:tasks.workunit.client.1.smithi099.stdout:5/109: dread d2/fa [0,4194304] 0 2024-09-17T01:01:47.370 INFO:tasks.workunit.client.1.smithi099.stdout:5/110: mknod d2/dc/d17/c28 0 2024-09-17T01:01:47.370 INFO:tasks.workunit.client.1.smithi099.stdout:5/111: chown d2/dc/ff 381 1 2024-09-17T01:01:47.372 INFO:tasks.workunit.client.1.smithi099.stdout:5/112: getdents d2/d26 0 2024-09-17T01:01:47.372 INFO:tasks.workunit.client.1.smithi099.stdout:5/113: truncate d2/dc/d14/d19/f21 1044065 0 2024-09-17T01:01:47.381 INFO:tasks.workunit.client.1.smithi099.stdout:3/71: dwrite d9/dc/f17 [0,4194304] 0 2024-09-17T01:01:47.381 INFO:tasks.workunit.client.1.smithi099.stdout:9/32: dwrite f4 [0,4194304] 0 2024-09-17T01:01:47.381 INFO:tasks.workunit.client.1.smithi099.stdout:9/33: mknod da/cc 0 2024-09-17T01:01:47.386 INFO:tasks.workunit.client.1.smithi099.stdout:9/34: dread f4 [4194304,4194304] 0 2024-09-17T01:01:47.389 INFO:tasks.workunit.client.1.smithi099.stdout:5/114: dwrite d2/f5 [0,4194304] 0 2024-09-17T01:01:47.390 INFO:tasks.workunit.client.1.smithi099.stdout:5/115: truncate d2/dc/ff 2978480 0 2024-09-17T01:01:47.391 INFO:tasks.workunit.client.1.smithi099.stdout:5/116: read - d2/f22 zero size 2024-09-17T01:01:47.392 INFO:tasks.workunit.client.1.smithi099.stdout:9/35: truncate f4 4258564 0 2024-09-17T01:01:47.395 INFO:tasks.workunit.client.1.smithi099.stdout:5/117: write d2/dc/ff [1450099,103084] 0 2024-09-17T01:01:47.396 INFO:tasks.workunit.client.1.smithi099.stdout:5/118: creat d2/d8/f29 x:0 0 0 2024-09-17T01:01:47.397 INFO:tasks.workunit.client.1.smithi099.stdout:5/119: readlink d2/dc/l1e 0 2024-09-17T01:01:47.397 INFO:tasks.workunit.client.1.smithi099.stdout:5/120: write d2/d8/fb [8424362,102276] 0 2024-09-17T01:01:47.397 INFO:tasks.workunit.client.1.smithi099.stdout:9/36: fsync f4 0 2024-09-17T01:01:47.397 INFO:tasks.workunit.client.1.smithi099.stdout:3/72: dwrite d9/f12 [0,4194304] 0 2024-09-17T01:01:47.398 INFO:tasks.workunit.client.1.smithi099.stdout:9/37: mkdir da/dd 0 2024-09-17T01:01:47.400 INFO:tasks.workunit.client.1.smithi099.stdout:3/73: link f6 d9/d15/d18/f19 0 2024-09-17T01:01:47.400 INFO:tasks.workunit.client.1.smithi099.stdout:3/74: write f2 [4950118,82153] 0 2024-09-17T01:01:47.404 INFO:tasks.workunit.client.1.smithi099.stdout:5/121: rmdir d2/d8 39 2024-09-17T01:01:47.405 INFO:tasks.workunit.client.1.smithi099.stdout:5/122: creat d2/d26/f2a x:0 0 0 2024-09-17T01:01:47.405 INFO:tasks.workunit.client.1.smithi099.stdout:5/123: chown d2/dc/l12 3683 1 2024-09-17T01:01:47.406 INFO:tasks.workunit.client.1.smithi099.stdout:5/124: write d2/dc/ff [244704,2801] 0 2024-09-17T01:01:47.410 INFO:tasks.workunit.client.1.smithi099.stdout:5/125: dread d2/f18 [0,4194304] 0 2024-09-17T01:01:47.410 INFO:tasks.workunit.client.1.smithi099.stdout:5/126: fsync d2/f22 0 2024-09-17T01:01:47.410 INFO:tasks.workunit.client.1.smithi099.stdout:5/127: fsync d2/f5 0 2024-09-17T01:01:47.411 INFO:tasks.workunit.client.1.smithi099.stdout:3/75: dread f2 [0,4194304] 0 2024-09-17T01:01:47.411 INFO:tasks.workunit.client.1.smithi099.stdout:3/76: write f6 [2064944,49805] 0 2024-09-17T01:01:47.412 INFO:tasks.workunit.client.1.smithi099.stdout:3/77: mkdir d9/d15/d18/d1a 0 2024-09-17T01:01:47.412 INFO:tasks.workunit.client.1.smithi099.stdout:5/128: dread d2/d8/f15 [0,4194304] 0 2024-09-17T01:01:47.412 INFO:tasks.workunit.client.1.smithi099.stdout:3/78: creat d9/d15/d18/d1a/f1b x:0 0 0 2024-09-17T01:01:47.412 INFO:tasks.workunit.client.1.smithi099.stdout:3/79: dread - d9/f10 zero size 2024-09-17T01:01:47.413 INFO:tasks.workunit.client.1.smithi099.stdout:5/129: symlink d2/l2b 0 2024-09-17T01:01:47.414 INFO:tasks.workunit.client.1.smithi099.stdout:3/80: symlink d9/l1c 0 2024-09-17T01:01:47.414 INFO:tasks.workunit.client.1.smithi099.stdout:9/38: dwrite f6 [4194304,4194304] 0 2024-09-17T01:01:47.414 INFO:tasks.workunit.client.1.smithi099.stdout:5/130: symlink d2/l2c 0 2024-09-17T01:01:47.415 INFO:tasks.workunit.client.1.smithi099.stdout:3/81: symlink d9/l1d 0 2024-09-17T01:01:47.416 INFO:tasks.workunit.client.1.smithi099.stdout:9/39: getdents da 0 2024-09-17T01:01:47.416 INFO:tasks.workunit.client.1.smithi099.stdout:9/40: chown c9 1089942 1 2024-09-17T01:01:47.417 INFO:tasks.workunit.client.1.smithi099.stdout:9/41: rmdir da/dd 0 2024-09-17T01:01:47.423 INFO:tasks.workunit.client.1.smithi099.stdout:3/82: rmdir d9 39 2024-09-17T01:01:47.425 INFO:tasks.workunit.client.1.smithi099.stdout:3/83: symlink d9/dc/l1e 0 2024-09-17T01:01:47.425 INFO:tasks.workunit.client.1.smithi099.stdout:5/131: write d2/f3 [1907061,57750] 0 2024-09-17T01:01:47.425 INFO:tasks.workunit.client.1.smithi099.stdout:5/132: getdents d2/dc/d17 0 2024-09-17T01:01:47.425 INFO:tasks.workunit.client.1.smithi099.stdout:5/133: chown d2/dc/d14/f16 488203531 1 2024-09-17T01:01:47.426 INFO:tasks.workunit.client.1.smithi099.stdout:5/134: readlink d2/l2c 0 2024-09-17T01:01:47.426 INFO:tasks.workunit.client.1.smithi099.stdout:3/84: dread f3 [0,4194304] 0 2024-09-17T01:01:47.426 INFO:tasks.workunit.client.1.smithi099.stdout:3/85: truncate d9/f10 943829 0 2024-09-17T01:01:47.426 INFO:tasks.workunit.client.1.smithi099.stdout:5/135: unlink d2/dc/ff 0 2024-09-17T01:01:47.427 INFO:tasks.workunit.client.1.smithi099.stdout:5/136: write d2/d26/f27 [311939,51098] 0 2024-09-17T01:01:47.427 INFO:tasks.workunit.client.1.smithi099.stdout:9/42: dread f4 [4194304,4194304] 0 2024-09-17T01:01:47.428 INFO:tasks.workunit.client.1.smithi099.stdout:3/86: rename d9/dc/fd to d9/d15/d18/d1a/f1f 0 2024-09-17T01:01:47.428 INFO:tasks.workunit.client.1.smithi099.stdout:3/87: fdatasync d9/d15/d18/d1a/f1b 0 2024-09-17T01:01:47.432 INFO:tasks.workunit.client.1.smithi099.stdout:9/43: dread f4 [4194304,4194304] 0 2024-09-17T01:01:47.452 INFO:tasks.workunit.client.1.smithi099.stdout:5/137: dwrite d2/f22 [0,4194304] 0 2024-09-17T01:01:47.453 INFO:tasks.workunit.client.1.smithi099.stdout:3/88: dwrite d9/d15/d18/f19 [0,4194304] 0 2024-09-17T01:01:47.453 INFO:tasks.workunit.client.1.smithi099.stdout:3/89: readlink d9/l1c 0 2024-09-17T01:01:47.453 INFO:tasks.workunit.client.1.smithi099.stdout:3/90: fsync d9/f10 0 2024-09-17T01:01:47.453 INFO:tasks.workunit.client.1.smithi099.stdout:9/44: dwrite f4 [4194304,4194304] 0 2024-09-17T01:01:47.454 INFO:tasks.workunit.client.1.smithi099.stdout:5/138: symlink d2/d26/l2d 0 2024-09-17T01:01:47.454 INFO:tasks.workunit.client.1.smithi099.stdout:9/45: creat da/fe x:0 0 0 2024-09-17T01:01:47.455 INFO:tasks.workunit.client.1.smithi099.stdout:5/139: mknod d2/d26/c2e 0 2024-09-17T01:01:47.455 INFO:tasks.workunit.client.1.smithi099.stdout:5/140: rename d2/d26 to d2/d26/d2f 22 2024-09-17T01:01:47.455 INFO:tasks.workunit.client.1.smithi099.stdout:9/46: creat da/ff x:0 0 0 2024-09-17T01:01:47.457 INFO:tasks.workunit.client.1.smithi099.stdout:5/141: link d2/d26/c2e d2/dc/d14/d19/c30 0 2024-09-17T01:01:47.457 INFO:tasks.workunit.client.1.smithi099.stdout:5/142: readlink d2/l2c 0 2024-09-17T01:01:47.458 INFO:tasks.workunit.client.1.smithi099.stdout:9/47: creat da/f10 x:0 0 0 2024-09-17T01:01:47.460 INFO:tasks.workunit.client.1.smithi099.stdout:9/48: mknod da/c11 0 2024-09-17T01:01:47.462 INFO:tasks.workunit.client.1.smithi099.stdout:9/49: mknod da/c12 0 2024-09-17T01:01:47.462 INFO:tasks.workunit.client.1.smithi099.stdout:9/50: dread - da/ff zero size 2024-09-17T01:01:47.465 INFO:tasks.workunit.client.1.smithi099.stdout:3/91: dread d9/dc/f17 [0,4194304] 0 2024-09-17T01:01:47.470 INFO:tasks.workunit.client.1.smithi099.stdout:5/143: dwrite d2/d26/f2a [0,4194304] 0 2024-09-17T01:01:47.472 INFO:tasks.workunit.client.1.smithi099.stdout:5/144: symlink d2/l31 0 2024-09-17T01:01:47.473 INFO:tasks.workunit.client.1.smithi099.stdout:5/145: getdents d2/d8 0 2024-09-17T01:01:47.474 INFO:tasks.workunit.client.1.smithi099.stdout:5/146: creat d2/f32 x:0 0 0 2024-09-17T01:01:47.475 INFO:tasks.workunit.client.1.smithi099.stdout:5/147: truncate d2/f5 68201 0 2024-09-17T01:01:47.482 INFO:tasks.workunit.client.1.smithi099.stdout:3/92: dwrite f2 [4194304,4194304] 0 2024-09-17T01:01:47.482 INFO:tasks.workunit.client.1.smithi099.stdout:3/93: fsync f3 0 2024-09-17T01:01:47.483 INFO:tasks.workunit.client.1.smithi099.stdout:3/94: creat d9/d15/d18/f20 x:0 0 0 2024-09-17T01:01:47.488 INFO:tasks.workunit.client.1.smithi099.stdout:9/51: dwrite f6 [0,4194304] 0 2024-09-17T01:01:47.489 INFO:tasks.workunit.client.1.smithi099.stdout:9/52: readlink da/lb 0 2024-09-17T01:01:47.492 INFO:tasks.workunit.client.1.smithi099.stdout:3/95: write d9/d15/d18/f19 [225022,25322] 0 2024-09-17T01:01:47.493 INFO:tasks.workunit.client.1.smithi099.stdout:3/96: rename d9/ca to d9/d15/c21 0 2024-09-17T01:01:47.494 INFO:tasks.workunit.client.1.smithi099.stdout:3/97: chown d9/d15/c21 6 1 2024-09-17T01:01:47.500 INFO:tasks.workunit.client.1.smithi099.stdout:3/98: dread f8 [0,4194304] 0 2024-09-17T01:01:47.501 INFO:tasks.workunit.client.1.smithi099.stdout:3/99: mknod d9/d15/d18/d1a/c22 0 2024-09-17T01:01:47.507 INFO:tasks.workunit.client.1.smithi099.stdout:3/100: rename d9/dc to d9/d15/d18/d1a/d23 0 2024-09-17T01:01:47.508 INFO:tasks.workunit.client.1.smithi099.stdout:3/101: rename d9/l1c to d9/d15/d18/l24 0 2024-09-17T01:01:47.508 INFO:tasks.workunit.client.1.smithi099.stdout:3/102: dread - d9/d15/d18/d1a/f1b zero size 2024-09-17T01:01:47.509 INFO:tasks.workunit.client.1.smithi099.stdout:3/103: creat d9/f25 x:0 0 0 2024-09-17T01:01:47.516 INFO:tasks.workunit.client.0.smithi002.stdout:4/66: creat d7/de/f15 x:0 0 0 2024-09-17T01:01:47.517 INFO:tasks.workunit.client.0.smithi002.stdout:5/49: mkdir d2/dc/dd 0 2024-09-17T01:01:47.520 INFO:tasks.workunit.client.0.smithi002.stdout:4/67: rename d7/fd to d7/f16 0 2024-09-17T01:01:47.523 INFO:tasks.workunit.client.1.smithi099.stdout:3/104: dwrite f2 [4194304,4194304] 0 2024-09-17T01:01:47.525 INFO:tasks.workunit.client.1.smithi099.stdout:3/105: symlink d9/d15/d18/l26 0 2024-09-17T01:01:47.531 INFO:tasks.workunit.client.0.smithi002.stdout:4/68: fsync d7/f14 0 2024-09-17T01:01:47.531 INFO:tasks.workunit.client.0.smithi002.stdout:4/69: write d7/de/f15 [133066,19216] 0 2024-09-17T01:01:47.531 INFO:tasks.workunit.client.0.smithi002.stdout:4/70: chown d7/de/f15 3865 1 2024-09-17T01:01:47.531 INFO:tasks.workunit.client.0.smithi002.stdout:4/71: truncate d7/de/f15 923040 0 2024-09-17T01:01:47.531 INFO:tasks.workunit.client.0.smithi002.stdout:4/72: fdatasync f4 0 2024-09-17T01:01:47.532 INFO:tasks.workunit.client.0.smithi002.stdout:4/73: write d7/f16 [1375793,102953] 0 2024-09-17T01:01:47.533 INFO:tasks.workunit.client.0.smithi002.stdout:4/74: write d7/f16 [316714,37958] 0 2024-09-17T01:01:47.534 INFO:tasks.workunit.client.0.smithi002.stdout:4/75: creat d7/f17 x:0 0 0 2024-09-17T01:01:47.534 INFO:tasks.workunit.client.0.smithi002.stdout:4/76: chown d7/f16 13 1 2024-09-17T01:01:47.537 INFO:tasks.workunit.client.0.smithi002.stdout:5/50: dwrite d2/f4 [8388608,4194304] 0 2024-09-17T01:01:47.583 INFO:tasks.workunit.client.0.smithi002.stdout:5/51: truncate f0 393835 0 2024-09-17T01:01:47.585 INFO:tasks.workunit.client.0.smithi002.stdout:4/77: rmdir d7 39 2024-09-17T01:01:47.592 INFO:tasks.workunit.client.0.smithi002.stdout:4/78: read f0 [4015049,16753] 0 2024-09-17T01:01:47.601 INFO:tasks.workunit.client.0.smithi002.stdout:5/52: dwrite f1 [0,4194304] 0 2024-09-17T01:01:47.695 INFO:tasks.workunit.client.0.smithi002.stdout:4/79: unlink d7/de/c10 0 2024-09-17T01:01:47.695 INFO:tasks.workunit.client.0.smithi002.stdout:4/80: chown d7/de/f15 24 1 2024-09-17T01:01:47.697 INFO:tasks.workunit.client.0.smithi002.stdout:4/81: creat d7/f18 x:0 0 0 2024-09-17T01:01:47.698 INFO:tasks.workunit.client.0.smithi002.stdout:4/82: mkdir d7/d19 0 2024-09-17T01:01:47.699 INFO:tasks.workunit.client.0.smithi002.stdout:4/83: dread d7/f14 [0,4194304] 0 2024-09-17T01:01:47.699 INFO:tasks.workunit.client.0.smithi002.stdout:4/84: dread - d7/f17 zero size 2024-09-17T01:01:47.700 INFO:tasks.workunit.client.0.smithi002.stdout:4/85: mknod d7/c1a 0 2024-09-17T01:01:47.700 INFO:tasks.workunit.client.0.smithi002.stdout:4/86: fsync f4 0 2024-09-17T01:01:47.701 INFO:tasks.workunit.client.0.smithi002.stdout:4/87: truncate f4 1256977 0 2024-09-17T01:01:48.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:47 smithi099 ceph-mon[34357]: pgmap v247: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 8.7 MiB/s rd, 15 MiB/s wr, 928 op/s 2024-09-17T01:01:48.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:47 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:01:48.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:47 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.vswzrb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:01:48.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:47 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:01:48.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:47 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:48.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:47 smithi002 ceph-mon[27650]: pgmap v247: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 8.7 MiB/s rd, 15 MiB/s wr, 928 op/s 2024-09-17T01:01:48.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:47 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:01:48.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:47 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.vswzrb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:01:48.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:47 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:01:48.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:47 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:01:48.677 INFO:tasks.workunit.client.1.smithi099.stdout:2/41: sync 2024-09-17T01:01:48.677 INFO:tasks.workunit.client.1.smithi099.stdout:0/37: sync 2024-09-17T01:01:48.677 INFO:tasks.workunit.client.1.smithi099.stdout:8/24: sync 2024-09-17T01:01:48.678 INFO:tasks.workunit.client.1.smithi099.stdout:7/24: sync 2024-09-17T01:01:48.678 INFO:tasks.workunit.client.1.smithi099.stdout:3/106: sync 2024-09-17T01:01:48.678 INFO:tasks.workunit.client.1.smithi099.stdout:6/60: sync 2024-09-17T01:01:48.678 INFO:tasks.workunit.client.1.smithi099.stdout:0/38: truncate f9 122257 0 2024-09-17T01:01:48.678 INFO:tasks.workunit.client.1.smithi099.stdout:5/148: sync 2024-09-17T01:01:48.678 INFO:tasks.workunit.client.1.smithi099.stdout:7/25: fsync d1/f2 0 2024-09-17T01:01:48.678 INFO:tasks.workunit.client.1.smithi099.stdout:4/23: sync 2024-09-17T01:01:48.678 INFO:tasks.workunit.client.1.smithi099.stdout:1/31: sync 2024-09-17T01:01:48.678 INFO:tasks.workunit.client.1.smithi099.stdout:9/53: sync 2024-09-17T01:01:48.678 INFO:tasks.workunit.client.1.smithi099.stdout:9/54: write da/ff [684178,88245] 0 2024-09-17T01:01:48.678 INFO:tasks.workunit.client.1.smithi099.stdout:2/42: truncate f0 2137727 0 2024-09-17T01:01:48.679 INFO:tasks.workunit.client.1.smithi099.stdout:8/25: mkdir d0 0 2024-09-17T01:01:48.679 INFO:tasks.workunit.client.1.smithi099.stdout:8/26: read - no filename 2024-09-17T01:01:48.680 INFO:tasks.workunit.client.1.smithi099.stdout:8/27: fdatasync - no filename 2024-09-17T01:01:48.680 INFO:tasks.workunit.client.1.smithi099.stdout:8/28: stat d0 0 2024-09-17T01:01:48.680 INFO:tasks.workunit.client.1.smithi099.stdout:8/29: rename d0 to d0/d1 22 2024-09-17T01:01:48.680 INFO:tasks.workunit.client.1.smithi099.stdout:8/30: stat d0 0 2024-09-17T01:01:48.680 INFO:tasks.workunit.client.1.smithi099.stdout:0/39: mkdir da/df 0 2024-09-17T01:01:48.681 INFO:tasks.workunit.client.1.smithi099.stdout:7/26: rename d1/f2 to d1/f4 0 2024-09-17T01:01:48.681 INFO:tasks.workunit.client.1.smithi099.stdout:7/27: dread - d1/f4 zero size 2024-09-17T01:01:48.681 INFO:tasks.workunit.client.1.smithi099.stdout:7/28: write d1/f4 [801716,98703] 0 2024-09-17T01:01:48.682 INFO:tasks.workunit.client.1.smithi099.stdout:1/32: mknod d0/d8/ca 0 2024-09-17T01:01:48.682 INFO:tasks.workunit.client.1.smithi099.stdout:1/33: write d0/d2/f7 [1082314,17467] 0 2024-09-17T01:01:48.693 INFO:tasks.workunit.client.1.smithi099.stdout:6/61: symlink dc/l16 0 2024-09-17T01:01:48.693 INFO:tasks.workunit.client.1.smithi099.stdout:6/62: fdatasync dc/fe 0 2024-09-17T01:01:48.693 INFO:tasks.workunit.client.1.smithi099.stdout:4/24: mkdir d7 0 2024-09-17T01:01:48.693 INFO:tasks.workunit.client.1.smithi099.stdout:8/31: creat d0/f2 x:0 0 0 2024-09-17T01:01:48.693 INFO:tasks.workunit.client.1.smithi099.stdout:8/32: chown d0/f2 0 1 2024-09-17T01:01:48.693 INFO:tasks.workunit.client.1.smithi099.stdout:4/25: read - f6 zero size 2024-09-17T01:01:48.693 INFO:tasks.workunit.client.1.smithi099.stdout:2/43: symlink d2/lf 0 2024-09-17T01:01:48.693 INFO:tasks.workunit.client.1.smithi099.stdout:7/29: mknod d1/c5 0 2024-09-17T01:01:48.693 INFO:tasks.workunit.client.1.smithi099.stdout:1/34: symlink d0/d2/d9/lb 0 2024-09-17T01:01:48.693 INFO:tasks.workunit.client.1.smithi099.stdout:1/35: readlink d0/l1 0 2024-09-17T01:01:48.693 INFO:tasks.workunit.client.1.smithi099.stdout:1/36: readlink d0/d2/d9/lb 0 2024-09-17T01:01:48.694 INFO:tasks.workunit.client.1.smithi099.stdout:9/55: symlink da/l13 0 2024-09-17T01:01:48.694 INFO:tasks.workunit.client.1.smithi099.stdout:9/56: chown da/lb 18707252 1 2024-09-17T01:01:48.694 INFO:tasks.workunit.client.1.smithi099.stdout:7/30: link d1/c5 d1/c6 0 2024-09-17T01:01:48.696 INFO:tasks.workunit.client.1.smithi099.stdout:1/37: creat d0/fc x:0 0 0 2024-09-17T01:01:48.697 INFO:tasks.workunit.client.1.smithi099.stdout:2/44: read d2/f4 [1307437,69836] 0 2024-09-17T01:01:48.697 INFO:tasks.workunit.client.1.smithi099.stdout:2/45: chown d2/f4 504689854 1 2024-09-17T01:01:48.697 INFO:tasks.workunit.client.1.smithi099.stdout:2/46: fsync d2/f3 0 2024-09-17T01:01:48.698 INFO:tasks.workunit.client.1.smithi099.stdout:7/31: mkdir d1/d7 0 2024-09-17T01:01:48.701 INFO:tasks.workunit.client.1.smithi099.stdout:2/47: symlink d2/d8/l10 0 2024-09-17T01:01:48.719 INFO:tasks.workunit.client.1.smithi099.stdout:3/107: dwrite d9/f25 [0,4194304] 0 2024-09-17T01:01:48.719 INFO:tasks.workunit.client.1.smithi099.stdout:3/108: creat d9/f27 x:0 0 0 2024-09-17T01:01:48.719 INFO:tasks.workunit.client.1.smithi099.stdout:4/26: dwrite f2 [4194304,4194304] 0 2024-09-17T01:01:48.721 INFO:tasks.workunit.client.1.smithi099.stdout:0/40: dwrite f9 [0,4194304] 0 2024-09-17T01:01:48.722 INFO:tasks.workunit.client.1.smithi099.stdout:5/149: dwrite d2/d8/f29 [0,4194304] 0 2024-09-17T01:01:48.722 INFO:tasks.workunit.client.1.smithi099.stdout:5/150: write d2/d8/f10 [4848262,30161] 0 2024-09-17T01:01:48.722 INFO:tasks.workunit.client.1.smithi099.stdout:5/151: fdatasync d2/d26/f2a 0 2024-09-17T01:01:48.725 INFO:tasks.workunit.client.1.smithi099.stdout:1/38: dread d0/d2/f7 [0,4194304] 0 2024-09-17T01:01:48.725 INFO:tasks.workunit.client.1.smithi099.stdout:4/27: creat d7/f8 x:0 0 0 2024-09-17T01:01:48.725 INFO:tasks.workunit.client.1.smithi099.stdout:4/28: write d7/f8 [265656,38113] 0 2024-09-17T01:01:48.725 INFO:tasks.workunit.client.1.smithi099.stdout:4/29: write d7/f8 [506664,113100] 0 2024-09-17T01:01:48.725 INFO:tasks.workunit.client.1.smithi099.stdout:4/30: dread - f6 zero size 2024-09-17T01:01:48.726 INFO:tasks.workunit.client.1.smithi099.stdout:7/32: dread d1/f4 [0,4194304] 0 2024-09-17T01:01:48.727 INFO:tasks.workunit.client.1.smithi099.stdout:6/63: dwrite fa [0,4194304] 0 2024-09-17T01:01:48.731 INFO:tasks.workunit.client.1.smithi099.stdout:8/33: fsync d0/f2 0 2024-09-17T01:01:48.731 INFO:tasks.workunit.client.1.smithi099.stdout:8/34: creat d0/f3 x:0 0 0 2024-09-17T01:01:48.732 INFO:tasks.workunit.client.1.smithi099.stdout:8/35: chown d0/f3 1161 1 2024-09-17T01:01:48.732 INFO:tasks.workunit.client.1.smithi099.stdout:8/36: truncate d0/f3 210989 0 2024-09-17T01:01:48.732 INFO:tasks.workunit.client.1.smithi099.stdout:5/152: mknod d2/d8/c33 0 2024-09-17T01:01:48.732 INFO:tasks.workunit.client.1.smithi099.stdout:4/31: dread f2 [0,4194304] 0 2024-09-17T01:01:48.733 INFO:tasks.workunit.client.1.smithi099.stdout:4/32: write d7/f8 [525692,74907] 0 2024-09-17T01:01:48.735 INFO:tasks.workunit.client.1.smithi099.stdout:9/57: rmdir da 39 2024-09-17T01:01:48.739 INFO:tasks.workunit.client.1.smithi099.stdout:7/33: mknod d1/c8 0 2024-09-17T01:01:48.739 INFO:tasks.workunit.client.1.smithi099.stdout:7/34: chown d1/f4 20 1 2024-09-17T01:01:48.740 INFO:tasks.workunit.client.1.smithi099.stdout:7/35: chown c0 34260146 1 2024-09-17T01:01:48.742 INFO:tasks.workunit.client.1.smithi099.stdout:0/41: dwrite f5 [0,4194304] 0 2024-09-17T01:01:48.742 INFO:tasks.workunit.client.1.smithi099.stdout:8/37: mkdir d0/d4 0 2024-09-17T01:01:48.745 INFO:tasks.workunit.client.1.smithi099.stdout:5/153: mknod d2/dc/d14/d19/c34 0 2024-09-17T01:01:48.745 INFO:tasks.workunit.client.1.smithi099.stdout:5/154: stat d2/dc/d14/d19/c34 0 2024-09-17T01:01:48.745 INFO:tasks.workunit.client.1.smithi099.stdout:9/58: read f6 [7992606,68179] 0 2024-09-17T01:01:48.746 INFO:tasks.workunit.client.1.smithi099.stdout:4/33: mknod d7/c9 0 2024-09-17T01:01:48.748 INFO:tasks.workunit.client.1.smithi099.stdout:3/109: getdents d9 0 2024-09-17T01:01:48.751 INFO:tasks.workunit.client.1.smithi099.stdout:1/39: truncate d0/d2/f7 15313 0 2024-09-17T01:01:48.751 INFO:tasks.workunit.client.1.smithi099.stdout:1/40: chown d0/fc 41150014 1 2024-09-17T01:01:48.753 INFO:tasks.workunit.client.1.smithi099.stdout:6/64: rename c8 to dc/c17 0 2024-09-17T01:01:48.753 INFO:tasks.workunit.client.1.smithi099.stdout:6/65: readlink dc/ld 0 2024-09-17T01:01:48.753 INFO:tasks.workunit.client.1.smithi099.stdout:6/66: dread - dc/ff zero size 2024-09-17T01:01:48.753 INFO:tasks.workunit.client.1.smithi099.stdout:6/67: write dc/ff [101642,71508] 0 2024-09-17T01:01:48.755 INFO:tasks.workunit.client.1.smithi099.stdout:0/42: dread f7 [0,4194304] 0 2024-09-17T01:01:48.755 INFO:tasks.workunit.client.1.smithi099.stdout:0/43: readlink l6 0 2024-09-17T01:01:48.755 INFO:tasks.workunit.client.1.smithi099.stdout:8/38: symlink d0/l5 0 2024-09-17T01:01:48.756 INFO:tasks.workunit.client.1.smithi099.stdout:8/39: chown d0/l5 34237359 1 2024-09-17T01:01:48.756 INFO:tasks.workunit.client.1.smithi099.stdout:8/40: truncate d0/f2 285659 0 2024-09-17T01:01:48.756 INFO:tasks.workunit.client.1.smithi099.stdout:5/155: creat d2/d8/f35 x:0 0 0 2024-09-17T01:01:48.756 INFO:tasks.workunit.client.1.smithi099.stdout:5/156: write d2/d8/f35 [249553,66770] 0 2024-09-17T01:01:48.757 INFO:tasks.workunit.client.1.smithi099.stdout:7/36: dwrite d1/f4 [0,4194304] 0 2024-09-17T01:01:48.758 INFO:tasks.workunit.client.1.smithi099.stdout:9/59: truncate f6 7169715 0 2024-09-17T01:01:48.759 INFO:tasks.workunit.client.1.smithi099.stdout:6/68: creat dc/f18 x:0 0 0 2024-09-17T01:01:48.761 INFO:tasks.workunit.client.1.smithi099.stdout:5/157: mkdir d2/dc/d14/d36 0 2024-09-17T01:01:48.765 INFO:tasks.workunit.client.1.smithi099.stdout:9/60: mkdir da/d14 0 2024-09-17T01:01:48.767 INFO:tasks.workunit.client.1.smithi099.stdout:6/69: mknod dc/c19 0 2024-09-17T01:01:48.767 INFO:tasks.workunit.client.1.smithi099.stdout:6/70: stat fa 0 2024-09-17T01:01:48.768 INFO:tasks.workunit.client.1.smithi099.stdout:5/158: mknod d2/dc/c37 0 2024-09-17T01:01:48.768 INFO:tasks.workunit.client.1.smithi099.stdout:5/159: write d2/f7 [564610,88780] 0 2024-09-17T01:01:48.768 INFO:tasks.workunit.client.1.smithi099.stdout:5/160: chown d2/dc/d14 20667 1 2024-09-17T01:01:48.770 INFO:tasks.workunit.client.1.smithi099.stdout:9/61: mknod da/c15 0 2024-09-17T01:01:48.770 INFO:tasks.workunit.client.1.smithi099.stdout:9/62: readlink l7 0 2024-09-17T01:01:48.777 INFO:tasks.workunit.client.1.smithi099.stdout:6/71: write fa [1469159,51900] 0 2024-09-17T01:01:48.777 INFO:tasks.workunit.client.1.smithi099.stdout:4/34: dwrite f2 [4194304,4194304] 0 2024-09-17T01:01:48.777 INFO:tasks.workunit.client.1.smithi099.stdout:4/35: creat d7/fa x:0 0 0 2024-09-17T01:01:48.777 INFO:tasks.workunit.client.1.smithi099.stdout:4/36: write f2 [9306849,28570] 0 2024-09-17T01:01:48.778 INFO:tasks.workunit.client.1.smithi099.stdout:3/110: dwrite d9/f27 [0,4194304] 0 2024-09-17T01:01:48.778 INFO:tasks.workunit.client.1.smithi099.stdout:3/111: write d9/d15/d18/f20 [554579,25789] 0 2024-09-17T01:01:48.778 INFO:tasks.workunit.client.1.smithi099.stdout:3/112: chown d9/cb 13433 1 2024-09-17T01:01:48.779 INFO:tasks.workunit.client.1.smithi099.stdout:3/113: readlink d9/d15/d18/l26 0 2024-09-17T01:01:48.779 INFO:tasks.workunit.client.1.smithi099.stdout:3/114: read - d9/d15/d18/d1a/f1b zero size 2024-09-17T01:01:48.779 INFO:tasks.workunit.client.1.smithi099.stdout:3/115: chown d9/d15/d18/l24 51689836 1 2024-09-17T01:01:48.779 INFO:tasks.workunit.client.1.smithi099.stdout:3/116: write d9/d15/d18/f19 [4998990,117974] 0 2024-09-17T01:01:48.779 INFO:tasks.workunit.client.1.smithi099.stdout:0/44: dwrite f7 [4194304,4194304] 0 2024-09-17T01:01:48.779 INFO:tasks.workunit.client.1.smithi099.stdout:0/45: getdents da/df 0 2024-09-17T01:01:48.786 INFO:tasks.workunit.client.1.smithi099.stdout:6/72: dread fa [0,4194304] 0 2024-09-17T01:01:48.787 INFO:tasks.workunit.client.1.smithi099.stdout:3/117: mknod d9/d15/d18/d1a/d23/c28 0 2024-09-17T01:01:48.789 INFO:tasks.workunit.client.1.smithi099.stdout:8/41: truncate d0/f2 17581 0 2024-09-17T01:01:48.789 INFO:tasks.workunit.client.1.smithi099.stdout:8/42: write d0/f3 [624405,68039] 0 2024-09-17T01:01:48.789 INFO:tasks.workunit.client.1.smithi099.stdout:8/43: creat d0/f6 x:0 0 0 2024-09-17T01:01:48.790 INFO:tasks.workunit.client.1.smithi099.stdout:0/46: dread f7 [0,4194304] 0 2024-09-17T01:01:48.793 INFO:tasks.workunit.client.1.smithi099.stdout:5/161: dwrite d2/f22 [0,4194304] 0 2024-09-17T01:01:48.799 INFO:tasks.workunit.client.1.smithi099.stdout:9/63: dwrite da/f10 [0,4194304] 0 2024-09-17T01:01:48.800 INFO:tasks.workunit.client.1.smithi099.stdout:6/73: mkdir dc/d1a 0 2024-09-17T01:01:48.800 INFO:tasks.workunit.client.1.smithi099.stdout:5/162: rename d2/d8/l1a to d2/dc/d14/l38 0 2024-09-17T01:01:48.801 INFO:tasks.workunit.client.1.smithi099.stdout:4/37: rmdir d7 39 2024-09-17T01:01:48.801 INFO:tasks.workunit.client.1.smithi099.stdout:4/38: chown d7/f8 23639 1 2024-09-17T01:01:48.801 INFO:tasks.workunit.client.1.smithi099.stdout:0/47: write f5 [165364,19182] 0 2024-09-17T01:01:48.801 INFO:tasks.workunit.client.1.smithi099.stdout:4/39: dread - f6 zero size 2024-09-17T01:01:48.803 INFO:tasks.workunit.client.1.smithi099.stdout:1/41: dwrite d0/d2/f7 [0,4194304] 0 2024-09-17T01:01:48.803 INFO:tasks.workunit.client.1.smithi099.stdout:1/42: write d0/fc [559007,21734] 0 2024-09-17T01:01:48.803 INFO:tasks.workunit.client.1.smithi099.stdout:1/43: chown d0/l1 182850217 1 2024-09-17T01:01:48.808 INFO:tasks.workunit.client.1.smithi099.stdout:5/163: dread d2/f7 [0,4194304] 0 2024-09-17T01:01:48.809 INFO:tasks.workunit.client.1.smithi099.stdout:5/164: chown d2/d8/f15 412565894 1 2024-09-17T01:01:48.809 INFO:tasks.workunit.client.1.smithi099.stdout:6/74: rename dc/ff to dc/d1a/f1b 0 2024-09-17T01:01:48.810 INFO:tasks.workunit.client.1.smithi099.stdout:5/165: write d2/f18 [1540767,38242] 0 2024-09-17T01:01:48.810 INFO:tasks.workunit.client.1.smithi099.stdout:5/166: truncate d2/dc/d14/f20 969736 0 2024-09-17T01:01:48.810 INFO:tasks.workunit.client.1.smithi099.stdout:5/167: chown d2/d8/c13 3 1 2024-09-17T01:01:48.810 INFO:tasks.workunit.client.1.smithi099.stdout:4/40: link f2 d7/fb 0 2024-09-17T01:01:48.811 INFO:tasks.workunit.client.1.smithi099.stdout:6/75: write dc/fe [1288133,65532] 0 2024-09-17T01:01:48.811 INFO:tasks.workunit.client.1.smithi099.stdout:1/44: mknod d0/cd 0 2024-09-17T01:01:48.813 INFO:tasks.workunit.client.1.smithi099.stdout:8/44: unlink d0/f2 0 2024-09-17T01:01:48.815 INFO:tasks.workunit.client.1.smithi099.stdout:5/168: creat d2/dc/f39 x:0 0 0 2024-09-17T01:01:48.815 INFO:tasks.workunit.client.1.smithi099.stdout:4/41: chown l0 1085 1 2024-09-17T01:01:48.817 INFO:tasks.workunit.client.1.smithi099.stdout:9/64: dwrite f4 [4194304,4194304] 0 2024-09-17T01:01:48.817 INFO:tasks.workunit.client.1.smithi099.stdout:9/65: truncate da/fe 979232 0 2024-09-17T01:01:48.818 INFO:tasks.workunit.client.1.smithi099.stdout:6/76: rename lb to dc/d1a/l1c 0 2024-09-17T01:01:48.819 INFO:tasks.workunit.client.1.smithi099.stdout:1/45: dread d0/fc [0,4194304] 0 2024-09-17T01:01:48.820 INFO:tasks.workunit.client.1.smithi099.stdout:4/42: link f1 d7/fc 0 2024-09-17T01:01:48.820 INFO:tasks.workunit.client.1.smithi099.stdout:9/66: chown da/cc 9682 1 2024-09-17T01:01:48.822 INFO:tasks.workunit.client.1.smithi099.stdout:8/45: truncate d0/f3 236306 0 2024-09-17T01:01:48.822 INFO:tasks.workunit.client.1.smithi099.stdout:5/169: dread d2/fa [0,4194304] 0 2024-09-17T01:01:48.823 INFO:tasks.workunit.client.1.smithi099.stdout:1/46: mkdir d0/d2/de 0 2024-09-17T01:01:48.825 INFO:tasks.workunit.client.1.smithi099.stdout:4/43: unlink d7/c9 0 2024-09-17T01:01:48.825 INFO:tasks.workunit.client.1.smithi099.stdout:4/44: write d7/fa [425888,98661] 0 2024-09-17T01:01:48.825 INFO:tasks.workunit.client.1.smithi099.stdout:6/77: mknod dc/c1d 0 2024-09-17T01:01:48.828 INFO:tasks.workunit.client.1.smithi099.stdout:5/170: creat d2/dc/d17/f3a x:0 0 0 2024-09-17T01:01:48.828 INFO:tasks.workunit.client.1.smithi099.stdout:5/171: write d2/f22 [4362227,642] 0 2024-09-17T01:01:48.829 INFO:tasks.workunit.client.1.smithi099.stdout:1/47: getdents d0/d8 0 2024-09-17T01:01:48.829 INFO:tasks.workunit.client.1.smithi099.stdout:4/45: mkdir d7/dd 0 2024-09-17T01:01:48.830 INFO:tasks.workunit.client.1.smithi099.stdout:4/46: truncate f1 4967351 0 2024-09-17T01:01:48.831 INFO:tasks.workunit.client.1.smithi099.stdout:5/172: truncate d2/d26/f2a 3093844 0 2024-09-17T01:01:48.833 INFO:tasks.workunit.client.1.smithi099.stdout:1/48: rename d0/d2/f7 to d0/d2/ff 0 2024-09-17T01:01:48.835 INFO:tasks.workunit.client.1.smithi099.stdout:5/173: mknod d2/d26/c3b 0 2024-09-17T01:01:48.838 INFO:tasks.workunit.client.1.smithi099.stdout:9/67: dwrite f4 [4194304,4194304] 0 2024-09-17T01:01:48.839 INFO:tasks.workunit.client.1.smithi099.stdout:5/174: truncate d2/d8/fb 3302862 0 2024-09-17T01:01:48.841 INFO:tasks.workunit.client.1.smithi099.stdout:8/46: unlink d0/f3 0 2024-09-17T01:01:48.841 INFO:tasks.workunit.client.1.smithi099.stdout:8/47: read - d0/f6 zero size 2024-09-17T01:01:48.842 INFO:tasks.workunit.client.1.smithi099.stdout:6/78: dwrite dc/f18 [0,4194304] 0 2024-09-17T01:01:48.842 INFO:tasks.workunit.client.1.smithi099.stdout:5/175: mkdir d2/dc/d17/d3c 0 2024-09-17T01:01:48.844 INFO:tasks.workunit.client.1.smithi099.stdout:9/68: rename l5 to da/l16 0 2024-09-17T01:01:48.844 INFO:tasks.workunit.client.1.smithi099.stdout:4/47: rmdir d7 39 2024-09-17T01:01:48.845 INFO:tasks.workunit.client.1.smithi099.stdout:8/48: link d0/f6 d0/d4/f7 0 2024-09-17T01:01:48.845 INFO:tasks.workunit.client.1.smithi099.stdout:8/49: write d0/d4/f7 [397957,56123] 0 2024-09-17T01:01:48.845 INFO:tasks.workunit.client.1.smithi099.stdout:8/50: chown d0/f6 1198782305 1 2024-09-17T01:01:48.846 INFO:tasks.workunit.client.1.smithi099.stdout:6/79: dread fa [0,4194304] 0 2024-09-17T01:01:48.849 INFO:tasks.workunit.client.1.smithi099.stdout:1/49: link d0/d2/ff d0/f10 0 2024-09-17T01:01:48.850 INFO:tasks.workunit.client.1.smithi099.stdout:8/51: dread d0/f6 [0,4194304] 0 2024-09-17T01:01:48.852 INFO:tasks.workunit.client.1.smithi099.stdout:4/48: mkdir d7/dd/de 0 2024-09-17T01:01:48.855 INFO:tasks.workunit.client.1.smithi099.stdout:1/50: symlink d0/d2/de/l11 0 2024-09-17T01:01:48.855 INFO:tasks.workunit.client.1.smithi099.stdout:1/51: chown d0 2526 1 2024-09-17T01:01:48.855 INFO:tasks.workunit.client.1.smithi099.stdout:1/52: fdatasync d0/d2/ff 0 2024-09-17T01:01:48.857 INFO:tasks.workunit.client.1.smithi099.stdout:8/52: mkdir d0/d8 0 2024-09-17T01:01:48.858 INFO:tasks.workunit.client.1.smithi099.stdout:5/176: dread d2/d8/fb [0,4194304] 0 2024-09-17T01:01:48.859 INFO:tasks.workunit.client.1.smithi099.stdout:5/177: dread - d2/f32 zero size 2024-09-17T01:01:48.859 INFO:tasks.workunit.client.1.smithi099.stdout:9/69: rename da/c15 to da/c17 0 2024-09-17T01:01:48.860 INFO:tasks.workunit.client.1.smithi099.stdout:9/70: write da/ff [347180,82246] 0 2024-09-17T01:01:48.861 INFO:tasks.workunit.client.1.smithi099.stdout:8/53: getdents d0/d4 0 2024-09-17T01:01:48.861 INFO:tasks.workunit.client.1.smithi099.stdout:8/54: chown d0/l5 237481335 1 2024-09-17T01:01:48.862 INFO:tasks.workunit.client.1.smithi099.stdout:5/178: mknod d2/dc/d17/d3c/c3d 0 2024-09-17T01:01:48.862 INFO:tasks.workunit.client.1.smithi099.stdout:5/179: fsync d2/f5 0 2024-09-17T01:01:48.862 INFO:tasks.workunit.client.1.smithi099.stdout:5/180: truncate d2/f7 1558767 0 2024-09-17T01:01:48.864 INFO:tasks.workunit.client.1.smithi099.stdout:8/55: rename d0/l5 to d0/d4/l9 0 2024-09-17T01:01:48.866 INFO:tasks.workunit.client.1.smithi099.stdout:5/181: rename d2/d8/f10 to d2/dc/d14/d36/f3e 0 2024-09-17T01:01:48.866 INFO:tasks.workunit.client.1.smithi099.stdout:5/182: chown d2/dc/c37 36 1 2024-09-17T01:01:48.867 INFO:tasks.workunit.client.1.smithi099.stdout:8/56: creat d0/d4/fa x:0 0 0 2024-09-17T01:01:48.869 INFO:tasks.workunit.client.1.smithi099.stdout:5/183: creat d2/dc/d14/d19/f3f x:0 0 0 2024-09-17T01:01:48.869 INFO:tasks.workunit.client.1.smithi099.stdout:5/184: chown d2/d26/l2d 2014285 1 2024-09-17T01:01:48.869 INFO:tasks.workunit.client.1.smithi099.stdout:5/185: creat d2/f40 x:0 0 0 2024-09-17T01:01:48.872 INFO:tasks.workunit.client.1.smithi099.stdout:6/80: dwrite dc/f18 [0,4194304] 0 2024-09-17T01:01:48.872 INFO:tasks.workunit.client.1.smithi099.stdout:6/81: write dc/fe [263209,63496] 0 2024-09-17T01:01:48.872 INFO:tasks.workunit.client.1.smithi099.stdout:9/71: write da/f10 [2121163,34786] 0 2024-09-17T01:01:48.872 INFO:tasks.workunit.client.1.smithi099.stdout:6/82: write dc/d1a/f1b [34411,67441] 0 2024-09-17T01:01:48.874 INFO:tasks.workunit.client.1.smithi099.stdout:1/53: truncate d0/f10 1740250 0 2024-09-17T01:01:48.875 INFO:tasks.workunit.client.1.smithi099.stdout:8/57: link d0/d4/fa d0/d4/fb 0 2024-09-17T01:01:48.878 INFO:tasks.workunit.client.1.smithi099.stdout:5/186: rmdir d2/d26 39 2024-09-17T01:01:48.878 INFO:tasks.workunit.client.1.smithi099.stdout:5/187: stat d2/f1b 0 2024-09-17T01:01:48.878 INFO:tasks.workunit.client.1.smithi099.stdout:5/188: dread - d2/f40 zero size 2024-09-17T01:01:48.879 INFO:tasks.workunit.client.1.smithi099.stdout:6/83: creat dc/d1a/f1e x:0 0 0 2024-09-17T01:01:48.885 INFO:tasks.workunit.client.1.smithi099.stdout:8/58: unlink d0/f6 0 2024-09-17T01:01:48.886 INFO:tasks.workunit.client.1.smithi099.stdout:9/72: mkdir da/d18 0 2024-09-17T01:01:48.887 INFO:tasks.workunit.client.1.smithi099.stdout:4/49: dwrite d7/fa [0,4194304] 0 2024-09-17T01:01:48.889 INFO:tasks.workunit.client.1.smithi099.stdout:4/50: read d7/fb [8715279,4494] 0 2024-09-17T01:01:48.890 INFO:tasks.workunit.client.1.smithi099.stdout:5/189: rename d2/dc/d14/d19/c34 to d2/dc/d14/d19/c41 0 2024-09-17T01:01:48.891 INFO:tasks.workunit.client.1.smithi099.stdout:1/54: dread d0/f10 [0,4194304] 0 2024-09-17T01:01:48.891 INFO:tasks.workunit.client.1.smithi099.stdout:1/55: stat d0/fc 0 2024-09-17T01:01:48.891 INFO:tasks.workunit.client.1.smithi099.stdout:6/84: symlink dc/d1a/l1f 0 2024-09-17T01:01:48.894 INFO:tasks.workunit.client.1.smithi099.stdout:1/56: dread d0/d2/ff [0,4194304] 0 2024-09-17T01:01:48.894 INFO:tasks.workunit.client.1.smithi099.stdout:1/57: chown d0/f10 21389 1 2024-09-17T01:01:48.895 INFO:tasks.workunit.client.1.smithi099.stdout:4/51: link f2 d7/dd/de/ff 0 2024-09-17T01:01:48.895 INFO:tasks.workunit.client.1.smithi099.stdout:6/85: dread dc/fe [0,4194304] 0 2024-09-17T01:01:48.896 INFO:tasks.workunit.client.1.smithi099.stdout:5/190: unlink d2/dc/d14/d36/f3e 0 2024-09-17T01:01:48.898 INFO:tasks.workunit.client.1.smithi099.stdout:1/58: rename d0/cd to d0/d2/de/c12 0 2024-09-17T01:01:48.898 INFO:tasks.workunit.client.1.smithi099.stdout:6/86: dread fa [0,4194304] 0 2024-09-17T01:01:48.898 INFO:tasks.workunit.client.1.smithi099.stdout:6/87: chown dc/d1a/f1e 28927062 1 2024-09-17T01:01:48.899 INFO:tasks.workunit.client.1.smithi099.stdout:4/52: mkdir d7/dd/de/d10 0 2024-09-17T01:01:48.899 INFO:tasks.workunit.client.1.smithi099.stdout:1/59: read d0/fc [312088,125783] 0 2024-09-17T01:01:48.899 INFO:tasks.workunit.client.1.smithi099.stdout:5/191: creat d2/dc/f42 x:0 0 0 2024-09-17T01:01:48.901 INFO:tasks.workunit.client.1.smithi099.stdout:4/53: truncate d7/dd/de/ff 6952558 0 2024-09-17T01:01:48.902 INFO:tasks.workunit.client.1.smithi099.stdout:9/73: dwrite f6 [8388608,4194304] 0 2024-09-17T01:01:48.902 INFO:tasks.workunit.client.1.smithi099.stdout:9/74: write da/ff [1705272,299] 0 2024-09-17T01:01:48.902 INFO:tasks.workunit.client.1.smithi099.stdout:5/192: mkdir d2/dc/d14/d36/d43 0 2024-09-17T01:01:48.903 INFO:tasks.workunit.client.1.smithi099.stdout:9/75: write da/fe [282598,69313] 0 2024-09-17T01:01:48.904 INFO:tasks.workunit.client.1.smithi099.stdout:4/54: mkdir d7/dd/de/d10/d11 0 2024-09-17T01:01:48.905 INFO:tasks.workunit.client.1.smithi099.stdout:4/55: chown d7/dd/de/ff 133 1 2024-09-17T01:01:48.906 INFO:tasks.workunit.client.1.smithi099.stdout:9/76: symlink da/d18/l19 0 2024-09-17T01:01:48.911 INFO:tasks.workunit.client.1.smithi099.stdout:5/193: dread d2/d8/f29 [0,4194304] 0 2024-09-17T01:01:48.911 INFO:tasks.workunit.client.1.smithi099.stdout:5/194: fdatasync d2/f1b 0 2024-09-17T01:01:48.911 INFO:tasks.workunit.client.1.smithi099.stdout:5/195: fsync d2/f32 0 2024-09-17T01:01:48.911 INFO:tasks.workunit.client.1.smithi099.stdout:5/196: stat d2/dc/d17 0 2024-09-17T01:01:48.911 INFO:tasks.workunit.client.1.smithi099.stdout:5/197: write d2/f32 [807630,104627] 0 2024-09-17T01:01:48.912 INFO:tasks.workunit.client.1.smithi099.stdout:6/88: rmdir dc 39 2024-09-17T01:01:48.914 INFO:tasks.workunit.client.1.smithi099.stdout:6/89: symlink dc/l20 0 2024-09-17T01:01:48.914 INFO:tasks.workunit.client.1.smithi099.stdout:6/90: chown dc/d1a/l1c 331 1 2024-09-17T01:01:48.918 INFO:tasks.workunit.client.1.smithi099.stdout:6/91: link dc/fe dc/f21 0 2024-09-17T01:01:48.921 INFO:tasks.workunit.client.1.smithi099.stdout:6/92: mknod dc/d1a/c22 0 2024-09-17T01:01:48.921 INFO:tasks.workunit.client.1.smithi099.stdout:9/77: getdents da/d18 0 2024-09-17T01:01:48.935 INFO:tasks.workunit.client.1.smithi099.stdout:4/56: dwrite d7/fb [4194304,4194304] 0 2024-09-17T01:01:48.935 INFO:tasks.workunit.client.1.smithi099.stdout:4/57: truncate d7/dd/de/ff 8929834 0 2024-09-17T01:01:48.936 INFO:tasks.workunit.client.1.smithi099.stdout:6/93: dwrite dc/fe [0,4194304] 0 2024-09-17T01:01:48.936 INFO:tasks.workunit.client.1.smithi099.stdout:6/94: chown dc/l15 3 1 2024-09-17T01:01:48.936 INFO:tasks.workunit.client.1.smithi099.stdout:4/58: creat d7/dd/f12 x:0 0 0 2024-09-17T01:01:48.937 INFO:tasks.workunit.client.1.smithi099.stdout:6/95: unlink l3 0 2024-09-17T01:01:48.937 INFO:tasks.workunit.client.1.smithi099.stdout:6/96: read fa [1136596,90461] 0 2024-09-17T01:01:48.938 INFO:tasks.workunit.client.1.smithi099.stdout:4/59: symlink d7/dd/de/l13 0 2024-09-17T01:01:48.979 INFO:tasks.workunit.client.1.smithi099.stdout:6/97: dwrite dc/fe [0,4194304] 0 2024-09-17T01:01:48.979 INFO:tasks.workunit.client.1.smithi099.stdout:4/60: dwrite d7/f8 [0,4194304] 0 2024-09-17T01:01:48.986 INFO:tasks.workunit.client.1.smithi099.stdout:6/98: dread f7 [0,4194304] 0 2024-09-17T01:01:48.986 INFO:tasks.workunit.client.1.smithi099.stdout:6/99: truncate dc/f18 4918085 0 2024-09-17T01:01:48.999 INFO:tasks.workunit.client.1.smithi099.stdout:4/61: dwrite d7/fb [4194304,4194304] 0 2024-09-17T01:01:49.000 INFO:tasks.workunit.client.1.smithi099.stdout:6/100: dwrite dc/f21 [4194304,4194304] 0 2024-09-17T01:01:49.000 INFO:tasks.workunit.client.1.smithi099.stdout:4/62: creat d7/dd/de/f14 x:0 0 0 2024-09-17T01:01:49.002 INFO:tasks.workunit.client.1.smithi099.stdout:4/63: rename d7/dd/de/l13 to d7/dd/l15 0 2024-09-17T01:01:49.004 INFO:tasks.workunit.client.1.smithi099.stdout:4/64: rmdir d7/dd/de/d10/d11 0 2024-09-17T01:01:49.005 INFO:tasks.workunit.client.1.smithi099.stdout:4/65: creat d7/f16 x:0 0 0 2024-09-17T01:01:49.005 INFO:tasks.workunit.client.1.smithi099.stdout:4/66: mkdir d7/dd/de/d17 0 2024-09-17T01:01:49.005 INFO:tasks.workunit.client.1.smithi099.stdout:4/67: chown d7/dd/de 0 1 2024-09-17T01:01:49.006 INFO:tasks.workunit.client.1.smithi099.stdout:4/68: mkdir d7/dd/de/d10/d18 0 2024-09-17T01:01:49.006 INFO:tasks.workunit.client.1.smithi099.stdout:4/69: mknod d7/dd/de/d10/c19 0 2024-09-17T01:01:49.016 INFO:tasks.workunit.client.1.smithi099.stdout:6/101: dwrite f7 [0,4194304] 0 2024-09-17T01:01:49.024 INFO:tasks.workunit.client.1.smithi099.stdout:6/102: write f7 [279821,89864] 0 2024-09-17T01:01:49.024 INFO:tasks.workunit.client.1.smithi099.stdout:6/103: rename dc/d1a to dc/d1a/d23 22 2024-09-17T01:01:49.030 INFO:tasks.workunit.client.1.smithi099.stdout:4/70: dwrite d7/fc [4194304,4194304] 0 2024-09-17T01:01:49.038 INFO:tasks.workunit.client.1.smithi099.stdout:4/71: dread f1 [4194304,4194304] 0 2024-09-17T01:01:49.038 INFO:tasks.workunit.client.1.smithi099.stdout:6/104: dwrite fa [0,4194304] 0 2024-09-17T01:01:49.040 INFO:tasks.workunit.client.1.smithi099.stdout:4/72: mkdir d7/dd/de/d10/d1a 0 2024-09-17T01:01:49.040 INFO:tasks.workunit.client.1.smithi099.stdout:4/73: fdatasync d7/dd/f12 0 2024-09-17T01:01:49.040 INFO:tasks.workunit.client.1.smithi099.stdout:4/74: write f6 [640250,23391] 0 2024-09-17T01:01:49.041 INFO:tasks.workunit.client.1.smithi099.stdout:6/105: rmdir dc 39 2024-09-17T01:01:49.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:48 smithi099 ceph-mon[34357]: Upgrade: Updating mgr.smithi099.vswzrb 2024-09-17T01:01:49.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:48 smithi099 ceph-mon[34357]: Deploying daemon mgr.smithi099.vswzrb on smithi099 2024-09-17T01:01:49.047 INFO:tasks.workunit.client.1.smithi099.stdout:4/75: mkdir d7/dd/de/d1b 0 2024-09-17T01:01:49.049 INFO:tasks.workunit.client.1.smithi099.stdout:4/76: mkdir d7/dd/de/d1b/d1c 0 2024-09-17T01:01:49.049 INFO:tasks.workunit.client.1.smithi099.stdout:4/77: chown l3 0 1 2024-09-17T01:01:49.050 INFO:tasks.workunit.client.1.smithi099.stdout:6/106: truncate fa 3743843 0 2024-09-17T01:01:49.051 INFO:tasks.workunit.client.1.smithi099.stdout:4/78: creat d7/dd/de/d1b/f1d x:0 0 0 2024-09-17T01:01:49.052 INFO:tasks.workunit.client.1.smithi099.stdout:4/79: mknod d7/dd/de/c1e 0 2024-09-17T01:01:49.053 INFO:tasks.workunit.client.1.smithi099.stdout:6/107: mknod dc/c24 0 2024-09-17T01:01:49.053 INFO:tasks.workunit.client.1.smithi099.stdout:6/108: truncate dc/d1a/f1e 495700 0 2024-09-17T01:01:49.055 INFO:tasks.workunit.client.1.smithi099.stdout:6/109: mknod dc/c25 0 2024-09-17T01:01:49.061 INFO:tasks.workunit.client.1.smithi099.stdout:4/80: write d7/f8 [3004851,78690] 0 2024-09-17T01:01:49.067 INFO:tasks.workunit.client.1.smithi099.stdout:4/81: dread d7/f8 [0,4194304] 0 2024-09-17T01:01:49.068 INFO:tasks.workunit.client.1.smithi099.stdout:4/82: mknod d7/dd/de/c1f 0 2024-09-17T01:01:49.069 INFO:tasks.workunit.client.1.smithi099.stdout:4/83: mknod d7/dd/c20 0 2024-09-17T01:01:49.069 INFO:tasks.workunit.client.1.smithi099.stdout:4/84: dread - d7/dd/de/f14 zero size 2024-09-17T01:01:49.069 INFO:tasks.workunit.client.1.smithi099.stdout:4/85: dread - d7/f16 zero size 2024-09-17T01:01:49.069 INFO:tasks.workunit.client.1.smithi099.stdout:4/86: mkdir d7/dd/d21 0 2024-09-17T01:01:49.070 INFO:tasks.workunit.client.1.smithi099.stdout:4/87: mknod d7/dd/d21/c22 0 2024-09-17T01:01:49.070 INFO:tasks.workunit.client.1.smithi099.stdout:4/88: symlink d7/dd/de/d1b/l23 0 2024-09-17T01:01:49.082 INFO:tasks.workunit.client.1.smithi099.stdout:4/89: dwrite d7/f16 [0,4194304] 0 2024-09-17T01:01:49.082 INFO:tasks.workunit.client.1.smithi099.stdout:4/90: read - d7/dd/f12 zero size 2024-09-17T01:01:49.085 INFO:tasks.workunit.client.1.smithi099.stdout:4/91: rmdir d7/dd/de/d1b/d1c 0 2024-09-17T01:01:49.085 INFO:tasks.workunit.client.1.smithi099.stdout:4/92: symlink d7/dd/de/d10/d1a/l24 0 2024-09-17T01:01:49.109 INFO:tasks.workunit.client.1.smithi099.stdout:4/93: dwrite f1 [4194304,4194304] 0 2024-09-17T01:01:49.109 INFO:tasks.workunit.client.1.smithi099.stdout:4/94: fsync d7/dd/f12 0 2024-09-17T01:01:49.109 INFO:tasks.workunit.client.1.smithi099.stdout:4/95: creat d7/dd/de/d17/f25 x:0 0 0 2024-09-17T01:01:49.117 INFO:tasks.workunit.client.1.smithi099.stdout:4/96: dread f1 [4194304,4194304] 0 2024-09-17T01:01:49.118 INFO:tasks.workunit.client.1.smithi099.stdout:4/97: unlink d7/dd/de/c1f 0 2024-09-17T01:01:49.132 INFO:tasks.workunit.client.1.smithi099.stdout:4/98: dwrite d7/fb [8388608,4194304] 0 2024-09-17T01:01:49.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:48 smithi002 ceph-mon[27650]: Upgrade: Updating mgr.smithi099.vswzrb 2024-09-17T01:01:49.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:48 smithi002 ceph-mon[27650]: Deploying daemon mgr.smithi099.vswzrb on smithi099 2024-09-17T01:01:49.209 INFO:tasks.workunit.client.1.smithi099.stdout:2/48: sync 2024-09-17T01:01:49.210 INFO:tasks.workunit.client.1.smithi099.stdout:7/37: sync 2024-09-17T01:01:49.217 INFO:tasks.workunit.client.1.smithi099.stdout:2/49: dread d2/f3 [0,4194304] 0 2024-09-17T01:01:49.217 INFO:tasks.workunit.client.1.smithi099.stdout:2/50: fsync d2/d7/fe 0 2024-09-17T01:01:49.219 INFO:tasks.workunit.client.1.smithi099.stdout:2/51: creat d2/d8/f11 x:0 0 0 2024-09-17T01:01:49.219 INFO:tasks.workunit.client.1.smithi099.stdout:2/52: readlink d2/d7/la 0 2024-09-17T01:01:49.219 INFO:tasks.workunit.client.1.smithi099.stdout:2/53: fdatasync d2/f3 0 2024-09-17T01:01:49.219 INFO:tasks.workunit.client.1.smithi099.stdout:2/54: dread - d2/d7/fe zero size 2024-09-17T01:01:49.219 INFO:tasks.workunit.client.1.smithi099.stdout:2/55: stat d2/d8/cc 0 2024-09-17T01:01:49.221 INFO:tasks.workunit.client.1.smithi099.stdout:2/56: dread d2/f3 [0,4194304] 0 2024-09-17T01:01:49.222 INFO:tasks.workunit.client.1.smithi099.stdout:2/57: dread - d2/d7/fe zero size 2024-09-17T01:01:49.224 INFO:tasks.workunit.client.1.smithi099.stdout:7/38: dwrite d1/f4 [0,4194304] 0 2024-09-17T01:01:49.224 INFO:tasks.workunit.client.1.smithi099.stdout:7/39: fsync d1/f4 0 2024-09-17T01:01:49.226 INFO:tasks.workunit.client.1.smithi099.stdout:7/40: unlink c0 0 2024-09-17T01:01:49.229 INFO:tasks.workunit.client.1.smithi099.stdout:2/58: rmdir d2/d8 39 2024-09-17T01:01:49.229 INFO:tasks.workunit.client.1.smithi099.stdout:7/41: truncate d1/f4 1715051 0 2024-09-17T01:01:49.230 INFO:tasks.workunit.client.1.smithi099.stdout:2/59: symlink d2/d9/l12 0 2024-09-17T01:01:49.231 INFO:tasks.workunit.client.1.smithi099.stdout:7/42: creat d1/d7/f9 x:0 0 0 2024-09-17T01:01:49.234 INFO:tasks.workunit.client.1.smithi099.stdout:2/60: mknod d2/c13 0 2024-09-17T01:01:49.247 INFO:tasks.workunit.client.1.smithi099.stdout:7/43: dwrite d1/d7/f9 [0,4194304] 0 2024-09-17T01:01:49.248 INFO:tasks.workunit.client.1.smithi099.stdout:7/44: link d1/c6 d1/d7/ca 0 2024-09-17T01:01:49.257 INFO:tasks.workunit.client.1.smithi099.stdout:7/45: read d1/d7/f9 [2660003,77498] 0 2024-09-17T01:01:49.257 INFO:tasks.workunit.client.1.smithi099.stdout:7/46: stat d1/c6 0 2024-09-17T01:01:49.270 INFO:tasks.workunit.client.1.smithi099.stdout:7/47: dwrite d1/f4 [0,4194304] 0 2024-09-17T01:01:49.270 INFO:tasks.workunit.client.1.smithi099.stdout:7/48: creat d1/d7/fb x:0 0 0 2024-09-17T01:01:49.270 INFO:tasks.workunit.client.1.smithi099.stdout:7/49: read d1/d7/f9 [3719048,100013] 0 2024-09-17T01:01:49.272 INFO:tasks.workunit.client.1.smithi099.stdout:7/50: link d1/c3 d1/cc 0 2024-09-17T01:01:49.272 INFO:tasks.workunit.client.1.smithi099.stdout:7/51: chown d1/d7/f9 1015033 1 2024-09-17T01:01:49.273 INFO:tasks.workunit.client.1.smithi099.stdout:7/52: unlink d1/c3 0 2024-09-17T01:01:49.273 INFO:tasks.workunit.client.1.smithi099.stdout:7/53: fdatasync d1/d7/f9 0 2024-09-17T01:01:49.274 INFO:tasks.workunit.client.1.smithi099.stdout:7/54: mknod d1/cd 0 2024-09-17T01:01:49.276 INFO:tasks.workunit.client.1.smithi099.stdout:7/55: rename d1/d7/fb to d1/d7/fe 0 2024-09-17T01:01:49.276 INFO:tasks.workunit.client.1.smithi099.stdout:7/56: chown d1/c6 180 1 2024-09-17T01:01:49.277 INFO:tasks.workunit.client.1.smithi099.stdout:7/57: creat d1/ff x:0 0 0 2024-09-17T01:01:49.277 INFO:tasks.workunit.client.1.smithi099.stdout:7/58: chown d1/d7/ca 1376388298 1 2024-09-17T01:01:49.278 INFO:tasks.workunit.client.1.smithi099.stdout:7/59: link d1/f4 d1/f10 0 2024-09-17T01:01:49.278 INFO:tasks.workunit.client.1.smithi099.stdout:7/60: read - d1/d7/fe zero size 2024-09-17T01:01:49.278 INFO:tasks.workunit.client.1.smithi099.stdout:7/61: link d1/ff d1/f11 0 2024-09-17T01:01:49.278 INFO:tasks.workunit.client.1.smithi099.stdout:7/62: mkdir d1/d7/d12 0 2024-09-17T01:01:49.279 INFO:tasks.workunit.client.1.smithi099.stdout:7/63: chown d1/f10 16014 1 2024-09-17T01:01:49.279 INFO:tasks.workunit.client.1.smithi099.stdout:7/64: creat d1/d7/f13 x:0 0 0 2024-09-17T01:01:49.279 INFO:tasks.workunit.client.1.smithi099.stdout:7/65: chown d1/cc 49 1 2024-09-17T01:01:49.297 INFO:tasks.workunit.client.1.smithi099.stdout:2/61: dwrite d2/f3 [0,4194304] 0 2024-09-17T01:01:49.298 INFO:tasks.workunit.client.1.smithi099.stdout:7/66: dwrite d1/d7/f9 [0,4194304] 0 2024-09-17T01:01:49.298 INFO:tasks.workunit.client.1.smithi099.stdout:2/62: creat d2/f14 x:0 0 0 2024-09-17T01:01:49.303 INFO:tasks.workunit.client.1.smithi099.stdout:2/63: mknod d2/d9/c15 0 2024-09-17T01:01:49.305 INFO:tasks.workunit.client.1.smithi099.stdout:7/67: getdents d1/d7 0 2024-09-17T01:01:49.305 INFO:tasks.workunit.client.1.smithi099.stdout:7/68: write d1/d7/fe [895979,41039] 0 2024-09-17T01:01:49.306 INFO:tasks.workunit.client.1.smithi099.stdout:7/69: fdatasync d1/d7/f13 0 2024-09-17T01:01:49.306 INFO:tasks.workunit.client.1.smithi099.stdout:2/64: dread d2/f4 [0,4194304] 0 2024-09-17T01:01:49.306 INFO:tasks.workunit.client.1.smithi099.stdout:2/65: write d2/d8/f11 [189423,78831] 0 2024-09-17T01:01:49.306 INFO:tasks.workunit.client.1.smithi099.stdout:7/70: creat d1/d7/d12/f14 x:0 0 0 2024-09-17T01:01:49.311 INFO:tasks.workunit.client.1.smithi099.stdout:3/118: sync 2024-09-17T01:01:49.312 INFO:tasks.workunit.client.1.smithi099.stdout:3/119: symlink d9/d15/d18/d1a/d23/l29 0 2024-09-17T01:01:49.313 INFO:tasks.workunit.client.1.smithi099.stdout:3/120: write d9/d15/d18/d1a/f1f [763387,87050] 0 2024-09-17T01:01:49.313 INFO:tasks.workunit.client.1.smithi099.stdout:3/121: chown d9/d15/d18/d1a 0 1 2024-09-17T01:01:49.313 INFO:tasks.workunit.client.1.smithi099.stdout:3/122: creat d9/d15/d18/f2a x:0 0 0 2024-09-17T01:01:49.313 INFO:tasks.workunit.client.1.smithi099.stdout:3/123: readlink d9/d15/d18/d1a/d23/l1e 0 2024-09-17T01:01:49.313 INFO:tasks.workunit.client.1.smithi099.stdout:3/124: write f3 [278805,128432] 0 2024-09-17T01:01:49.314 INFO:tasks.workunit.client.1.smithi099.stdout:7/71: dread d1/d7/f9 [0,4194304] 0 2024-09-17T01:01:49.316 INFO:tasks.workunit.client.1.smithi099.stdout:3/125: truncate d9/f12 3095265 0 2024-09-17T01:01:49.316 INFO:tasks.workunit.client.1.smithi099.stdout:3/126: write d9/d15/d18/f20 [1309034,39560] 0 2024-09-17T01:01:49.316 INFO:tasks.workunit.client.1.smithi099.stdout:3/127: chown d9/d15/c16 61443733 1 2024-09-17T01:01:49.316 INFO:tasks.workunit.client.1.smithi099.stdout:7/72: symlink d1/d7/d12/l15 0 2024-09-17T01:01:49.316 INFO:tasks.workunit.client.1.smithi099.stdout:7/73: write d1/d7/d12/f14 [622099,86179] 0 2024-09-17T01:01:49.317 INFO:tasks.workunit.client.1.smithi099.stdout:7/74: creat d1/d7/d12/f16 x:0 0 0 2024-09-17T01:01:49.317 INFO:tasks.workunit.client.1.smithi099.stdout:3/128: mkdir d9/d2b 0 2024-09-17T01:01:49.317 INFO:tasks.workunit.client.1.smithi099.stdout:3/129: fsync d9/d15/d18/d1a/f1b 0 2024-09-17T01:01:49.321 INFO:tasks.workunit.client.1.smithi099.stdout:3/130: rename f8 to d9/d15/d18/d1a/d23/f2c 0 2024-09-17T01:01:49.322 INFO:tasks.workunit.client.1.smithi099.stdout:7/75: write d1/f11 [648399,95695] 0 2024-09-17T01:01:49.322 INFO:tasks.workunit.client.1.smithi099.stdout:3/131: creat d9/d2b/f2d x:0 0 0 2024-09-17T01:01:49.324 INFO:tasks.workunit.client.1.smithi099.stdout:7/76: mknod d1/d7/d12/c17 0 2024-09-17T01:01:49.324 INFO:tasks.workunit.client.1.smithi099.stdout:7/77: creat d1/d7/d12/f18 x:0 0 0 2024-09-17T01:01:49.324 INFO:tasks.workunit.client.1.smithi099.stdout:3/132: mkdir d9/d2e 0 2024-09-17T01:01:49.326 INFO:tasks.workunit.client.1.smithi099.stdout:7/78: creat d1/f19 x:0 0 0 2024-09-17T01:01:49.326 INFO:tasks.workunit.client.1.smithi099.stdout:7/79: creat d1/d7/d12/f1a x:0 0 0 2024-09-17T01:01:49.327 INFO:tasks.workunit.client.1.smithi099.stdout:3/133: link f2 d9/d15/d18/f2f 0 2024-09-17T01:01:49.335 INFO:tasks.workunit.client.1.smithi099.stdout:3/134: dread d9/f25 [0,4194304] 0 2024-09-17T01:01:49.336 INFO:tasks.workunit.client.1.smithi099.stdout:3/135: creat d9/f30 x:0 0 0 2024-09-17T01:01:49.336 INFO:tasks.workunit.client.1.smithi099.stdout:3/136: write d9/d15/d18/f2a [444882,18420] 0 2024-09-17T01:01:49.336 INFO:tasks.workunit.client.1.smithi099.stdout:7/80: rmdir d1 39 2024-09-17T01:01:49.337 INFO:tasks.workunit.client.1.smithi099.stdout:7/81: write d1/f19 [154983,103193] 0 2024-09-17T01:01:49.339 INFO:tasks.workunit.client.1.smithi099.stdout:7/82: write - open d1/f10 failed 14 2024-09-17T01:01:49.350 INFO:tasks.workunit.client.1.smithi099.stdout:3/137: dwrite d9/d15/d18/d1a/f1f [0,4194304] 0 2024-09-17T01:01:49.350 INFO:tasks.workunit.client.1.smithi099.stdout:3/138: truncate d9/d15/d18/d1a/f1b 45102 0 2024-09-17T01:01:49.352 INFO:tasks.workunit.client.1.smithi099.stdout:3/139: mknod d9/d15/d18/d1a/c31 0 2024-09-17T01:01:49.352 INFO:tasks.workunit.client.1.smithi099.stdout:3/140: chown d9/ce 11009439 1 2024-09-17T01:01:49.359 INFO:tasks.workunit.client.1.smithi099.stdout:3/141: write d9/f27 [540714,10332] 0 2024-09-17T01:01:49.360 INFO:tasks.workunit.client.1.smithi099.stdout:7/83: dwrite d1/f11 [0,4194304] 0 2024-09-17T01:01:49.361 INFO:tasks.workunit.client.1.smithi099.stdout:7/84: rmdir d1 39 2024-09-17T01:01:49.362 INFO:tasks.workunit.client.1.smithi099.stdout:7/85: write - open d1/f11 failed 14 2024-09-17T01:01:49.362 INFO:tasks.workunit.client.1.smithi099.stdout:7/86: write d1/d7/d12/f16 [346073,57615] 0 2024-09-17T01:01:49.362 INFO:tasks.workunit.client.1.smithi099.stdout:7/87: readlink d1/d7/d12/l15 0 2024-09-17T01:01:49.362 INFO:tasks.workunit.client.1.smithi099.stdout:7/88: write d1/d7/f13 [783342,119294] 0 2024-09-17T01:01:49.364 INFO:tasks.workunit.client.1.smithi099.stdout:7/89: unlink d1/c5 0 2024-09-17T01:01:49.364 INFO:tasks.workunit.client.1.smithi099.stdout:7/90: write d1/d7/d12/f1a [628664,30936] 0 2024-09-17T01:01:49.365 INFO:tasks.workunit.client.1.smithi099.stdout:7/91: creat d1/d7/f1b x:0 0 0 2024-09-17T01:01:49.373 INFO:tasks.workunit.client.1.smithi099.stdout:3/142: dwrite d9/d2b/f2d [0,4194304] 0 2024-09-17T01:01:49.373 INFO:tasks.workunit.client.1.smithi099.stdout:3/143: stat d9/d15/d18/d1a/d23/l13 0 2024-09-17T01:01:49.375 INFO:tasks.workunit.client.1.smithi099.stdout:7/92: getdents d1 0 2024-09-17T01:01:49.376 INFO:tasks.workunit.client.1.smithi099.stdout:7/93: read d1/d7/d12/f14 [197249,86353] 0 2024-09-17T01:01:49.376 INFO:tasks.workunit.client.1.smithi099.stdout:3/144: link d9/cb d9/d15/d18/c32 0 2024-09-17T01:01:49.395 INFO:tasks.workunit.client.1.smithi099.stdout:3/145: dwrite d9/d15/d18/f20 [0,4194304] 0 2024-09-17T01:01:49.395 INFO:tasks.workunit.client.1.smithi099.stdout:7/94: dwrite d1/d7/f9 [0,4194304] 0 2024-09-17T01:01:49.398 INFO:tasks.workunit.client.1.smithi099.stdout:3/146: dread d9/f25 [0,4194304] 0 2024-09-17T01:01:49.405 INFO:tasks.workunit.client.1.smithi099.stdout:7/95: mkdir d1/d7/d1c 0 2024-09-17T01:01:49.415 INFO:tasks.workunit.client.1.smithi099.stdout:3/147: dwrite d9/d15/d18/d1a/f1b [0,4194304] 0 2024-09-17T01:01:49.418 INFO:tasks.workunit.client.1.smithi099.stdout:3/148: getdents d9/d15/d18/d1a 0 2024-09-17T01:01:49.426 INFO:tasks.workunit.client.1.smithi099.stdout:7/96: dwrite d1/f11 [0,4194304] 0 2024-09-17T01:01:49.429 INFO:tasks.workunit.client.1.smithi099.stdout:3/149: read d9/d15/d18/d1a/f1b [2449457,65604] 0 2024-09-17T01:01:49.431 INFO:tasks.workunit.client.1.smithi099.stdout:3/150: link d9/f10 d9/d15/d18/d1a/d23/f33 0 2024-09-17T01:01:49.431 INFO:tasks.workunit.client.1.smithi099.stdout:3/151: fsync d9/d15/d18/f19 0 2024-09-17T01:01:49.433 INFO:tasks.workunit.client.1.smithi099.stdout:3/152: unlink f6 0 2024-09-17T01:01:49.434 INFO:tasks.workunit.client.1.smithi099.stdout:3/153: creat d9/d15/f34 x:0 0 0 2024-09-17T01:01:49.437 INFO:tasks.workunit.client.1.smithi099.stdout:3/154: write d9/f25 [2424464,42524] 0 2024-09-17T01:01:49.437 INFO:tasks.workunit.client.1.smithi099.stdout:3/155: fsync d9/d15/d18/d1a/d23/f17 0 2024-09-17T01:01:49.438 INFO:tasks.workunit.client.1.smithi099.stdout:3/156: truncate d9/d2b/f2d 3432080 0 2024-09-17T01:01:49.438 INFO:tasks.workunit.client.1.smithi099.stdout:3/157: write d9/f27 [4748295,55470] 0 2024-09-17T01:01:49.438 INFO:tasks.workunit.client.1.smithi099.stdout:3/158: creat d9/d15/d18/f35 x:0 0 0 2024-09-17T01:01:49.441 INFO:tasks.workunit.client.1.smithi099.stdout:3/159: rename c0 to d9/d15/c36 0 2024-09-17T01:01:49.441 INFO:tasks.workunit.client.1.smithi099.stdout:7/97: dwrite d1/f10 [0,4194304] 0 2024-09-17T01:01:49.449 INFO:tasks.workunit.client.1.smithi099.stdout:7/98: creat d1/d7/f1d x:0 0 0 2024-09-17T01:01:49.457 INFO:tasks.workunit.client.1.smithi099.stdout:3/160: dwrite d9/f10 [0,4194304] 0 2024-09-17T01:01:49.457 INFO:tasks.workunit.client.1.smithi099.stdout:3/161: read d9/f25 [3078066,66329] 0 2024-09-17T01:01:49.460 INFO:tasks.workunit.client.1.smithi099.stdout:1/60: sync 2024-09-17T01:01:49.460 INFO:tasks.workunit.client.1.smithi099.stdout:0/48: sync 2024-09-17T01:01:49.460 INFO:tasks.workunit.client.1.smithi099.stdout:8/59: sync 2024-09-17T01:01:49.460 INFO:tasks.workunit.client.1.smithi099.stdout:1/61: fdatasync d0/fc 0 2024-09-17T01:01:49.460 INFO:tasks.workunit.client.1.smithi099.stdout:1/62: creat d0/f13 x:0 0 0 2024-09-17T01:01:49.465 INFO:tasks.workunit.client.1.smithi099.stdout:7/99: rename d1/d7 to d1/d1e 0 2024-09-17T01:01:49.466 INFO:tasks.workunit.client.1.smithi099.stdout:8/60: rmdir d0/d4 39 2024-09-17T01:01:49.468 INFO:tasks.workunit.client.1.smithi099.stdout:3/162: write d9/d15/d18/d1a/f1f [3893443,67160] 0 2024-09-17T01:01:49.468 INFO:tasks.workunit.client.1.smithi099.stdout:3/163: fsync d9/d15/f34 0 2024-09-17T01:01:49.469 INFO:tasks.workunit.client.1.smithi099.stdout:7/100: symlink d1/l1f 0 2024-09-17T01:01:49.469 INFO:tasks.workunit.client.1.smithi099.stdout:7/101: write d1/d1e/f1d [368720,116903] 0 2024-09-17T01:01:49.469 INFO:tasks.workunit.client.1.smithi099.stdout:7/102: write d1/ff [4772436,10708] 0 2024-09-17T01:01:49.471 INFO:tasks.workunit.client.1.smithi099.stdout:8/61: getdents d0 0 2024-09-17T01:01:49.471 INFO:tasks.workunit.client.1.smithi099.stdout:0/49: write f7 [8129812,23152] 0 2024-09-17T01:01:49.474 INFO:tasks.workunit.client.1.smithi099.stdout:7/103: truncate d1/d1e/d12/f16 670959 0 2024-09-17T01:01:49.474 INFO:tasks.workunit.client.1.smithi099.stdout:7/104: stat d1/d1e/f1d 0 2024-09-17T01:01:49.481 INFO:tasks.workunit.client.1.smithi099.stdout:0/50: fsync f7 0 2024-09-17T01:01:49.481 INFO:tasks.workunit.client.1.smithi099.stdout:0/51: getdents da/df 0 2024-09-17T01:01:49.484 INFO:tasks.workunit.client.1.smithi099.stdout:2/66: sync 2024-09-17T01:01:49.484 INFO:tasks.workunit.client.1.smithi099.stdout:5/198: sync 2024-09-17T01:01:49.484 INFO:tasks.workunit.client.1.smithi099.stdout:2/67: chown d2/d7 263 1 2024-09-17T01:01:49.484 INFO:tasks.workunit.client.1.smithi099.stdout:5/199: write d2/f18 [4397869,119593] 0 2024-09-17T01:01:49.484 INFO:tasks.workunit.client.1.smithi099.stdout:5/200: write d2/f18 [4526860,53804] 0 2024-09-17T01:01:49.484 INFO:tasks.workunit.client.1.smithi099.stdout:5/201: chown d2/d26/f2a 589913737 1 2024-09-17T01:01:49.484 INFO:tasks.workunit.client.1.smithi099.stdout:4/99: sync 2024-09-17T01:01:49.484 INFO:tasks.workunit.client.1.smithi099.stdout:6/110: sync 2024-09-17T01:01:49.487 INFO:tasks.workunit.client.1.smithi099.stdout:6/111: getdents dc 0 2024-09-17T01:01:49.489 INFO:tasks.workunit.client.1.smithi099.stdout:4/100: read f6 [63109,119681] 0 2024-09-17T01:01:49.489 INFO:tasks.workunit.client.1.smithi099.stdout:4/101: fdatasync d7/dd/de/f14 0 2024-09-17T01:01:49.489 INFO:tasks.workunit.client.1.smithi099.stdout:4/102: fdatasync f2 0 2024-09-17T01:01:49.489 INFO:tasks.workunit.client.1.smithi099.stdout:4/103: dread - d7/dd/f12 zero size 2024-09-17T01:01:49.489 INFO:tasks.workunit.client.1.smithi099.stdout:1/63: dwrite d0/f10 [0,4194304] 0 2024-09-17T01:01:49.490 INFO:tasks.workunit.client.1.smithi099.stdout:9/78: sync 2024-09-17T01:01:49.490 INFO:tasks.workunit.client.1.smithi099.stdout:9/79: fdatasync da/fe 0 2024-09-17T01:01:49.492 INFO:tasks.workunit.client.1.smithi099.stdout:1/64: getdents d0/d2 0 2024-09-17T01:01:49.492 INFO:tasks.workunit.client.1.smithi099.stdout:1/65: fsync d0/f13 0 2024-09-17T01:01:49.492 INFO:tasks.workunit.client.1.smithi099.stdout:1/66: fsync d0/f13 0 2024-09-17T01:01:49.493 INFO:tasks.workunit.client.1.smithi099.stdout:9/80: creat da/d14/f1a x:0 0 0 2024-09-17T01:01:49.493 INFO:tasks.workunit.client.1.smithi099.stdout:9/81: read da/f10 [1389992,71653] 0 2024-09-17T01:01:49.493 INFO:tasks.workunit.client.1.smithi099.stdout:1/67: symlink d0/d2/de/l14 0 2024-09-17T01:01:49.497 INFO:tasks.workunit.client.1.smithi099.stdout:3/164: dwrite d9/d2b/f2d [0,4194304] 0 2024-09-17T01:01:49.498 INFO:tasks.workunit.client.1.smithi099.stdout:3/165: readlink d9/d15/d18/d1a/d23/l1e 0 2024-09-17T01:01:49.501 INFO:tasks.workunit.client.1.smithi099.stdout:6/112: dread dc/f21 [0,4194304] 0 2024-09-17T01:01:49.501 INFO:tasks.workunit.client.1.smithi099.stdout:4/104: write d7/fa [3345602,51130] 0 2024-09-17T01:01:49.502 INFO:tasks.workunit.client.1.smithi099.stdout:4/105: chown d7/dd/de/ff 15585 1 2024-09-17T01:01:49.502 INFO:tasks.workunit.client.1.smithi099.stdout:4/106: chown d7/fc 0 1 2024-09-17T01:01:49.503 INFO:tasks.workunit.client.1.smithi099.stdout:2/68: write f0 [2972214,67026] 0 2024-09-17T01:01:49.505 INFO:tasks.workunit.client.1.smithi099.stdout:6/113: write dc/f21 [3315335,111070] 0 2024-09-17T01:01:49.505 INFO:tasks.workunit.client.1.smithi099.stdout:8/62: dwrite d0/d4/fa [0,4194304] 0 2024-09-17T01:01:49.507 INFO:tasks.workunit.client.1.smithi099.stdout:1/68: rmdir d0 39 2024-09-17T01:01:49.507 INFO:tasks.workunit.client.1.smithi099.stdout:1/69: fdatasync d0/f10 0 2024-09-17T01:01:49.510 INFO:tasks.workunit.client.1.smithi099.stdout:1/70: creat d0/d2/de/f15 x:0 0 0 2024-09-17T01:01:49.512 INFO:tasks.workunit.client.1.smithi099.stdout:1/71: rename d0/d2/de/l14 to d0/d2/d5/l16 0 2024-09-17T01:01:49.512 INFO:tasks.workunit.client.1.smithi099.stdout:1/72: write d0/d2/de/f15 [506580,60421] 0 2024-09-17T01:01:49.514 INFO:tasks.workunit.client.1.smithi099.stdout:2/69: fdatasync f0 0 2024-09-17T01:01:49.514 INFO:tasks.workunit.client.1.smithi099.stdout:0/52: dwrite f7 [4194304,4194304] 0 2024-09-17T01:01:49.514 INFO:tasks.workunit.client.1.smithi099.stdout:0/53: truncate da/fe 258764 0 2024-09-17T01:01:49.514 INFO:tasks.workunit.client.1.smithi099.stdout:5/202: dwrite d2/d26/f27 [0,4194304] 0 2024-09-17T01:01:49.515 INFO:tasks.workunit.client.1.smithi099.stdout:2/70: mknod d2/d8/c16 0 2024-09-17T01:01:49.518 INFO:tasks.workunit.client.1.smithi099.stdout:0/54: creat da/df/f10 x:0 0 0 2024-09-17T01:01:49.519 INFO:tasks.workunit.client.1.smithi099.stdout:0/55: dread - da/df/f10 zero size 2024-09-17T01:01:49.519 INFO:tasks.workunit.client.1.smithi099.stdout:0/56: write da/df/f10 [880191,31758] 0 2024-09-17T01:01:49.519 INFO:tasks.workunit.client.1.smithi099.stdout:8/63: dread d0/d4/fa [0,4194304] 0 2024-09-17T01:01:49.519 INFO:tasks.workunit.client.1.smithi099.stdout:9/82: dwrite da/f10 [0,4194304] 0 2024-09-17T01:01:49.522 INFO:tasks.workunit.client.1.smithi099.stdout:1/73: rename d0/l1 to d0/d2/d9/l17 0 2024-09-17T01:01:49.522 INFO:tasks.workunit.client.1.smithi099.stdout:1/74: write d0/fc [395298,76520] 0 2024-09-17T01:01:49.522 INFO:tasks.workunit.client.1.smithi099.stdout:1/75: chown d0/d2/d9/l17 0 1 2024-09-17T01:01:49.526 INFO:tasks.workunit.client.1.smithi099.stdout:6/114: truncate dc/f21 1678882 0 2024-09-17T01:01:49.527 INFO:tasks.workunit.client.1.smithi099.stdout:8/64: truncate d0/d4/f7 1095631 0 2024-09-17T01:01:49.529 INFO:tasks.workunit.client.1.smithi099.stdout:1/76: mkdir d0/d2/d18 0 2024-09-17T01:01:49.530 INFO:tasks.workunit.client.1.smithi099.stdout:6/115: creat dc/d1a/f26 x:0 0 0 2024-09-17T01:01:49.530 INFO:tasks.workunit.client.1.smithi099.stdout:6/116: chown dc/l16 498 1 2024-09-17T01:01:49.531 INFO:tasks.workunit.client.1.smithi099.stdout:8/65: rmdir d0 39 2024-09-17T01:01:49.531 INFO:tasks.workunit.client.1.smithi099.stdout:8/66: getdents d0 0 2024-09-17T01:01:49.532 INFO:tasks.workunit.client.1.smithi099.stdout:2/71: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:01:49.532 INFO:tasks.workunit.client.1.smithi099.stdout:2/72: write d2/d8/f11 [306569,73598] 0 2024-09-17T01:01:49.532 INFO:tasks.workunit.client.1.smithi099.stdout:9/83: mkdir da/d1b 0 2024-09-17T01:01:49.533 INFO:tasks.workunit.client.1.smithi099.stdout:9/84: chown da/ff 3015362 1 2024-09-17T01:01:49.534 INFO:tasks.workunit.client.1.smithi099.stdout:6/117: mkdir dc/d27 0 2024-09-17T01:01:49.534 INFO:tasks.workunit.client.1.smithi099.stdout:6/118: read f7 [1560825,118645] 0 2024-09-17T01:01:49.534 INFO:tasks.workunit.client.1.smithi099.stdout:6/119: readlink dc/d1a/l1c 0 2024-09-17T01:01:49.534 INFO:tasks.workunit.client.1.smithi099.stdout:6/120: readlink l6 0 2024-09-17T01:01:49.536 INFO:tasks.workunit.client.1.smithi099.stdout:1/77: read d0/f10 [1839618,33916] 0 2024-09-17T01:01:49.538 INFO:tasks.workunit.client.1.smithi099.stdout:2/73: mkdir d2/d9/d17 0 2024-09-17T01:01:49.538 INFO:tasks.workunit.client.1.smithi099.stdout:0/57: rmdir da 39 2024-09-17T01:01:49.541 INFO:tasks.workunit.client.1.smithi099.stdout:8/67: symlink d0/d4/lc 0 2024-09-17T01:01:49.542 INFO:tasks.workunit.client.1.smithi099.stdout:2/74: rmdir d2/d7 39 2024-09-17T01:01:49.544 INFO:tasks.workunit.client.1.smithi099.stdout:8/68: creat d0/fd x:0 0 0 2024-09-17T01:01:49.549 INFO:tasks.workunit.client.1.smithi099.stdout:8/69: unlink d0/d4/f7 0 2024-09-17T01:01:49.552 INFO:tasks.workunit.client.1.smithi099.stdout:8/70: symlink d0/d8/le 0 2024-09-17T01:01:49.552 INFO:tasks.workunit.client.1.smithi099.stdout:8/71: dread - d0/fd zero size 2024-09-17T01:01:49.557 INFO:tasks.workunit.client.1.smithi099.stdout:2/75: read d2/f4 [649899,76665] 0 2024-09-17T01:01:49.558 INFO:tasks.workunit.client.1.smithi099.stdout:2/76: mkdir d2/d18 0 2024-09-17T01:01:49.560 INFO:tasks.workunit.client.1.smithi099.stdout:8/72: read d0/d4/fb [913298,2590] 0 2024-09-17T01:01:49.560 INFO:tasks.workunit.client.1.smithi099.stdout:2/77: link d2/d7/la d2/d9/l19 0 2024-09-17T01:01:49.560 INFO:tasks.workunit.client.1.smithi099.stdout:2/78: chown d2/d8/l10 552 1 2024-09-17T01:01:49.560 INFO:tasks.workunit.client.1.smithi099.stdout:2/79: stat d2/d9 0 2024-09-17T01:01:49.561 INFO:tasks.workunit.client.1.smithi099.stdout:8/73: creat d0/d8/ff x:0 0 0 2024-09-17T01:01:49.562 INFO:tasks.workunit.client.1.smithi099.stdout:8/74: unlink d0/d8/ff 0 2024-09-17T01:01:49.562 INFO:tasks.workunit.client.1.smithi099.stdout:8/75: dread - d0/fd zero size 2024-09-17T01:01:49.562 INFO:tasks.workunit.client.1.smithi099.stdout:8/76: chown d0/d4/fb 517 1 2024-09-17T01:01:49.563 INFO:tasks.workunit.client.1.smithi099.stdout:8/77: truncate d0/d4/fa 2108209 0 2024-09-17T01:01:49.572 INFO:tasks.workunit.client.1.smithi099.stdout:2/80: dread d2/f3 [0,4194304] 0 2024-09-17T01:01:49.573 INFO:tasks.workunit.client.1.smithi099.stdout:2/81: unlink d2/d8/l10 0 2024-09-17T01:01:49.574 INFO:tasks.workunit.client.1.smithi099.stdout:0/58: dwrite f7 [4194304,4194304] 0 2024-09-17T01:01:49.575 INFO:tasks.workunit.client.1.smithi099.stdout:9/85: dwrite da/d14/f1a [0,4194304] 0 2024-09-17T01:01:49.575 INFO:tasks.workunit.client.1.smithi099.stdout:2/82: unlink d2/f3 0 2024-09-17T01:01:49.576 INFO:tasks.workunit.client.1.smithi099.stdout:6/121: getdents dc/d1a 0 2024-09-17T01:01:49.578 INFO:tasks.workunit.client.1.smithi099.stdout:1/78: dwrite d0/d2/de/f15 [0,4194304] 0 2024-09-17T01:01:49.578 INFO:tasks.workunit.client.1.smithi099.stdout:1/79: chown d0/d8 174 1 2024-09-17T01:01:49.580 INFO:tasks.workunit.client.1.smithi099.stdout:9/86: truncate da/fe 53283 0 2024-09-17T01:01:49.581 INFO:tasks.workunit.client.1.smithi099.stdout:0/59: dread f7 [0,4194304] 0 2024-09-17T01:01:49.581 INFO:tasks.workunit.client.1.smithi099.stdout:0/60: chown da/fe 512580734 1 2024-09-17T01:01:49.581 INFO:tasks.workunit.client.1.smithi099.stdout:2/83: truncate f0 2701786 0 2024-09-17T01:01:49.585 INFO:tasks.workunit.client.1.smithi099.stdout:0/61: symlink da/df/l11 0 2024-09-17T01:01:49.585 INFO:tasks.workunit.client.1.smithi099.stdout:6/122: dread f7 [0,4194304] 0 2024-09-17T01:01:49.586 INFO:tasks.workunit.client.1.smithi099.stdout:2/84: unlink d2/f14 0 2024-09-17T01:01:49.587 INFO:tasks.workunit.client.1.smithi099.stdout:0/62: mkdir da/d12 0 2024-09-17T01:01:49.588 INFO:tasks.workunit.client.1.smithi099.stdout:6/123: mknod dc/d1a/c28 0 2024-09-17T01:01:49.588 INFO:tasks.workunit.client.1.smithi099.stdout:6/124: write fa [3773823,107620] 0 2024-09-17T01:01:49.588 INFO:tasks.workunit.client.1.smithi099.stdout:6/125: chown dc/d1a/f1e 2 1 2024-09-17T01:01:49.591 INFO:tasks.workunit.client.1.smithi099.stdout:6/126: mkdir dc/d29 0 2024-09-17T01:01:49.592 INFO:tasks.workunit.client.1.smithi099.stdout:8/78: write d0/d4/fa [320763,64606] 0 2024-09-17T01:01:49.592 INFO:tasks.workunit.client.1.smithi099.stdout:8/79: write d0/fd [257311,68948] 0 2024-09-17T01:01:49.600 INFO:tasks.workunit.client.1.smithi099.stdout:9/87: dread da/f10 [0,4194304] 0 2024-09-17T01:01:49.600 INFO:tasks.workunit.client.1.smithi099.stdout:0/63: write f7 [3318046,123916] 0 2024-09-17T01:01:49.601 INFO:tasks.workunit.client.1.smithi099.stdout:6/127: write dc/f18 [694034,76294] 0 2024-09-17T01:01:49.601 INFO:tasks.workunit.client.1.smithi099.stdout:6/128: write dc/d1a/f1e [948494,74815] 0 2024-09-17T01:01:49.601 INFO:tasks.workunit.client.1.smithi099.stdout:1/80: dwrite d0/d2/ff [0,4194304] 0 2024-09-17T01:01:49.602 INFO:tasks.workunit.client.1.smithi099.stdout:0/64: creat da/d12/f13 x:0 0 0 2024-09-17T01:01:49.602 INFO:tasks.workunit.client.1.smithi099.stdout:0/65: readlink da/df/l11 0 2024-09-17T01:01:49.606 INFO:tasks.workunit.client.1.smithi099.stdout:2/85: dread f0 [0,4194304] 0 2024-09-17T01:01:49.606 INFO:tasks.workunit.client.1.smithi099.stdout:2/86: write d2/d7/fe [960142,128151] 0 2024-09-17T01:01:49.606 INFO:tasks.workunit.client.1.smithi099.stdout:6/129: mknod dc/c2a 0 2024-09-17T01:01:49.606 INFO:tasks.workunit.client.1.smithi099.stdout:1/81: mknod d0/d2/de/c19 0 2024-09-17T01:01:49.607 INFO:tasks.workunit.client.1.smithi099.stdout:1/82: chown d0/d2/d5/l6 1463732 1 2024-09-17T01:01:49.607 INFO:tasks.workunit.client.1.smithi099.stdout:6/130: write dc/f21 [1053266,108157] 0 2024-09-17T01:01:49.608 INFO:tasks.workunit.client.1.smithi099.stdout:0/66: rename da/fc to da/f14 0 2024-09-17T01:01:49.609 INFO:tasks.workunit.client.1.smithi099.stdout:2/87: write d2/d7/fe [430309,91393] 0 2024-09-17T01:01:49.610 INFO:tasks.workunit.client.1.smithi099.stdout:6/131: mkdir dc/d2b 0 2024-09-17T01:01:49.611 INFO:tasks.workunit.client.1.smithi099.stdout:2/88: write f0 [2386450,8650] 0 2024-09-17T01:01:49.612 INFO:tasks.workunit.client.1.smithi099.stdout:0/67: rename da/fe to da/df/f15 0 2024-09-17T01:01:49.612 INFO:tasks.workunit.client.1.smithi099.stdout:0/68: readlink l6 0 2024-09-17T01:01:49.616 INFO:tasks.workunit.client.1.smithi099.stdout:0/69: rename f5 to da/d12/f16 0 2024-09-17T01:01:49.617 INFO:tasks.workunit.client.1.smithi099.stdout:0/70: write da/f14 [454638,24709] 0 2024-09-17T01:01:49.617 INFO:tasks.workunit.client.1.smithi099.stdout:2/89: getdents d2 0 2024-09-17T01:01:49.618 INFO:tasks.workunit.client.1.smithi099.stdout:2/90: fdatasync d2/f4 0 2024-09-17T01:01:49.618 INFO:tasks.workunit.client.1.smithi099.stdout:1/83: dread d0/fc [0,4194304] 0 2024-09-17T01:01:49.619 INFO:tasks.workunit.client.1.smithi099.stdout:1/84: truncate d0/d2/ff 3640503 0 2024-09-17T01:01:49.629 INFO:tasks.workunit.client.1.smithi099.stdout:8/80: dwrite d0/d4/fb [0,4194304] 0 2024-09-17T01:01:49.629 INFO:tasks.workunit.client.1.smithi099.stdout:9/88: dwrite da/d14/f1a [0,4194304] 0 2024-09-17T01:01:49.637 INFO:tasks.workunit.client.1.smithi099.stdout:1/85: rename d0/f10 to d0/d2/d18/f1a 0 2024-09-17T01:01:49.637 INFO:tasks.workunit.client.1.smithi099.stdout:1/86: stat d0/d2/d5 0 2024-09-17T01:01:49.637 INFO:tasks.workunit.client.1.smithi099.stdout:1/87: readlink d0/d2/l4 0 2024-09-17T01:01:49.638 INFO:tasks.workunit.client.1.smithi099.stdout:1/88: rename d0/d2/de/l11 to d0/d2/d5/l1b 0 2024-09-17T01:01:49.638 INFO:tasks.workunit.client.1.smithi099.stdout:1/89: truncate d0/fc 135173 0 2024-09-17T01:01:49.638 INFO:tasks.workunit.client.1.smithi099.stdout:1/90: chown d0/d2/d5/l16 57 1 2024-09-17T01:01:49.638 INFO:tasks.workunit.client.1.smithi099.stdout:1/91: chown d0/d2/l4 456150458 1 2024-09-17T01:01:49.639 INFO:tasks.workunit.client.1.smithi099.stdout:1/92: mknod d0/d2/d18/c1c 0 2024-09-17T01:01:49.639 INFO:tasks.workunit.client.1.smithi099.stdout:1/93: chown d0/d2/d18/f1a 44 1 2024-09-17T01:01:49.645 INFO:tasks.workunit.client.1.smithi099.stdout:6/132: dwrite dc/fe [0,4194304] 0 2024-09-17T01:01:49.648 INFO:tasks.workunit.client.1.smithi099.stdout:0/71: dwrite da/d12/f13 [0,4194304] 0 2024-09-17T01:01:49.650 INFO:tasks.workunit.client.1.smithi099.stdout:0/72: rmdir da 39 2024-09-17T01:01:49.652 INFO:tasks.workunit.client.1.smithi099.stdout:0/73: symlink da/l17 0 2024-09-17T01:01:49.654 INFO:tasks.workunit.client.1.smithi099.stdout:0/74: link f9 da/d12/f18 0 2024-09-17T01:01:49.655 INFO:tasks.workunit.client.1.smithi099.stdout:1/94: write d0/fc [364405,33425] 0 2024-09-17T01:01:49.657 INFO:tasks.workunit.client.1.smithi099.stdout:1/95: unlink d0/d2/d5/l6 0 2024-09-17T01:01:49.664 INFO:tasks.workunit.client.1.smithi099.stdout:9/89: dwrite f4 [0,4194304] 0 2024-09-17T01:01:49.664 INFO:tasks.workunit.client.1.smithi099.stdout:2/91: dwrite d2/d7/fe [0,4194304] 0 2024-09-17T01:01:49.667 INFO:tasks.workunit.client.1.smithi099.stdout:2/92: creat d2/f1a x:0 0 0 2024-09-17T01:01:49.668 INFO:tasks.workunit.client.1.smithi099.stdout:8/81: dwrite d0/d4/fb [0,4194304] 0 2024-09-17T01:01:49.668 INFO:tasks.workunit.client.1.smithi099.stdout:8/82: write d0/fd [1147072,105579] 0 2024-09-17T01:01:49.668 INFO:tasks.workunit.client.1.smithi099.stdout:6/133: dwrite dc/d1a/f1b [0,4194304] 0 2024-09-17T01:01:49.672 INFO:tasks.workunit.client.1.smithi099.stdout:2/93: mkdir d2/d8/d1b 0 2024-09-17T01:01:49.672 INFO:tasks.workunit.client.1.smithi099.stdout:9/90: symlink da/l1c 0 2024-09-17T01:01:49.673 INFO:tasks.workunit.client.1.smithi099.stdout:1/96: write d0/d2/de/f15 [1056226,122675] 0 2024-09-17T01:01:49.678 INFO:tasks.workunit.client.1.smithi099.stdout:9/91: symlink da/d1b/l1d 0 2024-09-17T01:01:49.679 INFO:tasks.workunit.client.1.smithi099.stdout:9/92: getdents da/d18 0 2024-09-17T01:01:49.679 INFO:tasks.workunit.client.1.smithi099.stdout:1/97: mknod d0/c1d 0 2024-09-17T01:01:49.679 INFO:tasks.workunit.client.1.smithi099.stdout:1/98: write d0/f13 [359574,34847] 0 2024-09-17T01:01:49.679 INFO:tasks.workunit.client.1.smithi099.stdout:1/99: fdatasync d0/d2/ff 0 2024-09-17T01:01:49.680 INFO:tasks.workunit.client.1.smithi099.stdout:1/100: chown d0/d2/d5 6 1 2024-09-17T01:01:49.680 INFO:tasks.workunit.client.1.smithi099.stdout:9/93: stat da/c17 0 2024-09-17T01:01:49.689 INFO:tasks.workunit.client.1.smithi099.stdout:1/101: write d0/d2/d18/f1a [827170,27349] 0 2024-09-17T01:01:49.689 INFO:tasks.workunit.client.1.smithi099.stdout:1/102: write d0/d2/de/f15 [3953194,85978] 0 2024-09-17T01:01:49.691 INFO:tasks.workunit.client.1.smithi099.stdout:1/103: mknod d0/d2/de/c1e 0 2024-09-17T01:01:49.716 INFO:tasks.workunit.client.1.smithi099.stdout:6/134: dwrite dc/f21 [0,4194304] 0 2024-09-17T01:01:49.717 INFO:tasks.workunit.client.1.smithi099.stdout:2/94: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:01:49.717 INFO:tasks.workunit.client.1.smithi099.stdout:2/95: chown d2/d8/c16 452260736 1 2024-09-17T01:01:49.717 INFO:tasks.workunit.client.1.smithi099.stdout:2/96: chown d2/d8/d1b 12743618 1 2024-09-17T01:01:49.717 INFO:tasks.workunit.client.1.smithi099.stdout:2/97: creat d2/f1c x:0 0 0 2024-09-17T01:01:49.718 INFO:tasks.workunit.client.1.smithi099.stdout:8/83: dwrite d0/d4/fb [4194304,4194304] 0 2024-09-17T01:01:49.718 INFO:tasks.workunit.client.1.smithi099.stdout:9/94: dwrite da/fe [0,4194304] 0 2024-09-17T01:01:49.718 INFO:tasks.workunit.client.1.smithi099.stdout:9/95: readlink da/l13 0 2024-09-17T01:01:49.720 INFO:tasks.workunit.client.1.smithi099.stdout:6/135: rmdir dc/d29 0 2024-09-17T01:01:49.720 INFO:tasks.workunit.client.1.smithi099.stdout:6/136: stat dc/fe 0 2024-09-17T01:01:49.721 INFO:tasks.workunit.client.1.smithi099.stdout:2/98: symlink d2/l1d 0 2024-09-17T01:01:49.721 INFO:tasks.workunit.client.1.smithi099.stdout:2/99: dread - d2/f1c zero size 2024-09-17T01:01:49.721 INFO:tasks.workunit.client.1.smithi099.stdout:8/84: mknod d0/d8/c10 0 2024-09-17T01:01:49.723 INFO:tasks.workunit.client.1.smithi099.stdout:2/100: dread d2/d8/f11 [0,4194304] 0 2024-09-17T01:01:49.723 INFO:tasks.workunit.client.1.smithi099.stdout:2/101: fsync d2/f1a 0 2024-09-17T01:01:49.723 INFO:tasks.workunit.client.1.smithi099.stdout:2/102: chown d2/d7/la 0 1 2024-09-17T01:01:49.723 INFO:tasks.workunit.client.1.smithi099.stdout:2/103: stat d2/f1a 0 2024-09-17T01:01:49.724 INFO:tasks.workunit.client.1.smithi099.stdout:6/137: creat dc/d2b/f2c x:0 0 0 2024-09-17T01:01:49.724 INFO:tasks.workunit.client.1.smithi099.stdout:2/104: rmdir d2/d7 39 2024-09-17T01:01:49.728 INFO:tasks.workunit.client.1.smithi099.stdout:8/85: rename d0/fd to d0/d4/f11 0 2024-09-17T01:01:49.728 INFO:tasks.workunit.client.1.smithi099.stdout:6/138: rename dc/d2b to dc/d2b/d2d 22 2024-09-17T01:01:49.728 INFO:tasks.workunit.client.1.smithi099.stdout:8/86: write d0/d4/f11 [1994954,31157] 0 2024-09-17T01:01:49.729 INFO:tasks.workunit.client.1.smithi099.stdout:9/96: read f6 [10015906,7055] 0 2024-09-17T01:01:49.729 INFO:tasks.workunit.client.1.smithi099.stdout:9/97: chown da/lb 137247 1 2024-09-17T01:01:49.731 INFO:tasks.workunit.client.1.smithi099.stdout:6/139: rename dc/d1a/c28 to dc/c2e 0 2024-09-17T01:01:49.731 INFO:tasks.workunit.client.1.smithi099.stdout:6/140: write dc/d2b/f2c [733979,74328] 0 2024-09-17T01:01:49.731 INFO:tasks.workunit.client.1.smithi099.stdout:6/141: readlink dc/l15 0 2024-09-17T01:01:49.733 INFO:tasks.workunit.client.1.smithi099.stdout:9/98: rename l7 to da/d14/l1e 0 2024-09-17T01:01:49.734 INFO:tasks.workunit.client.1.smithi099.stdout:9/99: mknod da/d18/c1f 0 2024-09-17T01:01:49.735 INFO:tasks.workunit.client.1.smithi099.stdout:9/100: symlink da/l20 0 2024-09-17T01:01:49.737 INFO:tasks.workunit.client.1.smithi099.stdout:2/105: getdents d2 0 2024-09-17T01:01:49.737 INFO:tasks.workunit.client.1.smithi099.stdout:2/106: dread - d2/f1c zero size 2024-09-17T01:01:49.738 INFO:tasks.workunit.client.1.smithi099.stdout:2/107: mknod d2/d7/c1e 0 2024-09-17T01:01:49.739 INFO:tasks.workunit.client.1.smithi099.stdout:2/108: creat d2/d9/f1f x:0 0 0 2024-09-17T01:01:49.739 INFO:tasks.workunit.client.1.smithi099.stdout:2/109: chown d2/d7/c1e 950470503 1 2024-09-17T01:01:49.741 INFO:tasks.workunit.client.1.smithi099.stdout:8/87: dread d0/d4/fa [0,4194304] 0 2024-09-17T01:01:49.742 INFO:tasks.workunit.client.1.smithi099.stdout:9/101: dread da/ff [0,4194304] 0 2024-09-17T01:01:49.745 INFO:tasks.workunit.client.1.smithi099.stdout:1/104: dwrite d0/d2/de/f15 [0,4194304] 0 2024-09-17T01:01:49.746 INFO:tasks.workunit.client.1.smithi099.stdout:8/88: dread d0/d4/fb [0,4194304] 0 2024-09-17T01:01:49.747 INFO:tasks.workunit.client.1.smithi099.stdout:9/102: mkdir da/d21 0 2024-09-17T01:01:49.748 INFO:tasks.workunit.client.1.smithi099.stdout:6/142: read dc/fe [3383991,76942] 0 2024-09-17T01:01:49.748 INFO:tasks.workunit.client.1.smithi099.stdout:1/105: link d0/d2/d18/c1c d0/d2/d18/c1f 0 2024-09-17T01:01:49.749 INFO:tasks.workunit.client.1.smithi099.stdout:9/103: mkdir da/d14/d22 0 2024-09-17T01:01:49.751 INFO:tasks.workunit.client.1.smithi099.stdout:1/106: fdatasync d0/fc 0 2024-09-17T01:01:49.753 INFO:tasks.workunit.client.1.smithi099.stdout:1/107: rename d0/d2/l4 to d0/d8/l20 0 2024-09-17T01:01:49.755 INFO:tasks.workunit.client.1.smithi099.stdout:1/108: symlink d0/d2/de/l21 0 2024-09-17T01:01:49.756 INFO:tasks.workunit.client.1.smithi099.stdout:6/143: dread dc/d2b/f2c [0,4194304] 0 2024-09-17T01:01:49.756 INFO:tasks.workunit.client.1.smithi099.stdout:8/89: dread d0/d4/fb [4194304,4194304] 0 2024-09-17T01:01:49.758 INFO:tasks.workunit.client.1.smithi099.stdout:2/110: dwrite d2/d9/f1f [0,4194304] 0 2024-09-17T01:01:49.760 INFO:tasks.workunit.client.1.smithi099.stdout:9/104: dread da/d14/f1a [0,4194304] 0 2024-09-17T01:01:49.760 INFO:tasks.workunit.client.1.smithi099.stdout:8/90: dread d0/d4/fb [0,4194304] 0 2024-09-17T01:01:49.766 INFO:tasks.workunit.client.1.smithi099.stdout:6/144: dread fa [0,4194304] 0 2024-09-17T01:01:49.766 INFO:tasks.workunit.client.1.smithi099.stdout:6/145: read dc/fe [3286179,1193] 0 2024-09-17T01:01:49.768 INFO:tasks.workunit.client.1.smithi099.stdout:1/109: dread d0/d2/de/f15 [0,4194304] 0 2024-09-17T01:01:49.768 INFO:tasks.workunit.client.1.smithi099.stdout:1/110: fdatasync d0/d2/ff 0 2024-09-17T01:01:49.768 INFO:tasks.workunit.client.1.smithi099.stdout:2/111: link d2/d8/f11 d2/d8/f20 0 2024-09-17T01:01:49.769 INFO:tasks.workunit.client.1.smithi099.stdout:9/105: creat da/d14/d22/f23 x:0 0 0 2024-09-17T01:01:49.770 INFO:tasks.workunit.client.1.smithi099.stdout:1/111: unlink d0/d2/d5/l16 0 2024-09-17T01:01:49.772 INFO:tasks.workunit.client.1.smithi099.stdout:2/112: rename d2/d8/f11 to d2/d9/d17/f21 0 2024-09-17T01:01:49.778 INFO:tasks.workunit.client.1.smithi099.stdout:2/113: rename d2/d8/cd to d2/d8/d1b/c22 0 2024-09-17T01:01:49.781 INFO:tasks.workunit.client.1.smithi099.stdout:9/106: write da/d14/f1a [1486256,96738] 0 2024-09-17T01:01:49.781 INFO:tasks.workunit.client.1.smithi099.stdout:9/107: read f6 [12030455,37969] 0 2024-09-17T01:01:49.782 INFO:tasks.workunit.client.1.smithi099.stdout:1/112: truncate d0/d2/ff 730680 0 2024-09-17T01:01:49.783 INFO:tasks.workunit.client.1.smithi099.stdout:9/108: rename da/cc to da/d18/c24 0 2024-09-17T01:01:49.783 INFO:tasks.workunit.client.1.smithi099.stdout:9/109: fsync f6 0 2024-09-17T01:01:49.783 INFO:tasks.workunit.client.1.smithi099.stdout:9/110: dread - da/d14/d22/f23 zero size 2024-09-17T01:01:49.783 INFO:tasks.workunit.client.1.smithi099.stdout:1/113: stat d0/d2/d18/c1c 0 2024-09-17T01:01:49.784 INFO:tasks.workunit.client.1.smithi099.stdout:1/114: fdatasync d0/fc 0 2024-09-17T01:01:49.791 INFO:tasks.workunit.client.1.smithi099.stdout:6/146: dwrite dc/f18 [0,4194304] 0 2024-09-17T01:01:49.791 INFO:tasks.workunit.client.1.smithi099.stdout:8/91: dwrite d0/d4/fa [4194304,4194304] 0 2024-09-17T01:01:49.791 INFO:tasks.workunit.client.1.smithi099.stdout:9/111: write f4 [2712010,103027] 0 2024-09-17T01:01:49.793 INFO:tasks.workunit.client.1.smithi099.stdout:2/114: write d2/d9/f1f [2523123,39735] 0 2024-09-17T01:01:49.794 INFO:tasks.workunit.client.1.smithi099.stdout:6/147: rename dc/l14 to dc/d27/l2f 0 2024-09-17T01:01:49.794 INFO:tasks.workunit.client.1.smithi099.stdout:6/148: stat dc/c17 0 2024-09-17T01:01:49.799 INFO:tasks.workunit.client.1.smithi099.stdout:7/105: sync 2024-09-17T01:01:49.800 INFO:tasks.workunit.client.1.smithi099.stdout:9/112: rename da/d1b/l1d to da/d14/d22/l25 0 2024-09-17T01:01:49.801 INFO:tasks.workunit.client.1.smithi099.stdout:1/115: dwrite d0/fc [0,4194304] 0 2024-09-17T01:01:49.801 INFO:tasks.workunit.client.1.smithi099.stdout:1/116: fsync d0/fc 0 2024-09-17T01:01:49.802 INFO:tasks.workunit.client.1.smithi099.stdout:7/106: creat d1/d1e/f20 x:0 0 0 2024-09-17T01:01:49.803 INFO:tasks.workunit.client.1.smithi099.stdout:7/107: write d1/d1e/d12/f14 [327962,78687] 0 2024-09-17T01:01:49.805 INFO:tasks.workunit.client.1.smithi099.stdout:9/113: rename da/f10 to da/d14/d22/f26 0 2024-09-17T01:01:49.807 INFO:tasks.workunit.client.1.smithi099.stdout:1/117: symlink d0/d8/l22 0 2024-09-17T01:01:49.807 INFO:tasks.workunit.client.1.smithi099.stdout:1/118: chown d0/c1d 719 1 2024-09-17T01:01:49.807 INFO:tasks.workunit.client.1.smithi099.stdout:1/119: truncate d0/f13 1217009 0 2024-09-17T01:01:49.807 INFO:tasks.workunit.client.1.smithi099.stdout:7/108: rmdir d1 39 2024-09-17T01:01:49.808 INFO:tasks.workunit.client.1.smithi099.stdout:9/114: symlink da/d14/l27 0 2024-09-17T01:01:49.809 INFO:tasks.workunit.client.1.smithi099.stdout:7/109: truncate d1/ff 2731202 0 2024-09-17T01:01:49.810 INFO:tasks.workunit.client.1.smithi099.stdout:7/110: symlink d1/d1e/d1c/l21 0 2024-09-17T01:01:49.810 INFO:tasks.workunit.client.1.smithi099.stdout:7/111: stat d1/d1e/d12/l15 0 2024-09-17T01:01:49.810 INFO:tasks.workunit.client.1.smithi099.stdout:7/112: chown d1/f11 11454 1 2024-09-17T01:01:49.811 INFO:tasks.workunit.client.1.smithi099.stdout:7/113: write d1/d1e/fe [249122,45855] 0 2024-09-17T01:01:49.812 INFO:tasks.workunit.client.1.smithi099.stdout:7/114: truncate d1/d1e/d12/f1a 1120667 0 2024-09-17T01:01:49.812 INFO:tasks.workunit.client.1.smithi099.stdout:7/115: write d1/d1e/f1b [924511,82211] 0 2024-09-17T01:01:49.812 INFO:tasks.workunit.client.1.smithi099.stdout:7/116: chown d1/d1e/f20 1522 1 2024-09-17T01:01:49.815 INFO:tasks.workunit.client.1.smithi099.stdout:7/117: dread d1/d1e/d12/f16 [0,4194304] 0 2024-09-17T01:01:49.815 INFO:tasks.workunit.client.1.smithi099.stdout:7/118: dread - d1/d1e/f20 zero size 2024-09-17T01:01:49.821 INFO:tasks.workunit.client.1.smithi099.stdout:8/92: dwrite d0/d4/fa [0,4194304] 0 2024-09-17T01:01:49.823 INFO:tasks.workunit.client.1.smithi099.stdout:1/120: dread d0/fc [0,4194304] 0 2024-09-17T01:01:49.823 INFO:tasks.workunit.client.1.smithi099.stdout:2/115: dwrite d2/f1a [0,4194304] 0 2024-09-17T01:01:49.824 INFO:tasks.workunit.client.1.smithi099.stdout:8/93: link d0/d4/fb d0/d8/f12 0 2024-09-17T01:01:49.824 INFO:tasks.workunit.client.1.smithi099.stdout:2/116: read d2/d8/f20 [264820,63011] 0 2024-09-17T01:01:49.824 INFO:tasks.workunit.client.1.smithi099.stdout:2/117: chown d2 59627 1 2024-09-17T01:01:49.824 INFO:tasks.workunit.client.1.smithi099.stdout:2/118: getdents d2 0 2024-09-17T01:01:49.825 INFO:tasks.workunit.client.1.smithi099.stdout:9/115: getdents da/d1b 0 2024-09-17T01:01:49.829 INFO:tasks.workunit.client.1.smithi099.stdout:1/121: dread d0/d2/de/f15 [0,4194304] 0 2024-09-17T01:01:49.830 INFO:tasks.workunit.client.1.smithi099.stdout:9/116: dread da/ff [0,4194304] 0 2024-09-17T01:01:49.833 INFO:tasks.workunit.client.1.smithi099.stdout:8/94: symlink d0/d8/l13 0 2024-09-17T01:01:49.834 INFO:tasks.workunit.client.1.smithi099.stdout:2/119: dread d2/d7/fe [0,4194304] 0 2024-09-17T01:01:49.834 INFO:tasks.workunit.client.1.smithi099.stdout:2/120: getdents d2/d18 0 2024-09-17T01:01:49.834 INFO:tasks.workunit.client.1.smithi099.stdout:1/122: symlink d0/d2/l23 0 2024-09-17T01:01:49.835 INFO:tasks.workunit.client.1.smithi099.stdout:8/95: write d0/d4/f11 [1696413,20966] 0 2024-09-17T01:01:49.835 INFO:tasks.workunit.client.1.smithi099.stdout:1/123: creat d0/d2/f24 x:0 0 0 2024-09-17T01:01:49.836 INFO:tasks.workunit.client.1.smithi099.stdout:9/117: symlink da/l28 0 2024-09-17T01:01:49.839 INFO:tasks.workunit.client.1.smithi099.stdout:7/119: dwrite d1/d1e/f1d [0,4194304] 0 2024-09-17T01:01:49.839 INFO:tasks.workunit.client.1.smithi099.stdout:9/118: getdents da/d14/d22 0 2024-09-17T01:01:49.839 INFO:tasks.workunit.client.1.smithi099.stdout:9/119: readlink da/lb 0 2024-09-17T01:01:49.839 INFO:tasks.workunit.client.1.smithi099.stdout:9/120: creat da/d14/f29 x:0 0 0 2024-09-17T01:01:49.845 INFO:tasks.workunit.client.1.smithi099.stdout:8/96: dread d0/d4/fa [4194304,4194304] 0 2024-09-17T01:01:49.845 INFO:tasks.workunit.client.1.smithi099.stdout:6/149: dwrite dc/d1a/f26 [0,4194304] 0 2024-09-17T01:01:49.845 INFO:tasks.workunit.client.1.smithi099.stdout:8/97: chown d0/d4/f11 2612940 1 2024-09-17T01:01:49.846 INFO:tasks.workunit.client.1.smithi099.stdout:8/98: stat d0/d4/fa 0 2024-09-17T01:01:49.846 INFO:tasks.workunit.client.1.smithi099.stdout:8/99: creat d0/d8/f14 x:0 0 0 2024-09-17T01:01:49.846 INFO:tasks.workunit.client.1.smithi099.stdout:9/121: mkdir da/d21/d2a 0 2024-09-17T01:01:49.846 INFO:tasks.workunit.client.1.smithi099.stdout:9/122: dread - da/d14/f29 zero size 2024-09-17T01:01:49.846 INFO:tasks.workunit.client.1.smithi099.stdout:2/121: write d2/f1a [1184407,109523] 0 2024-09-17T01:01:49.847 INFO:tasks.workunit.client.1.smithi099.stdout:7/120: getdents d1/d1e 0 2024-09-17T01:01:49.851 INFO:tasks.workunit.client.1.smithi099.stdout:6/150: truncate dc/d1a/f1b 3429647 0 2024-09-17T01:01:49.852 INFO:tasks.workunit.client.1.smithi099.stdout:8/100: symlink d0/l15 0 2024-09-17T01:01:49.916 INFO:tasks.workunit.client.1.smithi099.stdout:7/121: mknod d1/d1e/d1c/c22 0 2024-09-17T01:01:49.917 INFO:tasks.workunit.client.1.smithi099.stdout:6/151: dread dc/d2b/f2c [0,4194304] 0 2024-09-17T01:01:49.919 INFO:tasks.workunit.client.1.smithi099.stdout:3/166: sync 2024-09-17T01:01:49.919 INFO:tasks.workunit.client.1.smithi099.stdout:3/167: write d9/d15/d18/f20 [4338208,116061] 0 2024-09-17T01:01:49.920 INFO:tasks.workunit.client.1.smithi099.stdout:1/124: dwrite d0/d2/d18/f1a [0,4194304] 0 2024-09-17T01:01:49.920 INFO:tasks.workunit.client.1.smithi099.stdout:1/125: creat d0/d2/f25 x:0 0 0 2024-09-17T01:01:49.921 INFO:tasks.workunit.client.1.smithi099.stdout:9/123: truncate f4 10065918 0 2024-09-17T01:01:49.926 INFO:tasks.workunit.client.1.smithi099.stdout:1/126: creat d0/d8/f26 x:0 0 0 2024-09-17T01:01:49.926 INFO:tasks.workunit.client.1.smithi099.stdout:1/127: dread - d0/d2/f24 zero size 2024-09-17T01:01:49.926 INFO:tasks.workunit.client.1.smithi099.stdout:1/128: creat d0/d2/de/f27 x:0 0 0 2024-09-17T01:01:49.926 INFO:tasks.workunit.client.1.smithi099.stdout:1/129: chown d0/d2/de/c12 1761 1 2024-09-17T01:01:49.927 INFO:tasks.workunit.client.1.smithi099.stdout:7/122: symlink d1/l23 0 2024-09-17T01:01:49.928 INFO:tasks.workunit.client.1.smithi099.stdout:9/124: symlink da/d1b/l2b 0 2024-09-17T01:01:49.931 INFO:tasks.workunit.client.1.smithi099.stdout:1/130: dread d0/fc [0,4194304] 0 2024-09-17T01:01:49.931 INFO:tasks.workunit.client.1.smithi099.stdout:1/131: fsync d0/d2/ff 0 2024-09-17T01:01:49.934 INFO:tasks.workunit.client.1.smithi099.stdout:1/132: creat d0/d2/d18/f28 x:0 0 0 2024-09-17T01:01:49.936 INFO:tasks.workunit.client.1.smithi099.stdout:8/101: getdents d0 0 2024-09-17T01:01:49.938 INFO:tasks.workunit.client.0.smithi002.stdout:9/7: sync 2024-09-17T01:01:49.938 INFO:tasks.workunit.client.0.smithi002.stdout:2/30: sync 2024-09-17T01:01:49.938 INFO:tasks.workunit.client.0.smithi002.stdout:6/62: sync 2024-09-17T01:01:49.939 INFO:tasks.workunit.client.0.smithi002.stdout:0/22: sync 2024-09-17T01:01:49.939 INFO:tasks.workunit.client.0.smithi002.stdout:0/23: chown l7 469 1 2024-09-17T01:01:49.939 INFO:tasks.workunit.client.0.smithi002.stdout:1/11: sync 2024-09-17T01:01:49.939 INFO:tasks.workunit.client.0.smithi002.stdout:5/53: sync 2024-09-17T01:01:49.939 INFO:tasks.workunit.client.0.smithi002.stdout:8/8: sync 2024-09-17T01:01:49.939 INFO:tasks.workunit.client.0.smithi002.stdout:8/9: truncate f0 707599 0 2024-09-17T01:01:49.939 INFO:tasks.workunit.client.0.smithi002.stdout:4/88: sync 2024-09-17T01:01:49.939 INFO:tasks.workunit.client.0.smithi002.stdout:7/31: sync 2024-09-17T01:01:49.939 INFO:tasks.workunit.client.0.smithi002.stdout:7/32: stat d1/la 0 2024-09-17T01:01:49.939 INFO:tasks.workunit.client.0.smithi002.stdout:3/12: sync 2024-09-17T01:01:49.940 INFO:tasks.workunit.client.0.smithi002.stdout:3/13: dwrite - no filename 2024-09-17T01:01:49.940 INFO:tasks.workunit.client.0.smithi002.stdout:3/14: dwrite - no filename 2024-09-17T01:01:49.940 INFO:tasks.workunit.client.0.smithi002.stdout:3/15: write - no filename 2024-09-17T01:01:49.940 INFO:tasks.workunit.client.0.smithi002.stdout:0/24: symlink l8 0 2024-09-17T01:01:49.941 INFO:tasks.workunit.client.1.smithi099.stdout:6/152: dwrite dc/f18 [0,4194304] 0 2024-09-17T01:01:49.941 INFO:tasks.workunit.client.0.smithi002.stdout:5/54: truncate d2/fa 266185 0 2024-09-17T01:01:49.942 INFO:tasks.workunit.client.0.smithi002.stdout:8/10: creat f1 x:0 0 0 2024-09-17T01:01:49.943 INFO:tasks.workunit.client.1.smithi099.stdout:6/153: mkdir dc/d27/d30 0 2024-09-17T01:01:49.946 INFO:tasks.workunit.client.1.smithi099.stdout:6/154: symlink dc/d2b/l31 0 2024-09-17T01:01:49.947 INFO:tasks.workunit.client.1.smithi099.stdout:9/125: dread f6 [0,4194304] 0 2024-09-17T01:01:49.947 INFO:tasks.workunit.client.1.smithi099.stdout:9/126: fsync da/d14/f29 0 2024-09-17T01:01:49.947 INFO:tasks.workunit.client.1.smithi099.stdout:6/155: rmdir dc 39 2024-09-17T01:01:49.948 INFO:tasks.workunit.client.0.smithi002.stdout:7/33: symlink d1/lb 0 2024-09-17T01:01:49.948 INFO:tasks.workunit.client.0.smithi002.stdout:3/16: mkdir d0/d3 0 2024-09-17T01:01:49.948 INFO:tasks.workunit.client.1.smithi099.stdout:9/127: creat da/f2c x:0 0 0 2024-09-17T01:01:49.948 INFO:tasks.workunit.client.1.smithi099.stdout:9/128: write da/ff [2265513,83188] 0 2024-09-17T01:01:49.949 INFO:tasks.workunit.client.0.smithi002.stdout:9/8: write f0 [524173,55040] 0 2024-09-17T01:01:49.949 INFO:tasks.workunit.client.0.smithi002.stdout:9/9: chown f0 11178 1 2024-09-17T01:01:49.949 INFO:tasks.workunit.client.0.smithi002.stdout:9/10: creat f2 x:0 0 0 2024-09-17T01:01:49.949 INFO:tasks.workunit.client.0.smithi002.stdout:8/11: mkdir d2 0 2024-09-17T01:01:49.949 INFO:tasks.workunit.client.0.smithi002.stdout:4/89: symlink d7/l1b 0 2024-09-17T01:01:49.950 INFO:tasks.workunit.client.1.smithi099.stdout:6/156: link dc/d1a/l1f dc/d27/d30/l32 0 2024-09-17T01:01:49.950 INFO:tasks.workunit.client.0.smithi002.stdout:9/11: write f0 [561859,130294] 0 2024-09-17T01:01:49.950 INFO:tasks.workunit.client.1.smithi099.stdout:9/129: symlink da/d1b/l2d 0 2024-09-17T01:01:49.950 INFO:tasks.workunit.client.1.smithi099.stdout:9/130: chown da/d18/c24 23 1 2024-09-17T01:01:49.954 INFO:tasks.workunit.client.0.smithi002.stdout:7/34: symlink d1/lc 0 2024-09-17T01:01:49.954 INFO:tasks.workunit.client.0.smithi002.stdout:3/17: creat d0/d3/f4 x:0 0 0 2024-09-17T01:01:49.954 INFO:tasks.workunit.client.0.smithi002.stdout:8/12: mkdir d2/d3 0 2024-09-17T01:01:49.954 INFO:tasks.workunit.client.0.smithi002.stdout:8/13: stat d2/d3 0 2024-09-17T01:01:49.956 INFO:tasks.workunit.client.0.smithi002.stdout:4/90: rename f4 to d7/d19/f1c 0 2024-09-17T01:01:49.956 INFO:tasks.workunit.client.0.smithi002.stdout:4/91: fsync d7/f18 0 2024-09-17T01:01:49.956 INFO:tasks.workunit.client.0.smithi002.stdout:7/35: rename d1 to d1/dd 22 2024-09-17T01:01:49.957 INFO:tasks.workunit.client.0.smithi002.stdout:7/36: write d1/f6 [2026525,118620] 0 2024-09-17T01:01:49.957 INFO:tasks.workunit.client.0.smithi002.stdout:9/12: mknod c3 0 2024-09-17T01:01:49.959 INFO:tasks.workunit.client.0.smithi002.stdout:3/18: rename d0/c2 to d0/c5 0 2024-09-17T01:01:49.959 INFO:tasks.workunit.client.0.smithi002.stdout:3/19: stat d0/d3 0 2024-09-17T01:01:49.960 INFO:tasks.workunit.client.0.smithi002.stdout:3/20: readlink - no filename 2024-09-17T01:01:49.960 INFO:tasks.workunit.client.0.smithi002.stdout:8/14: creat d2/f4 x:0 0 0 2024-09-17T01:01:49.962 INFO:tasks.workunit.client.0.smithi002.stdout:4/92: creat d7/d19/f1d x:0 0 0 2024-09-17T01:01:49.962 INFO:tasks.workunit.client.0.smithi002.stdout:4/93: write d7/f17 [878584,130450] 0 2024-09-17T01:01:49.963 INFO:tasks.workunit.client.0.smithi002.stdout:7/37: symlink d1/le 0 2024-09-17T01:01:49.964 INFO:tasks.workunit.client.0.smithi002.stdout:9/13: symlink l4 0 2024-09-17T01:01:49.964 INFO:tasks.workunit.client.1.smithi099.stdout:6/157: dread dc/d1a/f26 [0,4194304] 0 2024-09-17T01:01:49.964 INFO:tasks.workunit.client.1.smithi099.stdout:6/158: readlink dc/l16 0 2024-09-17T01:01:49.965 INFO:tasks.workunit.client.0.smithi002.stdout:4/94: mknod d7/d19/c1e 0 2024-09-17T01:01:49.965 INFO:tasks.workunit.client.0.smithi002.stdout:0/25: write f4 [1587831,113292] 0 2024-09-17T01:01:49.966 INFO:tasks.workunit.client.0.smithi002.stdout:7/38: symlink d1/lf 0 2024-09-17T01:01:49.966 INFO:tasks.workunit.client.1.smithi099.stdout:9/131: write da/fe [201460,114919] 0 2024-09-17T01:01:49.968 INFO:tasks.workunit.client.0.smithi002.stdout:0/26: symlink l9 0 2024-09-17T01:01:49.970 INFO:tasks.workunit.client.0.smithi002.stdout:0/27: symlink la 0 2024-09-17T01:01:49.974 INFO:tasks.workunit.client.1.smithi099.stdout:3/168: dwrite d9/d15/d18/d1a/d23/f33 [0,4194304] 0 2024-09-17T01:01:49.974 INFO:tasks.workunit.client.1.smithi099.stdout:3/169: readlink l7 0 2024-09-17T01:01:49.975 INFO:tasks.workunit.client.1.smithi099.stdout:3/170: write d9/d15/d18/d1a/d23/f17 [4705344,23497] 0 2024-09-17T01:01:49.976 INFO:tasks.workunit.client.1.smithi099.stdout:3/171: stat d9/d15/c36 0 2024-09-17T01:01:49.976 INFO:tasks.workunit.client.1.smithi099.stdout:3/172: stat d9/d15/d18/d1a/d23/f17 0 2024-09-17T01:01:49.985 INFO:tasks.workunit.client.1.smithi099.stdout:7/123: dwrite d1/ff [0,4194304] 0 2024-09-17T01:01:49.985 INFO:tasks.workunit.client.1.smithi099.stdout:7/124: chown d1/f4 5885861 1 2024-09-17T01:01:49.986 INFO:tasks.workunit.client.1.smithi099.stdout:7/125: getdents d1/d1e 0 2024-09-17T01:01:49.987 INFO:tasks.workunit.client.1.smithi099.stdout:7/126: write d1/d1e/f13 [754318,8784] 0 2024-09-17T01:01:49.988 INFO:tasks.workunit.client.1.smithi099.stdout:7/127: creat d1/f24 x:0 0 0 2024-09-17T01:01:49.992 INFO:tasks.workunit.client.1.smithi099.stdout:7/128: dread d1/d1e/f1b [0,4194304] 0 2024-09-17T01:01:49.992 INFO:tasks.workunit.client.1.smithi099.stdout:8/102: dwrite d0/d4/fa [0,4194304] 0 2024-09-17T01:01:49.993 INFO:tasks.workunit.client.0.smithi002.stdout:2/31: dwrite f3 [0,4194304] 0 2024-09-17T01:01:49.993 INFO:tasks.workunit.client.0.smithi002.stdout:2/32: chown f3 708 1 2024-09-17T01:01:49.995 INFO:tasks.workunit.client.0.smithi002.stdout:2/33: creat f5 x:0 0 0 2024-09-17T01:01:49.997 INFO:tasks.workunit.client.0.smithi002.stdout:2/34: rename f3 to f6 0 2024-09-17T01:01:49.999 INFO:tasks.workunit.client.0.smithi002.stdout:2/35: link l2 l7 0 2024-09-17T01:01:50.000 INFO:tasks.workunit.client.0.smithi002.stdout:2/36: chown f5 10141140 1 2024-09-17T01:01:50.000 INFO:tasks.workunit.client.1.smithi099.stdout:8/103: dread d0/d8/f12 [4194304,4194304] 0 2024-09-17T01:01:50.002 INFO:tasks.workunit.client.0.smithi002.stdout:1/12: dwrite f1 [0,4194304] 0 2024-09-17T01:01:50.002 INFO:tasks.workunit.client.0.smithi002.stdout:1/13: creat f3 x:0 0 0 2024-09-17T01:01:50.002 INFO:tasks.workunit.client.0.smithi002.stdout:1/14: chown f3 193473 1 2024-09-17T01:01:50.002 INFO:tasks.workunit.client.0.smithi002.stdout:1/15: chown f1 261 1 2024-09-17T01:01:50.005 INFO:tasks.workunit.client.0.smithi002.stdout:1/16: mkdir d4 0 2024-09-17T01:01:50.009 INFO:tasks.workunit.client.1.smithi099.stdout:1/133: dwrite d0/d2/d18/f1a [4194304,4194304] 0 2024-09-17T01:01:50.010 INFO:tasks.workunit.client.0.smithi002.stdout:5/55: dwrite d2/f6 [0,4194304] 0 2024-09-17T01:01:50.012 INFO:tasks.workunit.client.0.smithi002.stdout:5/56: mkdir d2/de 0 2024-09-17T01:01:50.012 INFO:tasks.workunit.client.0.smithi002.stdout:5/57: rmdir d2/dc 39 2024-09-17T01:01:50.014 INFO:tasks.workunit.client.1.smithi099.stdout:8/104: write d0/d4/fb [3736878,128353] 0 2024-09-17T01:01:50.014 INFO:tasks.workunit.client.1.smithi099.stdout:8/105: write d0/d8/f12 [9424740,66530] 0 2024-09-17T01:01:50.014 INFO:tasks.workunit.client.1.smithi099.stdout:8/106: chown d0/l15 111389 1 2024-09-17T01:01:50.016 INFO:tasks.workunit.client.1.smithi099.stdout:8/107: mknod d0/d8/c16 0 2024-09-17T01:01:50.017 INFO:tasks.workunit.client.1.smithi099.stdout:3/173: dwrite f3 [0,4194304] 0 2024-09-17T01:01:50.019 INFO:tasks.workunit.client.0.smithi002.stdout:6/63: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:01:50.020 INFO:tasks.workunit.client.1.smithi099.stdout:6/159: dwrite dc/d1a/f1e [0,4194304] 0 2024-09-17T01:01:50.021 INFO:tasks.workunit.client.0.smithi002.stdout:5/58: write d2/fa [1144645,88334] 0 2024-09-17T01:01:50.021 INFO:tasks.workunit.client.0.smithi002.stdout:5/59: fdatasync d2/f4 0 2024-09-17T01:01:50.022 INFO:tasks.workunit.client.0.smithi002.stdout:3/21: dwrite d0/d3/f4 [0,4194304] 0 2024-09-17T01:01:50.023 INFO:tasks.workunit.client.0.smithi002.stdout:8/15: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:01:50.024 INFO:tasks.workunit.client.1.smithi099.stdout:9/132: dwrite f6 [4194304,4194304] 0 2024-09-17T01:01:50.028 INFO:tasks.workunit.client.1.smithi099.stdout:7/129: dwrite d1/d1e/f1b [0,4194304] 0 2024-09-17T01:01:50.028 INFO:tasks.workunit.client.0.smithi002.stdout:5/60: rename f1 to d2/de/ff 0 2024-09-17T01:01:50.029 INFO:tasks.workunit.client.0.smithi002.stdout:5/61: dread - d2/f3 zero size 2024-09-17T01:01:50.029 INFO:tasks.workunit.client.0.smithi002.stdout:2/37: dwrite f6 [0,4194304] 0 2024-09-17T01:01:50.029 INFO:tasks.workunit.client.0.smithi002.stdout:2/38: truncate f5 619737 0 2024-09-17T01:01:50.029 INFO:tasks.workunit.client.0.smithi002.stdout:9/14: dread f0 [0,4194304] 0 2024-09-17T01:01:50.032 INFO:tasks.workunit.client.1.smithi099.stdout:9/133: symlink da/d18/l2e 0 2024-09-17T01:01:50.036 INFO:tasks.workunit.client.0.smithi002.stdout:5/62: dread d2/f4 [4194304,4194304] 0 2024-09-17T01:01:50.037 INFO:tasks.workunit.client.0.smithi002.stdout:8/16: fsync d2/f4 0 2024-09-17T01:01:50.037 INFO:tasks.workunit.client.0.smithi002.stdout:8/17: write f1 [493271,51731] 0 2024-09-17T01:01:50.039 INFO:tasks.workunit.client.0.smithi002.stdout:3/22: getdents d0/d3 0 2024-09-17T01:01:50.040 INFO:tasks.workunit.client.1.smithi099.stdout:1/134: dwrite d0/d2/f24 [0,4194304] 0 2024-09-17T01:01:50.040 INFO:tasks.workunit.client.1.smithi099.stdout:8/108: rename d0/d8 to d0/d17 0 2024-09-17T01:01:50.040 INFO:tasks.workunit.client.1.smithi099.stdout:9/134: write da/d14/d22/f26 [346557,117168] 0 2024-09-17T01:01:50.041 INFO:tasks.workunit.client.0.smithi002.stdout:5/63: mkdir d2/dc/dd/d10 0 2024-09-17T01:01:50.042 INFO:tasks.workunit.client.1.smithi099.stdout:6/160: dread dc/d1a/f1b [0,4194304] 0 2024-09-17T01:01:50.042 INFO:tasks.workunit.client.1.smithi099.stdout:1/135: symlink d0/d2/d18/l29 0 2024-09-17T01:01:50.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:49 smithi099 ceph-mon[34357]: pgmap v248: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 8.2 MiB/s rd, 15 MiB/s wr, 574 op/s 2024-09-17T01:01:50.043 INFO:tasks.workunit.client.0.smithi002.stdout:1/17: dwrite f1 [0,4194304] 0 2024-09-17T01:01:50.043 INFO:tasks.workunit.client.0.smithi002.stdout:8/18: unlink f1 0 2024-09-17T01:01:50.045 INFO:tasks.workunit.client.0.smithi002.stdout:0/28: truncate f1 6065 0 2024-09-17T01:01:50.046 INFO:tasks.workunit.client.0.smithi002.stdout:6/64: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:01:50.046 INFO:tasks.workunit.client.0.smithi002.stdout:6/65: chown d2/d6/ca 21 1 2024-09-17T01:01:50.046 INFO:tasks.workunit.client.0.smithi002.stdout:6/66: stat f1 0 2024-09-17T01:01:50.046 INFO:tasks.workunit.client.0.smithi002.stdout:2/39: symlink l8 0 2024-09-17T01:01:50.047 INFO:tasks.workunit.client.1.smithi099.stdout:9/135: rename da/d18/l2e to da/d21/l2f 0 2024-09-17T01:01:50.047 INFO:tasks.workunit.client.1.smithi099.stdout:9/136: write da/f2c [623777,74250] 0 2024-09-17T01:01:50.047 INFO:tasks.workunit.client.1.smithi099.stdout:9/137: write f4 [1666720,121169] 0 2024-09-17T01:01:50.047 INFO:tasks.workunit.client.1.smithi099.stdout:6/161: creat dc/d1a/f33 x:0 0 0 2024-09-17T01:01:50.047 INFO:tasks.workunit.client.1.smithi099.stdout:1/136: mknod d0/d2/d5/c2a 0 2024-09-17T01:01:50.047 INFO:tasks.workunit.client.1.smithi099.stdout:1/137: fsync d0/d2/d18/f1a 0 2024-09-17T01:01:50.048 INFO:tasks.workunit.client.0.smithi002.stdout:3/23: mkdir d0/d3/d6 0 2024-09-17T01:01:50.048 INFO:tasks.workunit.client.0.smithi002.stdout:8/19: mknod d2/c5 0 2024-09-17T01:01:50.049 INFO:tasks.workunit.client.0.smithi002.stdout:6/67: creat d2/f13 x:0 0 0 2024-09-17T01:01:50.049 INFO:tasks.workunit.client.0.smithi002.stdout:6/68: stat f1 0 2024-09-17T01:01:50.050 INFO:tasks.workunit.client.1.smithi099.stdout:6/162: creat dc/f34 x:0 0 0 2024-09-17T01:01:50.050 INFO:tasks.workunit.client.1.smithi099.stdout:6/163: write dc/fe [440555,45569] 0 2024-09-17T01:01:50.051 INFO:tasks.workunit.client.0.smithi002.stdout:2/40: fsync f6 0 2024-09-17T01:01:50.051 INFO:tasks.workunit.client.1.smithi099.stdout:1/138: link d0/d2/de/c12 d0/c2b 0 2024-09-17T01:01:50.053 INFO:tasks.workunit.client.1.smithi099.stdout:6/164: symlink dc/d1a/l35 0 2024-09-17T01:01:50.055 INFO:tasks.workunit.client.1.smithi099.stdout:1/139: rename d0/d2/de/c12 to d0/d8/c2c 0 2024-09-17T01:01:50.055 INFO:tasks.workunit.client.1.smithi099.stdout:1/140: dread - d0/d2/d18/f28 zero size 2024-09-17T01:01:50.055 INFO:tasks.workunit.client.1.smithi099.stdout:9/138: dread da/ff [0,4194304] 0 2024-09-17T01:01:50.055 INFO:tasks.workunit.client.1.smithi099.stdout:1/141: fsync d0/d2/de/f27 0 2024-09-17T01:01:50.055 INFO:tasks.workunit.client.0.smithi002.stdout:6/69: symlink d2/dc/l14 0 2024-09-17T01:01:50.056 INFO:tasks.workunit.client.0.smithi002.stdout:6/70: creat d2/f15 x:0 0 0 2024-09-17T01:01:50.056 INFO:tasks.workunit.client.0.smithi002.stdout:6/71: creat d2/f16 x:0 0 0 2024-09-17T01:01:50.056 INFO:tasks.workunit.client.0.smithi002.stdout:6/72: readlink d2/dc/lf 0 2024-09-17T01:01:50.056 INFO:tasks.workunit.client.1.smithi099.stdout:9/139: write da/f2c [356433,38970] 0 2024-09-17T01:01:50.056 INFO:tasks.workunit.client.1.smithi099.stdout:9/140: stat da/d14/l27 0 2024-09-17T01:01:50.057 INFO:tasks.workunit.client.1.smithi099.stdout:1/142: symlink d0/d2/d18/l2d 0 2024-09-17T01:01:50.057 INFO:tasks.workunit.client.1.smithi099.stdout:1/143: readlink d0/d2/d9/lb 0 2024-09-17T01:01:50.058 INFO:tasks.workunit.client.0.smithi002.stdout:2/41: creat f9 x:0 0 0 2024-09-17T01:01:50.060 INFO:tasks.workunit.client.1.smithi099.stdout:6/165: read fa [1901583,39970] 0 2024-09-17T01:01:50.060 INFO:tasks.workunit.client.1.smithi099.stdout:6/166: chown dc/d1a 16193160 1 2024-09-17T01:01:50.060 INFO:tasks.workunit.client.1.smithi099.stdout:6/167: creat dc/f36 x:0 0 0 2024-09-17T01:01:50.060 INFO:tasks.workunit.client.1.smithi099.stdout:3/174: dwrite d9/d15/d18/f2a [0,4194304] 0 2024-09-17T01:01:50.060 INFO:tasks.workunit.client.1.smithi099.stdout:3/175: write f3 [4307284,81595] 0 2024-09-17T01:01:50.062 INFO:tasks.workunit.client.0.smithi002.stdout:2/42: unlink f6 0 2024-09-17T01:01:50.062 INFO:tasks.workunit.client.0.smithi002.stdout:2/43: truncate f5 1210562 0 2024-09-17T01:01:50.063 INFO:tasks.workunit.client.0.smithi002.stdout:5/64: dread d2/de/ff [0,4194304] 0 2024-09-17T01:01:50.063 INFO:tasks.workunit.client.0.smithi002.stdout:1/18: write f1 [3069782,14781] 0 2024-09-17T01:01:50.063 INFO:tasks.workunit.client.1.smithi099.stdout:6/168: mknod dc/d1a/c37 0 2024-09-17T01:01:50.064 INFO:tasks.workunit.client.0.smithi002.stdout:2/44: rename f9 to fa 0 2024-09-17T01:01:50.066 INFO:tasks.workunit.client.1.smithi099.stdout:3/176: getdents d9/d15/d18/d1a/d23 0 2024-09-17T01:01:50.066 INFO:tasks.workunit.client.1.smithi099.stdout:3/177: creat d9/d15/d18/f37 x:0 0 0 2024-09-17T01:01:50.066 INFO:tasks.workunit.client.1.smithi099.stdout:3/178: chown d9/d15/f34 403392 1 2024-09-17T01:01:50.067 INFO:tasks.workunit.client.0.smithi002.stdout:5/65: creat d2/de/f11 x:0 0 0 2024-09-17T01:01:50.067 INFO:tasks.workunit.client.1.smithi099.stdout:4/107: sync 2024-09-17T01:01:50.067 INFO:tasks.workunit.client.1.smithi099.stdout:0/75: sync 2024-09-17T01:01:50.067 INFO:tasks.workunit.client.1.smithi099.stdout:5/203: sync 2024-09-17T01:01:50.067 INFO:tasks.workunit.client.1.smithi099.stdout:0/76: fsync f9 0 2024-09-17T01:01:50.068 INFO:tasks.workunit.client.0.smithi002.stdout:2/45: creat fb x:0 0 0 2024-09-17T01:01:50.069 INFO:tasks.workunit.client.1.smithi099.stdout:7/130: dwrite d1/d1e/f20 [0,4194304] 0 2024-09-17T01:01:50.069 INFO:tasks.workunit.client.0.smithi002.stdout:2/46: stat l7 0 2024-09-17T01:01:50.069 INFO:tasks.workunit.client.0.smithi002.stdout:2/47: fdatasync fb 0 2024-09-17T01:01:50.069 INFO:tasks.workunit.client.0.smithi002.stdout:2/48: fdatasync f5 0 2024-09-17T01:01:50.069 INFO:tasks.workunit.client.0.smithi002.stdout:2/49: write f5 [1921977,35107] 0 2024-09-17T01:01:50.070 INFO:tasks.workunit.client.1.smithi099.stdout:3/179: mkdir d9/d15/d38 0 2024-09-17T01:01:50.071 INFO:tasks.workunit.client.1.smithi099.stdout:4/108: mkdir d7/dd/d21/d26 0 2024-09-17T01:01:50.071 INFO:tasks.workunit.client.1.smithi099.stdout:4/109: chown d7/dd/de/c1e 6121689 1 2024-09-17T01:01:50.071 INFO:tasks.workunit.client.1.smithi099.stdout:4/110: fdatasync f6 0 2024-09-17T01:01:50.071 INFO:tasks.workunit.client.1.smithi099.stdout:4/111: fdatasync f6 0 2024-09-17T01:01:50.071 INFO:tasks.workunit.client.1.smithi099.stdout:4/112: creat d7/dd/de/d1b/f27 x:0 0 0 2024-09-17T01:01:50.071 INFO:tasks.workunit.client.1.smithi099.stdout:4/113: dread - d7/dd/f12 zero size 2024-09-17T01:01:50.071 INFO:tasks.workunit.client.1.smithi099.stdout:0/77: rmdir da/df 39 2024-09-17T01:01:50.071 INFO:tasks.workunit.client.1.smithi099.stdout:0/78: chown da/f14 898 1 2024-09-17T01:01:50.073 INFO:tasks.workunit.client.1.smithi099.stdout:5/204: mknod d2/dc/d17/d3c/c44 0 2024-09-17T01:01:50.073 INFO:tasks.workunit.client.0.smithi002.stdout:5/66: write f0 [614173,19630] 0 2024-09-17T01:01:50.073 INFO:tasks.workunit.client.0.smithi002.stdout:0/29: write f4 [660844,42059] 0 2024-09-17T01:01:50.073 INFO:tasks.workunit.client.0.smithi002.stdout:0/30: rmdir - no directory 2024-09-17T01:01:50.076 INFO:tasks.workunit.client.1.smithi099.stdout:3/180: mknod d9/c39 0 2024-09-17T01:01:50.076 INFO:tasks.workunit.client.0.smithi002.stdout:2/50: dread f5 [0,4194304] 0 2024-09-17T01:01:50.077 INFO:tasks.workunit.client.1.smithi099.stdout:6/169: fdatasync dc/fe 0 2024-09-17T01:01:50.078 INFO:tasks.workunit.client.1.smithi099.stdout:4/114: truncate d7/fc 4185108 0 2024-09-17T01:01:50.078 INFO:tasks.workunit.client.1.smithi099.stdout:4/115: chown d7/fb 973 1 2024-09-17T01:01:50.078 INFO:tasks.workunit.client.1.smithi099.stdout:4/116: creat d7/dd/f28 x:0 0 0 2024-09-17T01:01:50.078 INFO:tasks.workunit.client.1.smithi099.stdout:4/117: creat d7/dd/de/f29 x:0 0 0 2024-09-17T01:01:50.078 INFO:tasks.workunit.client.1.smithi099.stdout:4/118: write d7/dd/de/d1b/f1d [105745,90978] 0 2024-09-17T01:01:50.078 INFO:tasks.workunit.client.0.smithi002.stdout:9/15: dwrite f0 [0,4194304] 0 2024-09-17T01:01:50.080 INFO:tasks.workunit.client.1.smithi099.stdout:9/141: dwrite da/ff [0,4194304] 0 2024-09-17T01:01:50.080 INFO:tasks.workunit.client.1.smithi099.stdout:9/142: chown da/l16 14409010 1 2024-09-17T01:01:50.081 INFO:tasks.workunit.client.1.smithi099.stdout:5/205: mkdir d2/d45 0 2024-09-17T01:01:50.084 INFO:tasks.workunit.client.1.smithi099.stdout:5/206: read d2/f5 [33344,4980] 0 2024-09-17T01:01:50.084 INFO:tasks.workunit.client.1.smithi099.stdout:7/131: rmdir d1 39 2024-09-17T01:01:50.085 INFO:tasks.workunit.client.0.smithi002.stdout:8/20: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:01:50.086 INFO:tasks.workunit.client.0.smithi002.stdout:1/19: dread f1 [0,4194304] 0 2024-09-17T01:01:50.087 INFO:tasks.workunit.client.0.smithi002.stdout:1/20: chown f1 19809 1 2024-09-17T01:01:50.087 INFO:tasks.workunit.client.1.smithi099.stdout:3/181: symlink d9/d15/d38/l3a 0 2024-09-17T01:01:50.087 INFO:tasks.workunit.client.1.smithi099.stdout:3/182: read d9/d15/d18/d1a/f1f [3047718,77116] 0 2024-09-17T01:01:50.087 INFO:tasks.workunit.client.0.smithi002.stdout:8/21: creat d2/d3/f6 x:0 0 0 2024-09-17T01:01:50.088 INFO:tasks.workunit.client.0.smithi002.stdout:1/21: symlink d4/l5 0 2024-09-17T01:01:50.090 INFO:tasks.workunit.client.0.smithi002.stdout:8/22: rename d2/d3/f6 to d2/d3/f7 0 2024-09-17T01:01:50.090 INFO:tasks.workunit.client.0.smithi002.stdout:8/23: readlink - no filename 2024-09-17T01:01:50.090 INFO:tasks.workunit.client.0.smithi002.stdout:1/22: rmdir d4 39 2024-09-17T01:01:50.092 INFO:tasks.workunit.client.1.smithi099.stdout:6/170: link dc/d27/l2f dc/l38 0 2024-09-17T01:01:50.092 INFO:tasks.workunit.client.1.smithi099.stdout:6/171: stat dc/d2b/f2c 0 2024-09-17T01:01:50.093 INFO:tasks.workunit.client.0.smithi002.stdout:1/23: creat d4/f6 x:0 0 0 2024-09-17T01:01:50.093 INFO:tasks.workunit.client.0.smithi002.stdout:1/24: chown f3 26695438 1 2024-09-17T01:01:50.093 INFO:tasks.workunit.client.0.smithi002.stdout:3/24: dwrite d0/d3/f4 [4194304,4194304] 0 2024-09-17T01:01:50.093 INFO:tasks.workunit.client.0.smithi002.stdout:9/16: write f0 [1465091,28337] 0 2024-09-17T01:01:50.093 INFO:tasks.workunit.client.0.smithi002.stdout:9/17: chown f2 6746 1 2024-09-17T01:01:50.093 INFO:tasks.workunit.client.0.smithi002.stdout:9/18: chown c3 0 1 2024-09-17T01:01:50.093 INFO:tasks.workunit.client.0.smithi002.stdout:9/19: stat c3 0 2024-09-17T01:01:50.093 INFO:tasks.workunit.client.0.smithi002.stdout:8/24: getdents d2 0 2024-09-17T01:01:50.094 INFO:tasks.workunit.client.1.smithi099.stdout:9/143: dread da/d14/f1a [0,4194304] 0 2024-09-17T01:01:50.094 INFO:tasks.workunit.client.1.smithi099.stdout:9/144: chown c2 69 1 2024-09-17T01:01:50.098 INFO:tasks.workunit.client.1.smithi099.stdout:4/119: symlink d7/dd/de/d10/d18/l2a 0 2024-09-17T01:01:50.098 INFO:tasks.workunit.client.1.smithi099.stdout:1/144: rmdir d0/d8 39 2024-09-17T01:01:50.101 INFO:tasks.workunit.client.0.smithi002.stdout:9/20: mkdir d5 0 2024-09-17T01:01:50.101 INFO:tasks.workunit.client.1.smithi099.stdout:7/132: stat d1/cd 0 2024-09-17T01:01:50.102 INFO:tasks.workunit.client.0.smithi002.stdout:8/25: symlink d2/l8 0 2024-09-17T01:01:50.103 INFO:tasks.workunit.client.1.smithi099.stdout:6/172: dread f7 [0,4194304] 0 2024-09-17T01:01:50.103 INFO:tasks.workunit.client.0.smithi002.stdout:3/25: symlink d0/d3/l7 0 2024-09-17T01:01:50.103 INFO:tasks.workunit.client.0.smithi002.stdout:3/26: chown d0/d3/f4 149 1 2024-09-17T01:01:50.104 INFO:tasks.workunit.client.0.smithi002.stdout:3/27: readlink d0/d3/l7 0 2024-09-17T01:01:50.105 INFO:tasks.workunit.client.1.smithi099.stdout:9/145: mknod da/d21/c30 0 2024-09-17T01:01:50.105 INFO:tasks.workunit.client.1.smithi099.stdout:9/146: read da/f2c [376582,29460] 0 2024-09-17T01:01:50.105 INFO:tasks.workunit.client.1.smithi099.stdout:9/147: write da/d14/d22/f23 [229809,37225] 0 2024-09-17T01:01:50.105 INFO:tasks.workunit.client.1.smithi099.stdout:9/148: readlink da/l13 0 2024-09-17T01:01:50.105 INFO:tasks.workunit.client.1.smithi099.stdout:9/149: fsync da/f2c 0 2024-09-17T01:01:50.105 INFO:tasks.workunit.client.1.smithi099.stdout:9/150: readlink da/l13 0 2024-09-17T01:01:50.106 INFO:tasks.workunit.client.0.smithi002.stdout:8/26: read - d2/d3/f7 zero size 2024-09-17T01:01:50.106 INFO:tasks.workunit.client.0.smithi002.stdout:8/27: fdatasync f0 0 2024-09-17T01:01:50.106 INFO:tasks.workunit.client.1.smithi099.stdout:4/120: symlink d7/dd/de/d10/d1a/l2b 0 2024-09-17T01:01:50.106 INFO:tasks.workunit.client.1.smithi099.stdout:4/121: write d7/dd/f12 [565976,28798] 0 2024-09-17T01:01:50.107 INFO:tasks.workunit.client.0.smithi002.stdout:3/28: creat d0/d3/f8 x:0 0 0 2024-09-17T01:01:50.107 INFO:tasks.workunit.client.0.smithi002.stdout:3/29: fsync d0/d3/f4 0 2024-09-17T01:01:50.107 INFO:tasks.workunit.client.1.smithi099.stdout:7/133: creat d1/f25 x:0 0 0 2024-09-17T01:01:50.111 INFO:tasks.workunit.client.0.smithi002.stdout:8/28: mkdir d2/d9 0 2024-09-17T01:01:50.112 INFO:tasks.workunit.client.1.smithi099.stdout:9/151: rename da/l1c to da/d21/d2a/l31 0 2024-09-17T01:01:50.113 INFO:tasks.workunit.client.0.smithi002.stdout:3/30: symlink d0/d3/l9 0 2024-09-17T01:01:50.114 INFO:tasks.workunit.client.0.smithi002.stdout:3/31: truncate d0/d3/f8 639467 0 2024-09-17T01:01:50.114 INFO:tasks.workunit.client.1.smithi099.stdout:4/122: creat d7/dd/de/d10/d1a/f2c x:0 0 0 2024-09-17T01:01:50.114 INFO:tasks.workunit.client.1.smithi099.stdout:4/123: write d7/dd/de/d10/d1a/f2c [525543,98822] 0 2024-09-17T01:01:50.117 INFO:tasks.workunit.client.1.smithi099.stdout:7/134: mknod d1/d1e/c26 0 2024-09-17T01:01:50.117 INFO:tasks.workunit.client.1.smithi099.stdout:7/135: stat d1/l1f 0 2024-09-17T01:01:50.117 INFO:tasks.workunit.client.1.smithi099.stdout:7/136: write d1/d1e/f13 [1242769,72960] 0 2024-09-17T01:01:50.122 INFO:tasks.workunit.client.1.smithi099.stdout:7/137: rename d1/cc to d1/d1e/c27 0 2024-09-17T01:01:50.122 INFO:tasks.workunit.client.1.smithi099.stdout:7/138: fdatasync d1/d1e/f1b 0 2024-09-17T01:01:50.122 INFO:tasks.workunit.client.1.smithi099.stdout:7/139: fdatasync d1/ff 0 2024-09-17T01:01:50.123 INFO:tasks.workunit.client.0.smithi002.stdout:1/25: fsync d4/f6 0 2024-09-17T01:01:50.124 INFO:tasks.workunit.client.0.smithi002.stdout:1/26: mknod d4/c7 0 2024-09-17T01:01:50.124 INFO:tasks.workunit.client.0.smithi002.stdout:1/27: truncate f3 784642 0 2024-09-17T01:01:50.124 INFO:tasks.workunit.client.0.smithi002.stdout:1/28: fsync f3 0 2024-09-17T01:01:50.125 INFO:tasks.workunit.client.0.smithi002.stdout:1/29: chown d4/f6 25493935 1 2024-09-17T01:01:50.125 INFO:tasks.workunit.client.0.smithi002.stdout:1/30: write d4/f6 [729307,111392] 0 2024-09-17T01:01:50.125 INFO:tasks.workunit.client.0.smithi002.stdout:1/31: rename d4 to d4/d8 22 2024-09-17T01:01:50.125 INFO:tasks.workunit.client.0.smithi002.stdout:8/29: read d2/f4 [3185092,118244] 0 2024-09-17T01:01:50.127 INFO:tasks.workunit.client.0.smithi002.stdout:1/32: mknod d4/c9 0 2024-09-17T01:01:50.127 INFO:tasks.workunit.client.0.smithi002.stdout:1/33: creat d4/fa x:0 0 0 2024-09-17T01:01:50.127 INFO:tasks.workunit.client.0.smithi002.stdout:8/30: symlink d2/d3/la 0 2024-09-17T01:01:50.128 INFO:tasks.workunit.client.1.smithi099.stdout:7/140: dread d1/d1e/fe [0,4194304] 0 2024-09-17T01:01:50.130 INFO:tasks.workunit.client.0.smithi002.stdout:1/34: mknod d4/cb 0 2024-09-17T01:01:50.130 INFO:tasks.workunit.client.0.smithi002.stdout:1/35: write d4/fa [856128,107832] 0 2024-09-17T01:01:50.130 INFO:tasks.workunit.client.1.smithi099.stdout:7/141: mknod d1/d1e/c28 0 2024-09-17T01:01:50.131 INFO:tasks.workunit.client.1.smithi099.stdout:7/142: chown d1/d1e/f9 19 1 2024-09-17T01:01:50.131 INFO:tasks.workunit.client.0.smithi002.stdout:8/31: creat d2/fb x:0 0 0 2024-09-17T01:01:50.134 INFO:tasks.workunit.client.0.smithi002.stdout:1/36: rename f1 to d4/fc 0 2024-09-17T01:01:50.135 INFO:tasks.workunit.client.1.smithi099.stdout:5/207: dwrite d2/f32 [0,4194304] 0 2024-09-17T01:01:50.135 INFO:tasks.workunit.client.0.smithi002.stdout:8/32: mknod d2/d3/cc 0 2024-09-17T01:01:50.135 INFO:tasks.workunit.client.0.smithi002.stdout:2/51: dwrite fa [0,4194304] 0 2024-09-17T01:01:50.136 INFO:tasks.workunit.client.0.smithi002.stdout:8/33: mkdir d2/d9/dd 0 2024-09-17T01:01:50.137 INFO:tasks.workunit.client.1.smithi099.stdout:5/208: creat d2/dc/d17/d3c/f46 x:0 0 0 2024-09-17T01:01:50.138 INFO:tasks.workunit.client.0.smithi002.stdout:2/52: rename l2 to lc 0 2024-09-17T01:01:50.139 INFO:tasks.workunit.client.1.smithi099.stdout:5/209: symlink d2/dc/d14/d36/l47 0 2024-09-17T01:01:50.139 INFO:tasks.workunit.client.1.smithi099.stdout:5/210: chown d2/d26/f2a 15309 1 2024-09-17T01:01:50.139 INFO:tasks.workunit.client.1.smithi099.stdout:5/211: readlink d2/d8/l1d 0 2024-09-17T01:01:50.139 INFO:tasks.workunit.client.0.smithi002.stdout:8/34: mknod d2/ce 0 2024-09-17T01:01:50.139 INFO:tasks.workunit.client.0.smithi002.stdout:8/35: stat f0 0 2024-09-17T01:01:50.140 INFO:tasks.workunit.client.0.smithi002.stdout:8/36: mknod d2/cf 0 2024-09-17T01:01:50.140 INFO:tasks.workunit.client.0.smithi002.stdout:0/31: dwrite f4 [0,4194304] 0 2024-09-17T01:01:50.141 INFO:tasks.workunit.client.0.smithi002.stdout:8/37: mknod d2/d9/c10 0 2024-09-17T01:01:50.141 INFO:tasks.workunit.client.1.smithi099.stdout:3/183: rmdir d9/d15 39 2024-09-17T01:01:50.142 INFO:tasks.workunit.client.1.smithi099.stdout:3/184: readlink d9/d15/d18/d1a/d23/l13 0 2024-09-17T01:01:50.150 INFO:tasks.workunit.client.0.smithi002.stdout:2/53: dread fa [0,4194304] 0 2024-09-17T01:01:50.151 INFO:tasks.workunit.client.0.smithi002.stdout:2/54: creat fd x:0 0 0 2024-09-17T01:01:50.152 INFO:tasks.workunit.client.0.smithi002.stdout:2/55: read - fb zero size 2024-09-17T01:01:50.153 INFO:tasks.workunit.client.0.smithi002.stdout:2/56: creat fe x:0 0 0 2024-09-17T01:01:50.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:49 smithi002 ceph-mon[27650]: pgmap v248: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 8.2 MiB/s rd, 15 MiB/s wr, 574 op/s 2024-09-17T01:01:50.154 INFO:tasks.workunit.client.1.smithi099.stdout:5/212: dread f0 [0,4194304] 0 2024-09-17T01:01:50.157 INFO:tasks.workunit.client.0.smithi002.stdout:2/57: read fa [763557,19611] 0 2024-09-17T01:01:50.157 INFO:tasks.workunit.client.0.smithi002.stdout:2/58: fsync fa 0 2024-09-17T01:01:50.158 INFO:tasks.workunit.client.0.smithi002.stdout:2/59: creat ff x:0 0 0 2024-09-17T01:01:50.159 INFO:tasks.workunit.client.0.smithi002.stdout:0/32: write f4 [1933883,25868] 0 2024-09-17T01:01:50.160 INFO:tasks.workunit.client.0.smithi002.stdout:0/33: mknod cb 0 2024-09-17T01:01:50.160 INFO:tasks.workunit.client.0.smithi002.stdout:5/67: dwrite d2/de/ff [4194304,4194304] 0 2024-09-17T01:01:50.160 INFO:tasks.workunit.client.0.smithi002.stdout:5/68: write f0 [272055,59236] 0 2024-09-17T01:01:50.160 INFO:tasks.workunit.client.0.smithi002.stdout:5/69: write d2/fa [1180239,76399] 0 2024-09-17T01:01:50.162 INFO:tasks.workunit.client.0.smithi002.stdout:5/70: getdents d2/de 0 2024-09-17T01:01:50.162 INFO:tasks.workunit.client.0.smithi002.stdout:5/71: readlink d2/lb 0 2024-09-17T01:01:50.167 INFO:tasks.workunit.client.1.smithi099.stdout:5/213: write d2/d8/fb [3095368,15387] 0 2024-09-17T01:01:50.168 INFO:tasks.workunit.client.1.smithi099.stdout:1/145: dwrite d0/d2/de/f15 [0,4194304] 0 2024-09-17T01:01:50.168 INFO:tasks.workunit.client.1.smithi099.stdout:9/152: dwrite f4 [8388608,4194304] 0 2024-09-17T01:01:50.169 INFO:tasks.workunit.client.1.smithi099.stdout:1/146: mknod d0/d2/de/c2e 0 2024-09-17T01:01:50.169 INFO:tasks.workunit.client.1.smithi099.stdout:1/147: write d0/d2/d18/f28 [980008,95766] 0 2024-09-17T01:01:50.170 INFO:tasks.workunit.client.1.smithi099.stdout:1/148: symlink d0/d2/d9/l2f 0 2024-09-17T01:01:50.170 INFO:tasks.workunit.client.1.smithi099.stdout:1/149: write d0/d2/f25 [67249,123322] 0 2024-09-17T01:01:50.176 INFO:tasks.workunit.client.1.smithi099.stdout:5/214: dread d2/d26/f27 [0,4194304] 0 2024-09-17T01:01:50.178 INFO:tasks.workunit.client.1.smithi099.stdout:5/215: unlink d2/dc/d14/l38 0 2024-09-17T01:01:50.178 INFO:tasks.workunit.client.1.smithi099.stdout:5/216: fdatasync d2/f7 0 2024-09-17T01:01:50.179 INFO:tasks.workunit.client.1.smithi099.stdout:9/153: dread da/ff [0,4194304] 0 2024-09-17T01:01:50.180 INFO:tasks.workunit.client.1.smithi099.stdout:9/154: symlink da/d21/l32 0 2024-09-17T01:01:50.183 INFO:tasks.workunit.client.1.smithi099.stdout:9/155: rename c9 to da/d21/c33 0 2024-09-17T01:01:50.183 INFO:tasks.workunit.client.1.smithi099.stdout:4/124: dwrite d7/dd/de/d17/f25 [0,4194304] 0 2024-09-17T01:01:50.183 INFO:tasks.workunit.client.1.smithi099.stdout:4/125: write d7/fa [3636530,116017] 0 2024-09-17T01:01:50.183 INFO:tasks.workunit.client.1.smithi099.stdout:4/126: readlink l3 0 2024-09-17T01:01:50.183 INFO:tasks.workunit.client.1.smithi099.stdout:9/156: mknod da/d1b/c34 0 2024-09-17T01:01:50.185 INFO:tasks.workunit.client.0.smithi002.stdout:1/37: dread d4/fa [0,4194304] 0 2024-09-17T01:01:50.185 INFO:tasks.workunit.client.0.smithi002.stdout:1/38: chown d4/cb 70369180 1 2024-09-17T01:01:50.185 INFO:tasks.workunit.client.0.smithi002.stdout:1/39: chown d4/c9 137964 1 2024-09-17T01:01:50.185 INFO:tasks.workunit.client.0.smithi002.stdout:1/40: write d4/fc [2651889,106886] 0 2024-09-17T01:01:50.186 INFO:tasks.workunit.client.1.smithi099.stdout:1/150: dread d0/d2/d18/f1a [4194304,4194304] 0 2024-09-17T01:01:50.186 INFO:tasks.workunit.client.1.smithi099.stdout:6/173: dwrite dc/d1a/f26 [0,4194304] 0 2024-09-17T01:01:50.187 INFO:tasks.workunit.client.0.smithi002.stdout:3/32: dwrite d0/d3/f4 [4194304,4194304] 0 2024-09-17T01:01:50.187 INFO:tasks.workunit.client.0.smithi002.stdout:3/33: chown d0 106863019 1 2024-09-17T01:01:50.187 INFO:tasks.workunit.client.1.smithi099.stdout:7/143: fsync d1/d1e/f13 0 2024-09-17T01:01:50.187 INFO:tasks.workunit.client.1.smithi099.stdout:1/151: truncate d0/d2/f24 3267151 0 2024-09-17T01:01:50.188 INFO:tasks.workunit.client.1.smithi099.stdout:3/185: dwrite d9/d15/f34 [0,4194304] 0 2024-09-17T01:01:50.188 INFO:tasks.workunit.client.0.smithi002.stdout:8/38: dwrite d2/d3/f7 [0,4194304] 0 2024-09-17T01:01:50.188 INFO:tasks.workunit.client.0.smithi002.stdout:8/39: creat d2/d3/f11 x:0 0 0 2024-09-17T01:01:50.189 INFO:tasks.workunit.client.0.smithi002.stdout:9/21: dwrite f0 [0,4194304] 0 2024-09-17T01:01:50.189 INFO:tasks.workunit.client.0.smithi002.stdout:0/34: fsync f4 0 2024-09-17T01:01:50.189 INFO:tasks.workunit.client.0.smithi002.stdout:0/35: fdatasync f4 0 2024-09-17T01:01:50.190 INFO:tasks.workunit.client.1.smithi099.stdout:9/157: dread da/ff [0,4194304] 0 2024-09-17T01:01:50.191 INFO:tasks.workunit.client.1.smithi099.stdout:6/174: link dc/f36 dc/f39 0 2024-09-17T01:01:50.193 INFO:tasks.workunit.client.1.smithi099.stdout:1/152: creat d0/d2/d9/f30 x:0 0 0 2024-09-17T01:01:50.193 INFO:tasks.workunit.client.1.smithi099.stdout:1/153: fdatasync d0/d2/de/f27 0 2024-09-17T01:01:50.198 INFO:tasks.workunit.client.0.smithi002.stdout:9/22: rename l4 to d5/l6 0 2024-09-17T01:01:50.198 INFO:tasks.workunit.client.0.smithi002.stdout:9/23: write f2 [104926,44269] 0 2024-09-17T01:01:50.198 INFO:tasks.workunit.client.0.smithi002.stdout:9/24: readlink d5/l6 0 2024-09-17T01:01:50.199 INFO:tasks.workunit.client.0.smithi002.stdout:9/25: readlink d5/l6 0 2024-09-17T01:01:50.204 INFO:tasks.workunit.client.0.smithi002.stdout:3/34: dread d0/d3/f4 [0,4194304] 0 2024-09-17T01:01:50.208 INFO:tasks.workunit.client.0.smithi002.stdout:1/41: getdents d4 0 2024-09-17T01:01:50.209 INFO:tasks.workunit.client.0.smithi002.stdout:8/40: dwrite d2/fb [0,4194304] 0 2024-09-17T01:01:50.210 INFO:tasks.workunit.client.0.smithi002.stdout:0/36: unlink f4 0 2024-09-17T01:01:50.211 INFO:tasks.workunit.client.0.smithi002.stdout:2/60: write fa [4550671,13969] 0 2024-09-17T01:01:50.211 INFO:tasks.workunit.client.0.smithi002.stdout:2/61: truncate fe 346601 0 2024-09-17T01:01:50.211 INFO:tasks.workunit.client.0.smithi002.stdout:2/62: stat fb 0 2024-09-17T01:01:50.212 INFO:tasks.workunit.client.0.smithi002.stdout:2/63: fdatasync fd 0 2024-09-17T01:01:50.213 INFO:tasks.workunit.client.0.smithi002.stdout:9/26: unlink c3 0 2024-09-17T01:01:50.214 INFO:tasks.workunit.client.0.smithi002.stdout:2/64: dread fe [0,4194304] 0 2024-09-17T01:01:50.214 INFO:tasks.workunit.client.0.smithi002.stdout:2/65: rmdir - no directory 2024-09-17T01:01:50.214 INFO:tasks.workunit.client.0.smithi002.stdout:3/35: creat d0/d3/d6/fa x:0 0 0 2024-09-17T01:01:50.216 INFO:tasks.workunit.client.1.smithi099.stdout:3/186: dwrite f3 [0,4194304] 0 2024-09-17T01:01:50.216 INFO:tasks.workunit.client.1.smithi099.stdout:9/158: dread f6 [4194304,4194304] 0 2024-09-17T01:01:50.216 INFO:tasks.workunit.client.1.smithi099.stdout:9/159: stat da/c12 0 2024-09-17T01:01:50.216 INFO:tasks.workunit.client.0.smithi002.stdout:1/42: symlink d4/ld 0 2024-09-17T01:01:50.217 INFO:tasks.workunit.client.0.smithi002.stdout:1/43: fsync f3 0 2024-09-17T01:01:50.217 INFO:tasks.workunit.client.0.smithi002.stdout:8/41: creat d2/f12 x:0 0 0 2024-09-17T01:01:50.217 INFO:tasks.workunit.client.0.smithi002.stdout:8/42: dread - d2/f12 zero size 2024-09-17T01:01:50.218 INFO:tasks.workunit.client.0.smithi002.stdout:0/37: symlink lc 0 2024-09-17T01:01:50.218 INFO:tasks.workunit.client.1.smithi099.stdout:3/187: mkdir d9/d3b 0 2024-09-17T01:01:50.220 INFO:tasks.workunit.client.1.smithi099.stdout:3/188: mknod d9/d15/d18/c3c 0 2024-09-17T01:01:50.221 INFO:tasks.workunit.client.1.smithi099.stdout:3/189: mknod d9/d15/c3d 0 2024-09-17T01:01:50.221 INFO:tasks.workunit.client.0.smithi002.stdout:3/36: link d0/d3/f8 d0/fb 0 2024-09-17T01:01:50.222 INFO:tasks.workunit.client.0.smithi002.stdout:1/44: creat d4/fe x:0 0 0 2024-09-17T01:01:50.223 INFO:tasks.workunit.client.0.smithi002.stdout:1/45: write d4/fe [654842,55864] 0 2024-09-17T01:01:50.223 INFO:tasks.workunit.client.1.smithi099.stdout:9/160: dread da/d14/d22/f26 [0,4194304] 0 2024-09-17T01:01:50.223 INFO:tasks.workunit.client.1.smithi099.stdout:9/161: chown da/d21/c30 10928878 1 2024-09-17T01:01:50.223 INFO:tasks.workunit.client.0.smithi002.stdout:8/43: mknod d2/d9/c13 0 2024-09-17T01:01:50.224 INFO:tasks.workunit.client.0.smithi002.stdout:8/44: stat d2/d9/c10 0 2024-09-17T01:01:50.224 INFO:tasks.workunit.client.1.smithi099.stdout:9/162: symlink da/d21/l35 0 2024-09-17T01:01:50.224 INFO:tasks.workunit.client.0.smithi002.stdout:0/38: mkdir dd 0 2024-09-17T01:01:50.224 INFO:tasks.workunit.client.0.smithi002.stdout:0/39: stat l7 0 2024-09-17T01:01:50.225 INFO:tasks.workunit.client.0.smithi002.stdout:2/66: mknod c10 0 2024-09-17T01:01:50.225 INFO:tasks.workunit.client.0.smithi002.stdout:2/67: truncate fb 1028545 0 2024-09-17T01:01:50.225 INFO:tasks.workunit.client.0.smithi002.stdout:2/68: fdatasync ff 0 2024-09-17T01:01:50.226 INFO:tasks.workunit.client.0.smithi002.stdout:3/37: symlink d0/lc 0 2024-09-17T01:01:50.226 INFO:tasks.workunit.client.0.smithi002.stdout:1/46: creat d4/ff x:0 0 0 2024-09-17T01:01:50.226 INFO:tasks.workunit.client.1.smithi099.stdout:7/144: dwrite d1/ff [0,4194304] 0 2024-09-17T01:01:50.226 INFO:tasks.workunit.client.1.smithi099.stdout:7/145: chown d1/d1e/fe 663338135 1 2024-09-17T01:01:50.228 INFO:tasks.workunit.client.0.smithi002.stdout:3/38: unlink d0/d3/f4 0 2024-09-17T01:01:50.229 INFO:tasks.workunit.client.1.smithi099.stdout:7/146: truncate d1/d1e/f1b 625840 0 2024-09-17T01:01:50.229 INFO:tasks.workunit.client.1.smithi099.stdout:7/147: stat d1/d1e/f20 0 2024-09-17T01:01:50.230 INFO:tasks.workunit.client.0.smithi002.stdout:2/69: rename l8 to l11 0 2024-09-17T01:01:50.230 INFO:tasks.workunit.client.0.smithi002.stdout:2/70: read fe [299235,122599] 0 2024-09-17T01:01:50.230 INFO:tasks.workunit.client.0.smithi002.stdout:9/27: truncate f0 3965888 0 2024-09-17T01:01:50.231 INFO:tasks.workunit.client.1.smithi099.stdout:7/148: truncate d1/d1e/fe 145411 0 2024-09-17T01:01:50.231 INFO:tasks.workunit.client.1.smithi099.stdout:1/154: write d0/d2/f24 [120808,54000] 0 2024-09-17T01:01:50.231 INFO:tasks.workunit.client.0.smithi002.stdout:3/39: rename d0/d3/d6/fa to d0/fd 0 2024-09-17T01:01:50.236 INFO:tasks.workunit.client.0.smithi002.stdout:2/71: creat f12 x:0 0 0 2024-09-17T01:01:50.236 INFO:tasks.workunit.client.0.smithi002.stdout:2/72: write fe [271430,33040] 0 2024-09-17T01:01:50.237 INFO:tasks.workunit.client.0.smithi002.stdout:3/40: link d0/lc d0/le 0 2024-09-17T01:01:50.237 INFO:tasks.workunit.client.0.smithi002.stdout:1/47: link d4/cb d4/c10 0 2024-09-17T01:01:50.238 INFO:tasks.workunit.client.1.smithi099.stdout:1/155: dread d0/f13 [0,4194304] 0 2024-09-17T01:01:50.240 INFO:tasks.workunit.client.1.smithi099.stdout:1/156: mkdir d0/d2/de/d31 0 2024-09-17T01:01:50.242 INFO:tasks.workunit.client.0.smithi002.stdout:3/41: rename d0/fb to d0/ff 0 2024-09-17T01:01:50.242 INFO:tasks.workunit.client.0.smithi002.stdout:3/42: chown d0/c5 0 1 2024-09-17T01:01:50.244 INFO:tasks.workunit.client.0.smithi002.stdout:2/73: rename f12 to f13 0 2024-09-17T01:01:50.244 INFO:tasks.workunit.client.0.smithi002.stdout:3/43: symlink d0/d3/d6/l10 0 2024-09-17T01:01:50.246 INFO:tasks.workunit.client.0.smithi002.stdout:3/44: symlink d0/l11 0 2024-09-17T01:01:50.246 INFO:tasks.workunit.client.0.smithi002.stdout:3/45: chown d0/d3 29 1 2024-09-17T01:01:50.246 INFO:tasks.workunit.client.0.smithi002.stdout:3/46: write d0/ff [1486733,7872] 0 2024-09-17T01:01:50.246 INFO:tasks.workunit.client.0.smithi002.stdout:3/47: write d0/fd [166288,111968] 0 2024-09-17T01:01:50.247 INFO:tasks.workunit.client.0.smithi002.stdout:3/48: write d0/ff [1479904,127333] 0 2024-09-17T01:01:50.247 INFO:tasks.workunit.client.0.smithi002.stdout:3/49: chown d0/d3/l7 1853 1 2024-09-17T01:01:50.247 INFO:tasks.workunit.client.0.smithi002.stdout:3/50: read d0/fd [83380,14105] 0 2024-09-17T01:01:50.247 INFO:tasks.workunit.client.0.smithi002.stdout:3/51: write d0/ff [2279280,90280] 0 2024-09-17T01:01:50.247 INFO:tasks.workunit.client.1.smithi099.stdout:6/175: dwrite dc/d1a/f26 [0,4194304] 0 2024-09-17T01:01:50.248 INFO:tasks.workunit.client.1.smithi099.stdout:6/176: mknod dc/d2b/c3a 0 2024-09-17T01:01:50.253 INFO:tasks.workunit.client.0.smithi002.stdout:3/52: dread d0/ff [0,4194304] 0 2024-09-17T01:01:50.255 INFO:tasks.workunit.client.0.smithi002.stdout:3/53: symlink d0/l12 0 2024-09-17T01:01:50.261 INFO:tasks.workunit.client.1.smithi099.stdout:3/190: dwrite f2 [8388608,4194304] 0 2024-09-17T01:01:50.261 INFO:tasks.workunit.client.1.smithi099.stdout:3/191: chown f3 1 1 2024-09-17T01:01:50.263 INFO:tasks.workunit.client.1.smithi099.stdout:3/192: symlink d9/d15/d18/d1a/d23/l3e 0 2024-09-17T01:01:50.265 INFO:tasks.workunit.client.0.smithi002.stdout:0/40: dwrite f1 [4194304,4194304] 0 2024-09-17T01:01:50.265 INFO:tasks.workunit.client.0.smithi002.stdout:8/45: dwrite f0 [0,4194304] 0 2024-09-17T01:01:50.266 INFO:tasks.workunit.client.1.smithi099.stdout:6/177: dwrite dc/d2b/f2c [0,4194304] 0 2024-09-17T01:01:50.267 INFO:tasks.workunit.client.1.smithi099.stdout:6/178: chown dc/d1a/l1f 374009 1 2024-09-17T01:01:50.267 INFO:tasks.workunit.client.0.smithi002.stdout:2/74: link l11 l14 0 2024-09-17T01:01:50.268 INFO:tasks.workunit.client.0.smithi002.stdout:9/28: truncate f0 4415960 0 2024-09-17T01:01:50.268 INFO:tasks.workunit.client.0.smithi002.stdout:9/29: chown d5/l6 44269 1 2024-09-17T01:01:50.268 INFO:tasks.workunit.client.0.smithi002.stdout:3/54: dwrite d0/fd [0,4194304] 0 2024-09-17T01:01:50.269 INFO:tasks.workunit.client.0.smithi002.stdout:0/41: unlink l5 0 2024-09-17T01:01:50.273 INFO:tasks.workunit.client.0.smithi002.stdout:1/48: dread d4/fc [0,4194304] 0 2024-09-17T01:01:50.273 INFO:tasks.workunit.client.1.smithi099.stdout:6/179: link dc/c19 dc/d2b/c3b 0 2024-09-17T01:01:50.277 INFO:tasks.workunit.client.1.smithi099.stdout:3/193: dread d9/d15/d18/f20 [0,4194304] 0 2024-09-17T01:01:50.279 INFO:tasks.workunit.client.0.smithi002.stdout:2/75: unlink fb 0 2024-09-17T01:01:50.280 INFO:tasks.workunit.client.0.smithi002.stdout:3/55: mknod d0/c13 0 2024-09-17T01:01:50.284 INFO:tasks.workunit.client.1.smithi099.stdout:7/149: truncate d1/d1e/fe 99429 0 2024-09-17T01:01:50.284 INFO:tasks.workunit.client.1.smithi099.stdout:7/150: write d1/d1e/d12/f14 [573869,52458] 0 2024-09-17T01:01:50.284 INFO:tasks.workunit.client.1.smithi099.stdout:7/151: stat d1/f19 0 2024-09-17T01:01:50.284 INFO:tasks.workunit.client.1.smithi099.stdout:1/157: dwrite d0/d2/f24 [0,4194304] 0 2024-09-17T01:01:50.284 INFO:tasks.workunit.client.0.smithi002.stdout:8/46: rename d2/c5 to d2/d3/c14 0 2024-09-17T01:01:50.285 INFO:tasks.workunit.client.0.smithi002.stdout:9/30: rename d5 to d5/d7 22 2024-09-17T01:01:50.285 INFO:tasks.workunit.client.1.smithi099.stdout:7/152: truncate d1/d1e/f13 851546 0 2024-09-17T01:01:50.285 INFO:tasks.workunit.client.1.smithi099.stdout:7/153: readlink d1/d1e/d1c/l21 0 2024-09-17T01:01:50.286 INFO:tasks.workunit.client.0.smithi002.stdout:3/56: rmdir d0 39 2024-09-17T01:01:50.287 INFO:tasks.workunit.client.1.smithi099.stdout:1/158: rename d0/d2/d18/f1a to d0/d8/f32 0 2024-09-17T01:01:50.287 INFO:tasks.workunit.client.0.smithi002.stdout:1/49: mkdir d4/d11 0 2024-09-17T01:01:50.289 INFO:tasks.workunit.client.0.smithi002.stdout:9/31: dread f2 [0,4194304] 0 2024-09-17T01:01:50.289 INFO:tasks.workunit.client.1.smithi099.stdout:7/154: getdents d1 0 2024-09-17T01:01:50.289 INFO:tasks.workunit.client.1.smithi099.stdout:7/155: write d1/d1e/d12/f16 [553910,2472] 0 2024-09-17T01:01:50.289 INFO:tasks.workunit.client.1.smithi099.stdout:3/194: dread f2 [0,4194304] 0 2024-09-17T01:01:50.290 INFO:tasks.workunit.client.0.smithi002.stdout:8/47: link f0 d2/d9/dd/f15 0 2024-09-17T01:01:50.290 INFO:tasks.workunit.client.1.smithi099.stdout:1/159: dread d0/d2/d18/f28 [0,4194304] 0 2024-09-17T01:01:50.292 INFO:tasks.workunit.client.1.smithi099.stdout:7/156: creat d1/d1e/d12/f29 x:0 0 0 2024-09-17T01:01:50.294 INFO:tasks.workunit.client.0.smithi002.stdout:2/76: rename l4 to l15 0 2024-09-17T01:01:50.295 INFO:tasks.workunit.client.0.smithi002.stdout:1/50: dread d4/fc [0,4194304] 0 2024-09-17T01:01:50.295 INFO:tasks.workunit.client.1.smithi099.stdout:6/180: dwrite dc/f21 [0,4194304] 0 2024-09-17T01:01:50.298 INFO:tasks.workunit.client.1.smithi099.stdout:6/181: truncate dc/d1a/f1e 2074325 0 2024-09-17T01:01:50.298 INFO:tasks.workunit.client.1.smithi099.stdout:6/182: write dc/fe [4817036,123733] 0 2024-09-17T01:01:50.298 INFO:tasks.workunit.client.0.smithi002.stdout:1/51: mkdir d4/d11/d12 0 2024-09-17T01:01:50.298 INFO:tasks.workunit.client.0.smithi002.stdout:1/52: fsync d4/ff 0 2024-09-17T01:01:50.298 INFO:tasks.workunit.client.0.smithi002.stdout:1/53: write f3 [1513252,71516] 0 2024-09-17T01:01:50.301 INFO:tasks.workunit.client.1.smithi099.stdout:6/183: link dc/c2e dc/d1a/c3c 0 2024-09-17T01:01:50.301 INFO:tasks.workunit.client.0.smithi002.stdout:0/42: truncate f1 7604974 0 2024-09-17T01:01:50.301 INFO:tasks.workunit.client.0.smithi002.stdout:0/43: chown l6 1080 1 2024-09-17T01:01:50.301 INFO:tasks.workunit.client.0.smithi002.stdout:0/44: readlink l9 0 2024-09-17T01:01:50.302 INFO:tasks.workunit.client.0.smithi002.stdout:3/57: dwrite d0/fd [0,4194304] 0 2024-09-17T01:01:50.303 INFO:tasks.workunit.client.0.smithi002.stdout:1/54: creat d4/f13 x:0 0 0 2024-09-17T01:01:50.303 INFO:tasks.workunit.client.1.smithi099.stdout:6/184: symlink dc/d27/d30/l3d 0 2024-09-17T01:01:50.306 INFO:tasks.workunit.client.0.smithi002.stdout:3/58: creat d0/f14 x:0 0 0 2024-09-17T01:01:50.308 INFO:tasks.workunit.client.0.smithi002.stdout:8/48: link d2/d3/c14 d2/c16 0 2024-09-17T01:01:50.309 INFO:tasks.workunit.client.0.smithi002.stdout:3/59: mkdir d0/d3/d6/d15 0 2024-09-17T01:01:50.309 INFO:tasks.workunit.client.0.smithi002.stdout:3/60: creat d0/f16 x:0 0 0 2024-09-17T01:01:50.311 INFO:tasks.workunit.client.0.smithi002.stdout:1/55: dread d4/fc [0,4194304] 0 2024-09-17T01:01:50.313 INFO:tasks.workunit.client.0.smithi002.stdout:3/61: mkdir d0/d3/d17 0 2024-09-17T01:01:50.314 INFO:tasks.workunit.client.1.smithi099.stdout:6/185: write dc/d1a/f26 [906573,90251] 0 2024-09-17T01:01:50.314 INFO:tasks.workunit.client.1.smithi099.stdout:6/186: write dc/d1a/f26 [1295930,115881] 0 2024-09-17T01:01:50.314 INFO:tasks.workunit.client.1.smithi099.stdout:6/187: chown dc/c19 29 1 2024-09-17T01:01:50.314 INFO:tasks.workunit.client.1.smithi099.stdout:6/188: chown dc/d1a/l35 556370 1 2024-09-17T01:01:50.314 INFO:tasks.workunit.client.1.smithi099.stdout:6/189: chown dc/d1a/c22 16510244 1 2024-09-17T01:01:50.315 INFO:tasks.workunit.client.0.smithi002.stdout:1/56: write f3 [644973,2763] 0 2024-09-17T01:01:50.317 INFO:tasks.workunit.client.0.smithi002.stdout:1/57: mkdir d4/d11/d12/d14 0 2024-09-17T01:01:50.317 INFO:tasks.workunit.client.0.smithi002.stdout:1/58: creat d4/d11/f15 x:0 0 0 2024-09-17T01:01:50.318 INFO:tasks.workunit.client.0.smithi002.stdout:1/59: stat d4/d11/d12 0 2024-09-17T01:01:50.318 INFO:tasks.workunit.client.0.smithi002.stdout:1/60: symlink d4/d11/d12/l16 0 2024-09-17T01:01:50.319 INFO:tasks.workunit.client.0.smithi002.stdout:1/61: fsync d4/f6 0 2024-09-17T01:01:50.320 INFO:tasks.workunit.client.0.smithi002.stdout:1/62: mkdir d4/d11/d12/d14/d17 0 2024-09-17T01:01:50.320 INFO:tasks.workunit.client.0.smithi002.stdout:1/63: dread - d4/f13 zero size 2024-09-17T01:01:50.320 INFO:tasks.workunit.client.0.smithi002.stdout:1/64: creat d4/f18 x:0 0 0 2024-09-17T01:01:50.321 INFO:tasks.workunit.client.1.smithi099.stdout:7/157: dwrite d1/d1e/d12/f18 [0,4194304] 0 2024-09-17T01:01:50.322 INFO:tasks.workunit.client.0.smithi002.stdout:9/32: dwrite f2 [0,4194304] 0 2024-09-17T01:01:50.323 INFO:tasks.workunit.client.1.smithi099.stdout:7/158: mknod d1/d1e/c2a 0 2024-09-17T01:01:50.323 INFO:tasks.workunit.client.1.smithi099.stdout:7/159: chown d1/d1e/d12/f16 56226077 1 2024-09-17T01:01:50.323 INFO:tasks.workunit.client.1.smithi099.stdout:7/160: fsync d1/f19 0 2024-09-17T01:01:50.324 INFO:tasks.workunit.client.1.smithi099.stdout:7/161: rename d1/d1e/d12/f1a to d1/d1e/d12/f2b 0 2024-09-17T01:01:50.325 INFO:tasks.workunit.client.1.smithi099.stdout:7/162: mkdir d1/d2c 0 2024-09-17T01:01:50.330 INFO:tasks.workunit.client.1.smithi099.stdout:1/160: dwrite d0/fc [4194304,4194304] 0 2024-09-17T01:01:50.330 INFO:tasks.workunit.client.1.smithi099.stdout:1/161: readlink d0/d2/d18/l2d 0 2024-09-17T01:01:50.330 INFO:tasks.workunit.client.1.smithi099.stdout:1/162: truncate d0/d2/de/f27 105110 0 2024-09-17T01:01:50.331 INFO:tasks.workunit.client.1.smithi099.stdout:7/163: dread d1/d1e/f13 [0,4194304] 0 2024-09-17T01:01:50.332 INFO:tasks.workunit.client.0.smithi002.stdout:1/65: dwrite d4/fe [0,4194304] 0 2024-09-17T01:01:50.332 INFO:tasks.workunit.client.1.smithi099.stdout:7/164: creat d1/d2c/f2d x:0 0 0 2024-09-17T01:01:50.332 INFO:tasks.workunit.client.1.smithi099.stdout:7/165: stat d1/f24 0 2024-09-17T01:01:50.334 INFO:tasks.workunit.client.0.smithi002.stdout:1/66: symlink d4/d11/l19 0 2024-09-17T01:01:50.335 INFO:tasks.workunit.client.0.smithi002.stdout:8/49: dwrite d2/fb [0,4194304] 0 2024-09-17T01:01:50.335 INFO:tasks.workunit.client.0.smithi002.stdout:8/50: fdatasync d2/f4 0 2024-09-17T01:01:50.336 INFO:tasks.workunit.client.0.smithi002.stdout:1/67: mkdir d4/d11/d1a 0 2024-09-17T01:01:50.336 INFO:tasks.workunit.client.0.smithi002.stdout:9/33: write f0 [2671996,58130] 0 2024-09-17T01:01:50.336 INFO:tasks.workunit.client.0.smithi002.stdout:9/34: fdatasync f2 0 2024-09-17T01:01:50.338 INFO:tasks.workunit.client.0.smithi002.stdout:1/68: creat d4/d11/d12/d14/f1b x:0 0 0 2024-09-17T01:01:50.339 INFO:tasks.workunit.client.0.smithi002.stdout:1/69: dread - d4/ff zero size 2024-09-17T01:01:50.341 INFO:tasks.workunit.client.1.smithi099.stdout:1/163: truncate d0/d2/f24 3353573 0 2024-09-17T01:01:50.341 INFO:tasks.workunit.client.0.smithi002.stdout:1/70: mkdir d4/d11/d1c 0 2024-09-17T01:01:50.341 INFO:tasks.workunit.client.0.smithi002.stdout:1/71: chown d4/cb 45 1 2024-09-17T01:01:50.341 INFO:tasks.workunit.client.0.smithi002.stdout:1/72: stat d4/d11/d1a 0 2024-09-17T01:01:50.343 INFO:tasks.workunit.client.0.smithi002.stdout:1/73: rename d4/d11/l19 to d4/d11/d1c/l1d 0 2024-09-17T01:01:50.343 INFO:tasks.workunit.client.0.smithi002.stdout:1/74: write d4/fc [2197053,90024] 0 2024-09-17T01:01:50.344 INFO:tasks.workunit.client.1.smithi099.stdout:1/164: dread d0/d2/f25 [0,4194304] 0 2024-09-17T01:01:50.347 INFO:tasks.workunit.client.1.smithi099.stdout:1/165: link d0/d2/de/c19 d0/d2/d5/c33 0 2024-09-17T01:01:50.349 INFO:tasks.workunit.client.1.smithi099.stdout:6/190: write dc/d1a/f1e [1189424,60958] 0 2024-09-17T01:01:50.350 INFO:tasks.workunit.client.1.smithi099.stdout:1/166: truncate d0/f13 223266 0 2024-09-17T01:01:50.353 INFO:tasks.workunit.client.1.smithi099.stdout:1/167: dread d0/d2/d18/f28 [0,4194304] 0 2024-09-17T01:01:50.360 INFO:tasks.workunit.client.0.smithi002.stdout:8/51: dwrite d2/d3/f7 [0,4194304] 0 2024-09-17T01:01:50.361 INFO:tasks.workunit.client.0.smithi002.stdout:8/52: link d2/l8 d2/d9/l17 0 2024-09-17T01:01:50.361 INFO:tasks.workunit.client.0.smithi002.stdout:8/53: dread - d2/d3/f11 zero size 2024-09-17T01:01:50.362 INFO:tasks.workunit.client.0.smithi002.stdout:8/54: getdents d2/d9/dd 0 2024-09-17T01:01:50.364 INFO:tasks.workunit.client.1.smithi099.stdout:6/191: dread dc/f21 [0,4194304] 0 2024-09-17T01:01:50.364 INFO:tasks.workunit.client.0.smithi002.stdout:0/45: dwrite f1 [4194304,4194304] 0 2024-09-17T01:01:50.364 INFO:tasks.workunit.client.0.smithi002.stdout:0/46: write f1 [3500931,54838] 0 2024-09-17T01:01:50.366 INFO:tasks.workunit.client.0.smithi002.stdout:0/47: symlink dd/le 0 2024-09-17T01:01:50.373 INFO:tasks.workunit.client.1.smithi099.stdout:2/122: sync 2024-09-17T01:01:50.373 INFO:tasks.workunit.client.1.smithi099.stdout:2/123: stat d2/d9/d17 0 2024-09-17T01:01:50.374 INFO:tasks.workunit.client.1.smithi099.stdout:2/124: mknod d2/d7/c23 0 2024-09-17T01:01:50.374 INFO:tasks.workunit.client.1.smithi099.stdout:2/125: chown d2/lf 1607 1 2024-09-17T01:01:50.375 INFO:tasks.workunit.client.1.smithi099.stdout:2/126: mknod d2/d8/d1b/c24 0 2024-09-17T01:01:50.376 INFO:tasks.workunit.client.1.smithi099.stdout:2/127: mkdir d2/d9/d25 0 2024-09-17T01:01:50.376 INFO:tasks.workunit.client.1.smithi099.stdout:2/128: readlink d2/d7/la 0 2024-09-17T01:01:50.387 INFO:tasks.workunit.client.1.smithi099.stdout:6/192: dwrite fa [0,4194304] 0 2024-09-17T01:01:50.387 INFO:tasks.workunit.client.1.smithi099.stdout:6/193: read f7 [3155720,129550] 0 2024-09-17T01:01:50.387 INFO:tasks.workunit.client.1.smithi099.stdout:6/194: readlink dc/d27/d30/l3d 0 2024-09-17T01:01:50.387 INFO:tasks.workunit.client.0.smithi002.stdout:9/35: dwrite f2 [4194304,4194304] 0 2024-09-17T01:01:50.389 INFO:tasks.workunit.client.0.smithi002.stdout:8/55: dwrite f0 [0,4194304] 0 2024-09-17T01:01:50.389 INFO:tasks.workunit.client.0.smithi002.stdout:8/56: fsync d2/d3/f11 0 2024-09-17T01:01:50.391 INFO:tasks.workunit.client.0.smithi002.stdout:8/57: creat d2/d9/dd/f18 x:0 0 0 2024-09-17T01:01:50.400 INFO:tasks.workunit.client.0.smithi002.stdout:8/58: read d2/fb [3218679,121475] 0 2024-09-17T01:01:50.402 INFO:tasks.workunit.client.0.smithi002.stdout:0/48: dread f1 [4194304,4194304] 0 2024-09-17T01:01:50.402 INFO:tasks.workunit.client.0.smithi002.stdout:8/59: rename d2/f4 to d2/d3/f19 0 2024-09-17T01:01:50.402 INFO:tasks.workunit.client.0.smithi002.stdout:8/60: chown d2/d9/dd/f18 15054505 1 2024-09-17T01:01:50.402 INFO:tasks.workunit.client.0.smithi002.stdout:8/61: write d2/d9/dd/f18 [423657,8529] 0 2024-09-17T01:01:50.403 INFO:tasks.workunit.client.0.smithi002.stdout:0/49: creat dd/ff x:0 0 0 2024-09-17T01:01:50.403 INFO:tasks.workunit.client.0.smithi002.stdout:8/62: creat d2/d9/f1a x:0 0 0 2024-09-17T01:01:50.403 INFO:tasks.workunit.client.0.smithi002.stdout:8/63: creat d2/d3/f1b x:0 0 0 2024-09-17T01:01:50.407 INFO:tasks.workunit.client.0.smithi002.stdout:9/36: dwrite f0 [0,4194304] 0 2024-09-17T01:01:50.407 INFO:tasks.workunit.client.1.smithi099.stdout:6/195: dwrite f7 [4194304,4194304] 0 2024-09-17T01:01:50.407 INFO:tasks.workunit.client.0.smithi002.stdout:9/37: symlink d5/l8 0 2024-09-17T01:01:50.411 INFO:tasks.workunit.client.0.smithi002.stdout:8/64: write d2/d3/f7 [303520,117105] 0 2024-09-17T01:01:50.411 INFO:tasks.workunit.client.0.smithi002.stdout:9/38: link f0 d5/f9 0 2024-09-17T01:01:50.413 INFO:tasks.workunit.client.0.smithi002.stdout:8/65: mkdir d2/d1c 0 2024-09-17T01:01:50.414 INFO:tasks.workunit.client.0.smithi002.stdout:8/66: creat d2/f1d x:0 0 0 2024-09-17T01:01:50.415 INFO:tasks.workunit.client.0.smithi002.stdout:0/50: dread f1 [0,4194304] 0 2024-09-17T01:01:50.418 INFO:tasks.workunit.client.0.smithi002.stdout:0/51: symlink dd/l10 0 2024-09-17T01:01:50.419 INFO:tasks.workunit.client.0.smithi002.stdout:0/52: fsync f1 0 2024-09-17T01:01:50.441 INFO:tasks.workunit.client.0.smithi002.stdout:8/67: dwrite d2/f12 [0,4194304] 0 2024-09-17T01:01:50.441 INFO:tasks.workunit.client.0.smithi002.stdout:0/53: dwrite dd/ff [0,4194304] 0 2024-09-17T01:01:50.441 INFO:tasks.workunit.client.1.smithi099.stdout:6/196: dwrite dc/f18 [0,4194304] 0 2024-09-17T01:01:50.441 INFO:tasks.workunit.client.1.smithi099.stdout:6/197: creat dc/f3e x:0 0 0 2024-09-17T01:01:50.441 INFO:tasks.workunit.client.1.smithi099.stdout:6/198: mkdir dc/d2b/d3f 0 2024-09-17T01:01:50.443 INFO:tasks.workunit.client.0.smithi002.stdout:0/54: dread f1 [4194304,4194304] 0 2024-09-17T01:01:50.443 INFO:tasks.workunit.client.0.smithi002.stdout:0/55: fdatasync dd/ff 0 2024-09-17T01:01:50.444 INFO:tasks.workunit.client.1.smithi099.stdout:6/199: dread dc/d1a/f1b [0,4194304] 0 2024-09-17T01:01:50.445 INFO:tasks.workunit.client.0.smithi002.stdout:8/68: fsync d2/d3/f19 0 2024-09-17T01:01:50.445 INFO:tasks.workunit.client.0.smithi002.stdout:8/69: fdatasync d2/f12 0 2024-09-17T01:01:50.446 INFO:tasks.workunit.client.1.smithi099.stdout:6/200: dread dc/d1a/f1e [0,4194304] 0 2024-09-17T01:01:50.448 INFO:tasks.workunit.client.0.smithi002.stdout:8/70: rmdir d2/d3 39 2024-09-17T01:01:50.465 INFO:tasks.workunit.client.0.smithi002.stdout:0/56: dwrite dd/ff [0,4194304] 0 2024-09-17T01:01:50.465 INFO:tasks.workunit.client.1.smithi099.stdout:6/201: dwrite dc/f21 [4194304,4194304] 0 2024-09-17T01:01:50.467 INFO:tasks.workunit.client.0.smithi002.stdout:8/71: dwrite d2/d9/dd/f18 [0,4194304] 0 2024-09-17T01:01:50.468 INFO:tasks.workunit.client.0.smithi002.stdout:8/72: creat d2/f1e x:0 0 0 2024-09-17T01:01:50.472 INFO:tasks.workunit.client.0.smithi002.stdout:8/73: dread d2/fb [0,4194304] 0 2024-09-17T01:01:50.472 INFO:tasks.workunit.client.0.smithi002.stdout:8/74: truncate f0 1365571 0 2024-09-17T01:01:50.473 INFO:tasks.workunit.client.0.smithi002.stdout:8/75: truncate d2/f1d 567545 0 2024-09-17T01:01:50.474 INFO:tasks.workunit.client.0.smithi002.stdout:0/57: dread f1 [0,4194304] 0 2024-09-17T01:01:50.474 INFO:tasks.workunit.client.0.smithi002.stdout:0/58: fsync dd/ff 0 2024-09-17T01:01:50.474 INFO:tasks.workunit.client.0.smithi002.stdout:8/76: dread d2/f1d [0,4194304] 0 2024-09-17T01:01:50.474 INFO:tasks.workunit.client.0.smithi002.stdout:8/77: chown d2/l8 9625 1 2024-09-17T01:01:50.475 INFO:tasks.workunit.client.0.smithi002.stdout:0/59: mknod dd/c11 0 2024-09-17T01:01:50.475 INFO:tasks.workunit.client.0.smithi002.stdout:0/60: rename dd to dd/d12 22 2024-09-17T01:01:50.476 INFO:tasks.workunit.client.0.smithi002.stdout:8/78: mknod d2/d9/dd/c1f 0 2024-09-17T01:01:50.494 INFO:tasks.workunit.client.0.smithi002.stdout:7/39: sync 2024-09-17T01:01:50.494 INFO:tasks.workunit.client.0.smithi002.stdout:4/95: sync 2024-09-17T01:01:50.494 INFO:tasks.workunit.client.0.smithi002.stdout:6/73: sync 2024-09-17T01:01:50.494 INFO:tasks.workunit.client.0.smithi002.stdout:7/40: chown d1/la 2443240 1 2024-09-17T01:01:50.494 INFO:tasks.workunit.client.0.smithi002.stdout:5/72: sync 2024-09-17T01:01:50.494 INFO:tasks.workunit.client.0.smithi002.stdout:7/41: fdatasync d1/f8 0 2024-09-17T01:01:50.495 INFO:tasks.workunit.client.0.smithi002.stdout:4/96: write d7/de/f15 [882912,46739] 0 2024-09-17T01:01:50.495 INFO:tasks.workunit.client.0.smithi002.stdout:4/97: creat d7/d19/f1f x:0 0 0 2024-09-17T01:01:50.495 INFO:tasks.workunit.client.0.smithi002.stdout:4/98: dread - d7/d19/f1d zero size 2024-09-17T01:01:50.495 INFO:tasks.workunit.client.0.smithi002.stdout:7/42: write d1/f8 [106428,119857] 0 2024-09-17T01:01:50.495 INFO:tasks.workunit.client.0.smithi002.stdout:7/43: creat d1/f10 x:0 0 0 2024-09-17T01:01:50.495 INFO:tasks.workunit.client.0.smithi002.stdout:7/44: chown d1/le 0 1 2024-09-17T01:01:50.496 INFO:tasks.workunit.client.0.smithi002.stdout:6/74: mknod d2/d6/c17 0 2024-09-17T01:01:50.496 INFO:tasks.workunit.client.0.smithi002.stdout:6/75: creat d2/f18 x:0 0 0 2024-09-17T01:01:50.496 INFO:tasks.workunit.client.0.smithi002.stdout:6/76: creat d2/f19 x:0 0 0 2024-09-17T01:01:50.497 INFO:tasks.workunit.client.0.smithi002.stdout:4/99: truncate f0 3070063 0 2024-09-17T01:01:50.498 INFO:tasks.workunit.client.0.smithi002.stdout:7/45: link d1/f8 d1/f11 0 2024-09-17T01:01:50.502 INFO:tasks.workunit.client.0.smithi002.stdout:4/100: creat d7/de/f20 x:0 0 0 2024-09-17T01:01:50.502 INFO:tasks.workunit.client.0.smithi002.stdout:4/101: write d7/d19/f1c [2059213,93071] 0 2024-09-17T01:01:50.502 INFO:tasks.workunit.client.0.smithi002.stdout:8/79: dwrite d2/d3/f1b [0,4194304] 0 2024-09-17T01:01:50.503 INFO:tasks.workunit.client.1.smithi099.stdout:0/79: sync 2024-09-17T01:01:50.503 INFO:tasks.workunit.client.1.smithi099.stdout:8/109: sync 2024-09-17T01:01:50.503 INFO:tasks.workunit.client.1.smithi099.stdout:0/80: chown l6 255 1 2024-09-17T01:01:50.503 INFO:tasks.workunit.client.1.smithi099.stdout:6/202: dwrite fa [4194304,4194304] 0 2024-09-17T01:01:50.504 INFO:tasks.workunit.client.0.smithi002.stdout:4/102: unlink d7/d19/f1d 0 2024-09-17T01:01:50.504 INFO:tasks.workunit.client.0.smithi002.stdout:4/103: stat d7/de/f20 0 2024-09-17T01:01:50.504 INFO:tasks.workunit.client.0.smithi002.stdout:4/104: write d7/de/f15 [91823,79265] 0 2024-09-17T01:01:50.504 INFO:tasks.workunit.client.0.smithi002.stdout:6/77: write f1 [7951153,123638] 0 2024-09-17T01:01:50.505 INFO:tasks.workunit.client.1.smithi099.stdout:6/203: unlink dc/d27/d30/l32 0 2024-09-17T01:01:50.508 INFO:tasks.workunit.client.0.smithi002.stdout:8/80: unlink d2/d9/c13 0 2024-09-17T01:01:50.508 INFO:tasks.workunit.client.0.smithi002.stdout:8/81: truncate d2/d9/f1a 112610 0 2024-09-17T01:01:50.512 INFO:tasks.workunit.client.0.smithi002.stdout:6/78: read d2/f4 [2200185,6015] 0 2024-09-17T01:01:50.512 INFO:tasks.workunit.client.0.smithi002.stdout:6/79: creat d2/f1a x:0 0 0 2024-09-17T01:01:50.513 INFO:tasks.workunit.client.0.smithi002.stdout:6/80: truncate d2/f1a 363895 0 2024-09-17T01:01:50.513 INFO:tasks.workunit.client.0.smithi002.stdout:4/105: unlink d7/de/f20 0 2024-09-17T01:01:50.514 INFO:tasks.workunit.client.0.smithi002.stdout:8/82: rename d2/d9/f1a to d2/d9/f20 0 2024-09-17T01:01:50.517 INFO:tasks.workunit.client.1.smithi099.stdout:6/204: dread dc/f21 [4194304,4194304] 0 2024-09-17T01:01:50.517 INFO:tasks.workunit.client.1.smithi099.stdout:6/205: creat dc/d1a/f40 x:0 0 0 2024-09-17T01:01:50.518 INFO:tasks.workunit.client.0.smithi002.stdout:8/83: link d2/cf d2/d9/dd/c21 0 2024-09-17T01:01:50.518 INFO:tasks.workunit.client.0.smithi002.stdout:8/84: chown d2/fb 42 1 2024-09-17T01:01:50.524 INFO:tasks.workunit.client.1.smithi099.stdout:8/110: dwrite d0/d4/f11 [0,4194304] 0 2024-09-17T01:01:50.525 INFO:tasks.workunit.client.1.smithi099.stdout:8/111: chown d0/d4/fb 30491004 1 2024-09-17T01:01:50.525 INFO:tasks.workunit.client.1.smithi099.stdout:8/112: fsync d0/d17/f12 0 2024-09-17T01:01:50.525 INFO:tasks.workunit.client.1.smithi099.stdout:8/113: stat d0/d4/lc 0 2024-09-17T01:01:50.525 INFO:tasks.workunit.client.0.smithi002.stdout:8/85: dread d2/d9/dd/f15 [0,4194304] 0 2024-09-17T01:01:50.525 INFO:tasks.workunit.client.0.smithi002.stdout:8/86: readlink d2/d3/la 0 2024-09-17T01:01:50.528 INFO:tasks.workunit.client.0.smithi002.stdout:5/73: dwrite d2/fa [0,4194304] 0 2024-09-17T01:01:50.528 INFO:tasks.workunit.client.1.smithi099.stdout:8/114: creat d0/f18 x:0 0 0 2024-09-17T01:01:50.530 INFO:tasks.workunit.client.0.smithi002.stdout:8/87: dread d2/d3/f19 [0,4194304] 0 2024-09-17T01:01:50.531 INFO:tasks.workunit.client.0.smithi002.stdout:8/88: dread - d2/d3/f11 zero size 2024-09-17T01:01:50.531 INFO:tasks.workunit.client.0.smithi002.stdout:5/74: symlink d2/dc/l12 0 2024-09-17T01:01:50.532 INFO:tasks.workunit.client.0.smithi002.stdout:8/89: creat d2/d3/f22 x:0 0 0 2024-09-17T01:01:50.532 INFO:tasks.workunit.client.0.smithi002.stdout:8/90: fdatasync d2/d3/f22 0 2024-09-17T01:01:50.533 INFO:tasks.workunit.client.0.smithi002.stdout:5/75: creat d2/dc/dd/f13 x:0 0 0 2024-09-17T01:01:50.533 INFO:tasks.workunit.client.0.smithi002.stdout:5/76: chown d2/f4 3127896 1 2024-09-17T01:01:50.533 INFO:tasks.workunit.client.0.smithi002.stdout:5/77: readlink d2/lb 0 2024-09-17T01:01:50.533 INFO:tasks.workunit.client.0.smithi002.stdout:5/78: chown d2/de/ff 56537660 1 2024-09-17T01:01:50.535 INFO:tasks.workunit.client.0.smithi002.stdout:8/91: rename d2/cf to d2/d3/c23 0 2024-09-17T01:01:50.536 INFO:tasks.workunit.client.0.smithi002.stdout:6/81: dwrite d2/f1a [0,4194304] 0 2024-09-17T01:01:50.537 INFO:tasks.workunit.client.0.smithi002.stdout:4/106: dwrite d7/f18 [0,4194304] 0 2024-09-17T01:01:50.537 INFO:tasks.workunit.client.0.smithi002.stdout:4/107: write d7/d19/f1c [2097216,92170] 0 2024-09-17T01:01:50.537 INFO:tasks.workunit.client.1.smithi099.stdout:8/115: dread d0/d4/fb [0,4194304] 0 2024-09-17T01:01:50.537 INFO:tasks.workunit.client.1.smithi099.stdout:8/116: truncate d0/d4/fb 9901016 0 2024-09-17T01:01:50.537 INFO:tasks.workunit.client.1.smithi099.stdout:8/117: write d0/d17/f12 [2788198,80155] 0 2024-09-17T01:01:50.537 INFO:tasks.workunit.client.0.smithi002.stdout:5/79: dread d2/f4 [4194304,4194304] 0 2024-09-17T01:01:50.538 INFO:tasks.workunit.client.1.smithi099.stdout:8/118: unlink d0/d17/c10 0 2024-09-17T01:01:50.540 INFO:tasks.workunit.client.1.smithi099.stdout:6/206: dwrite dc/f34 [0,4194304] 0 2024-09-17T01:01:50.540 INFO:tasks.workunit.client.1.smithi099.stdout:6/207: readlink l6 0 2024-09-17T01:01:50.541 INFO:tasks.workunit.client.0.smithi002.stdout:6/82: rename d2/d6/c12 to d2/d6/c1b 0 2024-09-17T01:01:50.544 INFO:tasks.workunit.client.1.smithi099.stdout:8/119: truncate d0/d4/fa 5889201 0 2024-09-17T01:01:50.544 INFO:tasks.workunit.client.1.smithi099.stdout:8/120: dread - d0/f18 zero size 2024-09-17T01:01:50.545 INFO:tasks.workunit.client.0.smithi002.stdout:4/108: dread d7/f12 [0,4194304] 0 2024-09-17T01:01:50.547 INFO:tasks.workunit.client.0.smithi002.stdout:6/83: link d2/c3 d2/dc/c1c 0 2024-09-17T01:01:50.548 INFO:tasks.workunit.client.1.smithi099.stdout:8/121: write d0/d17/f12 [2935644,65789] 0 2024-09-17T01:01:50.549 INFO:tasks.workunit.client.1.smithi099.stdout:8/122: mknod d0/c19 0 2024-09-17T01:01:50.549 INFO:tasks.workunit.client.1.smithi099.stdout:8/123: dread - d0/d17/f14 zero size 2024-09-17T01:01:50.550 INFO:tasks.workunit.client.1.smithi099.stdout:8/124: mknod d0/c1a 0 2024-09-17T01:01:50.557 INFO:tasks.workunit.client.0.smithi002.stdout:8/92: dwrite d2/fb [0,4194304] 0 2024-09-17T01:01:50.557 INFO:tasks.workunit.client.0.smithi002.stdout:8/93: creat d2/d3/f24 x:0 0 0 2024-09-17T01:01:50.557 INFO:tasks.workunit.client.0.smithi002.stdout:8/94: dread - d2/d3/f24 zero size 2024-09-17T01:01:50.558 INFO:tasks.workunit.client.1.smithi099.stdout:8/125: rmdir d0 39 2024-09-17T01:01:50.558 INFO:tasks.workunit.client.0.smithi002.stdout:8/95: read d2/d9/f20 [91981,1010] 0 2024-09-17T01:01:50.558 INFO:tasks.workunit.client.0.smithi002.stdout:8/96: creat d2/d9/f25 x:0 0 0 2024-09-17T01:01:50.558 INFO:tasks.workunit.client.1.smithi099.stdout:8/126: mknod d0/d4/c1b 0 2024-09-17T01:01:50.559 INFO:tasks.workunit.client.1.smithi099.stdout:8/127: link d0/f18 d0/d4/f1c 0 2024-09-17T01:01:50.560 INFO:tasks.workunit.client.1.smithi099.stdout:8/128: creat d0/f1d x:0 0 0 2024-09-17T01:01:50.561 INFO:tasks.workunit.client.1.smithi099.stdout:8/129: symlink d0/d4/l1e 0 2024-09-17T01:01:50.563 INFO:tasks.workunit.client.1.smithi099.stdout:8/130: rename d0/d17 to d0/d1f 0 2024-09-17T01:01:50.563 INFO:tasks.workunit.client.1.smithi099.stdout:8/131: write d0/f1d [399706,37005] 0 2024-09-17T01:01:50.563 INFO:tasks.workunit.client.0.smithi002.stdout:8/97: mkdir d2/d26 0 2024-09-17T01:01:50.563 INFO:tasks.workunit.client.0.smithi002.stdout:8/98: chown d2/d3/la 940682485 1 2024-09-17T01:01:50.569 INFO:tasks.workunit.client.0.smithi002.stdout:5/80: dwrite d2/de/ff [4194304,4194304] 0 2024-09-17T01:01:50.569 INFO:tasks.workunit.client.0.smithi002.stdout:5/81: stat d2 0 2024-09-17T01:01:50.569 INFO:tasks.workunit.client.0.smithi002.stdout:5/82: chown d2/dc 396242 1 2024-09-17T01:01:50.574 INFO:tasks.workunit.client.0.smithi002.stdout:4/109: dwrite f0 [0,4194304] 0 2024-09-17T01:01:50.574 INFO:tasks.workunit.client.1.smithi099.stdout:6/208: dwrite dc/d1a/f1b [0,4194304] 0 2024-09-17T01:01:50.575 INFO:tasks.workunit.client.1.smithi099.stdout:6/209: symlink dc/d1a/l41 0 2024-09-17T01:01:50.577 INFO:tasks.workunit.client.0.smithi002.stdout:8/99: rmdir d2/d9 39 2024-09-17T01:01:50.578 INFO:tasks.workunit.client.0.smithi002.stdout:5/83: read d2/de/ff [4505166,52003] 0 2024-09-17T01:01:50.578 INFO:tasks.workunit.client.0.smithi002.stdout:5/84: write d2/dc/dd/f13 [792,64641] 0 2024-09-17T01:01:50.579 INFO:tasks.workunit.client.0.smithi002.stdout:6/84: dwrite d2/f13 [0,4194304] 0 2024-09-17T01:01:50.579 INFO:tasks.workunit.client.1.smithi099.stdout:6/210: dread dc/f21 [4194304,4194304] 0 2024-09-17T01:01:50.580 INFO:tasks.workunit.client.1.smithi099.stdout:5/217: sync 2024-09-17T01:01:50.580 INFO:tasks.workunit.client.1.smithi099.stdout:4/127: sync 2024-09-17T01:01:50.582 INFO:tasks.workunit.client.1.smithi099.stdout:5/218: symlink d2/dc/d14/d19/l48 0 2024-09-17T01:01:50.582 INFO:tasks.workunit.client.1.smithi099.stdout:5/219: fdatasync f0 0 2024-09-17T01:01:50.582 INFO:tasks.workunit.client.1.smithi099.stdout:5/220: dread - d2/dc/f42 zero size 2024-09-17T01:01:50.582 INFO:tasks.workunit.client.1.smithi099.stdout:5/221: creat d2/d8/f49 x:0 0 0 2024-09-17T01:01:50.584 INFO:tasks.workunit.client.0.smithi002.stdout:4/110: write f0 [1918312,95374] 0 2024-09-17T01:01:50.584 INFO:tasks.workunit.client.1.smithi099.stdout:5/222: symlink d2/dc/d17/l4a 0 2024-09-17T01:01:50.584 INFO:tasks.workunit.client.1.smithi099.stdout:5/223: chown d2/f18 2532866 1 2024-09-17T01:01:50.585 INFO:tasks.workunit.client.1.smithi099.stdout:5/224: creat d2/dc/d14/d19/f4b x:0 0 0 2024-09-17T01:01:50.586 INFO:tasks.workunit.client.0.smithi002.stdout:4/111: link d7/d19/f1f d7/d19/f21 0 2024-09-17T01:01:50.586 INFO:tasks.workunit.client.1.smithi099.stdout:5/225: creat d2/d45/f4c x:0 0 0 2024-09-17T01:01:50.586 INFO:tasks.workunit.client.1.smithi099.stdout:5/226: read d2/f18 [3568959,35145] 0 2024-09-17T01:01:50.587 INFO:tasks.workunit.client.0.smithi002.stdout:5/85: dread d2/f4 [0,4194304] 0 2024-09-17T01:01:50.587 INFO:tasks.workunit.client.0.smithi002.stdout:5/86: fdatasync d2/f3 0 2024-09-17T01:01:50.588 INFO:tasks.workunit.client.0.smithi002.stdout:5/87: chown d2/dc/dd/f13 259 1 2024-09-17T01:01:50.588 INFO:tasks.workunit.client.1.smithi099.stdout:5/227: symlink d2/dc/d14/d19/l4d 0 2024-09-17T01:01:50.588 INFO:tasks.workunit.client.0.smithi002.stdout:4/112: mkdir d7/de/d22 0 2024-09-17T01:01:50.589 INFO:tasks.workunit.client.0.smithi002.stdout:5/88: mkdir d2/dc/dd/d10/d14 0 2024-09-17T01:01:50.589 INFO:tasks.workunit.client.1.smithi099.stdout:5/228: link d2/dc/d17/f3a d2/d26/f4e 0 2024-09-17T01:01:50.591 INFO:tasks.workunit.client.0.smithi002.stdout:4/113: dread d7/f14 [0,4194304] 0 2024-09-17T01:01:50.591 INFO:tasks.workunit.client.0.smithi002.stdout:4/114: chown d7/d19/c1e 863 1 2024-09-17T01:01:50.591 INFO:tasks.workunit.client.0.smithi002.stdout:4/115: write d7/f12 [1871531,76771] 0 2024-09-17T01:01:50.591 INFO:tasks.workunit.client.0.smithi002.stdout:5/89: rename d2/lb to d2/de/l15 0 2024-09-17T01:01:50.591 INFO:tasks.workunit.client.0.smithi002.stdout:5/90: write d2/f9 [616569,21863] 0 2024-09-17T01:01:50.591 INFO:tasks.workunit.client.0.smithi002.stdout:5/91: readlink d2/de/l15 0 2024-09-17T01:01:50.592 INFO:tasks.workunit.client.0.smithi002.stdout:4/116: mkdir d7/de/d23 0 2024-09-17T01:01:50.593 INFO:tasks.workunit.client.0.smithi002.stdout:5/92: unlink d2/f3 0 2024-09-17T01:01:50.595 INFO:tasks.workunit.client.0.smithi002.stdout:4/117: rename c6 to d7/d19/c24 0 2024-09-17T01:01:50.601 INFO:tasks.workunit.client.0.smithi002.stdout:5/93: creat d2/dc/f16 x:0 0 0 2024-09-17T01:01:50.601 INFO:tasks.workunit.client.0.smithi002.stdout:6/85: dwrite d2/f16 [0,4194304] 0 2024-09-17T01:01:50.602 INFO:tasks.workunit.client.0.smithi002.stdout:6/86: chown d2/d6/ca 9177 1 2024-09-17T01:01:50.602 INFO:tasks.workunit.client.0.smithi002.stdout:4/118: creat d7/f25 x:0 0 0 2024-09-17T01:01:50.602 INFO:tasks.workunit.client.0.smithi002.stdout:4/119: write d7/f16 [1929677,88385] 0 2024-09-17T01:01:50.604 INFO:tasks.workunit.client.0.smithi002.stdout:6/87: rmdir d2/dc 39 2024-09-17T01:01:50.604 INFO:tasks.workunit.client.0.smithi002.stdout:6/88: write d2/f15 [1020755,61994] 0 2024-09-17T01:01:50.604 INFO:tasks.workunit.client.1.smithi099.stdout:5/229: write d2/dc/d14/f16 [1291518,74915] 0 2024-09-17T01:01:50.605 INFO:tasks.workunit.client.1.smithi099.stdout:5/230: chown d2/dc/d17/d3c 0 1 2024-09-17T01:01:50.605 INFO:tasks.workunit.client.0.smithi002.stdout:6/89: write d2/f19 [509101,97860] 0 2024-09-17T01:01:50.605 INFO:tasks.workunit.client.0.smithi002.stdout:6/90: read f1 [2727770,90490] 0 2024-09-17T01:01:50.605 INFO:tasks.workunit.client.0.smithi002.stdout:4/120: creat d7/de/d22/f26 x:0 0 0 2024-09-17T01:01:50.606 INFO:tasks.workunit.client.0.smithi002.stdout:2/77: sync 2024-09-17T01:01:50.606 INFO:tasks.workunit.client.1.smithi099.stdout:5/231: write d2/f18 [4348661,65004] 0 2024-09-17T01:01:50.606 INFO:tasks.workunit.client.0.smithi002.stdout:6/91: mkdir d2/d1d 0 2024-09-17T01:01:50.607 INFO:tasks.workunit.client.0.smithi002.stdout:6/92: symlink d2/l1e 0 2024-09-17T01:01:50.608 INFO:tasks.workunit.client.1.smithi099.stdout:5/232: getdents d2 0 2024-09-17T01:01:50.608 INFO:tasks.workunit.client.0.smithi002.stdout:4/121: dread d7/de/f15 [0,4194304] 0 2024-09-17T01:01:50.608 INFO:tasks.workunit.client.0.smithi002.stdout:4/122: read d7/f12 [1587964,70947] 0 2024-09-17T01:01:50.609 INFO:tasks.workunit.client.1.smithi099.stdout:5/233: unlink d2/dc/d14/c23 0 2024-09-17T01:01:50.609 INFO:tasks.workunit.client.0.smithi002.stdout:2/78: getdents . 0 2024-09-17T01:01:50.610 INFO:tasks.workunit.client.0.smithi002.stdout:8/100: dwrite d2/d9/f20 [0,4194304] 0 2024-09-17T01:01:50.610 INFO:tasks.workunit.client.0.smithi002.stdout:6/93: symlink d2/d6/l1f 0 2024-09-17T01:01:50.612 INFO:tasks.workunit.client.1.smithi099.stdout:5/234: fsync d2/d26/f4e 0 2024-09-17T01:01:50.614 INFO:tasks.workunit.client.1.smithi099.stdout:5/235: creat d2/dc/d14/f4f x:0 0 0 2024-09-17T01:01:50.615 INFO:tasks.workunit.client.0.smithi002.stdout:2/79: creat f16 x:0 0 0 2024-09-17T01:01:50.615 INFO:tasks.workunit.client.0.smithi002.stdout:2/80: rmdir - no directory 2024-09-17T01:01:50.615 INFO:tasks.workunit.client.0.smithi002.stdout:2/81: fsync ff 0 2024-09-17T01:01:50.615 INFO:tasks.workunit.client.0.smithi002.stdout:2/82: write f13 [892896,62951] 0 2024-09-17T01:01:50.615 INFO:tasks.workunit.client.0.smithi002.stdout:2/83: rmdir - no directory 2024-09-17T01:01:50.615 INFO:tasks.workunit.client.0.smithi002.stdout:2/84: creat f17 x:0 0 0 2024-09-17T01:01:50.616 INFO:tasks.workunit.client.0.smithi002.stdout:2/85: chown l7 34 1 2024-09-17T01:01:50.616 INFO:tasks.workunit.client.0.smithi002.stdout:2/86: chown lc 2926 1 2024-09-17T01:01:50.617 INFO:tasks.workunit.client.0.smithi002.stdout:8/101: symlink d2/d26/l27 0 2024-09-17T01:01:50.623 INFO:tasks.workunit.client.0.smithi002.stdout:8/102: mkdir d2/d1c/d28 0 2024-09-17T01:01:50.626 INFO:tasks.workunit.client.0.smithi002.stdout:8/103: symlink d2/d9/l29 0 2024-09-17T01:01:50.626 INFO:tasks.workunit.client.0.smithi002.stdout:8/104: chown d2/d9/f25 291491 1 2024-09-17T01:01:50.645 INFO:tasks.workunit.client.0.smithi002.stdout:4/123: dwrite d7/d19/f1c [0,4194304] 0 2024-09-17T01:01:50.645 INFO:tasks.workunit.client.0.smithi002.stdout:2/87: dwrite fa [0,4194304] 0 2024-09-17T01:01:50.645 INFO:tasks.workunit.client.1.smithi099.stdout:4/128: dwrite f1 [4194304,4194304] 0 2024-09-17T01:01:50.646 INFO:tasks.workunit.client.1.smithi099.stdout:6/211: dwrite dc/f3e [0,4194304] 0 2024-09-17T01:01:50.646 INFO:tasks.workunit.client.1.smithi099.stdout:5/236: dwrite d2/d26/f2a [0,4194304] 0 2024-09-17T01:01:50.646 INFO:tasks.workunit.client.1.smithi099.stdout:5/237: truncate d2/dc/f39 952261 0 2024-09-17T01:01:50.646 INFO:tasks.workunit.client.1.smithi099.stdout:5/238: dread - d2/dc/d17/d3c/f46 zero size 2024-09-17T01:01:50.646 INFO:tasks.workunit.client.0.smithi002.stdout:4/124: rename d7/f17 to d7/de/f27 0 2024-09-17T01:01:50.647 INFO:tasks.workunit.client.0.smithi002.stdout:4/125: write f0 [716444,93918] 0 2024-09-17T01:01:50.647 INFO:tasks.workunit.client.0.smithi002.stdout:4/126: dread - d7/f25 zero size 2024-09-17T01:01:50.647 INFO:tasks.workunit.client.0.smithi002.stdout:4/127: fdatasync d7/d19/f1c 0 2024-09-17T01:01:50.647 INFO:tasks.workunit.client.0.smithi002.stdout:6/94: rmdir d2/d6 39 2024-09-17T01:01:50.647 INFO:tasks.workunit.client.1.smithi099.stdout:6/212: creat dc/d27/f42 x:0 0 0 2024-09-17T01:01:50.648 INFO:tasks.workunit.client.0.smithi002.stdout:2/88: mknod c18 0 2024-09-17T01:01:50.648 INFO:tasks.workunit.client.1.smithi099.stdout:5/239: symlink d2/l50 0 2024-09-17T01:01:50.649 INFO:tasks.workunit.client.1.smithi099.stdout:6/213: symlink dc/l43 0 2024-09-17T01:01:50.649 INFO:tasks.workunit.client.0.smithi002.stdout:4/128: rename f0 to d7/de/f28 0 2024-09-17T01:01:50.650 INFO:tasks.workunit.client.0.smithi002.stdout:2/89: rename fa to f19 0 2024-09-17T01:01:50.653 INFO:tasks.workunit.client.0.smithi002.stdout:6/95: dread d2/f16 [0,4194304] 0 2024-09-17T01:01:50.671 INFO:tasks.workunit.client.0.smithi002.stdout:4/129: dwrite d7/de/f15 [0,4194304] 0 2024-09-17T01:01:50.671 INFO:tasks.workunit.client.0.smithi002.stdout:4/130: fsync d7/de/d22/f26 0 2024-09-17T01:01:50.671 INFO:tasks.workunit.client.0.smithi002.stdout:4/131: fdatasync d7/de/f27 0 2024-09-17T01:01:50.671 INFO:tasks.workunit.client.0.smithi002.stdout:2/90: dwrite fe [0,4194304] 0 2024-09-17T01:01:50.672 INFO:tasks.workunit.client.0.smithi002.stdout:2/91: chown c18 999 1 2024-09-17T01:01:50.672 INFO:tasks.workunit.client.0.smithi002.stdout:2/92: fdatasync ff 0 2024-09-17T01:01:50.672 INFO:tasks.workunit.client.0.smithi002.stdout:2/93: write ff [494545,77800] 0 2024-09-17T01:01:50.672 INFO:tasks.workunit.client.0.smithi002.stdout:2/94: creat f1a x:0 0 0 2024-09-17T01:01:50.672 INFO:tasks.workunit.client.0.smithi002.stdout:8/105: dwrite d2/d9/f20 [4194304,4194304] 0 2024-09-17T01:01:50.673 INFO:tasks.workunit.client.0.smithi002.stdout:4/132: unlink d7/ca 0 2024-09-17T01:01:50.675 INFO:tasks.workunit.client.1.smithi099.stdout:6/214: symlink dc/d27/l44 0 2024-09-17T01:01:50.675 INFO:tasks.workunit.client.1.smithi099.stdout:6/215: write f7 [3315598,46721] 0 2024-09-17T01:01:50.675 INFO:tasks.workunit.client.1.smithi099.stdout:6/216: chown dc/f34 26 1 2024-09-17T01:01:50.676 INFO:tasks.workunit.client.1.smithi099.stdout:6/217: creat dc/d27/d30/f45 x:0 0 0 2024-09-17T01:01:50.677 INFO:tasks.workunit.client.0.smithi002.stdout:2/95: mkdir d1b 0 2024-09-17T01:01:50.677 INFO:tasks.workunit.client.0.smithi002.stdout:2/96: chown c18 21067 1 2024-09-17T01:01:50.678 INFO:tasks.workunit.client.1.smithi099.stdout:0/81: sync 2024-09-17T01:01:50.678 INFO:tasks.workunit.client.1.smithi099.stdout:7/166: sync 2024-09-17T01:01:50.678 INFO:tasks.workunit.client.1.smithi099.stdout:3/195: sync 2024-09-17T01:01:50.678 INFO:tasks.workunit.client.1.smithi099.stdout:9/163: sync 2024-09-17T01:01:50.678 INFO:tasks.workunit.client.1.smithi099.stdout:7/167: stat d1/d1e/d12/f14 0 2024-09-17T01:01:50.678 INFO:tasks.workunit.client.1.smithi099.stdout:3/196: write d9/d15/d18/d1a/f1b [3605254,20684] 0 2024-09-17T01:01:50.678 INFO:tasks.workunit.client.1.smithi099.stdout:1/168: sync 2024-09-17T01:01:50.678 INFO:tasks.workunit.client.1.smithi099.stdout:1/169: fdatasync d0/fc 0 2024-09-17T01:01:50.678 INFO:tasks.workunit.client.1.smithi099.stdout:1/170: chown d0/d2/d9/f30 0 1 2024-09-17T01:01:50.680 INFO:tasks.workunit.client.0.smithi002.stdout:2/97: unlink c18 0 2024-09-17T01:01:50.680 INFO:tasks.workunit.client.1.smithi099.stdout:2/129: sync 2024-09-17T01:01:50.681 INFO:tasks.workunit.client.0.smithi002.stdout:2/98: creat d1b/f1c x:0 0 0 2024-09-17T01:01:50.682 INFO:tasks.workunit.client.1.smithi099.stdout:9/164: creat da/d21/d2a/f36 x:0 0 0 2024-09-17T01:01:50.683 INFO:tasks.workunit.client.1.smithi099.stdout:1/171: write d0/d2/ff [5850676,41693] 0 2024-09-17T01:01:50.683 INFO:tasks.workunit.client.1.smithi099.stdout:1/172: creat d0/d2/d18/f34 x:0 0 0 2024-09-17T01:01:50.683 INFO:tasks.workunit.client.1.smithi099.stdout:1/173: stat d0/fc 0 2024-09-17T01:01:50.683 INFO:tasks.workunit.client.1.smithi099.stdout:3/197: mknod d9/d2b/c3f 0 2024-09-17T01:01:50.683 INFO:tasks.workunit.client.1.smithi099.stdout:3/198: readlink d9/lf 0 2024-09-17T01:01:50.687 INFO:tasks.workunit.client.1.smithi099.stdout:9/165: rename da/d14/l27 to da/d18/l37 0 2024-09-17T01:01:50.687 INFO:tasks.workunit.client.1.smithi099.stdout:9/166: write da/d14/f29 [755129,119988] 0 2024-09-17T01:01:50.687 INFO:tasks.workunit.client.1.smithi099.stdout:9/167: chown da/l28 5518836 1 2024-09-17T01:01:50.689 INFO:tasks.workunit.client.1.smithi099.stdout:1/174: symlink d0/d2/de/l35 0 2024-09-17T01:01:50.691 INFO:tasks.workunit.client.1.smithi099.stdout:3/199: creat d9/d15/f40 x:0 0 0 2024-09-17T01:01:50.693 INFO:tasks.workunit.client.1.smithi099.stdout:9/168: symlink da/d14/d22/l38 0 2024-09-17T01:01:50.693 INFO:tasks.workunit.client.1.smithi099.stdout:9/169: write da/d14/d22/f23 [1277027,27793] 0 2024-09-17T01:01:50.694 INFO:tasks.workunit.client.1.smithi099.stdout:1/175: creat d0/f36 x:0 0 0 2024-09-17T01:01:50.695 INFO:tasks.workunit.client.1.smithi099.stdout:2/130: rmdir d2/d18 0 2024-09-17T01:01:50.696 INFO:tasks.workunit.client.1.smithi099.stdout:1/176: rename d0/d2/de/c1e to d0/d2/d18/c37 0 2024-09-17T01:01:50.698 INFO:tasks.workunit.client.1.smithi099.stdout:1/177: mkdir d0/d8/d38 0 2024-09-17T01:01:50.700 INFO:tasks.workunit.client.1.smithi099.stdout:2/131: rename d2/d8 to d2/d9/d25/d26 0 2024-09-17T01:01:50.700 INFO:tasks.workunit.client.1.smithi099.stdout:2/132: write d2/d9/d25/d26/f20 [755892,27182] 0 2024-09-17T01:01:50.701 INFO:tasks.workunit.client.1.smithi099.stdout:2/133: write d2/d9/f1f [1591109,111665] 0 2024-09-17T01:01:50.702 INFO:tasks.workunit.client.0.smithi002.stdout:8/106: dwrite d2/d9/f25 [0,4194304] 0 2024-09-17T01:01:50.703 INFO:tasks.workunit.client.1.smithi099.stdout:6/218: dwrite dc/d1a/f1b [0,4194304] 0 2024-09-17T01:01:50.704 INFO:tasks.workunit.client.0.smithi002.stdout:8/107: mknod d2/d1c/d28/c2a 0 2024-09-17T01:01:50.704 INFO:tasks.workunit.client.0.smithi002.stdout:8/108: chown d2/l8 12032 1 2024-09-17T01:01:50.704 INFO:tasks.workunit.client.0.smithi002.stdout:8/109: readlink d2/l8 0 2024-09-17T01:01:50.704 INFO:tasks.workunit.client.0.smithi002.stdout:8/110: mkdir d2/d26/d2b 0 2024-09-17T01:01:50.704 INFO:tasks.workunit.client.0.smithi002.stdout:8/111: rmdir d2/d9 39 2024-09-17T01:01:50.705 INFO:tasks.workunit.client.0.smithi002.stdout:8/112: read d2/f1d [466688,11526] 0 2024-09-17T01:01:50.705 INFO:tasks.workunit.client.1.smithi099.stdout:6/219: rename dc/c2e to dc/d1a/c46 0 2024-09-17T01:01:50.707 INFO:tasks.workunit.client.1.smithi099.stdout:3/200: write d9/d2b/f2d [280628,25767] 0 2024-09-17T01:01:50.707 INFO:tasks.workunit.client.1.smithi099.stdout:3/201: write d9/d15/d18/f2a [4529710,86399] 0 2024-09-17T01:01:50.714 INFO:tasks.workunit.client.1.smithi099.stdout:0/82: dwrite f8 [0,4194304] 0 2024-09-17T01:01:50.715 INFO:tasks.workunit.client.0.smithi002.stdout:2/99: dwrite f1a [0,4194304] 0 2024-09-17T01:01:50.715 INFO:tasks.workunit.client.1.smithi099.stdout:7/168: dwrite d1/d1e/d12/f14 [0,4194304] 0 2024-09-17T01:01:50.715 INFO:tasks.workunit.client.1.smithi099.stdout:6/220: dread dc/f18 [0,4194304] 0 2024-09-17T01:01:50.716 INFO:tasks.workunit.client.0.smithi002.stdout:3/62: sync 2024-09-17T01:01:50.716 INFO:tasks.workunit.client.0.smithi002.stdout:1/75: sync 2024-09-17T01:01:50.718 INFO:tasks.workunit.client.0.smithi002.stdout:1/76: link d4/c9 d4/d11/d12/d14/d17/c1e 0 2024-09-17T01:01:50.718 INFO:tasks.workunit.client.0.smithi002.stdout:1/77: read f3 [594210,107387] 0 2024-09-17T01:01:50.719 INFO:tasks.workunit.client.1.smithi099.stdout:2/134: dread d2/f4 [0,4194304] 0 2024-09-17T01:01:50.719 INFO:tasks.workunit.client.0.smithi002.stdout:1/78: creat d4/d11/d1c/f1f x:0 0 0 2024-09-17T01:01:50.723 INFO:tasks.workunit.client.0.smithi002.stdout:8/113: write d2/d3/f1b [3314085,946] 0 2024-09-17T01:01:50.724 INFO:tasks.workunit.client.1.smithi099.stdout:0/83: creat da/f19 x:0 0 0 2024-09-17T01:01:50.724 INFO:tasks.workunit.client.1.smithi099.stdout:0/84: fsync da/d12/f18 0 2024-09-17T01:01:50.724 INFO:tasks.workunit.client.1.smithi099.stdout:0/85: chown da/df/l11 39527365 1 2024-09-17T01:01:50.724 INFO:tasks.workunit.client.0.smithi002.stdout:2/100: write fe [2064346,48463] 0 2024-09-17T01:01:50.725 INFO:tasks.workunit.client.0.smithi002.stdout:8/114: creat d2/d9/dd/f2c x:0 0 0 2024-09-17T01:01:50.726 INFO:tasks.workunit.client.1.smithi099.stdout:2/135: dread d2/d9/d17/f21 [0,4194304] 0 2024-09-17T01:01:50.727 INFO:tasks.workunit.client.0.smithi002.stdout:2/101: mkdir d1b/d1d 0 2024-09-17T01:01:50.728 INFO:tasks.workunit.client.0.smithi002.stdout:2/102: creat d1b/f1e x:0 0 0 2024-09-17T01:01:50.728 INFO:tasks.workunit.client.1.smithi099.stdout:1/178: link d0/d2/d18/c37 d0/d2/de/d31/c39 0 2024-09-17T01:01:50.729 INFO:tasks.workunit.client.0.smithi002.stdout:8/115: unlink d2/l8 0 2024-09-17T01:01:50.731 INFO:tasks.workunit.client.0.smithi002.stdout:8/116: rename d2/d3/la to d2/d3/l2d 0 2024-09-17T01:01:50.732 INFO:tasks.workunit.client.0.smithi002.stdout:8/117: creat d2/f2e x:0 0 0 2024-09-17T01:01:50.732 INFO:tasks.workunit.client.0.smithi002.stdout:8/118: write d2/f1d [676593,118] 0 2024-09-17T01:01:50.734 INFO:tasks.workunit.client.1.smithi099.stdout:6/221: link dc/d27/d30/f45 dc/d2b/d3f/f47 0 2024-09-17T01:01:50.734 INFO:tasks.workunit.client.1.smithi099.stdout:1/179: dread d0/d2/d18/f28 [0,4194304] 0 2024-09-17T01:01:50.734 INFO:tasks.workunit.client.1.smithi099.stdout:6/222: write dc/d2b/d3f/f47 [543631,36743] 0 2024-09-17T01:01:50.737 INFO:tasks.workunit.client.1.smithi099.stdout:1/180: rename d0/d2/d9/lb to d0/d2/de/l3a 0 2024-09-17T01:01:50.737 INFO:tasks.workunit.client.1.smithi099.stdout:1/181: chown d0/d8/f32 58818 1 2024-09-17T01:01:50.737 INFO:tasks.workunit.client.1.smithi099.stdout:1/182: write d0/d2/de/f27 [826475,67138] 0 2024-09-17T01:01:50.737 INFO:tasks.workunit.client.1.smithi099.stdout:1/183: creat d0/d2/f3b x:0 0 0 2024-09-17T01:01:50.738 INFO:tasks.workunit.client.1.smithi099.stdout:6/223: symlink dc/d2b/l48 0 2024-09-17T01:01:50.739 INFO:tasks.workunit.client.1.smithi099.stdout:1/184: mknod d0/c3c 0 2024-09-17T01:01:50.742 INFO:tasks.workunit.client.1.smithi099.stdout:1/185: rmdir d0/d2/d5 39 2024-09-17T01:01:50.742 INFO:tasks.workunit.client.1.smithi099.stdout:1/186: fsync d0/fc 0 2024-09-17T01:01:50.743 INFO:tasks.workunit.client.0.smithi002.stdout:1/79: dwrite d4/fe [0,4194304] 0 2024-09-17T01:01:50.744 INFO:tasks.workunit.client.0.smithi002.stdout:1/80: mkdir d4/d11/d12/d14/d17/d20 0 2024-09-17T01:01:50.749 INFO:tasks.workunit.client.1.smithi099.stdout:6/224: read dc/fe [7371288,94749] 0 2024-09-17T01:01:50.754 INFO:tasks.workunit.client.1.smithi099.stdout:7/169: dwrite d1/d1e/fe [0,4194304] 0 2024-09-17T01:01:50.754 INFO:tasks.workunit.client.1.smithi099.stdout:7/170: chown d1/d1e/fe 15672 1 2024-09-17T01:01:50.754 INFO:tasks.workunit.client.1.smithi099.stdout:3/202: dwrite d9/d15/d18/d1a/f1f [4194304,4194304] 0 2024-09-17T01:01:50.756 INFO:tasks.workunit.client.1.smithi099.stdout:7/171: symlink d1/d1e/d1c/l2e 0 2024-09-17T01:01:50.757 INFO:tasks.workunit.client.1.smithi099.stdout:7/172: write d1/d1e/f13 [519051,43673] 0 2024-09-17T01:01:50.764 INFO:tasks.workunit.client.1.smithi099.stdout:9/170: dwrite da/d14/f29 [0,4194304] 0 2024-09-17T01:01:50.767 INFO:tasks.workunit.client.1.smithi099.stdout:9/171: rename da/d21/c33 to da/d14/d22/c39 0 2024-09-17T01:01:50.767 INFO:tasks.workunit.client.1.smithi099.stdout:9/172: readlink da/d21/l32 0 2024-09-17T01:01:50.769 INFO:tasks.workunit.client.1.smithi099.stdout:7/173: write d1/f10 [1155670,9104] 0 2024-09-17T01:01:50.769 INFO:tasks.workunit.client.1.smithi099.stdout:7/174: readlink d1/l23 0 2024-09-17T01:01:50.770 INFO:tasks.workunit.client.1.smithi099.stdout:7/175: fdatasync d1/f11 0 2024-09-17T01:01:50.771 INFO:tasks.workunit.client.1.smithi099.stdout:2/136: dwrite d2/f1c [0,4194304] 0 2024-09-17T01:01:50.771 INFO:tasks.workunit.client.0.smithi002.stdout:3/63: dwrite d0/f14 [0,4194304] 0 2024-09-17T01:01:50.772 INFO:tasks.workunit.client.0.smithi002.stdout:2/103: dwrite fd [0,4194304] 0 2024-09-17T01:01:50.773 INFO:tasks.workunit.client.1.smithi099.stdout:0/86: rmdir da 39 2024-09-17T01:01:50.775 INFO:tasks.workunit.client.1.smithi099.stdout:2/137: mknod d2/d9/d25/d26/c27 0 2024-09-17T01:01:50.776 INFO:tasks.workunit.client.0.smithi002.stdout:8/119: dread d2/f1d [0,4194304] 0 2024-09-17T01:01:50.777 INFO:tasks.workunit.client.1.smithi099.stdout:7/176: symlink d1/d1e/l2f 0 2024-09-17T01:01:50.777 INFO:tasks.workunit.client.1.smithi099.stdout:7/177: creat d1/d2c/f30 x:0 0 0 2024-09-17T01:01:50.777 INFO:tasks.workunit.client.1.smithi099.stdout:6/225: rmdir dc/d27/d30 39 2024-09-17T01:01:50.778 INFO:tasks.workunit.client.1.smithi099.stdout:0/87: mkdir da/df/d1a 0 2024-09-17T01:01:50.778 INFO:tasks.workunit.client.1.smithi099.stdout:0/88: readlink l6 0 2024-09-17T01:01:50.778 INFO:tasks.workunit.client.0.smithi002.stdout:8/120: symlink d2/l2f 0 2024-09-17T01:01:50.782 INFO:tasks.workunit.client.1.smithi099.stdout:0/89: dread da/df/f10 [0,4194304] 0 2024-09-17T01:01:50.784 INFO:tasks.workunit.client.1.smithi099.stdout:0/90: creat da/f1b x:0 0 0 2024-09-17T01:01:50.784 INFO:tasks.workunit.client.1.smithi099.stdout:0/91: chown l6 56 1 2024-09-17T01:01:50.784 INFO:tasks.workunit.client.1.smithi099.stdout:0/92: mkdir da/d1c 0 2024-09-17T01:01:50.785 INFO:tasks.workunit.client.0.smithi002.stdout:2/104: dwrite f1a [4194304,4194304] 0 2024-09-17T01:01:50.785 INFO:tasks.workunit.client.1.smithi099.stdout:0/93: creat da/df/d1a/f1d x:0 0 0 2024-09-17T01:01:50.786 INFO:tasks.workunit.client.1.smithi099.stdout:0/94: mkdir da/d1c/d1e 0 2024-09-17T01:01:50.787 INFO:tasks.workunit.client.1.smithi099.stdout:0/95: creat da/d1c/d1e/f1f x:0 0 0 2024-09-17T01:01:50.790 INFO:tasks.workunit.client.0.smithi002.stdout:3/64: dread d0/f14 [0,4194304] 0 2024-09-17T01:01:50.790 INFO:tasks.workunit.client.0.smithi002.stdout:3/65: chown d0/l12 2317017 1 2024-09-17T01:01:50.794 INFO:tasks.workunit.client.1.smithi099.stdout:7/178: dread d1/d1e/d12/f18 [0,4194304] 0 2024-09-17T01:01:50.795 INFO:tasks.workunit.client.1.smithi099.stdout:3/203: dwrite d9/d15/f34 [0,4194304] 0 2024-09-17T01:01:50.795 INFO:tasks.workunit.client.1.smithi099.stdout:1/187: dwrite d0/d2/d18/f28 [0,4194304] 0 2024-09-17T01:01:50.795 INFO:tasks.workunit.client.0.smithi002.stdout:1/81: dwrite f3 [0,4194304] 0 2024-09-17T01:01:50.797 INFO:tasks.workunit.client.1.smithi099.stdout:7/179: link d1/l1f d1/d2c/l31 0 2024-09-17T01:01:50.797 INFO:tasks.workunit.client.1.smithi099.stdout:2/138: dwrite d2/d7/fe [0,4194304] 0 2024-09-17T01:01:50.798 INFO:tasks.workunit.client.0.smithi002.stdout:1/82: symlink d4/l21 0 2024-09-17T01:01:50.800 INFO:tasks.workunit.client.0.smithi002.stdout:1/83: dread d4/fa [0,4194304] 0 2024-09-17T01:01:50.801 INFO:tasks.workunit.client.0.smithi002.stdout:1/84: dread - d4/f18 zero size 2024-09-17T01:01:50.801 INFO:tasks.workunit.client.1.smithi099.stdout:0/96: dread da/d12/f18 [0,4194304] 0 2024-09-17T01:01:50.803 INFO:tasks.workunit.client.0.smithi002.stdout:1/85: mkdir d4/d22 0 2024-09-17T01:01:50.803 INFO:tasks.workunit.client.1.smithi099.stdout:1/188: symlink d0/l3d 0 2024-09-17T01:01:50.803 INFO:tasks.workunit.client.1.smithi099.stdout:1/189: fdatasync d0/d8/f26 0 2024-09-17T01:01:50.804 INFO:tasks.workunit.client.0.smithi002.stdout:1/86: mkdir d4/d11/d12/d23 0 2024-09-17T01:01:50.804 INFO:tasks.workunit.client.1.smithi099.stdout:9/173: rename da/d14/d22 to da/d1b/d3a 0 2024-09-17T01:01:50.805 INFO:tasks.workunit.client.1.smithi099.stdout:3/204: dread d9/d15/d18/d1a/d23/f33 [0,4194304] 0 2024-09-17T01:01:50.805 INFO:tasks.workunit.client.1.smithi099.stdout:3/205: dread - d9/d15/d18/f35 zero size 2024-09-17T01:01:50.806 INFO:tasks.workunit.client.0.smithi002.stdout:8/121: getdents d2/d3 0 2024-09-17T01:01:50.807 INFO:tasks.workunit.client.1.smithi099.stdout:7/180: unlink d1/d1e/d1c/c22 0 2024-09-17T01:01:50.807 INFO:tasks.workunit.client.1.smithi099.stdout:7/181: creat d1/d1e/d12/f32 x:0 0 0 2024-09-17T01:01:50.812 INFO:tasks.workunit.client.0.smithi002.stdout:8/122: mkdir d2/d30 0 2024-09-17T01:01:50.812 INFO:tasks.workunit.client.0.smithi002.stdout:8/123: chown d2/f2e 0 1 2024-09-17T01:01:50.813 INFO:tasks.workunit.client.1.smithi099.stdout:1/190: symlink d0/d2/l3e 0 2024-09-17T01:01:50.814 INFO:tasks.workunit.client.1.smithi099.stdout:1/191: read - d0/d2/d9/f30 zero size 2024-09-17T01:01:50.815 INFO:tasks.workunit.client.1.smithi099.stdout:9/174: creat da/d21/f3b x:0 0 0 2024-09-17T01:01:50.815 INFO:tasks.workunit.client.0.smithi002.stdout:2/105: truncate fd 3183044 0 2024-09-17T01:01:50.815 INFO:tasks.workunit.client.0.smithi002.stdout:3/66: dwrite d0/f14 [0,4194304] 0 2024-09-17T01:01:50.816 INFO:tasks.workunit.client.1.smithi099.stdout:6/226: rename dc/d27/d30 to dc/d1a/d49 0 2024-09-17T01:01:50.817 INFO:tasks.workunit.client.0.smithi002.stdout:3/67: mknod d0/d3/d6/c18 0 2024-09-17T01:01:50.817 INFO:tasks.workunit.client.0.smithi002.stdout:3/68: readlink d0/d3/l9 0 2024-09-17T01:01:50.817 INFO:tasks.workunit.client.0.smithi002.stdout:3/69: read - d0/f16 zero size 2024-09-17T01:01:50.817 INFO:tasks.workunit.client.1.smithi099.stdout:7/182: fsync d1/f4 0 2024-09-17T01:01:50.818 INFO:tasks.workunit.client.1.smithi099.stdout:3/206: mknod d9/d15/d18/d1a/d23/c41 0 2024-09-17T01:01:50.819 INFO:tasks.workunit.client.0.smithi002.stdout:3/70: dread d0/d3/f8 [0,4194304] 0 2024-09-17T01:01:50.819 INFO:tasks.workunit.client.0.smithi002.stdout:3/71: chown d0/lc 31334 1 2024-09-17T01:01:50.820 INFO:tasks.workunit.client.1.smithi099.stdout:1/192: link d0/d2/de/f27 d0/d2/f3f 0 2024-09-17T01:01:50.820 INFO:tasks.workunit.client.1.smithi099.stdout:1/193: creat d0/f40 x:0 0 0 2024-09-17T01:01:50.822 INFO:tasks.workunit.client.1.smithi099.stdout:6/227: unlink dc/c25 0 2024-09-17T01:01:50.823 INFO:tasks.workunit.client.0.smithi002.stdout:3/72: rename d0/ff to d0/d3/f19 0 2024-09-17T01:01:50.824 INFO:tasks.workunit.client.0.smithi002.stdout:3/73: creat d0/d3/f1a x:0 0 0 2024-09-17T01:01:50.825 INFO:tasks.workunit.client.0.smithi002.stdout:3/74: truncate d0/d3/f19 1730625 0 2024-09-17T01:01:50.832 INFO:tasks.workunit.client.1.smithi099.stdout:0/97: rmdir da/d1c/d1e 39 2024-09-17T01:01:50.832 INFO:tasks.workunit.client.1.smithi099.stdout:0/98: write da/f1b [272023,55660] 0 2024-09-17T01:01:50.832 INFO:tasks.workunit.client.1.smithi099.stdout:0/99: truncate f8 4411269 0 2024-09-17T01:01:50.832 INFO:tasks.workunit.client.1.smithi099.stdout:9/175: dread da/fe [0,4194304] 0 2024-09-17T01:01:50.835 INFO:tasks.workunit.client.1.smithi099.stdout:9/176: mknod da/d14/c3c 0 2024-09-17T01:01:50.835 INFO:tasks.workunit.client.1.smithi099.stdout:9/177: readlink da/d1b/l2b 0 2024-09-17T01:01:50.835 INFO:tasks.workunit.client.0.smithi002.stdout:8/124: unlink d2/d9/f25 0 2024-09-17T01:01:50.835 INFO:tasks.workunit.client.0.smithi002.stdout:3/75: dread d0/fd [0,4194304] 0 2024-09-17T01:01:50.835 INFO:tasks.workunit.client.0.smithi002.stdout:3/76: chown d0/d3/d6/c18 13 1 2024-09-17T01:01:50.836 INFO:tasks.workunit.client.0.smithi002.stdout:3/77: readlink d0/lc 0 2024-09-17T01:01:50.839 INFO:tasks.workunit.client.0.smithi002.stdout:3/78: rmdir d0/d3/d6/d15 0 2024-09-17T01:01:50.840 INFO:tasks.workunit.client.0.smithi002.stdout:7/46: sync 2024-09-17T01:01:50.840 INFO:tasks.workunit.client.0.smithi002.stdout:9/39: sync 2024-09-17T01:01:50.840 INFO:tasks.workunit.client.0.smithi002.stdout:0/61: sync 2024-09-17T01:01:50.841 INFO:tasks.workunit.client.1.smithi099.stdout:9/178: dread da/f2c [0,4194304] 0 2024-09-17T01:01:50.841 INFO:tasks.workunit.client.1.smithi099.stdout:9/179: creat da/d1b/f3d x:0 0 0 2024-09-17T01:01:50.843 INFO:tasks.workunit.client.1.smithi099.stdout:9/180: link da/d21/l32 da/d1b/l3e 0 2024-09-17T01:01:50.844 INFO:tasks.workunit.client.0.smithi002.stdout:1/87: dwrite f3 [0,4194304] 0 2024-09-17T01:01:50.844 INFO:tasks.workunit.client.0.smithi002.stdout:1/88: chown d4/cb 9696 1 2024-09-17T01:01:50.844 INFO:tasks.workunit.client.0.smithi002.stdout:1/89: write d4/d11/d1c/f1f [131407,125507] 0 2024-09-17T01:01:50.849 INFO:tasks.workunit.client.1.smithi099.stdout:9/181: symlink da/d1b/d3a/l3f 0 2024-09-17T01:01:50.849 INFO:tasks.workunit.client.1.smithi099.stdout:1/194: read d0/d2/de/f15 [1315590,32026] 0 2024-09-17T01:01:50.849 INFO:tasks.workunit.client.1.smithi099.stdout:9/182: truncate f4 10946829 0 2024-09-17T01:01:50.849 INFO:tasks.workunit.client.1.smithi099.stdout:1/195: mkdir d0/d2/de/d31/d41 0 2024-09-17T01:01:50.850 INFO:tasks.workunit.client.1.smithi099.stdout:1/196: symlink d0/d2/de/l42 0 2024-09-17T01:01:50.850 INFO:tasks.workunit.client.1.smithi099.stdout:1/197: readlink d0/d2/de/l35 0 2024-09-17T01:01:50.852 INFO:tasks.workunit.client.1.smithi099.stdout:1/198: dread d0/d2/de/f27 [0,4194304] 0 2024-09-17T01:01:50.854 INFO:tasks.workunit.client.1.smithi099.stdout:1/199: rmdir d0/d2/d9 39 2024-09-17T01:01:50.854 INFO:tasks.workunit.client.1.smithi099.stdout:1/200: dread - d0/d2/d9/f30 zero size 2024-09-17T01:01:50.854 INFO:tasks.workunit.client.1.smithi099.stdout:1/201: chown d0/d2/d18/c1c 11958162 1 2024-09-17T01:01:50.854 INFO:tasks.workunit.client.1.smithi099.stdout:1/202: readlink d0/d8/l20 0 2024-09-17T01:01:50.855 INFO:tasks.workunit.client.0.smithi002.stdout:3/79: dread d0/f14 [0,4194304] 0 2024-09-17T01:01:50.855 INFO:tasks.workunit.client.0.smithi002.stdout:3/80: truncate d0/f16 106645 0 2024-09-17T01:01:50.856 INFO:tasks.workunit.client.1.smithi099.stdout:1/203: symlink d0/d2/d18/l43 0 2024-09-17T01:01:50.856 INFO:tasks.workunit.client.0.smithi002.stdout:3/81: symlink d0/l1b 0 2024-09-17T01:01:50.857 INFO:tasks.workunit.client.0.smithi002.stdout:3/82: readlink d0/l1b 0 2024-09-17T01:01:50.857 INFO:tasks.workunit.client.1.smithi099.stdout:1/204: symlink d0/l44 0 2024-09-17T01:01:50.857 INFO:tasks.workunit.client.1.smithi099.stdout:1/205: stat d0/d2/de/l35 0 2024-09-17T01:01:50.858 INFO:tasks.workunit.client.1.smithi099.stdout:1/206: rmdir d0/d2/de/d31/d41 0 2024-09-17T01:01:50.859 INFO:tasks.workunit.client.1.smithi099.stdout:2/139: dwrite d2/d9/f1f [0,4194304] 0 2024-09-17T01:01:50.859 INFO:tasks.workunit.client.1.smithi099.stdout:1/207: rmdir d0/d2/de/d31 39 2024-09-17T01:01:50.859 INFO:tasks.workunit.client.1.smithi099.stdout:1/208: readlink d0/d2/de/l42 0 2024-09-17T01:01:50.859 INFO:tasks.workunit.client.1.smithi099.stdout:1/209: truncate d0/f40 246139 0 2024-09-17T01:01:50.860 INFO:tasks.workunit.client.1.smithi099.stdout:2/140: symlink d2/d9/d25/d26/d1b/l28 0 2024-09-17T01:01:50.860 INFO:tasks.workunit.client.1.smithi099.stdout:2/141: stat d2/d9/d25/d26 0 2024-09-17T01:01:50.861 INFO:tasks.workunit.client.1.smithi099.stdout:2/142: creat d2/d9/d25/d26/f29 x:0 0 0 2024-09-17T01:01:50.863 INFO:tasks.workunit.client.1.smithi099.stdout:2/143: mknod d2/c2a 0 2024-09-17T01:01:50.863 INFO:tasks.workunit.client.1.smithi099.stdout:2/144: creat d2/d9/d25/d26/f2b x:0 0 0 2024-09-17T01:01:50.863 INFO:tasks.workunit.client.1.smithi099.stdout:2/145: truncate d2/d9/d25/d26/f2b 996121 0 2024-09-17T01:01:50.865 INFO:tasks.workunit.client.1.smithi099.stdout:1/210: dread d0/d2/de/f15 [0,4194304] 0 2024-09-17T01:01:50.865 INFO:tasks.workunit.client.1.smithi099.stdout:1/211: chown d0/d2/d5/c2a 18 1 2024-09-17T01:01:50.867 INFO:tasks.workunit.client.1.smithi099.stdout:1/212: mknod d0/d2/d5/c45 0 2024-09-17T01:01:50.867 INFO:tasks.workunit.client.1.smithi099.stdout:7/183: dwrite d1/f11 [0,4194304] 0 2024-09-17T01:01:50.868 INFO:tasks.workunit.client.0.smithi002.stdout:2/106: dwrite f17 [0,4194304] 0 2024-09-17T01:01:50.874 INFO:tasks.workunit.client.1.smithi099.stdout:3/207: dwrite d9/d15/d18/f2f [4194304,4194304] 0 2024-09-17T01:01:50.874 INFO:tasks.workunit.client.0.smithi002.stdout:0/62: dwrite dd/ff [4194304,4194304] 0 2024-09-17T01:01:50.874 INFO:tasks.workunit.client.0.smithi002.stdout:0/63: creat dd/f13 x:0 0 0 2024-09-17T01:01:50.875 INFO:tasks.workunit.client.0.smithi002.stdout:7/47: dwrite d1/f6 [0,4194304] 0 2024-09-17T01:01:50.877 INFO:tasks.workunit.client.1.smithi099.stdout:3/208: creat d9/d15/d18/f42 x:0 0 0 2024-09-17T01:01:50.877 INFO:tasks.workunit.client.1.smithi099.stdout:3/209: chown d9/d15/c36 33368063 1 2024-09-17T01:01:50.877 INFO:tasks.workunit.client.1.smithi099.stdout:3/210: chown d9/d15/d18/f20 22 1 2024-09-17T01:01:50.878 INFO:tasks.workunit.client.0.smithi002.stdout:7/48: rename d1/la to d1/l12 0 2024-09-17T01:01:50.878 INFO:tasks.workunit.client.0.smithi002.stdout:7/49: fdatasync d1/f6 0 2024-09-17T01:01:50.880 INFO:tasks.workunit.client.1.smithi099.stdout:6/228: getdents dc/d27 0 2024-09-17T01:01:50.880 INFO:tasks.workunit.client.1.smithi099.stdout:0/100: dwrite da/d12/f16 [0,4194304] 0 2024-09-17T01:01:50.880 INFO:tasks.workunit.client.1.smithi099.stdout:0/101: fdatasync da/df/d1a/f1d 0 2024-09-17T01:01:50.880 INFO:tasks.workunit.client.1.smithi099.stdout:0/102: fdatasync da/df/f10 0 2024-09-17T01:01:50.881 INFO:tasks.workunit.client.0.smithi002.stdout:1/90: dwrite d4/f6 [0,4194304] 0 2024-09-17T01:01:50.881 INFO:tasks.workunit.client.0.smithi002.stdout:3/83: dwrite d0/f14 [0,4194304] 0 2024-09-17T01:01:50.882 INFO:tasks.workunit.client.1.smithi099.stdout:6/229: mknod dc/d1a/d49/c4a 0 2024-09-17T01:01:50.883 INFO:tasks.workunit.client.0.smithi002.stdout:1/91: mknod d4/d11/d12/d14/d17/d20/c24 0 2024-09-17T01:01:50.885 INFO:tasks.workunit.client.1.smithi099.stdout:0/103: mkdir da/df/d20 0 2024-09-17T01:01:50.885 INFO:tasks.workunit.client.1.smithi099.stdout:0/104: write da/df/f15 [583798,45454] 0 2024-09-17T01:01:50.885 INFO:tasks.workunit.client.1.smithi099.stdout:0/105: chown f8 26117 1 2024-09-17T01:01:50.885 INFO:tasks.workunit.client.1.smithi099.stdout:1/213: getdents d0/d2 0 2024-09-17T01:01:50.885 INFO:tasks.workunit.client.1.smithi099.stdout:7/184: dread d1/f11 [0,4194304] 0 2024-09-17T01:01:50.885 INFO:tasks.workunit.client.0.smithi002.stdout:3/84: creat d0/d3/d17/f1c x:0 0 0 2024-09-17T01:01:50.887 INFO:tasks.workunit.client.1.smithi099.stdout:1/214: symlink d0/d2/l46 0 2024-09-17T01:01:50.887 INFO:tasks.workunit.client.0.smithi002.stdout:1/92: mknod d4/d11/d12/d14/c25 0 2024-09-17T01:01:50.888 INFO:tasks.workunit.client.1.smithi099.stdout:7/185: rename d1/d1e/d1c/l21 to d1/d1e/d1c/l33 0 2024-09-17T01:01:50.888 INFO:tasks.workunit.client.0.smithi002.stdout:8/125: rmdir d2 39 2024-09-17T01:01:50.889 INFO:tasks.workunit.client.1.smithi099.stdout:1/215: mknod d0/d8/c47 0 2024-09-17T01:01:50.890 INFO:tasks.workunit.client.1.smithi099.stdout:8/132: sync 2024-09-17T01:01:50.891 INFO:tasks.workunit.client.1.smithi099.stdout:9/183: rmdir da/d21 39 2024-09-17T01:01:50.892 INFO:tasks.workunit.client.0.smithi002.stdout:5/94: sync 2024-09-17T01:01:50.892 INFO:tasks.workunit.client.0.smithi002.stdout:5/95: stat d2/de 0 2024-09-17T01:01:50.893 INFO:tasks.workunit.client.1.smithi099.stdout:8/133: link d0/f18 d0/d1f/f20 0 2024-09-17T01:01:50.894 INFO:tasks.workunit.client.1.smithi099.stdout:8/134: chown d0/d1f 8574 1 2024-09-17T01:01:50.896 INFO:tasks.workunit.client.1.smithi099.stdout:2/146: dwrite d2/f1c [0,4194304] 0 2024-09-17T01:01:50.896 INFO:tasks.workunit.client.0.smithi002.stdout:6/96: sync 2024-09-17T01:01:50.897 INFO:tasks.workunit.client.0.smithi002.stdout:4/133: sync 2024-09-17T01:01:50.897 INFO:tasks.workunit.client.0.smithi002.stdout:4/134: truncate d7/f14 740601 0 2024-09-17T01:01:50.898 INFO:tasks.workunit.client.1.smithi099.stdout:1/216: creat d0/d2/d9/f48 x:0 0 0 2024-09-17T01:01:50.899 INFO:tasks.workunit.client.0.smithi002.stdout:1/93: creat d4/f26 x:0 0 0 2024-09-17T01:01:50.899 INFO:tasks.workunit.client.0.smithi002.stdout:1/94: dread - d4/d11/d12/d14/f1b zero size 2024-09-17T01:01:50.899 INFO:tasks.workunit.client.0.smithi002.stdout:8/126: mknod d2/d26/d2b/c31 0 2024-09-17T01:01:50.899 INFO:tasks.workunit.client.0.smithi002.stdout:3/85: mknod d0/d3/c1d 0 2024-09-17T01:01:50.900 INFO:tasks.workunit.client.1.smithi099.stdout:8/135: symlink d0/d1f/l21 0 2024-09-17T01:01:50.900 INFO:tasks.workunit.client.0.smithi002.stdout:2/107: dwrite fd [0,4194304] 0 2024-09-17T01:01:50.902 INFO:tasks.workunit.client.0.smithi002.stdout:1/95: rename d4/f26 to d4/d11/d12/d14/d17/f27 0 2024-09-17T01:01:50.902 INFO:tasks.workunit.client.0.smithi002.stdout:1/96: chown d4/d11/d12/d14/d17/c1e 126524910 1 2024-09-17T01:01:50.902 INFO:tasks.workunit.client.0.smithi002.stdout:1/97: read - d4/f18 zero size 2024-09-17T01:01:50.902 INFO:tasks.workunit.client.0.smithi002.stdout:8/127: dread - d2/d9/dd/f2c zero size 2024-09-17T01:01:50.903 INFO:tasks.workunit.client.1.smithi099.stdout:2/147: mkdir d2/d9/d25/d26/d1b/d2c 0 2024-09-17T01:01:50.905 INFO:tasks.workunit.client.1.smithi099.stdout:1/217: mkdir d0/d8/d49 0 2024-09-17T01:01:50.906 INFO:tasks.workunit.client.0.smithi002.stdout:2/108: creat d1b/d1d/f1f x:0 0 0 2024-09-17T01:01:50.907 INFO:tasks.workunit.client.1.smithi099.stdout:8/136: mknod d0/c22 0 2024-09-17T01:01:50.908 INFO:tasks.workunit.client.1.smithi099.stdout:1/218: mkdir d0/d8/d4a 0 2024-09-17T01:01:50.908 INFO:tasks.workunit.client.1.smithi099.stdout:1/219: chown d0/d8/l22 59848 1 2024-09-17T01:01:50.910 INFO:tasks.workunit.client.0.smithi002.stdout:1/98: creat d4/d11/d12/d14/d17/f28 x:0 0 0 2024-09-17T01:01:50.910 INFO:tasks.workunit.client.0.smithi002.stdout:1/99: write d4/fc [3048589,104077] 0 2024-09-17T01:01:50.911 INFO:tasks.workunit.client.1.smithi099.stdout:9/184: write f6 [6342492,94664] 0 2024-09-17T01:01:50.911 INFO:tasks.workunit.client.1.smithi099.stdout:1/220: unlink d0/d2/d18/c1f 0 2024-09-17T01:01:50.912 INFO:tasks.workunit.client.0.smithi002.stdout:8/128: creat d2/d30/f32 x:0 0 0 2024-09-17T01:01:50.912 INFO:tasks.workunit.client.0.smithi002.stdout:8/129: write d2/d3/f19 [3004679,63760] 0 2024-09-17T01:01:50.913 INFO:tasks.workunit.client.0.smithi002.stdout:0/64: getdents dd 0 2024-09-17T01:01:50.913 INFO:tasks.workunit.client.0.smithi002.stdout:0/65: stat dd/c11 0 2024-09-17T01:01:50.913 INFO:tasks.workunit.client.0.smithi002.stdout:0/66: getdents dd 0 2024-09-17T01:01:50.914 INFO:tasks.workunit.client.0.smithi002.stdout:1/100: link d4/d11/d12/d14/f1b d4/d11/d1a/f29 0 2024-09-17T01:01:50.914 INFO:tasks.workunit.client.1.smithi099.stdout:9/185: mkdir da/d14/d40 0 2024-09-17T01:01:50.914 INFO:tasks.workunit.client.1.smithi099.stdout:1/221: mkdir d0/d2/d9/d4b 0 2024-09-17T01:01:50.914 INFO:tasks.workunit.client.1.smithi099.stdout:1/222: chown d0/f40 0 1 2024-09-17T01:01:50.915 INFO:tasks.workunit.client.1.smithi099.stdout:9/186: link l3 da/d21/d2a/l41 0 2024-09-17T01:01:50.917 INFO:tasks.workunit.client.1.smithi099.stdout:7/186: fdatasync - open d1/d1e/f9 failed 14 2024-09-17T01:01:50.917 INFO:tasks.workunit.client.1.smithi099.stdout:7/187: stat d1/d1e/d12 0 2024-09-17T01:01:50.917 INFO:tasks.workunit.client.1.smithi099.stdout:7/188: fsync d1/ff 0 2024-09-17T01:01:50.921 INFO:tasks.workunit.client.0.smithi002.stdout:0/67: write dd/ff [7331959,26186] 0 2024-09-17T01:01:50.922 INFO:tasks.workunit.client.0.smithi002.stdout:0/68: getdents dd 0 2024-09-17T01:01:50.922 INFO:tasks.workunit.client.0.smithi002.stdout:0/69: chown dd/c11 885 1 2024-09-17T01:01:50.922 INFO:tasks.workunit.client.0.smithi002.stdout:0/70: truncate dd/f13 764481 0 2024-09-17T01:01:50.923 INFO:tasks.workunit.client.0.smithi002.stdout:0/71: creat dd/f14 x:0 0 0 2024-09-17T01:01:50.924 INFO:tasks.workunit.client.1.smithi099.stdout:7/189: creat d1/d1e/f34 x:0 0 0 2024-09-17T01:01:50.924 INFO:tasks.workunit.client.1.smithi099.stdout:2/148: read d2/d7/fe [1647696,71442] 0 2024-09-17T01:01:50.924 INFO:tasks.workunit.client.1.smithi099.stdout:0/106: dwrite da/d12/f18 [0,4194304] 0 2024-09-17T01:01:50.924 INFO:tasks.workunit.client.1.smithi099.stdout:0/107: write da/f19 [604773,60549] 0 2024-09-17T01:01:50.925 INFO:tasks.workunit.client.1.smithi099.stdout:7/190: link d1/d1e/d12/f32 d1/f35 0 2024-09-17T01:01:50.925 INFO:tasks.workunit.client.0.smithi002.stdout:0/72: unlink dd/le 0 2024-09-17T01:01:50.925 INFO:tasks.workunit.client.0.smithi002.stdout:0/73: readlink la 0 2024-09-17T01:01:50.925 INFO:tasks.workunit.client.0.smithi002.stdout:4/135: dread d7/de/f27 [0,4194304] 0 2024-09-17T01:01:50.926 INFO:tasks.workunit.client.0.smithi002.stdout:0/74: write dd/f13 [1723144,14767] 0 2024-09-17T01:01:50.926 INFO:tasks.workunit.client.0.smithi002.stdout:0/75: chown c3 11402205 1 2024-09-17T01:01:50.926 INFO:tasks.workunit.client.1.smithi099.stdout:0/108: mknod da/c21 0 2024-09-17T01:01:50.928 INFO:tasks.workunit.client.1.smithi099.stdout:0/109: mkdir da/d12/d22 0 2024-09-17T01:01:50.934 INFO:tasks.workunit.client.0.smithi002.stdout:7/50: dwrite f0 [0,4194304] 0 2024-09-17T01:01:50.934 INFO:tasks.workunit.client.0.smithi002.stdout:7/51: chown d1/le 199712251 1 2024-09-17T01:01:50.934 INFO:tasks.workunit.client.0.smithi002.stdout:7/52: chown d1/f10 0 1 2024-09-17T01:01:50.935 INFO:tasks.workunit.client.0.smithi002.stdout:7/53: creat d1/f13 x:0 0 0 2024-09-17T01:01:50.935 INFO:tasks.workunit.client.0.smithi002.stdout:6/97: dwrite d2/f13 [4194304,4194304] 0 2024-09-17T01:01:50.936 INFO:tasks.workunit.client.1.smithi099.stdout:3/211: dwrite d9/d15/d18/d1a/d23/f33 [0,4194304] 0 2024-09-17T01:01:50.938 INFO:tasks.workunit.client.1.smithi099.stdout:3/212: creat d9/d15/d18/d1a/d23/f43 x:0 0 0 2024-09-17T01:01:50.939 INFO:tasks.workunit.client.0.smithi002.stdout:3/86: dwrite d0/d3/d17/f1c [0,4194304] 0 2024-09-17T01:01:50.943 INFO:tasks.workunit.client.1.smithi099.stdout:3/213: read d9/d15/d18/f20 [2406960,22330] 0 2024-09-17T01:01:50.945 INFO:tasks.workunit.client.0.smithi002.stdout:6/98: dread d2/f19 [0,4194304] 0 2024-09-17T01:01:50.951 INFO:tasks.workunit.client.0.smithi002.stdout:3/87: write d0/d3/d17/f1c [3630458,69121] 0 2024-09-17T01:01:50.951 INFO:tasks.workunit.client.0.smithi002.stdout:3/88: fsync d0/d3/f8 0 2024-09-17T01:01:50.952 INFO:tasks.workunit.client.0.smithi002.stdout:3/89: readlink d0/l11 0 2024-09-17T01:01:50.952 INFO:tasks.workunit.client.0.smithi002.stdout:3/90: dread - d0/d3/f1a zero size 2024-09-17T01:01:50.952 INFO:tasks.workunit.client.1.smithi099.stdout:6/230: dwrite dc/d1a/f26 [0,4194304] 0 2024-09-17T01:01:50.953 INFO:tasks.workunit.client.0.smithi002.stdout:3/91: mknod d0/d3/c1e 0 2024-09-17T01:01:50.953 INFO:tasks.workunit.client.0.smithi002.stdout:3/92: chown d0/d3/d6/c18 10 1 2024-09-17T01:01:50.953 INFO:tasks.workunit.client.0.smithi002.stdout:3/93: chown d0/d3/c1e 1410 1 2024-09-17T01:01:50.954 INFO:tasks.workunit.client.0.smithi002.stdout:3/94: unlink d0/c13 0 2024-09-17T01:01:50.954 INFO:tasks.workunit.client.0.smithi002.stdout:3/95: creat d0/f1f x:0 0 0 2024-09-17T01:01:50.954 INFO:tasks.workunit.client.0.smithi002.stdout:3/96: write d0/d3/d17/f1c [2011771,6519] 0 2024-09-17T01:01:50.962 INFO:tasks.workunit.client.1.smithi099.stdout:6/231: write dc/f34 [3328292,89268] 0 2024-09-17T01:01:50.962 INFO:tasks.workunit.client.1.smithi099.stdout:6/232: creat dc/d2b/f4b x:0 0 0 2024-09-17T01:01:50.964 INFO:tasks.workunit.client.1.smithi099.stdout:6/233: mkdir dc/d1a/d49/d4c 0 2024-09-17T01:01:50.964 INFO:tasks.workunit.client.1.smithi099.stdout:6/234: fdatasync dc/f3e 0 2024-09-17T01:01:50.964 INFO:tasks.workunit.client.1.smithi099.stdout:6/235: dread - dc/f39 zero size 2024-09-17T01:01:50.964 INFO:tasks.workunit.client.1.smithi099.stdout:6/236: write dc/d1a/f1e [2200769,61777] 0 2024-09-17T01:01:50.970 INFO:tasks.workunit.client.0.smithi002.stdout:5/96: dwrite d2/dc/dd/f13 [0,4194304] 0 2024-09-17T01:01:50.970 INFO:tasks.workunit.client.0.smithi002.stdout:5/97: creat d2/dc/dd/f17 x:0 0 0 2024-09-17T01:01:50.971 INFO:tasks.workunit.client.1.smithi099.stdout:7/191: getdents d1/d1e/d1c 0 2024-09-17T01:01:50.971 INFO:tasks.workunit.client.1.smithi099.stdout:7/192: chown d1/d1e/d12/f14 229723 1 2024-09-17T01:01:50.972 INFO:tasks.workunit.client.1.smithi099.stdout:7/193: truncate d1/f19 137389 0 2024-09-17T01:01:50.973 INFO:tasks.workunit.client.0.smithi002.stdout:5/98: rename f0 to d2/dc/dd/f18 0 2024-09-17T01:01:50.973 INFO:tasks.workunit.client.0.smithi002.stdout:5/99: stat d2/dc/dd/f17 0 2024-09-17T01:01:50.973 INFO:tasks.workunit.client.0.smithi002.stdout:5/100: stat d2/de/f11 0 2024-09-17T01:01:50.974 INFO:tasks.workunit.client.1.smithi099.stdout:2/149: truncate d2/f1c 1387999 0 2024-09-17T01:01:50.979 INFO:tasks.workunit.client.1.smithi099.stdout:1/223: dwrite d0/d2/de/f15 [0,4194304] 0 2024-09-17T01:01:50.980 INFO:tasks.workunit.client.1.smithi099.stdout:1/224: truncate d0/f40 803925 0 2024-09-17T01:01:50.981 INFO:tasks.workunit.client.1.smithi099.stdout:1/225: write d0/d2/f3f [1654888,126188] 0 2024-09-17T01:01:50.981 INFO:tasks.workunit.client.1.smithi099.stdout:6/237: read fa [901896,96908] 0 2024-09-17T01:01:50.982 INFO:tasks.workunit.client.0.smithi002.stdout:5/101: write d2/fa [1622415,86885] 0 2024-09-17T01:01:50.982 INFO:tasks.workunit.client.1.smithi099.stdout:1/226: creat d0/d8/d49/f4c x:0 0 0 2024-09-17T01:01:50.983 INFO:tasks.workunit.client.0.smithi002.stdout:1/101: rmdir d4/d11/d12/d14/d17 39 2024-09-17T01:01:50.983 INFO:tasks.workunit.client.0.smithi002.stdout:1/102: write d4/d11/f15 [23066,130062] 0 2024-09-17T01:01:50.985 INFO:tasks.workunit.client.0.smithi002.stdout:2/109: dwrite f19 [4194304,4194304] 0 2024-09-17T01:01:50.985 INFO:tasks.workunit.client.0.smithi002.stdout:1/103: symlink d4/d11/d12/d23/l2a 0 2024-09-17T01:01:50.985 INFO:tasks.workunit.client.1.smithi099.stdout:1/227: creat d0/d2/d5/f4d x:0 0 0 2024-09-17T01:01:50.985 INFO:tasks.workunit.client.1.smithi099.stdout:1/228: fdatasync d0/d2/de/f15 0 2024-09-17T01:01:50.986 INFO:tasks.workunit.client.0.smithi002.stdout:5/102: dread d2/de/ff [4194304,4194304] 0 2024-09-17T01:01:50.986 INFO:tasks.workunit.client.1.smithi099.stdout:0/110: truncate f8 623491 0 2024-09-17T01:01:50.987 INFO:tasks.workunit.client.0.smithi002.stdout:2/110: mknod d1b/c20 0 2024-09-17T01:01:50.987 INFO:tasks.workunit.client.1.smithi099.stdout:2/150: write d2/d9/f1f [1151879,49832] 0 2024-09-17T01:01:50.988 INFO:tasks.workunit.client.1.smithi099.stdout:0/111: mkdir da/df/d1a/d23 0 2024-09-17T01:01:50.988 INFO:tasks.workunit.client.0.smithi002.stdout:2/111: symlink d1b/l21 0 2024-09-17T01:01:50.989 INFO:tasks.workunit.client.1.smithi099.stdout:2/151: creat d2/d9/d25/f2d x:0 0 0 2024-09-17T01:01:50.992 INFO:tasks.workunit.client.1.smithi099.stdout:8/137: dwrite d0/d4/fa [4194304,4194304] 0 2024-09-17T01:01:50.992 INFO:tasks.workunit.client.1.smithi099.stdout:8/138: fsync d0/d1f/f12 0 2024-09-17T01:01:50.996 INFO:tasks.workunit.client.1.smithi099.stdout:6/238: dread dc/d1a/f1b [0,4194304] 0 2024-09-17T01:01:50.997 INFO:tasks.workunit.client.0.smithi002.stdout:1/104: write d4/fe [593512,103750] 0 2024-09-17T01:01:50.999 INFO:tasks.workunit.client.0.smithi002.stdout:8/130: dwrite f0 [0,4194304] 0 2024-09-17T01:01:51.000 INFO:tasks.workunit.client.0.smithi002.stdout:6/99: dwrite d2/f1a [0,4194304] 0 2024-09-17T01:01:51.001 INFO:tasks.workunit.client.1.smithi099.stdout:8/139: rmdir d0 39 2024-09-17T01:01:51.001 INFO:tasks.workunit.client.1.smithi099.stdout:1/229: dread d0/d2/d18/f28 [0,4194304] 0 2024-09-17T01:01:51.002 INFO:tasks.workunit.client.0.smithi002.stdout:0/76: dwrite dd/ff [0,4194304] 0 2024-09-17T01:01:51.002 INFO:tasks.workunit.client.0.smithi002.stdout:0/77: fdatasync dd/f14 0 2024-09-17T01:01:51.002 INFO:tasks.workunit.client.0.smithi002.stdout:8/131: unlink d2/d3/f22 0 2024-09-17T01:01:51.002 INFO:tasks.workunit.client.0.smithi002.stdout:8/132: dread - d2/d3/f24 zero size 2024-09-17T01:01:51.002 INFO:tasks.workunit.client.0.smithi002.stdout:8/133: chown d2/d30/f32 43149 1 2024-09-17T01:01:51.003 INFO:tasks.workunit.client.1.smithi099.stdout:8/140: creat d0/f23 x:0 0 0 2024-09-17T01:01:51.003 INFO:tasks.workunit.client.1.smithi099.stdout:8/141: chown d0/f18 3225 1 2024-09-17T01:01:51.003 INFO:tasks.workunit.client.1.smithi099.stdout:1/230: write d0/d2/ff [7477587,124171] 0 2024-09-17T01:01:51.004 INFO:tasks.workunit.client.1.smithi099.stdout:1/231: dread - d0/d8/f26 zero size 2024-09-17T01:01:51.004 INFO:tasks.workunit.client.1.smithi099.stdout:1/232: read d0/d8/f32 [7543379,78947] 0 2024-09-17T01:01:51.004 INFO:tasks.workunit.client.0.smithi002.stdout:6/100: dread d2/f15 [0,4194304] 0 2024-09-17T01:01:51.008 INFO:tasks.workunit.client.0.smithi002.stdout:0/78: write dd/f13 [1094763,85669] 0 2024-09-17T01:01:51.008 INFO:tasks.workunit.client.0.smithi002.stdout:0/79: write dd/f13 [1660896,3354] 0 2024-09-17T01:01:51.008 INFO:tasks.workunit.client.0.smithi002.stdout:0/80: chown lc 32680 1 2024-09-17T01:01:51.008 INFO:tasks.workunit.client.0.smithi002.stdout:0/81: fdatasync f1 0 2024-09-17T01:01:51.008 INFO:tasks.workunit.client.0.smithi002.stdout:0/82: stat l7 0 2024-09-17T01:01:51.008 INFO:tasks.workunit.client.0.smithi002.stdout:0/83: chown c3 439 1 2024-09-17T01:01:51.008 INFO:tasks.workunit.client.0.smithi002.stdout:0/84: write f1 [200961,91298] 0 2024-09-17T01:01:51.009 INFO:tasks.workunit.client.0.smithi002.stdout:3/97: dwrite d0/fd [4194304,4194304] 0 2024-09-17T01:01:51.009 INFO:tasks.workunit.client.0.smithi002.stdout:3/98: creat d0/d3/d17/f20 x:0 0 0 2024-09-17T01:01:51.009 INFO:tasks.workunit.client.0.smithi002.stdout:3/99: readlink d0/l11 0 2024-09-17T01:01:51.015 INFO:tasks.workunit.client.0.smithi002.stdout:0/85: rmdir dd 39 2024-09-17T01:01:51.016 INFO:tasks.workunit.client.1.smithi099.stdout:7/194: dwrite d1/d1e/f13 [0,4194304] 0 2024-09-17T01:01:51.017 INFO:tasks.workunit.client.0.smithi002.stdout:8/134: dread d2/f12 [0,4194304] 0 2024-09-17T01:01:51.017 INFO:tasks.workunit.client.1.smithi099.stdout:8/142: read d0/d1f/f12 [6519874,270] 0 2024-09-17T01:01:51.019 INFO:tasks.workunit.client.1.smithi099.stdout:7/195: truncate d1/d1e/d12/f18 1686609 0 2024-09-17T01:01:51.019 INFO:tasks.workunit.client.1.smithi099.stdout:7/196: fsync d1/f11 0 2024-09-17T01:01:51.020 INFO:tasks.workunit.client.0.smithi002.stdout:8/135: unlink d2/d3/c14 0 2024-09-17T01:01:51.020 INFO:tasks.workunit.client.0.smithi002.stdout:8/136: write d2/d3/f11 [1039515,93802] 0 2024-09-17T01:01:51.024 INFO:tasks.workunit.client.0.smithi002.stdout:8/137: rename d2/d3/f24 to d2/d26/f33 0 2024-09-17T01:01:51.024 INFO:tasks.workunit.client.0.smithi002.stdout:8/138: fsync d2/fb 0 2024-09-17T01:01:51.026 INFO:tasks.workunit.client.0.smithi002.stdout:8/139: rename d2/f1e to d2/d9/f34 0 2024-09-17T01:01:51.027 INFO:tasks.workunit.client.0.smithi002.stdout:8/140: symlink d2/d30/l35 0 2024-09-17T01:01:51.029 INFO:tasks.workunit.client.0.smithi002.stdout:8/141: rename d2/f2e to d2/d26/d2b/f36 0 2024-09-17T01:01:51.029 INFO:tasks.workunit.client.0.smithi002.stdout:8/142: chown d2/d26/d2b/c31 990 1 2024-09-17T01:01:51.029 INFO:tasks.workunit.client.0.smithi002.stdout:8/143: readlink d2/d30/l35 0 2024-09-17T01:01:51.029 INFO:tasks.workunit.client.0.smithi002.stdout:8/144: chown d2/d9/f20 22 1 2024-09-17T01:01:51.031 INFO:tasks.workunit.client.0.smithi002.stdout:8/145: creat d2/f37 x:0 0 0 2024-09-17T01:01:51.031 INFO:tasks.workunit.client.0.smithi002.stdout:8/146: chown d2/d3/f19 167633036 1 2024-09-17T01:01:51.031 INFO:tasks.workunit.client.0.smithi002.stdout:8/147: truncate d2/d3/f1b 4288311 0 2024-09-17T01:01:51.031 INFO:tasks.workunit.client.0.smithi002.stdout:8/148: write d2/d26/d2b/f36 [621701,83387] 0 2024-09-17T01:01:51.031 INFO:tasks.workunit.client.0.smithi002.stdout:8/149: fdatasync d2/f37 0 2024-09-17T01:01:51.031 INFO:tasks.workunit.client.1.smithi099.stdout:8/143: dread d0/d4/f11 [0,4194304] 0 2024-09-17T01:01:51.032 INFO:tasks.workunit.client.0.smithi002.stdout:8/150: rmdir d2/d9/dd 39 2024-09-17T01:01:51.033 INFO:tasks.workunit.client.0.smithi002.stdout:8/151: creat d2/d9/f38 x:0 0 0 2024-09-17T01:01:51.034 INFO:tasks.workunit.client.0.smithi002.stdout:8/152: symlink d2/d3/l39 0 2024-09-17T01:01:51.034 INFO:tasks.workunit.client.0.smithi002.stdout:8/153: chown d2/d30/l35 272546 1 2024-09-17T01:01:51.034 INFO:tasks.workunit.client.1.smithi099.stdout:8/144: write d0/d4/f11 [2339536,124429] 0 2024-09-17T01:01:51.035 INFO:tasks.workunit.client.1.smithi099.stdout:8/145: write d0/d1f/f12 [124502,82112] 0 2024-09-17T01:01:51.036 INFO:tasks.workunit.client.0.smithi002.stdout:8/154: mknod d2/c3a 0 2024-09-17T01:01:51.036 INFO:tasks.workunit.client.0.smithi002.stdout:8/155: dread - d2/d26/f33 zero size 2024-09-17T01:01:51.044 INFO:tasks.workunit.client.1.smithi099.stdout:2/152: dwrite d2/d9/d25/d26/f2b [0,4194304] 0 2024-09-17T01:01:51.044 INFO:tasks.workunit.client.1.smithi099.stdout:2/153: chown d2/lf 2340859 1 2024-09-17T01:01:51.045 INFO:tasks.workunit.client.1.smithi099.stdout:2/154: creat d2/d9/d25/f2e x:0 0 0 2024-09-17T01:01:51.045 INFO:tasks.workunit.client.0.smithi002.stdout:5/103: dwrite d2/f9 [0,4194304] 0 2024-09-17T01:01:51.045 INFO:tasks.workunit.client.1.smithi099.stdout:0/112: rmdir da 39 2024-09-17T01:01:51.046 INFO:tasks.workunit.client.0.smithi002.stdout:5/104: mkdir d2/dc/dd/d10/d14/d19 0 2024-09-17T01:01:51.047 INFO:tasks.workunit.client.0.smithi002.stdout:5/105: creat d2/de/f1a x:0 0 0 2024-09-17T01:01:51.047 INFO:tasks.workunit.client.1.smithi099.stdout:6/239: dwrite dc/d2b/f2c [0,4194304] 0 2024-09-17T01:01:51.049 INFO:tasks.workunit.client.1.smithi099.stdout:2/155: truncate d2/d7/fe 665640 0 2024-09-17T01:01:51.050 INFO:tasks.workunit.client.1.smithi099.stdout:6/240: link dc/d2b/f4b dc/d1a/d49/f4d 0 2024-09-17T01:01:51.050 INFO:tasks.workunit.client.1.smithi099.stdout:6/241: readlink dc/l13 0 2024-09-17T01:01:51.052 INFO:tasks.workunit.client.1.smithi099.stdout:6/242: rename dc/d27/l2f to dc/l4e 0 2024-09-17T01:01:51.053 INFO:tasks.workunit.client.1.smithi099.stdout:6/243: symlink dc/d1a/d49/l4f 0 2024-09-17T01:01:51.053 INFO:tasks.workunit.client.1.smithi099.stdout:6/244: getdents dc/d1a 0 2024-09-17T01:01:51.058 INFO:tasks.workunit.client.0.smithi002.stdout:1/105: dwrite d4/d11/d12/d14/f1b [0,4194304] 0 2024-09-17T01:01:51.059 INFO:tasks.workunit.client.0.smithi002.stdout:1/106: chown d4/d11/d1c/l1d 321198 1 2024-09-17T01:01:51.059 INFO:tasks.workunit.client.0.smithi002.stdout:1/107: chown d4/f18 129 1 2024-09-17T01:01:51.059 INFO:tasks.workunit.client.0.smithi002.stdout:1/108: truncate d4/d11/d1c/f1f 782786 0 2024-09-17T01:01:51.059 INFO:tasks.workunit.client.0.smithi002.stdout:1/109: creat d4/d11/d12/d14/f2b x:0 0 0 2024-09-17T01:01:51.059 INFO:tasks.workunit.client.1.smithi099.stdout:0/113: dread f7 [4194304,4194304] 0 2024-09-17T01:01:51.059 INFO:tasks.workunit.client.1.smithi099.stdout:1/233: dwrite d0/f36 [0,4194304] 0 2024-09-17T01:01:51.060 INFO:tasks.workunit.client.0.smithi002.stdout:6/101: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:01:51.060 INFO:tasks.workunit.client.0.smithi002.stdout:3/100: dwrite d0/d3/f1a [0,4194304] 0 2024-09-17T01:01:51.061 INFO:tasks.workunit.client.1.smithi099.stdout:7/197: dwrite d1/d1e/f20 [4194304,4194304] 0 2024-09-17T01:01:51.063 INFO:tasks.workunit.client.1.smithi099.stdout:0/114: creat da/d1c/d1e/f24 x:0 0 0 2024-09-17T01:01:51.064 INFO:tasks.workunit.client.0.smithi002.stdout:6/102: creat d2/dc/f20 x:0 0 0 2024-09-17T01:01:51.065 INFO:tasks.workunit.client.1.smithi099.stdout:1/234: mkdir d0/d8/d49/d4e 0 2024-09-17T01:01:51.065 INFO:tasks.workunit.client.0.smithi002.stdout:5/106: dread d2/f9 [0,4194304] 0 2024-09-17T01:01:51.065 INFO:tasks.workunit.client.0.smithi002.stdout:1/110: dread d4/d11/d1c/f1f [0,4194304] 0 2024-09-17T01:01:51.070 INFO:tasks.workunit.client.1.smithi099.stdout:4/129: sync 2024-09-17T01:01:51.070 INFO:tasks.workunit.client.1.smithi099.stdout:5/240: sync 2024-09-17T01:01:51.070 INFO:tasks.workunit.client.1.smithi099.stdout:4/130: dread - d7/dd/de/f14 zero size 2024-09-17T01:01:51.070 INFO:tasks.workunit.client.1.smithi099.stdout:4/131: creat d7/dd/de/d10/d1a/f2d x:0 0 0 2024-09-17T01:01:51.070 INFO:tasks.workunit.client.1.smithi099.stdout:4/132: readlink d7/dd/l15 0 2024-09-17T01:01:51.070 INFO:tasks.workunit.client.1.smithi099.stdout:4/133: chown d7/dd/d21/d26 5270480 1 2024-09-17T01:01:51.071 INFO:tasks.workunit.client.1.smithi099.stdout:5/241: mknod d2/d45/c51 0 2024-09-17T01:01:51.071 INFO:tasks.workunit.client.1.smithi099.stdout:5/242: chown d2 198 1 2024-09-17T01:01:51.071 INFO:tasks.workunit.client.1.smithi099.stdout:5/243: write d2/dc/d14/f4f [81735,53165] 0 2024-09-17T01:01:51.071 INFO:tasks.workunit.client.1.smithi099.stdout:5/244: fsync d2/dc/d14/d19/f4b 0 2024-09-17T01:01:51.072 INFO:tasks.workunit.client.1.smithi099.stdout:5/245: write d2/f3 [878497,72662] 0 2024-09-17T01:01:51.072 INFO:tasks.workunit.client.0.smithi002.stdout:5/107: dread d2/dc/dd/f18 [4194304,4194304] 0 2024-09-17T01:01:51.072 INFO:tasks.workunit.client.1.smithi099.stdout:5/246: write d2/d8/f35 [192156,42265] 0 2024-09-17T01:01:51.072 INFO:tasks.workunit.client.1.smithi099.stdout:5/247: creat d2/dc/d17/f52 x:0 0 0 2024-09-17T01:01:51.074 INFO:tasks.workunit.client.1.smithi099.stdout:4/134: creat d7/dd/de/d10/d18/f2e x:0 0 0 2024-09-17T01:01:51.077 INFO:tasks.workunit.client.1.smithi099.stdout:5/248: rename d2/fa to d2/dc/d17/f53 0 2024-09-17T01:01:51.078 INFO:tasks.workunit.client.0.smithi002.stdout:5/108: dread d2/f9 [0,4194304] 0 2024-09-17T01:01:51.083 INFO:tasks.workunit.client.1.smithi099.stdout:5/249: write f0 [2005477,48973] 0 2024-09-17T01:01:51.083 INFO:tasks.workunit.client.0.smithi002.stdout:3/101: getdents d0 0 2024-09-17T01:01:51.086 INFO:tasks.workunit.client.1.smithi099.stdout:7/198: dwrite d1/f24 [0,4194304] 0 2024-09-17T01:01:51.086 INFO:tasks.workunit.client.1.smithi099.stdout:0/115: dwrite f8 [0,4194304] 0 2024-09-17T01:01:51.088 INFO:tasks.workunit.client.1.smithi099.stdout:7/199: mkdir d1/d36 0 2024-09-17T01:01:51.089 INFO:tasks.workunit.client.0.smithi002.stdout:6/103: dwrite d2/f18 [0,4194304] 0 2024-09-17T01:01:51.090 INFO:tasks.workunit.client.0.smithi002.stdout:6/104: creat d2/dc/f21 x:0 0 0 2024-09-17T01:01:51.090 INFO:tasks.workunit.client.1.smithi099.stdout:0/116: symlink da/df/d1a/l25 0 2024-09-17T01:01:51.090 INFO:tasks.workunit.client.1.smithi099.stdout:0/117: chown da/df/d1a 1699 1 2024-09-17T01:01:51.090 INFO:tasks.workunit.client.0.smithi002.stdout:8/156: truncate d2/d3/f1b 397377 0 2024-09-17T01:01:51.091 INFO:tasks.workunit.client.1.smithi099.stdout:4/135: dread d7/dd/de/ff [8388608,4194304] 0 2024-09-17T01:01:51.093 INFO:tasks.workunit.client.0.smithi002.stdout:3/102: rmdir d0/d3 39 2024-09-17T01:01:51.095 INFO:tasks.workunit.client.1.smithi099.stdout:0/118: write f7 [4902656,78101] 0 2024-09-17T01:01:51.096 INFO:tasks.workunit.client.1.smithi099.stdout:0/119: chown da/d12/f18 2 1 2024-09-17T01:01:51.098 INFO:tasks.workunit.client.1.smithi099.stdout:0/120: write da/df/f15 [570368,111752] 0 2024-09-17T01:01:51.106 INFO:tasks.workunit.client.0.smithi002.stdout:8/157: mkdir d2/d1c/d3b 0 2024-09-17T01:01:51.107 INFO:tasks.workunit.client.0.smithi002.stdout:8/158: truncate d2/f1d 604949 0 2024-09-17T01:01:51.108 INFO:tasks.workunit.client.0.smithi002.stdout:8/159: chown d2/d1c/d28/c2a 31850218 1 2024-09-17T01:01:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:8/160: mkdir d2/d1c/d3c 0 2024-09-17T01:01:51.109 INFO:tasks.workunit.client.1.smithi099.stdout:0/121: dread f8 [0,4194304] 0 2024-09-17T01:01:51.110 INFO:tasks.workunit.client.0.smithi002.stdout:6/105: dwrite d2/f15 [0,4194304] 0 2024-09-17T01:01:51.110 INFO:tasks.workunit.client.0.smithi002.stdout:8/161: write d2/d9/f34 [901160,58070] 0 2024-09-17T01:01:51.110 INFO:tasks.workunit.client.1.smithi099.stdout:0/122: creat da/f26 x:0 0 0 2024-09-17T01:01:51.110 INFO:tasks.workunit.client.1.smithi099.stdout:0/123: creat da/f27 x:0 0 0 2024-09-17T01:01:51.114 INFO:tasks.workunit.client.0.smithi002.stdout:9/40: sync 2024-09-17T01:01:51.115 INFO:tasks.workunit.client.0.smithi002.stdout:6/106: creat d2/d6/f22 x:0 0 0 2024-09-17T01:01:51.115 INFO:tasks.workunit.client.0.smithi002.stdout:8/162: fdatasync d2/fb 0 2024-09-17T01:01:51.116 INFO:tasks.workunit.client.1.smithi099.stdout:7/200: dwrite d1/d1e/d12/f14 [4194304,4194304] 0 2024-09-17T01:01:51.116 INFO:tasks.workunit.client.1.smithi099.stdout:7/201: fsync d1/f25 0 2024-09-17T01:01:51.116 INFO:tasks.workunit.client.1.smithi099.stdout:7/202: readlink d1/l1f 0 2024-09-17T01:01:51.117 INFO:tasks.workunit.client.0.smithi002.stdout:6/107: unlink d2/c5 0 2024-09-17T01:01:51.117 INFO:tasks.workunit.client.0.smithi002.stdout:6/108: fdatasync d2/dc/f21 0 2024-09-17T01:01:51.117 INFO:tasks.workunit.client.1.smithi099.stdout:7/203: mkdir d1/d37 0 2024-09-17T01:01:51.118 INFO:tasks.workunit.client.1.smithi099.stdout:7/204: mknod d1/c38 0 2024-09-17T01:01:51.118 INFO:tasks.workunit.client.1.smithi099.stdout:7/205: fdatasync d1/d1e/d12/f14 0 2024-09-17T01:01:51.118 INFO:tasks.workunit.client.1.smithi099.stdout:7/206: readlink d1/d1e/d1c/l2e 0 2024-09-17T01:01:51.118 INFO:tasks.workunit.client.0.smithi002.stdout:8/163: mknod d2/d3/c3d 0 2024-09-17T01:01:51.119 INFO:tasks.workunit.client.0.smithi002.stdout:8/164: fsync d2/d9/f20 0 2024-09-17T01:01:51.121 INFO:tasks.workunit.client.0.smithi002.stdout:8/165: symlink d2/d30/l3e 0 2024-09-17T01:01:51.122 INFO:tasks.workunit.client.0.smithi002.stdout:6/109: read d2/f16 [614856,118883] 0 2024-09-17T01:01:51.123 INFO:tasks.workunit.client.0.smithi002.stdout:8/166: getdents d2/d26/d2b 0 2024-09-17T01:01:51.129 INFO:tasks.workunit.client.0.smithi002.stdout:9/41: dread d5/f9 [0,4194304] 0 2024-09-17T01:01:51.129 INFO:tasks.workunit.client.1.smithi099.stdout:4/136: dwrite f2 [8388608,4194304] 0 2024-09-17T01:01:51.129 INFO:tasks.workunit.client.0.smithi002.stdout:8/167: dread d2/d26/d2b/f36 [0,4194304] 0 2024-09-17T01:01:51.130 INFO:tasks.workunit.client.0.smithi002.stdout:9/42: dread f0 [4194304,4194304] 0 2024-09-17T01:01:51.130 INFO:tasks.workunit.client.0.smithi002.stdout:5/109: dwrite d2/f9 [4194304,4194304] 0 2024-09-17T01:01:51.130 INFO:tasks.workunit.client.0.smithi002.stdout:8/168: symlink d2/d9/dd/l3f 0 2024-09-17T01:01:51.131 INFO:tasks.workunit.client.0.smithi002.stdout:3/103: dwrite d0/d3/d17/f1c [4194304,4194304] 0 2024-09-17T01:01:51.131 INFO:tasks.workunit.client.0.smithi002.stdout:3/104: write d0/d3/f1a [4213512,23047] 0 2024-09-17T01:01:51.131 INFO:tasks.workunit.client.0.smithi002.stdout:3/105: stat d0/d3/f8 0 2024-09-17T01:01:51.132 INFO:tasks.workunit.client.0.smithi002.stdout:9/43: rmdir d5 39 2024-09-17T01:01:51.132 INFO:tasks.workunit.client.0.smithi002.stdout:9/44: chown d5/l6 771031 1 2024-09-17T01:01:51.132 INFO:tasks.workunit.client.1.smithi099.stdout:4/137: link f6 d7/dd/de/d1b/f2f 0 2024-09-17T01:01:51.132 INFO:tasks.workunit.client.1.smithi099.stdout:4/138: fdatasync d7/fc 0 2024-09-17T01:01:51.132 INFO:tasks.workunit.client.1.smithi099.stdout:4/139: creat d7/dd/f30 x:0 0 0 2024-09-17T01:01:51.133 INFO:tasks.workunit.client.0.smithi002.stdout:6/110: dread d2/f15 [0,4194304] 0 2024-09-17T01:01:51.134 INFO:tasks.workunit.client.1.smithi099.stdout:4/140: rmdir d7/dd/d21 39 2024-09-17T01:01:51.135 INFO:tasks.workunit.client.0.smithi002.stdout:6/111: dread d2/f19 [0,4194304] 0 2024-09-17T01:01:51.135 INFO:tasks.workunit.client.0.smithi002.stdout:8/169: dread d2/d3/f7 [0,4194304] 0 2024-09-17T01:01:51.135 INFO:tasks.workunit.client.0.smithi002.stdout:8/170: dread - d2/d26/f33 zero size 2024-09-17T01:01:51.135 INFO:tasks.workunit.client.0.smithi002.stdout:5/110: unlink d2/de/f11 0 2024-09-17T01:01:51.140 INFO:tasks.workunit.client.0.smithi002.stdout:3/106: creat d0/f21 x:0 0 0 2024-09-17T01:01:51.140 INFO:tasks.workunit.client.0.smithi002.stdout:6/112: dread d2/f16 [0,4194304] 0 2024-09-17T01:01:51.142 INFO:tasks.workunit.client.1.smithi099.stdout:0/124: dwrite da/f27 [0,4194304] 0 2024-09-17T01:01:51.142 INFO:tasks.workunit.client.0.smithi002.stdout:9/45: mknod d5/ca 0 2024-09-17T01:01:51.144 INFO:tasks.workunit.client.1.smithi099.stdout:0/125: creat da/df/f28 x:0 0 0 2024-09-17T01:01:51.144 INFO:tasks.workunit.client.0.smithi002.stdout:8/171: chown d2/c16 0 1 2024-09-17T01:01:51.145 INFO:tasks.workunit.client.0.smithi002.stdout:8/172: stat d2/c16 0 2024-09-17T01:01:51.147 INFO:tasks.workunit.client.0.smithi002.stdout:3/107: unlink d0/d3/d17/f1c 0 2024-09-17T01:01:51.147 INFO:tasks.workunit.client.0.smithi002.stdout:6/113: fsync d2/d6/f22 0 2024-09-17T01:01:51.147 INFO:tasks.workunit.client.0.smithi002.stdout:6/114: write d2/f16 [1705626,78818] 0 2024-09-17T01:01:51.147 INFO:tasks.workunit.client.0.smithi002.stdout:6/115: dread - d2/dc/f21 zero size 2024-09-17T01:01:51.147 INFO:tasks.workunit.client.0.smithi002.stdout:6/116: chown d2/dc/f21 7634 1 2024-09-17T01:01:51.149 INFO:tasks.workunit.client.0.smithi002.stdout:9/46: creat d5/fb x:0 0 0 2024-09-17T01:01:51.150 INFO:tasks.workunit.client.0.smithi002.stdout:3/108: symlink d0/d3/d17/l22 0 2024-09-17T01:01:51.153 INFO:tasks.workunit.client.0.smithi002.stdout:6/117: symlink d2/dc/l23 0 2024-09-17T01:01:51.153 INFO:tasks.workunit.client.0.smithi002.stdout:6/118: write d2/dc/f21 [491409,15742] 0 2024-09-17T01:01:51.153 INFO:tasks.workunit.client.0.smithi002.stdout:6/119: getdents d2/d1d 0 2024-09-17T01:01:51.154 INFO:tasks.workunit.client.0.smithi002.stdout:3/109: creat d0/f23 x:0 0 0 2024-09-17T01:01:51.155 INFO:tasks.workunit.client.0.smithi002.stdout:9/47: write f0 [414556,114350] 0 2024-09-17T01:01:51.155 INFO:tasks.workunit.client.0.smithi002.stdout:8/173: dread d2/d3/f19 [0,4194304] 0 2024-09-17T01:01:51.157 INFO:tasks.workunit.client.0.smithi002.stdout:6/120: getdents d2 0 2024-09-17T01:01:51.157 INFO:tasks.workunit.client.0.smithi002.stdout:5/111: dwrite d2/de/f1a [0,4194304] 0 2024-09-17T01:01:51.158 INFO:tasks.workunit.client.1.smithi099.stdout:4/141: dwrite d7/dd/de/d1b/f2f [0,4194304] 0 2024-09-17T01:01:51.159 INFO:tasks.workunit.client.0.smithi002.stdout:8/174: creat d2/d26/f40 x:0 0 0 2024-09-17T01:01:51.160 INFO:tasks.workunit.client.0.smithi002.stdout:8/175: write d2/d3/f11 [2101910,82124] 0 2024-09-17T01:01:51.160 INFO:tasks.workunit.client.1.smithi099.stdout:4/142: mknod d7/dd/de/d10/d1a/c31 0 2024-09-17T01:01:51.161 INFO:tasks.workunit.client.1.smithi099.stdout:4/143: rename d7/fa to d7/dd/d21/d26/f32 0 2024-09-17T01:01:51.162 INFO:tasks.workunit.client.1.smithi099.stdout:4/144: mknod d7/dd/d21/d26/c33 0 2024-09-17T01:01:51.162 INFO:tasks.workunit.client.0.smithi002.stdout:5/112: creat d2/dc/dd/d10/f1b x:0 0 0 2024-09-17T01:01:51.165 INFO:tasks.workunit.client.0.smithi002.stdout:3/110: rename d0/f14 to d0/d3/f24 0 2024-09-17T01:01:51.166 INFO:tasks.workunit.client.0.smithi002.stdout:8/176: mkdir d2/d41 0 2024-09-17T01:01:51.166 INFO:tasks.workunit.client.0.smithi002.stdout:6/121: write d2/f4 [2243744,41765] 0 2024-09-17T01:01:51.166 INFO:tasks.workunit.client.0.smithi002.stdout:4/136: sync 2024-09-17T01:01:51.170 INFO:tasks.workunit.client.0.smithi002.stdout:3/111: creat d0/d3/d6/f25 x:0 0 0 2024-09-17T01:01:51.170 INFO:tasks.workunit.client.0.smithi002.stdout:8/177: mknod d2/d30/c42 0 2024-09-17T01:01:51.171 INFO:tasks.workunit.client.0.smithi002.stdout:9/48: rmdir d5 39 2024-09-17T01:01:51.171 INFO:tasks.workunit.client.0.smithi002.stdout:9/49: readlink d5/l6 0 2024-09-17T01:01:51.172 INFO:tasks.workunit.client.1.smithi099.stdout:0/126: dwrite f7 [0,4194304] 0 2024-09-17T01:01:51.173 INFO:tasks.workunit.client.1.smithi099.stdout:0/127: creat da/df/d1a/f29 x:0 0 0 2024-09-17T01:01:51.174 INFO:tasks.workunit.client.0.smithi002.stdout:4/137: mknod d7/de/d23/c29 0 2024-09-17T01:01:51.175 INFO:tasks.workunit.client.1.smithi099.stdout:0/128: creat da/df/d1a/d23/f2a x:0 0 0 2024-09-17T01:01:51.175 INFO:tasks.workunit.client.0.smithi002.stdout:3/112: readlink d0/le 0 2024-09-17T01:01:51.175 INFO:tasks.workunit.client.0.smithi002.stdout:3/113: write d0/d3/d6/f25 [659619,94315] 0 2024-09-17T01:01:51.179 INFO:tasks.workunit.client.0.smithi002.stdout:8/178: creat d2/d1c/f43 x:0 0 0 2024-09-17T01:01:51.179 INFO:tasks.workunit.client.1.smithi099.stdout:0/129: mkdir da/d12/d2b 0 2024-09-17T01:01:51.180 INFO:tasks.workunit.client.1.smithi099.stdout:0/130: symlink da/df/d1a/d23/l2c 0 2024-09-17T01:01:51.180 INFO:tasks.workunit.client.0.smithi002.stdout:9/50: mkdir d5/dc 0 2024-09-17T01:01:51.180 INFO:tasks.workunit.client.0.smithi002.stdout:3/114: truncate d0/f16 1074533 0 2024-09-17T01:01:51.182 INFO:tasks.workunit.client.0.smithi002.stdout:9/51: symlink d5/dc/ld 0 2024-09-17T01:01:51.183 INFO:tasks.workunit.client.0.smithi002.stdout:5/113: dwrite d2/dc/dd/d10/f1b [0,4194304] 0 2024-09-17T01:01:51.183 INFO:tasks.workunit.client.0.smithi002.stdout:5/114: truncate d2/dc/dd/f13 4921180 0 2024-09-17T01:01:51.183 INFO:tasks.workunit.client.0.smithi002.stdout:5/115: stat d2/c5 0 2024-09-17T01:01:51.184 INFO:tasks.workunit.client.0.smithi002.stdout:9/52: creat d5/dc/fe x:0 0 0 2024-09-17T01:01:51.185 INFO:tasks.workunit.client.0.smithi002.stdout:9/53: write f0 [1808458,26187] 0 2024-09-17T01:01:51.185 INFO:tasks.workunit.client.0.smithi002.stdout:9/54: dread - d5/fb zero size 2024-09-17T01:01:51.185 INFO:tasks.workunit.client.0.smithi002.stdout:9/55: rename d5 to d5/dc/df 22 2024-09-17T01:01:51.187 INFO:tasks.workunit.client.0.smithi002.stdout:6/122: dwrite f1 [0,4194304] 0 2024-09-17T01:01:51.190 INFO:tasks.workunit.client.0.smithi002.stdout:3/115: link d0/c5 d0/c26 0 2024-09-17T01:01:51.191 INFO:tasks.workunit.client.0.smithi002.stdout:8/179: dread d2/d9/dd/f18 [0,4194304] 0 2024-09-17T01:01:51.191 INFO:tasks.workunit.client.0.smithi002.stdout:5/116: creat d2/dc/dd/d10/d14/d19/f1c x:0 0 0 2024-09-17T01:01:51.194 INFO:tasks.workunit.client.0.smithi002.stdout:4/138: dwrite d7/d19/f21 [0,4194304] 0 2024-09-17T01:01:51.194 INFO:tasks.workunit.client.0.smithi002.stdout:4/139: creat d7/de/f2a x:0 0 0 2024-09-17T01:01:51.194 INFO:tasks.workunit.client.0.smithi002.stdout:8/180: truncate d2/d3/f19 3062767 0 2024-09-17T01:01:51.194 INFO:tasks.workunit.client.0.smithi002.stdout:3/116: rmdir d0/d3/d17 39 2024-09-17T01:01:51.197 INFO:tasks.workunit.client.0.smithi002.stdout:4/140: mknod d7/de/d22/c2b 0 2024-09-17T01:01:51.198 INFO:tasks.workunit.client.0.smithi002.stdout:6/123: read d2/f1a [2954369,84291] 0 2024-09-17T01:01:51.198 INFO:tasks.workunit.client.0.smithi002.stdout:8/181: mknod d2/d1c/c44 0 2024-09-17T01:01:51.199 INFO:tasks.workunit.client.1.smithi099.stdout:0/131: dwrite da/d1c/d1e/f24 [0,4194304] 0 2024-09-17T01:01:51.199 INFO:tasks.workunit.client.1.smithi099.stdout:0/132: write da/f26 [8618,37222] 0 2024-09-17T01:01:51.200 INFO:tasks.workunit.client.0.smithi002.stdout:3/117: chown d0/fd 12255647 1 2024-09-17T01:01:51.200 INFO:tasks.workunit.client.0.smithi002.stdout:6/124: dread d2/f19 [0,4194304] 0 2024-09-17T01:01:51.201 INFO:tasks.workunit.client.1.smithi099.stdout:0/133: rename da/df/d1a/f1d to da/df/d1a/f2d 0 2024-09-17T01:01:51.201 INFO:tasks.workunit.client.1.smithi099.stdout:0/134: read - da/df/d1a/f29 zero size 2024-09-17T01:01:51.201 INFO:tasks.workunit.client.0.smithi002.stdout:8/182: mknod d2/d30/c45 0 2024-09-17T01:01:51.202 INFO:tasks.workunit.client.1.smithi099.stdout:0/135: unlink da/l17 0 2024-09-17T01:01:51.202 INFO:tasks.workunit.client.0.smithi002.stdout:5/117: read d2/de/f1a [2359010,35469] 0 2024-09-17T01:01:51.203 INFO:tasks.workunit.client.1.smithi099.stdout:0/136: symlink da/l2e 0 2024-09-17T01:01:51.204 INFO:tasks.workunit.client.0.smithi002.stdout:3/118: rename d0/d3/c1e to d0/d3/d17/c27 0 2024-09-17T01:01:51.204 INFO:tasks.workunit.client.0.smithi002.stdout:3/119: read - d0/f23 zero size 2024-09-17T01:01:51.205 INFO:tasks.workunit.client.0.smithi002.stdout:8/183: creat d2/d1c/d3c/f46 x:0 0 0 2024-09-17T01:01:51.205 INFO:tasks.workunit.client.1.smithi099.stdout:0/137: rmdir da/df/d1a/d23 39 2024-09-17T01:01:51.215 INFO:tasks.workunit.client.0.smithi002.stdout:9/56: getdents d5 0 2024-09-17T01:01:51.215 INFO:tasks.workunit.client.0.smithi002.stdout:9/57: write d5/dc/fe [662733,60167] 0 2024-09-17T01:01:51.215 INFO:tasks.workunit.client.0.smithi002.stdout:9/58: write f0 [3385258,44571] 0 2024-09-17T01:01:51.218 INFO:tasks.workunit.client.0.smithi002.stdout:6/125: rename d2/d6 to d2/dc/d24 0 2024-09-17T01:01:51.222 INFO:tasks.workunit.client.0.smithi002.stdout:9/59: rename d5/f9 to d5/f10 0 2024-09-17T01:01:51.223 INFO:tasks.workunit.client.0.smithi002.stdout:7/54: sync 2024-09-17T01:01:51.223 INFO:tasks.workunit.client.0.smithi002.stdout:2/112: sync 2024-09-17T01:01:51.223 INFO:tasks.workunit.client.0.smithi002.stdout:2/113: fdatasync f13 0 2024-09-17T01:01:51.223 INFO:tasks.workunit.client.0.smithi002.stdout:2/114: truncate d1b/f1e 902777 0 2024-09-17T01:01:51.223 INFO:tasks.workunit.client.0.smithi002.stdout:2/115: fsync f16 0 2024-09-17T01:01:51.223 INFO:tasks.workunit.client.0.smithi002.stdout:2/116: dread - d1b/d1d/f1f zero size 2024-09-17T01:01:51.224 INFO:tasks.workunit.client.0.smithi002.stdout:4/141: dwrite d7/de/f2a [0,4194304] 0 2024-09-17T01:01:51.225 INFO:tasks.workunit.client.0.smithi002.stdout:5/118: dwrite d2/fa [0,4194304] 0 2024-09-17T01:01:51.227 INFO:tasks.workunit.client.0.smithi002.stdout:6/126: creat d2/d1d/f25 x:0 0 0 2024-09-17T01:01:51.227 INFO:tasks.workunit.client.0.smithi002.stdout:6/127: fdatasync d2/f19 0 2024-09-17T01:01:51.227 INFO:tasks.workunit.client.0.smithi002.stdout:6/128: dread - d2/d1d/f25 zero size 2024-09-17T01:01:51.227 INFO:tasks.workunit.client.0.smithi002.stdout:6/129: truncate d2/f19 1063964 0 2024-09-17T01:01:51.231 INFO:tasks.workunit.client.0.smithi002.stdout:7/55: mkdir d1/d14 0 2024-09-17T01:01:51.235 INFO:tasks.workunit.client.1.smithi099.stdout:0/138: dwrite da/d12/f16 [0,4194304] 0 2024-09-17T01:01:51.235 INFO:tasks.workunit.client.0.smithi002.stdout:3/120: dwrite d0/f1f [0,4194304] 0 2024-09-17T01:01:51.235 INFO:tasks.workunit.client.0.smithi002.stdout:3/121: read - d0/f23 zero size 2024-09-17T01:01:51.235 INFO:tasks.workunit.client.0.smithi002.stdout:5/119: mkdir d2/de/d1d 0 2024-09-17T01:01:51.236 INFO:tasks.workunit.client.0.smithi002.stdout:7/56: creat d1/d14/f15 x:0 0 0 2024-09-17T01:01:51.238 INFO:tasks.workunit.client.0.smithi002.stdout:3/122: mknod d0/d3/d17/c28 0 2024-09-17T01:01:51.240 INFO:tasks.workunit.client.0.smithi002.stdout:7/57: dread d1/f11 [0,4194304] 0 2024-09-17T01:01:51.240 INFO:tasks.workunit.client.0.smithi002.stdout:4/142: truncate d7/d19/f1f 3594503 0 2024-09-17T01:01:51.242 INFO:tasks.workunit.client.0.smithi002.stdout:9/60: truncate f0 3955542 0 2024-09-17T01:01:51.243 INFO:tasks.workunit.client.0.smithi002.stdout:7/58: dread d1/f11 [0,4194304] 0 2024-09-17T01:01:51.245 INFO:tasks.workunit.client.0.smithi002.stdout:3/123: rmdir d0/d3/d6 39 2024-09-17T01:01:51.246 INFO:tasks.workunit.client.0.smithi002.stdout:3/124: read - d0/d3/d17/f20 zero size 2024-09-17T01:01:51.248 INFO:tasks.workunit.client.0.smithi002.stdout:7/59: symlink d1/l16 0 2024-09-17T01:01:51.248 INFO:tasks.workunit.client.0.smithi002.stdout:7/60: write d1/f8 [1262494,35495] 0 2024-09-17T01:01:51.248 INFO:tasks.workunit.client.0.smithi002.stdout:7/61: fdatasync d1/f6 0 2024-09-17T01:01:51.248 INFO:tasks.workunit.client.0.smithi002.stdout:7/62: creat d1/f17 x:0 0 0 2024-09-17T01:01:51.250 INFO:tasks.workunit.client.0.smithi002.stdout:3/125: link d0/d3/f19 d0/d3/d17/f29 0 2024-09-17T01:01:51.250 INFO:tasks.workunit.client.0.smithi002.stdout:3/126: write d0/d3/f8 [191059,116363] 0 2024-09-17T01:01:51.252 INFO:tasks.workunit.client.0.smithi002.stdout:7/63: symlink d1/l18 0 2024-09-17T01:01:51.252 INFO:tasks.workunit.client.0.smithi002.stdout:7/64: read - d1/f17 zero size 2024-09-17T01:01:51.253 INFO:tasks.workunit.client.0.smithi002.stdout:3/127: creat d0/d3/d17/f2a x:0 0 0 2024-09-17T01:01:51.253 INFO:tasks.workunit.client.0.smithi002.stdout:3/128: write d0/d3/d17/f2a [304587,23818] 0 2024-09-17T01:01:51.254 INFO:tasks.workunit.client.0.smithi002.stdout:7/65: symlink d1/l19 0 2024-09-17T01:01:51.254 INFO:tasks.workunit.client.0.smithi002.stdout:7/66: fsync d1/f5 0 2024-09-17T01:01:51.255 INFO:tasks.workunit.client.0.smithi002.stdout:3/129: symlink d0/d3/d6/l2b 0 2024-09-17T01:01:51.255 INFO:tasks.workunit.client.0.smithi002.stdout:3/130: creat d0/d3/d17/f2c x:0 0 0 2024-09-17T01:01:51.255 INFO:tasks.workunit.client.0.smithi002.stdout:3/131: write d0/f16 [1227745,58578] 0 2024-09-17T01:01:51.256 INFO:tasks.workunit.client.0.smithi002.stdout:7/67: mknod d1/d14/c1a 0 2024-09-17T01:01:51.261 INFO:tasks.workunit.client.0.smithi002.stdout:2/117: dwrite fe [0,4194304] 0 2024-09-17T01:01:51.261 INFO:tasks.workunit.client.0.smithi002.stdout:2/118: dread - f16 zero size 2024-09-17T01:01:51.261 INFO:tasks.workunit.client.0.smithi002.stdout:6/130: dwrite f1 [0,4194304] 0 2024-09-17T01:01:51.261 INFO:tasks.workunit.client.0.smithi002.stdout:5/120: dwrite d2/f6 [4194304,4194304] 0 2024-09-17T01:01:51.261 INFO:tasks.workunit.client.0.smithi002.stdout:5/121: chown d2/dc/dd/f18 2 1 2024-09-17T01:01:51.261 INFO:tasks.workunit.client.0.smithi002.stdout:5/122: write d2/dc/dd/d10/d14/d19/f1c [367960,72748] 0 2024-09-17T01:01:51.261 INFO:tasks.workunit.client.0.smithi002.stdout:2/119: unlink f1a 0 2024-09-17T01:01:51.262 INFO:tasks.workunit.client.0.smithi002.stdout:2/120: creat d1b/f22 x:0 0 0 2024-09-17T01:01:51.263 INFO:tasks.workunit.client.0.smithi002.stdout:5/123: mkdir d2/dc/dd/d10/d1e 0 2024-09-17T01:01:51.264 INFO:tasks.workunit.client.1.smithi099.stdout:0/139: dwrite da/f19 [0,4194304] 0 2024-09-17T01:01:51.270 INFO:tasks.workunit.client.0.smithi002.stdout:2/121: link l14 d1b/l23 0 2024-09-17T01:01:51.271 INFO:tasks.workunit.client.0.smithi002.stdout:2/122: chown d1b/d1d 28328 1 2024-09-17T01:01:51.271 INFO:tasks.workunit.client.0.smithi002.stdout:0/86: sync 2024-09-17T01:01:51.271 INFO:tasks.workunit.client.0.smithi002.stdout:9/61: read f0 [2125685,82086] 0 2024-09-17T01:01:51.271 INFO:tasks.workunit.client.0.smithi002.stdout:1/111: sync 2024-09-17T01:01:51.271 INFO:tasks.workunit.client.0.smithi002.stdout:1/112: chown d4/d11/d12/d14 148 1 2024-09-17T01:01:51.273 INFO:tasks.workunit.client.0.smithi002.stdout:2/123: link d1b/l21 d1b/d1d/l24 0 2024-09-17T01:01:51.274 INFO:tasks.workunit.client.0.smithi002.stdout:2/124: truncate d1b/d1d/f1f 895334 0 2024-09-17T01:01:51.274 INFO:tasks.workunit.client.0.smithi002.stdout:6/131: write d2/f13 [1946279,61713] 0 2024-09-17T01:01:51.276 INFO:tasks.workunit.client.0.smithi002.stdout:1/113: readlink d4/l5 0 2024-09-17T01:01:51.276 INFO:tasks.workunit.client.0.smithi002.stdout:5/124: dread d2/dc/dd/f13 [0,4194304] 0 2024-09-17T01:01:51.276 INFO:tasks.workunit.client.0.smithi002.stdout:1/114: truncate d4/d11/d12/d14/d17/f28 1046859 0 2024-09-17T01:01:51.276 INFO:tasks.workunit.client.0.smithi002.stdout:5/125: creat d2/de/f1f x:0 0 0 2024-09-17T01:01:51.276 INFO:tasks.workunit.client.0.smithi002.stdout:5/126: chown d2/dc/f16 11062015 1 2024-09-17T01:01:51.276 INFO:tasks.workunit.client.0.smithi002.stdout:7/68: dwrite d1/d14/f15 [0,4194304] 0 2024-09-17T01:01:51.279 INFO:tasks.workunit.client.0.smithi002.stdout:6/132: dread d2/f4 [0,4194304] 0 2024-09-17T01:01:51.285 INFO:tasks.workunit.client.0.smithi002.stdout:9/62: symlink d5/dc/l11 0 2024-09-17T01:01:51.289 INFO:tasks.workunit.client.0.smithi002.stdout:5/127: mkdir d2/dc/dd/d10/d20 0 2024-09-17T01:01:51.289 INFO:tasks.workunit.client.0.smithi002.stdout:5/128: chown d2/dc/dd/d10/d14/d19 5035 1 2024-09-17T01:01:51.289 INFO:tasks.workunit.client.0.smithi002.stdout:5/129: rename d2/dc/dd/d10 to d2/dc/dd/d10/d21 22 2024-09-17T01:01:51.290 INFO:tasks.workunit.client.0.smithi002.stdout:4/143: dwrite d7/d19/f1f [0,4194304] 0 2024-09-17T01:01:51.290 INFO:tasks.workunit.client.0.smithi002.stdout:4/144: chown d7/f12 33 1 2024-09-17T01:01:51.290 INFO:tasks.workunit.client.0.smithi002.stdout:4/145: chown d7/de/d22 1798659953 1 2024-09-17T01:01:51.294 INFO:tasks.workunit.client.0.smithi002.stdout:1/115: write d4/f6 [1357924,62774] 0 2024-09-17T01:01:51.294 INFO:tasks.workunit.client.0.smithi002.stdout:1/116: write d4/d11/f15 [493675,57399] 0 2024-09-17T01:01:51.295 INFO:tasks.workunit.client.0.smithi002.stdout:4/146: dread d7/f14 [0,4194304] 0 2024-09-17T01:01:51.298 INFO:tasks.workunit.client.0.smithi002.stdout:0/87: dwrite dd/f13 [0,4194304] 0 2024-09-17T01:01:51.299 INFO:tasks.workunit.client.0.smithi002.stdout:6/133: rmdir d2/d1d 39 2024-09-17T01:01:51.300 INFO:tasks.workunit.client.0.smithi002.stdout:6/134: write f1 [4662302,44778] 0 2024-09-17T01:01:51.300 INFO:tasks.workunit.client.0.smithi002.stdout:6/135: write f1 [4972849,57405] 0 2024-09-17T01:01:51.302 INFO:tasks.workunit.client.0.smithi002.stdout:0/88: creat dd/f15 x:0 0 0 2024-09-17T01:01:51.303 INFO:tasks.workunit.client.0.smithi002.stdout:5/130: getdents d2/dc/dd/d10/d14/d19 0 2024-09-17T01:01:51.303 INFO:tasks.workunit.client.0.smithi002.stdout:5/131: fdatasync d2/dc/dd/f17 0 2024-09-17T01:01:51.303 INFO:tasks.workunit.client.0.smithi002.stdout:6/136: truncate d2/f16 1202761 0 2024-09-17T01:01:51.304 INFO:tasks.workunit.client.0.smithi002.stdout:4/147: mknod d7/c2c 0 2024-09-17T01:01:51.304 INFO:tasks.workunit.client.0.smithi002.stdout:4/148: write d7/de/f2a [4720620,18962] 0 2024-09-17T01:01:51.304 INFO:tasks.workunit.client.1.smithi099.stdout:0/140: dwrite da/d1c/d1e/f24 [0,4194304] 0 2024-09-17T01:01:51.305 INFO:tasks.workunit.client.0.smithi002.stdout:0/89: mknod dd/c16 0 2024-09-17T01:01:51.305 INFO:tasks.workunit.client.1.smithi099.stdout:0/141: mkdir da/d1c/d1e/d2f 0 2024-09-17T01:01:51.306 INFO:tasks.workunit.client.1.smithi099.stdout:0/142: symlink da/d12/d2b/l30 0 2024-09-17T01:01:51.306 INFO:tasks.workunit.client.0.smithi002.stdout:5/132: creat d2/dc/dd/d10/d14/d19/f22 x:0 0 0 2024-09-17T01:01:51.307 INFO:tasks.workunit.client.0.smithi002.stdout:6/137: unlink d2/dc/c1c 0 2024-09-17T01:01:51.308 INFO:tasks.workunit.client.0.smithi002.stdout:4/149: mknod d7/de/d22/c2d 0 2024-09-17T01:01:51.309 INFO:tasks.workunit.client.0.smithi002.stdout:4/150: fsync d7/de/f15 0 2024-09-17T01:01:51.310 INFO:tasks.workunit.client.0.smithi002.stdout:0/90: mknod dd/c17 0 2024-09-17T01:01:51.312 INFO:tasks.workunit.client.0.smithi002.stdout:2/125: getdents d1b/d1d 0 2024-09-17T01:01:51.312 INFO:tasks.workunit.client.0.smithi002.stdout:2/126: write d1b/d1d/f1f [1563892,30292] 0 2024-09-17T01:01:51.314 INFO:tasks.workunit.client.0.smithi002.stdout:9/63: dwrite f0 [0,4194304] 0 2024-09-17T01:01:51.314 INFO:tasks.workunit.client.0.smithi002.stdout:6/138: mkdir d2/d1d/d26 0 2024-09-17T01:01:51.315 INFO:tasks.workunit.client.0.smithi002.stdout:6/139: truncate d2/f4 4433075 0 2024-09-17T01:01:51.317 INFO:tasks.workunit.client.0.smithi002.stdout:1/117: dwrite d4/d11/d12/d14/d17/f27 [0,4194304] 0 2024-09-17T01:01:51.317 INFO:tasks.workunit.client.0.smithi002.stdout:1/118: write d4/fc [1674357,7887] 0 2024-09-17T01:01:51.318 INFO:tasks.workunit.client.0.smithi002.stdout:4/151: write d7/f18 [3716896,61951] 0 2024-09-17T01:01:51.318 INFO:tasks.workunit.client.0.smithi002.stdout:7/69: dwrite f0 [0,4194304] 0 2024-09-17T01:01:51.318 INFO:tasks.workunit.client.0.smithi002.stdout:7/70: read - d1/f10 zero size 2024-09-17T01:01:51.319 INFO:tasks.workunit.client.0.smithi002.stdout:2/127: rename d1b/l23 to d1b/l25 0 2024-09-17T01:01:51.319 INFO:tasks.workunit.client.0.smithi002.stdout:2/128: creat d1b/f26 x:0 0 0 2024-09-17T01:01:51.319 INFO:tasks.workunit.client.0.smithi002.stdout:2/129: readlink d1b/l21 0 2024-09-17T01:01:51.322 INFO:tasks.workunit.client.0.smithi002.stdout:6/140: mkdir d2/d1d/d27 0 2024-09-17T01:01:51.328 INFO:tasks.workunit.client.0.smithi002.stdout:4/152: mkdir d7/d19/d2e 0 2024-09-17T01:01:51.329 INFO:tasks.workunit.client.0.smithi002.stdout:7/71: mknod d1/c1b 0 2024-09-17T01:01:51.329 INFO:tasks.workunit.client.0.smithi002.stdout:7/72: write d1/d14/f15 [5061806,99442] 0 2024-09-17T01:01:51.329 INFO:tasks.workunit.client.0.smithi002.stdout:7/73: chown d1/f11 6 1 2024-09-17T01:01:51.330 INFO:tasks.workunit.client.0.smithi002.stdout:4/153: read d7/de/f27 [73992,88502] 0 2024-09-17T01:01:51.330 INFO:tasks.workunit.client.0.smithi002.stdout:4/154: chown d7/c2c 693 1 2024-09-17T01:01:51.330 INFO:tasks.workunit.client.0.smithi002.stdout:4/155: truncate d7/d19/f1c 4867878 0 2024-09-17T01:01:51.332 INFO:tasks.workunit.client.0.smithi002.stdout:2/130: creat d1b/d1d/f27 x:0 0 0 2024-09-17T01:01:51.332 INFO:tasks.workunit.client.0.smithi002.stdout:2/131: dread - d1b/f26 zero size 2024-09-17T01:01:51.334 INFO:tasks.workunit.client.0.smithi002.stdout:6/141: rename d2/c11 to d2/d1d/d26/c28 0 2024-09-17T01:01:51.338 INFO:tasks.workunit.client.0.smithi002.stdout:4/156: creat d7/de/d23/f2f x:0 0 0 2024-09-17T01:01:51.338 INFO:tasks.workunit.client.0.smithi002.stdout:4/157: write d7/de/d22/f26 [972033,112574] 0 2024-09-17T01:01:51.339 INFO:tasks.workunit.client.1.smithi099.stdout:0/143: dwrite da/df/d1a/d23/f2a [0,4194304] 0 2024-09-17T01:01:51.340 INFO:tasks.workunit.client.0.smithi002.stdout:6/142: unlink d2/f1a 0 2024-09-17T01:01:51.341 INFO:tasks.workunit.client.0.smithi002.stdout:9/64: dwrite d5/f10 [4194304,4194304] 0 2024-09-17T01:01:51.342 INFO:tasks.workunit.client.0.smithi002.stdout:9/65: stat d5 0 2024-09-17T01:01:51.342 INFO:tasks.workunit.client.0.smithi002.stdout:1/119: dwrite d4/d11/f15 [0,4194304] 0 2024-09-17T01:01:51.342 INFO:tasks.workunit.client.1.smithi099.stdout:0/144: mkdir da/df/d31 0 2024-09-17T01:01:51.342 INFO:tasks.workunit.client.0.smithi002.stdout:7/74: rmdir d1/d14 39 2024-09-17T01:01:51.343 INFO:tasks.workunit.client.0.smithi002.stdout:7/75: chown d1/lf 32035 1 2024-09-17T01:01:51.344 INFO:tasks.workunit.client.0.smithi002.stdout:6/143: symlink d2/dc/l29 0 2024-09-17T01:01:51.344 INFO:tasks.workunit.client.0.smithi002.stdout:6/144: truncate f1 9404595 0 2024-09-17T01:01:51.344 INFO:tasks.workunit.client.0.smithi002.stdout:6/145: write d2/f13 [3173137,57063] 0 2024-09-17T01:01:51.344 INFO:tasks.workunit.client.0.smithi002.stdout:6/146: readlink d2/dc/l23 0 2024-09-17T01:01:51.344 INFO:tasks.workunit.client.0.smithi002.stdout:6/147: dread - d2/d1d/f25 zero size 2024-09-17T01:01:51.346 INFO:tasks.workunit.client.0.smithi002.stdout:5/133: fsync d2/dc/dd/d10/d14/d19/f22 0 2024-09-17T01:01:51.346 INFO:tasks.workunit.client.0.smithi002.stdout:5/134: write d2/dc/dd/d10/f1b [4849738,86335] 0 2024-09-17T01:01:51.347 INFO:tasks.workunit.client.0.smithi002.stdout:9/66: rmdir d5 39 2024-09-17T01:01:51.347 INFO:tasks.workunit.client.0.smithi002.stdout:9/67: chown d5 24 1 2024-09-17T01:01:51.348 INFO:tasks.workunit.client.0.smithi002.stdout:1/120: dread d4/fe [0,4194304] 0 2024-09-17T01:01:51.351 INFO:tasks.workunit.client.1.smithi099.stdout:0/145: dread da/f27 [0,4194304] 0 2024-09-17T01:01:51.351 INFO:tasks.workunit.client.1.smithi099.stdout:0/146: fsync da/df/d1a/d23/f2a 0 2024-09-17T01:01:51.352 INFO:tasks.workunit.client.1.smithi099.stdout:0/147: creat da/d1c/f32 x:0 0 0 2024-09-17T01:01:51.352 INFO:tasks.workunit.client.1.smithi099.stdout:0/148: stat da/d1c/d1e 0 2024-09-17T01:01:51.353 INFO:tasks.workunit.client.0.smithi002.stdout:5/135: mkdir d2/dc/dd/d10/d23 0 2024-09-17T01:01:51.353 INFO:tasks.workunit.client.0.smithi002.stdout:9/68: readlink d5/l8 0 2024-09-17T01:01:51.354 INFO:tasks.workunit.client.0.smithi002.stdout:1/121: mknod d4/d11/d1c/c2c 0 2024-09-17T01:01:51.357 INFO:tasks.workunit.client.0.smithi002.stdout:9/69: link c1 d5/dc/c12 0 2024-09-17T01:01:51.357 INFO:tasks.workunit.client.0.smithi002.stdout:9/70: creat d5/dc/f13 x:0 0 0 2024-09-17T01:01:51.357 INFO:tasks.workunit.client.0.smithi002.stdout:9/71: stat d5/dc/f13 0 2024-09-17T01:01:51.358 INFO:tasks.workunit.client.0.smithi002.stdout:1/122: symlink d4/d22/l2d 0 2024-09-17T01:01:51.359 INFO:tasks.workunit.client.0.smithi002.stdout:5/136: dread d2/dc/dd/f18 [4194304,4194304] 0 2024-09-17T01:01:51.359 INFO:tasks.workunit.client.0.smithi002.stdout:5/137: chown d2/f4 4875 1 2024-09-17T01:01:51.361 INFO:tasks.workunit.client.0.smithi002.stdout:7/76: rmdir d1 39 2024-09-17T01:01:51.363 INFO:tasks.workunit.client.0.smithi002.stdout:6/148: write f1 [2462157,32873] 0 2024-09-17T01:01:51.363 INFO:tasks.workunit.client.0.smithi002.stdout:4/158: dwrite d7/f14 [0,4194304] 0 2024-09-17T01:01:51.363 INFO:tasks.workunit.client.0.smithi002.stdout:4/159: truncate d7/f16 2147350 0 2024-09-17T01:01:51.363 INFO:tasks.workunit.client.0.smithi002.stdout:9/72: dread d5/dc/fe [0,4194304] 0 2024-09-17T01:01:51.363 INFO:tasks.workunit.client.0.smithi002.stdout:7/77: rmdir d1/d14 39 2024-09-17T01:01:51.363 INFO:tasks.workunit.client.0.smithi002.stdout:7/78: chown d1/l18 21818 1 2024-09-17T01:01:51.366 INFO:tasks.workunit.client.1.smithi099.stdout:0/149: dwrite da/d12/f18 [0,4194304] 0 2024-09-17T01:01:51.366 INFO:tasks.workunit.client.1.smithi099.stdout:0/150: readlink da/d12/d2b/l30 0 2024-09-17T01:01:51.367 INFO:tasks.workunit.client.1.smithi099.stdout:0/151: mknod da/df/d1a/c33 0 2024-09-17T01:01:51.368 INFO:tasks.workunit.client.0.smithi002.stdout:4/160: symlink d7/de/d23/l30 0 2024-09-17T01:01:51.368 INFO:tasks.workunit.client.1.smithi099.stdout:9/187: sync 2024-09-17T01:01:51.368 INFO:tasks.workunit.client.1.smithi099.stdout:0/152: unlink da/f19 0 2024-09-17T01:01:51.369 INFO:tasks.workunit.client.0.smithi002.stdout:9/73: truncate d5/fb 794659 0 2024-09-17T01:01:51.370 INFO:tasks.workunit.client.1.smithi099.stdout:0/153: creat da/df/d31/f34 x:0 0 0 2024-09-17T01:01:51.370 INFO:tasks.workunit.client.1.smithi099.stdout:0/154: fdatasync f8 0 2024-09-17T01:01:51.370 INFO:tasks.workunit.client.0.smithi002.stdout:7/79: rename d1/f10 to d1/d14/f1c 0 2024-09-17T01:01:51.371 INFO:tasks.workunit.client.1.smithi099.stdout:0/155: symlink da/l35 0 2024-09-17T01:01:51.372 INFO:tasks.workunit.client.1.smithi099.stdout:9/188: dread da/ff [0,4194304] 0 2024-09-17T01:01:51.373 INFO:tasks.workunit.client.0.smithi002.stdout:6/149: dread f1 [4194304,4194304] 0 2024-09-17T01:01:51.373 INFO:tasks.workunit.client.0.smithi002.stdout:6/150: readlink d2/dc/lf 0 2024-09-17T01:01:51.374 INFO:tasks.workunit.client.0.smithi002.stdout:4/161: getdents d7/d19 0 2024-09-17T01:01:51.376 INFO:tasks.workunit.client.0.smithi002.stdout:6/151: creat d2/d1d/d26/f2a x:0 0 0 2024-09-17T01:01:51.376 INFO:tasks.workunit.client.0.smithi002.stdout:6/152: creat d2/d1d/d26/f2b x:0 0 0 2024-09-17T01:01:51.380 INFO:tasks.workunit.client.0.smithi002.stdout:4/162: link d7/d19/f1c d7/de/d22/f31 0 2024-09-17T01:01:51.381 INFO:tasks.workunit.client.0.smithi002.stdout:4/163: write d7/de/d22/f31 [4793295,35055] 0 2024-09-17T01:01:51.381 INFO:tasks.workunit.client.0.smithi002.stdout:4/164: chown d7/de/f27 469 1 2024-09-17T01:01:51.381 INFO:tasks.workunit.client.0.smithi002.stdout:4/165: chown d7/de/d22 206569284 1 2024-09-17T01:01:51.382 INFO:tasks.workunit.client.0.smithi002.stdout:4/166: chown d7/lf 8361 1 2024-09-17T01:01:51.383 INFO:tasks.workunit.client.0.smithi002.stdout:5/138: dwrite d2/f9 [4194304,4194304] 0 2024-09-17T01:01:51.383 INFO:tasks.workunit.client.0.smithi002.stdout:6/153: dread d2/f13 [0,4194304] 0 2024-09-17T01:01:51.386 INFO:tasks.workunit.client.0.smithi002.stdout:5/139: mkdir d2/dc/dd/d10/d20/d24 0 2024-09-17T01:01:51.386 INFO:tasks.workunit.client.0.smithi002.stdout:5/140: chown d2/de/d1d 5678 1 2024-09-17T01:01:51.386 INFO:tasks.workunit.client.0.smithi002.stdout:5/141: fsync d2/dc/dd/d10/f1b 0 2024-09-17T01:01:51.386 INFO:tasks.workunit.client.0.smithi002.stdout:5/142: dread - d2/dc/dd/d10/d14/d19/f22 zero size 2024-09-17T01:01:51.386 INFO:tasks.workunit.client.0.smithi002.stdout:6/154: dread d2/f16 [0,4194304] 0 2024-09-17T01:01:51.386 INFO:tasks.workunit.client.0.smithi002.stdout:6/155: write f1 [1795547,71522] 0 2024-09-17T01:01:51.386 INFO:tasks.workunit.client.0.smithi002.stdout:6/156: write d2/dc/f20 [4632,119180] 0 2024-09-17T01:01:51.387 INFO:tasks.workunit.client.0.smithi002.stdout:6/157: write d2/d1d/d26/f2b [167607,88437] 0 2024-09-17T01:01:51.387 INFO:tasks.workunit.client.0.smithi002.stdout:9/74: dwrite d5/dc/fe [0,4194304] 0 2024-09-17T01:01:51.387 INFO:tasks.workunit.client.1.smithi099.stdout:0/156: write f7 [3847872,128359] 0 2024-09-17T01:01:51.387 INFO:tasks.workunit.client.1.smithi099.stdout:9/189: dread f4 [0,4194304] 0 2024-09-17T01:01:51.388 INFO:tasks.workunit.client.0.smithi002.stdout:5/143: mkdir d2/dc/dd/d10/d1e/d25 0 2024-09-17T01:01:51.390 INFO:tasks.workunit.client.0.smithi002.stdout:7/80: dwrite d1/d14/f1c [0,4194304] 0 2024-09-17T01:01:51.390 INFO:tasks.workunit.client.0.smithi002.stdout:6/158: getdents d2 0 2024-09-17T01:01:51.391 INFO:tasks.workunit.client.0.smithi002.stdout:6/159: write d2/dc/d24/f22 [239901,130486] 0 2024-09-17T01:01:51.391 INFO:tasks.workunit.client.1.smithi099.stdout:9/190: write da/ff [4017712,33328] 0 2024-09-17T01:01:51.392 INFO:tasks.workunit.client.0.smithi002.stdout:5/144: mknod d2/dc/dd/d10/d23/c26 0 2024-09-17T01:01:51.393 INFO:tasks.workunit.client.1.smithi099.stdout:9/191: symlink da/d21/d2a/l42 0 2024-09-17T01:01:51.394 INFO:tasks.workunit.client.0.smithi002.stdout:7/81: mkdir d1/d14/d1d 0 2024-09-17T01:01:51.394 INFO:tasks.workunit.client.0.smithi002.stdout:5/145: symlink d2/dc/dd/d10/l27 0 2024-09-17T01:01:51.395 INFO:tasks.workunit.client.1.smithi099.stdout:9/192: truncate f4 677358 0 2024-09-17T01:01:51.395 INFO:tasks.workunit.client.0.smithi002.stdout:7/82: symlink d1/l1e 0 2024-09-17T01:01:51.396 INFO:tasks.workunit.client.0.smithi002.stdout:5/146: symlink d2/dc/dd/d10/d14/l28 0 2024-09-17T01:01:51.398 INFO:tasks.workunit.client.0.smithi002.stdout:7/83: symlink d1/d14/l1f 0 2024-09-17T01:01:51.399 INFO:tasks.workunit.client.0.smithi002.stdout:4/167: dwrite d7/de/d22/f26 [0,4194304] 0 2024-09-17T01:01:51.400 INFO:tasks.workunit.client.1.smithi099.stdout:9/193: write f6 [843255,97192] 0 2024-09-17T01:01:51.400 INFO:tasks.workunit.client.0.smithi002.stdout:5/147: symlink d2/l29 0 2024-09-17T01:01:51.400 INFO:tasks.workunit.client.0.smithi002.stdout:5/148: creat d2/dc/f2a x:0 0 0 2024-09-17T01:01:51.402 INFO:tasks.workunit.client.1.smithi099.stdout:9/194: symlink da/d1b/d3a/l43 0 2024-09-17T01:01:51.403 INFO:tasks.workunit.client.1.smithi099.stdout:9/195: truncate da/ff 3180826 0 2024-09-17T01:01:51.403 INFO:tasks.workunit.client.0.smithi002.stdout:9/75: dread d5/dc/fe [0,4194304] 0 2024-09-17T01:01:51.403 INFO:tasks.workunit.client.1.smithi099.stdout:9/196: creat da/f44 x:0 0 0 2024-09-17T01:01:51.404 INFO:tasks.workunit.client.1.smithi099.stdout:9/197: truncate da/d21/f3b 587868 0 2024-09-17T01:01:51.404 INFO:tasks.workunit.client.1.smithi099.stdout:9/198: mknod da/d1b/d3a/c45 0 2024-09-17T01:01:51.405 INFO:tasks.workunit.client.1.smithi099.stdout:9/199: symlink da/d14/d40/l46 0 2024-09-17T01:01:51.405 INFO:tasks.workunit.client.1.smithi099.stdout:9/200: mkdir da/d21/d2a/d47 0 2024-09-17T01:01:51.406 INFO:tasks.workunit.client.1.smithi099.stdout:9/201: write da/f44 [587448,18006] 0 2024-09-17T01:01:51.407 INFO:tasks.workunit.client.0.smithi002.stdout:9/76: creat d5/f14 x:0 0 0 2024-09-17T01:01:51.408 INFO:tasks.workunit.client.1.smithi099.stdout:0/157: dwrite da/f1b [0,4194304] 0 2024-09-17T01:01:51.409 INFO:tasks.workunit.client.0.smithi002.stdout:9/77: unlink f2 0 2024-09-17T01:01:51.409 INFO:tasks.workunit.client.1.smithi099.stdout:0/158: mknod da/d12/d2b/c36 0 2024-09-17T01:01:51.411 INFO:tasks.workunit.client.0.smithi002.stdout:6/160: dread f1 [4194304,4194304] 0 2024-09-17T01:01:51.413 INFO:tasks.workunit.client.0.smithi002.stdout:5/149: dread d2/de/f1a [0,4194304] 0 2024-09-17T01:01:51.413 INFO:tasks.workunit.client.0.smithi002.stdout:5/150: readlink d2/dc/dd/d10/d14/l28 0 2024-09-17T01:01:51.416 INFO:tasks.workunit.client.0.smithi002.stdout:6/161: dread d2/dc/f21 [0,4194304] 0 2024-09-17T01:01:51.416 INFO:tasks.workunit.client.0.smithi002.stdout:6/162: chown d2/dc/d24/ca 105505 1 2024-09-17T01:01:51.416 INFO:tasks.workunit.client.0.smithi002.stdout:6/163: dread - d2/d1d/d26/f2a zero size 2024-09-17T01:01:51.418 INFO:tasks.workunit.client.0.smithi002.stdout:6/164: mknod d2/dc/c2c 0 2024-09-17T01:01:51.420 INFO:tasks.workunit.client.0.smithi002.stdout:6/165: mkdir d2/d1d/d2d 0 2024-09-17T01:01:51.421 INFO:tasks.workunit.client.0.smithi002.stdout:6/166: getdents d2/dc/d24 0 2024-09-17T01:01:51.423 INFO:tasks.workunit.client.0.smithi002.stdout:4/168: dread d7/de/d22/f31 [0,4194304] 0 2024-09-17T01:01:51.423 INFO:tasks.workunit.client.0.smithi002.stdout:6/167: creat d2/d1d/d2d/f2e x:0 0 0 2024-09-17T01:01:51.423 INFO:tasks.workunit.client.0.smithi002.stdout:6/168: stat d2/f16 0 2024-09-17T01:01:51.425 INFO:tasks.workunit.client.0.smithi002.stdout:4/169: mkdir d7/de/d32 0 2024-09-17T01:01:51.425 INFO:tasks.workunit.client.0.smithi002.stdout:7/84: dwrite d1/f6 [0,4194304] 0 2024-09-17T01:01:51.425 INFO:tasks.workunit.client.0.smithi002.stdout:7/85: chown d1/d14/f15 18292 1 2024-09-17T01:01:51.426 INFO:tasks.workunit.client.0.smithi002.stdout:4/170: creat d7/d19/d2e/f33 x:0 0 0 2024-09-17T01:01:51.427 INFO:tasks.workunit.client.1.smithi099.stdout:9/202: truncate f4 560598 0 2024-09-17T01:01:51.427 INFO:tasks.workunit.client.1.smithi099.stdout:9/203: getdents da/d1b/d3a 0 2024-09-17T01:01:51.431 INFO:tasks.workunit.client.1.smithi099.stdout:0/159: dwrite da/df/f28 [0,4194304] 0 2024-09-17T01:01:51.434 INFO:tasks.workunit.client.1.smithi099.stdout:0/160: getdents da/d1c/d1e 0 2024-09-17T01:01:51.434 INFO:tasks.workunit.client.1.smithi099.stdout:0/161: fsync da/d1c/f32 0 2024-09-17T01:01:51.434 INFO:tasks.workunit.client.1.smithi099.stdout:0/162: chown da/d1c/d1e/d2f 10 1 2024-09-17T01:01:51.436 INFO:tasks.workunit.client.1.smithi099.stdout:0/163: rename da/d1c/f32 to da/d12/d2b/f37 0 2024-09-17T01:01:51.437 INFO:tasks.workunit.client.1.smithi099.stdout:0/164: creat da/d1c/d1e/f38 x:0 0 0 2024-09-17T01:01:51.437 INFO:tasks.workunit.client.1.smithi099.stdout:0/165: creat da/df/d31/f39 x:0 0 0 2024-09-17T01:01:51.437 INFO:tasks.workunit.client.1.smithi099.stdout:0/166: chown da/df/l11 19 1 2024-09-17T01:01:51.438 INFO:tasks.workunit.client.0.smithi002.stdout:9/78: dwrite d5/f10 [0,4194304] 0 2024-09-17T01:01:51.438 INFO:tasks.workunit.client.0.smithi002.stdout:5/151: dwrite d2/dc/dd/f13 [0,4194304] 0 2024-09-17T01:01:51.438 INFO:tasks.workunit.client.0.smithi002.stdout:7/86: dread d1/d14/f15 [0,4194304] 0 2024-09-17T01:01:51.439 INFO:tasks.workunit.client.0.smithi002.stdout:5/152: rmdir d2/dc/dd/d10/d23 39 2024-09-17T01:01:51.439 INFO:tasks.workunit.client.0.smithi002.stdout:5/153: readlink d2/de/l15 0 2024-09-17T01:01:51.439 INFO:tasks.workunit.client.0.smithi002.stdout:6/169: dread d2/d1d/d26/f2b [0,4194304] 0 2024-09-17T01:01:51.440 INFO:tasks.workunit.client.1.smithi099.stdout:9/204: dread da/d14/f29 [0,4194304] 0 2024-09-17T01:01:51.441 INFO:tasks.workunit.client.0.smithi002.stdout:9/79: getdents d5/dc 0 2024-09-17T01:01:51.441 INFO:tasks.workunit.client.0.smithi002.stdout:9/80: write d5/dc/f13 [940471,35738] 0 2024-09-17T01:01:51.442 INFO:tasks.workunit.client.0.smithi002.stdout:6/170: mknod d2/dc/d24/c2f 0 2024-09-17T01:01:51.442 INFO:tasks.workunit.client.0.smithi002.stdout:6/171: getdents d2/d1d/d27 0 2024-09-17T01:01:51.442 INFO:tasks.workunit.client.1.smithi099.stdout:9/205: mkdir da/d14/d48 0 2024-09-17T01:01:51.443 INFO:tasks.workunit.client.0.smithi002.stdout:6/172: mkdir d2/d1d/d27/d30 0 2024-09-17T01:01:51.443 INFO:tasks.workunit.client.0.smithi002.stdout:6/173: write f1 [3024640,99930] 0 2024-09-17T01:01:51.445 INFO:tasks.workunit.client.0.smithi002.stdout:9/81: symlink d5/l15 0 2024-09-17T01:01:51.446 INFO:tasks.workunit.client.1.smithi099.stdout:9/206: write da/d14/f29 [3690620,83016] 0 2024-09-17T01:01:51.446 INFO:tasks.workunit.client.1.smithi099.stdout:9/207: fdatasync da/d14/f1a 0 2024-09-17T01:01:51.447 INFO:tasks.workunit.client.0.smithi002.stdout:7/87: write f0 [1353814,103979] 0 2024-09-17T01:01:51.447 INFO:tasks.workunit.client.0.smithi002.stdout:6/174: truncate d2/f13 2950435 0 2024-09-17T01:01:51.449 INFO:tasks.workunit.client.0.smithi002.stdout:6/175: dread d2/dc/f21 [0,4194304] 0 2024-09-17T01:01:51.450 INFO:tasks.workunit.client.0.smithi002.stdout:7/88: creat d1/f20 x:0 0 0 2024-09-17T01:01:51.450 INFO:tasks.workunit.client.0.smithi002.stdout:7/89: write d1/d14/f1c [5166232,121888] 0 2024-09-17T01:01:51.451 INFO:tasks.workunit.client.0.smithi002.stdout:6/176: creat d2/f31 x:0 0 0 2024-09-17T01:01:51.452 INFO:tasks.workunit.client.0.smithi002.stdout:7/90: mkdir d1/d14/d1d/d21 0 2024-09-17T01:01:51.453 INFO:tasks.workunit.client.0.smithi002.stdout:6/177: link d2/dc/d24/ce d2/d1d/d26/c32 0 2024-09-17T01:01:51.453 INFO:tasks.workunit.client.0.smithi002.stdout:6/178: dread - d2/d1d/d26/f2a zero size 2024-09-17T01:01:51.454 INFO:tasks.workunit.client.1.smithi099.stdout:0/167: dwrite da/d1c/d1e/f1f [0,4194304] 0 2024-09-17T01:01:51.456 INFO:tasks.workunit.client.1.smithi099.stdout:0/168: mknod da/d12/d22/c3a 0 2024-09-17T01:01:51.456 INFO:tasks.workunit.client.0.smithi002.stdout:7/91: unlink d1/d14/f1c 0 2024-09-17T01:01:51.459 INFO:tasks.workunit.client.0.smithi002.stdout:7/92: rename d1/d14/l1f to d1/d14/d1d/l22 0 2024-09-17T01:01:51.459 INFO:tasks.workunit.client.1.smithi099.stdout:9/208: dread da/d14/f29 [0,4194304] 0 2024-09-17T01:01:51.459 INFO:tasks.workunit.client.1.smithi099.stdout:9/209: write f6 [1237786,78249] 0 2024-09-17T01:01:51.460 INFO:tasks.workunit.client.0.smithi002.stdout:7/93: symlink d1/d14/d1d/d21/l23 0 2024-09-17T01:01:51.460 INFO:tasks.workunit.client.0.smithi002.stdout:9/82: dread d5/f10 [0,4194304] 0 2024-09-17T01:01:51.461 INFO:tasks.workunit.client.0.smithi002.stdout:7/94: mkdir d1/d24 0 2024-09-17T01:01:51.461 INFO:tasks.workunit.client.0.smithi002.stdout:7/95: chown d1/d14 1168677 1 2024-09-17T01:01:51.461 INFO:tasks.workunit.client.0.smithi002.stdout:7/96: fdatasync d1/d14/f15 0 2024-09-17T01:01:51.463 INFO:tasks.workunit.client.0.smithi002.stdout:9/83: unlink d5/dc/fe 0 2024-09-17T01:01:51.463 INFO:tasks.workunit.client.0.smithi002.stdout:9/84: fsync f0 0 2024-09-17T01:01:51.467 INFO:tasks.workunit.client.1.smithi099.stdout:4/145: sync 2024-09-17T01:01:51.467 INFO:tasks.workunit.client.1.smithi099.stdout:5/250: sync 2024-09-17T01:01:51.467 INFO:tasks.workunit.client.1.smithi099.stdout:8/146: sync 2024-09-17T01:01:51.467 INFO:tasks.workunit.client.1.smithi099.stdout:4/146: readlink d7/dd/de/d10/d18/l2a 0 2024-09-17T01:01:51.467 INFO:tasks.workunit.client.1.smithi099.stdout:4/147: stat d7/dd/d21 0 2024-09-17T01:01:51.468 INFO:tasks.workunit.client.1.smithi099.stdout:3/214: sync 2024-09-17T01:01:51.468 INFO:tasks.workunit.client.1.smithi099.stdout:3/215: dread - d9/d15/d18/f42 zero size 2024-09-17T01:01:51.468 INFO:tasks.workunit.client.1.smithi099.stdout:5/251: unlink d2/d45/f4c 0 2024-09-17T01:01:51.470 INFO:tasks.workunit.client.1.smithi099.stdout:8/147: unlink d0/d4/l1e 0 2024-09-17T01:01:51.470 INFO:tasks.workunit.client.1.smithi099.stdout:1/235: sync 2024-09-17T01:01:51.470 INFO:tasks.workunit.client.1.smithi099.stdout:2/156: sync 2024-09-17T01:01:51.470 INFO:tasks.workunit.client.1.smithi099.stdout:2/157: truncate d2/d9/d25/f2e 277156 0 2024-09-17T01:01:51.471 INFO:tasks.workunit.client.0.smithi002.stdout:7/97: write d1/d14/f15 [1903814,100299] 0 2024-09-17T01:01:51.472 INFO:tasks.workunit.client.1.smithi099.stdout:6/245: sync 2024-09-17T01:01:51.472 INFO:tasks.workunit.client.1.smithi099.stdout:7/207: sync 2024-09-17T01:01:51.472 INFO:tasks.workunit.client.1.smithi099.stdout:7/208: read - d1/f35 zero size 2024-09-17T01:01:51.472 INFO:tasks.workunit.client.1.smithi099.stdout:6/246: chown dc/f21 1897 1 2024-09-17T01:01:51.472 INFO:tasks.workunit.client.1.smithi099.stdout:6/247: chown dc/l15 0 1 2024-09-17T01:01:51.472 INFO:tasks.workunit.client.1.smithi099.stdout:5/252: creat d2/dc/d14/d19/f54 x:0 0 0 2024-09-17T01:01:51.472 INFO:tasks.workunit.client.1.smithi099.stdout:8/148: truncate d0/d4/fa 6449997 0 2024-09-17T01:01:51.473 INFO:tasks.workunit.client.1.smithi099.stdout:1/236: creat d0/d8/d4a/f4f x:0 0 0 2024-09-17T01:01:51.473 INFO:tasks.workunit.client.1.smithi099.stdout:5/253: dread d2/dc/d14/f20 [0,4194304] 0 2024-09-17T01:01:51.473 INFO:tasks.workunit.client.1.smithi099.stdout:2/158: mkdir d2/d9/d25/d2f 0 2024-09-17T01:01:51.475 INFO:tasks.workunit.client.0.smithi002.stdout:7/98: dread d1/f8 [0,4194304] 0 2024-09-17T01:01:51.475 INFO:tasks.workunit.client.0.smithi002.stdout:7/99: write d1/f5 [1248603,22733] 0 2024-09-17T01:01:51.476 INFO:tasks.workunit.client.1.smithi099.stdout:6/248: mknod dc/d1a/c50 0 2024-09-17T01:01:51.477 INFO:tasks.workunit.client.1.smithi099.stdout:0/169: dwrite da/f14 [0,4194304] 0 2024-09-17T01:01:51.481 INFO:tasks.workunit.client.1.smithi099.stdout:4/148: read d7/fc [6692936,71377] 0 2024-09-17T01:01:51.482 INFO:tasks.workunit.client.1.smithi099.stdout:9/210: dwrite da/d14/f29 [0,4194304] 0 2024-09-17T01:01:51.485 INFO:tasks.workunit.client.1.smithi099.stdout:8/149: symlink d0/d4/l24 0 2024-09-17T01:01:51.488 INFO:tasks.workunit.client.1.smithi099.stdout:1/237: rmdir d0/d2/d18 39 2024-09-17T01:01:51.489 INFO:tasks.workunit.client.1.smithi099.stdout:9/211: mkdir da/d18/d49 0 2024-09-17T01:01:51.489 INFO:tasks.workunit.client.1.smithi099.stdout:9/212: chown da/l16 963530 1 2024-09-17T01:01:51.490 INFO:tasks.workunit.client.1.smithi099.stdout:1/238: creat d0/d8/d49/d4e/f50 x:0 0 0 2024-09-17T01:01:51.491 INFO:tasks.workunit.client.1.smithi099.stdout:9/213: mknod da/d1b/d3a/c4a 0 2024-09-17T01:01:51.492 INFO:tasks.workunit.client.1.smithi099.stdout:1/239: truncate d0/d2/d18/f28 907386 0 2024-09-17T01:01:51.492 INFO:tasks.workunit.client.1.smithi099.stdout:1/240: chown d0/d2/d9/f30 68496163 1 2024-09-17T01:01:51.494 INFO:tasks.workunit.client.1.smithi099.stdout:1/241: mkdir d0/d2/d51 0 2024-09-17T01:01:51.495 INFO:tasks.workunit.client.1.smithi099.stdout:1/242: creat d0/d2/d18/f52 x:0 0 0 2024-09-17T01:01:51.500 INFO:tasks.workunit.client.1.smithi099.stdout:4/149: write f2 [12284893,32143] 0 2024-09-17T01:01:51.500 INFO:tasks.workunit.client.1.smithi099.stdout:4/150: creat d7/dd/de/d1b/f34 x:0 0 0 2024-09-17T01:01:51.500 INFO:tasks.workunit.client.1.smithi099.stdout:4/151: chown f6 198 1 2024-09-17T01:01:51.501 INFO:tasks.workunit.client.1.smithi099.stdout:6/249: dread dc/d1a/f26 [0,4194304] 0 2024-09-17T01:01:51.502 INFO:tasks.workunit.client.1.smithi099.stdout:4/152: mkdir d7/d35 0 2024-09-17T01:01:51.505 INFO:tasks.workunit.client.1.smithi099.stdout:7/209: dwrite d1/f10 [0,4194304] 0 2024-09-17T01:01:51.509 INFO:tasks.workunit.client.1.smithi099.stdout:7/210: truncate d1/d1e/d12/f16 285026 0 2024-09-17T01:01:51.509 INFO:tasks.workunit.client.1.smithi099.stdout:7/211: stat d1/f19 0 2024-09-17T01:01:51.509 INFO:tasks.workunit.client.1.smithi099.stdout:7/212: truncate d1/d1e/f13 4468568 0 2024-09-17T01:01:51.509 INFO:tasks.workunit.client.1.smithi099.stdout:7/213: dread - d1/d1e/d12/f29 zero size 2024-09-17T01:01:51.509 INFO:tasks.workunit.client.1.smithi099.stdout:3/216: dwrite d9/f12 [0,4194304] 0 2024-09-17T01:01:51.510 INFO:tasks.workunit.client.1.smithi099.stdout:3/217: mkdir d9/d3b/d44 0 2024-09-17T01:01:51.511 INFO:tasks.workunit.client.1.smithi099.stdout:2/159: dwrite d2/d9/d25/d26/f29 [0,4194304] 0 2024-09-17T01:01:51.511 INFO:tasks.workunit.client.1.smithi099.stdout:5/254: dwrite d2/dc/f42 [0,4194304] 0 2024-09-17T01:01:51.511 INFO:tasks.workunit.client.1.smithi099.stdout:5/255: dread - d2/d8/f49 zero size 2024-09-17T01:01:51.516 INFO:tasks.workunit.client.1.smithi099.stdout:5/256: rmdir d2/dc/d14/d36/d43 0 2024-09-17T01:01:51.518 INFO:tasks.workunit.client.1.smithi099.stdout:5/257: getdents d2/dc/d17/d3c 0 2024-09-17T01:01:51.519 INFO:tasks.workunit.client.1.smithi099.stdout:5/258: mknod d2/d8/c55 0 2024-09-17T01:01:51.519 INFO:tasks.workunit.client.1.smithi099.stdout:5/259: fdatasync d2/dc/d14/f16 0 2024-09-17T01:01:51.519 INFO:tasks.workunit.client.1.smithi099.stdout:0/170: dwrite da/f26 [0,4194304] 0 2024-09-17T01:01:51.520 INFO:tasks.workunit.client.1.smithi099.stdout:5/260: symlink d2/dc/d14/l56 0 2024-09-17T01:01:51.520 INFO:tasks.workunit.client.1.smithi099.stdout:5/261: write d2/dc/d17/d3c/f46 [624764,123129] 0 2024-09-17T01:01:51.521 INFO:tasks.workunit.client.1.smithi099.stdout:9/214: dwrite da/d1b/d3a/f26 [0,4194304] 0 2024-09-17T01:01:51.521 INFO:tasks.workunit.client.1.smithi099.stdout:8/150: dwrite d0/d1f/f12 [0,4194304] 0 2024-09-17T01:01:51.523 INFO:tasks.workunit.client.1.smithi099.stdout:0/171: mkdir da/d3b 0 2024-09-17T01:01:51.524 INFO:tasks.workunit.client.1.smithi099.stdout:3/218: write f3 [3076276,129888] 0 2024-09-17T01:01:51.525 INFO:tasks.workunit.client.1.smithi099.stdout:4/153: dwrite d7/dd/f30 [0,4194304] 0 2024-09-17T01:01:51.527 INFO:tasks.workunit.client.1.smithi099.stdout:5/262: getdents d2/dc/d14/d19 0 2024-09-17T01:01:51.530 INFO:tasks.workunit.client.1.smithi099.stdout:9/215: mkdir da/d1b/d3a/d4b 0 2024-09-17T01:01:51.532 INFO:tasks.workunit.client.1.smithi099.stdout:8/151: rename d0/d4/f1c to d0/f25 0 2024-09-17T01:01:51.532 INFO:tasks.workunit.client.1.smithi099.stdout:8/152: truncate d0/f23 841952 0 2024-09-17T01:01:51.535 INFO:tasks.workunit.client.1.smithi099.stdout:0/172: creat da/df/d1a/d23/f3c x:0 0 0 2024-09-17T01:01:51.542 INFO:tasks.workunit.client.1.smithi099.stdout:9/216: dread da/d14/f29 [0,4194304] 0 2024-09-17T01:01:51.542 INFO:tasks.workunit.client.1.smithi099.stdout:0/173: rmdir da/d1c/d1e/d2f 0 2024-09-17T01:01:51.543 INFO:tasks.workunit.client.1.smithi099.stdout:5/263: rmdir d2/d45 39 2024-09-17T01:01:51.543 INFO:tasks.workunit.client.1.smithi099.stdout:5/264: readlink d2/dc/d17/l4a 0 2024-09-17T01:01:51.543 INFO:tasks.workunit.client.1.smithi099.stdout:5/265: dread - d2/dc/d17/f3a zero size 2024-09-17T01:01:51.543 INFO:tasks.workunit.client.1.smithi099.stdout:5/266: chown d2/d26/f27 5 1 2024-09-17T01:01:51.544 INFO:tasks.workunit.client.1.smithi099.stdout:8/153: symlink d0/d4/l26 0 2024-09-17T01:01:51.544 INFO:tasks.workunit.client.1.smithi099.stdout:9/217: rmdir da/d21 39 2024-09-17T01:01:51.544 INFO:tasks.workunit.client.1.smithi099.stdout:9/218: write da/ff [3568225,62302] 0 2024-09-17T01:01:51.547 INFO:tasks.workunit.client.1.smithi099.stdout:5/267: mknod d2/dc/d14/c57 0 2024-09-17T01:01:51.547 INFO:tasks.workunit.client.1.smithi099.stdout:5/268: chown d2/dc/d17/d3c/c3d 234 1 2024-09-17T01:01:51.549 INFO:tasks.workunit.client.1.smithi099.stdout:9/219: mkdir da/d14/d40/d4c 0 2024-09-17T01:01:51.549 INFO:tasks.workunit.client.1.smithi099.stdout:9/220: chown da/d21 126 1 2024-09-17T01:01:51.549 INFO:tasks.workunit.client.1.smithi099.stdout:0/174: rmdir da/df/d31 39 2024-09-17T01:01:51.550 INFO:tasks.workunit.client.1.smithi099.stdout:0/175: creat da/d1c/f3d x:0 0 0 2024-09-17T01:01:51.550 INFO:tasks.workunit.client.1.smithi099.stdout:0/176: readlink da/df/l11 0 2024-09-17T01:01:51.551 INFO:tasks.workunit.client.1.smithi099.stdout:5/269: symlink d2/l58 0 2024-09-17T01:01:51.554 INFO:tasks.workunit.client.1.smithi099.stdout:5/270: unlink d2/dc/d14/c57 0 2024-09-17T01:01:51.570 INFO:tasks.workunit.client.1.smithi099.stdout:6/250: dwrite dc/d2b/f2c [4194304,4194304] 0 2024-09-17T01:01:51.572 INFO:tasks.workunit.client.1.smithi099.stdout:1/243: dread d0/d2/d18/f28 [0,4194304] 0 2024-09-17T01:01:51.573 INFO:tasks.workunit.client.1.smithi099.stdout:2/160: dwrite d2/f1a [0,4194304] 0 2024-09-17T01:01:51.573 INFO:tasks.workunit.client.1.smithi099.stdout:0/177: write da/f14 [477137,75123] 0 2024-09-17T01:01:51.573 INFO:tasks.workunit.client.1.smithi099.stdout:6/251: rename dc/d1a/c37 to dc/d2b/d3f/c51 0 2024-09-17T01:01:51.574 INFO:tasks.workunit.client.1.smithi099.stdout:1/244: mknod d0/d8/d49/c53 0 2024-09-17T01:01:51.575 INFO:tasks.workunit.client.1.smithi099.stdout:3/219: dwrite d9/d15/d18/f37 [0,4194304] 0 2024-09-17T01:01:51.576 INFO:tasks.workunit.client.1.smithi099.stdout:4/154: dwrite d7/dd/f12 [0,4194304] 0 2024-09-17T01:01:51.576 INFO:tasks.workunit.client.1.smithi099.stdout:6/252: symlink dc/d27/l52 0 2024-09-17T01:01:51.576 INFO:tasks.workunit.client.1.smithi099.stdout:1/245: truncate d0/d2/f24 3389462 0 2024-09-17T01:01:51.577 INFO:tasks.workunit.client.1.smithi099.stdout:9/221: dwrite da/d1b/d3a/f26 [4194304,4194304] 0 2024-09-17T01:01:51.577 INFO:tasks.workunit.client.1.smithi099.stdout:8/154: dwrite d0/f25 [0,4194304] 0 2024-09-17T01:01:51.577 INFO:tasks.workunit.client.1.smithi099.stdout:8/155: chown d0/d4/lc 114 1 2024-09-17T01:01:51.578 INFO:tasks.workunit.client.1.smithi099.stdout:8/156: dread d0/f1d [0,4194304] 0 2024-09-17T01:01:51.581 INFO:tasks.workunit.client.1.smithi099.stdout:9/222: write da/d14/f29 [2926105,126982] 0 2024-09-17T01:01:51.581 INFO:tasks.workunit.client.1.smithi099.stdout:9/223: stat da/d21/d2a/d47 0 2024-09-17T01:01:51.582 INFO:tasks.workunit.client.1.smithi099.stdout:0/178: dread da/f14 [0,4194304] 0 2024-09-17T01:01:51.584 INFO:tasks.workunit.client.1.smithi099.stdout:4/155: rename d7/dd/f30 to d7/d35/f36 0 2024-09-17T01:01:51.584 INFO:tasks.workunit.client.1.smithi099.stdout:4/156: write d7/dd/de/ff [3172497,21306] 0 2024-09-17T01:01:51.584 INFO:tasks.workunit.client.1.smithi099.stdout:4/157: creat d7/dd/de/d10/d1a/f37 x:0 0 0 2024-09-17T01:01:51.584 INFO:tasks.workunit.client.1.smithi099.stdout:4/158: chown d7/dd/de/d10/d1a/f2d 5 1 2024-09-17T01:01:51.584 INFO:tasks.workunit.client.1.smithi099.stdout:4/159: dread - d7/dd/f28 zero size 2024-09-17T01:01:51.584 INFO:tasks.workunit.client.1.smithi099.stdout:4/160: stat d7/dd/de/d17 0 2024-09-17T01:01:51.587 INFO:tasks.workunit.client.1.smithi099.stdout:3/220: write d9/d15/d18/f2a [410637,130210] 0 2024-09-17T01:01:51.589 INFO:tasks.workunit.client.1.smithi099.stdout:1/246: fdatasync d0/d2/f25 0 2024-09-17T01:01:51.589 INFO:tasks.workunit.client.1.smithi099.stdout:1/247: readlink d0/d8/l20 0 2024-09-17T01:01:51.589 INFO:tasks.workunit.client.1.smithi099.stdout:1/248: write d0/d8/f26 [368096,123030] 0 2024-09-17T01:01:51.589 INFO:tasks.workunit.client.1.smithi099.stdout:1/249: write d0/d8/f26 [589612,95917] 0 2024-09-17T01:01:51.589 INFO:tasks.workunit.client.1.smithi099.stdout:8/157: dread d0/d1f/f12 [4194304,4194304] 0 2024-09-17T01:01:51.589 INFO:tasks.workunit.client.1.smithi099.stdout:8/158: fdatasync d0/d4/fa 0 2024-09-17T01:01:51.589 INFO:tasks.workunit.client.1.smithi099.stdout:8/159: chown d0/f1d 7120 1 2024-09-17T01:01:51.589 INFO:tasks.workunit.client.1.smithi099.stdout:8/160: chown d0/d1f/c16 1966 1 2024-09-17T01:01:51.591 INFO:tasks.workunit.client.1.smithi099.stdout:6/253: dread dc/f18 [0,4194304] 0 2024-09-17T01:01:51.595 INFO:tasks.workunit.client.1.smithi099.stdout:9/224: symlink da/d14/d48/l4d 0 2024-09-17T01:01:51.596 INFO:tasks.workunit.client.1.smithi099.stdout:0/179: mknod da/df/d31/c3e 0 2024-09-17T01:01:51.598 INFO:tasks.workunit.client.1.smithi099.stdout:4/161: dread f6 [0,4194304] 0 2024-09-17T01:01:51.598 INFO:tasks.workunit.client.1.smithi099.stdout:4/162: chown d7/dd/de/d17 229420 1 2024-09-17T01:01:51.599 INFO:tasks.workunit.client.1.smithi099.stdout:1/250: dread d0/d2/d18/f28 [0,4194304] 0 2024-09-17T01:01:51.599 INFO:tasks.workunit.client.1.smithi099.stdout:1/251: chown d0/d2/d5/c45 15021 1 2024-09-17T01:01:51.601 INFO:tasks.workunit.client.1.smithi099.stdout:6/254: mkdir dc/d2b/d53 0 2024-09-17T01:01:51.601 INFO:tasks.workunit.client.1.smithi099.stdout:6/255: write dc/d2b/f2c [9335063,35582] 0 2024-09-17T01:01:51.601 INFO:tasks.workunit.client.1.smithi099.stdout:0/180: dread da/f14 [0,4194304] 0 2024-09-17T01:01:51.601 INFO:tasks.workunit.client.1.smithi099.stdout:0/181: write da/df/d1a/f2d [878990,29546] 0 2024-09-17T01:01:51.602 INFO:tasks.workunit.client.1.smithi099.stdout:9/225: symlink da/d14/d48/l4e 0 2024-09-17T01:01:51.602 INFO:tasks.workunit.client.1.smithi099.stdout:9/226: dread - da/d21/d2a/f36 zero size 2024-09-17T01:01:51.602 INFO:tasks.workunit.client.1.smithi099.stdout:2/161: truncate d2/f1a 2452375 0 2024-09-17T01:01:51.603 INFO:tasks.workunit.client.1.smithi099.stdout:3/221: getdents d9/d15/d18 0 2024-09-17T01:01:51.604 INFO:tasks.workunit.client.1.smithi099.stdout:3/222: fsync d9/d15/f34 0 2024-09-17T01:01:51.606 INFO:tasks.workunit.client.1.smithi099.stdout:9/227: mknod da/d14/d40/d4c/c4f 0 2024-09-17T01:01:51.606 INFO:tasks.workunit.client.1.smithi099.stdout:2/162: truncate d2/d7/fe 304379 0 2024-09-17T01:01:51.606 INFO:tasks.workunit.client.1.smithi099.stdout:2/163: fsync d2/d9/d25/f2e 0 2024-09-17T01:01:51.606 INFO:tasks.workunit.client.1.smithi099.stdout:2/164: creat d2/d9/d25/d26/f30 x:0 0 0 2024-09-17T01:01:51.606 INFO:tasks.workunit.client.1.smithi099.stdout:2/165: fdatasync f0 0 2024-09-17T01:01:51.606 INFO:tasks.workunit.client.1.smithi099.stdout:2/166: write d2/d9/d25/f2e [148771,92536] 0 2024-09-17T01:01:51.606 INFO:tasks.workunit.client.1.smithi099.stdout:2/167: write d2/d9/d25/f2e [1043630,72516] 0 2024-09-17T01:01:51.607 INFO:tasks.workunit.client.1.smithi099.stdout:9/228: dread da/f44 [0,4194304] 0 2024-09-17T01:01:51.608 INFO:tasks.workunit.client.1.smithi099.stdout:4/163: dread d7/d35/f36 [0,4194304] 0 2024-09-17T01:01:51.611 INFO:tasks.workunit.client.1.smithi099.stdout:1/252: rmdir d0 39 2024-09-17T01:01:51.612 INFO:tasks.workunit.client.1.smithi099.stdout:6/256: dread dc/f3e [0,4194304] 0 2024-09-17T01:01:51.612 INFO:tasks.workunit.client.1.smithi099.stdout:1/253: read d0/f13 [6692,43983] 0 2024-09-17T01:01:51.612 INFO:tasks.workunit.client.0.smithi002.stdout:3/132: sync 2024-09-17T01:01:51.613 INFO:tasks.workunit.client.0.smithi002.stdout:8/184: sync 2024-09-17T01:01:51.613 INFO:tasks.workunit.client.0.smithi002.stdout:3/133: truncate d0/d3/f8 476615 0 2024-09-17T01:01:51.614 INFO:tasks.workunit.client.1.smithi099.stdout:2/168: symlink d2/l31 0 2024-09-17T01:01:51.614 INFO:tasks.workunit.client.1.smithi099.stdout:2/169: chown d2/c2a 247386 1 2024-09-17T01:01:51.614 INFO:tasks.workunit.client.1.smithi099.stdout:2/170: read f0 [1473662,7511] 0 2024-09-17T01:01:51.614 INFO:tasks.workunit.client.1.smithi099.stdout:2/171: read d2/d9/d25/d26/f20 [523390,37239] 0 2024-09-17T01:01:51.614 INFO:tasks.workunit.client.1.smithi099.stdout:0/182: write da/d12/f18 [3053348,113561] 0 2024-09-17T01:01:51.615 INFO:tasks.workunit.client.0.smithi002.stdout:8/185: getdents d2/d1c/d28 0 2024-09-17T01:01:51.615 INFO:tasks.workunit.client.0.smithi002.stdout:3/134: rename d0/l1b to d0/l2d 0 2024-09-17T01:01:51.616 INFO:tasks.workunit.client.0.smithi002.stdout:3/135: readlink d0/d3/d17/l22 0 2024-09-17T01:01:51.616 INFO:tasks.workunit.client.0.smithi002.stdout:3/136: creat d0/d3/d17/f2e x:0 0 0 2024-09-17T01:01:51.616 INFO:tasks.workunit.client.0.smithi002.stdout:3/137: fsync d0/f23 0 2024-09-17T01:01:51.616 INFO:tasks.workunit.client.1.smithi099.stdout:4/164: creat d7/dd/d21/f38 x:0 0 0 2024-09-17T01:01:51.617 INFO:tasks.workunit.client.1.smithi099.stdout:3/223: dread d9/f25 [0,4194304] 0 2024-09-17T01:01:51.617 INFO:tasks.workunit.client.1.smithi099.stdout:8/161: dwrite d0/f23 [0,4194304] 0 2024-09-17T01:01:51.617 INFO:tasks.workunit.client.1.smithi099.stdout:8/162: chown d0/d4/l26 883 1 2024-09-17T01:01:51.619 INFO:tasks.workunit.client.1.smithi099.stdout:1/254: symlink d0/d2/de/l54 0 2024-09-17T01:01:51.619 INFO:tasks.workunit.client.1.smithi099.stdout:9/229: mkdir da/d50 0 2024-09-17T01:01:51.620 INFO:tasks.workunit.client.1.smithi099.stdout:9/230: read da/f2c [669702,99036] 0 2024-09-17T01:01:51.622 INFO:tasks.workunit.client.1.smithi099.stdout:3/224: mknod d9/d3b/d44/c45 0 2024-09-17T01:01:51.622 INFO:tasks.workunit.client.1.smithi099.stdout:6/257: write dc/d1a/f1b [3890645,127358] 0 2024-09-17T01:01:51.622 INFO:tasks.workunit.client.1.smithi099.stdout:6/258: fsync dc/f3e 0 2024-09-17T01:01:51.624 INFO:tasks.workunit.client.0.smithi002.stdout:3/138: dread d0/d3/f1a [0,4194304] 0 2024-09-17T01:01:51.628 INFO:tasks.workunit.client.1.smithi099.stdout:1/255: creat d0/f55 x:0 0 0 2024-09-17T01:01:51.633 INFO:tasks.workunit.client.1.smithi099.stdout:3/225: mknod d9/d3b/c46 0 2024-09-17T01:01:51.635 INFO:tasks.workunit.client.1.smithi099.stdout:6/259: mknod dc/d2b/d3f/c54 0 2024-09-17T01:01:51.635 INFO:tasks.workunit.client.1.smithi099.stdout:6/260: write dc/d27/f42 [223471,112751] 0 2024-09-17T01:01:51.635 INFO:tasks.workunit.client.1.smithi099.stdout:6/261: stat dc/d27/l52 0 2024-09-17T01:01:51.637 INFO:tasks.workunit.client.1.smithi099.stdout:1/256: mkdir d0/d8/d38/d56 0 2024-09-17T01:01:51.637 INFO:tasks.workunit.client.1.smithi099.stdout:1/257: readlink d0/d2/d9/l2f 0 2024-09-17T01:01:51.638 INFO:tasks.workunit.client.1.smithi099.stdout:9/231: truncate da/d21/f3b 585739 0 2024-09-17T01:01:51.640 INFO:tasks.workunit.client.1.smithi099.stdout:3/226: symlink d9/d15/d18/d1a/l47 0 2024-09-17T01:01:51.640 INFO:tasks.workunit.client.1.smithi099.stdout:6/262: mknod dc/d1a/d49/c55 0 2024-09-17T01:01:51.641 INFO:tasks.workunit.client.1.smithi099.stdout:1/258: rename d0/d2/d9/f48 to d0/d8/d38/d56/f57 0 2024-09-17T01:01:51.643 INFO:tasks.workunit.client.1.smithi099.stdout:9/232: mknod da/d18/c51 0 2024-09-17T01:01:51.643 INFO:tasks.workunit.client.1.smithi099.stdout:9/233: chown da/d21/l32 6511 1 2024-09-17T01:01:51.643 INFO:tasks.workunit.client.1.smithi099.stdout:9/234: write da/f44 [786150,104401] 0 2024-09-17T01:01:51.643 INFO:tasks.workunit.client.1.smithi099.stdout:3/227: rmdir d9/d2e 0 2024-09-17T01:01:51.643 INFO:tasks.workunit.client.1.smithi099.stdout:3/228: chown d9/c11 25947 1 2024-09-17T01:01:51.644 INFO:tasks.workunit.client.1.smithi099.stdout:9/235: link da/d21/l35 da/d18/l52 0 2024-09-17T01:01:51.645 INFO:tasks.workunit.client.1.smithi099.stdout:9/236: truncate f6 1276670 0 2024-09-17T01:01:51.652 INFO:tasks.workunit.client.1.smithi099.stdout:3/229: write d9/d15/d18/d1a/f1f [6830830,46038] 0 2024-09-17T01:01:51.652 INFO:tasks.workunit.client.1.smithi099.stdout:3/230: dread - d9/f30 zero size 2024-09-17T01:01:51.653 INFO:tasks.workunit.client.1.smithi099.stdout:3/231: creat d9/d3b/d44/f48 x:0 0 0 2024-09-17T01:01:51.654 INFO:tasks.workunit.client.1.smithi099.stdout:3/232: link d9/d2b/f2d d9/d15/d18/d1a/d23/f49 0 2024-09-17T01:01:51.659 INFO:tasks.workunit.client.1.smithi099.stdout:0/183: dwrite da/df/f28 [4194304,4194304] 0 2024-09-17T01:01:51.659 INFO:tasks.workunit.client.1.smithi099.stdout:8/163: dwrite d0/d4/f11 [0,4194304] 0 2024-09-17T01:01:51.660 INFO:tasks.workunit.client.1.smithi099.stdout:3/233: fsync d9/d15/d18/d1a/f1f 0 2024-09-17T01:01:51.661 INFO:tasks.workunit.client.1.smithi099.stdout:4/165: dwrite d7/dd/de/d1b/f34 [0,4194304] 0 2024-09-17T01:01:51.662 INFO:tasks.workunit.client.1.smithi099.stdout:0/184: rmdir da/d1c 39 2024-09-17T01:01:51.663 INFO:tasks.workunit.client.1.smithi099.stdout:8/164: getdents d0 0 2024-09-17T01:01:51.664 INFO:tasks.workunit.client.1.smithi099.stdout:9/237: dread da/f44 [0,4194304] 0 2024-09-17T01:01:51.666 INFO:tasks.workunit.client.1.smithi099.stdout:3/234: getdents d9/d2b 0 2024-09-17T01:01:51.666 INFO:tasks.workunit.client.1.smithi099.stdout:4/166: dread d7/dd/de/d10/d1a/f2c [0,4194304] 0 2024-09-17T01:01:51.666 INFO:tasks.workunit.client.1.smithi099.stdout:4/167: stat d7/dd 0 2024-09-17T01:01:51.666 INFO:tasks.workunit.client.1.smithi099.stdout:4/168: write d7/dd/d21/d26/f32 [4730159,44386] 0 2024-09-17T01:01:51.666 INFO:tasks.workunit.client.1.smithi099.stdout:4/169: write d7/dd/f28 [425461,37795] 0 2024-09-17T01:01:51.666 INFO:tasks.workunit.client.1.smithi099.stdout:4/170: write d7/dd/de/ff [13272384,114293] 0 2024-09-17T01:01:51.666 INFO:tasks.workunit.client.1.smithi099.stdout:8/165: mknod d0/d1f/c27 0 2024-09-17T01:01:51.667 INFO:tasks.workunit.client.1.smithi099.stdout:8/166: dread - d0/d1f/f14 zero size 2024-09-17T01:01:51.667 INFO:tasks.workunit.client.1.smithi099.stdout:4/171: link d7/f16 d7/dd/de/d1b/f39 0 2024-09-17T01:01:51.668 INFO:tasks.workunit.client.1.smithi099.stdout:8/167: symlink d0/d1f/l28 0 2024-09-17T01:01:51.669 INFO:tasks.workunit.client.1.smithi099.stdout:9/238: symlink da/l53 0 2024-09-17T01:01:51.670 INFO:tasks.workunit.client.1.smithi099.stdout:9/239: truncate da/d14/f1a 3913583 0 2024-09-17T01:01:51.671 INFO:tasks.workunit.client.1.smithi099.stdout:8/168: mkdir d0/d4/d29 0 2024-09-17T01:01:51.673 INFO:tasks.workunit.client.1.smithi099.stdout:9/240: unlink da/d1b/d3a/l38 0 2024-09-17T01:01:51.673 INFO:tasks.workunit.client.1.smithi099.stdout:8/169: mknod d0/c2a 0 2024-09-17T01:01:51.676 INFO:tasks.workunit.client.1.smithi099.stdout:9/241: creat da/d21/d2a/f54 x:0 0 0 2024-09-17T01:01:51.677 INFO:tasks.workunit.client.1.smithi099.stdout:8/170: rename d0/f25 to d0/d1f/f2b 0 2024-09-17T01:01:51.677 INFO:tasks.workunit.client.1.smithi099.stdout:9/242: rename da/d1b/d3a/c39 to da/d21/c55 0 2024-09-17T01:01:51.678 INFO:tasks.workunit.client.1.smithi099.stdout:8/171: creat d0/d1f/f2c x:0 0 0 2024-09-17T01:01:51.678 INFO:tasks.workunit.client.1.smithi099.stdout:6/263: write dc/f18 [4734335,109869] 0 2024-09-17T01:01:51.679 INFO:tasks.workunit.client.1.smithi099.stdout:6/264: creat dc/d1a/f56 x:0 0 0 2024-09-17T01:01:51.680 INFO:tasks.workunit.client.1.smithi099.stdout:6/265: mknod dc/c57 0 2024-09-17T01:01:51.686 INFO:tasks.workunit.client.1.smithi099.stdout:1/259: getdents d0/d8/d38 0 2024-09-17T01:01:51.686 INFO:tasks.workunit.client.1.smithi099.stdout:1/260: stat d0/d2/de/c19 0 2024-09-17T01:01:51.687 INFO:tasks.workunit.client.0.smithi002.stdout:3/139: dwrite d0/fd [4194304,4194304] 0 2024-09-17T01:01:51.688 INFO:tasks.workunit.client.0.smithi002.stdout:3/140: creat d0/f2f x:0 0 0 2024-09-17T01:01:51.688 INFO:tasks.workunit.client.0.smithi002.stdout:3/141: chown d0/d3 488505 1 2024-09-17T01:01:51.689 INFO:tasks.workunit.client.0.smithi002.stdout:3/142: unlink d0/l12 0 2024-09-17T01:01:51.689 INFO:tasks.workunit.client.1.smithi099.stdout:4/172: dwrite d7/dd/de/f29 [0,4194304] 0 2024-09-17T01:01:51.690 INFO:tasks.workunit.client.0.smithi002.stdout:3/143: rename d0/l2d to d0/d3/d6/l30 0 2024-09-17T01:01:51.691 INFO:tasks.workunit.client.0.smithi002.stdout:3/144: mkdir d0/d31 0 2024-09-17T01:01:51.691 INFO:tasks.workunit.client.0.smithi002.stdout:3/145: fsync d0/d3/d17/f2c 0 2024-09-17T01:01:51.692 INFO:tasks.workunit.client.0.smithi002.stdout:3/146: chown d0/d3/l9 8 1 2024-09-17T01:01:51.692 INFO:tasks.workunit.client.0.smithi002.stdout:3/147: readlink d0/d3/l7 0 2024-09-17T01:01:51.692 INFO:tasks.workunit.client.0.smithi002.stdout:3/148: chown d0/d3/d6 195529748 1 2024-09-17T01:01:51.692 INFO:tasks.workunit.client.1.smithi099.stdout:0/185: dwrite da/d12/f16 [0,4194304] 0 2024-09-17T01:01:51.693 INFO:tasks.workunit.client.1.smithi099.stdout:8/172: read d0/f18 [3653747,124051] 0 2024-09-17T01:01:51.694 INFO:tasks.workunit.client.1.smithi099.stdout:4/173: mkdir d7/dd/de/d10/d3a 0 2024-09-17T01:01:51.696 INFO:tasks.workunit.client.1.smithi099.stdout:0/186: truncate da/f26 1918987 0 2024-09-17T01:01:51.698 INFO:tasks.workunit.client.0.smithi002.stdout:3/149: rename d0/d3/d6 to d0/d31/d32 0 2024-09-17T01:01:51.699 INFO:tasks.workunit.client.1.smithi099.stdout:1/261: dread d0/d2/de/f15 [0,4194304] 0 2024-09-17T01:01:51.700 INFO:tasks.workunit.client.1.smithi099.stdout:1/262: fsync d0/d2/ff 0 2024-09-17T01:01:51.700 INFO:tasks.workunit.client.1.smithi099.stdout:1/263: write d0/d8/d38/d56/f57 [364037,62845] 0 2024-09-17T01:01:51.704 INFO:tasks.workunit.client.1.smithi099.stdout:4/174: symlink d7/dd/d21/d26/l3b 0 2024-09-17T01:01:51.705 INFO:tasks.workunit.client.1.smithi099.stdout:1/264: creat d0/d2/d5/f58 x:0 0 0 2024-09-17T01:01:51.707 INFO:tasks.workunit.client.1.smithi099.stdout:1/265: mkdir d0/d2/d9/d4b/d59 0 2024-09-17T01:01:51.709 INFO:tasks.workunit.client.1.smithi099.stdout:1/266: mkdir d0/d8/d49/d5a 0 2024-09-17T01:01:51.709 INFO:tasks.workunit.client.1.smithi099.stdout:1/267: stat d0/d2/d5/l1b 0 2024-09-17T01:01:51.710 INFO:tasks.workunit.client.1.smithi099.stdout:1/268: mknod d0/d2/d9/c5b 0 2024-09-17T01:01:51.714 INFO:tasks.workunit.client.1.smithi099.stdout:8/173: dwrite d0/f18 [4194304,4194304] 0 2024-09-17T01:01:51.714 INFO:tasks.workunit.client.1.smithi099.stdout:9/243: dwrite f6 [0,4194304] 0 2024-09-17T01:01:51.742 INFO:tasks.workunit.client.1.smithi099.stdout:9/244: dwrite da/d1b/d3a/f23 [0,4194304] 0 2024-09-17T01:01:51.743 INFO:tasks.workunit.client.1.smithi099.stdout:9/245: write da/d21/d2a/f54 [15496,91051] 0 2024-09-17T01:01:51.743 INFO:tasks.workunit.client.1.smithi099.stdout:4/175: dwrite f1 [4194304,4194304] 0 2024-09-17T01:01:51.743 INFO:tasks.workunit.client.0.smithi002.stdout:3/150: dwrite d0/d3/d17/f2c [0,4194304] 0 2024-09-17T01:01:51.744 INFO:tasks.workunit.client.0.smithi002.stdout:2/132: sync 2024-09-17T01:01:51.744 INFO:tasks.workunit.client.0.smithi002.stdout:9/85: sync 2024-09-17T01:01:51.744 INFO:tasks.workunit.client.0.smithi002.stdout:9/86: fdatasync f0 0 2024-09-17T01:01:51.744 INFO:tasks.workunit.client.0.smithi002.stdout:7/100: sync 2024-09-17T01:01:51.744 INFO:tasks.workunit.client.0.smithi002.stdout:0/91: sync 2024-09-17T01:01:51.744 INFO:tasks.workunit.client.0.smithi002.stdout:5/154: sync 2024-09-17T01:01:51.745 INFO:tasks.workunit.client.0.smithi002.stdout:5/155: rename d2/dc/dd/d10/d23 to d2/dc/dd/d10/d23/d2b 22 2024-09-17T01:01:51.745 INFO:tasks.workunit.client.0.smithi002.stdout:5/156: creat d2/f2c x:0 0 0 2024-09-17T01:01:51.745 INFO:tasks.workunit.client.0.smithi002.stdout:4/171: sync 2024-09-17T01:01:51.745 INFO:tasks.workunit.client.0.smithi002.stdout:4/172: chown d7/c1a 778 1 2024-09-17T01:01:51.748 INFO:tasks.workunit.client.0.smithi002.stdout:3/151: mkdir d0/d3/d33 0 2024-09-17T01:01:51.749 INFO:tasks.workunit.client.0.smithi002.stdout:9/87: getdents d5/dc 0 2024-09-17T01:01:51.752 INFO:tasks.workunit.client.1.smithi099.stdout:1/269: unlink d0/f55 0 2024-09-17T01:01:51.753 INFO:tasks.workunit.client.0.smithi002.stdout:3/152: getdents d0/d31/d32 0 2024-09-17T01:01:51.753 INFO:tasks.workunit.client.0.smithi002.stdout:3/153: chown d0/d31/d32 10469 1 2024-09-17T01:01:51.756 INFO:tasks.workunit.client.0.smithi002.stdout:7/101: write d1/f5 [744886,4653] 0 2024-09-17T01:01:51.757 INFO:tasks.workunit.client.0.smithi002.stdout:5/157: rename d2/dc/dd to d2/d2d 0 2024-09-17T01:01:51.757 INFO:tasks.workunit.client.0.smithi002.stdout:3/154: mknod d0/d31/c34 0 2024-09-17T01:01:51.758 INFO:tasks.workunit.client.0.smithi002.stdout:9/88: mknod d5/c16 0 2024-09-17T01:01:51.759 INFO:tasks.workunit.client.0.smithi002.stdout:1/123: sync 2024-09-17T01:01:51.759 INFO:tasks.workunit.client.0.smithi002.stdout:7/102: symlink d1/d14/d1d/l25 0 2024-09-17T01:01:51.759 INFO:tasks.workunit.client.0.smithi002.stdout:6/179: sync 2024-09-17T01:01:51.761 INFO:tasks.workunit.client.0.smithi002.stdout:5/158: creat d2/d2d/d10/d20/d24/f2e x:0 0 0 2024-09-17T01:01:51.761 INFO:tasks.workunit.client.0.smithi002.stdout:3/155: mkdir d0/d3/d17/d35 0 2024-09-17T01:01:51.762 INFO:tasks.workunit.client.0.smithi002.stdout:3/156: dread - d0/d3/d17/f20 zero size 2024-09-17T01:01:51.762 INFO:tasks.workunit.client.0.smithi002.stdout:3/157: dread - d0/f2f zero size 2024-09-17T01:01:51.762 INFO:tasks.workunit.client.0.smithi002.stdout:3/158: chown d0/c5 10 1 2024-09-17T01:01:51.763 INFO:tasks.workunit.client.0.smithi002.stdout:6/180: mknod d2/d1d/d27/c33 0 2024-09-17T01:01:51.765 INFO:tasks.workunit.client.0.smithi002.stdout:5/159: symlink d2/d2d/l2f 0 2024-09-17T01:01:51.765 INFO:tasks.workunit.client.1.smithi099.stdout:8/174: mknod d0/d4/c2d 0 2024-09-17T01:01:51.766 INFO:tasks.workunit.client.0.smithi002.stdout:3/159: mknod d0/d3/d17/c36 0 2024-09-17T01:01:51.767 INFO:tasks.workunit.client.1.smithi099.stdout:8/175: read d0/f1d [377908,105600] 0 2024-09-17T01:01:51.767 INFO:tasks.workunit.client.0.smithi002.stdout:6/181: mkdir d2/dc/d34 0 2024-09-17T01:01:51.768 INFO:tasks.workunit.client.0.smithi002.stdout:5/160: rmdir d2/d2d/d10/d1e 39 2024-09-17T01:01:51.768 INFO:tasks.workunit.client.0.smithi002.stdout:5/161: stat d2/f9 0 2024-09-17T01:01:51.768 INFO:tasks.workunit.client.0.smithi002.stdout:5/162: write d2/d2d/f17 [41632,41632] 0 2024-09-17T01:01:51.769 INFO:tasks.workunit.client.1.smithi099.stdout:8/176: rename d0/d4/fa to d0/d4/d29/f2e 0 2024-09-17T01:01:51.769 INFO:tasks.workunit.client.0.smithi002.stdout:1/124: dread d4/f6 [0,4194304] 0 2024-09-17T01:01:51.769 INFO:tasks.workunit.client.0.smithi002.stdout:1/125: read - d4/f13 zero size 2024-09-17T01:01:51.770 INFO:tasks.workunit.client.0.smithi002.stdout:3/160: dread d0/d3/d17/f29 [0,4194304] 0 2024-09-17T01:01:51.770 INFO:tasks.workunit.client.0.smithi002.stdout:3/161: chown d0/f21 22106 1 2024-09-17T01:01:51.770 INFO:tasks.workunit.client.0.smithi002.stdout:3/162: stat d0/d3/l9 0 2024-09-17T01:01:51.770 INFO:tasks.workunit.client.0.smithi002.stdout:2/133: dwrite f5 [0,4194304] 0 2024-09-17T01:01:51.771 INFO:tasks.workunit.client.0.smithi002.stdout:1/126: rename d4/d11/d12/d14/d17/d20/c24 to d4/d11/d12/d14/c2e 0 2024-09-17T01:01:51.771 INFO:tasks.workunit.client.0.smithi002.stdout:1/127: fdatasync d4/f6 0 2024-09-17T01:01:51.774 INFO:tasks.workunit.client.0.smithi002.stdout:1/128: link d4/fa d4/d22/f2f 0 2024-09-17T01:01:51.775 INFO:tasks.workunit.client.0.smithi002.stdout:3/163: mkdir d0/d3/d37 0 2024-09-17T01:01:51.775 INFO:tasks.workunit.client.0.smithi002.stdout:6/182: dread d2/f19 [0,4194304] 0 2024-09-17T01:01:51.775 INFO:tasks.workunit.client.0.smithi002.stdout:6/183: read d2/dc/d24/f22 [293136,70775] 0 2024-09-17T01:01:51.776 INFO:tasks.workunit.client.0.smithi002.stdout:1/129: mkdir d4/d11/d12/d30 0 2024-09-17T01:01:51.777 INFO:tasks.workunit.client.0.smithi002.stdout:1/130: chown d4/l21 790802408 1 2024-09-17T01:01:51.778 INFO:tasks.workunit.client.0.smithi002.stdout:3/164: symlink d0/d31/d32/l38 0 2024-09-17T01:01:51.778 INFO:tasks.workunit.client.0.smithi002.stdout:3/165: read d0/d3/d17/f29 [258604,67287] 0 2024-09-17T01:01:51.779 INFO:tasks.workunit.client.0.smithi002.stdout:6/184: mkdir d2/d1d/d2d/d35 0 2024-09-17T01:01:51.780 INFO:tasks.workunit.client.0.smithi002.stdout:3/166: mknod d0/d3/d37/c39 0 2024-09-17T01:01:51.780 INFO:tasks.workunit.client.0.smithi002.stdout:3/167: dread - d0/f2f zero size 2024-09-17T01:01:51.780 INFO:tasks.workunit.client.0.smithi002.stdout:3/168: creat d0/d3/d17/f3a x:0 0 0 2024-09-17T01:01:51.780 INFO:tasks.workunit.client.0.smithi002.stdout:6/185: dread d2/dc/f20 [0,4194304] 0 2024-09-17T01:01:51.782 INFO:tasks.workunit.client.0.smithi002.stdout:3/169: truncate d0/fd 5199832 0 2024-09-17T01:01:51.783 INFO:tasks.workunit.client.0.smithi002.stdout:3/170: creat d0/d31/d32/f3b x:0 0 0 2024-09-17T01:01:51.783 INFO:tasks.workunit.client.0.smithi002.stdout:3/171: dread - d0/d31/d32/f3b zero size 2024-09-17T01:01:51.783 INFO:tasks.workunit.client.0.smithi002.stdout:3/172: rmdir d0/d3/d37 39 2024-09-17T01:01:51.785 INFO:tasks.workunit.client.0.smithi002.stdout:3/173: creat d0/d3/f3c x:0 0 0 2024-09-17T01:01:51.785 INFO:tasks.workunit.client.1.smithi099.stdout:4/176: dwrite d7/dd/de/d1b/f34 [0,4194304] 0 2024-09-17T01:01:51.785 INFO:tasks.workunit.client.1.smithi099.stdout:4/177: creat d7/dd/de/f3c x:0 0 0 2024-09-17T01:01:51.785 INFO:tasks.workunit.client.1.smithi099.stdout:4/178: stat d7/f16 0 2024-09-17T01:01:51.785 INFO:tasks.workunit.client.1.smithi099.stdout:4/179: stat d7/dd/d21/d26/l3b 0 2024-09-17T01:01:51.785 INFO:tasks.workunit.client.1.smithi099.stdout:4/180: stat d7/dd/d21/d26/l3b 0 2024-09-17T01:01:51.789 INFO:tasks.workunit.client.1.smithi099.stdout:8/177: write d0/f18 [7621124,122333] 0 2024-09-17T01:01:51.791 INFO:tasks.workunit.client.0.smithi002.stdout:6/186: dread d2/f18 [0,4194304] 0 2024-09-17T01:01:51.793 INFO:tasks.workunit.client.0.smithi002.stdout:6/187: creat d2/d1d/d27/d30/f36 x:0 0 0 2024-09-17T01:01:51.795 INFO:tasks.workunit.client.0.smithi002.stdout:6/188: mkdir d2/d1d/d2d/d35/d37 0 2024-09-17T01:01:51.795 INFO:tasks.workunit.client.0.smithi002.stdout:6/189: write f1 [7902,115052] 0 2024-09-17T01:01:51.795 INFO:tasks.workunit.client.0.smithi002.stdout:6/190: chown d2/d1d/d26/f2b 2 1 2024-09-17T01:01:51.795 INFO:tasks.workunit.client.0.smithi002.stdout:6/191: chown d2/dc/d24/c1b 3855 1 2024-09-17T01:01:51.796 INFO:tasks.workunit.client.0.smithi002.stdout:6/192: mknod d2/d1d/c38 0 2024-09-17T01:01:51.796 INFO:tasks.workunit.client.0.smithi002.stdout:6/193: truncate d2/f31 20272 0 2024-09-17T01:01:51.798 INFO:tasks.workunit.client.0.smithi002.stdout:6/194: rename d2/f31 to d2/dc/d34/f39 0 2024-09-17T01:01:51.798 INFO:tasks.workunit.client.0.smithi002.stdout:6/195: write d2/f16 [354858,69045] 0 2024-09-17T01:01:51.798 INFO:tasks.workunit.client.0.smithi002.stdout:6/196: write d2/d1d/d2d/f2e [809541,7935] 0 2024-09-17T01:01:51.798 INFO:tasks.workunit.client.0.smithi002.stdout:6/197: creat d2/d1d/d2d/d35/d37/f3a x:0 0 0 2024-09-17T01:01:51.803 INFO:tasks.workunit.client.0.smithi002.stdout:3/174: dwrite d0/d3/d17/f29 [0,4194304] 0 2024-09-17T01:01:51.803 INFO:tasks.workunit.client.0.smithi002.stdout:3/175: stat d0/d3/d37/c39 0 2024-09-17T01:01:51.804 INFO:tasks.workunit.client.1.smithi099.stdout:4/181: dread d7/dd/de/f29 [0,4194304] 0 2024-09-17T01:01:51.804 INFO:tasks.workunit.client.0.smithi002.stdout:3/176: symlink d0/d3/l3d 0 2024-09-17T01:01:51.805 INFO:tasks.workunit.client.0.smithi002.stdout:3/177: creat d0/f3e x:0 0 0 2024-09-17T01:01:51.805 INFO:tasks.workunit.client.0.smithi002.stdout:3/178: chown d0/f21 2271384 1 2024-09-17T01:01:51.806 INFO:tasks.workunit.client.1.smithi099.stdout:4/182: rmdir d7/dd/d21 39 2024-09-17T01:01:51.807 INFO:tasks.workunit.client.0.smithi002.stdout:3/179: rename d0/d3/d17/f2a to d0/d3/f3f 0 2024-09-17T01:01:51.808 INFO:tasks.workunit.client.0.smithi002.stdout:3/180: mkdir d0/d3/d33/d40 0 2024-09-17T01:01:51.809 INFO:tasks.workunit.client.1.smithi099.stdout:8/178: write d0/f23 [721389,126223] 0 2024-09-17T01:01:51.810 INFO:tasks.workunit.client.1.smithi099.stdout:8/179: symlink d0/d1f/l2f 0 2024-09-17T01:01:51.811 INFO:tasks.workunit.client.0.smithi002.stdout:0/92: dwrite f1 [4194304,4194304] 0 2024-09-17T01:01:51.812 INFO:tasks.workunit.client.1.smithi099.stdout:8/180: unlink d0/c1a 0 2024-09-17T01:01:51.812 INFO:tasks.workunit.client.1.smithi099.stdout:7/214: sync 2024-09-17T01:01:51.813 INFO:tasks.workunit.client.0.smithi002.stdout:1/131: dwrite d4/fc [4194304,4194304] 0 2024-09-17T01:01:51.814 INFO:tasks.workunit.client.1.smithi099.stdout:8/181: creat d0/f30 x:0 0 0 2024-09-17T01:01:51.814 INFO:tasks.workunit.client.1.smithi099.stdout:8/182: stat d0/f23 0 2024-09-17T01:01:51.814 INFO:tasks.workunit.client.0.smithi002.stdout:0/93: link dd/f15 dd/f18 0 2024-09-17T01:01:51.814 INFO:tasks.workunit.client.1.smithi099.stdout:1/270: dwrite d0/d8/d49/d4e/f50 [0,4194304] 0 2024-09-17T01:01:51.815 INFO:tasks.workunit.client.0.smithi002.stdout:2/134: dwrite d1b/f1e [0,4194304] 0 2024-09-17T01:01:51.815 INFO:tasks.workunit.client.0.smithi002.stdout:2/135: creat d1b/d1d/f28 x:0 0 0 2024-09-17T01:01:51.815 INFO:tasks.workunit.client.0.smithi002.stdout:5/163: dwrite d2/f6 [8388608,4194304] 0 2024-09-17T01:01:51.815 INFO:tasks.workunit.client.0.smithi002.stdout:4/173: dwrite d7/d19/d2e/f33 [0,4194304] 0 2024-09-17T01:01:51.816 INFO:tasks.workunit.client.0.smithi002.stdout:1/132: creat d4/d11/d1a/f31 x:0 0 0 2024-09-17T01:01:51.816 INFO:tasks.workunit.client.0.smithi002.stdout:9/89: dwrite f0 [4194304,4194304] 0 2024-09-17T01:01:51.817 INFO:tasks.workunit.client.1.smithi099.stdout:7/215: symlink d1/d1e/d12/l39 0 2024-09-17T01:01:51.817 INFO:tasks.workunit.client.1.smithi099.stdout:7/216: chown d1/c6 122066 1 2024-09-17T01:01:51.817 INFO:tasks.workunit.client.1.smithi099.stdout:7/217: chown d1/d1e/d1c 18402 1 2024-09-17T01:01:51.817 INFO:tasks.workunit.client.0.smithi002.stdout:0/94: mkdir dd/d19 0 2024-09-17T01:01:51.818 INFO:tasks.workunit.client.1.smithi099.stdout:8/183: mkdir d0/d1f/d31 0 2024-09-17T01:01:51.819 INFO:tasks.workunit.client.1.smithi099.stdout:7/218: symlink d1/d1e/d12/l3a 0 2024-09-17T01:01:51.821 INFO:tasks.workunit.client.1.smithi099.stdout:7/219: mknod d1/c3b 0 2024-09-17T01:01:51.827 INFO:tasks.workunit.client.0.smithi002.stdout:6/198: dwrite d2/f18 [0,4194304] 0 2024-09-17T01:01:51.827 INFO:tasks.workunit.client.0.smithi002.stdout:5/164: symlink d2/de/d1d/l30 0 2024-09-17T01:01:51.829 INFO:tasks.workunit.client.1.smithi099.stdout:7/220: mknod d1/d1e/c3c 0 2024-09-17T01:01:51.831 INFO:tasks.workunit.client.0.smithi002.stdout:4/174: mkdir d7/d19/d34 0 2024-09-17T01:01:51.832 INFO:tasks.workunit.client.1.smithi099.stdout:7/221: symlink d1/d37/l3d 0 2024-09-17T01:01:51.832 INFO:tasks.workunit.client.1.smithi099.stdout:7/222: dread - d1/d1e/f34 zero size 2024-09-17T01:01:51.833 INFO:tasks.workunit.client.1.smithi099.stdout:7/223: chown d1/d1e/d12/l39 3649 1 2024-09-17T01:01:51.833 INFO:tasks.workunit.client.1.smithi099.stdout:7/224: creat d1/d2c/f3e x:0 0 0 2024-09-17T01:01:51.833 INFO:tasks.workunit.client.1.smithi099.stdout:8/184: read d0/d1f/f12 [2894994,61067] 0 2024-09-17T01:01:51.833 INFO:tasks.workunit.client.1.smithi099.stdout:8/185: truncate d0/d1f/f14 640840 0 2024-09-17T01:01:51.835 INFO:tasks.workunit.client.0.smithi002.stdout:1/133: mkdir d4/d11/d12/d23/d32 0 2024-09-17T01:01:51.835 INFO:tasks.workunit.client.0.smithi002.stdout:1/134: write d4/ff [218702,99218] 0 2024-09-17T01:01:51.835 INFO:tasks.workunit.client.0.smithi002.stdout:1/135: chown d4/d11/d12/d14/d17/c1e 2070 1 2024-09-17T01:01:51.836 INFO:tasks.workunit.client.0.smithi002.stdout:9/90: symlink d5/dc/l17 0 2024-09-17T01:01:51.836 INFO:tasks.workunit.client.0.smithi002.stdout:9/91: chown c1 82992 1 2024-09-17T01:01:51.836 INFO:tasks.workunit.client.0.smithi002.stdout:9/92: write d5/f14 [692546,29352] 0 2024-09-17T01:01:51.837 INFO:tasks.workunit.client.1.smithi099.stdout:8/186: link d0/d1f/l2f d0/l32 0 2024-09-17T01:01:51.840 INFO:tasks.workunit.client.1.smithi099.stdout:7/225: mkdir d1/d1e/d3f 0 2024-09-17T01:01:51.841 INFO:tasks.workunit.client.0.smithi002.stdout:4/175: dread d7/de/f28 [0,4194304] 0 2024-09-17T01:01:51.842 INFO:tasks.workunit.client.1.smithi099.stdout:7/226: rename d1/d2c/f3e to d1/d2c/f40 0 2024-09-17T01:01:51.844 INFO:tasks.workunit.client.1.smithi099.stdout:7/227: rename d1/d1e/f20 to d1/d1e/d3f/f41 0 2024-09-17T01:01:51.848 INFO:tasks.workunit.client.0.smithi002.stdout:6/199: link d2/dc/d24/c17 d2/d1d/d2d/d35/d37/c3b 0 2024-09-17T01:01:51.849 INFO:tasks.workunit.client.1.smithi099.stdout:5/271: sync 2024-09-17T01:01:51.849 INFO:tasks.workunit.client.1.smithi099.stdout:4/183: dwrite d7/dd/d21/d26/f32 [0,4194304] 0 2024-09-17T01:01:51.850 INFO:tasks.workunit.client.0.smithi002.stdout:5/165: rename d2/de/f1a to d2/d2d/d10/d20/d24/f31 0 2024-09-17T01:01:51.851 INFO:tasks.workunit.client.0.smithi002.stdout:9/93: creat d5/f18 x:0 0 0 2024-09-17T01:01:51.852 INFO:tasks.workunit.client.0.smithi002.stdout:4/176: mknod d7/d19/d2e/c35 0 2024-09-17T01:01:51.854 INFO:tasks.workunit.client.0.smithi002.stdout:6/200: link d2/c3 d2/dc/d24/c3c 0 2024-09-17T01:01:51.856 INFO:tasks.workunit.client.0.smithi002.stdout:9/94: creat d5/f19 x:0 0 0 2024-09-17T01:01:51.859 INFO:tasks.workunit.client.0.smithi002.stdout:6/201: unlink d2/dc/d24/f22 0 2024-09-17T01:01:51.859 INFO:tasks.workunit.client.0.smithi002.stdout:6/202: chown d2/d1d/c38 321696 1 2024-09-17T01:01:51.859 INFO:tasks.workunit.client.1.smithi099.stdout:2/172: sync 2024-09-17T01:01:51.860 INFO:tasks.workunit.client.1.smithi099.stdout:2/173: chown d2/d9/d25/d26/f30 44058 1 2024-09-17T01:01:51.860 INFO:tasks.workunit.client.1.smithi099.stdout:2/174: write d2/d9/d17/f21 [1418089,103102] 0 2024-09-17T01:01:51.860 INFO:tasks.workunit.client.1.smithi099.stdout:2/175: creat d2/d9/d25/d26/f32 x:0 0 0 2024-09-17T01:01:51.860 INFO:tasks.workunit.client.0.smithi002.stdout:6/203: creat d2/d1d/f3d x:0 0 0 2024-09-17T01:01:51.885 INFO:tasks.workunit.client.0.smithi002.stdout:9/95: dread f0 [4194304,4194304] 0 2024-09-17T01:01:51.885 INFO:tasks.workunit.client.0.smithi002.stdout:9/96: write d5/f19 [361032,23943] 0 2024-09-17T01:01:51.886 INFO:tasks.workunit.client.0.smithi002.stdout:9/97: symlink d5/l1a 0 2024-09-17T01:01:51.886 INFO:tasks.workunit.client.0.smithi002.stdout:9/98: write d5/fb [1500166,128623] 0 2024-09-17T01:01:51.888 INFO:tasks.workunit.client.0.smithi002.stdout:9/99: creat d5/dc/f1b x:0 0 0 2024-09-17T01:01:51.888 INFO:tasks.workunit.client.0.smithi002.stdout:9/100: mknod d5/dc/c1c 0 2024-09-17T01:01:51.889 INFO:tasks.workunit.client.0.smithi002.stdout:9/101: creat d5/f1d x:0 0 0 2024-09-17T01:01:51.889 INFO:tasks.workunit.client.0.smithi002.stdout:9/102: write d5/f1d [409504,93882] 0 2024-09-17T01:01:51.889 INFO:tasks.workunit.client.0.smithi002.stdout:9/103: creat d5/f1e x:0 0 0 2024-09-17T01:01:51.892 INFO:tasks.workunit.client.0.smithi002.stdout:1/136: dwrite d4/d22/f2f [0,4194304] 0 2024-09-17T01:01:51.893 INFO:tasks.workunit.client.0.smithi002.stdout:2/136: dwrite fd [0,4194304] 0 2024-09-17T01:01:51.893 INFO:tasks.workunit.client.0.smithi002.stdout:2/137: creat d1b/f29 x:0 0 0 2024-09-17T01:01:51.893 INFO:tasks.workunit.client.0.smithi002.stdout:0/95: dwrite dd/ff [4194304,4194304] 0 2024-09-17T01:01:51.893 INFO:tasks.workunit.client.1.smithi099.stdout:1/271: dwrite d0/d2/d18/f52 [0,4194304] 0 2024-09-17T01:01:51.894 INFO:tasks.workunit.client.1.smithi099.stdout:1/272: dread - d0/d8/d49/f4c zero size 2024-09-17T01:01:51.894 INFO:tasks.workunit.client.1.smithi099.stdout:1/273: truncate d0/d2/d5/f58 940166 0 2024-09-17T01:01:51.894 INFO:tasks.workunit.client.1.smithi099.stdout:1/274: stat d0/d2/d18/f52 0 2024-09-17T01:01:51.894 INFO:tasks.workunit.client.1.smithi099.stdout:1/275: readlink d0/d2/d18/l29 0 2024-09-17T01:01:51.894 INFO:tasks.workunit.client.1.smithi099.stdout:1/276: truncate d0/f13 587131 0 2024-09-17T01:01:51.894 INFO:tasks.workunit.client.1.smithi099.stdout:7/228: rmdir d1/d1e/d12 39 2024-09-17T01:01:51.895 INFO:tasks.workunit.client.1.smithi099.stdout:1/277: dread d0/f13 [0,4194304] 0 2024-09-17T01:01:51.895 INFO:tasks.workunit.client.1.smithi099.stdout:1/278: dread - d0/d2/d5/f4d zero size 2024-09-17T01:01:51.895 INFO:tasks.workunit.client.1.smithi099.stdout:1/279: read d0/f13 [95417,25117] 0 2024-09-17T01:01:51.895 INFO:tasks.workunit.client.1.smithi099.stdout:1/280: truncate d0/d8/d4a/f4f 760148 0 2024-09-17T01:01:51.895 INFO:tasks.workunit.client.1.smithi099.stdout:8/187: dwrite d0/d1f/f2c [0,4194304] 0 2024-09-17T01:01:51.896 INFO:tasks.workunit.client.0.smithi002.stdout:1/137: link d4/d22/l2d d4/d11/d12/d14/l33 0 2024-09-17T01:01:51.896 INFO:tasks.workunit.client.0.smithi002.stdout:1/138: stat d4/f13 0 2024-09-17T01:01:51.897 INFO:tasks.workunit.client.1.smithi099.stdout:7/229: link d1/d1e/c2a d1/d1e/d1c/c42 0 2024-09-17T01:01:51.897 INFO:tasks.workunit.client.0.smithi002.stdout:2/138: mkdir d1b/d1d/d2a 0 2024-09-17T01:01:51.897 INFO:tasks.workunit.client.0.smithi002.stdout:2/139: chown d1b/d1d/f28 977 1 2024-09-17T01:01:51.898 INFO:tasks.workunit.client.0.smithi002.stdout:3/181: read d0/fd [4975135,67886] 0 2024-09-17T01:01:51.898 INFO:tasks.workunit.client.0.smithi002.stdout:0/96: mkdir dd/d19/d1a 0 2024-09-17T01:01:51.899 INFO:tasks.workunit.client.0.smithi002.stdout:1/139: mkdir d4/d11/d12/d34 0 2024-09-17T01:01:51.899 INFO:tasks.workunit.client.0.smithi002.stdout:1/140: chown d4/d11/d1a/f29 437 1 2024-09-17T01:01:51.899 INFO:tasks.workunit.client.0.smithi002.stdout:1/141: fsync d4/fa 0 2024-09-17T01:01:51.899 INFO:tasks.workunit.client.1.smithi099.stdout:1/281: creat d0/d2/de/f5c x:0 0 0 2024-09-17T01:01:51.899 INFO:tasks.workunit.client.1.smithi099.stdout:1/282: stat d0/d2/de/c2e 0 2024-09-17T01:01:51.900 INFO:tasks.workunit.client.1.smithi099.stdout:1/283: read d0/d8/f26 [188773,46636] 0 2024-09-17T01:01:51.900 INFO:tasks.workunit.client.0.smithi002.stdout:2/140: symlink d1b/l2b 0 2024-09-17T01:01:51.901 INFO:tasks.workunit.client.0.smithi002.stdout:3/182: unlink d0/d3/d17/f2e 0 2024-09-17T01:01:51.902 INFO:tasks.workunit.client.1.smithi099.stdout:8/188: mknod d0/c33 0 2024-09-17T01:01:51.903 INFO:tasks.workunit.client.0.smithi002.stdout:0/97: creat dd/d19/f1b x:0 0 0 2024-09-17T01:01:51.904 INFO:tasks.workunit.client.0.smithi002.stdout:9/104: truncate d5/f10 3217928 0 2024-09-17T01:01:51.905 INFO:tasks.workunit.client.0.smithi002.stdout:0/98: truncate dd/f13 670793 0 2024-09-17T01:01:51.905 INFO:tasks.workunit.client.0.smithi002.stdout:5/166: dwrite d2/dc/f16 [0,4194304] 0 2024-09-17T01:01:51.906 INFO:tasks.workunit.client.0.smithi002.stdout:5/167: chown d2/d2d/d10/l27 0 1 2024-09-17T01:01:51.906 INFO:tasks.workunit.client.0.smithi002.stdout:9/105: read d5/fb [458299,6726] 0 2024-09-17T01:01:51.906 INFO:tasks.workunit.client.1.smithi099.stdout:2/176: dwrite d2/d7/fe [0,4194304] 0 2024-09-17T01:01:51.906 INFO:tasks.workunit.client.1.smithi099.stdout:2/177: creat d2/d9/d25/d26/f33 x:0 0 0 2024-09-17T01:01:51.906 INFO:tasks.workunit.client.1.smithi099.stdout:2/178: dread - d2/d9/d25/d26/f30 zero size 2024-09-17T01:01:51.907 INFO:tasks.workunit.client.0.smithi002.stdout:0/99: mkdir dd/d19/d1c 0 2024-09-17T01:01:51.907 INFO:tasks.workunit.client.0.smithi002.stdout:6/204: dwrite d2/d1d/f3d [0,4194304] 0 2024-09-17T01:01:51.907 INFO:tasks.workunit.client.0.smithi002.stdout:6/205: write d2/d1d/f25 [405754,91178] 0 2024-09-17T01:01:51.907 INFO:tasks.workunit.client.0.smithi002.stdout:6/206: fdatasync d2/f16 0 2024-09-17T01:01:51.908 INFO:tasks.workunit.client.0.smithi002.stdout:4/177: dwrite d7/d19/f1f [0,4194304] 0 2024-09-17T01:01:51.908 INFO:tasks.workunit.client.1.smithi099.stdout:7/230: dread d1/f10 [0,4194304] 0 2024-09-17T01:01:51.909 INFO:tasks.workunit.client.1.smithi099.stdout:5/272: dwrite d2/dc/d14/d19/f54 [0,4194304] 0 2024-09-17T01:01:51.909 INFO:tasks.workunit.client.0.smithi002.stdout:8/186: sync 2024-09-17T01:01:51.909 INFO:tasks.workunit.client.0.smithi002.stdout:1/142: dread d4/d11/d1a/f29 [0,4194304] 0 2024-09-17T01:01:51.909 INFO:tasks.workunit.client.0.smithi002.stdout:1/143: write d4/fe [1775258,74297] 0 2024-09-17T01:01:51.910 INFO:tasks.workunit.client.0.smithi002.stdout:5/168: mkdir d2/d2d/d10/d1e/d25/d32 0 2024-09-17T01:01:51.911 INFO:tasks.workunit.client.0.smithi002.stdout:3/183: dread d0/d3/d17/f2c [0,4194304] 0 2024-09-17T01:01:51.912 INFO:tasks.workunit.client.0.smithi002.stdout:0/100: creat dd/d19/d1a/f1d x:0 0 0 2024-09-17T01:01:51.912 INFO:tasks.workunit.client.0.smithi002.stdout:0/101: creat dd/d19/f1e x:0 0 0 2024-09-17T01:01:51.913 INFO:tasks.workunit.client.1.smithi099.stdout:2/179: rename d2/d9/d25/d26/f2b to d2/d9/f34 0 2024-09-17T01:01:51.913 INFO:tasks.workunit.client.1.smithi099.stdout:2/180: readlink d2/l31 0 2024-09-17T01:01:51.914 INFO:tasks.workunit.client.1.smithi099.stdout:1/284: rmdir d0 39 2024-09-17T01:01:51.914 INFO:tasks.workunit.client.1.smithi099.stdout:1/285: dread - d0/d2/d5/f4d zero size 2024-09-17T01:01:51.923 INFO:tasks.workunit.client.0.smithi002.stdout:3/184: write d0/fd [1975279,44154] 0 2024-09-17T01:01:51.923 INFO:tasks.workunit.client.1.smithi099.stdout:7/231: rename d1/d1e/c26 to d1/d36/c43 0 2024-09-17T01:01:51.923 INFO:tasks.workunit.client.1.smithi099.stdout:7/232: fdatasync d1/d1e/f34 0 2024-09-17T01:01:51.924 INFO:tasks.workunit.client.0.smithi002.stdout:4/178: read d7/d19/f1f [1829378,42725] 0 2024-09-17T01:01:51.925 INFO:tasks.workunit.client.1.smithi099.stdout:1/286: rename d0/d2/de/l3a to d0/d2/de/d31/l5d 0 2024-09-17T01:01:51.925 INFO:tasks.workunit.client.1.smithi099.stdout:5/273: write d2/f22 [299826,87430] 0 2024-09-17T01:01:51.925 INFO:tasks.workunit.client.1.smithi099.stdout:5/274: creat d2/dc/d17/f59 x:0 0 0 2024-09-17T01:01:51.926 INFO:tasks.workunit.client.1.smithi099.stdout:7/233: symlink d1/d1e/d12/l44 0 2024-09-17T01:01:51.926 INFO:tasks.workunit.client.1.smithi099.stdout:7/234: fsync d1/d2c/f30 0 2024-09-17T01:01:51.926 INFO:tasks.workunit.client.1.smithi099.stdout:7/235: fdatasync d1/d1e/d12/f16 0 2024-09-17T01:01:51.927 INFO:tasks.workunit.client.1.smithi099.stdout:5/275: rename d2/dc to d2/dc/d5a 22 2024-09-17T01:01:51.927 INFO:tasks.workunit.client.1.smithi099.stdout:5/276: write d2/dc/d14/d19/f4b [603816,73936] 0 2024-09-17T01:01:51.928 INFO:tasks.workunit.client.0.smithi002.stdout:8/187: unlink d2/d9/dd/l3f 0 2024-09-17T01:01:51.928 INFO:tasks.workunit.client.1.smithi099.stdout:7/236: creat d1/d36/f45 x:0 0 0 2024-09-17T01:01:51.928 INFO:tasks.workunit.client.1.smithi099.stdout:7/237: truncate d1/d1e/f1b 704700 0 2024-09-17T01:01:51.929 INFO:tasks.workunit.client.1.smithi099.stdout:7/238: creat d1/d36/f46 x:0 0 0 2024-09-17T01:01:51.929 INFO:tasks.workunit.client.1.smithi099.stdout:7/239: write d1/d1e/d12/f32 [215916,129359] 0 2024-09-17T01:01:51.929 INFO:tasks.workunit.client.1.smithi099.stdout:7/240: chown d1/d1e/f1d 931 1 2024-09-17T01:01:51.929 INFO:tasks.workunit.client.1.smithi099.stdout:7/241: readlink d1/d1e/d12/l39 0 2024-09-17T01:01:51.929 INFO:tasks.workunit.client.1.smithi099.stdout:1/287: dread d0/fc [0,4194304] 0 2024-09-17T01:01:51.929 INFO:tasks.workunit.client.1.smithi099.stdout:5/277: link d2/dc/d17/f53 d2/d8/f5b 0 2024-09-17T01:01:51.930 INFO:tasks.workunit.client.1.smithi099.stdout:5/278: fdatasync d2/f3 0 2024-09-17T01:01:51.930 INFO:tasks.workunit.client.1.smithi099.stdout:5/279: readlink d2/dc/d14/d19/l48 0 2024-09-17T01:01:51.930 INFO:tasks.workunit.client.0.smithi002.stdout:8/188: write d2/d26/d2b/f36 [70414,6586] 0 2024-09-17T01:01:51.931 INFO:tasks.workunit.client.1.smithi099.stdout:7/242: mkdir d1/d2c/d47 0 2024-09-17T01:01:51.931 INFO:tasks.workunit.client.0.smithi002.stdout:1/144: creat d4/d11/d12/d23/f35 x:0 0 0 2024-09-17T01:01:51.931 INFO:tasks.workunit.client.0.smithi002.stdout:1/145: stat d4/d11/d12/d14 0 2024-09-17T01:01:51.931 INFO:tasks.workunit.client.0.smithi002.stdout:1/146: stat d4/fc 0 2024-09-17T01:01:51.931 INFO:tasks.workunit.client.0.smithi002.stdout:5/169: getdents d2/d2d/d10/d14/d19 0 2024-09-17T01:01:51.932 INFO:tasks.workunit.client.1.smithi099.stdout:1/288: creat d0/d8/d49/f5e x:0 0 0 2024-09-17T01:01:51.932 INFO:tasks.workunit.client.1.smithi099.stdout:7/243: mkdir d1/d2c/d47/d48 0 2024-09-17T01:01:51.933 INFO:tasks.workunit.client.1.smithi099.stdout:1/289: dread d0/d2/f25 [0,4194304] 0 2024-09-17T01:01:51.933 INFO:tasks.workunit.client.1.smithi099.stdout:1/290: dread - d0/d2/d9/f30 zero size 2024-09-17T01:01:51.933 INFO:tasks.workunit.client.1.smithi099.stdout:7/244: rename d1/d1e/c2a to d1/d2c/d47/d48/c49 0 2024-09-17T01:01:51.933 INFO:tasks.workunit.client.0.smithi002.stdout:0/102: mkdir dd/d19/d1c/d1f 0 2024-09-17T01:01:51.933 INFO:tasks.workunit.client.0.smithi002.stdout:3/185: truncate d0/d3/d17/f2c 2126581 0 2024-09-17T01:01:51.934 INFO:tasks.workunit.client.1.smithi099.stdout:7/245: creat d1/d1e/f4a x:0 0 0 2024-09-17T01:01:51.935 INFO:tasks.workunit.client.1.smithi099.stdout:7/246: creat d1/d1e/d12/f4b x:0 0 0 2024-09-17T01:01:51.935 INFO:tasks.workunit.client.1.smithi099.stdout:7/247: fsync d1/d1e/d12/f16 0 2024-09-17T01:01:51.935 INFO:tasks.workunit.client.0.smithi002.stdout:4/179: creat d7/f36 x:0 0 0 2024-09-17T01:01:51.936 INFO:tasks.workunit.client.0.smithi002.stdout:8/189: mkdir d2/d1c/d3c/d47 0 2024-09-17T01:01:51.937 INFO:tasks.workunit.client.0.smithi002.stdout:1/147: truncate d4/d11/d12/d14/d17/f27 2027888 0 2024-09-17T01:01:51.937 INFO:tasks.workunit.client.0.smithi002.stdout:1/148: dread - d4/d11/d1a/f31 zero size 2024-09-17T01:01:51.938 INFO:tasks.workunit.client.0.smithi002.stdout:5/170: mkdir d2/d2d/d10/d1e/d25/d32/d33 0 2024-09-17T01:01:51.939 INFO:tasks.workunit.client.0.smithi002.stdout:5/171: creat d2/de/f34 x:0 0 0 2024-09-17T01:01:51.941 INFO:tasks.workunit.client.0.smithi002.stdout:0/103: link lc dd/l20 0 2024-09-17T01:01:51.942 INFO:tasks.workunit.client.0.smithi002.stdout:2/141: dwrite ff [0,4194304] 0 2024-09-17T01:01:51.943 INFO:tasks.workunit.client.0.smithi002.stdout:4/180: truncate d7/d19/f1c 3520392 0 2024-09-17T01:01:51.943 INFO:tasks.workunit.client.0.smithi002.stdout:4/181: write d7/f25 [901528,123851] 0 2024-09-17T01:01:51.943 INFO:tasks.workunit.client.1.smithi099.stdout:2/181: dwrite d2/d9/d25/f2d [0,4194304] 0 2024-09-17T01:01:51.943 INFO:tasks.workunit.client.1.smithi099.stdout:5/280: read d2/dc/d14/d19/f54 [2649243,24223] 0 2024-09-17T01:01:51.944 INFO:tasks.workunit.client.1.smithi099.stdout:8/189: dwrite d0/d1f/f2b [4194304,4194304] 0 2024-09-17T01:01:51.944 INFO:tasks.workunit.client.1.smithi099.stdout:5/281: write d2/dc/d17/f53 [1645902,53075] 0 2024-09-17T01:01:51.948 INFO:tasks.workunit.client.1.smithi099.stdout:2/182: mknod d2/d9/d25/c35 0 2024-09-17T01:01:51.951 INFO:tasks.workunit.client.0.smithi002.stdout:2/142: mkdir d1b/d2c 0 2024-09-17T01:01:51.952 INFO:tasks.workunit.client.1.smithi099.stdout:5/282: rename d2/d8/l24 to d2/dc/d17/d3c/l5c 0 2024-09-17T01:01:51.952 INFO:tasks.workunit.client.1.smithi099.stdout:5/283: creat d2/dc/d17/f5d x:0 0 0 2024-09-17T01:01:51.952 INFO:tasks.workunit.client.0.smithi002.stdout:0/104: dread dd/ff [4194304,4194304] 0 2024-09-17T01:01:51.953 INFO:tasks.workunit.client.0.smithi002.stdout:0/105: truncate dd/f18 657818 0 2024-09-17T01:01:51.953 INFO:tasks.workunit.client.0.smithi002.stdout:0/106: chown dd 1 1 2024-09-17T01:01:51.953 INFO:tasks.workunit.client.0.smithi002.stdout:0/107: chown dd/f18 142 1 2024-09-17T01:01:51.953 INFO:tasks.workunit.client.0.smithi002.stdout:0/108: write dd/f13 [1007133,76665] 0 2024-09-17T01:01:51.953 INFO:tasks.workunit.client.0.smithi002.stdout:6/207: dwrite d2/dc/f21 [0,4194304] 0 2024-09-17T01:01:51.953 INFO:tasks.workunit.client.0.smithi002.stdout:6/208: write d2/d1d/d27/d30/f36 [885466,6627] 0 2024-09-17T01:01:51.953 INFO:tasks.workunit.client.0.smithi002.stdout:4/182: mknod d7/d19/d34/c37 0 2024-09-17T01:01:51.953 INFO:tasks.workunit.client.1.smithi099.stdout:7/248: dwrite d1/d1e/d12/f14 [0,4194304] 0 2024-09-17T01:01:51.954 INFO:tasks.workunit.client.0.smithi002.stdout:8/190: getdents d2/d1c 0 2024-09-17T01:01:51.954 INFO:tasks.workunit.client.1.smithi099.stdout:8/190: mkdir d0/d1f/d31/d34 0 2024-09-17T01:01:51.958 INFO:tasks.workunit.client.1.smithi099.stdout:8/191: truncate d0/d4/d29/f2e 5341244 0 2024-09-17T01:01:51.959 INFO:tasks.workunit.client.0.smithi002.stdout:0/109: link dd/ff dd/d19/d1c/d1f/f21 0 2024-09-17T01:01:51.963 INFO:tasks.workunit.client.0.smithi002.stdout:5/172: dwrite d2/f9 [4194304,4194304] 0 2024-09-17T01:01:51.963 INFO:tasks.workunit.client.0.smithi002.stdout:6/209: symlink d2/d1d/l3e 0 2024-09-17T01:01:51.964 INFO:tasks.workunit.client.0.smithi002.stdout:2/143: write d1b/d1d/f1f [208605,69270] 0 2024-09-17T01:01:51.964 INFO:tasks.workunit.client.0.smithi002.stdout:4/183: mknod d7/de/c38 0 2024-09-17T01:01:51.965 INFO:tasks.workunit.client.0.smithi002.stdout:4/184: write d7/d19/f1f [1111624,112319] 0 2024-09-17T01:01:51.965 INFO:tasks.workunit.client.1.smithi099.stdout:8/192: rename d0/f23 to d0/d1f/f35 0 2024-09-17T01:01:51.966 INFO:tasks.workunit.client.0.smithi002.stdout:7/103: sync 2024-09-17T01:01:51.966 INFO:tasks.workunit.client.0.smithi002.stdout:7/104: write d1/d14/f15 [3643033,118957] 0 2024-09-17T01:01:51.968 INFO:tasks.workunit.client.1.smithi099.stdout:1/291: rmdir d0/d8/d49 39 2024-09-17T01:01:51.968 INFO:tasks.workunit.client.1.smithi099.stdout:1/292: write d0/d8/d4a/f4f [1178390,96805] 0 2024-09-17T01:01:51.968 INFO:tasks.workunit.client.0.smithi002.stdout:5/173: creat d2/d2d/d10/d1e/f35 x:0 0 0 2024-09-17T01:01:51.969 INFO:tasks.workunit.client.1.smithi099.stdout:1/293: mknod d0/d2/d51/c5f 0 2024-09-17T01:01:51.971 INFO:tasks.workunit.client.1.smithi099.stdout:1/294: mknod d0/d2/d5/c60 0 2024-09-17T01:01:51.973 INFO:tasks.workunit.client.1.smithi099.stdout:1/295: unlink d0/d2/l46 0 2024-09-17T01:01:51.975 INFO:tasks.workunit.client.0.smithi002.stdout:5/174: unlink d2/de/l15 0 2024-09-17T01:01:51.975 INFO:tasks.workunit.client.0.smithi002.stdout:5/175: write d2/d2d/d10/d1e/f35 [915778,78329] 0 2024-09-17T01:01:51.977 INFO:tasks.workunit.client.1.smithi099.stdout:1/296: mkdir d0/d2/d61 0 2024-09-17T01:01:51.977 INFO:tasks.workunit.client.0.smithi002.stdout:4/185: dread d7/f25 [0,4194304] 0 2024-09-17T01:01:51.978 INFO:tasks.workunit.client.0.smithi002.stdout:4/186: creat d7/d19/d2e/f39 x:0 0 0 2024-09-17T01:01:51.978 INFO:tasks.workunit.client.0.smithi002.stdout:5/176: mknod d2/de/c36 0 2024-09-17T01:01:51.978 INFO:tasks.workunit.client.0.smithi002.stdout:5/177: chown d2/dc 28 1 2024-09-17T01:01:51.979 INFO:tasks.workunit.client.1.smithi099.stdout:1/297: rmdir d0/d8/d4a 39 2024-09-17T01:01:51.981 INFO:tasks.workunit.client.0.smithi002.stdout:4/187: mkdir d7/de/d3a 0 2024-09-17T01:01:51.981 INFO:tasks.workunit.client.1.smithi099.stdout:1/298: symlink d0/d2/d18/l62 0 2024-09-17T01:01:51.981 INFO:tasks.workunit.client.1.smithi099.stdout:1/299: write d0/d2/d18/f34 [820186,97048] 0 2024-09-17T01:01:51.982 INFO:tasks.workunit.client.0.smithi002.stdout:5/178: symlink d2/d2d/d10/d1e/d25/d32/d33/l37 0 2024-09-17T01:01:51.982 INFO:tasks.workunit.client.0.smithi002.stdout:5/179: chown d2/f6 3016 1 2024-09-17T01:01:51.999 INFO:tasks.workunit.client.1.smithi099.stdout:1/300: dwrite d0/d8/d49/f4c [0,4194304] 0 2024-09-17T01:01:51.999 INFO:tasks.workunit.client.1.smithi099.stdout:1/301: dread - d0/d2/d9/f30 zero size 2024-09-17T01:01:52.008 INFO:tasks.workunit.client.0.smithi002.stdout:4/188: write d7/f14 [287944,108775] 0 2024-09-17T01:01:52.008 INFO:tasks.workunit.client.0.smithi002.stdout:4/189: chown d7/de/d23/f2f 924913 1 2024-09-17T01:01:52.016 INFO:tasks.workunit.client.0.smithi002.stdout:4/190: write d7/d19/d2e/f33 [2846745,117542] 0 2024-09-17T01:01:52.017 INFO:tasks.workunit.client.0.smithi002.stdout:4/191: chown d7/de/f27 12387342 1 2024-09-17T01:01:52.017 INFO:tasks.workunit.client.0.smithi002.stdout:4/192: read d7/de/f27 [616495,116023] 0 2024-09-17T01:01:52.025 INFO:tasks.workunit.client.0.smithi002.stdout:0/110: dwrite dd/f14 [0,4194304] 0 2024-09-17T01:01:52.026 INFO:tasks.workunit.client.1.smithi099.stdout:7/249: dwrite d1/d1e/f34 [0,4194304] 0 2024-09-17T01:01:52.026 INFO:tasks.workunit.client.1.smithi099.stdout:7/250: chown d1/d1e/d12/l3a 74904 1 2024-09-17T01:01:52.026 INFO:tasks.workunit.client.1.smithi099.stdout:1/302: dwrite d0/f40 [0,4194304] 0 2024-09-17T01:01:52.026 INFO:tasks.workunit.client.1.smithi099.stdout:8/193: dwrite d0/d1f/f20 [0,4194304] 0 2024-09-17T01:01:52.026 INFO:tasks.workunit.client.1.smithi099.stdout:8/194: read d0/f1d [280976,7305] 0 2024-09-17T01:01:52.026 INFO:tasks.workunit.client.1.smithi099.stdout:8/195: stat d0/d4/d29/f2e 0 2024-09-17T01:01:52.026 INFO:tasks.workunit.client.1.smithi099.stdout:5/284: dwrite d2/d8/fb [0,4194304] 0 2024-09-17T01:01:52.026 INFO:tasks.workunit.client.1.smithi099.stdout:2/183: dwrite d2/d9/d25/f2e [0,4194304] 0 2024-09-17T01:01:52.026 INFO:tasks.workunit.client.1.smithi099.stdout:7/251: read d1/f19 [107185,60873] 0 2024-09-17T01:01:52.027 INFO:tasks.workunit.client.0.smithi002.stdout:2/144: dwrite d1b/d1d/f27 [0,4194304] 0 2024-09-17T01:01:52.027 INFO:tasks.workunit.client.0.smithi002.stdout:7/105: dwrite d1/f11 [0,4194304] 0 2024-09-17T01:01:52.027 INFO:tasks.workunit.client.0.smithi002.stdout:2/145: write d1b/d1d/f1f [216492,129808] 0 2024-09-17T01:01:52.027 INFO:tasks.workunit.client.0.smithi002.stdout:2/146: dread - d1b/f1c zero size 2024-09-17T01:01:52.028 INFO:tasks.workunit.client.0.smithi002.stdout:2/147: truncate f5 4946784 0 2024-09-17T01:01:52.028 INFO:tasks.workunit.client.0.smithi002.stdout:5/180: dwrite d2/de/f1f [0,4194304] 0 2024-09-17T01:01:52.028 INFO:tasks.workunit.client.0.smithi002.stdout:3/186: dread d0/d3/d17/f2c [0,4194304] 0 2024-09-17T01:01:52.028 INFO:tasks.workunit.client.0.smithi002.stdout:3/187: write d0/d3/d17/f20 [73770,46579] 0 2024-09-17T01:01:52.029 INFO:tasks.workunit.client.1.smithi099.stdout:1/303: dread d0/d8/d38/d56/f57 [0,4194304] 0 2024-09-17T01:01:52.030 INFO:tasks.workunit.client.1.smithi099.stdout:8/196: mknod d0/d1f/d31/c36 0 2024-09-17T01:01:52.030 INFO:tasks.workunit.client.1.smithi099.stdout:5/285: stat d2/dc/d14/d19/c30 0 2024-09-17T01:01:52.030 INFO:tasks.workunit.client.1.smithi099.stdout:5/286: read d2/dc/d14/d19/f4b [31832,8696] 0 2024-09-17T01:01:52.033 INFO:tasks.workunit.client.0.smithi002.stdout:1/149: write d4/d11/d12/d14/d17/f27 [266098,64948] 0 2024-09-17T01:01:52.040 INFO:tasks.workunit.client.1.smithi099.stdout:2/184: dread f0 [0,4194304] 0 2024-09-17T01:01:52.040 INFO:tasks.workunit.client.1.smithi099.stdout:2/185: chown d2/d9/d25/d26/f30 1 1 2024-09-17T01:01:52.041 INFO:tasks.workunit.client.0.smithi002.stdout:7/106: unlink d1/f17 0 2024-09-17T01:01:52.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:51 smithi099 ceph-mon[34357]: pgmap v249: 65 pgs: 65 active+clean; 478 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 29 MiB/s rd, 38 MiB/s wr, 700 op/s 2024-09-17T01:01:52.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:51 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:52.043 INFO:tasks.workunit.client.1.smithi099.stdout:7/252: symlink d1/d1e/d12/l4c 0 2024-09-17T01:01:52.044 INFO:tasks.workunit.client.1.smithi099.stdout:1/304: creat d0/d8/d38/d56/f63 x:0 0 0 2024-09-17T01:01:52.044 INFO:tasks.workunit.client.1.smithi099.stdout:1/305: read - d0/d8/d38/d56/f63 zero size 2024-09-17T01:01:52.044 INFO:tasks.workunit.client.1.smithi099.stdout:1/306: write d0/d2/d18/f28 [1094668,28728] 0 2024-09-17T01:01:52.044 INFO:tasks.workunit.client.1.smithi099.stdout:1/307: chown d0/d2/d9/f30 1934 1 2024-09-17T01:01:52.045 INFO:tasks.workunit.client.1.smithi099.stdout:5/287: mknod d2/dc/d14/d19/c5e 0 2024-09-17T01:01:52.045 INFO:tasks.workunit.client.1.smithi099.stdout:1/308: dread d0/d2/f25 [0,4194304] 0 2024-09-17T01:01:52.045 INFO:tasks.workunit.client.1.smithi099.stdout:1/309: chown d0/d8 0 1 2024-09-17T01:01:52.048 INFO:tasks.workunit.client.0.smithi002.stdout:2/148: rename d1b/f22 to d1b/f2d 0 2024-09-17T01:01:52.049 INFO:tasks.workunit.client.1.smithi099.stdout:7/253: getdents d1/d2c/d47 0 2024-09-17T01:01:52.049 INFO:tasks.workunit.client.1.smithi099.stdout:7/254: chown d1/f35 0 1 2024-09-17T01:01:52.051 INFO:tasks.workunit.client.1.smithi099.stdout:8/197: mknod d0/d4/c37 0 2024-09-17T01:01:52.052 INFO:tasks.workunit.client.0.smithi002.stdout:5/181: rename d2/d2d/d10/f1b to d2/dc/f38 0 2024-09-17T01:01:52.052 INFO:tasks.workunit.client.1.smithi099.stdout:2/186: dread d2/d9/d25/f2d [0,4194304] 0 2024-09-17T01:01:52.054 INFO:tasks.workunit.client.1.smithi099.stdout:5/288: rename d2/dc/d17/d3c/l5c to d2/dc/d14/d19/l5f 0 2024-09-17T01:01:52.054 INFO:tasks.workunit.client.1.smithi099.stdout:5/289: readlink d2/dc/l1e 0 2024-09-17T01:01:52.054 INFO:tasks.workunit.client.1.smithi099.stdout:7/255: write d1/f4 [2006412,65540] 0 2024-09-17T01:01:52.056 INFO:tasks.workunit.client.1.smithi099.stdout:1/310: rmdir d0/d2/d18 39 2024-09-17T01:01:52.058 INFO:tasks.workunit.client.1.smithi099.stdout:8/198: getdents d0/d1f/d31 0 2024-09-17T01:01:52.058 INFO:tasks.workunit.client.1.smithi099.stdout:5/290: mkdir d2/dc/d17/d3c/d60 0 2024-09-17T01:01:52.058 INFO:tasks.workunit.client.1.smithi099.stdout:5/291: write d2/f18 [2571710,54188] 0 2024-09-17T01:01:52.062 INFO:tasks.workunit.client.1.smithi099.stdout:8/199: creat d0/d1f/d31/f38 x:0 0 0 2024-09-17T01:01:52.063 INFO:tasks.workunit.client.1.smithi099.stdout:8/200: getdents d0/d4/d29 0 2024-09-17T01:01:52.066 INFO:tasks.workunit.client.1.smithi099.stdout:8/201: mknod d0/d1f/d31/c39 0 2024-09-17T01:01:52.068 INFO:tasks.workunit.client.1.smithi099.stdout:1/311: dread d0/d2/d18/f34 [0,4194304] 0 2024-09-17T01:01:52.069 INFO:tasks.workunit.client.1.smithi099.stdout:5/292: write d2/dc/d17/d3c/f46 [424423,46338] 0 2024-09-17T01:01:52.070 INFO:tasks.workunit.client.1.smithi099.stdout:1/312: creat d0/f64 x:0 0 0 2024-09-17T01:01:52.070 INFO:tasks.workunit.client.1.smithi099.stdout:1/313: write d0/d8/d49/f5e [51937,81480] 0 2024-09-17T01:01:52.070 INFO:tasks.workunit.client.1.smithi099.stdout:9/246: sync 2024-09-17T01:01:52.070 INFO:tasks.workunit.client.1.smithi099.stdout:6/266: sync 2024-09-17T01:01:52.072 INFO:tasks.workunit.client.1.smithi099.stdout:4/184: sync 2024-09-17T01:01:52.072 INFO:tasks.workunit.client.1.smithi099.stdout:0/187: sync 2024-09-17T01:01:52.072 INFO:tasks.workunit.client.1.smithi099.stdout:3/235: sync 2024-09-17T01:01:52.072 INFO:tasks.workunit.client.1.smithi099.stdout:3/236: readlink d9/lf 0 2024-09-17T01:01:52.074 INFO:tasks.workunit.client.1.smithi099.stdout:6/267: mkdir dc/d27/d58 0 2024-09-17T01:01:52.075 INFO:tasks.workunit.client.1.smithi099.stdout:9/247: mkdir da/d56 0 2024-09-17T01:01:52.078 INFO:tasks.workunit.client.1.smithi099.stdout:9/248: rename da/d18/l19 to da/d1b/d3a/d4b/l57 0 2024-09-17T01:01:52.078 INFO:tasks.workunit.client.1.smithi099.stdout:9/249: chown da/ff 446 1 2024-09-17T01:01:52.078 INFO:tasks.workunit.client.1.smithi099.stdout:8/202: write d0/d1f/f2b [2423939,177] 0 2024-09-17T01:01:52.081 INFO:tasks.workunit.client.1.smithi099.stdout:9/250: rmdir da/d21/d2a/d47 0 2024-09-17T01:01:52.084 INFO:tasks.workunit.client.1.smithi099.stdout:0/188: dread da/f27 [0,4194304] 0 2024-09-17T01:01:52.085 INFO:tasks.workunit.client.1.smithi099.stdout:8/203: creat d0/d4/f3a x:0 0 0 2024-09-17T01:01:52.085 INFO:tasks.workunit.client.1.smithi099.stdout:8/204: write d0/d4/fb [4475754,69525] 0 2024-09-17T01:01:52.085 INFO:tasks.workunit.client.1.smithi099.stdout:8/205: creat d0/d1f/d31/f3b x:0 0 0 2024-09-17T01:01:52.085 INFO:tasks.workunit.client.1.smithi099.stdout:9/251: symlink da/d14/d40/d4c/l58 0 2024-09-17T01:01:52.085 INFO:tasks.workunit.client.1.smithi099.stdout:9/252: chown da/d56 272 1 2024-09-17T01:01:52.085 INFO:tasks.workunit.client.1.smithi099.stdout:9/253: chown da/d1b/d3a/f26 2 1 2024-09-17T01:01:52.085 INFO:tasks.workunit.client.1.smithi099.stdout:9/254: chown da 16158 1 2024-09-17T01:01:52.085 INFO:tasks.workunit.client.1.smithi099.stdout:2/187: dwrite d2/d7/fe [4194304,4194304] 0 2024-09-17T01:01:52.087 INFO:tasks.workunit.client.1.smithi099.stdout:8/206: creat d0/d4/f3c x:0 0 0 2024-09-17T01:01:52.090 INFO:tasks.workunit.client.1.smithi099.stdout:0/189: dread f9 [0,4194304] 0 2024-09-17T01:01:52.091 INFO:tasks.workunit.client.1.smithi099.stdout:0/190: stat da/d12/d2b 0 2024-09-17T01:01:52.091 INFO:tasks.workunit.client.0.smithi002.stdout:0/111: getdents dd/d19/d1a 0 2024-09-17T01:01:52.091 INFO:tasks.workunit.client.1.smithi099.stdout:7/256: dwrite d1/f25 [0,4194304] 0 2024-09-17T01:01:52.092 INFO:tasks.workunit.client.1.smithi099.stdout:0/191: rename da/df/d1a/l25 to da/l3f 0 2024-09-17T01:01:52.094 INFO:tasks.workunit.client.1.smithi099.stdout:9/255: dread da/fe [0,4194304] 0 2024-09-17T01:01:52.094 INFO:tasks.workunit.client.1.smithi099.stdout:9/256: fsync da/d14/f1a 0 2024-09-17T01:01:52.094 INFO:tasks.workunit.client.1.smithi099.stdout:9/257: chown da/d14/d40/d4c/l58 794 1 2024-09-17T01:01:52.095 INFO:tasks.workunit.client.1.smithi099.stdout:9/258: chown l3 22 1 2024-09-17T01:01:52.095 INFO:tasks.workunit.client.1.smithi099.stdout:9/259: truncate da/d1b/d3a/f23 4891589 0 2024-09-17T01:01:52.095 INFO:tasks.workunit.client.1.smithi099.stdout:9/260: readlink da/d14/d48/l4d 0 2024-09-17T01:01:52.096 INFO:tasks.workunit.client.1.smithi099.stdout:7/257: truncate d1/d1e/f13 3903116 0 2024-09-17T01:01:52.097 INFO:tasks.workunit.client.0.smithi002.stdout:2/149: stat d1b/l21 0 2024-09-17T01:01:52.098 INFO:tasks.workunit.client.0.smithi002.stdout:5/182: unlink d2/l29 0 2024-09-17T01:01:52.099 INFO:tasks.workunit.client.1.smithi099.stdout:0/192: link da/df/d1a/f29 da/df/d1a/d23/f40 0 2024-09-17T01:01:52.099 INFO:tasks.workunit.client.1.smithi099.stdout:0/193: creat da/df/f41 x:0 0 0 2024-09-17T01:01:52.100 INFO:tasks.workunit.client.0.smithi002.stdout:3/188: symlink d0/d3/l41 0 2024-09-17T01:01:52.100 INFO:tasks.workunit.client.0.smithi002.stdout:3/189: creat d0/d31/d32/f42 x:0 0 0 2024-09-17T01:01:52.101 INFO:tasks.workunit.client.0.smithi002.stdout:3/190: write d0/d3/d17/f20 [937430,35504] 0 2024-09-17T01:01:52.102 INFO:tasks.workunit.client.0.smithi002.stdout:0/112: mkdir dd/d19/d1c/d1f/d22 0 2024-09-17T01:01:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/150: rmdir d4/d11/d1c 39 2024-09-17T01:01:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/151: chown d4/d22/l2d 183224887 1 2024-09-17T01:01:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/152: truncate d4/f13 490225 0 2024-09-17T01:01:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/153: dread - d4/d11/d12/d23/f35 zero size 2024-09-17T01:01:52.104 INFO:tasks.workunit.client.0.smithi002.stdout:1/154: chown d4/d11/f15 1007986 1 2024-09-17T01:01:52.104 INFO:tasks.workunit.client.0.smithi002.stdout:1/155: write d4/d11/f15 [4993341,65344] 0 2024-09-17T01:01:52.104 INFO:tasks.workunit.client.0.smithi002.stdout:1/156: creat d4/d11/d12/d14/f36 x:0 0 0 2024-09-17T01:01:52.104 INFO:tasks.workunit.client.0.smithi002.stdout:1/157: fdatasync d4/d11/d1c/f1f 0 2024-09-17T01:01:52.108 INFO:tasks.workunit.client.0.smithi002.stdout:5/183: getdents d2/d2d/d10/d14 0 2024-09-17T01:01:52.109 INFO:tasks.workunit.client.1.smithi099.stdout:8/207: read d0/d1f/f2c [1885888,42784] 0 2024-09-17T01:01:52.110 INFO:tasks.workunit.client.1.smithi099.stdout:8/208: fsync d0/d1f/f2c 0 2024-09-17T01:01:52.110 INFO:tasks.workunit.client.1.smithi099.stdout:8/209: chown d0/d4/d29/f2e 27600272 1 2024-09-17T01:01:52.110 INFO:tasks.workunit.client.1.smithi099.stdout:7/258: write d1/d1e/d12/f2b [716834,66660] 0 2024-09-17T01:01:52.110 INFO:tasks.workunit.client.1.smithi099.stdout:4/185: dwrite d7/dd/de/d10/d18/f2e [0,4194304] 0 2024-09-17T01:01:52.113 INFO:tasks.workunit.client.0.smithi002.stdout:2/150: getdents d1b 0 2024-09-17T01:01:52.115 INFO:tasks.workunit.client.1.smithi099.stdout:7/259: symlink d1/d37/l4d 0 2024-09-17T01:01:52.117 INFO:tasks.workunit.client.1.smithi099.stdout:4/186: creat d7/d35/f3d x:0 0 0 2024-09-17T01:01:52.118 INFO:tasks.workunit.client.0.smithi002.stdout:2/151: rmdir d1b 39 2024-09-17T01:01:52.118 INFO:tasks.workunit.client.0.smithi002.stdout:2/152: chown d1b/d1d/l24 0 1 2024-09-17T01:01:52.118 INFO:tasks.workunit.client.1.smithi099.stdout:8/210: link d0/d4/c2d d0/d4/c3d 0 2024-09-17T01:01:52.119 INFO:tasks.workunit.client.0.smithi002.stdout:2/153: creat d1b/d1d/d2a/f2e x:0 0 0 2024-09-17T01:01:52.119 INFO:tasks.workunit.client.0.smithi002.stdout:2/154: creat d1b/d1d/d2a/f2f x:0 0 0 2024-09-17T01:01:52.120 INFO:tasks.workunit.client.1.smithi099.stdout:8/211: mknod d0/d1f/d31/c3e 0 2024-09-17T01:01:52.122 INFO:tasks.workunit.client.1.smithi099.stdout:0/194: dread da/df/f28 [0,4194304] 0 2024-09-17T01:01:52.123 INFO:tasks.workunit.client.1.smithi099.stdout:4/187: dread d7/dd/f28 [0,4194304] 0 2024-09-17T01:01:52.123 INFO:tasks.workunit.client.1.smithi099.stdout:4/188: creat d7/dd/de/d1b/f3e x:0 0 0 2024-09-17T01:01:52.123 INFO:tasks.workunit.client.1.smithi099.stdout:4/189: write d7/dd/de/d10/d1a/f37 [666928,46956] 0 2024-09-17T01:01:52.124 INFO:tasks.workunit.client.1.smithi099.stdout:0/195: unlink da/df/f10 0 2024-09-17T01:01:52.126 INFO:tasks.workunit.client.1.smithi099.stdout:4/190: truncate d7/dd/de/d1b/f39 3782419 0 2024-09-17T01:01:52.127 INFO:tasks.workunit.client.1.smithi099.stdout:0/196: rename da/df/d1a/c33 to da/d3b/c42 0 2024-09-17T01:01:52.128 INFO:tasks.workunit.client.1.smithi099.stdout:0/197: write da/d1c/f3d [81733,99838] 0 2024-09-17T01:01:52.134 INFO:tasks.workunit.client.1.smithi099.stdout:7/260: dread d1/d1e/f1d [0,4194304] 0 2024-09-17T01:01:52.136 INFO:tasks.workunit.client.1.smithi099.stdout:0/198: write da/f27 [3429189,60520] 0 2024-09-17T01:01:52.138 INFO:tasks.workunit.client.1.smithi099.stdout:6/268: dwrite dc/f21 [0,4194304] 0 2024-09-17T01:01:52.138 INFO:tasks.workunit.client.1.smithi099.stdout:8/212: dread d0/d1f/f20 [4194304,4194304] 0 2024-09-17T01:01:52.138 INFO:tasks.workunit.client.1.smithi099.stdout:6/269: chown dc/c17 93386 1 2024-09-17T01:01:52.141 INFO:tasks.workunit.client.1.smithi099.stdout:8/213: rename d0/d1f/d31/c36 to d0/d1f/c3f 0 2024-09-17T01:01:52.141 INFO:tasks.workunit.client.1.smithi099.stdout:8/214: dread - d0/d1f/d31/f38 zero size 2024-09-17T01:01:52.142 INFO:tasks.workunit.client.1.smithi099.stdout:8/215: creat d0/f40 x:0 0 0 2024-09-17T01:01:52.142 INFO:tasks.workunit.client.1.smithi099.stdout:8/216: chown d0/d1f/le 4063095 1 2024-09-17T01:01:52.144 INFO:tasks.workunit.client.0.smithi002.stdout:9/106: sync 2024-09-17T01:01:52.144 INFO:tasks.workunit.client.0.smithi002.stdout:9/107: truncate d5/dc/f1b 910353 0 2024-09-17T01:01:52.145 INFO:tasks.workunit.client.1.smithi099.stdout:5/293: dwrite d2/f22 [0,4194304] 0 2024-09-17T01:01:52.145 INFO:tasks.workunit.client.1.smithi099.stdout:7/261: dread d1/d1e/f9 [0,4194304] 0 2024-09-17T01:01:52.145 INFO:tasks.workunit.client.1.smithi099.stdout:5/294: write d2/dc/d17/f59 [338395,122648] 0 2024-09-17T01:01:52.145 INFO:tasks.workunit.client.1.smithi099.stdout:5/295: write d2/dc/d17/f53 [3208379,77762] 0 2024-09-17T01:01:52.145 INFO:tasks.workunit.client.1.smithi099.stdout:6/270: link dc/d1a/l41 dc/d1a/l59 0 2024-09-17T01:01:52.145 INFO:tasks.workunit.client.1.smithi099.stdout:6/271: getdents dc/d2b/d53 0 2024-09-17T01:01:52.146 INFO:tasks.workunit.client.0.smithi002.stdout:9/108: truncate d5/fb 464762 0 2024-09-17T01:01:52.146 INFO:tasks.workunit.client.0.smithi002.stdout:9/109: dread - d5/f18 zero size 2024-09-17T01:01:52.146 INFO:tasks.workunit.client.0.smithi002.stdout:3/191: rmdir d0 39 2024-09-17T01:01:52.146 INFO:tasks.workunit.client.0.smithi002.stdout:3/192: fdatasync d0/f1f 0 2024-09-17T01:01:52.147 INFO:tasks.workunit.client.0.smithi002.stdout:3/193: chown d0/lc 601825672 1 2024-09-17T01:01:52.148 INFO:tasks.workunit.client.0.smithi002.stdout:3/194: creat d0/d31/f43 x:0 0 0 2024-09-17T01:01:52.149 INFO:tasks.workunit.client.1.smithi099.stdout:8/217: unlink d0/d1f/l21 0 2024-09-17T01:01:52.149 INFO:tasks.workunit.client.1.smithi099.stdout:7/262: symlink d1/d2c/l4e 0 2024-09-17T01:01:52.149 INFO:tasks.workunit.client.0.smithi002.stdout:5/184: dwrite d2/dc/f38 [4194304,4194304] 0 2024-09-17T01:01:52.150 INFO:tasks.workunit.client.1.smithi099.stdout:0/199: write da/f1b [3232790,80483] 0 2024-09-17T01:01:52.151 INFO:tasks.workunit.client.1.smithi099.stdout:0/200: chown da/d3b/c42 13844 1 2024-09-17T01:01:52.151 INFO:tasks.workunit.client.1.smithi099.stdout:1/314: dwrite d0/d8/d4a/f4f [0,4194304] 0 2024-09-17T01:01:52.152 INFO:tasks.workunit.client.1.smithi099.stdout:8/218: mkdir d0/d41 0 2024-09-17T01:01:52.152 INFO:tasks.workunit.client.1.smithi099.stdout:8/219: write d0/d4/d29/f2e [1249612,83243] 0 2024-09-17T01:01:52.153 INFO:tasks.workunit.client.1.smithi099.stdout:8/220: write d0/d4/f3a [905830,4853] 0 2024-09-17T01:01:52.153 INFO:tasks.workunit.client.1.smithi099.stdout:0/201: rmdir da/d12/d2b 39 2024-09-17T01:01:52.153 INFO:tasks.workunit.client.0.smithi002.stdout:0/113: dwrite dd/f14 [4194304,4194304] 0 2024-09-17T01:01:52.153 INFO:tasks.workunit.client.0.smithi002.stdout:0/114: dread - dd/d19/f1b zero size 2024-09-17T01:01:52.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:51 smithi002 ceph-mon[27650]: pgmap v249: 65 pgs: 65 active+clean; 478 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 29 MiB/s rd, 38 MiB/s wr, 700 op/s 2024-09-17T01:01:52.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:51 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:01:52.155 INFO:tasks.workunit.client.1.smithi099.stdout:1/315: creat d0/d8/f65 x:0 0 0 2024-09-17T01:01:52.157 INFO:tasks.workunit.client.0.smithi002.stdout:2/155: dwrite d1b/f1c [0,4194304] 0 2024-09-17T01:01:52.157 INFO:tasks.workunit.client.0.smithi002.stdout:1/158: dwrite d4/d11/d12/d14/d17/f28 [0,4194304] 0 2024-09-17T01:01:52.158 INFO:tasks.workunit.client.1.smithi099.stdout:0/202: symlink da/df/d31/l43 0 2024-09-17T01:01:52.160 INFO:tasks.workunit.client.0.smithi002.stdout:1/159: link d4/f18 d4/d11/d12/d23/d32/f37 0 2024-09-17T01:01:52.161 INFO:tasks.workunit.client.0.smithi002.stdout:2/156: mknod d1b/c30 0 2024-09-17T01:01:52.161 INFO:tasks.workunit.client.0.smithi002.stdout:2/157: truncate d1b/d1d/f28 857188 0 2024-09-17T01:01:52.161 INFO:tasks.workunit.client.0.smithi002.stdout:2/158: getdents d1b/d2c 0 2024-09-17T01:01:52.161 INFO:tasks.workunit.client.1.smithi099.stdout:1/316: symlink d0/d2/d5/l66 0 2024-09-17T01:01:52.163 INFO:tasks.workunit.client.1.smithi099.stdout:7/263: dread d1/f10 [0,4194304] 0 2024-09-17T01:01:52.163 INFO:tasks.workunit.client.1.smithi099.stdout:7/264: fdatasync d1/ff 0 2024-09-17T01:01:52.164 INFO:tasks.workunit.client.0.smithi002.stdout:2/159: rmdir d1b/d2c 0 2024-09-17T01:01:52.164 INFO:tasks.workunit.client.0.smithi002.stdout:2/160: write d1b/d1d/f1f [1046881,4070] 0 2024-09-17T01:01:52.165 INFO:tasks.workunit.client.1.smithi099.stdout:8/221: rename d0/d1f/f35 to d0/d4/f42 0 2024-09-17T01:01:52.165 INFO:tasks.workunit.client.1.smithi099.stdout:8/222: write d0/d1f/d31/f3b [838300,5604] 0 2024-09-17T01:01:52.165 INFO:tasks.workunit.client.1.smithi099.stdout:8/223: write d0/d4/fb [385964,56888] 0 2024-09-17T01:01:52.165 INFO:tasks.workunit.client.1.smithi099.stdout:8/224: creat d0/d1f/d31/f43 x:0 0 0 2024-09-17T01:01:52.165 INFO:tasks.workunit.client.1.smithi099.stdout:8/225: getdents d0/d41 0 2024-09-17T01:01:52.165 INFO:tasks.workunit.client.1.smithi099.stdout:8/226: readlink d0/d4/l26 0 2024-09-17T01:01:52.165 INFO:tasks.workunit.client.1.smithi099.stdout:0/203: symlink da/df/d31/l44 0 2024-09-17T01:01:52.165 INFO:tasks.workunit.client.1.smithi099.stdout:0/204: fsync da/d1c/d1e/f1f 0 2024-09-17T01:01:52.166 INFO:tasks.workunit.client.0.smithi002.stdout:1/160: dread d4/d11/d1a/f29 [0,4194304] 0 2024-09-17T01:01:52.169 INFO:tasks.workunit.client.1.smithi099.stdout:4/191: fsync d7/dd/de/d1b/f39 0 2024-09-17T01:01:52.171 INFO:tasks.workunit.client.0.smithi002.stdout:2/161: creat d1b/f31 x:0 0 0 2024-09-17T01:01:52.172 INFO:tasks.workunit.client.0.smithi002.stdout:1/161: creat d4/d11/d12/f38 x:0 0 0 2024-09-17T01:01:52.174 INFO:tasks.workunit.client.0.smithi002.stdout:2/162: rename d1b/l21 to d1b/l32 0 2024-09-17T01:01:52.174 INFO:tasks.workunit.client.0.smithi002.stdout:2/163: creat d1b/d1d/f33 x:0 0 0 2024-09-17T01:01:52.176 INFO:tasks.workunit.client.1.smithi099.stdout:5/296: dwrite d2/dc/d17/f5d [0,4194304] 0 2024-09-17T01:01:52.181 INFO:tasks.workunit.client.0.smithi002.stdout:2/164: mknod d1b/d1d/d2a/c34 0 2024-09-17T01:01:52.181 INFO:tasks.workunit.client.0.smithi002.stdout:2/165: creat d1b/d1d/d2a/f35 x:0 0 0 2024-09-17T01:01:52.181 INFO:tasks.workunit.client.0.smithi002.stdout:2/166: read - d1b/d1d/d2a/f2f zero size 2024-09-17T01:01:52.183 INFO:tasks.workunit.client.0.smithi002.stdout:1/162: getdents d4 0 2024-09-17T01:01:52.183 INFO:tasks.workunit.client.1.smithi099.stdout:7/265: mkdir d1/d37/d4f 0 2024-09-17T01:01:52.184 INFO:tasks.workunit.client.1.smithi099.stdout:8/227: rmdir d0/d1f/d31/d34 0 2024-09-17T01:01:52.184 INFO:tasks.workunit.client.0.smithi002.stdout:2/167: symlink d1b/d1d/l36 0 2024-09-17T01:01:52.185 INFO:tasks.workunit.client.0.smithi002.stdout:2/168: chown l7 40 1 2024-09-17T01:01:52.186 INFO:tasks.workunit.client.0.smithi002.stdout:1/163: creat d4/d22/f39 x:0 0 0 2024-09-17T01:01:52.187 INFO:tasks.workunit.client.0.smithi002.stdout:2/169: mkdir d1b/d37 0 2024-09-17T01:01:52.187 INFO:tasks.workunit.client.0.smithi002.stdout:2/170: chown d1b/d1d/f33 23956112 1 2024-09-17T01:01:52.188 INFO:tasks.workunit.client.1.smithi099.stdout:5/297: symlink d2/dc/d17/l61 0 2024-09-17T01:01:52.188 INFO:tasks.workunit.client.1.smithi099.stdout:5/298: stat d2/dc/d14/d19/c41 0 2024-09-17T01:01:52.188 INFO:tasks.workunit.client.1.smithi099.stdout:5/299: chown d2/f3 517931 1 2024-09-17T01:01:52.188 INFO:tasks.workunit.client.1.smithi099.stdout:5/300: creat d2/dc/d17/f62 x:0 0 0 2024-09-17T01:01:52.189 INFO:tasks.workunit.client.0.smithi002.stdout:1/164: mknod d4/d11/d12/d30/c3a 0 2024-09-17T01:01:52.190 INFO:tasks.workunit.client.0.smithi002.stdout:1/165: dread - d4/d11/d12/d14/f36 zero size 2024-09-17T01:01:52.190 INFO:tasks.workunit.client.0.smithi002.stdout:2/171: mkdir d1b/d1d/d38 0 2024-09-17T01:01:52.190 INFO:tasks.workunit.client.0.smithi002.stdout:2/172: creat d1b/f39 x:0 0 0 2024-09-17T01:01:52.190 INFO:tasks.workunit.client.0.smithi002.stdout:2/173: creat d1b/f3a x:0 0 0 2024-09-17T01:01:52.190 INFO:tasks.workunit.client.0.smithi002.stdout:2/174: truncate d1b/f3a 872711 0 2024-09-17T01:01:52.191 INFO:tasks.workunit.client.0.smithi002.stdout:1/166: stat d4/d11/d12/d14/d17/c1e 0 2024-09-17T01:01:52.191 INFO:tasks.workunit.client.1.smithi099.stdout:8/228: mknod d0/d1f/d31/c44 0 2024-09-17T01:01:52.191 INFO:tasks.workunit.client.1.smithi099.stdout:8/229: stat d0/d1f/d31/c3e 0 2024-09-17T01:01:52.191 INFO:tasks.workunit.client.1.smithi099.stdout:4/192: getdents d7/dd/de/d10/d1a 0 2024-09-17T01:01:52.191 INFO:tasks.workunit.client.1.smithi099.stdout:1/317: dread d0/d8/d49/d4e/f50 [0,4194304] 0 2024-09-17T01:01:52.191 INFO:tasks.workunit.client.1.smithi099.stdout:4/193: mkdir d7/dd/d21/d26/d3f 0 2024-09-17T01:01:52.192 INFO:tasks.workunit.client.1.smithi099.stdout:1/318: dread - d0/d2/f3b zero size 2024-09-17T01:01:52.192 INFO:tasks.workunit.client.1.smithi099.stdout:1/319: fdatasync d0/fc 0 2024-09-17T01:01:52.192 INFO:tasks.workunit.client.1.smithi099.stdout:4/194: link d7/dd/de/c1e d7/dd/c40 0 2024-09-17T01:01:52.193 INFO:tasks.workunit.client.1.smithi099.stdout:4/195: read - d7/dd/d21/f38 zero size 2024-09-17T01:01:52.194 INFO:tasks.workunit.client.1.smithi099.stdout:8/230: fdatasync d0/d1f/d31/f3b 0 2024-09-17T01:01:52.196 INFO:tasks.workunit.client.0.smithi002.stdout:5/185: dwrite d2/f9 [0,4194304] 0 2024-09-17T01:01:52.196 INFO:tasks.workunit.client.0.smithi002.stdout:5/186: chown d2/d2d/d10/d14/d19/f22 2992766 1 2024-09-17T01:01:52.196 INFO:tasks.workunit.client.0.smithi002.stdout:5/187: truncate d2/dc/f2a 1021276 0 2024-09-17T01:01:52.196 INFO:tasks.workunit.client.0.smithi002.stdout:5/188: fsync d2/dc/f38 0 2024-09-17T01:01:52.196 INFO:tasks.workunit.client.0.smithi002.stdout:1/167: mkdir d4/d11/d12/d14/d17/d3b 0 2024-09-17T01:01:52.196 INFO:tasks.workunit.client.0.smithi002.stdout:1/168: write d4/f18 [55533,76306] 0 2024-09-17T01:01:52.196 INFO:tasks.workunit.client.1.smithi099.stdout:8/231: mknod d0/d41/c45 0 2024-09-17T01:01:52.198 INFO:tasks.workunit.client.1.smithi099.stdout:0/205: dwrite da/df/f15 [0,4194304] 0 2024-09-17T01:01:52.200 INFO:tasks.workunit.client.0.smithi002.stdout:5/189: rename d2/d2d/d10/d1e to d2/d2d/d10/d14/d19/d39 0 2024-09-17T01:01:52.201 INFO:tasks.workunit.client.0.smithi002.stdout:9/110: dread d5/fb [0,4194304] 0 2024-09-17T01:01:52.202 INFO:tasks.workunit.client.1.smithi099.stdout:1/320: dread d0/d2/d18/f52 [0,4194304] 0 2024-09-17T01:01:52.203 INFO:tasks.workunit.client.1.smithi099.stdout:1/321: write d0/d8/d49/f5e [968733,114367] 0 2024-09-17T01:01:52.203 INFO:tasks.workunit.client.1.smithi099.stdout:1/322: readlink d0/d8/l22 0 2024-09-17T01:01:52.203 INFO:tasks.workunit.client.1.smithi099.stdout:1/323: chown d0/c2b 681341 1 2024-09-17T01:01:52.203 INFO:tasks.workunit.client.1.smithi099.stdout:0/206: mknod da/d12/c45 0 2024-09-17T01:01:52.204 INFO:tasks.workunit.client.1.smithi099.stdout:7/266: dwrite d1/d1e/f4a [0,4194304] 0 2024-09-17T01:01:52.204 INFO:tasks.workunit.client.0.smithi002.stdout:5/190: rename d2/d2d/d10/d14/d19/f22 to d2/f3a 0 2024-09-17T01:01:52.205 INFO:tasks.workunit.client.0.smithi002.stdout:5/191: chown d2/d2d/d10 85 1 2024-09-17T01:01:52.205 INFO:tasks.workunit.client.0.smithi002.stdout:9/111: dread d5/fb [0,4194304] 0 2024-09-17T01:01:52.205 INFO:tasks.workunit.client.0.smithi002.stdout:9/112: write d5/f10 [3727493,51823] 0 2024-09-17T01:01:52.206 INFO:tasks.workunit.client.0.smithi002.stdout:0/115: dwrite dd/ff [8388608,4194304] 0 2024-09-17T01:01:52.207 INFO:tasks.workunit.client.1.smithi099.stdout:5/301: write d2/d26/f2a [3804851,102601] 0 2024-09-17T01:01:52.209 INFO:tasks.workunit.client.0.smithi002.stdout:0/116: unlink la 0 2024-09-17T01:01:52.211 INFO:tasks.workunit.client.0.smithi002.stdout:9/113: dread d5/f19 [0,4194304] 0 2024-09-17T01:01:52.211 INFO:tasks.workunit.client.0.smithi002.stdout:1/169: write d4/d11/d12/d14/d17/f28 [3153661,95711] 0 2024-09-17T01:01:52.212 INFO:tasks.workunit.client.0.smithi002.stdout:9/114: chown d5/c16 42009 1 2024-09-17T01:01:52.212 INFO:tasks.workunit.client.0.smithi002.stdout:1/170: write d4/f6 [4328385,23623] 0 2024-09-17T01:01:52.212 INFO:tasks.workunit.client.1.smithi099.stdout:5/302: getdents d2/d26 0 2024-09-17T01:01:52.215 INFO:tasks.workunit.client.1.smithi099.stdout:5/303: dread d2/dc/d14/d19/f54 [0,4194304] 0 2024-09-17T01:01:52.215 INFO:tasks.workunit.client.1.smithi099.stdout:5/304: write d2/dc/d14/d19/f4b [1443450,86199] 0 2024-09-17T01:01:52.216 INFO:tasks.workunit.client.1.smithi099.stdout:5/305: creat d2/f63 x:0 0 0 2024-09-17T01:01:52.217 INFO:tasks.workunit.client.1.smithi099.stdout:0/207: dread da/d1c/d1e/f24 [0,4194304] 0 2024-09-17T01:01:52.217 INFO:tasks.workunit.client.1.smithi099.stdout:5/306: mkdir d2/d26/d64 0 2024-09-17T01:01:52.220 INFO:tasks.workunit.client.0.smithi002.stdout:9/115: creat d5/f1f x:0 0 0 2024-09-17T01:01:52.223 INFO:tasks.workunit.client.1.smithi099.stdout:5/307: dread d2/dc/f39 [0,4194304] 0 2024-09-17T01:01:52.223 INFO:tasks.workunit.client.0.smithi002.stdout:9/116: chown d5/l6 28867 1 2024-09-17T01:01:52.223 INFO:tasks.workunit.client.0.smithi002.stdout:9/117: chown d5/f18 54931 1 2024-09-17T01:01:52.224 INFO:tasks.workunit.client.0.smithi002.stdout:0/117: write dd/f14 [225884,42545] 0 2024-09-17T01:01:52.225 INFO:tasks.workunit.client.0.smithi002.stdout:9/118: dread d5/f19 [0,4194304] 0 2024-09-17T01:01:52.225 INFO:tasks.workunit.client.1.smithi099.stdout:5/308: symlink d2/l65 0 2024-09-17T01:01:52.226 INFO:tasks.workunit.client.1.smithi099.stdout:5/309: truncate d2/f7 494028 0 2024-09-17T01:01:52.226 INFO:tasks.workunit.client.0.smithi002.stdout:0/118: symlink dd/d19/l23 0 2024-09-17T01:01:52.227 INFO:tasks.workunit.client.0.smithi002.stdout:0/119: chown dd/l10 3501 1 2024-09-17T01:01:52.227 INFO:tasks.workunit.client.1.smithi099.stdout:5/310: truncate f0 447326 0 2024-09-17T01:01:52.228 INFO:tasks.workunit.client.0.smithi002.stdout:1/171: rmdir d4/d22 39 2024-09-17T01:01:52.229 INFO:tasks.workunit.client.1.smithi099.stdout:4/196: dwrite d7/dd/d21/d26/f32 [4194304,4194304] 0 2024-09-17T01:01:52.229 INFO:tasks.workunit.client.1.smithi099.stdout:4/197: truncate d7/dd/de/d1b/f3e 584406 0 2024-09-17T01:01:52.231 INFO:tasks.workunit.client.0.smithi002.stdout:1/172: unlink d4/d11/d1a/f31 0 2024-09-17T01:01:52.233 INFO:tasks.workunit.client.0.smithi002.stdout:1/173: rmdir d4/d11/d12 39 2024-09-17T01:01:52.235 INFO:tasks.workunit.client.0.smithi002.stdout:1/174: unlink d4/d11/d1c/l1d 0 2024-09-17T01:01:52.236 INFO:tasks.workunit.client.0.smithi002.stdout:1/175: symlink d4/d11/d12/d14/d17/l3c 0 2024-09-17T01:01:52.236 INFO:tasks.workunit.client.0.smithi002.stdout:1/176: chown d4/d11/d12/d14/f1b 97 1 2024-09-17T01:01:52.237 INFO:tasks.workunit.client.0.smithi002.stdout:1/177: creat d4/d11/d12/f3d x:0 0 0 2024-09-17T01:01:52.238 INFO:tasks.workunit.client.0.smithi002.stdout:1/178: mknod d4/d11/d12/d14/d17/d3b/c3e 0 2024-09-17T01:01:52.240 INFO:tasks.workunit.client.0.smithi002.stdout:1/179: rename d4/f13 to d4/f3f 0 2024-09-17T01:01:52.240 INFO:tasks.workunit.client.0.smithi002.stdout:0/120: write dd/f14 [7014796,8013] 0 2024-09-17T01:01:52.240 INFO:tasks.workunit.client.1.smithi099.stdout:8/232: dwrite d0/f30 [0,4194304] 0 2024-09-17T01:01:52.242 INFO:tasks.workunit.client.1.smithi099.stdout:8/233: mknod d0/d1f/d31/c46 0 2024-09-17T01:01:52.242 INFO:tasks.workunit.client.1.smithi099.stdout:8/234: creat d0/f47 x:0 0 0 2024-09-17T01:01:52.243 INFO:tasks.workunit.client.0.smithi002.stdout:1/180: dread d4/d11/d12/d14/f1b [0,4194304] 0 2024-09-17T01:01:52.244 INFO:tasks.workunit.client.1.smithi099.stdout:4/198: dread d7/f16 [0,4194304] 0 2024-09-17T01:01:52.245 INFO:tasks.workunit.client.1.smithi099.stdout:8/235: rmdir d0/d4 39 2024-09-17T01:01:52.252 INFO:tasks.workunit.client.0.smithi002.stdout:2/175: dwrite d1b/d1d/f27 [0,4194304] 0 2024-09-17T01:01:52.252 INFO:tasks.workunit.client.0.smithi002.stdout:5/192: dwrite d2/d2d/f13 [0,4194304] 0 2024-09-17T01:01:52.253 INFO:tasks.workunit.client.1.smithi099.stdout:7/267: dwrite d1/f25 [0,4194304] 0 2024-09-17T01:01:52.253 INFO:tasks.workunit.client.1.smithi099.stdout:4/199: read d7/d35/f36 [2966028,50445] 0 2024-09-17T01:01:52.256 INFO:tasks.workunit.client.1.smithi099.stdout:7/268: link d1/d1e/f34 d1/d2c/d47/f50 0 2024-09-17T01:01:52.257 INFO:tasks.workunit.client.1.smithi099.stdout:4/200: creat d7/dd/d21/f41 x:0 0 0 2024-09-17T01:01:52.258 INFO:tasks.workunit.client.1.smithi099.stdout:7/269: creat d1/d37/f51 x:0 0 0 2024-09-17T01:01:52.261 INFO:tasks.workunit.client.1.smithi099.stdout:4/201: link d7/dd/d21/f38 d7/dd/de/d10/d18/f42 0 2024-09-17T01:01:52.261 INFO:tasks.workunit.client.1.smithi099.stdout:4/202: stat d7/dd/de/d1b 0 2024-09-17T01:01:52.261 INFO:tasks.workunit.client.1.smithi099.stdout:4/203: read - d7/dd/de/d10/d1a/f2d zero size 2024-09-17T01:01:52.263 INFO:tasks.workunit.client.1.smithi099.stdout:5/311: dwrite d2/dc/d17/f53 [0,4194304] 0 2024-09-17T01:01:52.263 INFO:tasks.workunit.client.1.smithi099.stdout:5/312: chown d2/d8 0 1 2024-09-17T01:01:52.267 INFO:tasks.workunit.client.1.smithi099.stdout:8/236: dwrite d0/f40 [0,4194304] 0 2024-09-17T01:01:52.267 INFO:tasks.workunit.client.1.smithi099.stdout:8/237: chown d0/d1f/c16 218602 1 2024-09-17T01:01:52.268 INFO:tasks.workunit.client.1.smithi099.stdout:0/208: dwrite da/f14 [0,4194304] 0 2024-09-17T01:01:52.271 INFO:tasks.workunit.client.0.smithi002.stdout:2/176: write f19 [7418685,83578] 0 2024-09-17T01:01:52.273 INFO:tasks.workunit.client.1.smithi099.stdout:0/209: mknod da/df/c46 0 2024-09-17T01:01:52.273 INFO:tasks.workunit.client.1.smithi099.stdout:0/210: truncate da/d1c/f3d 1073100 0 2024-09-17T01:01:52.273 INFO:tasks.workunit.client.1.smithi099.stdout:8/238: write d0/d1f/f2b [7860671,44962] 0 2024-09-17T01:01:52.273 INFO:tasks.workunit.client.1.smithi099.stdout:8/239: write d0/d4/f42 [2409704,127102] 0 2024-09-17T01:01:52.274 INFO:tasks.workunit.client.1.smithi099.stdout:8/240: symlink d0/d1f/l48 0 2024-09-17T01:01:52.274 INFO:tasks.workunit.client.1.smithi099.stdout:8/241: fdatasync d0/d4/fb 0 2024-09-17T01:01:52.276 INFO:tasks.workunit.client.1.smithi099.stdout:8/242: creat d0/d4/f49 x:0 0 0 2024-09-17T01:01:52.277 INFO:tasks.workunit.client.1.smithi099.stdout:8/243: creat d0/d41/f4a x:0 0 0 2024-09-17T01:01:52.279 INFO:tasks.workunit.client.1.smithi099.stdout:8/244: mkdir d0/d4/d29/d4b 0 2024-09-17T01:01:52.280 INFO:tasks.workunit.client.1.smithi099.stdout:8/245: mkdir d0/d1f/d31/d4c 0 2024-09-17T01:01:52.281 INFO:tasks.workunit.client.1.smithi099.stdout:0/211: read da/d1c/d1e/f24 [3591445,102195] 0 2024-09-17T01:01:52.281 INFO:tasks.workunit.client.1.smithi099.stdout:0/212: fsync da/df/f15 0 2024-09-17T01:01:52.281 INFO:tasks.workunit.client.1.smithi099.stdout:0/213: creat da/df/f47 x:0 0 0 2024-09-17T01:01:52.281 INFO:tasks.workunit.client.1.smithi099.stdout:0/214: readlink da/d12/d2b/l30 0 2024-09-17T01:01:52.281 INFO:tasks.workunit.client.1.smithi099.stdout:0/215: fdatasync da/d1c/f3d 0 2024-09-17T01:01:52.281 INFO:tasks.workunit.client.0.smithi002.stdout:2/177: write f19 [2679830,128190] 0 2024-09-17T01:01:52.282 INFO:tasks.workunit.client.0.smithi002.stdout:2/178: creat d1b/d1d/d2a/f3b x:0 0 0 2024-09-17T01:01:52.289 INFO:tasks.workunit.client.0.smithi002.stdout:5/193: dwrite d2/d2d/f13 [4194304,4194304] 0 2024-09-17T01:01:52.289 INFO:tasks.workunit.client.0.smithi002.stdout:5/194: dread - d2/de/f34 zero size 2024-09-17T01:01:52.290 INFO:tasks.workunit.client.0.smithi002.stdout:5/195: mkdir d2/d2d/d10/d3b 0 2024-09-17T01:01:52.293 INFO:tasks.workunit.client.1.smithi099.stdout:4/204: rmdir d7/dd/d21 39 2024-09-17T01:01:52.293 INFO:tasks.workunit.client.1.smithi099.stdout:4/205: getdents d7/dd/d21/d26/d3f 0 2024-09-17T01:01:52.293 INFO:tasks.workunit.client.1.smithi099.stdout:4/206: stat d7/dd/d21 0 2024-09-17T01:01:52.293 INFO:tasks.workunit.client.1.smithi099.stdout:4/207: creat d7/dd/de/d10/d18/f43 x:0 0 0 2024-09-17T01:01:52.295 INFO:tasks.workunit.client.1.smithi099.stdout:4/208: rename l3 to d7/dd/l44 0 2024-09-17T01:01:52.295 INFO:tasks.workunit.client.1.smithi099.stdout:4/209: fsync d7/dd/de/f14 0 2024-09-17T01:01:52.296 INFO:tasks.workunit.client.1.smithi099.stdout:4/210: symlink d7/dd/de/d10/d1a/l45 0 2024-09-17T01:01:52.301 INFO:tasks.workunit.client.0.smithi002.stdout:9/119: rmdir d5 39 2024-09-17T01:01:52.302 INFO:tasks.workunit.client.1.smithi099.stdout:0/216: dread da/df/f15 [0,4194304] 0 2024-09-17T01:01:52.302 INFO:tasks.workunit.client.0.smithi002.stdout:5/196: dread d2/f9 [0,4194304] 0 2024-09-17T01:01:52.304 INFO:tasks.workunit.client.0.smithi002.stdout:2/179: dwrite d1b/d1d/f27 [0,4194304] 0 2024-09-17T01:01:52.304 INFO:tasks.workunit.client.0.smithi002.stdout:9/120: rename f0 to d5/f20 0 2024-09-17T01:01:52.304 INFO:tasks.workunit.client.0.smithi002.stdout:9/121: write d5/f18 [731156,28060] 0 2024-09-17T01:01:52.305 INFO:tasks.workunit.client.0.smithi002.stdout:5/197: creat d2/d2d/d10/d14/d19/d39/f3c x:0 0 0 2024-09-17T01:01:52.306 INFO:tasks.workunit.client.1.smithi099.stdout:7/270: dwrite d1/d2c/f40 [0,4194304] 0 2024-09-17T01:01:52.307 INFO:tasks.workunit.client.1.smithi099.stdout:7/271: write d1/d36/f45 [329727,90145] 0 2024-09-17T01:01:52.307 INFO:tasks.workunit.client.1.smithi099.stdout:5/313: dwrite d2/dc/d17/f59 [0,4194304] 0 2024-09-17T01:01:52.307 INFO:tasks.workunit.client.1.smithi099.stdout:0/217: dread da/df/f15 [0,4194304] 0 2024-09-17T01:01:52.307 INFO:tasks.workunit.client.0.smithi002.stdout:0/121: dwrite dd/f14 [0,4194304] 0 2024-09-17T01:01:52.308 INFO:tasks.workunit.client.0.smithi002.stdout:2/180: creat d1b/d1d/d38/f3c x:0 0 0 2024-09-17T01:01:52.308 INFO:tasks.workunit.client.1.smithi099.stdout:8/246: dwrite d0/d1f/d31/f38 [0,4194304] 0 2024-09-17T01:01:52.309 INFO:tasks.workunit.client.1.smithi099.stdout:7/272: mknod d1/d1e/d3f/c52 0 2024-09-17T01:01:52.309 INFO:tasks.workunit.client.1.smithi099.stdout:7/273: creat d1/d1e/d12/f53 x:0 0 0 2024-09-17T01:01:52.312 INFO:tasks.workunit.client.1.smithi099.stdout:4/211: getdents d7/dd/de/d10/d1a 0 2024-09-17T01:01:52.314 INFO:tasks.workunit.client.0.smithi002.stdout:2/181: rename d1b/d1d/f27 to d1b/d1d/d38/f3d 0 2024-09-17T01:01:52.314 INFO:tasks.workunit.client.1.smithi099.stdout:5/314: creat d2/dc/f66 x:0 0 0 2024-09-17T01:01:52.315 INFO:tasks.workunit.client.0.smithi002.stdout:9/122: mknod d5/c21 0 2024-09-17T01:01:52.316 INFO:tasks.workunit.client.0.smithi002.stdout:9/123: dread - d5/f1f zero size 2024-09-17T01:01:52.316 INFO:tasks.workunit.client.0.smithi002.stdout:9/124: truncate d5/f20 3990371 0 2024-09-17T01:01:52.316 INFO:tasks.workunit.client.0.smithi002.stdout:9/125: dread - d5/f1e zero size 2024-09-17T01:01:52.316 INFO:tasks.workunit.client.1.smithi099.stdout:4/212: dread d7/f16 [0,4194304] 0 2024-09-17T01:01:52.317 INFO:tasks.workunit.client.0.smithi002.stdout:9/126: read d5/dc/f1b [572958,51488] 0 2024-09-17T01:01:52.317 INFO:tasks.workunit.client.0.smithi002.stdout:2/182: mkdir d1b/d1d/d38/d3e 0 2024-09-17T01:01:52.318 INFO:tasks.workunit.client.1.smithi099.stdout:5/315: creat d2/dc/d14/d36/f67 x:0 0 0 2024-09-17T01:01:52.318 INFO:tasks.workunit.client.1.smithi099.stdout:5/316: chown d2/dc/c37 0 1 2024-09-17T01:01:52.318 INFO:tasks.workunit.client.0.smithi002.stdout:0/122: dread dd/f14 [4194304,4194304] 0 2024-09-17T01:01:52.318 INFO:tasks.workunit.client.0.smithi002.stdout:0/123: creat dd/d19/f24 x:0 0 0 2024-09-17T01:01:52.319 INFO:tasks.workunit.client.1.smithi099.stdout:5/317: dread d2/dc/f39 [0,4194304] 0 2024-09-17T01:01:52.319 INFO:tasks.workunit.client.1.smithi099.stdout:5/318: fdatasync d2/f40 0 2024-09-17T01:01:52.320 INFO:tasks.workunit.client.0.smithi002.stdout:0/124: dread dd/f18 [0,4194304] 0 2024-09-17T01:01:52.320 INFO:tasks.workunit.client.0.smithi002.stdout:0/125: fsync dd/f14 0 2024-09-17T01:01:52.320 INFO:tasks.workunit.client.0.smithi002.stdout:2/183: mkdir d1b/d3f 0 2024-09-17T01:01:52.322 INFO:tasks.workunit.client.1.smithi099.stdout:4/213: unlink d7/dd/de/f29 0 2024-09-17T01:01:52.322 INFO:tasks.workunit.client.1.smithi099.stdout:8/247: write d0/f40 [402003,75691] 0 2024-09-17T01:01:52.323 INFO:tasks.workunit.client.1.smithi099.stdout:8/248: creat d0/d1f/f4d x:0 0 0 2024-09-17T01:01:52.324 INFO:tasks.workunit.client.0.smithi002.stdout:0/126: symlink dd/d19/d1c/d1f/d22/l25 0 2024-09-17T01:01:52.324 INFO:tasks.workunit.client.0.smithi002.stdout:8/191: sync 2024-09-17T01:01:52.324 INFO:tasks.workunit.client.0.smithi002.stdout:8/192: write d2/d26/d2b/f36 [293774,43993] 0 2024-09-17T01:01:52.326 INFO:tasks.workunit.client.0.smithi002.stdout:0/127: mknod dd/d19/d1c/d1f/c26 0 2024-09-17T01:01:52.326 INFO:tasks.workunit.client.1.smithi099.stdout:8/249: creat d0/d4/d29/d4b/f4e x:0 0 0 2024-09-17T01:01:52.327 INFO:tasks.workunit.client.0.smithi002.stdout:5/198: write d2/dc/f16 [2613236,53324] 0 2024-09-17T01:01:52.327 INFO:tasks.workunit.client.1.smithi099.stdout:7/274: dread d1/d36/f45 [0,4194304] 0 2024-09-17T01:01:52.328 INFO:tasks.workunit.client.0.smithi002.stdout:8/193: link d2/fb d2/d3/f48 0 2024-09-17T01:01:52.328 INFO:tasks.workunit.client.0.smithi002.stdout:8/194: chown d2/d30/c45 107152 1 2024-09-17T01:01:52.328 INFO:tasks.workunit.client.0.smithi002.stdout:8/195: rename d2 to d2/d41/d49 22 2024-09-17T01:01:52.328 INFO:tasks.workunit.client.0.smithi002.stdout:8/196: write d2/d3/f19 [1561766,61147] 0 2024-09-17T01:01:52.329 INFO:tasks.workunit.client.1.smithi099.stdout:0/218: dwrite f7 [4194304,4194304] 0 2024-09-17T01:01:52.329 INFO:tasks.workunit.client.1.smithi099.stdout:8/250: unlink d0/d41/f4a 0 2024-09-17T01:01:52.329 INFO:tasks.workunit.client.1.smithi099.stdout:8/251: write d0/f47 [413340,129152] 0 2024-09-17T01:01:52.329 INFO:tasks.workunit.client.1.smithi099.stdout:8/252: chown d0/d1f/d31/c44 3295369 1 2024-09-17T01:01:52.331 INFO:tasks.workunit.client.1.smithi099.stdout:8/253: dread d0/d1f/f14 [0,4194304] 0 2024-09-17T01:01:52.331 INFO:tasks.workunit.client.1.smithi099.stdout:7/275: symlink d1/d1e/d12/l54 0 2024-09-17T01:01:52.331 INFO:tasks.workunit.client.1.smithi099.stdout:5/319: dread d2/dc/d14/d19/f4b [0,4194304] 0 2024-09-17T01:01:52.332 INFO:tasks.workunit.client.0.smithi002.stdout:5/199: symlink d2/de/d1d/l3d 0 2024-09-17T01:01:52.332 INFO:tasks.workunit.client.0.smithi002.stdout:5/200: readlink d2/de/d1d/l30 0 2024-09-17T01:01:52.335 INFO:tasks.workunit.client.0.smithi002.stdout:2/184: read d1b/f1e [4006890,58230] 0 2024-09-17T01:01:52.336 INFO:tasks.workunit.client.0.smithi002.stdout:8/197: rename d2/d26/l27 to d2/d1c/l4a 0 2024-09-17T01:01:52.336 INFO:tasks.workunit.client.1.smithi099.stdout:0/219: symlink da/df/l48 0 2024-09-17T01:01:52.336 INFO:tasks.workunit.client.1.smithi099.stdout:0/220: chown f7 7033 1 2024-09-17T01:01:52.336 INFO:tasks.workunit.client.1.smithi099.stdout:0/221: read f7 [147544,45986] 0 2024-09-17T01:01:52.336 INFO:tasks.workunit.client.1.smithi099.stdout:0/222: write da/f27 [1469315,78173] 0 2024-09-17T01:01:52.336 INFO:tasks.workunit.client.1.smithi099.stdout:0/223: chown da/df/d1a/d23/f3c 114844 1 2024-09-17T01:01:52.339 INFO:tasks.workunit.client.0.smithi002.stdout:8/198: mknod d2/d26/c4b 0 2024-09-17T01:01:52.339 INFO:tasks.workunit.client.0.smithi002.stdout:8/199: write d2/d9/f38 [884193,80412] 0 2024-09-17T01:01:52.339 INFO:tasks.workunit.client.0.smithi002.stdout:2/185: rmdir d1b/d1d/d2a 39 2024-09-17T01:01:52.340 INFO:tasks.workunit.client.1.smithi099.stdout:0/224: getdents da/d3b 0 2024-09-17T01:01:52.341 INFO:tasks.workunit.client.1.smithi099.stdout:0/225: mkdir da/df/d1a/d49 0 2024-09-17T01:01:52.341 INFO:tasks.workunit.client.1.smithi099.stdout:0/226: truncate da/df/d31/f34 220255 0 2024-09-17T01:01:52.342 INFO:tasks.workunit.client.0.smithi002.stdout:2/186: symlink d1b/d1d/d2a/l40 0 2024-09-17T01:01:52.343 INFO:tasks.workunit.client.1.smithi099.stdout:0/227: creat da/df/d1a/d49/f4a x:0 0 0 2024-09-17T01:01:52.343 INFO:tasks.workunit.client.1.smithi099.stdout:0/228: dread - da/df/f41 zero size 2024-09-17T01:01:52.344 INFO:tasks.workunit.client.0.smithi002.stdout:2/187: rename l11 to d1b/l41 0 2024-09-17T01:01:52.344 INFO:tasks.workunit.client.1.smithi099.stdout:0/229: rename da/cd to da/df/d31/c4b 0 2024-09-17T01:01:52.345 INFO:tasks.workunit.client.0.smithi002.stdout:2/188: creat d1b/d37/f42 x:0 0 0 2024-09-17T01:01:52.345 INFO:tasks.workunit.client.1.smithi099.stdout:0/230: rename da/df/d1a/f29 to da/df/d31/f4c 0 2024-09-17T01:01:52.345 INFO:tasks.workunit.client.1.smithi099.stdout:0/231: chown da/df/d1a/d23/f40 0 1 2024-09-17T01:01:52.346 INFO:tasks.workunit.client.1.smithi099.stdout:0/232: rmdir da/d1c 39 2024-09-17T01:01:52.352 INFO:tasks.workunit.client.1.smithi099.stdout:4/214: dwrite d7/d35/f36 [0,4194304] 0 2024-09-17T01:01:52.352 INFO:tasks.workunit.client.1.smithi099.stdout:4/215: chown l5 7565602 1 2024-09-17T01:01:52.353 INFO:tasks.workunit.client.1.smithi099.stdout:4/216: rename l0 to d7/l46 0 2024-09-17T01:01:52.354 INFO:tasks.workunit.client.1.smithi099.stdout:4/217: stat l5 0 2024-09-17T01:01:52.354 INFO:tasks.workunit.client.1.smithi099.stdout:4/218: chown d7/dd/de/d17 16351 1 2024-09-17T01:01:52.365 INFO:tasks.workunit.client.0.smithi002.stdout:9/127: dwrite d5/f20 [4194304,4194304] 0 2024-09-17T01:01:52.368 INFO:tasks.workunit.client.0.smithi002.stdout:9/128: rename d5/l15 to d5/l22 0 2024-09-17T01:01:52.368 INFO:tasks.workunit.client.0.smithi002.stdout:9/129: chown d5/f20 673157500 1 2024-09-17T01:01:52.370 INFO:tasks.workunit.client.0.smithi002.stdout:9/130: rename d5/dc/c1c to d5/c23 0 2024-09-17T01:01:52.371 INFO:tasks.workunit.client.0.smithi002.stdout:9/131: mknod d5/dc/c24 0 2024-09-17T01:01:52.371 INFO:tasks.workunit.client.1.smithi099.stdout:0/233: read da/d1c/d1e/f1f [2382080,55670] 0 2024-09-17T01:01:52.371 INFO:tasks.workunit.client.1.smithi099.stdout:0/234: readlink da/df/l11 0 2024-09-17T01:01:52.372 INFO:tasks.workunit.client.1.smithi099.stdout:0/235: write da/d12/f16 [4583182,128031] 0 2024-09-17T01:01:52.372 INFO:tasks.workunit.client.1.smithi099.stdout:0/236: mkdir da/df/d4d 0 2024-09-17T01:01:52.373 INFO:tasks.workunit.client.0.smithi002.stdout:9/132: dread d5/f18 [0,4194304] 0 2024-09-17T01:01:52.373 INFO:tasks.workunit.client.0.smithi002.stdout:9/133: chown d5/fb 727475 1 2024-09-17T01:01:52.373 INFO:tasks.workunit.client.0.smithi002.stdout:9/134: rename d5/f1f to d5/dc/f25 0 2024-09-17T01:01:52.380 INFO:tasks.workunit.client.1.smithi099.stdout:7/276: dwrite d1/d1e/d12/f18 [0,4194304] 0 2024-09-17T01:01:52.382 INFO:tasks.workunit.client.1.smithi099.stdout:7/277: symlink d1/d2c/d47/l55 0 2024-09-17T01:01:52.382 INFO:tasks.workunit.client.1.smithi099.stdout:7/278: creat d1/d37/f56 x:0 0 0 2024-09-17T01:01:52.383 INFO:tasks.workunit.client.0.smithi002.stdout:5/201: dwrite d2/d2d/d10/d20/d24/f2e [0,4194304] 0 2024-09-17T01:01:52.383 INFO:tasks.workunit.client.1.smithi099.stdout:5/320: dwrite d2/d8/fb [0,4194304] 0 2024-09-17T01:01:52.386 INFO:tasks.workunit.client.1.smithi099.stdout:8/254: getdents d0/d4/d29/d4b 0 2024-09-17T01:01:52.387 INFO:tasks.workunit.client.1.smithi099.stdout:8/255: truncate d0/d1f/d31/f43 662064 0 2024-09-17T01:01:52.388 INFO:tasks.workunit.client.1.smithi099.stdout:8/256: symlink d0/d4/d29/d4b/l4f 0 2024-09-17T01:01:52.389 INFO:tasks.workunit.client.1.smithi099.stdout:8/257: creat d0/d4/f50 x:0 0 0 2024-09-17T01:01:52.389 INFO:tasks.workunit.client.1.smithi099.stdout:4/219: dwrite d7/dd/de/d17/f25 [0,4194304] 0 2024-09-17T01:01:52.392 INFO:tasks.workunit.client.1.smithi099.stdout:4/220: mknod d7/dd/d21/c47 0 2024-09-17T01:01:52.394 INFO:tasks.workunit.client.0.smithi002.stdout:8/200: dwrite d2/f1d [0,4194304] 0 2024-09-17T01:01:52.394 INFO:tasks.workunit.client.0.smithi002.stdout:2/189: dwrite f19 [0,4194304] 0 2024-09-17T01:01:52.397 INFO:tasks.workunit.client.0.smithi002.stdout:9/135: dwrite d5/dc/f1b [0,4194304] 0 2024-09-17T01:01:52.397 INFO:tasks.workunit.client.1.smithi099.stdout:7/279: read d1/d1e/f4a [751562,60634] 0 2024-09-17T01:01:52.398 INFO:tasks.workunit.client.1.smithi099.stdout:4/221: symlink d7/dd/d21/d26/l48 0 2024-09-17T01:01:52.399 INFO:tasks.workunit.client.0.smithi002.stdout:8/201: unlink d2/d30/c42 0 2024-09-17T01:01:52.399 INFO:tasks.workunit.client.1.smithi099.stdout:0/237: dread da/d12/f16 [0,4194304] 0 2024-09-17T01:01:52.399 INFO:tasks.workunit.client.1.smithi099.stdout:5/321: write d2/d8/fb [389309,4675] 0 2024-09-17T01:01:52.399 INFO:tasks.workunit.client.1.smithi099.stdout:0/238: chown da/d12/d2b/f37 19775459 1 2024-09-17T01:01:52.400 INFO:tasks.workunit.client.1.smithi099.stdout:4/222: mknod d7/dd/de/d17/c49 0 2024-09-17T01:01:52.402 INFO:tasks.workunit.client.1.smithi099.stdout:5/322: truncate d2/f18 4466715 0 2024-09-17T01:01:52.403 INFO:tasks.workunit.client.0.smithi002.stdout:5/202: dwrite d2/f6 [12582912,4194304] 0 2024-09-17T01:01:52.404 INFO:tasks.workunit.client.1.smithi099.stdout:4/223: symlink d7/dd/d21/l4a 0 2024-09-17T01:01:52.405 INFO:tasks.workunit.client.0.smithi002.stdout:2/190: write f17 [2265007,104986] 0 2024-09-17T01:01:52.405 INFO:tasks.workunit.client.0.smithi002.stdout:8/202: creat d2/d1c/d3b/f4c x:0 0 0 2024-09-17T01:01:52.407 INFO:tasks.workunit.client.1.smithi099.stdout:4/224: rename d7/dd/de/d1b to d7/dd/de/d10/d18/d4b 0 2024-09-17T01:01:52.409 INFO:tasks.workunit.client.1.smithi099.stdout:4/225: symlink d7/dd/d21/d26/d3f/l4c 0 2024-09-17T01:01:52.409 INFO:tasks.workunit.client.0.smithi002.stdout:5/203: rename d2/de/ff to d2/d2d/d10/d20/f3e 0 2024-09-17T01:01:52.412 INFO:tasks.workunit.client.0.smithi002.stdout:2/191: symlink d1b/d1d/d38/d3e/l43 0 2024-09-17T01:01:52.413 INFO:tasks.workunit.client.0.smithi002.stdout:2/192: write d1b/d1d/d2a/f2f [373927,72] 0 2024-09-17T01:01:52.413 INFO:tasks.workunit.client.0.smithi002.stdout:8/203: dread - d2/f37 zero size 2024-09-17T01:01:52.415 INFO:tasks.workunit.client.1.smithi099.stdout:7/280: rmdir d1/d2c 39 2024-09-17T01:01:52.415 INFO:tasks.workunit.client.0.smithi002.stdout:2/193: mknod d1b/d37/c44 0 2024-09-17T01:01:52.415 INFO:tasks.workunit.client.0.smithi002.stdout:2/194: rename d1b to d1b/d3f/d45 22 2024-09-17T01:01:52.416 INFO:tasks.workunit.client.1.smithi099.stdout:7/281: rename d1/d1e/c28 to d1/d37/d4f/c57 0 2024-09-17T01:01:52.417 INFO:tasks.workunit.client.1.smithi099.stdout:7/282: creat d1/d37/f58 x:0 0 0 2024-09-17T01:01:52.419 INFO:tasks.workunit.client.1.smithi099.stdout:7/283: symlink d1/d2c/d47/d48/l59 0 2024-09-17T01:01:52.420 INFO:tasks.workunit.client.0.smithi002.stdout:8/204: symlink d2/d9/l4d 0 2024-09-17T01:01:52.420 INFO:tasks.workunit.client.1.smithi099.stdout:7/284: mkdir d1/d1e/d1c/d5a 0 2024-09-17T01:01:52.422 INFO:tasks.workunit.client.1.smithi099.stdout:7/285: symlink d1/d36/l5b 0 2024-09-17T01:01:52.423 INFO:tasks.workunit.client.0.smithi002.stdout:6/210: sync 2024-09-17T01:01:52.423 INFO:tasks.workunit.client.0.smithi002.stdout:4/193: sync 2024-09-17T01:01:52.423 INFO:tasks.workunit.client.0.smithi002.stdout:6/211: write d2/d1d/d26/f2a [1015910,15357] 0 2024-09-17T01:01:52.424 INFO:tasks.workunit.client.0.smithi002.stdout:6/212: truncate d2/f18 589183 0 2024-09-17T01:01:52.424 INFO:tasks.workunit.client.0.smithi002.stdout:6/213: truncate d2/dc/d34/f39 791726 0 2024-09-17T01:01:52.425 INFO:tasks.workunit.client.0.smithi002.stdout:6/214: mknod d2/d1d/d26/c3f 0 2024-09-17T01:01:52.425 INFO:tasks.workunit.client.1.smithi099.stdout:4/226: write d7/d35/f36 [882350,87308] 0 2024-09-17T01:01:52.425 INFO:tasks.workunit.client.1.smithi099.stdout:4/227: dread - d7/dd/de/f3c zero size 2024-09-17T01:01:52.427 INFO:tasks.workunit.client.1.smithi099.stdout:4/228: mknod d7/dd/de/d10/c4d 0 2024-09-17T01:01:52.427 INFO:tasks.workunit.client.1.smithi099.stdout:4/229: write d7/dd/de/f14 [285526,84608] 0 2024-09-17T01:01:52.428 INFO:tasks.workunit.client.1.smithi099.stdout:4/230: dread - d7/d35/f3d zero size 2024-09-17T01:01:52.428 INFO:tasks.workunit.client.1.smithi099.stdout:4/231: creat d7/dd/de/f4e x:0 0 0 2024-09-17T01:01:52.428 INFO:tasks.workunit.client.1.smithi099.stdout:4/232: creat d7/dd/de/f4f x:0 0 0 2024-09-17T01:01:52.428 INFO:tasks.workunit.client.0.smithi002.stdout:6/215: rmdir d2/d1d/d2d/d35/d37 39 2024-09-17T01:01:52.430 INFO:tasks.workunit.client.0.smithi002.stdout:6/216: unlink d2/d1d/l3e 0 2024-09-17T01:01:52.430 INFO:tasks.workunit.client.0.smithi002.stdout:6/217: readlink d2/dc/lf 0 2024-09-17T01:01:52.432 INFO:tasks.workunit.client.0.smithi002.stdout:6/218: dread d2/d1d/d2d/f2e [0,4194304] 0 2024-09-17T01:01:52.434 INFO:tasks.workunit.client.0.smithi002.stdout:6/219: unlink d2/dc/c2c 0 2024-09-17T01:01:52.435 INFO:tasks.workunit.client.1.smithi099.stdout:3/237: sync 2024-09-17T01:01:52.435 INFO:tasks.workunit.client.1.smithi099.stdout:3/238: readlink d9/d15/d18/d1a/d23/l3e 0 2024-09-17T01:01:52.436 INFO:tasks.workunit.client.1.smithi099.stdout:7/286: write d1/d2c/f40 [147544,56236] 0 2024-09-17T01:01:52.436 INFO:tasks.workunit.client.1.smithi099.stdout:3/239: rmdir d9/d15/d18/d1a 39 2024-09-17T01:01:52.443 INFO:tasks.workunit.client.0.smithi002.stdout:9/136: dwrite d5/dc/f25 [0,4194304] 0 2024-09-17T01:01:52.443 INFO:tasks.workunit.client.0.smithi002.stdout:9/137: dread - d5/f1e zero size 2024-09-17T01:01:52.443 INFO:tasks.workunit.client.0.smithi002.stdout:9/138: chown d5/l6 2106 1 2024-09-17T01:01:52.443 INFO:tasks.workunit.client.0.smithi002.stdout:9/139: fsync d5/fb 0 2024-09-17T01:01:52.448 INFO:tasks.workunit.client.0.smithi002.stdout:4/194: write d7/de/f2a [3752216,67201] 0 2024-09-17T01:01:52.450 INFO:tasks.workunit.client.1.smithi099.stdout:8/258: dwrite d0/d4/f49 [0,4194304] 0 2024-09-17T01:01:52.450 INFO:tasks.workunit.client.0.smithi002.stdout:4/195: link d7/c2c d7/de/c3b 0 2024-09-17T01:01:52.452 INFO:tasks.workunit.client.1.smithi099.stdout:8/259: mknod d0/d4/c51 0 2024-09-17T01:01:52.453 INFO:tasks.workunit.client.1.smithi099.stdout:8/260: symlink d0/d41/l52 0 2024-09-17T01:01:52.454 INFO:tasks.workunit.client.1.smithi099.stdout:8/261: mkdir d0/d53 0 2024-09-17T01:01:52.454 INFO:tasks.workunit.client.1.smithi099.stdout:8/262: write d0/d1f/f4d [241481,100305] 0 2024-09-17T01:01:52.454 INFO:tasks.workunit.client.1.smithi099.stdout:8/263: creat d0/f54 x:0 0 0 2024-09-17T01:01:52.455 INFO:tasks.workunit.client.1.smithi099.stdout:8/264: mkdir d0/d1f/d55 0 2024-09-17T01:01:52.463 INFO:tasks.workunit.client.1.smithi099.stdout:5/323: dwrite d2/d8/f49 [0,4194304] 0 2024-09-17T01:01:52.463 INFO:tasks.workunit.client.1.smithi099.stdout:5/324: chown d2/dc/d14/d19/c30 3564 1 2024-09-17T01:01:52.467 INFO:tasks.workunit.client.1.smithi099.stdout:7/287: rename d1/d1e to d1/d2c/d5c 0 2024-09-17T01:01:52.467 INFO:tasks.workunit.client.1.smithi099.stdout:7/288: dread - d1/d2c/f2d zero size 2024-09-17T01:01:52.468 INFO:tasks.workunit.client.1.smithi099.stdout:7/289: rename d1/d2c/d5c/ca to d1/d2c/d5c/d1c/c5d 0 2024-09-17T01:01:52.472 INFO:tasks.workunit.client.1.smithi099.stdout:4/233: dwrite d7/fb [4194304,4194304] 0 2024-09-17T01:01:52.472 INFO:tasks.workunit.client.0.smithi002.stdout:5/204: dwrite d2/d2d/d10/d20/d24/f31 [4194304,4194304] 0 2024-09-17T01:01:52.474 INFO:tasks.workunit.client.1.smithi099.stdout:5/325: write d2/f22 [453653,112427] 0 2024-09-17T01:01:52.475 INFO:tasks.workunit.client.0.smithi002.stdout:2/195: getdents d1b/d1d/d38/d3e 0 2024-09-17T01:01:52.475 INFO:tasks.workunit.client.0.smithi002.stdout:2/196: write d1b/d1d/d2a/f2f [1141323,44590] 0 2024-09-17T01:01:52.475 INFO:tasks.workunit.client.0.smithi002.stdout:2/197: creat d1b/d1d/d38/f46 x:0 0 0 2024-09-17T01:01:52.476 INFO:tasks.workunit.client.1.smithi099.stdout:5/326: write d2/dc/d14/d19/f4b [1136979,53473] 0 2024-09-17T01:01:52.476 INFO:tasks.workunit.client.0.smithi002.stdout:2/198: dread d1b/f3a [0,4194304] 0 2024-09-17T01:01:52.476 INFO:tasks.workunit.client.0.smithi002.stdout:2/199: chown d1b/d1d/d2a/l40 24 1 2024-09-17T01:01:52.477 INFO:tasks.workunit.client.1.smithi099.stdout:5/327: rename d2/dc/d17/f62 to d2/d26/d64/f68 0 2024-09-17T01:01:52.478 INFO:tasks.workunit.client.0.smithi002.stdout:9/140: dwrite d5/f18 [0,4194304] 0 2024-09-17T01:01:52.478 INFO:tasks.workunit.client.0.smithi002.stdout:9/141: write d5/fb [1307511,126046] 0 2024-09-17T01:01:52.479 INFO:tasks.workunit.client.1.smithi099.stdout:4/234: dread d7/d35/f36 [0,4194304] 0 2024-09-17T01:01:52.479 INFO:tasks.workunit.client.1.smithi099.stdout:4/235: chown d7/dd/d21/d26/c33 1079552 1 2024-09-17T01:01:52.480 INFO:tasks.workunit.client.0.smithi002.stdout:9/142: dread d5/f19 [0,4194304] 0 2024-09-17T01:01:52.480 INFO:tasks.workunit.client.0.smithi002.stdout:9/143: chown d5/l1a 302586798 1 2024-09-17T01:01:52.481 INFO:tasks.workunit.client.0.smithi002.stdout:9/144: mkdir d5/dc/d26 0 2024-09-17T01:01:52.482 INFO:tasks.workunit.client.1.smithi099.stdout:3/240: dwrite d9/f30 [0,4194304] 0 2024-09-17T01:01:52.482 INFO:tasks.workunit.client.1.smithi099.stdout:3/241: chown d9/d15/d18/d1a/d23/c28 55620 1 2024-09-17T01:01:52.486 INFO:tasks.workunit.client.0.smithi002.stdout:2/200: write f5 [3774155,76577] 0 2024-09-17T01:01:52.486 INFO:tasks.workunit.client.0.smithi002.stdout:2/201: creat d1b/d1d/f47 x:0 0 0 2024-09-17T01:01:52.486 INFO:tasks.workunit.client.0.smithi002.stdout:2/202: fsync d1b/d1d/f1f 0 2024-09-17T01:01:52.493 INFO:tasks.workunit.client.0.smithi002.stdout:9/145: dread d5/f18 [0,4194304] 0 2024-09-17T01:01:52.493 INFO:tasks.workunit.client.0.smithi002.stdout:6/220: write d2/f18 [548736,127125] 0 2024-09-17T01:01:52.493 INFO:tasks.workunit.client.1.smithi099.stdout:3/242: rmdir d9/d3b/d44 39 2024-09-17T01:01:52.494 INFO:tasks.workunit.client.0.smithi002.stdout:6/221: rmdir d2/d1d/d26 39 2024-09-17T01:01:52.496 INFO:tasks.workunit.client.0.smithi002.stdout:4/196: dwrite d7/de/f15 [0,4194304] 0 2024-09-17T01:01:52.497 INFO:tasks.workunit.client.1.smithi099.stdout:8/265: dwrite d0/d1f/f2b [0,4194304] 0 2024-09-17T01:01:52.499 INFO:tasks.workunit.client.1.smithi099.stdout:8/266: unlink d0/d1f/d31/c44 0 2024-09-17T01:01:52.499 INFO:tasks.workunit.client.0.smithi002.stdout:4/197: rename d7/f36 to d7/de/d3a/f3c 0 2024-09-17T01:01:52.500 INFO:tasks.workunit.client.1.smithi099.stdout:8/267: symlink d0/d1f/d31/l56 0 2024-09-17T01:01:52.500 INFO:tasks.workunit.client.1.smithi099.stdout:8/268: truncate d0/f54 532008 0 2024-09-17T01:01:52.501 INFO:tasks.workunit.client.1.smithi099.stdout:8/269: creat d0/d4/d29/f57 x:0 0 0 2024-09-17T01:01:52.502 INFO:tasks.workunit.client.1.smithi099.stdout:8/270: readlink d0/d4/l26 0 2024-09-17T01:01:52.502 INFO:tasks.workunit.client.1.smithi099.stdout:8/271: write d0/d1f/f2b [8891719,44304] 0 2024-09-17T01:01:52.503 INFO:tasks.workunit.client.1.smithi099.stdout:8/272: dread d0/d1f/d31/f43 [0,4194304] 0 2024-09-17T01:01:52.503 INFO:tasks.workunit.client.1.smithi099.stdout:8/273: chown d0/d1f/d31/c3e 18462 1 2024-09-17T01:01:52.503 INFO:tasks.workunit.client.1.smithi099.stdout:8/274: dread - d0/d4/f50 zero size 2024-09-17T01:01:52.503 INFO:tasks.workunit.client.1.smithi099.stdout:8/275: creat d0/d4/d29/f58 x:0 0 0 2024-09-17T01:01:52.504 INFO:tasks.workunit.client.1.smithi099.stdout:3/243: dread d9/d15/f34 [0,4194304] 0 2024-09-17T01:01:52.504 INFO:tasks.workunit.client.1.smithi099.stdout:3/244: fsync d9/d15/d18/d1a/f1b 0 2024-09-17T01:01:52.504 INFO:tasks.workunit.client.1.smithi099.stdout:3/245: readlink d9/d15/d18/d1a/d23/l13 0 2024-09-17T01:01:52.506 INFO:tasks.workunit.client.1.smithi099.stdout:7/290: dwrite d1/d36/f45 [0,4194304] 0 2024-09-17T01:01:52.507 INFO:tasks.workunit.client.1.smithi099.stdout:3/246: rename f3 to d9/d15/d18/d1a/d23/f4a 0 2024-09-17T01:01:52.513 INFO:tasks.workunit.client.1.smithi099.stdout:5/328: dwrite d2/dc/d17/f59 [0,4194304] 0 2024-09-17T01:01:52.514 INFO:tasks.workunit.client.1.smithi099.stdout:4/236: dwrite d7/dd/de/d10/d18/d4b/f1d [0,4194304] 0 2024-09-17T01:01:52.516 INFO:tasks.workunit.client.1.smithi099.stdout:5/329: mknod d2/d26/c69 0 2024-09-17T01:01:52.517 INFO:tasks.workunit.client.0.smithi002.stdout:4/198: dwrite d7/de/f28 [0,4194304] 0 2024-09-17T01:01:52.517 INFO:tasks.workunit.client.0.smithi002.stdout:4/199: creat d7/d19/d2e/f3d x:0 0 0 2024-09-17T01:01:52.517 INFO:tasks.workunit.client.0.smithi002.stdout:4/200: fsync d7/d19/f1f 0 2024-09-17T01:01:52.517 INFO:tasks.workunit.client.0.smithi002.stdout:4/201: chown d7/de/c38 1637 1 2024-09-17T01:01:52.517 INFO:tasks.workunit.client.0.smithi002.stdout:4/202: chown d7/de/c13 11 1 2024-09-17T01:01:52.517 INFO:tasks.workunit.client.0.smithi002.stdout:4/203: readlink d7/lf 0 2024-09-17T01:01:52.517 INFO:tasks.workunit.client.0.smithi002.stdout:4/204: write d7/f18 [5183979,75155] 0 2024-09-17T01:01:52.520 INFO:tasks.workunit.client.1.smithi099.stdout:4/237: rmdir d7/dd/de 39 2024-09-17T01:01:52.523 INFO:tasks.workunit.client.0.smithi002.stdout:9/146: dwrite d5/f1d [0,4194304] 0 2024-09-17T01:01:52.526 INFO:tasks.workunit.client.0.smithi002.stdout:9/147: symlink d5/dc/l27 0 2024-09-17T01:01:52.529 INFO:tasks.workunit.client.1.smithi099.stdout:5/330: write d2/d8/f5b [3561407,11837] 0 2024-09-17T01:01:52.536 INFO:tasks.workunit.client.1.smithi099.stdout:8/276: dwrite d0/d4/f42 [0,4194304] 0 2024-09-17T01:01:52.536 INFO:tasks.workunit.client.1.smithi099.stdout:8/277: chown d0/f54 2331615 1 2024-09-17T01:01:52.536 INFO:tasks.workunit.client.1.smithi099.stdout:4/238: dwrite d7/dd/de/d10/d1a/f37 [0,4194304] 0 2024-09-17T01:01:52.536 INFO:tasks.workunit.client.1.smithi099.stdout:4/239: write d7/dd/de/d10/d18/f43 [563905,87732] 0 2024-09-17T01:01:52.537 INFO:tasks.workunit.client.1.smithi099.stdout:3/247: dwrite d9/d15/d18/d1a/d23/f49 [4194304,4194304] 0 2024-09-17T01:01:52.537 INFO:tasks.workunit.client.1.smithi099.stdout:5/331: fsync d2/dc/d17/f53 0 2024-09-17T01:01:52.537 INFO:tasks.workunit.client.1.smithi099.stdout:5/332: chown d2/dc/d17 73251 1 2024-09-17T01:01:52.538 INFO:tasks.workunit.client.1.smithi099.stdout:8/278: unlink d0/d4/l26 0 2024-09-17T01:01:52.540 INFO:tasks.workunit.client.0.smithi002.stdout:4/205: getdents d7/d19/d2e 0 2024-09-17T01:01:52.541 INFO:tasks.workunit.client.1.smithi099.stdout:4/240: symlink d7/dd/de/l50 0 2024-09-17T01:01:52.542 INFO:tasks.workunit.client.0.smithi002.stdout:3/195: sync 2024-09-17T01:01:52.542 INFO:tasks.workunit.client.0.smithi002.stdout:7/107: sync 2024-09-17T01:01:52.542 INFO:tasks.workunit.client.0.smithi002.stdout:1/181: sync 2024-09-17T01:01:52.542 INFO:tasks.workunit.client.0.smithi002.stdout:9/148: dread d5/f1d [0,4194304] 0 2024-09-17T01:01:52.543 INFO:tasks.workunit.client.0.smithi002.stdout:7/108: unlink d1/f13 0 2024-09-17T01:01:52.543 INFO:tasks.workunit.client.0.smithi002.stdout:3/196: symlink d0/d31/l44 0 2024-09-17T01:01:52.544 INFO:tasks.workunit.client.0.smithi002.stdout:1/182: mkdir d4/d11/d12/d14/d17/d40 0 2024-09-17T01:01:52.544 INFO:tasks.workunit.client.0.smithi002.stdout:1/183: chown d4/d11/d12/d14/d17/f28 2873 1 2024-09-17T01:01:52.545 INFO:tasks.workunit.client.0.smithi002.stdout:9/149: unlink d5/dc/f13 0 2024-09-17T01:01:52.546 INFO:tasks.workunit.client.0.smithi002.stdout:7/109: unlink d1/f6 0 2024-09-17T01:01:52.548 INFO:tasks.workunit.client.1.smithi099.stdout:4/241: rename d7/dd/f12 to d7/dd/d21/d26/f51 0 2024-09-17T01:01:52.549 INFO:tasks.workunit.client.1.smithi099.stdout:3/248: dread d9/d15/d18/f20 [0,4194304] 0 2024-09-17T01:01:52.550 INFO:tasks.workunit.client.0.smithi002.stdout:3/197: creat d0/d3/d33/d40/f45 x:0 0 0 2024-09-17T01:01:52.550 INFO:tasks.workunit.client.0.smithi002.stdout:1/184: link d4/d11/d12/d14/c25 d4/d11/d12/d23/c41 0 2024-09-17T01:01:52.550 INFO:tasks.workunit.client.0.smithi002.stdout:9/150: symlink d5/dc/d26/l28 0 2024-09-17T01:01:52.550 INFO:tasks.workunit.client.0.smithi002.stdout:7/110: unlink d1/d14/d1d/l25 0 2024-09-17T01:01:52.550 INFO:tasks.workunit.client.0.smithi002.stdout:7/111: creat d1/f26 x:0 0 0 2024-09-17T01:01:52.550 INFO:tasks.workunit.client.0.smithi002.stdout:7/112: creat d1/f27 x:0 0 0 2024-09-17T01:01:52.550 INFO:tasks.workunit.client.0.smithi002.stdout:3/198: mknod d0/d3/d33/c46 0 2024-09-17T01:01:52.550 INFO:tasks.workunit.client.0.smithi002.stdout:1/185: truncate d4/fe 2627549 0 2024-09-17T01:01:52.552 INFO:tasks.workunit.client.1.smithi099.stdout:5/333: rmdir d2/dc/d14 39 2024-09-17T01:01:52.552 INFO:tasks.workunit.client.1.smithi099.stdout:5/334: write d2/dc/d14/d36/f67 [422406,53553] 0 2024-09-17T01:01:52.552 INFO:tasks.workunit.client.1.smithi099.stdout:8/279: dread d0/f30 [0,4194304] 0 2024-09-17T01:01:52.552 INFO:tasks.workunit.client.1.smithi099.stdout:8/280: write d0/f47 [1130621,63309] 0 2024-09-17T01:01:52.552 INFO:tasks.workunit.client.1.smithi099.stdout:8/281: read d0/d1f/f12 [3859793,110494] 0 2024-09-17T01:01:52.552 INFO:tasks.workunit.client.1.smithi099.stdout:4/242: creat d7/dd/de/d17/f52 x:0 0 0 2024-09-17T01:01:52.552 INFO:tasks.workunit.client.1.smithi099.stdout:4/243: readlink d7/dd/de/d10/d18/l2a 0 2024-09-17T01:01:52.553 INFO:tasks.workunit.client.0.smithi002.stdout:3/199: rmdir d0/d3/d17 39 2024-09-17T01:01:52.553 INFO:tasks.workunit.client.1.smithi099.stdout:3/249: creat d9/d15/d38/f4b x:0 0 0 2024-09-17T01:01:52.554 INFO:tasks.workunit.client.0.smithi002.stdout:1/186: rename d4/d11/d12/d23/d32/f37 to d4/d11/d12/d14/d17/d3b/f42 0 2024-09-17T01:01:52.554 INFO:tasks.workunit.client.0.smithi002.stdout:3/200: write d0/d3/d17/f20 [403605,49559] 0 2024-09-17T01:01:52.555 INFO:tasks.workunit.client.0.smithi002.stdout:1/187: unlink d4/cb 0 2024-09-17T01:01:52.555 INFO:tasks.workunit.client.0.smithi002.stdout:1/188: stat d4/d11/d12/d14/d17/f28 0 2024-09-17T01:01:52.556 INFO:tasks.workunit.client.0.smithi002.stdout:9/151: dread d5/f1d [0,4194304] 0 2024-09-17T01:01:52.556 INFO:tasks.workunit.client.0.smithi002.stdout:3/201: rename d0/d3/f3f to d0/d3/d37/f47 0 2024-09-17T01:01:52.557 INFO:tasks.workunit.client.1.smithi099.stdout:8/282: stat d0/l32 0 2024-09-17T01:01:52.557 INFO:tasks.workunit.client.0.smithi002.stdout:7/113: write d1/f11 [3845981,117471] 0 2024-09-17T01:01:52.557 INFO:tasks.workunit.client.1.smithi099.stdout:4/244: creat d7/dd/de/d10/d3a/f53 x:0 0 0 2024-09-17T01:01:52.558 INFO:tasks.workunit.client.0.smithi002.stdout:1/189: mkdir d4/d11/d12/d30/d43 0 2024-09-17T01:01:52.558 INFO:tasks.workunit.client.0.smithi002.stdout:1/190: fdatasync d4/d11/d12/d14/f36 0 2024-09-17T01:01:52.558 INFO:tasks.workunit.client.0.smithi002.stdout:9/152: creat d5/f29 x:0 0 0 2024-09-17T01:01:52.559 INFO:tasks.workunit.client.1.smithi099.stdout:4/245: truncate d7/dd/de/d10/d1a/f2c 89486 0 2024-09-17T01:01:52.560 INFO:tasks.workunit.client.0.smithi002.stdout:4/206: dwrite d7/de/f15 [4194304,4194304] 0 2024-09-17T01:01:52.561 INFO:tasks.workunit.client.0.smithi002.stdout:3/202: chown d0/l11 14266 1 2024-09-17T01:01:52.563 INFO:tasks.workunit.client.0.smithi002.stdout:7/114: mkdir d1/d14/d1d/d28 0 2024-09-17T01:01:52.563 INFO:tasks.workunit.client.0.smithi002.stdout:7/115: write d1/f8 [2936750,127097] 0 2024-09-17T01:01:52.563 INFO:tasks.workunit.client.0.smithi002.stdout:7/116: dread - d1/f27 zero size 2024-09-17T01:01:52.563 INFO:tasks.workunit.client.1.smithi099.stdout:8/283: truncate d0/d1f/f20 8590948 0 2024-09-17T01:01:52.563 INFO:tasks.workunit.client.0.smithi002.stdout:7/117: fdatasync d1/f20 0 2024-09-17T01:01:52.567 INFO:tasks.workunit.client.0.smithi002.stdout:7/118: mkdir d1/d14/d1d/d29 0 2024-09-17T01:01:52.571 INFO:tasks.workunit.client.1.smithi099.stdout:4/246: dread d7/d35/f36 [0,4194304] 0 2024-09-17T01:01:52.572 INFO:tasks.workunit.client.0.smithi002.stdout:3/203: dread d0/d3/f1a [0,4194304] 0 2024-09-17T01:01:52.572 INFO:tasks.workunit.client.0.smithi002.stdout:3/204: write d0/fd [3093639,22644] 0 2024-09-17T01:01:52.573 INFO:tasks.workunit.client.1.smithi099.stdout:4/247: mknod d7/dd/de/d10/c54 0 2024-09-17T01:01:52.573 INFO:tasks.workunit.client.1.smithi099.stdout:4/248: write d7/dd/d21/f38 [372358,50499] 0 2024-09-17T01:01:52.574 INFO:tasks.workunit.client.0.smithi002.stdout:3/205: rmdir d0/d3 39 2024-09-17T01:01:52.574 INFO:tasks.workunit.client.1.smithi099.stdout:3/250: dread d9/d15/d18/f19 [0,4194304] 0 2024-09-17T01:01:52.581 INFO:tasks.workunit.client.0.smithi002.stdout:9/153: write d5/dc/f1b [3939626,16678] 0 2024-09-17T01:01:52.587 INFO:tasks.workunit.client.1.smithi099.stdout:4/249: read d7/dd/de/ff [6498636,117550] 0 2024-09-17T01:01:52.589 INFO:tasks.workunit.client.1.smithi099.stdout:4/250: rename d7/dd/de/d17/c49 to d7/dd/de/d10/d18/d4b/c55 0 2024-09-17T01:01:52.589 INFO:tasks.workunit.client.1.smithi099.stdout:4/251: readlink d7/dd/de/d10/d1a/l24 0 2024-09-17T01:01:52.590 INFO:tasks.workunit.client.0.smithi002.stdout:9/154: rename d5/ca to d5/dc/d26/c2a 0 2024-09-17T01:01:52.591 INFO:tasks.workunit.client.1.smithi099.stdout:4/252: creat d7/dd/d21/d26/f56 x:0 0 0 2024-09-17T01:01:52.591 INFO:tasks.workunit.client.1.smithi099.stdout:4/253: read d7/f8 [3815348,95723] 0 2024-09-17T01:01:52.591 INFO:tasks.workunit.client.1.smithi099.stdout:4/254: write d7/dd/de/d10/d1a/f2c [1020240,9301] 0 2024-09-17T01:01:52.591 INFO:tasks.workunit.client.1.smithi099.stdout:4/255: fsync d7/dd/de/d10/d18/d4b/f3e 0 2024-09-17T01:01:52.597 INFO:tasks.workunit.client.1.smithi099.stdout:4/256: dread d7/d35/f36 [0,4194304] 0 2024-09-17T01:01:52.597 INFO:tasks.workunit.client.1.smithi099.stdout:4/257: mknod d7/dd/de/d10/d18/d4b/c57 0 2024-09-17T01:01:52.605 INFO:tasks.workunit.client.1.smithi099.stdout:8/284: dwrite d0/d1f/d31/f3b [0,4194304] 0 2024-09-17T01:01:52.606 INFO:tasks.workunit.client.1.smithi099.stdout:5/335: dwrite d2/dc/d17/d3c/f46 [0,4194304] 0 2024-09-17T01:01:52.607 INFO:tasks.workunit.client.0.smithi002.stdout:4/207: dwrite d7/de/f15 [0,4194304] 0 2024-09-17T01:01:52.607 INFO:tasks.workunit.client.0.smithi002.stdout:4/208: write d7/de/f2a [5312394,79092] 0 2024-09-17T01:01:52.607 INFO:tasks.workunit.client.0.smithi002.stdout:1/191: dwrite d4/fa [0,4194304] 0 2024-09-17T01:01:52.608 INFO:tasks.workunit.client.0.smithi002.stdout:7/119: dwrite d1/f20 [0,4194304] 0 2024-09-17T01:01:52.608 INFO:tasks.workunit.client.0.smithi002.stdout:7/120: dread - d1/f27 zero size 2024-09-17T01:01:52.608 INFO:tasks.workunit.client.0.smithi002.stdout:3/206: dwrite d0/d31/d32/f25 [0,4194304] 0 2024-09-17T01:01:52.608 INFO:tasks.workunit.client.0.smithi002.stdout:3/207: write d0/d31/d32/f42 [255817,55010] 0 2024-09-17T01:01:52.608 INFO:tasks.workunit.client.0.smithi002.stdout:3/208: chown d0/d3/d33/c46 304 1 2024-09-17T01:01:52.608 INFO:tasks.workunit.client.1.smithi099.stdout:8/285: rmdir d0/d4/d29/d4b 39 2024-09-17T01:01:52.616 INFO:tasks.workunit.client.0.smithi002.stdout:1/192: truncate d4/d11/d12/d23/f35 705457 0 2024-09-17T01:01:52.618 INFO:tasks.workunit.client.0.smithi002.stdout:3/209: dread d0/f1f [0,4194304] 0 2024-09-17T01:01:52.619 INFO:tasks.workunit.client.0.smithi002.stdout:7/121: symlink d1/d14/d1d/d28/l2a 0 2024-09-17T01:01:52.621 INFO:tasks.workunit.client.0.smithi002.stdout:1/193: mknod d4/d11/c44 0 2024-09-17T01:01:52.621 INFO:tasks.workunit.client.0.smithi002.stdout:4/209: dwrite d7/de/f28 [4194304,4194304] 0 2024-09-17T01:01:52.621 INFO:tasks.workunit.client.0.smithi002.stdout:4/210: fsync d7/f12 0 2024-09-17T01:01:52.622 INFO:tasks.workunit.client.0.smithi002.stdout:1/194: readlink d4/l21 0 2024-09-17T01:01:52.622 INFO:tasks.workunit.client.0.smithi002.stdout:1/195: write d4/d11/d12/d14/d17/d3b/f42 [602892,91385] 0 2024-09-17T01:01:52.623 INFO:tasks.workunit.client.0.smithi002.stdout:4/211: mknod d7/d19/d34/c3e 0 2024-09-17T01:01:52.623 INFO:tasks.workunit.client.0.smithi002.stdout:4/212: chown d7/c11 761173 1 2024-09-17T01:01:52.624 INFO:tasks.workunit.client.0.smithi002.stdout:1/196: mknod d4/d11/d12/d14/c45 0 2024-09-17T01:01:52.624 INFO:tasks.workunit.client.1.smithi099.stdout:2/188: sync 2024-09-17T01:01:52.624 INFO:tasks.workunit.client.1.smithi099.stdout:6/272: sync 2024-09-17T01:01:52.625 INFO:tasks.workunit.client.1.smithi099.stdout:9/261: sync 2024-09-17T01:01:52.626 INFO:tasks.workunit.client.1.smithi099.stdout:6/273: creat dc/d2b/d53/f5a x:0 0 0 2024-09-17T01:01:52.626 INFO:tasks.workunit.client.1.smithi099.stdout:6/274: chown dc/d2b/f2c 48 1 2024-09-17T01:01:52.627 INFO:tasks.workunit.client.0.smithi002.stdout:4/213: mkdir d7/d3f 0 2024-09-17T01:01:52.627 INFO:tasks.workunit.client.0.smithi002.stdout:4/214: getdents d7/d19/d2e 0 2024-09-17T01:01:52.627 INFO:tasks.workunit.client.0.smithi002.stdout:4/215: truncate d7/d19/f1f 4818400 0 2024-09-17T01:01:52.627 INFO:tasks.workunit.client.0.smithi002.stdout:4/216: getdents d7/de/d32 0 2024-09-17T01:01:52.627 INFO:tasks.workunit.client.1.smithi099.stdout:4/258: dwrite d7/dd/d21/d26/f56 [0,4194304] 0 2024-09-17T01:01:52.627 INFO:tasks.workunit.client.1.smithi099.stdout:4/259: chown d7/dd/l15 980659 1 2024-09-17T01:01:52.628 INFO:tasks.workunit.client.1.smithi099.stdout:9/262: link da/d1b/d3a/l43 da/d50/l59 0 2024-09-17T01:01:52.630 INFO:tasks.workunit.client.1.smithi099.stdout:4/260: symlink d7/dd/de/d10/d1a/l58 0 2024-09-17T01:01:52.630 INFO:tasks.workunit.client.1.smithi099.stdout:8/286: dwrite d0/d4/d29/f2e [0,4194304] 0 2024-09-17T01:01:52.632 INFO:tasks.workunit.client.1.smithi099.stdout:9/263: rename da/d18/l52 to da/d14/d40/l5a 0 2024-09-17T01:01:52.632 INFO:tasks.workunit.client.1.smithi099.stdout:9/264: dread - da/d1b/f3d zero size 2024-09-17T01:01:52.632 INFO:tasks.workunit.client.1.smithi099.stdout:9/265: chown da/d21/d2a/l31 42228739 1 2024-09-17T01:01:52.633 INFO:tasks.workunit.client.1.smithi099.stdout:6/275: getdents dc/d1a 0 2024-09-17T01:01:52.633 INFO:tasks.workunit.client.1.smithi099.stdout:6/276: write dc/f36 [253092,65607] 0 2024-09-17T01:01:52.636 INFO:tasks.workunit.client.0.smithi002.stdout:1/197: dread d4/d22/f2f [0,4194304] 0 2024-09-17T01:01:52.636 INFO:tasks.workunit.client.0.smithi002.stdout:1/198: chown f3 194 1 2024-09-17T01:01:52.636 INFO:tasks.workunit.client.1.smithi099.stdout:9/266: rename da/d14/d40/d4c to da/d21/d5b 0 2024-09-17T01:01:52.637 INFO:tasks.workunit.client.1.smithi099.stdout:9/267: fdatasync da/d14/f1a 0 2024-09-17T01:01:52.637 INFO:tasks.workunit.client.0.smithi002.stdout:1/199: getdents d4/d11/d1c 0 2024-09-17T01:01:52.638 INFO:tasks.workunit.client.1.smithi099.stdout:6/277: rename dc/d27/f42 to dc/d1a/d49/f5b 0 2024-09-17T01:01:52.639 INFO:tasks.workunit.client.1.smithi099.stdout:9/268: creat da/d50/f5c x:0 0 0 2024-09-17T01:01:52.640 INFO:tasks.workunit.client.1.smithi099.stdout:6/278: creat dc/d1a/d49/d4c/f5c x:0 0 0 2024-09-17T01:01:52.641 INFO:tasks.workunit.client.1.smithi099.stdout:6/279: mkdir dc/d5d 0 2024-09-17T01:01:52.642 INFO:tasks.workunit.client.1.smithi099.stdout:6/280: symlink dc/d2b/l5e 0 2024-09-17T01:01:52.644 INFO:tasks.workunit.client.0.smithi002.stdout:4/217: write d7/de/f15 [6664062,54276] 0 2024-09-17T01:01:52.645 INFO:tasks.workunit.client.0.smithi002.stdout:4/218: rename d7/de/d23/f2f to d7/de/d32/f40 0 2024-09-17T01:01:52.645 INFO:tasks.workunit.client.0.smithi002.stdout:4/219: write d7/f12 [408397,64225] 0 2024-09-17T01:01:52.646 INFO:tasks.workunit.client.1.smithi099.stdout:8/287: write d0/d4/d29/f2e [665246,80416] 0 2024-09-17T01:01:52.647 INFO:tasks.workunit.client.1.smithi099.stdout:8/288: creat d0/d53/f59 x:0 0 0 2024-09-17T01:01:52.647 INFO:tasks.workunit.client.1.smithi099.stdout:8/289: chown d0/c19 80475 1 2024-09-17T01:01:52.647 INFO:tasks.workunit.client.1.smithi099.stdout:8/290: dread - d0/d4/d29/f58 zero size 2024-09-17T01:01:52.647 INFO:tasks.workunit.client.1.smithi099.stdout:8/291: chown d0/d4/f42 17625920 1 2024-09-17T01:01:52.648 INFO:tasks.workunit.client.1.smithi099.stdout:8/292: mkdir d0/d41/d5a 0 2024-09-17T01:01:52.652 INFO:tasks.workunit.client.0.smithi002.stdout:3/210: dwrite d0/f2f [0,4194304] 0 2024-09-17T01:01:52.653 INFO:tasks.workunit.client.1.smithi099.stdout:4/261: dwrite d7/dd/de/d10/d18/d4b/f3e [0,4194304] 0 2024-09-17T01:01:52.653 INFO:tasks.workunit.client.1.smithi099.stdout:4/262: dread - d7/dd/de/d10/d3a/f53 zero size 2024-09-17T01:01:52.655 INFO:tasks.workunit.client.1.smithi099.stdout:4/263: mknod d7/dd/de/c59 0 2024-09-17T01:01:52.656 INFO:tasks.workunit.client.1.smithi099.stdout:4/264: write d7/dd/de/d10/d18/f42 [1447399,69946] 0 2024-09-17T01:01:52.657 INFO:tasks.workunit.client.0.smithi002.stdout:7/122: dwrite f0 [0,4194304] 0 2024-09-17T01:01:52.657 INFO:tasks.workunit.client.1.smithi099.stdout:4/265: link d7/dd/d21/d26/l48 d7/dd/d21/l5a 0 2024-09-17T01:01:52.657 INFO:tasks.workunit.client.1.smithi099.stdout:4/266: chown d7/dd 503991 1 2024-09-17T01:01:52.658 INFO:tasks.workunit.client.0.smithi002.stdout:1/200: dread d4/f18 [0,4194304] 0 2024-09-17T01:01:52.658 INFO:tasks.workunit.client.0.smithi002.stdout:1/201: fdatasync d4/d11/d12/d14/f36 0 2024-09-17T01:01:52.661 INFO:tasks.workunit.client.0.smithi002.stdout:3/211: mknod d0/d3/d17/c48 0 2024-09-17T01:01:52.661 INFO:tasks.workunit.client.0.smithi002.stdout:3/212: dread - d0/d31/d32/f3b zero size 2024-09-17T01:01:52.661 INFO:tasks.workunit.client.0.smithi002.stdout:3/213: read - d0/d3/d33/d40/f45 zero size 2024-09-17T01:01:52.662 INFO:tasks.workunit.client.0.smithi002.stdout:3/214: creat d0/d3/d37/f49 x:0 0 0 2024-09-17T01:01:52.663 INFO:tasks.workunit.client.0.smithi002.stdout:3/215: stat d0/d3/d17/f2c 0 2024-09-17T01:01:52.663 INFO:tasks.workunit.client.0.smithi002.stdout:1/202: dread d4/f3f [0,4194304] 0 2024-09-17T01:01:52.663 INFO:tasks.workunit.client.0.smithi002.stdout:7/123: rmdir d1 39 2024-09-17T01:01:52.664 INFO:tasks.workunit.client.0.smithi002.stdout:7/124: chown d1/d14/c1a 1 1 2024-09-17T01:01:52.664 INFO:tasks.workunit.client.0.smithi002.stdout:7/125: chown d1/l9 0 1 2024-09-17T01:01:52.664 INFO:tasks.workunit.client.0.smithi002.stdout:7/126: dread - d1/f26 zero size 2024-09-17T01:01:52.665 INFO:tasks.workunit.client.0.smithi002.stdout:1/203: mknod d4/d11/d12/d14/d17/d40/c46 0 2024-09-17T01:01:52.665 INFO:tasks.workunit.client.0.smithi002.stdout:3/216: getdents d0/d31 0 2024-09-17T01:01:52.666 INFO:tasks.workunit.client.0.smithi002.stdout:1/204: readlink d4/l5 0 2024-09-17T01:01:52.668 INFO:tasks.workunit.client.0.smithi002.stdout:4/220: dwrite d7/de/f28 [0,4194304] 0 2024-09-17T01:01:52.668 INFO:tasks.workunit.client.1.smithi099.stdout:8/293: dwrite d0/f54 [0,4194304] 0 2024-09-17T01:01:52.671 INFO:tasks.workunit.client.1.smithi099.stdout:4/267: fdatasync d7/dd/d21/f38 0 2024-09-17T01:01:52.671 INFO:tasks.workunit.client.1.smithi099.stdout:6/281: dwrite dc/f18 [0,4194304] 0 2024-09-17T01:01:52.671 INFO:tasks.workunit.client.1.smithi099.stdout:9/269: dwrite da/d1b/f3d [0,4194304] 0 2024-09-17T01:01:52.672 INFO:tasks.workunit.client.1.smithi099.stdout:8/294: mknod d0/d1f/d55/c5b 0 2024-09-17T01:01:52.677 INFO:tasks.workunit.client.0.smithi002.stdout:1/205: write d4/d11/d1a/f29 [3719592,100096] 0 2024-09-17T01:01:52.677 INFO:tasks.workunit.client.1.smithi099.stdout:4/268: rename d7/dd/de/d10/d1a to d7/dd/d21/d26/d3f/d5b 0 2024-09-17T01:01:52.679 INFO:tasks.workunit.client.1.smithi099.stdout:6/282: rename dc/f39 to dc/d1a/d49/d4c/f5f 0 2024-09-17T01:01:52.680 INFO:tasks.workunit.client.1.smithi099.stdout:4/269: rmdir d7/dd/de/d10/d18/d4b 39 2024-09-17T01:01:52.680 INFO:tasks.workunit.client.1.smithi099.stdout:4/270: write d7/dd/de/d10/d18/d4b/f34 [4777441,29087] 0 2024-09-17T01:01:52.680 INFO:tasks.workunit.client.1.smithi099.stdout:4/271: chown d7/dd/d21/d26/d3f/l4c 53999534 1 2024-09-17T01:01:52.681 INFO:tasks.workunit.client.0.smithi002.stdout:1/206: rename d4/d11/d1c/f1f to d4/f47 0 2024-09-17T01:01:52.681 INFO:tasks.workunit.client.1.smithi099.stdout:6/283: mkdir dc/d2b/d3f/d60 0 2024-09-17T01:01:52.681 INFO:tasks.workunit.client.1.smithi099.stdout:6/284: readlink dc/l15 0 2024-09-17T01:01:52.681 INFO:tasks.workunit.client.1.smithi099.stdout:6/285: chown dc/d2b/l5e 0 1 2024-09-17T01:01:52.682 INFO:tasks.workunit.client.0.smithi002.stdout:1/207: rmdir d4/d11/d12/d14/d17/d40 39 2024-09-17T01:01:52.683 INFO:tasks.workunit.client.0.smithi002.stdout:1/208: creat d4/d11/d12/d30/d43/f48 x:0 0 0 2024-09-17T01:01:52.683 INFO:tasks.workunit.client.0.smithi002.stdout:1/209: chown d4/l5 63302 1 2024-09-17T01:01:52.683 INFO:tasks.workunit.client.0.smithi002.stdout:3/217: dwrite d0/d3/d17/f29 [0,4194304] 0 2024-09-17T01:01:52.683 INFO:tasks.workunit.client.0.smithi002.stdout:7/127: dwrite d1/f5 [0,4194304] 0 2024-09-17T01:01:52.684 INFO:tasks.workunit.client.0.smithi002.stdout:1/210: symlink d4/d11/d12/d14/d17/l49 0 2024-09-17T01:01:52.684 INFO:tasks.workunit.client.1.smithi099.stdout:4/272: mknod d7/dd/de/d10/c5c 0 2024-09-17T01:01:52.684 INFO:tasks.workunit.client.1.smithi099.stdout:4/273: chown d7/dd/de/d10/d18/d4b/c57 26035 1 2024-09-17T01:01:52.684 INFO:tasks.workunit.client.1.smithi099.stdout:9/270: read da/d1b/d3a/f26 [3979475,93908] 0 2024-09-17T01:01:52.685 INFO:tasks.workunit.client.1.smithi099.stdout:6/286: unlink dc/d1a/d49/f4d 0 2024-09-17T01:01:52.686 INFO:tasks.workunit.client.0.smithi002.stdout:3/218: mkdir d0/d3/d33/d4a 0 2024-09-17T01:01:52.686 INFO:tasks.workunit.client.0.smithi002.stdout:3/219: write d0/f3e [111219,112346] 0 2024-09-17T01:01:52.686 INFO:tasks.workunit.client.0.smithi002.stdout:3/220: fsync d0/d3/d17/f20 0 2024-09-17T01:01:52.686 INFO:tasks.workunit.client.0.smithi002.stdout:3/221: truncate d0/d31/d32/f3b 817081 0 2024-09-17T01:01:52.686 INFO:tasks.workunit.client.1.smithi099.stdout:8/295: rename d0/f54 to d0/d4/d29/d4b/f5c 0 2024-09-17T01:01:52.687 INFO:tasks.workunit.client.0.smithi002.stdout:7/128: mknod d1/d14/d1d/d28/c2b 0 2024-09-17T01:01:52.688 INFO:tasks.workunit.client.0.smithi002.stdout:7/129: write d1/f27 [333320,41310] 0 2024-09-17T01:01:52.688 INFO:tasks.workunit.client.0.smithi002.stdout:7/130: dread - d1/f26 zero size 2024-09-17T01:01:52.688 INFO:tasks.workunit.client.1.smithi099.stdout:9/271: mknod da/d50/c5d 0 2024-09-17T01:01:52.689 INFO:tasks.workunit.client.0.smithi002.stdout:1/211: symlink d4/d11/d12/d14/d17/l4a 0 2024-09-17T01:01:52.689 INFO:tasks.workunit.client.0.smithi002.stdout:7/131: rmdir d1/d14/d1d/d28 39 2024-09-17T01:01:52.689 INFO:tasks.workunit.client.1.smithi099.stdout:6/287: symlink dc/d1a/d49/d4c/l61 0 2024-09-17T01:01:52.689 INFO:tasks.workunit.client.0.smithi002.stdout:1/212: rename d4/d22/l2d to d4/d11/d12/d30/d43/l4b 0 2024-09-17T01:01:52.691 INFO:tasks.workunit.client.0.smithi002.stdout:4/221: dwrite d7/de/f15 [4194304,4194304] 0 2024-09-17T01:01:52.692 INFO:tasks.workunit.client.1.smithi099.stdout:8/296: rename d0/f30 to d0/d1f/d31/d4c/f5d 0 2024-09-17T01:01:52.693 INFO:tasks.workunit.client.0.smithi002.stdout:4/222: creat d7/d19/d34/f41 x:0 0 0 2024-09-17T01:01:52.697 INFO:tasks.workunit.client.1.smithi099.stdout:9/272: mkdir da/d18/d5e 0 2024-09-17T01:01:52.698 INFO:tasks.workunit.client.1.smithi099.stdout:6/288: creat dc/d1a/d49/f62 x:0 0 0 2024-09-17T01:01:52.698 INFO:tasks.workunit.client.0.smithi002.stdout:4/223: truncate d7/d19/f1c 2733330 0 2024-09-17T01:01:52.698 INFO:tasks.workunit.client.0.smithi002.stdout:4/224: stat d7/de/d22/c2d 0 2024-09-17T01:01:52.698 INFO:tasks.workunit.client.0.smithi002.stdout:0/128: sync 2024-09-17T01:01:52.698 INFO:tasks.workunit.client.0.smithi002.stdout:8/205: sync 2024-09-17T01:01:52.698 INFO:tasks.workunit.client.0.smithi002.stdout:8/206: fdatasync d2/fb 0 2024-09-17T01:01:52.698 INFO:tasks.workunit.client.0.smithi002.stdout:8/207: creat d2/d1c/d3b/f4e x:0 0 0 2024-09-17T01:01:52.699 INFO:tasks.workunit.client.0.smithi002.stdout:0/129: mknod dd/d19/d1c/d1f/d22/c27 0 2024-09-17T01:01:52.699 INFO:tasks.workunit.client.0.smithi002.stdout:4/225: read d7/f25 [771986,44286] 0 2024-09-17T01:01:52.700 INFO:tasks.workunit.client.0.smithi002.stdout:8/208: mkdir d2/d26/d2b/d4f 0 2024-09-17T01:01:52.700 INFO:tasks.workunit.client.0.smithi002.stdout:8/209: truncate d2/d26/f33 935387 0 2024-09-17T01:01:52.701 INFO:tasks.workunit.client.0.smithi002.stdout:8/210: readlink d2/l2f 0 2024-09-17T01:01:52.702 INFO:tasks.workunit.client.0.smithi002.stdout:4/226: symlink d7/l42 0 2024-09-17T01:01:52.702 INFO:tasks.workunit.client.0.smithi002.stdout:4/227: stat d7/de/d22 0 2024-09-17T01:01:52.705 INFO:tasks.workunit.client.0.smithi002.stdout:8/211: dread d2/d3/f1b [0,4194304] 0 2024-09-17T01:01:52.707 INFO:tasks.workunit.client.0.smithi002.stdout:3/222: dwrite d0/d3/d17/f20 [0,4194304] 0 2024-09-17T01:01:52.707 INFO:tasks.workunit.client.1.smithi099.stdout:4/274: dread d7/fb [0,4194304] 0 2024-09-17T01:01:52.708 INFO:tasks.workunit.client.1.smithi099.stdout:8/297: dread d0/d1f/f2b [4194304,4194304] 0 2024-09-17T01:01:52.708 INFO:tasks.workunit.client.1.smithi099.stdout:8/298: chown d0/d41/l52 2733615 1 2024-09-17T01:01:52.708 INFO:tasks.workunit.client.1.smithi099.stdout:6/289: dread dc/d2b/d3f/f47 [0,4194304] 0 2024-09-17T01:01:52.708 INFO:tasks.workunit.client.1.smithi099.stdout:6/290: write dc/d1a/d49/d4c/f5c [124414,33385] 0 2024-09-17T01:01:52.709 INFO:tasks.workunit.client.1.smithi099.stdout:4/275: rename d7/dd/de/d10/c54 to d7/dd/de/d17/c5d 0 2024-09-17T01:01:52.710 INFO:tasks.workunit.client.1.smithi099.stdout:8/299: symlink d0/l5e 0 2024-09-17T01:01:52.710 INFO:tasks.workunit.client.1.smithi099.stdout:6/291: mknod dc/d2b/d3f/c63 0 2024-09-17T01:01:52.711 INFO:tasks.workunit.client.0.smithi002.stdout:3/223: rename d0/d3/l3d to d0/d3/l4b 0 2024-09-17T01:01:52.714 INFO:tasks.workunit.client.0.smithi002.stdout:3/224: mknod d0/d3/d37/c4c 0 2024-09-17T01:01:52.715 INFO:tasks.workunit.client.0.smithi002.stdout:8/212: write d2/d3/f48 [1757898,89186] 0 2024-09-17T01:01:52.715 INFO:tasks.workunit.client.0.smithi002.stdout:8/213: dread - d2/f37 zero size 2024-09-17T01:01:52.715 INFO:tasks.workunit.client.0.smithi002.stdout:8/214: write d2/d30/f32 [313432,107431] 0 2024-09-17T01:01:52.717 INFO:tasks.workunit.client.0.smithi002.stdout:8/215: mkdir d2/d3/d50 0 2024-09-17T01:01:52.717 INFO:tasks.workunit.client.0.smithi002.stdout:8/216: chown d2/d9/dd 130 1 2024-09-17T01:01:52.734 INFO:tasks.workunit.client.0.smithi002.stdout:1/213: dwrite d4/f47 [0,4194304] 0 2024-09-17T01:01:52.740 INFO:tasks.workunit.client.1.smithi099.stdout:9/273: dwrite da/d21/f3b [0,4194304] 0 2024-09-17T01:01:52.740 INFO:tasks.workunit.client.1.smithi099.stdout:9/274: chown da/d1b/d3a/c4a 6 1 2024-09-17T01:01:52.742 INFO:tasks.workunit.client.0.smithi002.stdout:1/214: dread f3 [0,4194304] 0 2024-09-17T01:01:52.742 INFO:tasks.workunit.client.0.smithi002.stdout:7/132: dwrite d1/f20 [0,4194304] 0 2024-09-17T01:01:52.742 INFO:tasks.workunit.client.0.smithi002.stdout:1/215: creat d4/d11/d12/f4c x:0 0 0 2024-09-17T01:01:52.742 INFO:tasks.workunit.client.0.smithi002.stdout:7/133: stat d1/le 0 2024-09-17T01:01:52.742 INFO:tasks.workunit.client.0.smithi002.stdout:1/216: truncate d4/d22/f39 479270 0 2024-09-17T01:01:52.742 INFO:tasks.workunit.client.0.smithi002.stdout:7/134: readlink d1/l12 0 2024-09-17T01:01:52.742 INFO:tasks.workunit.client.0.smithi002.stdout:1/217: creat d4/d11/d12/d30/d43/f4d x:0 0 0 2024-09-17T01:01:52.742 INFO:tasks.workunit.client.0.smithi002.stdout:7/135: chown d1/c1b 198 1 2024-09-17T01:01:52.744 INFO:tasks.workunit.client.0.smithi002.stdout:4/228: dread d7/de/d22/f31 [0,4194304] 0 2024-09-17T01:01:52.744 INFO:tasks.workunit.client.0.smithi002.stdout:4/229: write d7/d19/d2e/f33 [335008,90142] 0 2024-09-17T01:01:52.744 INFO:tasks.workunit.client.0.smithi002.stdout:1/218: stat d4/c7 0 2024-09-17T01:01:52.744 INFO:tasks.workunit.client.0.smithi002.stdout:8/217: dwrite d2/d9/dd/f15 [0,4194304] 0 2024-09-17T01:01:52.745 INFO:tasks.workunit.client.0.smithi002.stdout:0/130: dwrite dd/f13 [0,4194304] 0 2024-09-17T01:01:52.745 INFO:tasks.workunit.client.0.smithi002.stdout:7/136: symlink d1/d14/d1d/l2c 0 2024-09-17T01:01:52.745 INFO:tasks.workunit.client.1.smithi099.stdout:4/276: dwrite d7/dd/de/f4f [0,4194304] 0 2024-09-17T01:01:52.746 INFO:tasks.workunit.client.0.smithi002.stdout:0/131: dread dd/f18 [0,4194304] 0 2024-09-17T01:01:52.746 INFO:tasks.workunit.client.0.smithi002.stdout:4/230: symlink d7/de/d22/l43 0 2024-09-17T01:01:52.753 INFO:tasks.workunit.client.1.smithi099.stdout:4/277: rename d7/d35/f3d to d7/dd/de/d10/f5e 0 2024-09-17T01:01:52.755 INFO:tasks.workunit.client.1.smithi099.stdout:4/278: rename d7/dd/l15 to d7/dd/d21/d26/d3f/l5f 0 2024-09-17T01:01:52.756 INFO:tasks.workunit.client.1.smithi099.stdout:4/279: rename d7/dd/de/d10/d18/d4b/f2f to d7/dd/d21/d26/f60 0 2024-09-17T01:01:52.757 INFO:tasks.workunit.client.1.smithi099.stdout:6/292: truncate dc/f18 1089778 0 2024-09-17T01:01:52.759 INFO:tasks.workunit.client.1.smithi099.stdout:6/293: stat dc/d1a/l59 0 2024-09-17T01:01:52.759 INFO:tasks.workunit.client.1.smithi099.stdout:6/294: chown dc/l4e 48027 1 2024-09-17T01:01:52.760 INFO:tasks.workunit.client.0.smithi002.stdout:8/218: link d2/d3/c23 d2/d1c/d3c/d47/c51 0 2024-09-17T01:01:52.760 INFO:tasks.workunit.client.0.smithi002.stdout:1/219: fsync d4/d11/d12/d30/d43/f4d 0 2024-09-17T01:01:52.760 INFO:tasks.workunit.client.1.smithi099.stdout:6/295: symlink dc/d27/d58/l64 0 2024-09-17T01:01:52.761 INFO:tasks.workunit.client.1.smithi099.stdout:6/296: getdents dc/d27 0 2024-09-17T01:01:52.761 INFO:tasks.workunit.client.1.smithi099.stdout:6/297: write dc/f21 [7767400,120000] 0 2024-09-17T01:01:52.761 INFO:tasks.workunit.client.0.smithi002.stdout:0/132: rename l9 to dd/d19/d1c/d1f/d22/l28 0 2024-09-17T01:01:52.762 INFO:tasks.workunit.client.1.smithi099.stdout:6/298: symlink dc/d5d/l65 0 2024-09-17T01:01:52.762 INFO:tasks.workunit.client.1.smithi099.stdout:6/299: write dc/d1a/f1e [1388894,15059] 0 2024-09-17T01:01:52.763 INFO:tasks.workunit.client.1.smithi099.stdout:6/300: chown dc/c24 1 1 2024-09-17T01:01:52.763 INFO:tasks.workunit.client.1.smithi099.stdout:6/301: readlink dc/d1a/d49/d4c/l61 0 2024-09-17T01:01:52.763 INFO:tasks.workunit.client.1.smithi099.stdout:6/302: write dc/d1a/f1e [105480,10462] 0 2024-09-17T01:01:52.763 INFO:tasks.workunit.client.1.smithi099.stdout:6/303: chown dc/d1a/c3c 15730968 1 2024-09-17T01:01:52.763 INFO:tasks.workunit.client.1.smithi099.stdout:6/304: fdatasync dc/d1a/f1b 0 2024-09-17T01:01:52.763 INFO:tasks.workunit.client.1.smithi099.stdout:6/305: chown dc/l15 3 1 2024-09-17T01:01:52.764 INFO:tasks.workunit.client.0.smithi002.stdout:1/220: truncate d4/fe 3651791 0 2024-09-17T01:01:52.764 INFO:tasks.workunit.client.0.smithi002.stdout:4/231: rename d7/de/c3b to d7/d19/d2e/c44 0 2024-09-17T01:01:52.764 INFO:tasks.workunit.client.0.smithi002.stdout:4/232: write d7/d19/d2e/f39 [177880,93919] 0 2024-09-17T01:01:52.764 INFO:tasks.workunit.client.1.smithi099.stdout:6/306: mkdir dc/d5d/d66 0 2024-09-17T01:01:52.764 INFO:tasks.workunit.client.1.smithi099.stdout:6/307: stat dc/d2b/d3f 0 2024-09-17T01:01:52.764 INFO:tasks.workunit.client.1.smithi099.stdout:6/308: write dc/d1a/d49/f45 [883499,2367] 0 2024-09-17T01:01:52.765 INFO:tasks.workunit.client.0.smithi002.stdout:0/133: mkdir dd/d19/d1a/d29 0 2024-09-17T01:01:52.765 INFO:tasks.workunit.client.0.smithi002.stdout:0/134: write dd/d19/d1a/f1d [515773,77501] 0 2024-09-17T01:01:52.765 INFO:tasks.workunit.client.0.smithi002.stdout:4/233: getdents d7 0 2024-09-17T01:01:52.765 INFO:tasks.workunit.client.0.smithi002.stdout:4/234: stat d7/c2c 0 2024-09-17T01:01:52.767 INFO:tasks.workunit.client.1.smithi099.stdout:4/280: dread d7/dd/d21/d26/f51 [0,4194304] 0 2024-09-17T01:01:52.772 INFO:tasks.workunit.client.0.smithi002.stdout:4/235: dread d7/d19/f1f [0,4194304] 0 2024-09-17T01:01:52.772 INFO:tasks.workunit.client.0.smithi002.stdout:4/236: fdatasync d7/f18 0 2024-09-17T01:01:52.772 INFO:tasks.workunit.client.0.smithi002.stdout:4/237: fsync d7/f16 0 2024-09-17T01:01:52.777 INFO:tasks.workunit.client.1.smithi099.stdout:9/275: dwrite da/d1b/d3a/f23 [4194304,4194304] 0 2024-09-17T01:01:52.779 INFO:tasks.workunit.client.1.smithi099.stdout:4/281: write d7/dd/d21/d26/f32 [5545511,62523] 0 2024-09-17T01:01:52.780 INFO:tasks.workunit.client.0.smithi002.stdout:7/137: dwrite d1/f8 [4194304,4194304] 0 2024-09-17T01:01:52.780 INFO:tasks.workunit.client.1.smithi099.stdout:4/282: creat d7/dd/de/d10/f61 x:0 0 0 2024-09-17T01:01:52.781 INFO:tasks.workunit.client.1.smithi099.stdout:4/283: creat d7/dd/de/f62 x:0 0 0 2024-09-17T01:01:52.782 INFO:tasks.workunit.client.1.smithi099.stdout:4/284: creat d7/dd/d21/f63 x:0 0 0 2024-09-17T01:01:52.783 INFO:tasks.workunit.client.1.smithi099.stdout:4/285: unlink d7/dd/d21/f63 0 2024-09-17T01:01:52.784 INFO:tasks.workunit.client.1.smithi099.stdout:4/286: write d7/f8 [987386,66919] 0 2024-09-17T01:01:52.784 INFO:tasks.workunit.client.0.smithi002.stdout:8/219: getdents d2/d1c/d3c/d47 0 2024-09-17T01:01:52.785 INFO:tasks.workunit.client.0.smithi002.stdout:8/220: getdents d2/d1c/d3b 0 2024-09-17T01:01:52.790 INFO:tasks.workunit.client.1.smithi099.stdout:6/309: dwrite dc/f3e [0,4194304] 0 2024-09-17T01:01:52.794 INFO:tasks.workunit.client.1.smithi099.stdout:4/287: dread d7/dd/de/d10/d18/d4b/f1d [0,4194304] 0 2024-09-17T01:01:52.794 INFO:tasks.workunit.client.1.smithi099.stdout:4/288: stat d7/dd/d21/d26/d3f/d5b/f2d 0 2024-09-17T01:01:52.796 INFO:tasks.workunit.client.0.smithi002.stdout:5/205: sync 2024-09-17T01:01:52.796 INFO:tasks.workunit.client.0.smithi002.stdout:5/206: getdents d2/d2d/d10/d14 0 2024-09-17T01:01:52.796 INFO:tasks.workunit.client.0.smithi002.stdout:1/221: dwrite d4/d11/d12/d23/f35 [0,4194304] 0 2024-09-17T01:01:52.796 INFO:tasks.workunit.client.0.smithi002.stdout:1/222: dread - d4/d11/d12/d14/f36 zero size 2024-09-17T01:01:52.797 INFO:tasks.workunit.client.0.smithi002.stdout:4/238: dwrite d7/d19/d2e/f33 [0,4194304] 0 2024-09-17T01:01:52.798 INFO:tasks.workunit.client.0.smithi002.stdout:5/207: mkdir d2/d2d/d10/d14/d19/d39/d3f 0 2024-09-17T01:01:52.798 INFO:tasks.workunit.client.1.smithi099.stdout:9/276: write da/d21/f3b [1775938,21066] 0 2024-09-17T01:01:52.798 INFO:tasks.workunit.client.1.smithi099.stdout:9/277: chown da/d21/d2a/l31 1636280 1 2024-09-17T01:01:52.798 INFO:tasks.workunit.client.1.smithi099.stdout:4/289: mkdir d7/dd/d64 0 2024-09-17T01:01:52.798 INFO:tasks.workunit.client.1.smithi099.stdout:4/290: readlink d7/dd/d21/d26/d3f/l4c 0 2024-09-17T01:01:52.799 INFO:tasks.workunit.client.1.smithi099.stdout:9/278: unlink da/d21/d5b/l58 0 2024-09-17T01:01:52.801 INFO:tasks.workunit.client.0.smithi002.stdout:1/223: rmdir d4/d11/d12/d34 0 2024-09-17T01:01:52.802 INFO:tasks.workunit.client.0.smithi002.stdout:4/239: mknod d7/de/d3a/c45 0 2024-09-17T01:01:52.802 INFO:tasks.workunit.client.0.smithi002.stdout:4/240: write d7/de/f2a [701856,15230] 0 2024-09-17T01:01:52.802 INFO:tasks.workunit.client.0.smithi002.stdout:4/241: readlink d7/l1b 0 2024-09-17T01:01:52.803 INFO:tasks.workunit.client.0.smithi002.stdout:5/208: creat d2/d2d/d10/d14/d19/d39/d25/d32/f40 x:0 0 0 2024-09-17T01:01:52.805 INFO:tasks.workunit.client.0.smithi002.stdout:1/224: mknod d4/d11/d12/d23/c4e 0 2024-09-17T01:01:52.806 INFO:tasks.workunit.client.0.smithi002.stdout:4/242: creat d7/d19/d2e/f46 x:0 0 0 2024-09-17T01:01:52.809 INFO:tasks.workunit.client.0.smithi002.stdout:5/209: mkdir d2/d2d/d10/d3b/d41 0 2024-09-17T01:01:52.809 INFO:tasks.workunit.client.0.smithi002.stdout:5/210: write d2/f3a [148639,120153] 0 2024-09-17T01:01:52.809 INFO:tasks.workunit.client.0.smithi002.stdout:8/221: dwrite d2/d26/f33 [0,4194304] 0 2024-09-17T01:01:52.809 INFO:tasks.workunit.client.1.smithi099.stdout:4/291: dread d7/dd/de/d10/d18/f2e [0,4194304] 0 2024-09-17T01:01:52.809 INFO:tasks.workunit.client.1.smithi099.stdout:4/292: creat d7/dd/d21/d26/f65 x:0 0 0 2024-09-17T01:01:52.810 INFO:tasks.workunit.client.1.smithi099.stdout:4/293: fdatasync d7/dd/de/d10/d18/f42 0 2024-09-17T01:01:52.811 INFO:tasks.workunit.client.0.smithi002.stdout:4/243: mknod d7/de/c47 0 2024-09-17T01:01:52.811 INFO:tasks.workunit.client.0.smithi002.stdout:5/211: creat d2/d2d/d10/d20/f42 x:0 0 0 2024-09-17T01:01:52.811 INFO:tasks.workunit.client.1.smithi099.stdout:1/324: sync 2024-09-17T01:01:52.811 INFO:tasks.workunit.client.1.smithi099.stdout:1/325: chown d0/d2/d5/c45 21 1 2024-09-17T01:01:52.811 INFO:tasks.workunit.client.1.smithi099.stdout:1/326: dread - d0/d2/f3b zero size 2024-09-17T01:01:52.812 INFO:tasks.workunit.client.1.smithi099.stdout:0/239: sync 2024-09-17T01:01:52.812 INFO:tasks.workunit.client.1.smithi099.stdout:0/240: fdatasync f9 0 2024-09-17T01:01:52.824 INFO:tasks.workunit.client.1.smithi099.stdout:9/279: mkdir da/d1b/d5f 0 2024-09-17T01:01:52.829 INFO:tasks.workunit.client.1.smithi099.stdout:4/294: symlink d7/dd/de/d10/d18/l66 0 2024-09-17T01:01:52.829 INFO:tasks.workunit.client.1.smithi099.stdout:4/295: rename d7/dd to d7/dd/de/d10/d67 22 2024-09-17T01:01:52.833 INFO:tasks.workunit.client.1.smithi099.stdout:0/241: mknod da/c4e 0 2024-09-17T01:01:52.834 INFO:tasks.workunit.client.0.smithi002.stdout:1/225: dwrite d4/d11/d1a/f29 [0,4194304] 0 2024-09-17T01:01:52.834 INFO:tasks.workunit.client.0.smithi002.stdout:1/226: chown d4/f3f 898448746 1 2024-09-17T01:01:52.834 INFO:tasks.workunit.client.0.smithi002.stdout:1/227: dread - d4/d11/d12/f38 zero size 2024-09-17T01:01:52.835 INFO:tasks.workunit.client.1.smithi099.stdout:9/280: rmdir da/d1b/d5f 0 2024-09-17T01:01:52.838 INFO:tasks.workunit.client.1.smithi099.stdout:9/281: dread da/d21/d2a/f54 [0,4194304] 0 2024-09-17T01:01:52.838 INFO:tasks.workunit.client.1.smithi099.stdout:9/282: creat da/d50/f60 x:0 0 0 2024-09-17T01:01:52.839 INFO:tasks.workunit.client.1.smithi099.stdout:9/283: fsync da/d50/f5c 0 2024-09-17T01:01:52.839 INFO:tasks.workunit.client.1.smithi099.stdout:9/284: write da/d50/f60 [879119,93951] 0 2024-09-17T01:01:52.839 INFO:tasks.workunit.client.1.smithi099.stdout:9/285: fdatasync da/f44 0 2024-09-17T01:01:52.840 INFO:tasks.workunit.client.1.smithi099.stdout:0/242: write da/d12/f16 [919718,78971] 0 2024-09-17T01:01:52.842 INFO:tasks.workunit.client.1.smithi099.stdout:9/286: mkdir da/d14/d40/d61 0 2024-09-17T01:01:52.844 INFO:tasks.workunit.client.1.smithi099.stdout:0/243: rename da/d1c/d1e/f1f to da/df/f4f 0 2024-09-17T01:01:52.844 INFO:tasks.workunit.client.1.smithi099.stdout:0/244: creat da/df/d1a/d23/f50 x:0 0 0 2024-09-17T01:01:52.846 INFO:tasks.workunit.client.1.smithi099.stdout:9/287: mkdir da/d14/d62 0 2024-09-17T01:01:52.847 INFO:tasks.workunit.client.0.smithi002.stdout:1/228: dread d4/d11/d12/d14/d17/f27 [0,4194304] 0 2024-09-17T01:01:52.847 INFO:tasks.workunit.client.0.smithi002.stdout:1/229: chown d4/d11/d12/d14/d17/d3b 110 1 2024-09-17T01:01:52.848 INFO:tasks.workunit.client.1.smithi099.stdout:1/327: dwrite d0/d8/f26 [0,4194304] 0 2024-09-17T01:01:52.848 INFO:tasks.workunit.client.1.smithi099.stdout:4/296: dwrite d7/d35/f36 [0,4194304] 0 2024-09-17T01:01:52.848 INFO:tasks.workunit.client.1.smithi099.stdout:9/288: truncate f4 271840 0 2024-09-17T01:01:52.852 INFO:tasks.workunit.client.0.smithi002.stdout:8/222: dwrite d2/d26/f33 [0,4194304] 0 2024-09-17T01:01:52.853 INFO:tasks.workunit.client.0.smithi002.stdout:5/212: dwrite d2/d2d/d10/d14/d19/d39/f35 [0,4194304] 0 2024-09-17T01:01:52.853 INFO:tasks.workunit.client.1.smithi099.stdout:1/328: rename d0/d8/d4a/f4f to d0/f67 0 2024-09-17T01:01:52.854 INFO:tasks.workunit.client.0.smithi002.stdout:4/244: dwrite d7/de/d22/f31 [0,4194304] 0 2024-09-17T01:01:52.856 INFO:tasks.workunit.client.0.smithi002.stdout:5/213: rmdir d2/d2d/d10 39 2024-09-17T01:01:52.857 INFO:tasks.workunit.client.0.smithi002.stdout:5/214: truncate d2/f6 2179534 0 2024-09-17T01:01:52.859 INFO:tasks.workunit.client.0.smithi002.stdout:4/245: rename d7/de/d22 to d7/d3f/d48 0 2024-09-17T01:01:52.859 INFO:tasks.workunit.client.0.smithi002.stdout:4/246: readlink d7/lf 0 2024-09-17T01:01:52.863 INFO:tasks.workunit.client.0.smithi002.stdout:5/215: rename d2/dc to d2/d2d/d10/d14/d19/d39/d43 0 2024-09-17T01:01:52.864 INFO:tasks.workunit.client.0.smithi002.stdout:8/223: dread f0 [0,4194304] 0 2024-09-17T01:01:52.864 INFO:tasks.workunit.client.0.smithi002.stdout:5/216: mkdir d2/d2d/d10/d23/d44 0 2024-09-17T01:01:52.867 INFO:tasks.workunit.client.0.smithi002.stdout:8/224: rename d2/d3/c3d to d2/d9/dd/c52 0 2024-09-17T01:01:52.868 INFO:tasks.workunit.client.1.smithi099.stdout:4/297: write d7/dd/de/f4f [4119499,85746] 0 2024-09-17T01:01:52.869 INFO:tasks.workunit.client.0.smithi002.stdout:4/247: write d7/d3f/d48/f31 [1936433,125084] 0 2024-09-17T01:01:52.869 INFO:tasks.workunit.client.0.smithi002.stdout:5/217: rename d2/d2d/d10/d23/c26 to d2/d2d/d10/d14/c45 0 2024-09-17T01:01:52.872 INFO:tasks.workunit.client.0.smithi002.stdout:4/248: link d7/de/d3a/c45 d7/d19/c49 0 2024-09-17T01:01:52.872 INFO:tasks.workunit.client.0.smithi002.stdout:4/249: chown d7/de/d3a/f3c 15 1 2024-09-17T01:01:52.879 INFO:tasks.workunit.client.0.smithi002.stdout:8/225: rename d2/d30/c45 to d2/d26/d2b/d4f/c53 0 2024-09-17T01:01:52.880 INFO:tasks.workunit.client.0.smithi002.stdout:5/218: creat d2/d2d/d10/d14/d19/d39/d3f/f46 x:0 0 0 2024-09-17T01:01:52.881 INFO:tasks.workunit.client.0.smithi002.stdout:8/226: getdents d2/d26/d2b 0 2024-09-17T01:01:52.882 INFO:tasks.workunit.client.0.smithi002.stdout:5/219: mknod d2/d2d/d10/d14/d19/d39/d43/c47 0 2024-09-17T01:01:52.882 INFO:tasks.workunit.client.0.smithi002.stdout:8/227: truncate d2/d9/dd/f18 1981530 0 2024-09-17T01:01:52.882 INFO:tasks.workunit.client.1.smithi099.stdout:4/298: write d7/dd/d21/d26/d3f/d5b/f37 [3884185,86621] 0 2024-09-17T01:01:52.883 INFO:tasks.workunit.client.0.smithi002.stdout:5/220: unlink d2/d2d/d10/d20/f42 0 2024-09-17T01:01:52.885 INFO:tasks.workunit.client.0.smithi002.stdout:8/228: creat d2/d41/f54 x:0 0 0 2024-09-17T01:01:52.885 INFO:tasks.workunit.client.0.smithi002.stdout:8/229: chown d2/d1c/d28 39 1 2024-09-17T01:01:52.886 INFO:tasks.workunit.client.0.smithi002.stdout:8/230: creat d2/d1c/d28/f55 x:0 0 0 2024-09-17T01:01:52.886 INFO:tasks.workunit.client.1.smithi099.stdout:0/245: dwrite f7 [0,4194304] 0 2024-09-17T01:01:52.887 INFO:tasks.workunit.client.1.smithi099.stdout:1/329: dwrite d0/d2/d18/f52 [4194304,4194304] 0 2024-09-17T01:01:52.887 INFO:tasks.workunit.client.0.smithi002.stdout:1/230: dwrite d4/d11/d12/d30/d43/f4d [0,4194304] 0 2024-09-17T01:01:52.887 INFO:tasks.workunit.client.0.smithi002.stdout:8/231: truncate d2/fb 3913148 0 2024-09-17T01:01:52.888 INFO:tasks.workunit.client.0.smithi002.stdout:1/231: mknod d4/d11/d12/d14/d17/d20/c4f 0 2024-09-17T01:01:52.889 INFO:tasks.workunit.client.1.smithi099.stdout:0/246: link da/df/f41 da/df/d1a/d49/f51 0 2024-09-17T01:01:52.889 INFO:tasks.workunit.client.0.smithi002.stdout:8/232: readlink d2/d9/l17 0 2024-09-17T01:01:52.890 INFO:tasks.workunit.client.0.smithi002.stdout:1/232: creat d4/d11/d12/d14/d17/d20/f50 x:0 0 0 2024-09-17T01:01:52.891 INFO:tasks.workunit.client.1.smithi099.stdout:0/247: mkdir da/d12/d22/d52 0 2024-09-17T01:01:52.891 INFO:tasks.workunit.client.0.smithi002.stdout:1/233: read d4/f6 [2318992,10419] 0 2024-09-17T01:01:52.892 INFO:tasks.workunit.client.0.smithi002.stdout:1/234: chown d4/d11/d12/d14/d17/f27 0 1 2024-09-17T01:01:52.892 INFO:tasks.workunit.client.0.smithi002.stdout:1/235: mkdir d4/d11/d12/d14/d17/d51 0 2024-09-17T01:01:52.893 INFO:tasks.workunit.client.0.smithi002.stdout:1/236: mknod d4/d11/c52 0 2024-09-17T01:01:52.893 INFO:tasks.workunit.client.1.smithi099.stdout:1/330: dread d0/d2/f3f [0,4194304] 0 2024-09-17T01:01:52.894 INFO:tasks.workunit.client.0.smithi002.stdout:1/237: dread d4/d11/d12/d14/d17/d3b/f42 [0,4194304] 0 2024-09-17T01:01:52.895 INFO:tasks.workunit.client.1.smithi099.stdout:1/331: rename d0/d2/d18/c37 to d0/d2/d61/c68 0 2024-09-17T01:01:52.896 INFO:tasks.workunit.client.0.smithi002.stdout:1/238: mknod d4/d11/d12/d14/d17/d40/c53 0 2024-09-17T01:01:52.896 INFO:tasks.workunit.client.1.smithi099.stdout:1/332: rename d0/d2/d5/c45 to d0/c69 0 2024-09-17T01:01:52.897 INFO:tasks.workunit.client.1.smithi099.stdout:1/333: symlink d0/d2/d5/l6a 0 2024-09-17T01:01:52.897 INFO:tasks.workunit.client.1.smithi099.stdout:1/334: fdatasync d0/d2/ff 0 2024-09-17T01:01:52.897 INFO:tasks.workunit.client.0.smithi002.stdout:1/239: mknod d4/d22/c54 0 2024-09-17T01:01:52.897 INFO:tasks.workunit.client.0.smithi002.stdout:8/233: dread d2/d3/f19 [0,4194304] 0 2024-09-17T01:01:52.900 INFO:tasks.workunit.client.0.smithi002.stdout:5/221: dread d2/d2d/f18 [0,4194304] 0 2024-09-17T01:01:52.900 INFO:tasks.workunit.client.0.smithi002.stdout:8/234: creat d2/f56 x:0 0 0 2024-09-17T01:01:52.901 INFO:tasks.workunit.client.0.smithi002.stdout:5/222: mkdir d2/d2d/d10/d14/d19/d39/d48 0 2024-09-17T01:01:52.901 INFO:tasks.workunit.client.0.smithi002.stdout:4/250: dwrite d7/f12 [0,4194304] 0 2024-09-17T01:01:52.902 INFO:tasks.workunit.client.1.smithi099.stdout:1/335: creat d0/d2/d18/f6b x:0 0 0 2024-09-17T01:01:52.902 INFO:tasks.workunit.client.0.smithi002.stdout:5/223: mknod d2/de/c49 0 2024-09-17T01:01:52.905 INFO:tasks.workunit.client.1.smithi099.stdout:7/291: sync 2024-09-17T01:01:52.905 INFO:tasks.workunit.client.1.smithi099.stdout:7/292: write d1/d2c/d5c/d12/f2b [1188045,117563] 0 2024-09-17T01:01:52.908 INFO:tasks.workunit.client.1.smithi099.stdout:7/293: symlink d1/d37/l5e 0 2024-09-17T01:01:52.908 INFO:tasks.workunit.client.0.smithi002.stdout:4/251: mkdir d7/d19/d4a 0 2024-09-17T01:01:52.908 INFO:tasks.workunit.client.0.smithi002.stdout:4/252: read d7/de/f27 [610740,46998] 0 2024-09-17T01:01:52.909 INFO:tasks.workunit.client.1.smithi099.stdout:0/248: dread da/f14 [0,4194304] 0 2024-09-17T01:01:52.909 INFO:tasks.workunit.client.1.smithi099.stdout:0/249: chown da/df/d1a/d23/f3c 654019173 1 2024-09-17T01:01:52.910 INFO:tasks.workunit.client.0.smithi002.stdout:4/253: truncate d7/d3f/d48/f26 3237526 0 2024-09-17T01:01:52.911 INFO:tasks.workunit.client.0.smithi002.stdout:5/224: write d2/f6 [588812,79055] 0 2024-09-17T01:01:52.913 INFO:tasks.workunit.client.0.smithi002.stdout:4/254: symlink d7/de/d23/l4b 0 2024-09-17T01:01:52.914 INFO:tasks.workunit.client.1.smithi099.stdout:7/294: dread d1/f19 [0,4194304] 0 2024-09-17T01:01:52.915 INFO:tasks.workunit.client.0.smithi002.stdout:1/240: dwrite d4/d11/d1a/f29 [0,4194304] 0 2024-09-17T01:01:52.916 INFO:tasks.workunit.client.0.smithi002.stdout:5/225: unlink d2/d2d/d10/d14/d19/d39/d43/f38 0 2024-09-17T01:01:52.918 INFO:tasks.workunit.client.0.smithi002.stdout:1/241: mkdir d4/d11/d55 0 2024-09-17T01:01:52.918 INFO:tasks.workunit.client.0.smithi002.stdout:6/222: sync 2024-09-17T01:01:52.918 INFO:tasks.workunit.client.0.smithi002.stdout:2/203: sync 2024-09-17T01:01:52.918 INFO:tasks.workunit.client.0.smithi002.stdout:2/204: read - d1b/f31 zero size 2024-09-17T01:01:52.918 INFO:tasks.workunit.client.0.smithi002.stdout:9/155: sync 2024-09-17T01:01:52.920 INFO:tasks.workunit.client.0.smithi002.stdout:4/255: getdents d7/de 0 2024-09-17T01:01:52.921 INFO:tasks.workunit.client.0.smithi002.stdout:1/242: mkdir d4/d11/d12/d14/d17/d56 0 2024-09-17T01:01:52.921 INFO:tasks.workunit.client.0.smithi002.stdout:1/243: fsync d4/f18 0 2024-09-17T01:01:52.921 INFO:tasks.workunit.client.0.smithi002.stdout:1/244: write d4/f18 [618088,15931] 0 2024-09-17T01:01:52.921 INFO:tasks.workunit.client.0.smithi002.stdout:1/245: fsync d4/d11/d1a/f29 0 2024-09-17T01:01:52.921 INFO:tasks.workunit.client.0.smithi002.stdout:1/246: read d4/f6 [1914375,24526] 0 2024-09-17T01:01:52.922 INFO:tasks.workunit.client.0.smithi002.stdout:2/205: mkdir d1b/d37/d48 0 2024-09-17T01:01:52.922 INFO:tasks.workunit.client.0.smithi002.stdout:2/206: creat d1b/d37/f49 x:0 0 0 2024-09-17T01:01:52.925 INFO:tasks.workunit.client.0.smithi002.stdout:1/247: mknod d4/d11/d55/c57 0 2024-09-17T01:01:52.927 INFO:tasks.workunit.client.1.smithi099.stdout:0/250: write da/df/f15 [254232,44186] 0 2024-09-17T01:01:52.928 INFO:tasks.workunit.client.1.smithi099.stdout:0/251: write da/d1c/f3d [393385,2398] 0 2024-09-17T01:01:52.930 INFO:tasks.workunit.client.0.smithi002.stdout:8/235: dwrite d2/f12 [4194304,4194304] 0 2024-09-17T01:01:52.932 INFO:tasks.workunit.client.1.smithi099.stdout:1/336: dwrite d0/d2/d18/f34 [0,4194304] 0 2024-09-17T01:01:52.932 INFO:tasks.workunit.client.1.smithi099.stdout:7/295: write d1/ff [3087913,116560] 0 2024-09-17T01:01:52.932 INFO:tasks.workunit.client.1.smithi099.stdout:7/296: chown d1/d2c/l4e 344394 1 2024-09-17T01:01:52.932 INFO:tasks.workunit.client.0.smithi002.stdout:5/226: write d2/de/f1f [3515072,12788] 0 2024-09-17T01:01:52.932 INFO:tasks.workunit.client.0.smithi002.stdout:5/227: chown d2/de/f34 31 1 2024-09-17T01:01:52.942 INFO:tasks.workunit.client.0.smithi002.stdout:2/207: mknod d1b/d3f/c4a 0 2024-09-17T01:01:52.945 INFO:tasks.workunit.client.0.smithi002.stdout:3/225: sync 2024-09-17T01:01:52.945 INFO:tasks.workunit.client.0.smithi002.stdout:3/226: chown d0/d3/c1d 234 1 2024-09-17T01:01:52.954 INFO:tasks.workunit.client.1.smithi099.stdout:0/252: dwrite da/df/f28 [0,4194304] 0 2024-09-17T01:01:52.969 INFO:tasks.workunit.client.0.smithi002.stdout:3/227: dread d0/d3/d17/f20 [0,4194304] 0 2024-09-17T01:01:52.972 INFO:tasks.workunit.client.1.smithi099.stdout:7/297: dwrite d1/d2c/d5c/f1d [0,4194304] 0 2024-09-17T01:01:52.973 INFO:tasks.workunit.client.0.smithi002.stdout:5/228: dwrite d2/d2d/d10/d14/d19/f1c [0,4194304] 0 2024-09-17T01:01:52.973 INFO:tasks.workunit.client.0.smithi002.stdout:5/229: truncate d2/d2d/d10/d14/d19/d39/d3f/f46 909224 0 2024-09-17T01:01:52.973 INFO:tasks.workunit.client.0.smithi002.stdout:5/230: stat d2/d2d/d10/d20 0 2024-09-17T01:01:52.973 INFO:tasks.workunit.client.0.smithi002.stdout:4/256: dwrite d7/de/d32/f40 [0,4194304] 0 2024-09-17T01:01:52.973 INFO:tasks.workunit.client.0.smithi002.stdout:5/231: creat d2/de/f4a x:0 0 0 2024-09-17T01:01:52.973 INFO:tasks.workunit.client.0.smithi002.stdout:2/208: dwrite d1b/d1d/f28 [0,4194304] 0 2024-09-17T01:01:52.974 INFO:tasks.workunit.client.0.smithi002.stdout:2/209: fdatasync f19 0 2024-09-17T01:01:52.974 INFO:tasks.workunit.client.0.smithi002.stdout:2/210: write d1b/f3a [1611383,65037] 0 2024-09-17T01:01:52.974 INFO:tasks.workunit.client.0.smithi002.stdout:2/211: creat d1b/f4b x:0 0 0 2024-09-17T01:01:52.974 INFO:tasks.workunit.client.0.smithi002.stdout:8/236: dwrite d2/d9/f34 [0,4194304] 0 2024-09-17T01:01:52.982 INFO:tasks.workunit.client.0.smithi002.stdout:4/257: unlink d7/d19/f1f 0 2024-09-17T01:01:52.983 INFO:tasks.workunit.client.0.smithi002.stdout:5/232: mknod d2/d2d/d10/d3b/c4b 0 2024-09-17T01:01:52.984 INFO:tasks.workunit.client.0.smithi002.stdout:0/135: sync 2024-09-17T01:01:52.986 INFO:tasks.workunit.client.0.smithi002.stdout:2/212: mknod d1b/d1d/d38/d3e/c4c 0 2024-09-17T01:01:52.988 INFO:tasks.workunit.client.0.smithi002.stdout:7/138: sync 2024-09-17T01:01:52.990 INFO:tasks.workunit.client.0.smithi002.stdout:7/139: mkdir d1/d14/d1d/d28/d2d 0 2024-09-17T01:01:52.991 INFO:tasks.workunit.client.0.smithi002.stdout:4/258: dread d7/d3f/d48/f26 [0,4194304] 0 2024-09-17T01:01:52.991 INFO:tasks.workunit.client.0.smithi002.stdout:4/259: dread - d7/d19/d34/f41 zero size 2024-09-17T01:01:52.991 INFO:tasks.workunit.client.0.smithi002.stdout:3/228: dwrite d0/d3/f8 [0,4194304] 0 2024-09-17T01:01:52.993 INFO:tasks.workunit.client.0.smithi002.stdout:7/140: symlink d1/d14/d1d/d21/l2e 0 2024-09-17T01:01:52.995 INFO:tasks.workunit.client.0.smithi002.stdout:8/237: dwrite d2/d9/dd/f2c [0,4194304] 0 2024-09-17T01:01:52.995 INFO:tasks.workunit.client.0.smithi002.stdout:8/238: write d2/d1c/d3c/f46 [419562,73664] 0 2024-09-17T01:01:52.995 INFO:tasks.workunit.client.0.smithi002.stdout:8/239: creat d2/d26/f57 x:0 0 0 2024-09-17T01:01:52.995 INFO:tasks.workunit.client.0.smithi002.stdout:4/260: mknod d7/d3f/c4c 0 2024-09-17T01:01:52.996 INFO:tasks.workunit.client.0.smithi002.stdout:3/229: dread d0/f3e [0,4194304] 0 2024-09-17T01:01:52.996 INFO:tasks.workunit.client.0.smithi002.stdout:3/230: creat d0/d3/d37/f4d x:0 0 0 2024-09-17T01:01:52.997 INFO:tasks.workunit.client.0.smithi002.stdout:7/141: creat d1/d14/d1d/d29/f2f x:0 0 0 2024-09-17T01:01:52.997 INFO:tasks.workunit.client.0.smithi002.stdout:7/142: truncate f0 5066244 0 2024-09-17T01:01:53.000 INFO:tasks.workunit.client.0.smithi002.stdout:8/240: mkdir d2/d26/d2b/d4f/d58 0 2024-09-17T01:01:53.002 INFO:tasks.workunit.client.0.smithi002.stdout:4/261: mkdir d7/d19/d4a/d4d 0 2024-09-17T01:01:53.005 INFO:tasks.workunit.client.0.smithi002.stdout:7/143: mkdir d1/d14/d1d/d29/d30 0 2024-09-17T01:01:53.012 INFO:tasks.workunit.client.0.smithi002.stdout:3/231: dwrite d0/fd [0,4194304] 0 2024-09-17T01:01:53.012 INFO:tasks.workunit.client.0.smithi002.stdout:3/232: chown d0/d3/d17/l22 0 1 2024-09-17T01:01:53.012 INFO:tasks.workunit.client.0.smithi002.stdout:3/233: chown d0/c5 5089584 1 2024-09-17T01:01:53.012 INFO:tasks.workunit.client.1.smithi099.stdout:0/253: mkdir da/d12/d22/d53 0 2024-09-17T01:01:53.013 INFO:tasks.workunit.client.0.smithi002.stdout:8/241: unlink d2/d9/c10 0 2024-09-17T01:01:53.013 INFO:tasks.workunit.client.1.smithi099.stdout:7/298: mknod d1/c5f 0 2024-09-17T01:01:53.014 INFO:tasks.workunit.client.0.smithi002.stdout:3/234: symlink d0/d3/d33/d40/l4e 0 2024-09-17T01:01:53.014 INFO:tasks.workunit.client.1.smithi099.stdout:0/254: unlink da/f26 0 2024-09-17T01:01:53.014 INFO:tasks.workunit.client.1.smithi099.stdout:0/255: chown da/df/d1a 55 1 2024-09-17T01:01:53.015 INFO:tasks.workunit.client.0.smithi002.stdout:8/242: mknod d2/d1c/c59 0 2024-09-17T01:01:53.016 INFO:tasks.workunit.client.0.smithi002.stdout:7/144: dread d1/f11 [4194304,4194304] 0 2024-09-17T01:01:53.016 INFO:tasks.workunit.client.0.smithi002.stdout:7/145: fsync d1/f20 0 2024-09-17T01:01:53.016 INFO:tasks.workunit.client.0.smithi002.stdout:3/235: mkdir d0/d3/d33/d4f 0 2024-09-17T01:01:53.017 INFO:tasks.workunit.client.0.smithi002.stdout:8/243: rename d2/d3/c23 to d2/d3/c5a 0 2024-09-17T01:01:53.017 INFO:tasks.workunit.client.0.smithi002.stdout:8/244: write d2/d1c/d28/f55 [826332,79988] 0 2024-09-17T01:01:53.018 INFO:tasks.workunit.client.0.smithi002.stdout:5/233: dwrite d2/de/f4a [0,4194304] 0 2024-09-17T01:01:53.018 INFO:tasks.workunit.client.0.smithi002.stdout:5/234: fsync d2/f6 0 2024-09-17T01:01:53.018 INFO:tasks.workunit.client.0.smithi002.stdout:5/235: chown d2/de 677965 1 2024-09-17T01:01:53.019 INFO:tasks.workunit.client.0.smithi002.stdout:7/146: creat d1/d24/f31 x:0 0 0 2024-09-17T01:01:53.019 INFO:tasks.workunit.client.0.smithi002.stdout:2/213: dwrite f17 [4194304,4194304] 0 2024-09-17T01:01:53.019 INFO:tasks.workunit.client.0.smithi002.stdout:0/136: dwrite dd/ff [4194304,4194304] 0 2024-09-17T01:01:53.019 INFO:tasks.workunit.client.0.smithi002.stdout:3/236: symlink d0/d3/d17/d35/l50 0 2024-09-17T01:01:53.022 INFO:tasks.workunit.client.0.smithi002.stdout:5/236: getdents d2/d2d/d10/d14/d19/d39/d25 0 2024-09-17T01:01:53.022 INFO:tasks.workunit.client.0.smithi002.stdout:5/237: write d2/d2d/f17 [176699,93184] 0 2024-09-17T01:01:53.027 INFO:tasks.workunit.client.0.smithi002.stdout:7/147: symlink d1/d14/d1d/l32 0 2024-09-17T01:01:53.029 INFO:tasks.workunit.client.0.smithi002.stdout:4/262: getdents d7/d3f 0 2024-09-17T01:01:53.029 INFO:tasks.workunit.client.0.smithi002.stdout:5/238: rmdir d2/d2d 39 2024-09-17T01:01:53.029 INFO:tasks.workunit.client.0.smithi002.stdout:5/239: chown d2/d2d/f13 263582466 1 2024-09-17T01:01:53.029 INFO:tasks.workunit.client.0.smithi002.stdout:5/240: creat d2/f4c x:0 0 0 2024-09-17T01:01:53.029 INFO:tasks.workunit.client.0.smithi002.stdout:5/241: fsync d2/f9 0 2024-09-17T01:01:53.029 INFO:tasks.workunit.client.0.smithi002.stdout:5/242: fdatasync d2/f4 0 2024-09-17T01:01:53.029 INFO:tasks.workunit.client.0.smithi002.stdout:5/243: truncate d2/f2c 110566 0 2024-09-17T01:01:53.031 INFO:tasks.workunit.client.0.smithi002.stdout:7/148: symlink d1/d14/d1d/d29/l33 0 2024-09-17T01:01:53.031 INFO:tasks.workunit.client.0.smithi002.stdout:7/149: chown d1/lf 215940 1 2024-09-17T01:01:53.032 INFO:tasks.workunit.client.0.smithi002.stdout:0/137: write dd/f13 [3249951,53445] 0 2024-09-17T01:01:53.033 INFO:tasks.workunit.client.0.smithi002.stdout:4/263: unlink d7/de/d23/c29 0 2024-09-17T01:01:53.034 INFO:tasks.workunit.client.1.smithi099.stdout:0/256: dwrite da/df/f47 [0,4194304] 0 2024-09-17T01:01:53.034 INFO:tasks.workunit.client.1.smithi099.stdout:0/257: chown da/d12 112 1 2024-09-17T01:01:53.034 INFO:tasks.workunit.client.1.smithi099.stdout:0/258: dread - da/df/d1a/d49/f4a zero size 2024-09-17T01:01:53.035 INFO:tasks.workunit.client.0.smithi002.stdout:8/245: getdents d2/d26/d2b/d4f 0 2024-09-17T01:01:53.036 INFO:tasks.workunit.client.0.smithi002.stdout:7/150: rename d1/d14/d1d/d21/l2e to d1/l34 0 2024-09-17T01:01:53.037 INFO:tasks.workunit.client.1.smithi099.stdout:0/259: creat da/df/d31/f54 x:0 0 0 2024-09-17T01:01:53.037 INFO:tasks.workunit.client.1.smithi099.stdout:0/260: creat da/df/f55 x:0 0 0 2024-09-17T01:01:53.037 INFO:tasks.workunit.client.1.smithi099.stdout:7/299: dwrite d1/d2c/d5c/f1b [0,4194304] 0 2024-09-17T01:01:53.038 INFO:tasks.workunit.client.0.smithi002.stdout:0/138: truncate dd/f18 490136 0 2024-09-17T01:01:53.039 INFO:tasks.workunit.client.1.smithi099.stdout:0/261: mkdir da/df/d1a/d56 0 2024-09-17T01:01:53.039 INFO:tasks.workunit.client.1.smithi099.stdout:0/262: chown da/d12/d2b 561080 1 2024-09-17T01:01:53.040 INFO:tasks.workunit.client.0.smithi002.stdout:5/244: rename d2/f4c to d2/f4d 0 2024-09-17T01:01:53.040 INFO:tasks.workunit.client.0.smithi002.stdout:5/245: write d2/f4d [933907,127982] 0 2024-09-17T01:01:53.040 INFO:tasks.workunit.client.0.smithi002.stdout:5/246: fdatasync d2/de/f4a 0 2024-09-17T01:01:53.041 INFO:tasks.workunit.client.1.smithi099.stdout:7/300: mkdir d1/d2c/d47/d48/d60 0 2024-09-17T01:01:53.041 INFO:tasks.workunit.client.0.smithi002.stdout:2/214: dwrite d1b/d1d/f33 [0,4194304] 0 2024-09-17T01:01:53.041 INFO:tasks.workunit.client.0.smithi002.stdout:4/264: dread d7/de/f28 [4194304,4194304] 0 2024-09-17T01:01:53.042 INFO:tasks.workunit.client.1.smithi099.stdout:0/263: mknod da/df/d4d/c57 0 2024-09-17T01:01:53.042 INFO:tasks.workunit.client.1.smithi099.stdout:0/264: chown da 52505126 1 2024-09-17T01:01:53.043 INFO:tasks.workunit.client.1.smithi099.stdout:0/265: rename da/df/f55 to da/d12/d22/d52/f58 0 2024-09-17T01:01:53.043 INFO:tasks.workunit.client.1.smithi099.stdout:0/266: readlink l6 0 2024-09-17T01:01:53.043 INFO:tasks.workunit.client.1.smithi099.stdout:0/267: mkdir da/d59 0 2024-09-17T01:01:53.044 INFO:tasks.workunit.client.0.smithi002.stdout:7/151: creat d1/d14/d1d/d28/d2d/f35 x:0 0 0 2024-09-17T01:01:53.044 INFO:tasks.workunit.client.1.smithi099.stdout:0/268: creat da/d12/f5a x:0 0 0 2024-09-17T01:01:53.045 INFO:tasks.workunit.client.1.smithi099.stdout:0/269: truncate da/df/f28 7301364 0 2024-09-17T01:01:53.045 INFO:tasks.workunit.client.1.smithi099.stdout:0/270: truncate da/d12/d2b/f37 923256 0 2024-09-17T01:01:53.045 INFO:tasks.workunit.client.1.smithi099.stdout:0/271: dread - da/df/d31/f54 zero size 2024-09-17T01:01:53.045 INFO:tasks.workunit.client.1.smithi099.stdout:0/272: chown da/df/f28 268722 1 2024-09-17T01:01:53.045 INFO:tasks.workunit.client.1.smithi099.stdout:0/273: rmdir da/d1c/d1e 39 2024-09-17T01:01:53.046 INFO:tasks.workunit.client.1.smithi099.stdout:0/274: creat da/d3b/f5b x:0 0 0 2024-09-17T01:01:53.046 INFO:tasks.workunit.client.0.smithi002.stdout:0/139: rename dd/ff to dd/d19/d1c/d1f/d22/f2a 0 2024-09-17T01:01:53.049 INFO:tasks.workunit.client.0.smithi002.stdout:5/247: symlink d2/d2d/d10/d14/d19/l4e 0 2024-09-17T01:01:53.049 INFO:tasks.workunit.client.0.smithi002.stdout:5/248: chown d2/d2d/d10/d14/d19/d39/d25 2 1 2024-09-17T01:01:53.049 INFO:tasks.workunit.client.0.smithi002.stdout:5/249: write d2/d2d/d10/d14/d19/d39/d3f/f46 [1487245,68010] 0 2024-09-17T01:01:53.049 INFO:tasks.workunit.client.0.smithi002.stdout:5/250: creat d2/de/f4f x:0 0 0 2024-09-17T01:01:53.049 INFO:tasks.workunit.client.0.smithi002.stdout:5/251: chown d2/d2d/d10/d20 961 1 2024-09-17T01:01:53.049 INFO:tasks.workunit.client.0.smithi002.stdout:5/252: write d2/f3a [980335,130797] 0 2024-09-17T01:01:53.053 INFO:tasks.workunit.client.1.smithi099.stdout:0/275: dread da/df/f15 [0,4194304] 0 2024-09-17T01:01:53.054 INFO:tasks.workunit.client.1.smithi099.stdout:0/276: read da/d1c/f3d [959925,1971] 0 2024-09-17T01:01:53.055 INFO:tasks.workunit.client.0.smithi002.stdout:3/237: dwrite d0/d3/d17/f2c [0,4194304] 0 2024-09-17T01:01:53.059 INFO:tasks.workunit.client.0.smithi002.stdout:4/265: read d7/d19/d2e/f33 [1323458,914] 0 2024-09-17T01:01:53.060 INFO:tasks.workunit.client.0.smithi002.stdout:8/246: rmdir d2 39 2024-09-17T01:01:53.060 INFO:tasks.workunit.client.0.smithi002.stdout:8/247: write d2/f12 [9341603,20091] 0 2024-09-17T01:01:53.062 INFO:tasks.workunit.client.0.smithi002.stdout:7/152: symlink d1/d14/d1d/d29/l36 0 2024-09-17T01:01:53.062 INFO:tasks.workunit.client.0.smithi002.stdout:7/153: write d1/d24/f31 [427750,92979] 0 2024-09-17T01:01:53.066 INFO:tasks.workunit.client.0.smithi002.stdout:5/253: link d2/de/d1d/l30 d2/l50 0 2024-09-17T01:01:53.067 INFO:tasks.workunit.client.0.smithi002.stdout:5/254: fsync d2/d2d/d10/d14/d19/d39/d43/f16 0 2024-09-17T01:01:53.067 INFO:tasks.workunit.client.0.smithi002.stdout:5/255: chown d2/d2d/d10/d3b/d41 472417749 1 2024-09-17T01:01:53.067 INFO:tasks.workunit.client.0.smithi002.stdout:5/256: dread - d2/de/f34 zero size 2024-09-17T01:01:53.068 INFO:tasks.workunit.client.1.smithi099.stdout:0/277: dread f8 [0,4194304] 0 2024-09-17T01:01:53.068 INFO:tasks.workunit.client.1.smithi099.stdout:0/278: write da/df/f41 [97639,84474] 0 2024-09-17T01:01:53.069 INFO:tasks.workunit.client.0.smithi002.stdout:8/248: unlink d2/d26/f33 0 2024-09-17T01:01:53.070 INFO:tasks.workunit.client.1.smithi099.stdout:0/279: mknod da/df/d31/c5c 0 2024-09-17T01:01:53.070 INFO:tasks.workunit.client.1.smithi099.stdout:0/280: read da/df/f4f [2023343,124366] 0 2024-09-17T01:01:53.070 INFO:tasks.workunit.client.1.smithi099.stdout:0/281: creat da/f5d x:0 0 0 2024-09-17T01:01:53.071 INFO:tasks.workunit.client.0.smithi002.stdout:5/257: mkdir d2/d2d/d10/d14/d19/d39/d51 0 2024-09-17T01:01:53.071 INFO:tasks.workunit.client.0.smithi002.stdout:5/258: creat d2/d2d/d10/d14/d19/d39/f52 x:0 0 0 2024-09-17T01:01:53.071 INFO:tasks.workunit.client.0.smithi002.stdout:5/259: truncate d2/de/f4f 638839 0 2024-09-17T01:01:53.071 INFO:tasks.workunit.client.0.smithi002.stdout:5/260: read d2/d2d/d10/d14/d19/d39/d43/f16 [2205082,117451] 0 2024-09-17T01:01:53.072 INFO:tasks.workunit.client.0.smithi002.stdout:4/266: write d7/f12 [1389573,6009] 0 2024-09-17T01:01:53.072 INFO:tasks.workunit.client.0.smithi002.stdout:4/267: write d7/f18 [6298617,67529] 0 2024-09-17T01:01:53.073 INFO:tasks.workunit.client.0.smithi002.stdout:5/261: unlink d2/f9 0 2024-09-17T01:01:53.074 INFO:tasks.workunit.client.0.smithi002.stdout:2/215: dwrite d1b/f1c [0,4194304] 0 2024-09-17T01:01:53.074 INFO:tasks.workunit.client.0.smithi002.stdout:2/216: creat d1b/d37/f4d x:0 0 0 2024-09-17T01:01:53.074 INFO:tasks.workunit.client.0.smithi002.stdout:3/238: dwrite d0/d31/d32/f25 [4194304,4194304] 0 2024-09-17T01:01:53.075 INFO:tasks.workunit.client.0.smithi002.stdout:8/249: fdatasync d2/d1c/d3c/f46 0 2024-09-17T01:01:53.075 INFO:tasks.workunit.client.0.smithi002.stdout:8/250: fdatasync d2/d9/dd/f18 0 2024-09-17T01:01:53.075 INFO:tasks.workunit.client.0.smithi002.stdout:8/251: write d2/d41/f54 [411957,99057] 0 2024-09-17T01:01:53.075 INFO:tasks.workunit.client.0.smithi002.stdout:5/262: rmdir d2/d2d/d10 39 2024-09-17T01:01:53.079 INFO:tasks.workunit.client.0.smithi002.stdout:2/217: rename d1b/d1d/d2a to d1b/d37/d48/d4e 0 2024-09-17T01:01:53.079 INFO:tasks.workunit.client.0.smithi002.stdout:2/218: chown f13 4651 1 2024-09-17T01:01:53.079 INFO:tasks.workunit.client.0.smithi002.stdout:2/219: dread - d1b/d37/f4d zero size 2024-09-17T01:01:53.079 INFO:tasks.workunit.client.0.smithi002.stdout:2/220: fdatasync d1b/d37/f49 0 2024-09-17T01:01:53.081 INFO:tasks.workunit.client.0.smithi002.stdout:3/239: unlink d0/d31/d32/f3b 0 2024-09-17T01:01:53.081 INFO:tasks.workunit.client.0.smithi002.stdout:3/240: chown d0/d3/f19 0 1 2024-09-17T01:01:53.083 INFO:tasks.workunit.client.0.smithi002.stdout:5/263: creat d2/d2d/f53 x:0 0 0 2024-09-17T01:01:53.083 INFO:tasks.workunit.client.0.smithi002.stdout:5/264: creat d2/f54 x:0 0 0 2024-09-17T01:01:53.083 INFO:tasks.workunit.client.0.smithi002.stdout:3/241: write d0/d3/d37/f47 [210214,7335] 0 2024-09-17T01:01:53.086 INFO:tasks.workunit.client.0.smithi002.stdout:4/268: dwrite d7/d19/d2e/f46 [0,4194304] 0 2024-09-17T01:01:53.087 INFO:tasks.workunit.client.0.smithi002.stdout:8/252: mknod d2/d1c/d3c/c5b 0 2024-09-17T01:01:53.092 INFO:tasks.workunit.client.0.smithi002.stdout:2/221: dwrite d1b/f3a [0,4194304] 0 2024-09-17T01:01:53.092 INFO:tasks.workunit.client.0.smithi002.stdout:8/253: dread d2/d3/f19 [0,4194304] 0 2024-09-17T01:01:53.092 INFO:tasks.workunit.client.0.smithi002.stdout:8/254: truncate d2/d41/f54 686024 0 2024-09-17T01:01:53.098 INFO:tasks.workunit.client.0.smithi002.stdout:2/222: link d1b/f39 d1b/d1d/f4f 0 2024-09-17T01:01:53.098 INFO:tasks.workunit.client.0.smithi002.stdout:5/265: dwrite d2/f3a [0,4194304] 0 2024-09-17T01:01:53.099 INFO:tasks.workunit.client.0.smithi002.stdout:5/266: write d2/d2d/f53 [538076,56126] 0 2024-09-17T01:01:53.100 INFO:tasks.workunit.client.0.smithi002.stdout:4/269: symlink d7/d19/l4e 0 2024-09-17T01:01:53.101 INFO:tasks.workunit.client.0.smithi002.stdout:2/223: mkdir d1b/d3f/d50 0 2024-09-17T01:01:53.101 INFO:tasks.workunit.client.0.smithi002.stdout:2/224: creat d1b/d1d/d38/f51 x:0 0 0 2024-09-17T01:01:53.104 INFO:tasks.workunit.client.0.smithi002.stdout:4/270: creat d7/f4f x:0 0 0 2024-09-17T01:01:53.107 INFO:tasks.workunit.client.0.smithi002.stdout:2/225: rename d1b/d1d/d38/d3e to d1b/d37/d48/d52 0 2024-09-17T01:01:53.108 INFO:tasks.workunit.client.0.smithi002.stdout:2/226: stat d1b/d1d/f4f 0 2024-09-17T01:01:53.108 INFO:tasks.workunit.client.0.smithi002.stdout:2/227: stat d1b/d1d/f1f 0 2024-09-17T01:01:53.116 INFO:tasks.workunit.client.0.smithi002.stdout:4/271: dread d7/d19/f21 [0,4194304] 0 2024-09-17T01:01:53.116 INFO:tasks.workunit.client.0.smithi002.stdout:4/272: fdatasync d7/f14 0 2024-09-17T01:01:53.116 INFO:tasks.workunit.client.0.smithi002.stdout:8/255: dwrite d2/d26/f40 [0,4194304] 0 2024-09-17T01:01:53.116 INFO:tasks.workunit.client.0.smithi002.stdout:8/256: fsync d2/f1d 0 2024-09-17T01:01:53.116 INFO:tasks.workunit.client.0.smithi002.stdout:4/273: rmdir d7/d3f 39 2024-09-17T01:01:53.117 INFO:tasks.workunit.client.0.smithi002.stdout:4/274: write d7/de/f2a [4498866,61425] 0 2024-09-17T01:01:53.117 INFO:tasks.workunit.client.0.smithi002.stdout:4/275: stat d7/de/d32/f40 0 2024-09-17T01:01:53.117 INFO:tasks.workunit.client.0.smithi002.stdout:5/267: dwrite d2/d2d/d10/d14/d19/d39/d43/f2a [0,4194304] 0 2024-09-17T01:01:53.118 INFO:tasks.workunit.client.0.smithi002.stdout:8/257: unlink d2/d1c/c59 0 2024-09-17T01:01:53.118 INFO:tasks.workunit.client.0.smithi002.stdout:8/258: write d2/d9/dd/f18 [2864858,70000] 0 2024-09-17T01:01:53.122 INFO:tasks.workunit.client.0.smithi002.stdout:8/259: creat d2/d26/f5c x:0 0 0 2024-09-17T01:01:53.123 INFO:tasks.workunit.client.0.smithi002.stdout:4/276: link d7/d19/d34/f41 d7/de/d23/f50 0 2024-09-17T01:01:53.125 INFO:tasks.workunit.client.0.smithi002.stdout:2/228: dwrite d1b/d1d/d38/f3d [0,4194304] 0 2024-09-17T01:01:53.126 INFO:tasks.workunit.client.1.smithi099.stdout:3/251: sync 2024-09-17T01:01:53.126 INFO:tasks.workunit.client.1.smithi099.stdout:3/252: chown d9/d15/d18/d1a/l47 3991808 1 2024-09-17T01:01:53.130 INFO:tasks.workunit.client.0.smithi002.stdout:8/260: dread d2/d9/dd/f2c [0,4194304] 0 2024-09-17T01:01:53.130 INFO:tasks.workunit.client.0.smithi002.stdout:8/261: fdatasync d2/d9/f20 0 2024-09-17T01:01:53.131 INFO:tasks.workunit.client.0.smithi002.stdout:8/262: truncate d2/d26/f40 3396946 0 2024-09-17T01:01:53.131 INFO:tasks.workunit.client.0.smithi002.stdout:8/263: write d2/d9/dd/f2c [5091624,33907] 0 2024-09-17T01:01:53.132 INFO:tasks.workunit.client.0.smithi002.stdout:8/264: mknod d2/d26/d2b/d4f/c5d 0 2024-09-17T01:01:53.138 INFO:tasks.workunit.client.0.smithi002.stdout:4/277: dread d7/d19/d2e/f46 [0,4194304] 0 2024-09-17T01:01:53.138 INFO:tasks.workunit.client.0.smithi002.stdout:4/278: chown d7/d19/d34/c3e 20352837 1 2024-09-17T01:01:53.139 INFO:tasks.workunit.client.0.smithi002.stdout:5/268: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:01:53.139 INFO:tasks.workunit.client.1.smithi099.stdout:3/253: dwrite d9/d15/d18/f35 [0,4194304] 0 2024-09-17T01:01:53.139 INFO:tasks.workunit.client.1.smithi099.stdout:3/254: fsync d9/d15/d18/f35 0 2024-09-17T01:01:53.140 INFO:tasks.workunit.client.1.smithi099.stdout:3/255: mkdir d9/d15/d18/d1a/d23/d4c 0 2024-09-17T01:01:53.141 INFO:tasks.workunit.client.1.smithi099.stdout:3/256: truncate d9/d15/d18/f2f 6382404 0 2024-09-17T01:01:53.141 INFO:tasks.workunit.client.0.smithi002.stdout:5/269: getdents d2/d2d/d10/d3b 0 2024-09-17T01:01:53.141 INFO:tasks.workunit.client.0.smithi002.stdout:2/229: write d1b/d1d/d38/f3d [2149775,17655] 0 2024-09-17T01:01:53.143 INFO:tasks.workunit.client.0.smithi002.stdout:4/279: dread d7/de/f28 [4194304,4194304] 0 2024-09-17T01:01:53.143 INFO:tasks.workunit.client.0.smithi002.stdout:8/265: read d2/d9/dd/f15 [744401,52476] 0 2024-09-17T01:01:53.145 INFO:tasks.workunit.client.0.smithi002.stdout:8/266: mknod d2/d3/c5e 0 2024-09-17T01:01:53.150 INFO:tasks.workunit.client.0.smithi002.stdout:8/267: write d2/d9/f38 [24882,9429] 0 2024-09-17T01:01:53.152 INFO:tasks.workunit.client.0.smithi002.stdout:8/268: rmdir d2/d3/d50 0 2024-09-17T01:01:53.152 INFO:tasks.workunit.client.1.smithi099.stdout:3/257: read d9/f30 [2913051,48954] 0 2024-09-17T01:01:53.154 INFO:tasks.workunit.client.1.smithi099.stdout:3/258: getdents d9/d15/d18/d1a/d23 0 2024-09-17T01:01:53.154 INFO:tasks.workunit.client.1.smithi099.stdout:3/259: chown d9/d15/d18/l24 49 1 2024-09-17T01:01:53.155 INFO:tasks.workunit.client.1.smithi099.stdout:3/260: creat d9/d15/d18/d1a/f4d x:0 0 0 2024-09-17T01:01:53.156 INFO:tasks.workunit.client.1.smithi099.stdout:3/261: rename f2 to d9/d15/d18/f4e 0 2024-09-17T01:01:53.166 INFO:tasks.workunit.client.0.smithi002.stdout:8/269: read d2/f1d [674183,71619] 0 2024-09-17T01:01:53.166 INFO:tasks.workunit.client.0.smithi002.stdout:8/270: rmdir d2/d41 39 2024-09-17T01:01:53.168 INFO:tasks.workunit.client.0.smithi002.stdout:8/271: rename d2/d1c/d3c to d2/d3/d5f 0 2024-09-17T01:01:53.172 INFO:tasks.workunit.client.0.smithi002.stdout:4/280: dwrite d7/d19/f21 [4194304,4194304] 0 2024-09-17T01:01:53.172 INFO:tasks.workunit.client.0.smithi002.stdout:5/270: dwrite d2/f54 [0,4194304] 0 2024-09-17T01:01:53.172 INFO:tasks.workunit.client.0.smithi002.stdout:4/281: write d7/f14 [1872652,75705] 0 2024-09-17T01:01:53.172 INFO:tasks.workunit.client.0.smithi002.stdout:4/282: creat d7/de/d23/f51 x:0 0 0 2024-09-17T01:01:53.173 INFO:tasks.workunit.client.1.smithi099.stdout:3/262: dwrite d9/d15/d18/f20 [0,4194304] 0 2024-09-17T01:01:53.173 INFO:tasks.workunit.client.1.smithi099.stdout:3/263: fdatasync d9/d15/d18/d1a/f4d 0 2024-09-17T01:01:53.174 INFO:tasks.workunit.client.0.smithi002.stdout:5/271: symlink d2/d2d/d10/d20/l55 0 2024-09-17T01:01:53.175 INFO:tasks.workunit.client.0.smithi002.stdout:4/283: mkdir d7/d3f/d48/d52 0 2024-09-17T01:01:53.176 INFO:tasks.workunit.client.0.smithi002.stdout:5/272: symlink d2/d2d/d10/d14/d19/d39/d43/l56 0 2024-09-17T01:01:53.177 INFO:tasks.workunit.client.0.smithi002.stdout:4/284: creat d7/de/d32/f53 x:0 0 0 2024-09-17T01:01:53.177 INFO:tasks.workunit.client.0.smithi002.stdout:4/285: write d7/d19/d2e/f39 [586409,73634] 0 2024-09-17T01:01:53.178 INFO:tasks.workunit.client.0.smithi002.stdout:4/286: mkdir d7/d19/d34/d54 0 2024-09-17T01:01:53.179 INFO:tasks.workunit.client.0.smithi002.stdout:4/287: mkdir d7/de/d55 0 2024-09-17T01:01:53.179 INFO:tasks.workunit.client.0.smithi002.stdout:4/288: fdatasync d7/de/d32/f53 0 2024-09-17T01:01:53.183 INFO:tasks.workunit.client.0.smithi002.stdout:5/273: dread d2/d2d/f18 [0,4194304] 0 2024-09-17T01:01:53.183 INFO:tasks.workunit.client.0.smithi002.stdout:4/289: dread d7/d3f/d48/f26 [0,4194304] 0 2024-09-17T01:01:53.184 INFO:tasks.workunit.client.0.smithi002.stdout:4/290: dread - d7/de/d32/f53 zero size 2024-09-17T01:01:53.185 INFO:tasks.workunit.client.0.smithi002.stdout:5/274: rename d2/d2d/d10/d3b/d41 to d2/de/d57 0 2024-09-17T01:01:53.185 INFO:tasks.workunit.client.0.smithi002.stdout:5/275: write d2/d2d/d10/d14/d19/d39/f52 [344538,86145] 0 2024-09-17T01:01:53.185 INFO:tasks.workunit.client.0.smithi002.stdout:4/291: symlink d7/d3f/d48/l56 0 2024-09-17T01:01:53.189 INFO:tasks.workunit.client.0.smithi002.stdout:8/272: dwrite d2/d3/f19 [0,4194304] 0 2024-09-17T01:01:53.190 INFO:tasks.workunit.client.1.smithi099.stdout:3/264: dwrite d9/d15/d18/d1a/f4d [0,4194304] 0 2024-09-17T01:01:53.207 INFO:tasks.workunit.client.0.smithi002.stdout:5/276: link d2/f54 d2/d2d/d10/f58 0 2024-09-17T01:01:53.213 INFO:tasks.workunit.client.1.smithi099.stdout:2/189: sync 2024-09-17T01:01:53.213 INFO:tasks.workunit.client.1.smithi099.stdout:5/336: sync 2024-09-17T01:01:53.214 INFO:tasks.workunit.client.1.smithi099.stdout:2/190: chown d2/d9/d25/d26/d1b/d2c 4005 1 2024-09-17T01:01:53.214 INFO:tasks.workunit.client.1.smithi099.stdout:5/337: truncate d2/f7 534663 0 2024-09-17T01:01:53.214 INFO:tasks.workunit.client.1.smithi099.stdout:5/338: chown d2/dc/d14/d36/f67 961 1 2024-09-17T01:01:53.214 INFO:tasks.workunit.client.1.smithi099.stdout:5/339: chown d2/f5 92635047 1 2024-09-17T01:01:53.214 INFO:tasks.workunit.client.1.smithi099.stdout:2/191: chown d2/d9/d25/d26/d1b/c24 126 1 2024-09-17T01:01:53.214 INFO:tasks.workunit.client.1.smithi099.stdout:2/192: fdatasync d2/d9/d25/d26/f29 0 2024-09-17T01:01:53.214 INFO:tasks.workunit.client.1.smithi099.stdout:2/193: chown d2/d9/l12 3496 1 2024-09-17T01:01:53.214 INFO:tasks.workunit.client.1.smithi099.stdout:2/194: chown d2/d9/f34 0 1 2024-09-17T01:01:53.215 INFO:tasks.workunit.client.1.smithi099.stdout:5/340: symlink d2/dc/d14/d19/l6a 0 2024-09-17T01:01:53.215 INFO:tasks.workunit.client.1.smithi099.stdout:5/341: mkdir d2/dc/d17/d6b 0 2024-09-17T01:01:53.216 INFO:tasks.workunit.client.0.smithi002.stdout:8/273: creat d2/d26/d2b/d4f/d58/f60 x:0 0 0 2024-09-17T01:01:53.217 INFO:tasks.workunit.client.1.smithi099.stdout:5/342: unlink d2/dc/d14/d19/l5f 0 2024-09-17T01:01:53.217 INFO:tasks.workunit.client.1.smithi099.stdout:5/343: write d2/f3 [3267865,76397] 0 2024-09-17T01:01:53.217 INFO:tasks.workunit.client.1.smithi099.stdout:2/195: dread d2/f1c [0,4194304] 0 2024-09-17T01:01:53.217 INFO:tasks.workunit.client.1.smithi099.stdout:2/196: dread - d2/d9/d25/d26/f30 zero size 2024-09-17T01:01:53.219 INFO:tasks.workunit.client.1.smithi099.stdout:5/344: mkdir d2/dc/d6c 0 2024-09-17T01:01:53.222 INFO:tasks.workunit.client.1.smithi099.stdout:5/345: getdents d2 0 2024-09-17T01:01:53.222 INFO:tasks.workunit.client.0.smithi002.stdout:8/274: truncate d2/d3/f19 1385871 0 2024-09-17T01:01:53.223 INFO:tasks.workunit.client.0.smithi002.stdout:6/223: sync 2024-09-17T01:01:53.223 INFO:tasks.workunit.client.0.smithi002.stdout:6/224: chown d2/dc/d24/ca 54147217 1 2024-09-17T01:01:53.223 INFO:tasks.workunit.client.0.smithi002.stdout:6/225: chown d2/dc/l29 264406 1 2024-09-17T01:01:53.223 INFO:tasks.workunit.client.0.smithi002.stdout:9/156: sync 2024-09-17T01:01:53.223 INFO:tasks.workunit.client.0.smithi002.stdout:9/157: readlink d5/dc/d26/l28 0 2024-09-17T01:01:53.223 INFO:tasks.workunit.client.0.smithi002.stdout:1/248: sync 2024-09-17T01:01:53.224 INFO:tasks.workunit.client.0.smithi002.stdout:6/226: read d2/dc/d34/f39 [486635,105719] 0 2024-09-17T01:01:53.225 INFO:tasks.workunit.client.1.smithi099.stdout:5/346: creat d2/dc/d14/d19/f6d x:0 0 0 2024-09-17T01:01:53.225 INFO:tasks.workunit.client.1.smithi099.stdout:5/347: read d2/d8/f5b [3042213,24469] 0 2024-09-17T01:01:53.225 INFO:tasks.workunit.client.1.smithi099.stdout:5/348: symlink d2/dc/d14/d19/l6e 0 2024-09-17T01:01:53.225 INFO:tasks.workunit.client.1.smithi099.stdout:5/349: chown d2/f40 236 1 2024-09-17T01:01:53.225 INFO:tasks.workunit.client.1.smithi099.stdout:5/350: chown d2/f7 0 1 2024-09-17T01:01:53.225 INFO:tasks.workunit.client.1.smithi099.stdout:5/351: fdatasync d2/dc/d14/d19/f3f 0 2024-09-17T01:01:53.225 INFO:tasks.workunit.client.1.smithi099.stdout:5/352: symlink d2/dc/d17/d6b/l6f 0 2024-09-17T01:01:53.225 INFO:tasks.workunit.client.1.smithi099.stdout:5/353: stat d2/dc/d14/d19/f4b 0 2024-09-17T01:01:53.225 INFO:tasks.workunit.client.1.smithi099.stdout:5/354: creat d2/dc/d17/f70 x:0 0 0 2024-09-17T01:01:53.226 INFO:tasks.workunit.client.0.smithi002.stdout:1/249: symlink d4/d11/d12/d23/l58 0 2024-09-17T01:01:53.226 INFO:tasks.workunit.client.0.smithi002.stdout:1/250: fsync d4/d11/d12/d23/f35 0 2024-09-17T01:01:53.226 INFO:tasks.workunit.client.0.smithi002.stdout:6/227: unlink d2/dc/l29 0 2024-09-17T01:01:53.226 INFO:tasks.workunit.client.0.smithi002.stdout:6/228: fdatasync d2/d1d/d27/d30/f36 0 2024-09-17T01:01:53.228 INFO:tasks.workunit.client.1.smithi099.stdout:5/355: mknod d2/dc/d14/d19/c71 0 2024-09-17T01:01:53.228 INFO:tasks.workunit.client.1.smithi099.stdout:5/356: read d2/d8/f5b [3903409,12738] 0 2024-09-17T01:01:53.228 INFO:tasks.workunit.client.1.smithi099.stdout:5/357: fdatasync d2/f1b 0 2024-09-17T01:01:53.228 INFO:tasks.workunit.client.1.smithi099.stdout:5/358: chown d2/d26/c69 4 1 2024-09-17T01:01:53.228 INFO:tasks.workunit.client.1.smithi099.stdout:5/359: chown d2/dc/d17 181 1 2024-09-17T01:01:53.228 INFO:tasks.workunit.client.1.smithi099.stdout:5/360: mkdir d2/dc/d17/d3c/d72 0 2024-09-17T01:01:53.228 INFO:tasks.workunit.client.0.smithi002.stdout:8/275: dread d2/d9/dd/f18 [0,4194304] 0 2024-09-17T01:01:53.228 INFO:tasks.workunit.client.0.smithi002.stdout:8/276: creat d2/d26/f61 x:0 0 0 2024-09-17T01:01:53.228 INFO:tasks.workunit.client.0.smithi002.stdout:8/277: chown d2 11467788 1 2024-09-17T01:01:53.229 INFO:tasks.workunit.client.0.smithi002.stdout:8/278: chown d2/d26/d2b/d4f/d58/f60 2557151 1 2024-09-17T01:01:53.229 INFO:tasks.workunit.client.0.smithi002.stdout:9/158: dread d5/f14 [0,4194304] 0 2024-09-17T01:01:53.229 INFO:tasks.workunit.client.0.smithi002.stdout:5/277: dwrite d2/d2d/d10/d14/d19/d39/d25/d32/f40 [0,4194304] 0 2024-09-17T01:01:53.229 INFO:tasks.workunit.client.0.smithi002.stdout:5/278: write d2/d2d/f18 [4222282,10074] 0 2024-09-17T01:01:53.229 INFO:tasks.workunit.client.0.smithi002.stdout:6/229: mkdir d2/d1d/d26/d40 0 2024-09-17T01:01:53.230 INFO:tasks.workunit.client.0.smithi002.stdout:5/279: write d2/f4d [768079,101851] 0 2024-09-17T01:01:53.230 INFO:tasks.workunit.client.0.smithi002.stdout:8/279: creat d2/d3/d5f/d47/f62 x:0 0 0 2024-09-17T01:01:53.230 INFO:tasks.workunit.client.1.smithi099.stdout:5/361: read d2/dc/f39 [278855,70047] 0 2024-09-17T01:01:53.230 INFO:tasks.workunit.client.1.smithi099.stdout:5/362: mknod d2/dc/d17/c73 0 2024-09-17T01:01:53.231 INFO:tasks.workunit.client.1.smithi099.stdout:5/363: stat d2/dc/d17/d3c 0 2024-09-17T01:01:53.231 INFO:tasks.workunit.client.1.smithi099.stdout:5/364: chown d2/dc/d17/d3c/c44 6235 1 2024-09-17T01:01:53.231 INFO:tasks.workunit.client.1.smithi099.stdout:5/365: stat d2/dc/d14/f20 0 2024-09-17T01:01:53.231 INFO:tasks.workunit.client.1.smithi099.stdout:5/366: creat d2/dc/f74 x:0 0 0 2024-09-17T01:01:53.231 INFO:tasks.workunit.client.1.smithi099.stdout:5/367: chown d2/d8/l1d 2054871 1 2024-09-17T01:01:53.231 INFO:tasks.workunit.client.1.smithi099.stdout:2/197: dwrite d2/d9/d25/d26/f33 [0,4194304] 0 2024-09-17T01:01:53.231 INFO:tasks.workunit.client.0.smithi002.stdout:9/159: symlink d5/dc/d26/l2b 0 2024-09-17T01:01:53.233 INFO:tasks.workunit.client.0.smithi002.stdout:6/230: truncate d2/f4 2634295 0 2024-09-17T01:01:53.233 INFO:tasks.workunit.client.0.smithi002.stdout:6/231: truncate d2/d1d/d27/d30/f36 1918986 0 2024-09-17T01:01:53.234 INFO:tasks.workunit.client.1.smithi099.stdout:2/198: creat d2/d9/d25/d26/d1b/d2c/f36 x:0 0 0 2024-09-17T01:01:53.235 INFO:tasks.workunit.client.1.smithi099.stdout:2/199: symlink d2/d7/l37 0 2024-09-17T01:01:53.236 INFO:tasks.workunit.client.1.smithi099.stdout:2/200: mknod d2/d9/d25/d26/d1b/d2c/c38 0 2024-09-17T01:01:53.237 INFO:tasks.workunit.client.0.smithi002.stdout:8/280: rename d2/d9/l29 to d2/d26/d2b/d4f/l63 0 2024-09-17T01:01:53.237 INFO:tasks.workunit.client.0.smithi002.stdout:8/281: chown d2/d9/l4d 1897873 1 2024-09-17T01:01:53.238 INFO:tasks.workunit.client.0.smithi002.stdout:9/160: rename d5/l22 to d5/l2c 0 2024-09-17T01:01:53.240 INFO:tasks.workunit.client.0.smithi002.stdout:8/282: unlink d2/d3/f48 0 2024-09-17T01:01:53.240 INFO:tasks.workunit.client.0.smithi002.stdout:6/232: write d2/d1d/f3d [1973297,69310] 0 2024-09-17T01:01:53.241 INFO:tasks.workunit.client.0.smithi002.stdout:6/233: dread d2/d1d/d26/f2b [0,4194304] 0 2024-09-17T01:01:53.241 INFO:tasks.workunit.client.0.smithi002.stdout:6/234: chown d2/d1d/d27/d30/f36 826753 1 2024-09-17T01:01:53.242 INFO:tasks.workunit.client.0.smithi002.stdout:9/161: creat d5/dc/d26/f2d x:0 0 0 2024-09-17T01:01:53.242 INFO:tasks.workunit.client.0.smithi002.stdout:9/162: creat d5/dc/d26/f2e x:0 0 0 2024-09-17T01:01:53.242 INFO:tasks.workunit.client.0.smithi002.stdout:9/163: dread - d5/f1e zero size 2024-09-17T01:01:53.242 INFO:tasks.workunit.client.0.smithi002.stdout:6/235: dread d2/dc/d34/f39 [0,4194304] 0 2024-09-17T01:01:53.244 INFO:tasks.workunit.client.0.smithi002.stdout:8/283: unlink d2/d9/l4d 0 2024-09-17T01:01:53.247 INFO:tasks.workunit.client.0.smithi002.stdout:8/284: mknod d2/d26/d2b/d4f/c64 0 2024-09-17T01:01:53.249 INFO:tasks.workunit.client.0.smithi002.stdout:8/285: rename d2/fb to d2/d26/d2b/f65 0 2024-09-17T01:01:53.252 INFO:tasks.workunit.client.0.smithi002.stdout:8/286: symlink d2/d1c/d3b/l66 0 2024-09-17T01:01:53.252 INFO:tasks.workunit.client.0.smithi002.stdout:8/287: read d2/d26/d2b/f65 [2083308,26992] 0 2024-09-17T01:01:53.253 INFO:tasks.workunit.client.0.smithi002.stdout:8/288: stat d2/d9/dd/f18 0 2024-09-17T01:01:53.254 INFO:tasks.workunit.client.0.smithi002.stdout:8/289: unlink d2/d1c/l4a 0 2024-09-17T01:01:53.257 INFO:tasks.workunit.client.0.smithi002.stdout:8/290: dread d2/d30/f32 [0,4194304] 0 2024-09-17T01:01:53.257 INFO:tasks.workunit.client.0.smithi002.stdout:8/291: chown d2/d1c/f43 0 1 2024-09-17T01:01:53.258 INFO:tasks.workunit.client.0.smithi002.stdout:8/292: mknod d2/d26/c67 0 2024-09-17T01:01:53.258 INFO:tasks.workunit.client.0.smithi002.stdout:8/293: read d2/f1d [3743195,107372] 0 2024-09-17T01:01:53.259 INFO:tasks.workunit.client.0.smithi002.stdout:8/294: symlink d2/d30/l68 0 2024-09-17T01:01:53.259 INFO:tasks.workunit.client.0.smithi002.stdout:5/280: dwrite d2/d2d/d10/d14/d19/d39/f3c [0,4194304] 0 2024-09-17T01:01:53.260 INFO:tasks.workunit.client.1.smithi099.stdout:5/368: dwrite d2/dc/d14/d19/f3f [0,4194304] 0 2024-09-17T01:01:53.260 INFO:tasks.workunit.client.1.smithi099.stdout:5/369: read d2/d26/f2a [1863967,12329] 0 2024-09-17T01:01:53.261 INFO:tasks.workunit.client.1.smithi099.stdout:2/201: dwrite d2/d9/d25/d26/f32 [0,4194304] 0 2024-09-17T01:01:53.261 INFO:tasks.workunit.client.0.smithi002.stdout:8/295: dread d2/d41/f54 [0,4194304] 0 2024-09-17T01:01:53.261 INFO:tasks.workunit.client.0.smithi002.stdout:8/296: chown d2/d3/d5f/f46 117 1 2024-09-17T01:01:53.261 INFO:tasks.workunit.client.0.smithi002.stdout:8/297: creat d2/d26/f69 x:0 0 0 2024-09-17T01:01:53.262 INFO:tasks.workunit.client.0.smithi002.stdout:8/298: chown d2/d26/f61 3311961 1 2024-09-17T01:01:53.262 INFO:tasks.workunit.client.0.smithi002.stdout:8/299: readlink d2/d9/l17 0 2024-09-17T01:01:53.262 INFO:tasks.workunit.client.0.smithi002.stdout:8/300: chown d2/f12 432 1 2024-09-17T01:01:53.262 INFO:tasks.workunit.client.0.smithi002.stdout:8/301: stat d2 0 2024-09-17T01:01:53.262 INFO:tasks.workunit.client.0.smithi002.stdout:8/302: creat d2/d26/d2b/d4f/d58/f6a x:0 0 0 2024-09-17T01:01:53.264 INFO:tasks.workunit.client.0.smithi002.stdout:8/303: creat d2/f6b x:0 0 0 2024-09-17T01:01:53.264 INFO:tasks.workunit.client.0.smithi002.stdout:8/304: write d2/d30/f32 [457753,78305] 0 2024-09-17T01:01:53.264 INFO:tasks.workunit.client.0.smithi002.stdout:8/305: dread - d2/d26/f5c zero size 2024-09-17T01:01:53.269 INFO:tasks.workunit.client.0.smithi002.stdout:5/281: read d2/de/f4a [4083970,4190] 0 2024-09-17T01:01:53.275 INFO:tasks.workunit.client.0.smithi002.stdout:5/282: dread d2/f4 [0,4194304] 0 2024-09-17T01:01:53.276 INFO:tasks.workunit.client.0.smithi002.stdout:5/283: readlink d2/d2d/d10/l27 0 2024-09-17T01:01:53.276 INFO:tasks.workunit.client.0.smithi002.stdout:5/284: mkdir d2/d2d/d10/d14/d59 0 2024-09-17T01:01:53.276 INFO:tasks.workunit.client.0.smithi002.stdout:5/285: chown d2/f4 3749 1 2024-09-17T01:01:53.277 INFO:tasks.workunit.client.0.smithi002.stdout:5/286: fsync d2/d2d/d10/d14/d19/d39/f35 0 2024-09-17T01:01:53.277 INFO:tasks.workunit.client.0.smithi002.stdout:5/287: mknod d2/de/d57/c5a 0 2024-09-17T01:01:53.290 INFO:tasks.workunit.client.0.smithi002.stdout:9/164: dwrite d5/dc/f1b [0,4194304] 0 2024-09-17T01:01:53.301 INFO:tasks.workunit.client.1.smithi099.stdout:2/202: dwrite d2/d9/f34 [4194304,4194304] 0 2024-09-17T01:01:53.301 INFO:tasks.workunit.client.0.smithi002.stdout:6/236: dwrite d2/d1d/f25 [0,4194304] 0 2024-09-17T01:01:53.301 INFO:tasks.workunit.client.0.smithi002.stdout:6/237: truncate d2/f16 1697237 0 2024-09-17T01:01:53.301 INFO:tasks.workunit.client.0.smithi002.stdout:6/238: readlink d2/dc/d24/l1f 0 2024-09-17T01:01:53.302 INFO:tasks.workunit.client.1.smithi099.stdout:2/203: unlink d2/l31 0 2024-09-17T01:01:53.303 INFO:tasks.workunit.client.1.smithi099.stdout:2/204: fsync d2/f4 0 2024-09-17T01:01:53.303 INFO:tasks.workunit.client.1.smithi099.stdout:2/205: truncate d2/d9/d25/d26/f30 751686 0 2024-09-17T01:01:53.303 INFO:tasks.workunit.client.0.smithi002.stdout:6/239: creat d2/d1d/d2d/d35/d37/f41 x:0 0 0 2024-09-17T01:01:53.308 INFO:tasks.workunit.client.0.smithi002.stdout:6/240: dread d2/f19 [0,4194304] 0 2024-09-17T01:01:53.310 INFO:tasks.workunit.client.1.smithi099.stdout:5/370: dwrite d2/d8/fb [0,4194304] 0 2024-09-17T01:01:53.310 INFO:tasks.workunit.client.0.smithi002.stdout:9/165: dwrite d5/f19 [0,4194304] 0 2024-09-17T01:01:53.313 INFO:tasks.workunit.client.1.smithi099.stdout:6/310: sync 2024-09-17T01:01:53.313 INFO:tasks.workunit.client.1.smithi099.stdout:6/311: chown dc/d1a/f1e 1879 1 2024-09-17T01:01:53.313 INFO:tasks.workunit.client.1.smithi099.stdout:5/371: unlink d2/dc/d17/d3c/c3d 0 2024-09-17T01:01:53.314 INFO:tasks.workunit.client.0.smithi002.stdout:5/288: dwrite d2/f3a [0,4194304] 0 2024-09-17T01:01:53.315 INFO:tasks.workunit.client.0.smithi002.stdout:9/166: mknod d5/dc/c2f 0 2024-09-17T01:01:53.315 INFO:tasks.workunit.client.1.smithi099.stdout:6/312: link dc/f3e dc/d5d/d66/f67 0 2024-09-17T01:01:53.315 INFO:tasks.workunit.client.1.smithi099.stdout:2/206: dread d2/d9/f1f [0,4194304] 0 2024-09-17T01:01:53.316 INFO:tasks.workunit.client.1.smithi099.stdout:5/372: unlink d2/dc/d14/d19/c41 0 2024-09-17T01:01:53.316 INFO:tasks.workunit.client.1.smithi099.stdout:5/373: fsync d2/dc/f39 0 2024-09-17T01:01:53.317 INFO:tasks.workunit.client.1.smithi099.stdout:5/374: stat d2/l58 0 2024-09-17T01:01:53.317 INFO:tasks.workunit.client.1.smithi099.stdout:5/375: truncate d2/dc/f74 371070 0 2024-09-17T01:01:53.317 INFO:tasks.workunit.client.1.smithi099.stdout:6/313: mknod dc/d5d/c68 0 2024-09-17T01:01:53.317 INFO:tasks.workunit.client.1.smithi099.stdout:6/314: readlink dc/l20 0 2024-09-17T01:01:53.317 INFO:tasks.workunit.client.1.smithi099.stdout:6/315: chown dc/d2b/d53 7 1 2024-09-17T01:01:53.319 INFO:tasks.workunit.client.1.smithi099.stdout:2/207: rename d2/d9/l19 to d2/d9/d25/l39 0 2024-09-17T01:01:53.319 INFO:tasks.workunit.client.0.smithi002.stdout:9/167: rename c1 to d5/dc/d26/c30 0 2024-09-17T01:01:53.319 INFO:tasks.workunit.client.0.smithi002.stdout:9/168: write d5/f29 [398250,58834] 0 2024-09-17T01:01:53.320 INFO:tasks.workunit.client.1.smithi099.stdout:6/316: creat dc/d5d/f69 x:0 0 0 2024-09-17T01:01:53.320 INFO:tasks.workunit.client.0.smithi002.stdout:9/169: truncate d5/dc/f25 2178201 0 2024-09-17T01:01:53.321 INFO:tasks.workunit.client.1.smithi099.stdout:2/208: creat d2/d7/f3a x:0 0 0 2024-09-17T01:01:53.321 INFO:tasks.workunit.client.1.smithi099.stdout:2/209: write d2/d9/f1f [1850350,103137] 0 2024-09-17T01:01:53.322 INFO:tasks.workunit.client.0.smithi002.stdout:8/306: dwrite d2/d30/f32 [0,4194304] 0 2024-09-17T01:01:53.322 INFO:tasks.workunit.client.1.smithi099.stdout:6/317: stat dc/d2b/c3b 0 2024-09-17T01:01:53.322 INFO:tasks.workunit.client.1.smithi099.stdout:5/376: dread d2/dc/d17/f53 [0,4194304] 0 2024-09-17T01:01:53.323 INFO:tasks.workunit.client.1.smithi099.stdout:4/299: sync 2024-09-17T01:01:53.324 INFO:tasks.workunit.client.0.smithi002.stdout:8/307: mknod d2/d41/c6c 0 2024-09-17T01:01:53.324 INFO:tasks.workunit.client.0.smithi002.stdout:8/308: fdatasync f0 0 2024-09-17T01:01:53.324 INFO:tasks.workunit.client.1.smithi099.stdout:2/210: symlink d2/d9/d25/d26/d1b/l3b 0 2024-09-17T01:01:53.325 INFO:tasks.workunit.client.1.smithi099.stdout:0/282: sync 2024-09-17T01:01:53.325 INFO:tasks.workunit.client.1.smithi099.stdout:8/300: sync 2024-09-17T01:01:53.325 INFO:tasks.workunit.client.1.smithi099.stdout:9/289: sync 2024-09-17T01:01:53.325 INFO:tasks.workunit.client.1.smithi099.stdout:1/337: sync 2024-09-17T01:01:53.325 INFO:tasks.workunit.client.1.smithi099.stdout:3/265: sync 2024-09-17T01:01:53.326 INFO:tasks.workunit.client.1.smithi099.stdout:3/266: chown d9/f10 1 1 2024-09-17T01:01:53.326 INFO:tasks.workunit.client.1.smithi099.stdout:0/283: creat da/d3b/f5e x:0 0 0 2024-09-17T01:01:53.326 INFO:tasks.workunit.client.1.smithi099.stdout:0/284: creat da/df/d1a/f5f x:0 0 0 2024-09-17T01:01:53.326 INFO:tasks.workunit.client.1.smithi099.stdout:9/290: write da/d50/f5c [201156,70366] 0 2024-09-17T01:01:53.326 INFO:tasks.workunit.client.1.smithi099.stdout:7/301: sync 2024-09-17T01:01:53.326 INFO:tasks.workunit.client.1.smithi099.stdout:9/291: truncate da/f2c 1737227 0 2024-09-17T01:01:53.328 INFO:tasks.workunit.client.0.smithi002.stdout:8/309: dread d2/d26/d2b/f36 [0,4194304] 0 2024-09-17T01:01:53.328 INFO:tasks.workunit.client.1.smithi099.stdout:5/377: getdents d2/d26 0 2024-09-17T01:01:53.328 INFO:tasks.workunit.client.1.smithi099.stdout:5/378: stat d2/d8/c33 0 2024-09-17T01:01:53.330 INFO:tasks.workunit.client.1.smithi099.stdout:4/300: mknod d7/dd/d21/d26/c68 0 2024-09-17T01:01:53.330 INFO:tasks.workunit.client.1.smithi099.stdout:4/301: dread - d7/dd/de/d10/d18/d4b/f27 zero size 2024-09-17T01:01:53.330 INFO:tasks.workunit.client.1.smithi099.stdout:4/302: fsync d7/dd/de/d10/f61 0 2024-09-17T01:01:53.330 INFO:tasks.workunit.client.1.smithi099.stdout:4/303: write d7/dd/de/d10/f5e [750509,36798] 0 2024-09-17T01:01:53.330 INFO:tasks.workunit.client.1.smithi099.stdout:4/304: chown d7/dd/de/d10/d18/d4b 1 1 2024-09-17T01:01:53.331 INFO:tasks.workunit.client.1.smithi099.stdout:4/305: write d7/dd/d21/d26/f65 [212816,72859] 0 2024-09-17T01:01:53.331 INFO:tasks.workunit.client.1.smithi099.stdout:2/211: truncate f0 113290 0 2024-09-17T01:01:53.331 INFO:tasks.workunit.client.0.smithi002.stdout:8/310: rename d2/c16 to d2/d1c/d3b/c6d 0 2024-09-17T01:01:53.338 INFO:tasks.workunit.client.1.smithi099.stdout:0/285: symlink da/df/l60 0 2024-09-17T01:01:53.338 INFO:tasks.workunit.client.1.smithi099.stdout:0/286: readlink l6 0 2024-09-17T01:01:53.338 INFO:tasks.workunit.client.1.smithi099.stdout:2/212: mknod d2/d7/c3c 0 2024-09-17T01:01:53.338 INFO:tasks.workunit.client.1.smithi099.stdout:9/292: creat da/d18/d49/f63 x:0 0 0 2024-09-17T01:01:53.338 INFO:tasks.workunit.client.1.smithi099.stdout:2/213: write d2/f1c [1516514,13479] 0 2024-09-17T01:01:53.339 INFO:tasks.workunit.client.1.smithi099.stdout:0/287: symlink da/d59/l61 0 2024-09-17T01:01:53.341 INFO:tasks.workunit.client.1.smithi099.stdout:1/338: write d0/d8/f26 [569211,41707] 0 2024-09-17T01:01:53.345 INFO:tasks.workunit.client.1.smithi099.stdout:2/214: unlink d2/cb 0 2024-09-17T01:01:53.345 INFO:tasks.workunit.client.1.smithi099.stdout:2/215: creat d2/d9/d25/d26/d1b/d2c/f3d x:0 0 0 2024-09-17T01:01:53.345 INFO:tasks.workunit.client.1.smithi099.stdout:2/216: read - d2/d7/f3a zero size 2024-09-17T01:01:53.345 INFO:tasks.workunit.client.1.smithi099.stdout:0/288: link da/d12/f18 da/d12/f62 0 2024-09-17T01:01:53.345 INFO:tasks.workunit.client.1.smithi099.stdout:0/289: fdatasync da/df/f47 0 2024-09-17T01:01:53.345 INFO:tasks.workunit.client.1.smithi099.stdout:0/290: write da/df/d31/f54 [935463,110124] 0 2024-09-17T01:01:53.345 INFO:tasks.workunit.client.1.smithi099.stdout:0/291: fsync da/df/f15 0 2024-09-17T01:01:53.345 INFO:tasks.workunit.client.1.smithi099.stdout:0/292: getdents da/df/d20 0 2024-09-17T01:01:53.345 INFO:tasks.workunit.client.1.smithi099.stdout:9/293: link da/d21/d2a/f36 da/f64 0 2024-09-17T01:01:53.346 INFO:tasks.workunit.client.1.smithi099.stdout:7/302: read d1/d36/f45 [441461,21603] 0 2024-09-17T01:01:53.346 INFO:tasks.workunit.client.1.smithi099.stdout:7/303: fsync d1/f11 0 2024-09-17T01:01:53.346 INFO:tasks.workunit.client.1.smithi099.stdout:7/304: write d1/d2c/d5c/d12/f32 [1128986,50397] 0 2024-09-17T01:01:53.346 INFO:tasks.workunit.client.1.smithi099.stdout:8/301: dread d0/f40 [0,4194304] 0 2024-09-17T01:01:53.346 INFO:tasks.workunit.client.0.smithi002.stdout:6/241: dwrite d2/f13 [0,4194304] 0 2024-09-17T01:01:53.347 INFO:tasks.workunit.client.0.smithi002.stdout:6/242: truncate d2/d1d/d26/f2b 86459 0 2024-09-17T01:01:53.348 INFO:tasks.workunit.client.1.smithi099.stdout:2/217: unlink d2/d9/d25/c35 0 2024-09-17T01:01:53.348 INFO:tasks.workunit.client.1.smithi099.stdout:2/218: chown d2/d9/d25/d26/d1b/d2c/f3d 96 1 2024-09-17T01:01:53.349 INFO:tasks.workunit.client.1.smithi099.stdout:0/293: mkdir da/df/d1a/d63 0 2024-09-17T01:01:53.349 INFO:tasks.workunit.client.1.smithi099.stdout:0/294: fdatasync da/d3b/f5e 0 2024-09-17T01:01:53.350 INFO:tasks.workunit.client.1.smithi099.stdout:9/294: creat da/d14/d40/f65 x:0 0 0 2024-09-17T01:01:53.350 INFO:tasks.workunit.client.1.smithi099.stdout:9/295: write da/d14/d40/f65 [312105,10070] 0 2024-09-17T01:01:53.351 INFO:tasks.workunit.client.1.smithi099.stdout:7/305: rename d1/d2c/d5c/d12/f14 to d1/d2c/d5c/d1c/f61 0 2024-09-17T01:01:53.352 INFO:tasks.workunit.client.1.smithi099.stdout:8/302: chown d0/d4/d29/d4b/f4e 144392 1 2024-09-17T01:01:53.352 INFO:tasks.workunit.client.1.smithi099.stdout:8/303: chown d0/d1f/d31/d4c 50 1 2024-09-17T01:01:53.353 INFO:tasks.workunit.client.1.smithi099.stdout:0/295: creat da/d12/d2b/f64 x:0 0 0 2024-09-17T01:01:53.353 INFO:tasks.workunit.client.1.smithi099.stdout:0/296: chown da/d1c/f3d 1 1 2024-09-17T01:01:53.353 INFO:tasks.workunit.client.1.smithi099.stdout:0/297: read da/df/f4f [1298718,73906] 0 2024-09-17T01:01:53.354 INFO:tasks.workunit.client.1.smithi099.stdout:7/306: rename d1/d2c/d5c/d3f/f41 to d1/d36/f62 0 2024-09-17T01:01:53.354 INFO:tasks.workunit.client.1.smithi099.stdout:7/307: chown d1/f11 31565 1 2024-09-17T01:01:53.354 INFO:tasks.workunit.client.1.smithi099.stdout:8/304: truncate d0/d4/f42 561205 0 2024-09-17T01:01:53.355 INFO:tasks.workunit.client.1.smithi099.stdout:8/305: fdatasync d0/f1d 0 2024-09-17T01:01:53.355 INFO:tasks.workunit.client.1.smithi099.stdout:8/306: creat d0/d4/d29/f5f x:0 0 0 2024-09-17T01:01:53.355 INFO:tasks.workunit.client.1.smithi099.stdout:8/307: truncate d0/d4/d29/f5f 871941 0 2024-09-17T01:01:53.356 INFO:tasks.workunit.client.1.smithi099.stdout:0/298: rename da/d12/d2b/f64 to da/df/d1a/d56/f65 0 2024-09-17T01:01:53.356 INFO:tasks.workunit.client.1.smithi099.stdout:1/339: write d0/d2/de/f15 [2346307,81679] 0 2024-09-17T01:01:53.356 INFO:tasks.workunit.client.1.smithi099.stdout:1/340: fsync d0/d8/d49/f5e 0 2024-09-17T01:01:53.358 INFO:tasks.workunit.client.1.smithi099.stdout:0/299: unlink da/d12/d2b/c36 0 2024-09-17T01:01:53.359 INFO:tasks.workunit.client.1.smithi099.stdout:7/308: symlink d1/d2c/d5c/l63 0 2024-09-17T01:01:53.360 INFO:tasks.workunit.client.1.smithi099.stdout:0/300: dread da/df/d1a/d49/f51 [0,4194304] 0 2024-09-17T01:01:53.361 INFO:tasks.workunit.client.1.smithi099.stdout:1/341: creat d0/d8/d49/d4e/f6c x:0 0 0 2024-09-17T01:01:53.361 INFO:tasks.workunit.client.1.smithi099.stdout:1/342: write d0/d8/f65 [981927,110533] 0 2024-09-17T01:01:53.362 INFO:tasks.workunit.client.1.smithi099.stdout:1/343: creat d0/d8/d49/d4e/f6d x:0 0 0 2024-09-17T01:01:53.362 INFO:tasks.workunit.client.1.smithi099.stdout:1/344: dread - d0/d2/d5/f4d zero size 2024-09-17T01:01:53.363 INFO:tasks.workunit.client.1.smithi099.stdout:7/309: stat d1/d2c/d47/d48/c49 0 2024-09-17T01:01:53.363 INFO:tasks.workunit.client.1.smithi099.stdout:7/310: chown d1/c5f 113947026 1 2024-09-17T01:01:53.364 INFO:tasks.workunit.client.1.smithi099.stdout:1/345: rmdir d0/d8/d4a 0 2024-09-17T01:01:53.365 INFO:tasks.workunit.client.1.smithi099.stdout:1/346: write d0/f64 [991350,104029] 0 2024-09-17T01:01:53.365 INFO:tasks.workunit.client.1.smithi099.stdout:1/347: readlink d0/d8/l20 0 2024-09-17T01:01:53.369 INFO:tasks.workunit.client.1.smithi099.stdout:2/219: dread d2/f4 [0,4194304] 0 2024-09-17T01:01:53.373 INFO:tasks.workunit.client.0.smithi002.stdout:9/170: dwrite d5/f1e [0,4194304] 0 2024-09-17T01:01:53.373 INFO:tasks.workunit.client.0.smithi002.stdout:9/171: creat d5/dc/d26/f31 x:0 0 0 2024-09-17T01:01:53.377 INFO:tasks.workunit.client.0.smithi002.stdout:9/172: write d5/f14 [643237,49897] 0 2024-09-17T01:01:53.377 INFO:tasks.workunit.client.0.smithi002.stdout:5/289: dwrite d2/fa [0,4194304] 0 2024-09-17T01:01:53.379 INFO:tasks.workunit.client.1.smithi099.stdout:4/306: dwrite d7/fb [12582912,4194304] 0 2024-09-17T01:01:53.379 INFO:tasks.workunit.client.1.smithi099.stdout:3/267: dwrite d9/d15/d18/f20 [0,4194304] 0 2024-09-17T01:01:53.379 INFO:tasks.workunit.client.0.smithi002.stdout:9/173: creat d5/dc/f32 x:0 0 0 2024-09-17T01:01:53.379 INFO:tasks.workunit.client.0.smithi002.stdout:9/174: creat d5/dc/d26/f33 x:0 0 0 2024-09-17T01:01:53.382 INFO:tasks.workunit.client.1.smithi099.stdout:4/307: mkdir d7/dd/de/d10/d18/d4b/d69 0 2024-09-17T01:01:53.382 INFO:tasks.workunit.client.1.smithi099.stdout:4/308: chown d7/dd/l44 384 1 2024-09-17T01:01:53.382 INFO:tasks.workunit.client.1.smithi099.stdout:4/309: write d7/dd/de/d10/d18/d4b/f39 [3930777,26262] 0 2024-09-17T01:01:53.383 INFO:tasks.workunit.client.0.smithi002.stdout:5/290: link d2/de/d1d/l3d d2/d2d/d10/d3b/l5b 0 2024-09-17T01:01:53.383 INFO:tasks.workunit.client.0.smithi002.stdout:5/291: chown d2/d2d/d10/d14/d19/d39/d25/d32 62 1 2024-09-17T01:01:53.383 INFO:tasks.workunit.client.1.smithi099.stdout:3/268: dread d9/d15/d18/d1a/d23/f2c [0,4194304] 0 2024-09-17T01:01:53.384 INFO:tasks.workunit.client.0.smithi002.stdout:9/175: mkdir d5/dc/d26/d34 0 2024-09-17T01:01:53.385 INFO:tasks.workunit.client.1.smithi099.stdout:4/310: link d7/dd/de/c59 d7/dd/de/d10/c6a 0 2024-09-17T01:01:53.385 INFO:tasks.workunit.client.1.smithi099.stdout:4/311: truncate d7/d35/f36 4447690 0 2024-09-17T01:01:53.388 INFO:tasks.workunit.client.1.smithi099.stdout:4/312: getdents d7/d35 0 2024-09-17T01:01:53.388 INFO:tasks.workunit.client.1.smithi099.stdout:4/313: stat l4 0 2024-09-17T01:01:53.389 INFO:tasks.workunit.client.1.smithi099.stdout:4/314: mkdir d7/dd/de/d10/d6b 0 2024-09-17T01:01:53.394 INFO:tasks.workunit.client.1.smithi099.stdout:4/315: dread d7/dd/d21/d26/d3f/d5b/f2c [0,4194304] 0 2024-09-17T01:01:53.394 INFO:tasks.workunit.client.1.smithi099.stdout:8/308: dwrite d0/d4/d29/f2e [0,4194304] 0 2024-09-17T01:01:53.396 INFO:tasks.workunit.client.1.smithi099.stdout:4/316: dread d7/dd/de/f14 [0,4194304] 0 2024-09-17T01:01:53.396 INFO:tasks.workunit.client.1.smithi099.stdout:8/309: symlink d0/d1f/d31/l60 0 2024-09-17T01:01:53.397 INFO:tasks.workunit.client.1.smithi099.stdout:3/269: dread d9/d15/d18/f37 [0,4194304] 0 2024-09-17T01:01:53.398 INFO:tasks.workunit.client.1.smithi099.stdout:4/317: write d7/dd/d21/f38 [1302095,92038] 0 2024-09-17T01:01:53.398 INFO:tasks.workunit.client.1.smithi099.stdout:4/318: creat d7/dd/d21/d26/f6c x:0 0 0 2024-09-17T01:01:53.398 INFO:tasks.workunit.client.1.smithi099.stdout:9/296: getdents da 0 2024-09-17T01:01:53.405 INFO:tasks.workunit.client.1.smithi099.stdout:0/301: dwrite da/d1c/d1e/f24 [0,4194304] 0 2024-09-17T01:01:53.405 INFO:tasks.workunit.client.1.smithi099.stdout:5/379: dwrite d2/dc/d17/f52 [0,4194304] 0 2024-09-17T01:01:53.405 INFO:tasks.workunit.client.1.smithi099.stdout:5/380: stat d2/dc/d17/l1c 0 2024-09-17T01:01:53.405 INFO:tasks.workunit.client.1.smithi099.stdout:5/381: creat d2/dc/d14/d19/f75 x:0 0 0 2024-09-17T01:01:53.405 INFO:tasks.workunit.client.1.smithi099.stdout:5/382: chown d2/l58 60370 1 2024-09-17T01:01:53.406 INFO:tasks.workunit.client.1.smithi099.stdout:4/319: creat d7/dd/d21/d26/d3f/f6d x:0 0 0 2024-09-17T01:01:53.406 INFO:tasks.workunit.client.1.smithi099.stdout:5/383: dread d2/dc/f74 [0,4194304] 0 2024-09-17T01:01:53.406 INFO:tasks.workunit.client.1.smithi099.stdout:5/384: write d2/d8/f35 [826354,37175] 0 2024-09-17T01:01:53.408 INFO:tasks.workunit.client.1.smithi099.stdout:9/297: link da/f64 da/d1b/d3a/d4b/f66 0 2024-09-17T01:01:53.411 INFO:tasks.workunit.client.1.smithi099.stdout:8/310: write d0/d1f/f2b [2531053,62389] 0 2024-09-17T01:01:53.411 INFO:tasks.workunit.client.1.smithi099.stdout:7/311: dwrite d1/d2c/d5c/f13 [0,4194304] 0 2024-09-17T01:01:53.411 INFO:tasks.workunit.client.1.smithi099.stdout:0/302: mkdir da/d12/d22/d66 0 2024-09-17T01:01:53.412 INFO:tasks.workunit.client.1.smithi099.stdout:0/303: truncate da/df/d1a/d23/f3c 130554 0 2024-09-17T01:01:53.413 INFO:tasks.workunit.client.1.smithi099.stdout:8/311: dread d0/f1d [0,4194304] 0 2024-09-17T01:01:53.413 INFO:tasks.workunit.client.1.smithi099.stdout:8/312: dread - d0/d4/f3c zero size 2024-09-17T01:01:53.413 INFO:tasks.workunit.client.0.smithi002.stdout:9/176: dwrite d5/f29 [0,4194304] 0 2024-09-17T01:01:53.414 INFO:tasks.workunit.client.1.smithi099.stdout:5/385: symlink d2/dc/d14/d19/l76 0 2024-09-17T01:01:53.415 INFO:tasks.workunit.client.1.smithi099.stdout:9/298: rmdir da/d14/d40/d61 0 2024-09-17T01:01:53.415 INFO:tasks.workunit.client.1.smithi099.stdout:9/299: stat da 0 2024-09-17T01:01:53.416 INFO:tasks.workunit.client.1.smithi099.stdout:7/312: symlink d1/d2c/d47/d48/l64 0 2024-09-17T01:01:53.416 INFO:tasks.workunit.client.1.smithi099.stdout:8/313: stat d0/d4/c2d 0 2024-09-17T01:01:53.417 INFO:tasks.workunit.client.1.smithi099.stdout:5/386: rename d2/d8/f49 to d2/d8/f77 0 2024-09-17T01:01:53.418 INFO:tasks.workunit.client.1.smithi099.stdout:9/300: creat da/d18/d5e/f67 x:0 0 0 2024-09-17T01:01:53.419 INFO:tasks.workunit.client.1.smithi099.stdout:9/301: write da/f64 [587627,66452] 0 2024-09-17T01:01:53.419 INFO:tasks.workunit.client.1.smithi099.stdout:8/314: getdents d0/d1f/d55 0 2024-09-17T01:01:53.419 INFO:tasks.workunit.client.1.smithi099.stdout:8/315: stat d0/d1f/l48 0 2024-09-17T01:01:53.421 INFO:tasks.workunit.client.1.smithi099.stdout:1/348: dwrite d0/d2/d9/f30 [0,4194304] 0 2024-09-17T01:01:53.422 INFO:tasks.workunit.client.1.smithi099.stdout:8/316: rename d0/d4/f11 to d0/f61 0 2024-09-17T01:01:53.422 INFO:tasks.workunit.client.1.smithi099.stdout:8/317: read d0/f1d [372697,121207] 0 2024-09-17T01:01:53.422 INFO:tasks.workunit.client.1.smithi099.stdout:8/318: stat d0/d1f/d55 0 2024-09-17T01:01:53.422 INFO:tasks.workunit.client.1.smithi099.stdout:3/270: dwrite d9/d15/d18/d1a/d23/f17 [4194304,4194304] 0 2024-09-17T01:01:53.425 INFO:tasks.workunit.client.0.smithi002.stdout:8/311: getdents d2/d41 0 2024-09-17T01:01:53.426 INFO:tasks.workunit.client.1.smithi099.stdout:0/304: write da/df/f28 [1030517,94696] 0 2024-09-17T01:01:53.426 INFO:tasks.workunit.client.1.smithi099.stdout:0/305: fsync da/df/d31/f54 0 2024-09-17T01:01:53.426 INFO:tasks.workunit.client.1.smithi099.stdout:0/306: chown da/d12/d22/c3a 97679 1 2024-09-17T01:01:53.427 INFO:tasks.workunit.client.1.smithi099.stdout:3/271: creat d9/d3b/f4f x:0 0 0 2024-09-17T01:01:53.431 INFO:tasks.workunit.client.0.smithi002.stdout:8/312: rmdir d2/d26/d2b/d4f/d58 39 2024-09-17T01:01:53.434 INFO:tasks.workunit.client.0.smithi002.stdout:8/313: creat d2/d3/f6e x:0 0 0 2024-09-17T01:01:53.434 INFO:tasks.workunit.client.0.smithi002.stdout:8/314: write d2/d26/f5c [462773,109470] 0 2024-09-17T01:01:53.436 INFO:tasks.workunit.client.0.smithi002.stdout:8/315: link d2/d1c/c44 d2/d26/d2b/d4f/d58/c6f 0 2024-09-17T01:01:53.438 INFO:tasks.workunit.client.0.smithi002.stdout:8/316: truncate d2/d9/f20 6463056 0 2024-09-17T01:01:53.438 INFO:tasks.workunit.client.0.smithi002.stdout:8/317: write d2/d3/f6e [59752,71879] 0 2024-09-17T01:01:53.438 INFO:tasks.workunit.client.0.smithi002.stdout:8/318: chown d2/d3/c5a 23084167 1 2024-09-17T01:01:53.440 INFO:tasks.workunit.client.0.smithi002.stdout:9/177: dwrite d5/f18 [0,4194304] 0 2024-09-17T01:01:53.441 INFO:tasks.workunit.client.0.smithi002.stdout:7/154: sync 2024-09-17T01:01:53.441 INFO:tasks.workunit.client.0.smithi002.stdout:0/140: sync 2024-09-17T01:01:53.442 INFO:tasks.workunit.client.1.smithi099.stdout:3/272: write d9/d15/d18/d1a/d23/f49 [4930134,58895] 0 2024-09-17T01:01:53.442 INFO:tasks.workunit.client.0.smithi002.stdout:0/141: chown l6 45054101 1 2024-09-17T01:01:53.444 INFO:tasks.workunit.client.1.smithi099.stdout:7/313: dwrite d1/d37/f51 [0,4194304] 0 2024-09-17T01:01:53.445 INFO:tasks.workunit.client.0.smithi002.stdout:9/178: unlink d5/dc/f1b 0 2024-09-17T01:01:53.447 INFO:tasks.workunit.client.0.smithi002.stdout:0/142: rename dd/d19/d1c/d1f/d22/f2a to dd/d19/d1a/f2b 0 2024-09-17T01:01:53.447 INFO:tasks.workunit.client.0.smithi002.stdout:0/143: chown dd/d19/d1c/d1f/c26 0 1 2024-09-17T01:01:53.450 INFO:tasks.workunit.client.1.smithi099.stdout:9/302: getdents da/d1b/d3a/d4b 0 2024-09-17T01:01:53.450 INFO:tasks.workunit.client.1.smithi099.stdout:9/303: write da/f44 [1181521,110511] 0 2024-09-17T01:01:53.451 INFO:tasks.workunit.client.1.smithi099.stdout:9/304: rename da/d21/d2a/l42 to da/d21/d5b/l68 0 2024-09-17T01:01:53.452 INFO:tasks.workunit.client.0.smithi002.stdout:8/319: dread d2/d30/f32 [0,4194304] 0 2024-09-17T01:01:53.456 INFO:tasks.workunit.client.0.smithi002.stdout:8/320: rename d2/d3/f7 to d2/d9/dd/f70 0 2024-09-17T01:01:53.460 INFO:tasks.workunit.client.1.smithi099.stdout:3/273: dread d9/d15/d18/d1a/f4d [0,4194304] 0 2024-09-17T01:01:53.460 INFO:tasks.workunit.client.0.smithi002.stdout:7/155: dread d1/d14/f15 [0,4194304] 0 2024-09-17T01:01:53.462 INFO:tasks.workunit.client.1.smithi099.stdout:7/314: dread d1/d36/f45 [0,4194304] 0 2024-09-17T01:01:53.462 INFO:tasks.workunit.client.0.smithi002.stdout:7/156: symlink d1/d14/d1d/d29/d30/l37 0 2024-09-17T01:01:53.462 INFO:tasks.workunit.client.0.smithi002.stdout:7/157: write d1/d14/d1d/d29/f2f [654987,22737] 0 2024-09-17T01:01:53.465 INFO:tasks.workunit.client.1.smithi099.stdout:4/320: dwrite d7/dd/de/d10/d18/f42 [0,4194304] 0 2024-09-17T01:01:53.466 INFO:tasks.workunit.client.1.smithi099.stdout:0/307: dwrite da/d1c/d1e/f24 [0,4194304] 0 2024-09-17T01:01:53.466 INFO:tasks.workunit.client.1.smithi099.stdout:5/387: dwrite d2/dc/d14/d19/f6d [0,4194304] 0 2024-09-17T01:01:53.466 INFO:tasks.workunit.client.1.smithi099.stdout:0/308: fdatasync da/df/d1a/d49/f4a 0 2024-09-17T01:01:53.467 INFO:tasks.workunit.client.1.smithi099.stdout:0/309: read - da/df/d31/f4c zero size 2024-09-17T01:01:53.469 INFO:tasks.workunit.client.0.smithi002.stdout:0/144: dwrite dd/f14 [8388608,4194304] 0 2024-09-17T01:01:53.469 INFO:tasks.workunit.client.0.smithi002.stdout:9/179: truncate d5/f18 3961130 0 2024-09-17T01:01:53.470 INFO:tasks.workunit.client.0.smithi002.stdout:9/180: chown d5/f18 19332013 1 2024-09-17T01:01:53.470 INFO:tasks.workunit.client.0.smithi002.stdout:9/181: chown d5/dc/d26/l2b 54833 1 2024-09-17T01:01:53.472 INFO:tasks.workunit.client.1.smithi099.stdout:5/388: symlink d2/dc/d14/d19/l78 0 2024-09-17T01:01:53.472 INFO:tasks.workunit.client.1.smithi099.stdout:5/389: readlink d2/dc/d14/d19/l6a 0 2024-09-17T01:01:53.474 INFO:tasks.workunit.client.0.smithi002.stdout:9/182: link d5/dc/d26/l2b d5/dc/l35 0 2024-09-17T01:01:53.475 INFO:tasks.workunit.client.0.smithi002.stdout:9/183: read d5/fb [662152,296] 0 2024-09-17T01:01:53.476 INFO:tasks.workunit.client.0.smithi002.stdout:9/184: chown d5/dc/c24 455408 1 2024-09-17T01:01:53.480 INFO:tasks.workunit.client.1.smithi099.stdout:7/315: write d1/d2c/d47/f50 [2666695,34861] 0 2024-09-17T01:01:53.482 INFO:tasks.workunit.client.1.smithi099.stdout:7/316: mknod d1/d2c/d47/d48/d60/c65 0 2024-09-17T01:01:53.485 INFO:tasks.workunit.client.0.smithi002.stdout:0/145: write dd/d19/d1c/d1f/f21 [8791837,107088] 0 2024-09-17T01:01:53.485 INFO:tasks.workunit.client.1.smithi099.stdout:5/390: dread d2/dc/d17/f59 [0,4194304] 0 2024-09-17T01:01:53.486 INFO:tasks.workunit.client.1.smithi099.stdout:5/391: dread d2/dc/d14/f20 [0,4194304] 0 2024-09-17T01:01:53.486 INFO:tasks.workunit.client.1.smithi099.stdout:5/392: readlink d2/dc/d14/d19/l6e 0 2024-09-17T01:01:53.487 INFO:tasks.workunit.client.1.smithi099.stdout:3/274: dwrite d9/d3b/f4f [0,4194304] 0 2024-09-17T01:01:53.488 INFO:tasks.workunit.client.1.smithi099.stdout:5/393: dread d2/f7 [0,4194304] 0 2024-09-17T01:01:53.488 INFO:tasks.workunit.client.1.smithi099.stdout:5/394: write d2/dc/d14/d19/f4b [1035141,55890] 0 2024-09-17T01:01:53.488 INFO:tasks.workunit.client.1.smithi099.stdout:5/395: fdatasync d2/f18 0 2024-09-17T01:01:53.489 INFO:tasks.workunit.client.1.smithi099.stdout:9/305: dwrite da/d1b/d3a/d4b/f66 [0,4194304] 0 2024-09-17T01:01:53.489 INFO:tasks.workunit.client.1.smithi099.stdout:9/306: write da/d21/f3b [3296307,107644] 0 2024-09-17T01:01:53.490 INFO:tasks.workunit.client.0.smithi002.stdout:8/321: getdents d2/d9/dd 0 2024-09-17T01:01:53.491 INFO:tasks.workunit.client.0.smithi002.stdout:7/158: dwrite d1/f20 [0,4194304] 0 2024-09-17T01:01:53.492 INFO:tasks.workunit.client.0.smithi002.stdout:8/322: truncate d2/d9/dd/f18 2145532 0 2024-09-17T01:01:53.493 INFO:tasks.workunit.client.1.smithi099.stdout:9/307: mkdir da/d14/d48/d69 0 2024-09-17T01:01:53.494 INFO:tasks.workunit.client.0.smithi002.stdout:7/159: write d1/d14/d1d/d29/f2f [457415,127521] 0 2024-09-17T01:01:53.494 INFO:tasks.workunit.client.0.smithi002.stdout:7/160: write d1/f27 [1313205,66710] 0 2024-09-17T01:01:53.496 INFO:tasks.workunit.client.1.smithi099.stdout:9/308: rename da/l16 to da/d14/d40/l6a 0 2024-09-17T01:01:53.496 INFO:tasks.workunit.client.1.smithi099.stdout:9/309: chown da/d1b/d3a/d4b/f66 696 1 2024-09-17T01:01:53.497 INFO:tasks.workunit.client.0.smithi002.stdout:3/242: sync 2024-09-17T01:01:53.497 INFO:tasks.workunit.client.0.smithi002.stdout:3/243: chown d0/d3/d17 1913 1 2024-09-17T01:01:53.497 INFO:tasks.workunit.client.0.smithi002.stdout:3/244: creat d0/d3/d37/f51 x:0 0 0 2024-09-17T01:01:53.497 INFO:tasks.workunit.client.0.smithi002.stdout:3/245: creat d0/d3/d33/d40/f52 x:0 0 0 2024-09-17T01:01:53.497 INFO:tasks.workunit.client.0.smithi002.stdout:7/161: symlink d1/d14/d1d/d21/l38 0 2024-09-17T01:01:53.497 INFO:tasks.workunit.client.0.smithi002.stdout:7/162: write d1/f26 [915910,59028] 0 2024-09-17T01:01:53.497 INFO:tasks.workunit.client.0.smithi002.stdout:7/163: chown d1/c1b 118727 1 2024-09-17T01:01:53.499 INFO:tasks.workunit.client.1.smithi099.stdout:4/321: truncate d7/d35/f36 1367607 0 2024-09-17T01:01:53.499 INFO:tasks.workunit.client.0.smithi002.stdout:3/246: unlink d0/d3/c1d 0 2024-09-17T01:01:53.500 INFO:tasks.workunit.client.0.smithi002.stdout:3/247: readlink d0/d3/l41 0 2024-09-17T01:01:53.500 INFO:tasks.workunit.client.0.smithi002.stdout:7/164: mknod d1/d24/c39 0 2024-09-17T01:01:53.501 INFO:tasks.workunit.client.1.smithi099.stdout:4/322: creat d7/d35/f6e x:0 0 0 2024-09-17T01:01:53.501 INFO:tasks.workunit.client.1.smithi099.stdout:4/323: rename d7/dd to d7/dd/d21/d6f 22 2024-09-17T01:01:53.501 INFO:tasks.workunit.client.1.smithi099.stdout:5/396: dread d2/d8/f29 [0,4194304] 0 2024-09-17T01:01:53.502 INFO:tasks.workunit.client.1.smithi099.stdout:4/324: symlink d7/dd/de/l70 0 2024-09-17T01:01:53.502 INFO:tasks.workunit.client.1.smithi099.stdout:4/325: chown d7/dd/de/d10/d18/d4b/c57 98778 1 2024-09-17T01:01:53.502 INFO:tasks.workunit.client.1.smithi099.stdout:4/326: stat d7/dd/d64 0 2024-09-17T01:01:53.502 INFO:tasks.workunit.client.1.smithi099.stdout:4/327: read d7/f8 [67113,80954] 0 2024-09-17T01:01:53.503 INFO:tasks.workunit.client.0.smithi002.stdout:3/248: link d0/d3/f19 d0/d3/d33/d4f/f53 0 2024-09-17T01:01:53.503 INFO:tasks.workunit.client.0.smithi002.stdout:3/249: chown d0/d3/d17/f2c 9400 1 2024-09-17T01:01:53.503 INFO:tasks.workunit.client.0.smithi002.stdout:3/250: dread - d0/f21 zero size 2024-09-17T01:01:53.504 INFO:tasks.workunit.client.1.smithi099.stdout:5/397: creat d2/dc/d17/d3c/d72/f79 x:0 0 0 2024-09-17T01:01:53.504 INFO:tasks.workunit.client.1.smithi099.stdout:5/398: write d2/f40 [259414,45262] 0 2024-09-17T01:01:53.504 INFO:tasks.workunit.client.1.smithi099.stdout:5/399: readlink d2/l50 0 2024-09-17T01:01:53.504 INFO:tasks.workunit.client.1.smithi099.stdout:5/400: creat d2/d8/f7a x:0 0 0 2024-09-17T01:01:53.506 INFO:tasks.workunit.client.0.smithi002.stdout:7/165: rename d1/l34 to d1/l3a 0 2024-09-17T01:01:53.506 INFO:tasks.workunit.client.1.smithi099.stdout:4/328: mknod d7/dd/de/d10/c71 0 2024-09-17T01:01:53.506 INFO:tasks.workunit.client.1.smithi099.stdout:9/310: dread da/f64 [0,4194304] 0 2024-09-17T01:01:53.507 INFO:tasks.workunit.client.0.smithi002.stdout:0/146: dwrite dd/f13 [4194304,4194304] 0 2024-09-17T01:01:53.512 INFO:tasks.workunit.client.0.smithi002.stdout:7/166: rename d1/d14/d1d/d21/l38 to d1/d14/d1d/d21/l3b 0 2024-09-17T01:01:53.512 INFO:tasks.workunit.client.0.smithi002.stdout:7/167: mkdir d1/d14/d1d/d29/d30/d3c 0 2024-09-17T01:01:53.513 INFO:tasks.workunit.client.1.smithi099.stdout:5/401: rename d2/dc/d17/d6b/l6f to d2/d26/d64/l7b 0 2024-09-17T01:01:53.513 INFO:tasks.workunit.client.1.smithi099.stdout:5/402: truncate d2/dc/d17/f5d 4750917 0 2024-09-17T01:01:53.513 INFO:tasks.workunit.client.1.smithi099.stdout:5/403: fdatasync d2/dc/d17/f53 0 2024-09-17T01:01:53.513 INFO:tasks.workunit.client.1.smithi099.stdout:5/404: read d2/dc/d17/f53 [3383828,48212] 0 2024-09-17T01:01:53.514 INFO:tasks.workunit.client.0.smithi002.stdout:7/168: creat d1/d14/d1d/d28/f3d x:0 0 0 2024-09-17T01:01:53.514 INFO:tasks.workunit.client.0.smithi002.stdout:3/251: dread d0/d3/d17/f29 [0,4194304] 0 2024-09-17T01:01:53.514 INFO:tasks.workunit.client.0.smithi002.stdout:3/252: write d0/d3/f1a [5115921,88203] 0 2024-09-17T01:01:53.514 INFO:tasks.workunit.client.1.smithi099.stdout:9/311: creat da/d14/d62/f6b x:0 0 0 2024-09-17T01:01:53.515 INFO:tasks.workunit.client.1.smithi099.stdout:9/312: mkdir da/d14/d48/d69/d6c 0 2024-09-17T01:01:53.516 INFO:tasks.workunit.client.1.smithi099.stdout:9/313: write da/d50/f5c [777222,129440] 0 2024-09-17T01:01:53.516 INFO:tasks.workunit.client.0.smithi002.stdout:3/253: symlink d0/d3/d17/l54 0 2024-09-17T01:01:53.516 INFO:tasks.workunit.client.0.smithi002.stdout:3/254: chown d0/d31/c34 4015256 1 2024-09-17T01:01:53.517 INFO:tasks.workunit.client.1.smithi099.stdout:5/405: dread d2/f18 [0,4194304] 0 2024-09-17T01:01:53.518 INFO:tasks.workunit.client.1.smithi099.stdout:5/406: stat d2/dc/d14 0 2024-09-17T01:01:53.518 INFO:tasks.workunit.client.0.smithi002.stdout:3/255: link d0/d3/f8 d0/d3/d33/f55 0 2024-09-17T01:01:53.518 INFO:tasks.workunit.client.1.smithi099.stdout:5/407: truncate d2/f32 456233 0 2024-09-17T01:01:53.519 INFO:tasks.workunit.client.1.smithi099.stdout:5/408: symlink d2/dc/d14/d19/l7c 0 2024-09-17T01:01:53.520 INFO:tasks.workunit.client.0.smithi002.stdout:3/256: creat d0/d31/f56 x:0 0 0 2024-09-17T01:01:53.521 INFO:tasks.workunit.client.0.smithi002.stdout:3/257: stat d0/d31/f56 0 2024-09-17T01:01:53.522 INFO:tasks.workunit.client.0.smithi002.stdout:3/258: symlink d0/d31/d32/l57 0 2024-09-17T01:01:53.525 INFO:tasks.workunit.client.0.smithi002.stdout:8/323: dwrite d2/d26/f61 [0,4194304] 0 2024-09-17T01:01:53.525 INFO:tasks.workunit.client.1.smithi099.stdout:3/275: dwrite d9/d15/d18/d1a/d23/f49 [4194304,4194304] 0 2024-09-17T01:01:53.527 INFO:tasks.workunit.client.0.smithi002.stdout:8/324: write d2/d1c/d28/f55 [568508,119881] 0 2024-09-17T01:01:53.530 INFO:tasks.workunit.client.0.smithi002.stdout:8/325: mkdir d2/d26/d2b/d71 0 2024-09-17T01:01:53.533 INFO:tasks.workunit.client.0.smithi002.stdout:3/259: write d0/fd [667939,52907] 0 2024-09-17T01:01:53.535 INFO:tasks.workunit.client.0.smithi002.stdout:3/260: symlink d0/d31/d32/l58 0 2024-09-17T01:01:53.535 INFO:tasks.workunit.client.0.smithi002.stdout:3/261: chown d0/d3/d33/c46 4913 1 2024-09-17T01:01:53.538 INFO:tasks.workunit.client.0.smithi002.stdout:8/326: dread d2/d9/dd/f70 [0,4194304] 0 2024-09-17T01:01:53.538 INFO:tasks.workunit.client.0.smithi002.stdout:8/327: read d2/d3/f1b [238912,62699] 0 2024-09-17T01:01:53.538 INFO:tasks.workunit.client.0.smithi002.stdout:8/328: fsync d2/d41/f54 0 2024-09-17T01:01:53.539 INFO:tasks.workunit.client.1.smithi099.stdout:3/276: read d9/d15/d18/d1a/d23/f17 [5189473,110177] 0 2024-09-17T01:01:53.539 INFO:tasks.workunit.client.0.smithi002.stdout:3/262: dread d0/f1f [0,4194304] 0 2024-09-17T01:01:53.539 INFO:tasks.workunit.client.0.smithi002.stdout:8/329: unlink d2/d9/l17 0 2024-09-17T01:01:53.540 INFO:tasks.workunit.client.0.smithi002.stdout:3/263: mknod d0/d3/d33/d40/c59 0 2024-09-17T01:01:53.541 INFO:tasks.workunit.client.0.smithi002.stdout:3/264: mkdir d0/d3/d37/d5a 0 2024-09-17T01:01:53.541 INFO:tasks.workunit.client.0.smithi002.stdout:3/265: dread - d0/d31/f56 zero size 2024-09-17T01:01:53.542 INFO:tasks.workunit.client.0.smithi002.stdout:7/169: dwrite d1/f20 [0,4194304] 0 2024-09-17T01:01:53.545 INFO:tasks.workunit.client.1.smithi099.stdout:9/314: dwrite da/d14/d40/f65 [0,4194304] 0 2024-09-17T01:01:53.547 INFO:tasks.workunit.client.0.smithi002.stdout:7/170: mknod d1/d14/d1d/d29/d30/c3e 0 2024-09-17T01:01:53.551 INFO:tasks.workunit.client.0.smithi002.stdout:7/171: rmdir d1/d14/d1d/d29/d30 39 2024-09-17T01:01:53.561 INFO:tasks.workunit.client.1.smithi099.stdout:9/315: truncate da/d14/d40/f65 2776097 0 2024-09-17T01:01:53.562 INFO:tasks.workunit.client.1.smithi099.stdout:9/316: mkdir da/d14/d6d 0 2024-09-17T01:01:53.564 INFO:tasks.workunit.client.1.smithi099.stdout:9/317: creat da/d56/f6e x:0 0 0 2024-09-17T01:01:53.564 INFO:tasks.workunit.client.1.smithi099.stdout:9/318: chown da/lb 17121 1 2024-09-17T01:01:53.564 INFO:tasks.workunit.client.0.smithi002.stdout:7/172: dread f0 [0,4194304] 0 2024-09-17T01:01:53.564 INFO:tasks.workunit.client.1.smithi099.stdout:9/319: mkdir da/d14/d40/d6f 0 2024-09-17T01:01:53.565 INFO:tasks.workunit.client.0.smithi002.stdout:7/173: rmdir d1/d14/d1d/d21 39 2024-09-17T01:01:53.566 INFO:tasks.workunit.client.0.smithi002.stdout:7/174: creat d1/d14/f3f x:0 0 0 2024-09-17T01:01:53.566 INFO:tasks.workunit.client.1.smithi099.stdout:9/320: link da/f2c da/d14/d40/d6f/f70 0 2024-09-17T01:01:53.567 INFO:tasks.workunit.client.0.smithi002.stdout:7/175: mkdir d1/d14/d1d/d28/d40 0 2024-09-17T01:01:53.577 INFO:tasks.workunit.client.1.smithi099.stdout:3/277: dwrite d9/d15/d18/f2a [0,4194304] 0 2024-09-17T01:01:53.577 INFO:tasks.workunit.client.1.smithi099.stdout:3/278: creat d9/d15/f50 x:0 0 0 2024-09-17T01:01:53.577 INFO:tasks.workunit.client.1.smithi099.stdout:3/279: getdents d9/d2b 0 2024-09-17T01:01:53.577 INFO:tasks.workunit.client.1.smithi099.stdout:3/280: creat d9/d15/d38/f51 x:0 0 0 2024-09-17T01:01:53.577 INFO:tasks.workunit.client.0.smithi002.stdout:3/266: dwrite d0/f21 [0,4194304] 0 2024-09-17T01:01:53.580 INFO:tasks.workunit.client.0.smithi002.stdout:8/330: dwrite d2/d9/f38 [0,4194304] 0 2024-09-17T01:01:53.580 INFO:tasks.workunit.client.0.smithi002.stdout:8/331: creat d2/d3/f72 x:0 0 0 2024-09-17T01:01:53.587 INFO:tasks.workunit.client.1.smithi099.stdout:9/321: dwrite da/d14/f29 [4194304,4194304] 0 2024-09-17T01:01:53.589 INFO:tasks.workunit.client.1.smithi099.stdout:3/281: dread d9/d15/d18/f35 [0,4194304] 0 2024-09-17T01:01:53.591 INFO:tasks.workunit.client.1.smithi099.stdout:3/282: mkdir d9/d2b/d52 0 2024-09-17T01:01:53.593 INFO:tasks.workunit.client.1.smithi099.stdout:3/283: mknod d9/d3b/d44/c53 0 2024-09-17T01:01:53.593 INFO:tasks.workunit.client.1.smithi099.stdout:3/284: stat d9/d15/d18/f2f 0 2024-09-17T01:01:53.604 INFO:tasks.workunit.client.1.smithi099.stdout:3/285: dread d9/d15/f34 [0,4194304] 0 2024-09-17T01:01:53.613 INFO:tasks.workunit.client.1.smithi099.stdout:3/286: dread d9/d15/d18/f2a [0,4194304] 0 2024-09-17T01:01:53.613 INFO:tasks.workunit.client.1.smithi099.stdout:9/322: dwrite da/d1b/d3a/d4b/f66 [4194304,4194304] 0 2024-09-17T01:01:53.614 INFO:tasks.workunit.client.0.smithi002.stdout:3/267: dwrite d0/d31/d32/f25 [8388608,4194304] 0 2024-09-17T01:01:53.614 INFO:tasks.workunit.client.0.smithi002.stdout:8/332: dwrite d2/d26/f57 [0,4194304] 0 2024-09-17T01:01:53.618 INFO:tasks.workunit.client.0.smithi002.stdout:8/333: rename d2/d30/l68 to d2/d1c/d3b/l73 0 2024-09-17T01:01:53.619 INFO:tasks.workunit.client.0.smithi002.stdout:8/334: truncate d2/d30/f32 277716 0 2024-09-17T01:01:53.634 INFO:tasks.workunit.client.1.smithi099.stdout:3/287: dwrite d9/d2b/f2d [0,4194304] 0 2024-09-17T01:01:53.634 INFO:tasks.workunit.client.1.smithi099.stdout:3/288: mknod d9/d2b/c54 0 2024-09-17T01:01:53.637 INFO:tasks.workunit.client.1.smithi099.stdout:3/289: dread d9/d15/d18/d1a/d23/f2c [4194304,4194304] 0 2024-09-17T01:01:53.637 INFO:tasks.workunit.client.1.smithi099.stdout:3/290: chown d9/d15/d18/d1a/f1f 570646 1 2024-09-17T01:01:53.637 INFO:tasks.workunit.client.1.smithi099.stdout:3/291: readlink l7 0 2024-09-17T01:01:53.638 INFO:tasks.workunit.client.1.smithi099.stdout:3/292: symlink d9/d15/d18/d1a/d23/d4c/l55 0 2024-09-17T01:01:53.643 INFO:tasks.workunit.client.0.smithi002.stdout:3/268: dwrite d0/d3/d37/f47 [0,4194304] 0 2024-09-17T01:01:53.643 INFO:tasks.workunit.client.0.smithi002.stdout:3/269: chown d0/d3/d37/f49 850 1 2024-09-17T01:01:53.644 INFO:tasks.workunit.client.1.smithi099.stdout:9/323: dwrite da/fe [4194304,4194304] 0 2024-09-17T01:01:53.645 INFO:tasks.workunit.client.1.smithi099.stdout:9/324: creat da/d14/d40/d6f/f71 x:0 0 0 2024-09-17T01:01:53.645 INFO:tasks.workunit.client.1.smithi099.stdout:9/325: fdatasync da/d14/f1a 0 2024-09-17T01:01:53.646 INFO:tasks.workunit.client.1.smithi099.stdout:3/293: write d9/d15/d18/f2f [5688764,7480] 0 2024-09-17T01:01:53.647 INFO:tasks.workunit.client.0.smithi002.stdout:8/335: dwrite d2/d26/f40 [0,4194304] 0 2024-09-17T01:01:53.647 INFO:tasks.workunit.client.0.smithi002.stdout:8/336: truncate d2/d1c/d3b/f4c 664676 0 2024-09-17T01:01:53.648 INFO:tasks.workunit.client.0.smithi002.stdout:8/337: mknod d2/d1c/d3b/c74 0 2024-09-17T01:01:53.648 INFO:tasks.workunit.client.0.smithi002.stdout:8/338: truncate d2/d9/f38 5045946 0 2024-09-17T01:01:53.648 INFO:tasks.workunit.client.0.smithi002.stdout:8/339: chown d2/d3/f11 86 1 2024-09-17T01:01:53.648 INFO:tasks.workunit.client.1.smithi099.stdout:3/294: creat d9/d2b/f56 x:0 0 0 2024-09-17T01:01:53.649 INFO:tasks.workunit.client.1.smithi099.stdout:3/295: mkdir d9/d3b/d44/d57 0 2024-09-17T01:01:53.649 INFO:tasks.workunit.client.1.smithi099.stdout:3/296: creat d9/d2b/f58 x:0 0 0 2024-09-17T01:01:53.654 INFO:tasks.workunit.client.1.smithi099.stdout:3/297: getdents d9/d3b/d44 0 2024-09-17T01:01:53.656 INFO:tasks.workunit.client.1.smithi099.stdout:3/298: rename d9/d15/d18/f37 to d9/d15/f59 0 2024-09-17T01:01:53.656 INFO:tasks.workunit.client.1.smithi099.stdout:3/299: write d9/f30 [292967,33502] 0 2024-09-17T01:01:53.656 INFO:tasks.workunit.client.1.smithi099.stdout:3/300: dread - d9/d15/f50 zero size 2024-09-17T01:01:53.656 INFO:tasks.workunit.client.0.smithi002.stdout:2/230: sync 2024-09-17T01:01:53.656 INFO:tasks.workunit.client.0.smithi002.stdout:4/292: sync 2024-09-17T01:01:53.657 INFO:tasks.workunit.client.1.smithi099.stdout:9/326: dread da/d1b/f3d [0,4194304] 0 2024-09-17T01:01:53.657 INFO:tasks.workunit.client.1.smithi099.stdout:3/301: rmdir d9/d15/d18/d1a/d23 39 2024-09-17T01:01:53.658 INFO:tasks.workunit.client.1.smithi099.stdout:3/302: creat d9/d3b/d44/d57/f5a x:0 0 0 2024-09-17T01:01:53.658 INFO:tasks.workunit.client.1.smithi099.stdout:3/303: chown d9/d15/d18/f19 493 1 2024-09-17T01:01:53.658 INFO:tasks.workunit.client.0.smithi002.stdout:2/231: unlink d1b/l41 0 2024-09-17T01:01:53.659 INFO:tasks.workunit.client.0.smithi002.stdout:4/293: link d7/de/d23/f50 d7/de/d23/f57 0 2024-09-17T01:01:53.660 INFO:tasks.workunit.client.0.smithi002.stdout:4/294: creat d7/d19/d34/f58 x:0 0 0 2024-09-17T01:01:53.663 INFO:tasks.workunit.client.0.smithi002.stdout:4/295: mkdir d7/de/d32/d59 0 2024-09-17T01:01:53.664 INFO:tasks.workunit.client.0.smithi002.stdout:4/296: chown d7/de/c47 11 1 2024-09-17T01:01:53.665 INFO:tasks.workunit.client.0.smithi002.stdout:4/297: rename d7/f16 to d7/de/d55/f5a 0 2024-09-17T01:01:53.665 INFO:tasks.workunit.client.1.smithi099.stdout:3/304: dread d9/d15/d18/f2a [0,4194304] 0 2024-09-17T01:01:53.666 INFO:tasks.workunit.client.0.smithi002.stdout:4/298: truncate d7/d19/f1c 2053324 0 2024-09-17T01:01:53.670 INFO:tasks.workunit.client.1.smithi099.stdout:9/327: write da/d1b/d3a/d4b/f66 [5575688,66710] 0 2024-09-17T01:01:53.670 INFO:tasks.workunit.client.1.smithi099.stdout:9/328: truncate da/d18/d5e/f67 68024 0 2024-09-17T01:01:53.672 INFO:tasks.workunit.client.1.smithi099.stdout:9/329: symlink da/d14/d40/l72 0 2024-09-17T01:01:53.673 INFO:tasks.workunit.client.1.smithi099.stdout:9/330: symlink da/d14/d6d/l73 0 2024-09-17T01:01:53.674 INFO:tasks.workunit.client.0.smithi002.stdout:2/232: write d1b/f1c [1837396,89848] 0 2024-09-17T01:01:53.674 INFO:tasks.workunit.client.0.smithi002.stdout:2/233: dread - d1b/d1d/d38/f3c zero size 2024-09-17T01:01:53.675 INFO:tasks.workunit.client.0.smithi002.stdout:2/234: mknod d1b/d37/c53 0 2024-09-17T01:01:53.675 INFO:tasks.workunit.client.0.smithi002.stdout:2/235: dread - d1b/f29 zero size 2024-09-17T01:01:53.676 INFO:tasks.workunit.client.0.smithi002.stdout:2/236: link d1b/d1d/f4f d1b/d37/d48/d4e/f54 0 2024-09-17T01:01:53.677 INFO:tasks.workunit.client.0.smithi002.stdout:2/237: mknod d1b/d37/d48/c55 0 2024-09-17T01:01:53.677 INFO:tasks.workunit.client.0.smithi002.stdout:3/270: dwrite d0/d3/d17/f3a [0,4194304] 0 2024-09-17T01:01:53.677 INFO:tasks.workunit.client.0.smithi002.stdout:2/238: dread - d1b/d37/f42 zero size 2024-09-17T01:01:53.677 INFO:tasks.workunit.client.0.smithi002.stdout:8/340: dwrite d2/d26/d2b/d4f/d58/f6a [0,4194304] 0 2024-09-17T01:01:53.679 INFO:tasks.workunit.client.0.smithi002.stdout:4/299: write d7/d19/f21 [5558735,37673] 0 2024-09-17T01:01:53.680 INFO:tasks.workunit.client.0.smithi002.stdout:3/271: mkdir d0/d3/d37/d5a/d5b 0 2024-09-17T01:01:53.682 INFO:tasks.workunit.client.1.smithi099.stdout:9/331: dread da/d14/d40/f65 [0,4194304] 0 2024-09-17T01:01:53.684 INFO:tasks.workunit.client.1.smithi099.stdout:9/332: rename da/d1b/d3a/l25 to da/d1b/d3a/l74 0 2024-09-17T01:01:53.684 INFO:tasks.workunit.client.1.smithi099.stdout:9/333: fdatasync da/ff 0 2024-09-17T01:01:53.684 INFO:tasks.workunit.client.1.smithi099.stdout:9/334: fsync da/d18/d49/f63 0 2024-09-17T01:01:53.685 INFO:tasks.workunit.client.0.smithi002.stdout:4/300: unlink d7/d3f/c4c 0 2024-09-17T01:01:53.685 INFO:tasks.workunit.client.0.smithi002.stdout:4/301: chown d7/f25 370 1 2024-09-17T01:01:53.685 INFO:tasks.workunit.client.0.smithi002.stdout:2/239: write d1b/f3a [1026759,50721] 0 2024-09-17T01:01:53.686 INFO:tasks.workunit.client.1.smithi099.stdout:9/335: rename da/d18/c24 to da/d14/d40/c75 0 2024-09-17T01:01:53.686 INFO:tasks.workunit.client.0.smithi002.stdout:3/272: link d0/d31/d32/f25 d0/d3/d37/d5a/f5c 0 2024-09-17T01:01:53.687 INFO:tasks.workunit.client.1.smithi099.stdout:9/336: dread da/d18/d5e/f67 [0,4194304] 0 2024-09-17T01:01:53.687 INFO:tasks.workunit.client.1.smithi099.stdout:9/337: chown da/d1b/c34 1320 1 2024-09-17T01:01:53.688 INFO:tasks.workunit.client.1.smithi099.stdout:3/305: dwrite d9/d15/f50 [0,4194304] 0 2024-09-17T01:01:53.688 INFO:tasks.workunit.client.1.smithi099.stdout:3/306: stat d9/d15/d18/d1a/d23/d4c/l55 0 2024-09-17T01:01:53.688 INFO:tasks.workunit.client.1.smithi099.stdout:3/307: fdatasync d9/d15/d18/d1a/d23/f2c 0 2024-09-17T01:01:53.692 INFO:tasks.workunit.client.1.smithi099.stdout:3/308: dread d9/d15/d18/f35 [0,4194304] 0 2024-09-17T01:01:53.693 INFO:tasks.workunit.client.0.smithi002.stdout:3/273: rename d0/d3/d37/f49 to d0/d3/d37/d5a/f5d 0 2024-09-17T01:01:53.693 INFO:tasks.workunit.client.1.smithi099.stdout:9/338: dread da/d21/f3b [0,4194304] 0 2024-09-17T01:01:53.696 INFO:tasks.workunit.client.0.smithi002.stdout:4/302: unlink d7/d19/c1e 0 2024-09-17T01:01:53.700 INFO:tasks.workunit.client.0.smithi002.stdout:3/274: write d0/d3/f19 [3593585,62335] 0 2024-09-17T01:01:53.700 INFO:tasks.workunit.client.0.smithi002.stdout:3/275: chown d0/d3/d37/f51 1527084 1 2024-09-17T01:01:53.704 INFO:tasks.workunit.client.0.smithi002.stdout:2/240: rename fd to d1b/f56 0 2024-09-17T01:01:53.704 INFO:tasks.workunit.client.0.smithi002.stdout:2/241: dread - d1b/f26 zero size 2024-09-17T01:01:53.706 INFO:tasks.workunit.client.0.smithi002.stdout:2/242: symlink d1b/d37/d48/d52/l57 0 2024-09-17T01:01:53.708 INFO:tasks.workunit.client.0.smithi002.stdout:2/243: fsync fe 0 2024-09-17T01:01:53.711 INFO:tasks.workunit.client.1.smithi099.stdout:3/309: dwrite d9/d2b/f56 [0,4194304] 0 2024-09-17T01:01:53.712 INFO:tasks.workunit.client.1.smithi099.stdout:9/339: dwrite da/ff [0,4194304] 0 2024-09-17T01:01:53.714 INFO:tasks.workunit.client.1.smithi099.stdout:3/310: mknod d9/d15/d18/d1a/c5b 0 2024-09-17T01:01:53.743 INFO:tasks.workunit.client.1.smithi099.stdout:9/340: dwrite da/d14/d40/d6f/f71 [0,4194304] 0 2024-09-17T01:01:53.744 INFO:tasks.workunit.client.1.smithi099.stdout:3/311: dwrite d9/d3b/f4f [4194304,4194304] 0 2024-09-17T01:01:53.744 INFO:tasks.workunit.client.0.smithi002.stdout:3/276: dwrite d0/d3/d17/f2c [0,4194304] 0 2024-09-17T01:01:53.744 INFO:tasks.workunit.client.0.smithi002.stdout:2/244: dwrite ff [0,4194304] 0 2024-09-17T01:01:53.744 INFO:tasks.workunit.client.0.smithi002.stdout:2/245: creat d1b/f58 x:0 0 0 2024-09-17T01:01:53.744 INFO:tasks.workunit.client.0.smithi002.stdout:2/246: chown ff 530531435 1 2024-09-17T01:01:53.745 INFO:tasks.workunit.client.0.smithi002.stdout:2/247: stat d1b/d1d/l36 0 2024-09-17T01:01:53.745 INFO:tasks.workunit.client.0.smithi002.stdout:2/248: truncate d1b/d37/f42 855776 0 2024-09-17T01:01:53.745 INFO:tasks.workunit.client.0.smithi002.stdout:3/277: mknod d0/d31/d32/c5e 0 2024-09-17T01:01:53.746 INFO:tasks.workunit.client.0.smithi002.stdout:2/249: stat f19 0 2024-09-17T01:01:53.746 INFO:tasks.workunit.client.0.smithi002.stdout:2/250: chown d1b/d37/d48/d4e/f35 9909993 1 2024-09-17T01:01:53.746 INFO:tasks.workunit.client.0.smithi002.stdout:2/251: write d1b/f4b [132609,114040] 0 2024-09-17T01:01:53.746 INFO:tasks.workunit.client.1.smithi099.stdout:9/341: symlink da/d14/d40/d6f/l76 0 2024-09-17T01:01:53.746 INFO:tasks.workunit.client.1.smithi099.stdout:9/342: creat da/d14/f77 x:0 0 0 2024-09-17T01:01:53.746 INFO:tasks.workunit.client.1.smithi099.stdout:9/343: creat da/d1b/f78 x:0 0 0 2024-09-17T01:01:53.746 INFO:tasks.workunit.client.1.smithi099.stdout:3/312: mkdir d9/d15/d18/d1a/d23/d5c 0 2024-09-17T01:01:53.749 INFO:tasks.workunit.client.1.smithi099.stdout:9/344: creat da/d14/d48/d69/f79 x:0 0 0 2024-09-17T01:01:53.749 INFO:tasks.workunit.client.1.smithi099.stdout:3/313: mknod d9/d2b/d52/c5d 0 2024-09-17T01:01:53.750 INFO:tasks.workunit.client.1.smithi099.stdout:9/345: symlink da/d1b/d3a/l7a 0 2024-09-17T01:01:53.751 INFO:tasks.workunit.client.1.smithi099.stdout:3/314: mkdir d9/d2b/d52/d5e 0 2024-09-17T01:01:53.751 INFO:tasks.workunit.client.1.smithi099.stdout:3/315: chown d9/cb 14 1 2024-09-17T01:01:53.752 INFO:tasks.workunit.client.0.smithi002.stdout:1/251: sync 2024-09-17T01:01:53.752 INFO:tasks.workunit.client.0.smithi002.stdout:6/243: sync 2024-09-17T01:01:53.752 INFO:tasks.workunit.client.0.smithi002.stdout:9/185: sync 2024-09-17T01:01:53.752 INFO:tasks.workunit.client.0.smithi002.stdout:5/292: sync 2024-09-17T01:01:53.752 INFO:tasks.workunit.client.0.smithi002.stdout:9/186: chown d5/f1e 85416034 1 2024-09-17T01:01:53.752 INFO:tasks.workunit.client.0.smithi002.stdout:9/187: write d5/f14 [1643313,2707] 0 2024-09-17T01:01:53.752 INFO:tasks.workunit.client.0.smithi002.stdout:9/188: read d5/fb [199748,100144] 0 2024-09-17T01:01:53.753 INFO:tasks.workunit.client.1.smithi099.stdout:9/346: symlink da/d14/l7b 0 2024-09-17T01:01:53.753 INFO:tasks.workunit.client.1.smithi099.stdout:3/316: link d9/d15/f40 d9/d15/d18/d1a/d23/f5f 0 2024-09-17T01:01:53.754 INFO:tasks.workunit.client.0.smithi002.stdout:1/252: mknod d4/d11/d12/d30/d43/c59 0 2024-09-17T01:01:53.754 INFO:tasks.workunit.client.0.smithi002.stdout:2/252: write ff [1234584,17312] 0 2024-09-17T01:01:53.754 INFO:tasks.workunit.client.0.smithi002.stdout:6/244: mknod d2/d1d/d2d/d35/c42 0 2024-09-17T01:01:53.754 INFO:tasks.workunit.client.0.smithi002.stdout:5/293: mknod d2/d2d/c5c 0 2024-09-17T01:01:53.754 INFO:tasks.workunit.client.0.smithi002.stdout:5/294: fsync d2/d2d/f13 0 2024-09-17T01:01:53.754 INFO:tasks.workunit.client.0.smithi002.stdout:9/189: mkdir d5/dc/d26/d34/d36 0 2024-09-17T01:01:53.755 INFO:tasks.workunit.client.1.smithi099.stdout:9/347: unlink da/l53 0 2024-09-17T01:01:53.755 INFO:tasks.workunit.client.1.smithi099.stdout:3/317: mknod d9/d15/d18/d1a/c60 0 2024-09-17T01:01:53.756 INFO:tasks.workunit.client.0.smithi002.stdout:2/253: mkdir d1b/d3f/d59 0 2024-09-17T01:01:53.756 INFO:tasks.workunit.client.0.smithi002.stdout:2/254: read d1b/d1d/d38/f3d [591470,120282] 0 2024-09-17T01:01:53.756 INFO:tasks.workunit.client.0.smithi002.stdout:2/255: creat d1b/f5a x:0 0 0 2024-09-17T01:01:53.756 INFO:tasks.workunit.client.1.smithi099.stdout:9/348: truncate da/d14/d40/d6f/f71 2218969 0 2024-09-17T01:01:53.757 INFO:tasks.workunit.client.0.smithi002.stdout:6/245: mkdir d2/d1d/d26/d40/d43 0 2024-09-17T01:01:53.759 INFO:tasks.workunit.client.0.smithi002.stdout:6/246: rmdir d2/d1d/d2d/d35 39 2024-09-17T01:01:53.760 INFO:tasks.workunit.client.0.smithi002.stdout:6/247: getdents d2/d1d/d2d/d35/d37 0 2024-09-17T01:01:53.762 INFO:tasks.workunit.client.0.smithi002.stdout:6/248: symlink d2/d1d/d27/d30/l44 0 2024-09-17T01:01:53.765 INFO:tasks.workunit.client.0.smithi002.stdout:1/253: read d4/d11/d12/d23/f35 [1854940,66699] 0 2024-09-17T01:01:53.766 INFO:tasks.workunit.client.1.smithi099.stdout:3/318: write d9/f10 [2320818,128843] 0 2024-09-17T01:01:53.767 INFO:tasks.workunit.client.0.smithi002.stdout:1/254: rename d4/d11/c44 to d4/d22/c5a 0 2024-09-17T01:01:53.768 INFO:tasks.workunit.client.1.smithi099.stdout:3/319: unlink d9/d15/d18/f19 0 2024-09-17T01:01:53.768 INFO:tasks.workunit.client.1.smithi099.stdout:3/320: dread - d9/d15/d38/f4b zero size 2024-09-17T01:01:53.768 INFO:tasks.workunit.client.1.smithi099.stdout:3/321: read d9/d15/d18/d1a/f1f [4043836,70671] 0 2024-09-17T01:01:53.768 INFO:tasks.workunit.client.1.smithi099.stdout:3/322: fdatasync d9/d15/f59 0 2024-09-17T01:01:53.769 INFO:tasks.workunit.client.1.smithi099.stdout:3/323: readlink d9/d15/d18/d1a/d23/l13 0 2024-09-17T01:01:53.769 INFO:tasks.workunit.client.0.smithi002.stdout:9/190: write d5/f29 [292213,96886] 0 2024-09-17T01:01:53.769 INFO:tasks.workunit.client.0.smithi002.stdout:2/256: dread f17 [0,4194304] 0 2024-09-17T01:01:53.770 INFO:tasks.workunit.client.0.smithi002.stdout:5/295: dwrite d2/d2d/f17 [0,4194304] 0 2024-09-17T01:01:53.770 INFO:tasks.workunit.client.0.smithi002.stdout:5/296: fdatasync d2/d2d/d10/d14/d19/d39/d43/f2a 0 2024-09-17T01:01:53.770 INFO:tasks.workunit.client.0.smithi002.stdout:9/191: truncate d5/f19 1783339 0 2024-09-17T01:01:53.772 INFO:tasks.workunit.client.1.smithi099.stdout:6/318: sync 2024-09-17T01:01:53.773 INFO:tasks.workunit.client.1.smithi099.stdout:2/220: sync 2024-09-17T01:01:53.773 INFO:tasks.workunit.client.1.smithi099.stdout:2/221: readlink d2/lf 0 2024-09-17T01:01:53.773 INFO:tasks.workunit.client.1.smithi099.stdout:2/222: chown d2/d9/d25/d26 733 1 2024-09-17T01:01:53.773 INFO:tasks.workunit.client.1.smithi099.stdout:6/319: write dc/d2b/d3f/f47 [1037865,69639] 0 2024-09-17T01:01:53.773 INFO:tasks.workunit.client.1.smithi099.stdout:6/320: creat dc/d2b/d53/f6a x:0 0 0 2024-09-17T01:01:53.773 INFO:tasks.workunit.client.1.smithi099.stdout:6/321: read - dc/d5d/f69 zero size 2024-09-17T01:01:53.773 INFO:tasks.workunit.client.0.smithi002.stdout:2/257: rename d1b/c30 to d1b/d3f/d59/c5b 0 2024-09-17T01:01:53.773 INFO:tasks.workunit.client.0.smithi002.stdout:2/258: fsync d1b/f2d 0 2024-09-17T01:01:53.773 INFO:tasks.workunit.client.0.smithi002.stdout:2/259: chown d1b/d1d/f4f 227 1 2024-09-17T01:01:53.774 INFO:tasks.workunit.client.0.smithi002.stdout:2/260: dread - d1b/d37/f49 zero size 2024-09-17T01:01:53.774 INFO:tasks.workunit.client.0.smithi002.stdout:2/261: chown d1b/f3a 128170250 1 2024-09-17T01:01:53.775 INFO:tasks.workunit.client.1.smithi099.stdout:2/223: mknod d2/d9/d25/d26/d1b/c3e 0 2024-09-17T01:01:53.777 INFO:tasks.workunit.client.0.smithi002.stdout:5/297: creat d2/d2d/d10/d14/f5d x:0 0 0 2024-09-17T01:01:53.779 INFO:tasks.workunit.client.0.smithi002.stdout:2/262: creat d1b/d3f/d50/f5c x:0 0 0 2024-09-17T01:01:53.780 INFO:tasks.workunit.client.1.smithi099.stdout:2/224: write d2/f1c [242954,96982] 0 2024-09-17T01:01:53.781 INFO:tasks.workunit.client.0.smithi002.stdout:6/249: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:01:53.781 INFO:tasks.workunit.client.0.smithi002.stdout:2/263: creat d1b/d37/d48/d52/f5d x:0 0 0 2024-09-17T01:01:53.782 INFO:tasks.workunit.client.0.smithi002.stdout:2/264: creat d1b/d37/d48/d52/f5e x:0 0 0 2024-09-17T01:01:53.782 INFO:tasks.workunit.client.0.smithi002.stdout:2/265: truncate d1b/d37/d48/d4e/f35 907565 0 2024-09-17T01:01:53.784 INFO:tasks.workunit.client.0.smithi002.stdout:6/250: symlink d2/d1d/d26/d40/d43/l45 0 2024-09-17T01:01:53.784 INFO:tasks.workunit.client.0.smithi002.stdout:6/251: chown d2/dc/d34/f39 0 1 2024-09-17T01:01:53.784 INFO:tasks.workunit.client.1.smithi099.stdout:3/324: dread d9/f12 [0,4194304] 0 2024-09-17T01:01:53.785 INFO:tasks.workunit.client.1.smithi099.stdout:2/225: mkdir d2/d9/d25/d26/d1b/d2c/d3f 0 2024-09-17T01:01:53.786 INFO:tasks.workunit.client.0.smithi002.stdout:5/298: dread d2/d2d/f13 [0,4194304] 0 2024-09-17T01:01:53.787 INFO:tasks.workunit.client.1.smithi099.stdout:6/322: read f7 [7729622,44916] 0 2024-09-17T01:01:53.787 INFO:tasks.workunit.client.1.smithi099.stdout:6/323: chown dc/c12 26231087 1 2024-09-17T01:01:53.787 INFO:tasks.workunit.client.1.smithi099.stdout:3/325: unlink d9/d15/d18/d1a/c22 0 2024-09-17T01:01:53.788 INFO:tasks.workunit.client.0.smithi002.stdout:6/252: rename d2/d1d/d26/c3f to d2/d1d/d27/d30/c46 0 2024-09-17T01:01:53.789 INFO:tasks.workunit.client.1.smithi099.stdout:2/226: rename d2/f1a to d2/d7/f40 0 2024-09-17T01:01:53.790 INFO:tasks.workunit.client.0.smithi002.stdout:5/299: dread d2/de/f4f [0,4194304] 0 2024-09-17T01:01:53.790 INFO:tasks.workunit.client.1.smithi099.stdout:6/324: symlink dc/d5d/l6b 0 2024-09-17T01:01:53.791 INFO:tasks.workunit.client.0.smithi002.stdout:5/300: creat d2/d2d/d10/d3b/f5e x:0 0 0 2024-09-17T01:01:53.792 INFO:tasks.workunit.client.1.smithi099.stdout:3/326: stat d9/d15/c21 0 2024-09-17T01:01:53.793 INFO:tasks.workunit.client.1.smithi099.stdout:2/227: mknod d2/d9/d17/c41 0 2024-09-17T01:01:53.793 INFO:tasks.workunit.client.1.smithi099.stdout:2/228: chown d2/d9/l12 20040600 1 2024-09-17T01:01:53.793 INFO:tasks.workunit.client.1.smithi099.stdout:2/229: write d2/f1c [1291466,286] 0 2024-09-17T01:01:53.793 INFO:tasks.workunit.client.0.smithi002.stdout:5/301: unlink d2/fa 0 2024-09-17T01:01:53.794 INFO:tasks.workunit.client.1.smithi099.stdout:6/325: link dc/l15 dc/d5d/l6c 0 2024-09-17T01:01:53.795 INFO:tasks.workunit.client.0.smithi002.stdout:5/302: symlink d2/d2d/d10/d14/d19/d39/d25/d32/l5f 0 2024-09-17T01:01:53.795 INFO:tasks.workunit.client.0.smithi002.stdout:5/303: fdatasync d2/de/f4a 0 2024-09-17T01:01:53.795 INFO:tasks.workunit.client.0.smithi002.stdout:5/304: chown d2/f4d 74 1 2024-09-17T01:01:53.795 INFO:tasks.workunit.client.1.smithi099.stdout:3/327: symlink d9/d15/l61 0 2024-09-17T01:01:53.795 INFO:tasks.workunit.client.1.smithi099.stdout:3/328: readlink d9/l1d 0 2024-09-17T01:01:53.796 INFO:tasks.workunit.client.1.smithi099.stdout:2/230: truncate d2/d9/d17/f21 1082345 0 2024-09-17T01:01:53.796 INFO:tasks.workunit.client.0.smithi002.stdout:1/255: dwrite d4/d11/d12/d14/f36 [0,4194304] 0 2024-09-17T01:01:53.797 INFO:tasks.workunit.client.1.smithi099.stdout:6/326: link dc/f34 dc/d1a/d49/d4c/f6d 0 2024-09-17T01:01:53.799 INFO:tasks.workunit.client.1.smithi099.stdout:3/329: rename d9/d15/d38/f4b to d9/d3b/f62 0 2024-09-17T01:01:53.799 INFO:tasks.workunit.client.1.smithi099.stdout:3/330: chown d9/d15/d18/c3c 390 1 2024-09-17T01:01:53.799 INFO:tasks.workunit.client.1.smithi099.stdout:3/331: creat d9/d15/f63 x:0 0 0 2024-09-17T01:01:53.799 INFO:tasks.workunit.client.1.smithi099.stdout:3/332: chown d9/d2b/d52 71529608 1 2024-09-17T01:01:53.799 INFO:tasks.workunit.client.1.smithi099.stdout:3/333: fdatasync d9/d15/d18/d1a/f1f 0 2024-09-17T01:01:53.800 INFO:tasks.workunit.client.1.smithi099.stdout:2/231: rename d2/d7/c1e to d2/d7/c42 0 2024-09-17T01:01:53.800 INFO:tasks.workunit.client.0.smithi002.stdout:1/256: link d4/fa d4/d11/d12/d14/d17/d20/f5b 0 2024-09-17T01:01:53.800 INFO:tasks.workunit.client.0.smithi002.stdout:1/257: creat d4/d11/f5c x:0 0 0 2024-09-17T01:01:53.801 INFO:tasks.workunit.client.0.smithi002.stdout:1/258: creat d4/d11/d12/d14/d17/d51/f5d x:0 0 0 2024-09-17T01:01:53.801 INFO:tasks.workunit.client.1.smithi099.stdout:3/334: mkdir d9/d15/d18/d1a/d23/d4c/d64 0 2024-09-17T01:01:53.802 INFO:tasks.workunit.client.1.smithi099.stdout:3/335: stat d9/f10 0 2024-09-17T01:01:53.802 INFO:tasks.workunit.client.1.smithi099.stdout:2/232: rmdir d2/d9/d25/d2f 0 2024-09-17T01:01:53.802 INFO:tasks.workunit.client.1.smithi099.stdout:2/233: chown f0 3 1 2024-09-17T01:01:53.803 INFO:tasks.workunit.client.1.smithi099.stdout:3/336: link d9/ce d9/d15/d38/c65 0 2024-09-17T01:01:53.804 INFO:tasks.workunit.client.0.smithi002.stdout:5/305: dread d2/f54 [0,4194304] 0 2024-09-17T01:01:53.805 INFO:tasks.workunit.client.0.smithi002.stdout:5/306: mkdir d2/d2d/d10/d23/d44/d60 0 2024-09-17T01:01:53.808 INFO:tasks.workunit.client.0.smithi002.stdout:6/253: dwrite d2/d1d/d27/d30/f36 [0,4194304] 0 2024-09-17T01:01:53.808 INFO:tasks.workunit.client.0.smithi002.stdout:1/259: write d4/d11/d12/d14/f1b [177818,19593] 0 2024-09-17T01:01:53.810 INFO:tasks.workunit.client.0.smithi002.stdout:6/254: dread d2/d1d/d26/f2b [0,4194304] 0 2024-09-17T01:01:53.810 INFO:tasks.workunit.client.0.smithi002.stdout:6/255: chown d2/d1d/d2d/d35/d37 82 1 2024-09-17T01:01:53.814 INFO:tasks.workunit.client.1.smithi099.stdout:6/327: write dc/d2b/f2c [2000471,63019] 0 2024-09-17T01:01:53.814 INFO:tasks.workunit.client.0.smithi002.stdout:9/192: dwrite d5/f10 [0,4194304] 0 2024-09-17T01:01:53.815 INFO:tasks.workunit.client.1.smithi099.stdout:2/234: dread d2/d9/f34 [4194304,4194304] 0 2024-09-17T01:01:53.816 INFO:tasks.workunit.client.0.smithi002.stdout:1/260: dread d4/fe [0,4194304] 0 2024-09-17T01:01:53.816 INFO:tasks.workunit.client.1.smithi099.stdout:6/328: rmdir dc/d5d 39 2024-09-17T01:01:53.818 INFO:tasks.workunit.client.1.smithi099.stdout:2/235: rename d2/d9/d25/d26/d1b/c24 to d2/d9/c43 0 2024-09-17T01:01:53.819 INFO:tasks.workunit.client.1.smithi099.stdout:6/329: rmdir dc/d2b 39 2024-09-17T01:01:53.820 INFO:tasks.workunit.client.1.smithi099.stdout:6/330: creat dc/d27/d58/f6e x:0 0 0 2024-09-17T01:01:53.820 INFO:tasks.workunit.client.1.smithi099.stdout:6/331: dread - dc/d2b/d53/f5a zero size 2024-09-17T01:01:53.821 INFO:tasks.workunit.client.0.smithi002.stdout:6/256: dread d2/dc/f21 [0,4194304] 0 2024-09-17T01:01:53.821 INFO:tasks.workunit.client.0.smithi002.stdout:6/257: dread - d2/d1d/d2d/d35/d37/f41 zero size 2024-09-17T01:01:53.821 INFO:tasks.workunit.client.1.smithi099.stdout:6/332: rmdir dc/d27 39 2024-09-17T01:01:53.822 INFO:tasks.workunit.client.0.smithi002.stdout:9/193: unlink d5/c16 0 2024-09-17T01:01:53.822 INFO:tasks.workunit.client.1.smithi099.stdout:6/333: rename dc/l13 to dc/d1a/d49/l6f 0 2024-09-17T01:01:53.823 INFO:tasks.workunit.client.0.smithi002.stdout:1/261: mkdir d4/d11/d12/d30/d5e 0 2024-09-17T01:01:53.824 INFO:tasks.workunit.client.0.smithi002.stdout:6/258: rmdir d2/dc/d34 39 2024-09-17T01:01:53.826 INFO:tasks.workunit.client.0.smithi002.stdout:9/194: getdents d5/dc 0 2024-09-17T01:01:53.826 INFO:tasks.workunit.client.0.smithi002.stdout:9/195: getdents d5/dc 0 2024-09-17T01:01:53.827 INFO:tasks.workunit.client.0.smithi002.stdout:6/259: write d2/d1d/d26/f2a [950112,26772] 0 2024-09-17T01:01:53.827 INFO:tasks.workunit.client.1.smithi099.stdout:3/337: dwrite d9/d15/d18/d1a/f1b [4194304,4194304] 0 2024-09-17T01:01:53.827 INFO:tasks.workunit.client.1.smithi099.stdout:3/338: fsync d9/d15/d18/d1a/d23/f33 0 2024-09-17T01:01:53.828 INFO:tasks.workunit.client.0.smithi002.stdout:6/260: mknod d2/d1d/d26/d40/c47 0 2024-09-17T01:01:53.828 INFO:tasks.workunit.client.0.smithi002.stdout:6/261: rmdir d2/d1d/d2d/d35 39 2024-09-17T01:01:53.828 INFO:tasks.workunit.client.0.smithi002.stdout:6/262: fdatasync d2/d1d/d27/d30/f36 0 2024-09-17T01:01:53.828 INFO:tasks.workunit.client.0.smithi002.stdout:6/263: fdatasync d2/f15 0 2024-09-17T01:01:53.828 INFO:tasks.workunit.client.0.smithi002.stdout:6/264: read - d2/d1d/d2d/d35/d37/f3a zero size 2024-09-17T01:01:53.829 INFO:tasks.workunit.client.0.smithi002.stdout:5/307: dwrite d2/d2d/f53 [0,4194304] 0 2024-09-17T01:01:53.829 INFO:tasks.workunit.client.0.smithi002.stdout:6/265: symlink d2/d1d/d26/l48 0 2024-09-17T01:01:53.829 INFO:tasks.workunit.client.1.smithi099.stdout:3/339: mknod d9/d15/d38/c66 0 2024-09-17T01:01:53.831 INFO:tasks.workunit.client.1.smithi099.stdout:3/340: creat d9/d3b/d44/f67 x:0 0 0 2024-09-17T01:01:53.831 INFO:tasks.workunit.client.0.smithi002.stdout:1/262: read d4/d11/d12/d30/d43/f4d [1907291,37491] 0 2024-09-17T01:01:53.832 INFO:tasks.workunit.client.0.smithi002.stdout:1/263: chown d4/d11/d12/d14/d17/d40 59577030 1 2024-09-17T01:01:53.832 INFO:tasks.workunit.client.1.smithi099.stdout:2/236: dread d2/d9/d25/d26/f33 [0,4194304] 0 2024-09-17T01:01:53.832 INFO:tasks.workunit.client.0.smithi002.stdout:5/308: truncate d2/f54 1821486 0 2024-09-17T01:01:53.832 INFO:tasks.workunit.client.0.smithi002.stdout:9/196: dread d5/fb [0,4194304] 0 2024-09-17T01:01:53.833 INFO:tasks.workunit.client.0.smithi002.stdout:6/266: mkdir d2/d1d/d26/d49 0 2024-09-17T01:01:53.833 INFO:tasks.workunit.client.1.smithi099.stdout:3/341: creat d9/d15/d18/d1a/d23/f68 x:0 0 0 2024-09-17T01:01:53.834 INFO:tasks.workunit.client.1.smithi099.stdout:3/342: creat d9/d3b/f69 x:0 0 0 2024-09-17T01:01:53.834 INFO:tasks.workunit.client.0.smithi002.stdout:1/264: link d4/d11/d12/d23/l2a d4/d11/d1c/l5f 0 2024-09-17T01:01:53.836 INFO:tasks.workunit.client.0.smithi002.stdout:6/267: truncate d2/f13 4132442 0 2024-09-17T01:01:53.838 INFO:tasks.workunit.client.0.smithi002.stdout:9/197: link d5/dc/l27 d5/l37 0 2024-09-17T01:01:53.839 INFO:tasks.workunit.client.0.smithi002.stdout:6/268: mknod d2/d1d/d2d/d35/c4a 0 2024-09-17T01:01:53.840 INFO:tasks.workunit.client.0.smithi002.stdout:1/265: rename d4/fc to d4/d11/d12/d30/d5e/f60 0 2024-09-17T01:01:53.840 INFO:tasks.workunit.client.0.smithi002.stdout:9/198: stat d5/dc/d26/c30 0 2024-09-17T01:01:53.841 INFO:tasks.workunit.client.0.smithi002.stdout:1/266: symlink d4/d11/d12/d14/d17/d56/l61 0 2024-09-17T01:01:53.843 INFO:tasks.workunit.client.0.smithi002.stdout:9/199: rename d5/dc/d26/l2b to d5/dc/l38 0 2024-09-17T01:01:53.844 INFO:tasks.workunit.client.1.smithi099.stdout:6/334: dwrite dc/f21 [4194304,4194304] 0 2024-09-17T01:01:53.844 INFO:tasks.workunit.client.1.smithi099.stdout:6/335: write dc/d2b/d3f/f47 [1237518,102139] 0 2024-09-17T01:01:53.844 INFO:tasks.workunit.client.0.smithi002.stdout:1/267: creat d4/d11/d12/d14/d17/d3b/f62 x:0 0 0 2024-09-17T01:01:53.846 INFO:tasks.workunit.client.0.smithi002.stdout:5/309: write d2/d2d/d10/d20/d24/f31 [5652030,103604] 0 2024-09-17T01:01:53.846 INFO:tasks.workunit.client.0.smithi002.stdout:9/200: rename d5/dc/ld to d5/dc/l39 0 2024-09-17T01:01:53.855 INFO:tasks.workunit.client.0.smithi002.stdout:1/268: dread d4/d11/f15 [0,4194304] 0 2024-09-17T01:01:53.856 INFO:tasks.workunit.client.1.smithi099.stdout:6/336: write dc/d2b/f2c [4369641,35318] 0 2024-09-17T01:01:53.856 INFO:tasks.workunit.client.1.smithi099.stdout:6/337: chown dc/d27/d58/f6e 110198815 1 2024-09-17T01:01:53.856 INFO:tasks.workunit.client.0.smithi002.stdout:1/269: symlink d4/d11/d12/d14/d17/d3b/l63 0 2024-09-17T01:01:53.857 INFO:tasks.workunit.client.1.smithi099.stdout:6/338: rename dc/c11 to dc/c70 0 2024-09-17T01:01:53.857 INFO:tasks.workunit.client.1.smithi099.stdout:6/339: truncate dc/d1a/d49/f5b 1316616 0 2024-09-17T01:01:53.859 INFO:tasks.workunit.client.0.smithi002.stdout:1/270: dread d4/d11/f15 [4194304,4194304] 0 2024-09-17T01:01:53.860 INFO:tasks.workunit.client.0.smithi002.stdout:1/271: creat d4/d11/d12/d23/f64 x:0 0 0 2024-09-17T01:01:53.861 INFO:tasks.workunit.client.1.smithi099.stdout:2/237: dwrite d2/d7/f40 [0,4194304] 0 2024-09-17T01:01:53.861 INFO:tasks.workunit.client.1.smithi099.stdout:2/238: getdents d2/d9/d25/d26/d1b/d2c/d3f 0 2024-09-17T01:01:53.862 INFO:tasks.workunit.client.0.smithi002.stdout:1/272: creat d4/d11/d55/f65 x:0 0 0 2024-09-17T01:01:53.862 INFO:tasks.workunit.client.0.smithi002.stdout:1/273: chown d4/d11/d12/d14/d17/d20/f5b 676369213 1 2024-09-17T01:01:53.862 INFO:tasks.workunit.client.0.smithi002.stdout:1/274: write d4/d11/d12/f4c [407583,47030] 0 2024-09-17T01:01:53.867 INFO:tasks.workunit.client.0.smithi002.stdout:9/201: dread d5/f10 [0,4194304] 0 2024-09-17T01:01:53.867 INFO:tasks.workunit.client.0.smithi002.stdout:9/202: chown d5/l6 563 1 2024-09-17T01:01:53.867 INFO:tasks.workunit.client.0.smithi002.stdout:9/203: fsync d5/f14 0 2024-09-17T01:01:53.867 INFO:tasks.workunit.client.0.smithi002.stdout:9/204: write d5/f29 [2359390,103809] 0 2024-09-17T01:01:53.867 INFO:tasks.workunit.client.0.smithi002.stdout:6/269: dwrite d2/f18 [0,4194304] 0 2024-09-17T01:01:53.869 INFO:tasks.workunit.client.0.smithi002.stdout:9/205: unlink d5/dc/f25 0 2024-09-17T01:01:53.873 INFO:tasks.workunit.client.1.smithi099.stdout:2/239: dread d2/d9/f34 [0,4194304] 0 2024-09-17T01:01:53.873 INFO:tasks.workunit.client.1.smithi099.stdout:2/240: fdatasync d2/d7/fe 0 2024-09-17T01:01:53.874 INFO:tasks.workunit.client.1.smithi099.stdout:6/340: dwrite dc/f21 [4194304,4194304] 0 2024-09-17T01:01:53.875 INFO:tasks.workunit.client.0.smithi002.stdout:6/270: getdents d2/d1d/d2d/d35 0 2024-09-17T01:01:53.875 INFO:tasks.workunit.client.0.smithi002.stdout:6/271: write d2/d1d/d2d/d35/d37/f3a [978415,4991] 0 2024-09-17T01:01:53.875 INFO:tasks.workunit.client.0.smithi002.stdout:6/272: fsync d2/dc/d34/f39 0 2024-09-17T01:01:53.875 INFO:tasks.workunit.client.1.smithi099.stdout:2/241: link d2/d7/c42 d2/d9/d25/d26/d1b/c44 0 2024-09-17T01:01:53.877 INFO:tasks.workunit.client.0.smithi002.stdout:6/273: dread d2/f19 [0,4194304] 0 2024-09-17T01:01:53.877 INFO:tasks.workunit.client.0.smithi002.stdout:6/274: readlink d2/dc/d24/l1f 0 2024-09-17T01:01:53.877 INFO:tasks.workunit.client.1.smithi099.stdout:6/341: creat dc/d1a/f71 x:0 0 0 2024-09-17T01:01:53.877 INFO:tasks.workunit.client.1.smithi099.stdout:6/342: read dc/d1a/d49/f5b [1245710,8133] 0 2024-09-17T01:01:53.878 INFO:tasks.workunit.client.1.smithi099.stdout:2/242: creat d2/d9/d25/d26/d1b/d2c/d3f/f45 x:0 0 0 2024-09-17T01:01:53.878 INFO:tasks.workunit.client.0.smithi002.stdout:6/275: mkdir d2/d4b 0 2024-09-17T01:01:53.879 INFO:tasks.workunit.client.1.smithi099.stdout:6/343: symlink dc/d27/d58/l72 0 2024-09-17T01:01:53.879 INFO:tasks.workunit.client.1.smithi099.stdout:6/344: stat dc/d27/d58/f6e 0 2024-09-17T01:01:53.880 INFO:tasks.workunit.client.0.smithi002.stdout:6/276: mkdir d2/d4b/d4c 0 2024-09-17T01:01:53.880 INFO:tasks.workunit.client.0.smithi002.stdout:7/176: sync 2024-09-17T01:01:53.880 INFO:tasks.workunit.client.0.smithi002.stdout:0/147: sync 2024-09-17T01:01:53.880 INFO:tasks.workunit.client.0.smithi002.stdout:0/148: fsync dd/d19/f1e 0 2024-09-17T01:01:53.880 INFO:tasks.workunit.client.0.smithi002.stdout:9/206: dread d5/f19 [0,4194304] 0 2024-09-17T01:01:53.881 INFO:tasks.workunit.client.0.smithi002.stdout:6/277: symlink d2/d1d/d26/d40/l4d 0 2024-09-17T01:01:53.881 INFO:tasks.workunit.client.0.smithi002.stdout:0/149: rmdir dd/d19/d1c/d1f/d22 39 2024-09-17T01:01:53.881 INFO:tasks.workunit.client.1.smithi099.stdout:2/243: getdents d2/d9/d17 0 2024-09-17T01:01:53.881 INFO:tasks.workunit.client.1.smithi099.stdout:6/345: rmdir dc/d2b 39 2024-09-17T01:01:53.881 INFO:tasks.workunit.client.1.smithi099.stdout:6/346: readlink dc/d1a/l1f 0 2024-09-17T01:01:53.883 INFO:tasks.workunit.client.0.smithi002.stdout:7/177: mkdir d1/d14/d1d/d29/d41 0 2024-09-17T01:01:53.885 INFO:tasks.workunit.client.0.smithi002.stdout:1/275: dwrite d4/d11/d55/f65 [0,4194304] 0 2024-09-17T01:01:53.885 INFO:tasks.workunit.client.0.smithi002.stdout:1/276: stat d4/d11 0 2024-09-17T01:01:53.885 INFO:tasks.workunit.client.0.smithi002.stdout:7/178: mknod d1/d14/d1d/d28/c42 0 2024-09-17T01:01:53.885 INFO:tasks.workunit.client.0.smithi002.stdout:7/179: read d1/d14/f15 [2476922,11379] 0 2024-09-17T01:01:53.888 INFO:tasks.workunit.client.0.smithi002.stdout:6/278: dread d2/d1d/d26/f2a [0,4194304] 0 2024-09-17T01:01:53.888 INFO:tasks.workunit.client.0.smithi002.stdout:9/207: dread d5/f20 [0,4194304] 0 2024-09-17T01:01:53.891 INFO:tasks.workunit.client.0.smithi002.stdout:6/279: symlink d2/l4e 0 2024-09-17T01:01:53.891 INFO:tasks.workunit.client.0.smithi002.stdout:6/280: write d2/dc/d34/f39 [835900,31870] 0 2024-09-17T01:01:53.891 INFO:tasks.workunit.client.0.smithi002.stdout:6/281: chown d2/f15 313 1 2024-09-17T01:01:53.891 INFO:tasks.workunit.client.0.smithi002.stdout:9/208: stat d5/dc/l35 0 2024-09-17T01:01:53.891 INFO:tasks.workunit.client.0.smithi002.stdout:9/209: fsync d5/dc/d26/f31 0 2024-09-17T01:01:53.891 INFO:tasks.workunit.client.0.smithi002.stdout:9/210: chown d5/dc/l17 26 1 2024-09-17T01:01:53.891 INFO:tasks.workunit.client.0.smithi002.stdout:0/150: dread dd/f14 [8388608,4194304] 0 2024-09-17T01:01:53.891 INFO:tasks.workunit.client.0.smithi002.stdout:0/151: creat dd/d19/f2c x:0 0 0 2024-09-17T01:01:53.891 INFO:tasks.workunit.client.0.smithi002.stdout:0/152: truncate dd/f18 866704 0 2024-09-17T01:01:53.892 INFO:tasks.workunit.client.0.smithi002.stdout:1/277: link d4/ff d4/d11/d1c/f66 0 2024-09-17T01:01:53.892 INFO:tasks.workunit.client.1.smithi099.stdout:6/347: dread dc/f3e [0,4194304] 0 2024-09-17T01:01:53.893 INFO:tasks.workunit.client.0.smithi002.stdout:9/211: mknod d5/dc/d26/c3a 0 2024-09-17T01:01:53.893 INFO:tasks.workunit.client.0.smithi002.stdout:9/212: write d5/dc/d26/f33 [978333,67858] 0 2024-09-17T01:01:53.893 INFO:tasks.workunit.client.0.smithi002.stdout:9/213: chown d5/l8 2416 1 2024-09-17T01:01:53.893 INFO:tasks.workunit.client.0.smithi002.stdout:9/214: creat d5/dc/d26/f3b x:0 0 0 2024-09-17T01:01:53.893 INFO:tasks.workunit.client.1.smithi099.stdout:6/348: read dc/d1a/d49/d4c/f5f [132483,99099] 0 2024-09-17T01:01:53.894 INFO:tasks.workunit.client.0.smithi002.stdout:0/153: mknod dd/d19/d1c/d1f/d22/c2d 0 2024-09-17T01:01:53.897 INFO:tasks.workunit.client.0.smithi002.stdout:0/154: truncate dd/f14 1007051 0 2024-09-17T01:01:53.898 INFO:tasks.workunit.client.0.smithi002.stdout:6/282: write d2/d1d/f25 [456964,106078] 0 2024-09-17T01:01:53.898 INFO:tasks.workunit.client.0.smithi002.stdout:6/283: creat d2/d1d/d2d/f4f x:0 0 0 2024-09-17T01:01:53.898 INFO:tasks.workunit.client.0.smithi002.stdout:0/155: link l6 dd/d19/l2e 0 2024-09-17T01:01:53.906 INFO:tasks.workunit.client.0.smithi002.stdout:6/284: read d2/f15 [2996348,39601] 0 2024-09-17T01:01:53.906 INFO:tasks.workunit.client.0.smithi002.stdout:6/285: write d2/d1d/d26/f2b [832829,73395] 0 2024-09-17T01:01:53.906 INFO:tasks.workunit.client.0.smithi002.stdout:6/286: chown d2/dc/f20 81 1 2024-09-17T01:01:53.906 INFO:tasks.workunit.client.0.smithi002.stdout:1/278: write d4/d11/d12/d14/f36 [3211181,58451] 0 2024-09-17T01:01:53.908 INFO:tasks.workunit.client.0.smithi002.stdout:6/287: getdents d2/d1d 0 2024-09-17T01:01:53.909 INFO:tasks.workunit.client.0.smithi002.stdout:9/215: write d5/f20 [5516891,110554] 0 2024-09-17T01:01:53.910 INFO:tasks.workunit.client.0.smithi002.stdout:6/288: rename d2/dc/d24/ce to d2/d4b/d4c/c50 0 2024-09-17T01:01:53.910 INFO:tasks.workunit.client.0.smithi002.stdout:6/289: chown d2/d1d/d27/d30/f36 57116 1 2024-09-17T01:01:53.911 INFO:tasks.workunit.client.0.smithi002.stdout:9/216: creat d5/dc/d26/d34/f3c x:0 0 0 2024-09-17T01:01:53.911 INFO:tasks.workunit.client.0.smithi002.stdout:9/217: write d5/f29 [2723586,126972] 0 2024-09-17T01:01:53.911 INFO:tasks.workunit.client.0.smithi002.stdout:6/290: mkdir d2/d1d/d26/d49/d51 0 2024-09-17T01:01:53.912 INFO:tasks.workunit.client.1.smithi099.stdout:2/244: dwrite d2/d9/d25/d26/d1b/d2c/f36 [0,4194304] 0 2024-09-17T01:01:53.912 INFO:tasks.workunit.client.1.smithi099.stdout:6/349: dwrite dc/d5d/f69 [0,4194304] 0 2024-09-17T01:01:53.912 INFO:tasks.workunit.client.0.smithi002.stdout:6/291: symlink d2/d1d/d2d/l52 0 2024-09-17T01:01:53.915 INFO:tasks.workunit.client.1.smithi099.stdout:2/245: mknod d2/d9/c46 0 2024-09-17T01:01:53.917 INFO:tasks.workunit.client.0.smithi002.stdout:1/279: write f3 [944764,97984] 0 2024-09-17T01:01:53.917 INFO:tasks.workunit.client.0.smithi002.stdout:1/280: fsync d4/d11/d12/d14/d17/d51/f5d 0 2024-09-17T01:01:53.917 INFO:tasks.workunit.client.0.smithi002.stdout:1/281: truncate d4/f3f 1098613 0 2024-09-17T01:01:53.917 INFO:tasks.workunit.client.0.smithi002.stdout:1/282: truncate d4/d11/d12/f38 822227 0 2024-09-17T01:01:53.917 INFO:tasks.workunit.client.0.smithi002.stdout:1/283: readlink d4/d11/d12/d23/l2a 0 2024-09-17T01:01:53.918 INFO:tasks.workunit.client.1.smithi099.stdout:2/246: creat d2/f47 x:0 0 0 2024-09-17T01:01:53.918 INFO:tasks.workunit.client.1.smithi099.stdout:2/247: creat d2/d9/d25/d26/d1b/d2c/f48 x:0 0 0 2024-09-17T01:01:53.918 INFO:tasks.workunit.client.1.smithi099.stdout:2/248: write d2/d9/d17/f21 [1768596,114753] 0 2024-09-17T01:01:53.921 INFO:tasks.workunit.client.1.smithi099.stdout:2/249: rename d2/d9/d17/c41 to d2/d9/c49 0 2024-09-17T01:01:53.924 INFO:tasks.workunit.client.0.smithi002.stdout:9/218: dread d5/f1e [0,4194304] 0 2024-09-17T01:01:53.926 INFO:tasks.workunit.client.0.smithi002.stdout:9/219: dread d5/dc/d26/f33 [0,4194304] 0 2024-09-17T01:01:53.927 INFO:tasks.workunit.client.0.smithi002.stdout:9/220: readlink d5/l1a 0 2024-09-17T01:01:53.928 INFO:tasks.workunit.client.0.smithi002.stdout:9/221: write d5/f14 [1026420,9967] 0 2024-09-17T01:01:53.931 INFO:tasks.workunit.client.1.smithi099.stdout:6/350: dwrite dc/d1a/d49/f62 [0,4194304] 0 2024-09-17T01:01:53.931 INFO:tasks.workunit.client.1.smithi099.stdout:6/351: creat dc/d1a/d49/f73 x:0 0 0 2024-09-17T01:01:53.931 INFO:tasks.workunit.client.0.smithi002.stdout:9/222: write d5/f19 [842572,97122] 0 2024-09-17T01:01:53.931 INFO:tasks.workunit.client.0.smithi002.stdout:1/284: rmdir d4/d11 39 2024-09-17T01:01:53.933 INFO:tasks.workunit.client.0.smithi002.stdout:1/285: mkdir d4/d11/d12/d30/d43/d67 0 2024-09-17T01:01:53.935 INFO:tasks.workunit.client.0.smithi002.stdout:1/286: unlink d4/d11/d12/d14/d17/c1e 0 2024-09-17T01:01:53.936 INFO:tasks.workunit.client.1.smithi099.stdout:1/349: sync 2024-09-17T01:01:53.939 INFO:tasks.workunit.client.1.smithi099.stdout:2/250: dwrite f0 [0,4194304] 0 2024-09-17T01:01:53.939 INFO:tasks.workunit.client.1.smithi099.stdout:2/251: fsync d2/f4 0 2024-09-17T01:01:53.939 INFO:tasks.workunit.client.1.smithi099.stdout:1/350: rename d0/d8/f32 to d0/d2/d61/f6e 0 2024-09-17T01:01:53.939 INFO:tasks.workunit.client.1.smithi099.stdout:1/351: write d0/d2/de/f5c [355486,128476] 0 2024-09-17T01:01:53.942 INFO:tasks.workunit.client.1.smithi099.stdout:6/352: write dc/d1a/f26 [272695,59442] 0 2024-09-17T01:01:53.942 INFO:tasks.workunit.client.1.smithi099.stdout:6/353: fdatasync dc/d1a/d49/f62 0 2024-09-17T01:01:53.949 INFO:tasks.workunit.client.0.smithi002.stdout:9/223: dwrite d5/dc/d26/f3b [0,4194304] 0 2024-09-17T01:01:53.950 INFO:tasks.workunit.client.0.smithi002.stdout:9/224: write d5/f14 [1286598,119534] 0 2024-09-17T01:01:53.951 INFO:tasks.workunit.client.0.smithi002.stdout:9/225: creat d5/dc/f3d x:0 0 0 2024-09-17T01:01:53.952 INFO:tasks.workunit.client.1.smithi099.stdout:6/354: write dc/fe [1832275,58270] 0 2024-09-17T01:01:53.953 INFO:tasks.workunit.client.1.smithi099.stdout:6/355: mkdir dc/d27/d58/d74 0 2024-09-17T01:01:53.953 INFO:tasks.workunit.client.1.smithi099.stdout:2/252: dwrite d2/d9/d25/d26/f30 [0,4194304] 0 2024-09-17T01:01:53.955 INFO:tasks.workunit.client.1.smithi099.stdout:6/356: rename dc/d1a/d49/l3d to dc/d1a/d49/l75 0 2024-09-17T01:01:53.955 INFO:tasks.workunit.client.1.smithi099.stdout:6/357: write dc/fe [3874763,104428] 0 2024-09-17T01:01:53.957 INFO:tasks.workunit.client.1.smithi099.stdout:2/253: symlink d2/d9/d25/l4a 0 2024-09-17T01:01:53.957 INFO:tasks.workunit.client.1.smithi099.stdout:6/358: creat dc/d2b/f76 x:0 0 0 2024-09-17T01:01:53.958 INFO:tasks.workunit.client.1.smithi099.stdout:6/359: chown dc/d5d/l6b 17 1 2024-09-17T01:01:53.959 INFO:tasks.workunit.client.1.smithi099.stdout:6/360: rmdir dc/d2b/d3f 39 2024-09-17T01:01:53.961 INFO:tasks.workunit.client.1.smithi099.stdout:2/254: rmdir d2/d7 39 2024-09-17T01:01:53.961 INFO:tasks.workunit.client.0.smithi002.stdout:9/226: dread d5/f1d [0,4194304] 0 2024-09-17T01:01:53.962 INFO:tasks.workunit.client.0.smithi002.stdout:9/227: readlink d5/l6 0 2024-09-17T01:01:53.962 INFO:tasks.workunit.client.0.smithi002.stdout:9/228: dread - d5/dc/d26/f31 zero size 2024-09-17T01:01:53.962 INFO:tasks.workunit.client.0.smithi002.stdout:9/229: fdatasync d5/fb 0 2024-09-17T01:01:53.962 INFO:tasks.workunit.client.1.smithi099.stdout:2/255: truncate d2/d9/d25/d26/f20 702430 0 2024-09-17T01:01:53.963 INFO:tasks.workunit.client.1.smithi099.stdout:2/256: truncate d2/d9/d25/d26/d1b/d2c/d3f/f45 682120 0 2024-09-17T01:01:53.963 INFO:tasks.workunit.client.0.smithi002.stdout:9/230: rmdir d5 39 2024-09-17T01:01:53.964 INFO:tasks.workunit.client.0.smithi002.stdout:9/231: rmdir d5/dc/d26 39 2024-09-17T01:01:53.964 INFO:tasks.workunit.client.0.smithi002.stdout:9/232: chown d5/dc/f32 9 1 2024-09-17T01:01:53.964 INFO:tasks.workunit.client.0.smithi002.stdout:9/233: chown d5/f20 28464 1 2024-09-17T01:01:53.964 INFO:tasks.workunit.client.0.smithi002.stdout:9/234: dread - d5/dc/d26/d34/f3c zero size 2024-09-17T01:01:53.966 INFO:tasks.workunit.client.1.smithi099.stdout:6/361: write dc/d1a/d49/f62 [3417914,88734] 0 2024-09-17T01:01:53.968 INFO:tasks.workunit.client.1.smithi099.stdout:2/257: creat d2/d7/f4b x:0 0 0 2024-09-17T01:01:53.968 INFO:tasks.workunit.client.1.smithi099.stdout:2/258: dread - d2/d7/f4b zero size 2024-09-17T01:01:53.968 INFO:tasks.workunit.client.1.smithi099.stdout:2/259: chown d2/d9/d25/l39 2659073 1 2024-09-17T01:01:53.971 INFO:tasks.workunit.client.1.smithi099.stdout:6/362: link dc/d2b/f2c dc/d5d/d66/f77 0 2024-09-17T01:01:53.971 INFO:tasks.workunit.client.1.smithi099.stdout:6/363: creat dc/d27/d58/f78 x:0 0 0 2024-09-17T01:01:53.972 INFO:tasks.workunit.client.1.smithi099.stdout:2/260: symlink d2/d9/d25/d26/d1b/d2c/d3f/l4c 0 2024-09-17T01:01:53.980 INFO:tasks.workunit.client.1.smithi099.stdout:2/261: dread d2/d9/d25/d26/f30 [0,4194304] 0 2024-09-17T01:01:53.981 INFO:tasks.workunit.client.1.smithi099.stdout:2/262: symlink d2/d9/l4d 0 2024-09-17T01:01:53.981 INFO:tasks.workunit.client.1.smithi099.stdout:2/263: mknod d2/c4e 0 2024-09-17T01:01:53.982 INFO:tasks.workunit.client.1.smithi099.stdout:2/264: rename d2/d7/f4b to d2/d9/d25/f4f 0 2024-09-17T01:01:53.996 INFO:tasks.workunit.client.1.smithi099.stdout:2/265: dwrite d2/d9/d25/d26/d1b/d2c/d3f/f45 [0,4194304] 0 2024-09-17T01:01:53.996 INFO:tasks.workunit.client.1.smithi099.stdout:2/266: creat d2/d9/d25/d26/f50 x:0 0 0 2024-09-17T01:01:53.997 INFO:tasks.workunit.client.0.smithi002.stdout:8/341: sync 2024-09-17T01:01:53.999 INFO:tasks.workunit.client.1.smithi099.stdout:2/267: rename d2/d9/d25/d26/f30 to d2/d9/d17/f51 0 2024-09-17T01:01:53.999 INFO:tasks.workunit.client.1.smithi099.stdout:2/268: creat d2/d9/d25/d26/d1b/d2c/f52 x:0 0 0 2024-09-17T01:01:53.999 INFO:tasks.workunit.client.1.smithi099.stdout:2/269: dread - d2/d9/d25/d26/d1b/d2c/f52 zero size 2024-09-17T01:01:53.999 INFO:tasks.workunit.client.1.smithi099.stdout:2/270: chown d2/f4 2436 1 2024-09-17T01:01:54.000 INFO:tasks.workunit.client.0.smithi002.stdout:8/342: dread d2/d26/f5c [0,4194304] 0 2024-09-17T01:01:54.002 INFO:tasks.workunit.client.0.smithi002.stdout:9/235: creat d5/f3e x:0 0 0 2024-09-17T01:01:54.002 INFO:tasks.workunit.client.0.smithi002.stdout:9/236: write d5/dc/f3d [446321,21878] 0 2024-09-17T01:01:54.002 INFO:tasks.workunit.client.0.smithi002.stdout:8/343: symlink d2/d26/d2b/d4f/l75 0 2024-09-17T01:01:54.002 INFO:tasks.workunit.client.0.smithi002.stdout:8/344: fsync d2/d9/dd/f2c 0 2024-09-17T01:01:54.003 INFO:tasks.workunit.client.1.smithi099.stdout:6/364: dread dc/f18 [0,4194304] 0 2024-09-17T01:01:54.003 INFO:tasks.workunit.client.0.smithi002.stdout:9/237: rename d5/dc/d26/f33 to d5/dc/d26/d34/f3f 0 2024-09-17T01:01:54.004 INFO:tasks.workunit.client.0.smithi002.stdout:8/345: symlink d2/d1c/l76 0 2024-09-17T01:01:54.004 INFO:tasks.workunit.client.0.smithi002.stdout:8/346: chown d2/d1c/d3b/l66 21427373 1 2024-09-17T01:01:54.004 INFO:tasks.workunit.client.0.smithi002.stdout:8/347: chown d2/d30 1715191 1 2024-09-17T01:01:54.004 INFO:tasks.workunit.client.0.smithi002.stdout:8/348: mkdir d2/d26/d2b/d4f/d77 0 2024-09-17T01:01:54.005 INFO:tasks.workunit.client.1.smithi099.stdout:2/271: write d2/d9/d17/f51 [2628285,27405] 0 2024-09-17T01:01:54.005 INFO:tasks.workunit.client.0.smithi002.stdout:9/238: mknod d5/c40 0 2024-09-17T01:01:54.008 INFO:tasks.workunit.client.1.smithi099.stdout:2/272: dread d2/d9/d25/d26/f33 [0,4194304] 0 2024-09-17T01:01:54.013 INFO:tasks.workunit.client.1.smithi099.stdout:6/365: dread f7 [0,4194304] 0 2024-09-17T01:01:54.013 INFO:tasks.workunit.client.1.smithi099.stdout:6/366: write dc/f36 [1070469,29120] 0 2024-09-17T01:01:54.013 INFO:tasks.workunit.client.1.smithi099.stdout:6/367: write dc/d1a/d49/d4c/f5f [1111910,36885] 0 2024-09-17T01:01:54.015 INFO:tasks.workunit.client.1.smithi099.stdout:6/368: rename dc/d5d/d66/f77 to dc/d1a/f79 0 2024-09-17T01:01:54.016 INFO:tasks.workunit.client.1.smithi099.stdout:6/369: mkdir dc/d5d/d66/d7a 0 2024-09-17T01:01:54.016 INFO:tasks.workunit.client.1.smithi099.stdout:6/370: chown dc/l16 214058 1 2024-09-17T01:01:54.017 INFO:tasks.workunit.client.1.smithi099.stdout:6/371: mknod dc/d2b/d3f/d60/c7b 0 2024-09-17T01:01:54.017 INFO:tasks.workunit.client.1.smithi099.stdout:6/372: readlink dc/d27/l44 0 2024-09-17T01:01:54.018 INFO:tasks.workunit.client.1.smithi099.stdout:6/373: creat dc/d5d/f7c x:0 0 0 2024-09-17T01:01:54.018 INFO:tasks.workunit.client.1.smithi099.stdout:6/374: fdatasync dc/d2b/d3f/f47 0 2024-09-17T01:01:54.019 INFO:tasks.workunit.client.0.smithi002.stdout:9/239: dread d5/f29 [0,4194304] 0 2024-09-17T01:01:54.019 INFO:tasks.workunit.client.0.smithi002.stdout:9/240: write d5/dc/d26/f2e [671691,102668] 0 2024-09-17T01:01:54.019 INFO:tasks.workunit.client.0.smithi002.stdout:9/241: mknod d5/dc/d26/c41 0 2024-09-17T01:01:54.022 INFO:tasks.workunit.client.0.smithi002.stdout:8/349: dread d2/d26/f57 [0,4194304] 0 2024-09-17T01:01:54.023 INFO:tasks.workunit.client.0.smithi002.stdout:8/350: mkdir d2/d26/d2b/d4f/d77/d78 0 2024-09-17T01:01:54.023 INFO:tasks.workunit.client.1.smithi099.stdout:2/273: dwrite d2/d9/d25/d26/d1b/d2c/d3f/f45 [0,4194304] 0 2024-09-17T01:01:54.024 INFO:tasks.workunit.client.1.smithi099.stdout:2/274: fsync d2/d9/d25/d26/d1b/d2c/f48 0 2024-09-17T01:01:54.024 INFO:tasks.workunit.client.1.smithi099.stdout:2/275: truncate d2/d9/f34 8464365 0 2024-09-17T01:01:54.024 INFO:tasks.workunit.client.1.smithi099.stdout:2/276: chown d2/d9/d25/d26/c27 3501266 1 2024-09-17T01:01:54.024 INFO:tasks.workunit.client.1.smithi099.stdout:2/277: chown d2/d9/d25/d26/f50 2539 1 2024-09-17T01:01:54.024 INFO:tasks.workunit.client.1.smithi099.stdout:2/278: creat d2/d9/d25/f53 x:0 0 0 2024-09-17T01:01:54.025 INFO:tasks.workunit.client.1.smithi099.stdout:6/375: dread f7 [0,4194304] 0 2024-09-17T01:01:54.025 INFO:tasks.workunit.client.0.smithi002.stdout:8/351: rmdir d2/d1c/d3b 39 2024-09-17T01:01:54.025 INFO:tasks.workunit.client.0.smithi002.stdout:8/352: mknod d2/d1c/d28/c79 0 2024-09-17T01:01:54.025 INFO:tasks.workunit.client.0.smithi002.stdout:8/353: creat d2/d26/d2b/d4f/d77/d78/f7a x:0 0 0 2024-09-17T01:01:54.025 INFO:tasks.workunit.client.0.smithi002.stdout:8/354: creat d2/d26/d2b/f7b x:0 0 0 2024-09-17T01:01:54.026 INFO:tasks.workunit.client.0.smithi002.stdout:8/355: write d2/d3/d5f/f46 [893920,21579] 0 2024-09-17T01:01:54.026 INFO:tasks.workunit.client.0.smithi002.stdout:8/356: stat d2/d26/f69 0 2024-09-17T01:01:54.028 INFO:tasks.workunit.client.0.smithi002.stdout:9/242: getdents d5 0 2024-09-17T01:01:54.036 INFO:tasks.workunit.client.1.smithi099.stdout:0/310: sync 2024-09-17T01:01:54.037 INFO:tasks.workunit.client.1.smithi099.stdout:7/317: sync 2024-09-17T01:01:54.037 INFO:tasks.workunit.client.1.smithi099.stdout:8/319: sync 2024-09-17T01:01:54.038 INFO:tasks.workunit.client.1.smithi099.stdout:4/329: sync 2024-09-17T01:01:54.038 INFO:tasks.workunit.client.1.smithi099.stdout:7/318: chown d1/d2c/d5c/d12/l39 1199458 1 2024-09-17T01:01:54.038 INFO:tasks.workunit.client.1.smithi099.stdout:0/311: rename da/df/d31/c5c to da/d12/d22/d53/c67 0 2024-09-17T01:01:54.039 INFO:tasks.workunit.client.1.smithi099.stdout:4/330: mkdir d7/dd/de/d17/d72 0 2024-09-17T01:01:54.040 INFO:tasks.workunit.client.0.smithi002.stdout:9/243: dread d5/f29 [0,4194304] 0 2024-09-17T01:01:54.040 INFO:tasks.workunit.client.0.smithi002.stdout:8/357: dread f0 [0,4194304] 0 2024-09-17T01:01:54.040 INFO:tasks.workunit.client.0.smithi002.stdout:8/358: fdatasync d2/d26/f69 0 2024-09-17T01:01:54.041 INFO:tasks.workunit.client.1.smithi099.stdout:8/320: rename d0/d4/f42 to d0/d1f/f62 0 2024-09-17T01:01:54.041 INFO:tasks.workunit.client.1.smithi099.stdout:0/312: dread da/df/d1a/f2d [0,4194304] 0 2024-09-17T01:01:54.042 INFO:tasks.workunit.client.1.smithi099.stdout:4/331: link d7/dd/d21/d26/f60 d7/dd/de/d10/d6b/f73 0 2024-09-17T01:01:54.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:53 smithi099 ceph-mon[34357]: pgmap v250: 65 pgs: 65 active+clean; 663 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 52 MiB/s rd, 62 MiB/s wr, 559 op/s 2024-09-17T01:01:54.043 INFO:tasks.workunit.client.1.smithi099.stdout:8/321: symlink d0/d41/d5a/l63 0 2024-09-17T01:01:54.044 INFO:tasks.workunit.client.1.smithi099.stdout:0/313: mkdir da/df/d1a/d49/d68 0 2024-09-17T01:01:54.044 INFO:tasks.workunit.client.1.smithi099.stdout:0/314: fdatasync da/d1c/d1e/f24 0 2024-09-17T01:01:54.044 INFO:tasks.workunit.client.1.smithi099.stdout:0/315: write da/df/d31/f39 [405067,98848] 0 2024-09-17T01:01:54.044 INFO:tasks.workunit.client.1.smithi099.stdout:0/316: write da/d12/f5a [547156,85804] 0 2024-09-17T01:01:54.045 INFO:tasks.workunit.client.1.smithi099.stdout:4/332: mkdir d7/dd/de/d10/d18/d74 0 2024-09-17T01:01:54.045 INFO:tasks.workunit.client.1.smithi099.stdout:0/317: symlink da/d12/d22/d52/l69 0 2024-09-17T01:01:54.045 INFO:tasks.workunit.client.1.smithi099.stdout:0/318: truncate da/d12/f62 5171537 0 2024-09-17T01:01:54.045 INFO:tasks.workunit.client.1.smithi099.stdout:4/333: creat d7/dd/de/d10/d18/d74/f75 x:0 0 0 2024-09-17T01:01:54.046 INFO:tasks.workunit.client.1.smithi099.stdout:0/319: mkdir da/df/d1a/d63/d6a 0 2024-09-17T01:01:54.046 INFO:tasks.workunit.client.1.smithi099.stdout:2/279: dwrite d2/d9/d25/d26/d1b/d2c/f48 [0,4194304] 0 2024-09-17T01:01:54.047 INFO:tasks.workunit.client.1.smithi099.stdout:2/280: fsync d2/d9/d25/f4f 0 2024-09-17T01:01:54.047 INFO:tasks.workunit.client.1.smithi099.stdout:0/320: truncate da/d1c/f3d 251884 0 2024-09-17T01:01:54.050 INFO:tasks.workunit.client.0.smithi002.stdout:8/359: write d2/f37 [971988,112339] 0 2024-09-17T01:01:54.050 INFO:tasks.workunit.client.0.smithi002.stdout:8/360: creat d2/d26/f7c x:0 0 0 2024-09-17T01:01:54.053 INFO:tasks.workunit.client.0.smithi002.stdout:9/244: fdatasync d5/dc/d26/f2e 0 2024-09-17T01:01:54.053 INFO:tasks.workunit.client.0.smithi002.stdout:9/245: chown d5/l37 102796 1 2024-09-17T01:01:54.054 INFO:tasks.workunit.client.0.smithi002.stdout:8/361: creat d2/d41/f7d x:0 0 0 2024-09-17T01:01:54.054 INFO:tasks.workunit.client.0.smithi002.stdout:8/362: write d2/d1c/d3b/f4e [216325,127996] 0 2024-09-17T01:01:54.054 INFO:tasks.workunit.client.0.smithi002.stdout:8/363: chown d2/d3/f72 18346018 1 2024-09-17T01:01:54.056 INFO:tasks.workunit.client.0.smithi002.stdout:8/364: creat d2/d1c/d3b/f7e x:0 0 0 2024-09-17T01:01:54.056 INFO:tasks.workunit.client.1.smithi099.stdout:8/322: write d0/d1f/d31/f38 [2416100,91231] 0 2024-09-17T01:01:54.057 INFO:tasks.workunit.client.1.smithi099.stdout:2/281: rmdir d2 39 2024-09-17T01:01:54.059 INFO:tasks.workunit.client.1.smithi099.stdout:4/334: dread d7/dd/d21/d26/f60 [0,4194304] 0 2024-09-17T01:01:54.059 INFO:tasks.workunit.client.1.smithi099.stdout:6/376: dwrite f7 [4194304,4194304] 0 2024-09-17T01:01:54.059 INFO:tasks.workunit.client.1.smithi099.stdout:6/377: dread - dc/d1a/f40 zero size 2024-09-17T01:01:54.060 INFO:tasks.workunit.client.0.smithi002.stdout:8/365: dread d2/d9/dd/f70 [0,4194304] 0 2024-09-17T01:01:54.060 INFO:tasks.workunit.client.0.smithi002.stdout:8/366: readlink d2/d30/l3e 0 2024-09-17T01:01:54.062 INFO:tasks.workunit.client.0.smithi002.stdout:8/367: rename d2/d3/f19 to d2/d30/f7f 0 2024-09-17T01:01:54.062 INFO:tasks.workunit.client.0.smithi002.stdout:8/368: fsync d2/d1c/d3b/f4c 0 2024-09-17T01:01:54.063 INFO:tasks.workunit.client.1.smithi099.stdout:4/335: rmdir d7/dd/d64 0 2024-09-17T01:01:54.063 INFO:tasks.workunit.client.1.smithi099.stdout:4/336: write d7/dd/d21/d26/d3f/d5b/f2c [1467800,96784] 0 2024-09-17T01:01:54.064 INFO:tasks.workunit.client.0.smithi002.stdout:8/369: mkdir d2/d3/d5f/d47/d80 0 2024-09-17T01:01:54.065 INFO:tasks.workunit.client.0.smithi002.stdout:8/370: creat d2/d1c/d28/f81 x:0 0 0 2024-09-17T01:01:54.065 INFO:tasks.workunit.client.0.smithi002.stdout:8/371: chown d2/d26/d2b/f7b 123930 1 2024-09-17T01:01:54.065 INFO:tasks.workunit.client.0.smithi002.stdout:8/372: dread - d2/d41/f7d zero size 2024-09-17T01:01:54.065 INFO:tasks.workunit.client.0.smithi002.stdout:8/373: fdatasync d2/d9/dd/f18 0 2024-09-17T01:01:54.065 INFO:tasks.workunit.client.0.smithi002.stdout:8/374: write d2/d1c/d28/f81 [1043146,124450] 0 2024-09-17T01:01:54.066 INFO:tasks.workunit.client.1.smithi099.stdout:8/323: mkdir d0/d4/d64 0 2024-09-17T01:01:54.066 INFO:tasks.workunit.client.0.smithi002.stdout:8/375: rmdir d2/d41 39 2024-09-17T01:01:54.068 INFO:tasks.workunit.client.0.smithi002.stdout:8/376: creat d2/d1c/f82 x:0 0 0 2024-09-17T01:01:54.068 INFO:tasks.workunit.client.1.smithi099.stdout:6/378: dread dc/f34 [0,4194304] 0 2024-09-17T01:01:54.069 INFO:tasks.workunit.client.1.smithi099.stdout:4/337: rename d7/dd/de/d10/c4d to d7/c76 0 2024-09-17T01:01:54.069 INFO:tasks.workunit.client.1.smithi099.stdout:4/338: creat d7/dd/d21/f77 x:0 0 0 2024-09-17T01:01:54.069 INFO:tasks.workunit.client.1.smithi099.stdout:4/339: creat d7/d35/f78 x:0 0 0 2024-09-17T01:01:54.069 INFO:tasks.workunit.client.1.smithi099.stdout:4/340: fdatasync d7/dd/d21/d26/d3f/d5b/f2d 0 2024-09-17T01:01:54.069 INFO:tasks.workunit.client.1.smithi099.stdout:4/341: dread - d7/d35/f78 zero size 2024-09-17T01:01:54.069 INFO:tasks.workunit.client.1.smithi099.stdout:4/342: readlink d7/dd/de/d10/d18/l66 0 2024-09-17T01:01:54.070 INFO:tasks.workunit.client.1.smithi099.stdout:8/324: mknod d0/d1f/d31/c65 0 2024-09-17T01:01:54.070 INFO:tasks.workunit.client.1.smithi099.stdout:8/325: chown d0/c22 3 1 2024-09-17T01:01:54.070 INFO:tasks.workunit.client.1.smithi099.stdout:8/326: stat d0/d1f/f2c 0 2024-09-17T01:01:54.070 INFO:tasks.workunit.client.1.smithi099.stdout:8/327: creat d0/d53/f66 x:0 0 0 2024-09-17T01:01:54.070 INFO:tasks.workunit.client.1.smithi099.stdout:6/379: truncate dc/d2b/d3f/f47 1159338 0 2024-09-17T01:01:54.071 INFO:tasks.workunit.client.0.smithi002.stdout:8/377: dread d2/d26/d2b/f65 [0,4194304] 0 2024-09-17T01:01:54.071 INFO:tasks.workunit.client.0.smithi002.stdout:8/378: chown d2/d26/d2b/d4f/l63 81367000 1 2024-09-17T01:01:54.072 INFO:tasks.workunit.client.0.smithi002.stdout:8/379: getdents d2/d26/d2b/d4f/d77 0 2024-09-17T01:01:54.072 INFO:tasks.workunit.client.1.smithi099.stdout:0/321: rmdir da 39 2024-09-17T01:01:54.072 INFO:tasks.workunit.client.1.smithi099.stdout:2/282: dwrite d2/d9/d25/f2d [0,4194304] 0 2024-09-17T01:01:54.072 INFO:tasks.workunit.client.1.smithi099.stdout:2/283: readlink d2/d7/l37 0 2024-09-17T01:01:54.074 INFO:tasks.workunit.client.1.smithi099.stdout:4/343: rmdir d7/dd/de/d10/d18/d4b/d69 0 2024-09-17T01:01:54.074 INFO:tasks.workunit.client.1.smithi099.stdout:4/344: write d7/dd/d21/f77 [77549,110388] 0 2024-09-17T01:01:54.075 INFO:tasks.workunit.client.1.smithi099.stdout:4/345: fdatasync d7/dd/d21/d26/f60 0 2024-09-17T01:01:54.075 INFO:tasks.workunit.client.1.smithi099.stdout:4/346: creat d7/dd/f79 x:0 0 0 2024-09-17T01:01:54.076 INFO:tasks.workunit.client.1.smithi099.stdout:8/328: rmdir d0/d4/d29/d4b 39 2024-09-17T01:01:54.078 INFO:tasks.workunit.client.1.smithi099.stdout:6/380: rename dc/d1a/f33 to dc/d27/f7d 0 2024-09-17T01:01:54.085 INFO:tasks.workunit.client.0.smithi002.stdout:2/266: sync 2024-09-17T01:01:54.086 INFO:tasks.workunit.client.0.smithi002.stdout:3/278: sync 2024-09-17T01:01:54.086 INFO:tasks.workunit.client.0.smithi002.stdout:4/303: sync 2024-09-17T01:01:54.086 INFO:tasks.workunit.client.0.smithi002.stdout:5/310: sync 2024-09-17T01:01:54.086 INFO:tasks.workunit.client.0.smithi002.stdout:4/304: chown d7/d19/f21 104 1 2024-09-17T01:01:54.086 INFO:tasks.workunit.client.0.smithi002.stdout:4/305: read d7/de/d55/f5a [616282,87574] 0 2024-09-17T01:01:54.086 INFO:tasks.workunit.client.0.smithi002.stdout:4/306: fsync d7/d19/d2e/f46 0 2024-09-17T01:01:54.086 INFO:tasks.workunit.client.1.smithi099.stdout:2/284: write d2/d9/d25/d26/f32 [4153926,9679] 0 2024-09-17T01:01:54.086 INFO:tasks.workunit.client.1.smithi099.stdout:2/285: write d2/d9/d17/f21 [991749,32736] 0 2024-09-17T01:01:54.087 INFO:tasks.workunit.client.0.smithi002.stdout:2/267: unlink d1b/d1d/d38/f3d 0 2024-09-17T01:01:54.087 INFO:tasks.workunit.client.0.smithi002.stdout:2/268: creat d1b/f5f x:0 0 0 2024-09-17T01:01:54.088 INFO:tasks.workunit.client.1.smithi099.stdout:4/347: symlink d7/d35/l7a 0 2024-09-17T01:01:54.088 INFO:tasks.workunit.client.0.smithi002.stdout:3/279: creat d0/d3/d33/d4a/f5f x:0 0 0 2024-09-17T01:01:54.088 INFO:tasks.workunit.client.0.smithi002.stdout:3/280: stat d0/d3/f3c 0 2024-09-17T01:01:54.088 INFO:tasks.workunit.client.0.smithi002.stdout:3/281: chown d0/d31/f56 1035709273 1 2024-09-17T01:01:54.089 INFO:tasks.workunit.client.1.smithi099.stdout:8/329: creat d0/d1f/d31/d4c/f67 x:0 0 0 2024-09-17T01:01:54.089 INFO:tasks.workunit.client.1.smithi099.stdout:6/381: dread dc/d1a/f1e [0,4194304] 0 2024-09-17T01:01:54.089 INFO:tasks.workunit.client.1.smithi099.stdout:6/382: getdents dc/d27/d58/d74 0 2024-09-17T01:01:54.090 INFO:tasks.workunit.client.1.smithi099.stdout:6/383: write dc/d27/f7d [43716,129626] 0 2024-09-17T01:01:54.090 INFO:tasks.workunit.client.0.smithi002.stdout:5/311: mknod d2/d2d/d10/d14/d19/d39/d25/d32/d33/c61 0 2024-09-17T01:01:54.090 INFO:tasks.workunit.client.0.smithi002.stdout:5/312: write d2/d2d/d10/d3b/f5e [987184,15277] 0 2024-09-17T01:01:54.090 INFO:tasks.workunit.client.1.smithi099.stdout:2/286: unlink d2/d9/f34 0 2024-09-17T01:01:54.091 INFO:tasks.workunit.client.1.smithi099.stdout:2/287: read - d2/d9/d25/d26/d1b/d2c/f52 zero size 2024-09-17T01:01:54.092 INFO:tasks.workunit.client.1.smithi099.stdout:8/330: rename d0/d1f/f14 to d0/d1f/f68 0 2024-09-17T01:01:54.093 INFO:tasks.workunit.client.0.smithi002.stdout:5/313: mknod d2/d2d/d10/d14/d19/d39/d51/c62 0 2024-09-17T01:01:54.093 INFO:tasks.workunit.client.0.smithi002.stdout:5/314: write d2/de/f4a [1756235,126489] 0 2024-09-17T01:01:54.093 INFO:tasks.workunit.client.0.smithi002.stdout:4/307: rmdir d7/d19/d34 39 2024-09-17T01:01:54.093 INFO:tasks.workunit.client.0.smithi002.stdout:4/308: fsync d7/d19/d2e/f39 0 2024-09-17T01:01:54.093 INFO:tasks.workunit.client.0.smithi002.stdout:4/309: write d7/d19/d2e/f39 [658784,64881] 0 2024-09-17T01:01:54.096 INFO:tasks.workunit.client.0.smithi002.stdout:5/315: rename d2/d2d/d10/d14/d19/d39/d25/d32/l5f to d2/d2d/d10/d14/d19/d39/d25/l63 0 2024-09-17T01:01:54.098 INFO:tasks.workunit.client.0.smithi002.stdout:5/316: mkdir d2/d2d/d10/d14/d19/d39/d64 0 2024-09-17T01:01:54.098 INFO:tasks.workunit.client.0.smithi002.stdout:5/317: fdatasync d2/d2d/d10/d20/f3e 0 2024-09-17T01:01:54.098 INFO:tasks.workunit.client.0.smithi002.stdout:8/380: dwrite d2/d26/d2b/d4f/d58/f60 [0,4194304] 0 2024-09-17T01:01:54.099 INFO:tasks.workunit.client.0.smithi002.stdout:5/318: write d2/d2d/d10/d14/d19/d39/f52 [218575,9503] 0 2024-09-17T01:01:54.099 INFO:tasks.workunit.client.1.smithi099.stdout:0/322: dwrite da/d1c/d1e/f38 [0,4194304] 0 2024-09-17T01:01:54.099 INFO:tasks.workunit.client.1.smithi099.stdout:0/323: write da/f1b [2716848,109642] 0 2024-09-17T01:01:54.103 INFO:tasks.workunit.client.1.smithi099.stdout:0/324: creat da/df/d20/f6b x:0 0 0 2024-09-17T01:01:54.103 INFO:tasks.workunit.client.1.smithi099.stdout:0/325: readlink da/d59/l61 0 2024-09-17T01:01:54.105 INFO:tasks.workunit.client.0.smithi002.stdout:5/319: mknod d2/d2d/d10/d23/d44/d60/c65 0 2024-09-17T01:01:54.106 INFO:tasks.workunit.client.0.smithi002.stdout:2/269: dwrite d1b/d1d/d38/f46 [0,4194304] 0 2024-09-17T01:01:54.106 INFO:tasks.workunit.client.0.smithi002.stdout:2/270: chown d1b/d37/d48/d4e/f35 52573910 1 2024-09-17T01:01:54.106 INFO:tasks.workunit.client.0.smithi002.stdout:2/271: chown fe 822778 1 2024-09-17T01:01:54.106 INFO:tasks.workunit.client.0.smithi002.stdout:3/282: dread d0/f21 [0,4194304] 0 2024-09-17T01:01:54.106 INFO:tasks.workunit.client.1.smithi099.stdout:4/348: rename d7/dd/de/d10/d18 to d7/dd/d21/d7b 0 2024-09-17T01:01:54.109 INFO:tasks.workunit.client.1.smithi099.stdout:2/288: rename d2/f4 to d2/d9/d25/d26/d1b/d2c/d3f/f54 0 2024-09-17T01:01:54.111 INFO:tasks.workunit.client.0.smithi002.stdout:2/272: getdents d1b/d3f 0 2024-09-17T01:01:54.111 INFO:tasks.workunit.client.0.smithi002.stdout:2/273: creat d1b/d37/f60 x:0 0 0 2024-09-17T01:01:54.111 INFO:tasks.workunit.client.0.smithi002.stdout:2/274: creat d1b/d1d/d38/f61 x:0 0 0 2024-09-17T01:01:54.112 INFO:tasks.workunit.client.1.smithi099.stdout:2/289: rename d2/lf to d2/d9/d25/d26/d1b/d2c/l55 0 2024-09-17T01:01:54.113 INFO:tasks.workunit.client.0.smithi002.stdout:3/283: truncate d0/f2f 3701584 0 2024-09-17T01:01:54.113 INFO:tasks.workunit.client.0.smithi002.stdout:3/284: write d0/f23 [734006,91195] 0 2024-09-17T01:01:54.113 INFO:tasks.workunit.client.0.smithi002.stdout:3/285: write d0/d3/d33/d40/f52 [121342,129598] 0 2024-09-17T01:01:54.113 INFO:tasks.workunit.client.0.smithi002.stdout:3/286: fdatasync d0/d3/d17/f29 0 2024-09-17T01:01:54.113 INFO:tasks.workunit.client.0.smithi002.stdout:3/287: dread - d0/d3/f3c zero size 2024-09-17T01:01:54.114 INFO:tasks.workunit.client.1.smithi099.stdout:2/290: symlink d2/d9/d25/d26/d1b/d2c/d3f/l56 0 2024-09-17T01:01:54.115 INFO:tasks.workunit.client.0.smithi002.stdout:8/381: write d2/d9/dd/f18 [1749920,79168] 0 2024-09-17T01:01:54.116 INFO:tasks.workunit.client.0.smithi002.stdout:3/288: mknod d0/d3/d17/d35/c60 0 2024-09-17T01:01:54.116 INFO:tasks.workunit.client.1.smithi099.stdout:2/291: rename d2/d9/d25/d26/d1b/d2c/c38 to d2/d9/d17/c57 0 2024-09-17T01:01:54.117 INFO:tasks.workunit.client.0.smithi002.stdout:2/275: truncate f5 2955539 0 2024-09-17T01:01:54.117 INFO:tasks.workunit.client.0.smithi002.stdout:2/276: creat d1b/d37/f62 x:0 0 0 2024-09-17T01:01:54.117 INFO:tasks.workunit.client.1.smithi099.stdout:2/292: rmdir d2/d7 39 2024-09-17T01:01:54.118 INFO:tasks.workunit.client.0.smithi002.stdout:8/382: mknod d2/d3/d5f/c83 0 2024-09-17T01:01:54.119 INFO:tasks.workunit.client.0.smithi002.stdout:3/289: creat d0/f61 x:0 0 0 2024-09-17T01:01:54.119 INFO:tasks.workunit.client.0.smithi002.stdout:3/290: dread - d0/d3/d37/f51 zero size 2024-09-17T01:01:54.119 INFO:tasks.workunit.client.1.smithi099.stdout:2/293: rmdir d2/d7 39 2024-09-17T01:01:54.120 INFO:tasks.workunit.client.0.smithi002.stdout:4/310: dwrite d7/d3f/d48/f26 [0,4194304] 0 2024-09-17T01:01:54.120 INFO:tasks.workunit.client.0.smithi002.stdout:4/311: chown d7/de/f2a 6317 1 2024-09-17T01:01:54.120 INFO:tasks.workunit.client.0.smithi002.stdout:4/312: dread - d7/de/d32/f53 zero size 2024-09-17T01:01:54.120 INFO:tasks.workunit.client.0.smithi002.stdout:4/313: dread - d7/de/d23/f50 zero size 2024-09-17T01:01:54.120 INFO:tasks.workunit.client.0.smithi002.stdout:4/314: write d7/d19/d34/f58 [187775,97031] 0 2024-09-17T01:01:54.121 INFO:tasks.workunit.client.0.smithi002.stdout:2/277: readlink l14 0 2024-09-17T01:01:54.121 INFO:tasks.workunit.client.0.smithi002.stdout:2/278: stat d1b/l2b 0 2024-09-17T01:01:54.121 INFO:tasks.workunit.client.1.smithi099.stdout:6/384: dwrite dc/d1a/d49/d4c/f6d [4194304,4194304] 0 2024-09-17T01:01:54.121 INFO:tasks.workunit.client.1.smithi099.stdout:6/385: read - dc/d1a/d49/f73 zero size 2024-09-17T01:01:54.122 INFO:tasks.workunit.client.1.smithi099.stdout:2/294: mkdir d2/d9/d17/d58 0 2024-09-17T01:01:54.124 INFO:tasks.workunit.client.0.smithi002.stdout:8/383: symlink d2/d26/d2b/d4f/d77/l84 0 2024-09-17T01:01:54.124 INFO:tasks.workunit.client.0.smithi002.stdout:8/384: fsync d2/d3/f1b 0 2024-09-17T01:01:54.124 INFO:tasks.workunit.client.0.smithi002.stdout:3/291: creat d0/f62 x:0 0 0 2024-09-17T01:01:54.125 INFO:tasks.workunit.client.0.smithi002.stdout:4/315: symlink d7/de/d23/l5b 0 2024-09-17T01:01:54.125 INFO:tasks.workunit.client.0.smithi002.stdout:2/279: truncate d1b/d1d/f1f 851401 0 2024-09-17T01:01:54.126 INFO:tasks.workunit.client.1.smithi099.stdout:6/386: unlink dc/d1a/c3c 0 2024-09-17T01:01:54.126 INFO:tasks.workunit.client.1.smithi099.stdout:6/387: chown dc/d2b/d3f/c63 1265 1 2024-09-17T01:01:54.126 INFO:tasks.workunit.client.1.smithi099.stdout:6/388: mkdir dc/d27/d7e 0 2024-09-17T01:01:54.126 INFO:tasks.workunit.client.1.smithi099.stdout:6/389: truncate dc/f36 1528056 0 2024-09-17T01:01:54.126 INFO:tasks.workunit.client.1.smithi099.stdout:2/295: dread d2/f1c [0,4194304] 0 2024-09-17T01:01:54.126 INFO:tasks.workunit.client.0.smithi002.stdout:4/316: rename d7/d3f/d48/f26 to d7/de/f5c 0 2024-09-17T01:01:54.129 INFO:tasks.workunit.client.1.smithi099.stdout:2/296: symlink d2/d9/d25/d26/d1b/l59 0 2024-09-17T01:01:54.129 INFO:tasks.workunit.client.0.smithi002.stdout:2/280: getdents d1b/d3f/d59 0 2024-09-17T01:01:54.130 INFO:tasks.workunit.client.0.smithi002.stdout:8/385: mknod d2/d9/c85 0 2024-09-17T01:01:54.132 INFO:tasks.workunit.client.0.smithi002.stdout:2/281: rename d1b/f56 to d1b/d3f/d59/f63 0 2024-09-17T01:01:54.133 INFO:tasks.workunit.client.0.smithi002.stdout:2/282: link ff d1b/d37/d48/f64 0 2024-09-17T01:01:54.133 INFO:tasks.workunit.client.1.smithi099.stdout:6/390: dread dc/d1a/d49/f62 [0,4194304] 0 2024-09-17T01:01:54.134 INFO:tasks.workunit.client.1.smithi099.stdout:6/391: creat dc/d1a/d49/f7f x:0 0 0 2024-09-17T01:01:54.136 INFO:tasks.workunit.client.1.smithi099.stdout:6/392: symlink dc/d5d/l80 0 2024-09-17T01:01:54.136 INFO:tasks.workunit.client.1.smithi099.stdout:6/393: chown dc/ld 28 1 2024-09-17T01:01:54.136 INFO:tasks.workunit.client.1.smithi099.stdout:6/394: truncate dc/f3e 2130990 0 2024-09-17T01:01:54.138 INFO:tasks.workunit.client.0.smithi002.stdout:8/386: read d2/d9/f38 [3264571,100154] 0 2024-09-17T01:01:54.138 INFO:tasks.workunit.client.1.smithi099.stdout:6/395: creat dc/d27/f81 x:0 0 0 2024-09-17T01:01:54.139 INFO:tasks.workunit.client.0.smithi002.stdout:8/387: getdents d2/d26/d2b/d4f/d58 0 2024-09-17T01:01:54.140 INFO:tasks.workunit.client.1.smithi099.stdout:6/396: mkdir dc/d1a/d82 0 2024-09-17T01:01:54.140 INFO:tasks.workunit.client.1.smithi099.stdout:6/397: write dc/f36 [1285,32538] 0 2024-09-17T01:01:54.140 INFO:tasks.workunit.client.1.smithi099.stdout:6/398: chown dc/l43 1000 0 2024-09-17T01:01:54.140 INFO:tasks.workunit.client.1.smithi099.stdout:6/399: chown dc/d27/l52 25 1 2024-09-17T01:01:54.140 INFO:tasks.workunit.client.1.smithi099.stdout:6/400: write dc/d27/f7d [286256,57925] 0 2024-09-17T01:01:54.140 INFO:tasks.workunit.client.1.smithi099.stdout:6/401: write dc/d27/d58/f78 [559015,104013] 0 2024-09-17T01:01:54.140 INFO:tasks.workunit.client.1.smithi099.stdout:6/402: write dc/d27/f7d [1266854,108733] 0 2024-09-17T01:01:54.140 INFO:tasks.workunit.client.1.smithi099.stdout:4/349: dwrite d7/dd/de/d17/f25 [4194304,4194304] 0 2024-09-17T01:01:54.141 INFO:tasks.workunit.client.0.smithi002.stdout:8/388: rename d2/d26/c4b to d2/d1c/c86 0 2024-09-17T01:01:54.141 INFO:tasks.workunit.client.0.smithi002.stdout:8/389: truncate d2/d3/f72 403202 0 2024-09-17T01:01:54.141 INFO:tasks.workunit.client.0.smithi002.stdout:8/390: write d2/d1c/d3b/f4e [365006,16117] 0 2024-09-17T01:01:54.141 INFO:tasks.workunit.client.1.smithi099.stdout:4/350: creat d7/dd/d21/d7b/d74/f7c x:0 0 0 2024-09-17T01:01:54.153 INFO:tasks.workunit.client.0.smithi002.stdout:5/320: dwrite d2/d2d/d10/d14/d19/d39/f35 [0,4194304] 0 2024-09-17T01:01:54.154 INFO:tasks.workunit.client.1.smithi099.stdout:8/331: dwrite d0/d1f/f68 [0,4194304] 0 2024-09-17T01:01:54.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:53 smithi002 ceph-mon[27650]: pgmap v250: 65 pgs: 65 active+clean; 663 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 52 MiB/s rd, 62 MiB/s wr, 559 op/s 2024-09-17T01:01:54.155 INFO:tasks.workunit.client.1.smithi099.stdout:0/326: dwrite f8 [4194304,4194304] 0 2024-09-17T01:01:54.155 INFO:tasks.workunit.client.1.smithi099.stdout:0/327: read da/df/f41 [152774,129567] 0 2024-09-17T01:01:54.155 INFO:tasks.workunit.client.1.smithi099.stdout:0/328: write da/df/d1a/d49/f51 [1225371,5023] 0 2024-09-17T01:01:54.161 INFO:tasks.workunit.client.1.smithi099.stdout:8/332: symlink d0/d1f/d55/l69 0 2024-09-17T01:01:54.161 INFO:tasks.workunit.client.1.smithi099.stdout:8/333: stat d0/d41/l52 0 2024-09-17T01:01:54.162 INFO:tasks.workunit.client.1.smithi099.stdout:8/334: symlink d0/d1f/l6a 0 2024-09-17T01:01:54.164 INFO:tasks.workunit.client.1.smithi099.stdout:2/297: dwrite d2/d9/d25/d26/f29 [0,4194304] 0 2024-09-17T01:01:54.164 INFO:tasks.workunit.client.1.smithi099.stdout:9/349: sync 2024-09-17T01:01:54.164 INFO:tasks.workunit.client.1.smithi099.stdout:5/409: sync 2024-09-17T01:01:54.165 INFO:tasks.workunit.client.1.smithi099.stdout:2/298: mknod d2/c5a 0 2024-09-17T01:01:54.165 INFO:tasks.workunit.client.1.smithi099.stdout:0/329: dread da/f27 [0,4194304] 0 2024-09-17T01:01:54.167 INFO:tasks.workunit.client.0.smithi002.stdout:8/391: dwrite d2/d41/f7d [0,4194304] 0 2024-09-17T01:01:54.167 INFO:tasks.workunit.client.0.smithi002.stdout:8/392: creat d2/d26/d2b/d4f/d77/d78/f87 x:0 0 0 2024-09-17T01:01:54.167 INFO:tasks.workunit.client.0.smithi002.stdout:8/393: dread - d2/d26/f69 zero size 2024-09-17T01:01:54.171 INFO:tasks.workunit.client.0.smithi002.stdout:2/283: getdents d1b 0 2024-09-17T01:01:54.173 INFO:tasks.workunit.client.1.smithi099.stdout:6/403: dwrite dc/f21 [4194304,4194304] 0 2024-09-17T01:01:54.174 INFO:tasks.workunit.client.1.smithi099.stdout:3/343: sync 2024-09-17T01:01:54.174 INFO:tasks.workunit.client.1.smithi099.stdout:3/344: chown d9/d15/d18/d1a/d23/l1e 832 1 2024-09-17T01:01:54.174 INFO:tasks.workunit.client.1.smithi099.stdout:3/345: stat d9/d15/d18/l26 0 2024-09-17T01:01:54.174 INFO:tasks.workunit.client.1.smithi099.stdout:3/346: chown d9/d15/d18/d1a/d23/l13 969161451 1 2024-09-17T01:01:54.174 INFO:tasks.workunit.client.1.smithi099.stdout:3/347: fdatasync d9/d15/f63 0 2024-09-17T01:01:54.174 INFO:tasks.workunit.client.1.smithi099.stdout:3/348: chown d9/d15/d18/d1a/d23/c28 60188040 1 2024-09-17T01:01:54.174 INFO:tasks.workunit.client.1.smithi099.stdout:3/349: chown d9/d15/d18/d1a/d23/f43 3913623 1 2024-09-17T01:01:54.175 INFO:tasks.workunit.client.1.smithi099.stdout:6/404: symlink dc/d27/d7e/l83 0 2024-09-17T01:01:54.177 INFO:tasks.workunit.client.0.smithi002.stdout:3/292: dwrite d0/d3/d33/d40/f52 [0,4194304] 0 2024-09-17T01:01:54.177 INFO:tasks.workunit.client.1.smithi099.stdout:4/351: dwrite f1 [0,4194304] 0 2024-09-17T01:01:54.177 INFO:tasks.workunit.client.1.smithi099.stdout:3/350: symlink d9/l6a 0 2024-09-17T01:01:54.177 INFO:tasks.workunit.client.1.smithi099.stdout:3/351: readlink d9/d15/d38/l3a 0 2024-09-17T01:01:54.178 INFO:tasks.workunit.client.1.smithi099.stdout:6/405: symlink dc/d27/d7e/l84 0 2024-09-17T01:01:54.178 INFO:tasks.workunit.client.1.smithi099.stdout:6/406: chown dc/d27/d58/f6e 4 1 2024-09-17T01:01:54.178 INFO:tasks.workunit.client.1.smithi099.stdout:6/407: chown dc/d1a/d49/d4c/f5f 73692059 1 2024-09-17T01:01:54.178 INFO:tasks.workunit.client.1.smithi099.stdout:6/408: dread - dc/d1a/f71 zero size 2024-09-17T01:01:54.179 INFO:tasks.workunit.client.1.smithi099.stdout:2/299: dread f0 [0,4194304] 0 2024-09-17T01:01:54.180 INFO:tasks.workunit.client.0.smithi002.stdout:8/394: write d2/d9/dd/f2c [1957979,80766] 0 2024-09-17T01:01:54.180 INFO:tasks.workunit.client.0.smithi002.stdout:8/395: creat d2/d26/d2b/d4f/d77/d78/f88 x:0 0 0 2024-09-17T01:01:54.180 INFO:tasks.workunit.client.0.smithi002.stdout:8/396: fsync d2/d1c/d3b/f4c 0 2024-09-17T01:01:54.180 INFO:tasks.workunit.client.1.smithi099.stdout:4/352: mknod d7/dd/de/d10/d3a/c7d 0 2024-09-17T01:01:54.181 INFO:tasks.workunit.client.1.smithi099.stdout:3/352: mkdir d9/d2b/d6b 0 2024-09-17T01:01:54.182 INFO:tasks.workunit.client.1.smithi099.stdout:3/353: readlink d9/l6a 0 2024-09-17T01:01:54.182 INFO:tasks.workunit.client.1.smithi099.stdout:6/409: write dc/d2b/f4b [300493,79915] 0 2024-09-17T01:01:54.182 INFO:tasks.workunit.client.0.smithi002.stdout:2/284: mknod d1b/d37/d48/c65 0 2024-09-17T01:01:54.183 INFO:tasks.workunit.client.1.smithi099.stdout:0/330: write da/df/d1a/d49/f51 [939601,39975] 0 2024-09-17T01:01:54.183 INFO:tasks.workunit.client.1.smithi099.stdout:0/331: chown da/df/d1a/d23 3647818 1 2024-09-17T01:01:54.185 INFO:tasks.workunit.client.1.smithi099.stdout:2/300: link d2/d9/d25/d26/d1b/d2c/d3f/f45 d2/d9/d25/d26/f5b 0 2024-09-17T01:01:54.185 INFO:tasks.workunit.client.0.smithi002.stdout:2/285: mknod d1b/d37/d48/c66 0 2024-09-17T01:01:54.186 INFO:tasks.workunit.client.1.smithi099.stdout:4/353: mknod d7/dd/de/d10/c7e 0 2024-09-17T01:01:54.188 INFO:tasks.workunit.client.0.smithi002.stdout:7/180: sync 2024-09-17T01:01:54.188 INFO:tasks.workunit.client.0.smithi002.stdout:0/156: sync 2024-09-17T01:01:54.189 INFO:tasks.workunit.client.1.smithi099.stdout:0/332: symlink da/d3b/l6c 0 2024-09-17T01:01:54.189 INFO:tasks.workunit.client.1.smithi099.stdout:2/301: rmdir d2/d9/d25/d26/d1b/d2c 39 2024-09-17T01:01:54.190 INFO:tasks.workunit.client.0.smithi002.stdout:2/286: read f13 [168795,50946] 0 2024-09-17T01:01:54.190 INFO:tasks.workunit.client.0.smithi002.stdout:2/287: chown d1b/d37 181052 1 2024-09-17T01:01:54.190 INFO:tasks.workunit.client.0.smithi002.stdout:7/181: creat d1/d14/d1d/d29/d41/f43 x:0 0 0 2024-09-17T01:01:54.190 INFO:tasks.workunit.client.0.smithi002.stdout:2/288: read - d1b/d1d/f47 zero size 2024-09-17T01:01:54.190 INFO:tasks.workunit.client.0.smithi002.stdout:7/182: fsync d1/f20 0 2024-09-17T01:01:54.190 INFO:tasks.workunit.client.0.smithi002.stdout:2/289: readlink d1b/d37/d48/d52/l57 0 2024-09-17T01:01:54.190 INFO:tasks.workunit.client.0.smithi002.stdout:0/157: symlink dd/d19/d1c/d1f/d22/l2f 0 2024-09-17T01:01:54.191 INFO:tasks.workunit.client.0.smithi002.stdout:7/183: truncate d1/f5 1450407 0 2024-09-17T01:01:54.192 INFO:tasks.workunit.client.1.smithi099.stdout:0/333: rename da/df/d20/f6b to da/d12/d22/d66/f6d 0 2024-09-17T01:01:54.192 INFO:tasks.workunit.client.1.smithi099.stdout:0/334: readlink da/df/d31/l43 0 2024-09-17T01:01:54.193 INFO:tasks.workunit.client.1.smithi099.stdout:0/335: fsync da/f5d 0 2024-09-17T01:01:54.193 INFO:tasks.workunit.client.0.smithi002.stdout:2/290: creat d1b/f67 x:0 0 0 2024-09-17T01:01:54.194 INFO:tasks.workunit.client.1.smithi099.stdout:2/302: symlink d2/l5c 0 2024-09-17T01:01:54.194 INFO:tasks.workunit.client.0.smithi002.stdout:0/158: mknod dd/d19/d1c/c30 0 2024-09-17T01:01:54.195 INFO:tasks.workunit.client.0.smithi002.stdout:2/291: getdents d1b/d3f/d59 0 2024-09-17T01:01:54.195 INFO:tasks.workunit.client.0.smithi002.stdout:2/292: dread - d1b/f26 zero size 2024-09-17T01:01:54.195 INFO:tasks.workunit.client.0.smithi002.stdout:2/293: stat d1b/f5f 0 2024-09-17T01:01:54.195 INFO:tasks.workunit.client.0.smithi002.stdout:2/294: creat d1b/f68 x:0 0 0 2024-09-17T01:01:54.195 INFO:tasks.workunit.client.0.smithi002.stdout:2/295: dread - d1b/f29 zero size 2024-09-17T01:01:54.196 INFO:tasks.workunit.client.0.smithi002.stdout:7/184: dread d1/d14/d1d/d29/f2f [0,4194304] 0 2024-09-17T01:01:54.196 INFO:tasks.workunit.client.1.smithi099.stdout:2/303: mkdir d2/d9/d25/d26/d1b/d2c/d5d 0 2024-09-17T01:01:54.196 INFO:tasks.workunit.client.1.smithi099.stdout:2/304: truncate d2/d7/fe 541092 0 2024-09-17T01:01:54.196 INFO:tasks.workunit.client.1.smithi099.stdout:2/305: chown d2/d9/d25/d26/d1b/d2c/d3f/f54 174041 1 2024-09-17T01:01:54.197 INFO:tasks.workunit.client.1.smithi099.stdout:2/306: rename d2/c2a to d2/d9/d25/d26/d1b/d2c/d5d/c5e 0 2024-09-17T01:01:54.197 INFO:tasks.workunit.client.1.smithi099.stdout:2/307: mknod d2/d9/d17/d58/c5f 0 2024-09-17T01:01:54.198 INFO:tasks.workunit.client.1.smithi099.stdout:2/308: rmdir d2/d9/d25 39 2024-09-17T01:01:54.198 INFO:tasks.workunit.client.1.smithi099.stdout:2/309: creat d2/d9/f60 x:0 0 0 2024-09-17T01:01:54.199 INFO:tasks.workunit.client.0.smithi002.stdout:0/159: rename dd/c17 to dd/c31 0 2024-09-17T01:01:54.199 INFO:tasks.workunit.client.0.smithi002.stdout:0/160: creat dd/f32 x:0 0 0 2024-09-17T01:01:54.199 INFO:tasks.workunit.client.0.smithi002.stdout:0/161: stat c3 0 2024-09-17T01:01:54.199 INFO:tasks.workunit.client.0.smithi002.stdout:0/162: fsync dd/f13 0 2024-09-17T01:01:54.200 INFO:tasks.workunit.client.0.smithi002.stdout:0/163: write dd/f15 [760169,52115] 0 2024-09-17T01:01:54.201 INFO:tasks.workunit.client.0.smithi002.stdout:2/296: rename d1b/f1e to d1b/d37/d48/d4e/f69 0 2024-09-17T01:01:54.202 INFO:tasks.workunit.client.1.smithi099.stdout:4/354: write d7/dd/d21/d26/f32 [3469454,64855] 0 2024-09-17T01:01:54.202 INFO:tasks.workunit.client.1.smithi099.stdout:8/335: dwrite d0/f47 [0,4194304] 0 2024-09-17T01:01:54.202 INFO:tasks.workunit.client.1.smithi099.stdout:9/350: dwrite f6 [0,4194304] 0 2024-09-17T01:01:54.203 INFO:tasks.workunit.client.0.smithi002.stdout:7/185: symlink d1/d14/d1d/d29/d41/l44 0 2024-09-17T01:01:54.203 INFO:tasks.workunit.client.1.smithi099.stdout:4/355: symlink d7/dd/d21/d7b/d74/l7f 0 2024-09-17T01:01:54.204 INFO:tasks.workunit.client.1.smithi099.stdout:5/410: dwrite d2/dc/d17/f3a [0,4194304] 0 2024-09-17T01:01:54.204 INFO:tasks.workunit.client.0.smithi002.stdout:2/297: dread d1b/d37/f42 [0,4194304] 0 2024-09-17T01:01:54.204 INFO:tasks.workunit.client.0.smithi002.stdout:2/298: readlink d1b/l25 0 2024-09-17T01:01:54.204 INFO:tasks.workunit.client.0.smithi002.stdout:2/299: creat d1b/d37/f6a x:0 0 0 2024-09-17T01:01:54.205 INFO:tasks.workunit.client.1.smithi099.stdout:8/336: symlink d0/d4/d29/l6b 0 2024-09-17T01:01:54.205 INFO:tasks.workunit.client.1.smithi099.stdout:4/356: truncate d7/dd/d21/d7b/d4b/f34 1992354 0 2024-09-17T01:01:54.205 INFO:tasks.workunit.client.1.smithi099.stdout:8/337: write d0/d1f/f2c [2545983,62401] 0 2024-09-17T01:01:54.206 INFO:tasks.workunit.client.1.smithi099.stdout:4/357: truncate d7/f8 1277431 0 2024-09-17T01:01:54.207 INFO:tasks.workunit.client.1.smithi099.stdout:4/358: mkdir d7/d35/d80 0 2024-09-17T01:01:54.208 INFO:tasks.workunit.client.1.smithi099.stdout:8/338: link d0/d4/d29/d4b/f4e d0/d4/f6c 0 2024-09-17T01:01:54.209 INFO:tasks.workunit.client.1.smithi099.stdout:8/339: mknod d0/d41/c6d 0 2024-09-17T01:01:54.210 INFO:tasks.workunit.client.1.smithi099.stdout:8/340: mknod d0/c6e 0 2024-09-17T01:01:54.210 INFO:tasks.workunit.client.1.smithi099.stdout:8/341: creat d0/d1f/d31/d4c/f6f x:0 0 0 2024-09-17T01:01:54.210 INFO:tasks.workunit.client.1.smithi099.stdout:8/342: readlink d0/l32 0 2024-09-17T01:01:54.214 INFO:tasks.workunit.client.1.smithi099.stdout:9/351: dread da/d14/d40/f65 [0,4194304] 0 2024-09-17T01:01:54.214 INFO:tasks.workunit.client.1.smithi099.stdout:9/352: creat da/d18/d49/f7c x:0 0 0 2024-09-17T01:01:54.215 INFO:tasks.workunit.client.0.smithi002.stdout:3/293: dwrite d0/fd [0,4194304] 0 2024-09-17T01:01:54.217 INFO:tasks.workunit.client.0.smithi002.stdout:7/186: dread d1/f20 [0,4194304] 0 2024-09-17T01:01:54.219 INFO:tasks.workunit.client.0.smithi002.stdout:0/164: dwrite dd/f13 [8388608,4194304] 0 2024-09-17T01:01:54.220 INFO:tasks.workunit.client.0.smithi002.stdout:0/165: mkdir dd/d19/d1c/d33 0 2024-09-17T01:01:54.220 INFO:tasks.workunit.client.0.smithi002.stdout:0/166: creat dd/d19/f34 x:0 0 0 2024-09-17T01:01:54.338 INFO:tasks.workunit.client.1.smithi099.stdout:0/336: dread da/d12/f18 [0,4194304] 0 2024-09-17T01:01:54.338 INFO:tasks.workunit.client.1.smithi099.stdout:9/353: read da/d18/d5e/f67 [23630,46451] 0 2024-09-17T01:01:54.338 INFO:tasks.workunit.client.1.smithi099.stdout:9/354: chown da/d18/d49 0 1 2024-09-17T01:01:54.338 INFO:tasks.workunit.client.1.smithi099.stdout:9/355: readlink l3 0 2024-09-17T01:01:54.340 INFO:tasks.workunit.client.0.smithi002.stdout:8/397: dwrite d2/d26/d2b/f36 [0,4194304] 0 2024-09-17T01:01:54.341 INFO:tasks.workunit.client.1.smithi099.stdout:0/337: creat da/df/d1a/d63/d6a/f6e x:0 0 0 2024-09-17T01:01:54.341 INFO:tasks.workunit.client.1.smithi099.stdout:8/343: dread d0/d4/d29/d4b/f5c [0,4194304] 0 2024-09-17T01:01:54.341 INFO:tasks.workunit.client.1.smithi099.stdout:9/356: rename da/d14/d40/c75 to da/d56/c7d 0 2024-09-17T01:01:54.342 INFO:tasks.workunit.client.0.smithi002.stdout:8/398: unlink d2/d26/d2b/d4f/c5d 0 2024-09-17T01:01:54.342 INFO:tasks.workunit.client.0.smithi002.stdout:8/399: stat d2/d26/d2b/d4f/c53 0 2024-09-17T01:01:54.343 INFO:tasks.workunit.client.1.smithi099.stdout:3/354: dwrite d9/d15/f63 [0,4194304] 0 2024-09-17T01:01:54.343 INFO:tasks.workunit.client.1.smithi099.stdout:3/355: dread - d9/d3b/d44/d57/f5a zero size 2024-09-17T01:01:54.343 INFO:tasks.workunit.client.1.smithi099.stdout:3/356: chown d9/d3b/d44 54298687 1 2024-09-17T01:01:54.344 INFO:tasks.workunit.client.1.smithi099.stdout:9/357: link f6 da/d18/f7e 0 2024-09-17T01:01:54.344 INFO:tasks.workunit.client.1.smithi099.stdout:9/358: chown da/d1b/d3a/l74 8039218 1 2024-09-17T01:01:54.344 INFO:tasks.workunit.client.1.smithi099.stdout:9/359: fsync da/d14/d40/f65 0 2024-09-17T01:01:54.344 INFO:tasks.workunit.client.0.smithi002.stdout:8/400: mkdir d2/d26/d2b/d71/d89 0 2024-09-17T01:01:54.345 INFO:tasks.workunit.client.0.smithi002.stdout:8/401: link d2/d41/f54 d2/d26/d2b/d4f/d77/f8a 0 2024-09-17T01:01:54.345 INFO:tasks.workunit.client.0.smithi002.stdout:8/402: write d2/d1c/d28/f55 [955392,20800] 0 2024-09-17T01:01:54.345 INFO:tasks.workunit.client.0.smithi002.stdout:8/403: fsync d2/d3/d5f/d47/f62 0 2024-09-17T01:01:54.346 INFO:tasks.workunit.client.0.smithi002.stdout:8/404: mkdir d2/d30/d8b 0 2024-09-17T01:01:54.352 INFO:tasks.workunit.client.1.smithi099.stdout:3/357: link d9/cb d9/c6c 0 2024-09-17T01:01:54.352 INFO:tasks.workunit.client.1.smithi099.stdout:3/358: dread - d9/d15/d18/d1a/d23/f43 zero size 2024-09-17T01:01:54.353 INFO:tasks.workunit.client.0.smithi002.stdout:7/187: rename d1/d14/d1d/d29/d41 to d1/d14/d1d/d21/d45 0 2024-09-17T01:01:54.353 INFO:tasks.workunit.client.0.smithi002.stdout:7/188: write d1/d14/f15 [5169923,6252] 0 2024-09-17T01:01:54.353 INFO:tasks.workunit.client.0.smithi002.stdout:7/189: stat d1/d14/d1d/d29/l36 0 2024-09-17T01:01:54.355 INFO:tasks.workunit.client.0.smithi002.stdout:0/167: rename dd/d19/d1c/d1f/c26 to dd/d19/d1a/c35 0 2024-09-17T01:01:54.356 INFO:tasks.workunit.client.1.smithi099.stdout:8/344: read d0/d1f/d31/d4c/f5d [1116308,40816] 0 2024-09-17T01:01:54.356 INFO:tasks.workunit.client.1.smithi099.stdout:8/345: creat d0/d1f/d31/d4c/f70 x:0 0 0 2024-09-17T01:01:54.357 INFO:tasks.workunit.client.0.smithi002.stdout:2/300: rmdir d1b 39 2024-09-17T01:01:54.359 INFO:tasks.workunit.client.1.smithi099.stdout:8/346: symlink d0/d4/l71 0 2024-09-17T01:01:54.360 INFO:tasks.workunit.client.1.smithi099.stdout:9/360: dread da/d14/f29 [0,4194304] 0 2024-09-17T01:01:54.360 INFO:tasks.workunit.client.1.smithi099.stdout:8/347: symlink d0/d1f/d31/d4c/l72 0 2024-09-17T01:01:54.360 INFO:tasks.workunit.client.1.smithi099.stdout:8/348: creat d0/d4/d29/f73 x:0 0 0 2024-09-17T01:01:54.360 INFO:tasks.workunit.client.1.smithi099.stdout:8/349: fdatasync d0/f1d 0 2024-09-17T01:01:54.367 INFO:tasks.workunit.client.1.smithi099.stdout:0/338: dwrite da/d3b/f5b [0,4194304] 0 2024-09-17T01:01:54.371 INFO:tasks.workunit.client.0.smithi002.stdout:3/294: dwrite d0/d3/d33/d40/f52 [0,4194304] 0 2024-09-17T01:01:54.371 INFO:tasks.workunit.client.0.smithi002.stdout:3/295: getdents d0/d3/d37/d5a/d5b 0 2024-09-17T01:01:54.371 INFO:tasks.workunit.client.0.smithi002.stdout:3/296: creat d0/d3/d33/d40/f63 x:0 0 0 2024-09-17T01:01:54.372 INFO:tasks.workunit.client.1.smithi099.stdout:9/361: write da/d14/d40/d6f/f71 [1414237,74147] 0 2024-09-17T01:01:54.372 INFO:tasks.workunit.client.1.smithi099.stdout:9/362: creat da/d21/d2a/f7f x:0 0 0 2024-09-17T01:01:54.372 INFO:tasks.workunit.client.1.smithi099.stdout:9/363: readlink l3 0 2024-09-17T01:01:54.372 INFO:tasks.workunit.client.1.smithi099.stdout:9/364: chown da/c11 93098446 1 2024-09-17T01:01:54.372 INFO:tasks.workunit.client.1.smithi099.stdout:0/339: mkdir da/df/d4d/d6f 0 2024-09-17T01:01:54.372 INFO:tasks.workunit.client.1.smithi099.stdout:5/411: dwrite d2/f22 [0,4194304] 0 2024-09-17T01:01:54.373 INFO:tasks.workunit.client.1.smithi099.stdout:5/412: write d2/f18 [173518,82976] 0 2024-09-17T01:01:54.374 INFO:tasks.workunit.client.1.smithi099.stdout:9/365: mkdir da/d14/d40/d80 0 2024-09-17T01:01:54.374 INFO:tasks.workunit.client.0.smithi002.stdout:0/168: getdents dd/d19 0 2024-09-17T01:01:54.375 INFO:tasks.workunit.client.1.smithi099.stdout:0/340: mkdir da/df/d1a/d70 0 2024-09-17T01:01:54.376 INFO:tasks.workunit.client.0.smithi002.stdout:3/297: symlink d0/d3/d17/l64 0 2024-09-17T01:01:54.377 INFO:tasks.workunit.client.0.smithi002.stdout:0/169: rmdir dd/d19/d1c/d1f/d22 39 2024-09-17T01:01:54.379 INFO:tasks.workunit.client.0.smithi002.stdout:3/298: unlink d0/d3/d17/c28 0 2024-09-17T01:01:54.379 INFO:tasks.workunit.client.0.smithi002.stdout:3/299: write d0/d31/d32/f25 [13459535,120930] 0 2024-09-17T01:01:54.379 INFO:tasks.workunit.client.0.smithi002.stdout:3/300: creat d0/d3/d33/d40/f65 x:0 0 0 2024-09-17T01:01:54.380 INFO:tasks.workunit.client.1.smithi099.stdout:9/366: link da/d18/c51 da/d14/d40/d6f/c81 0 2024-09-17T01:01:54.380 INFO:tasks.workunit.client.1.smithi099.stdout:9/367: creat da/d50/f82 x:0 0 0 2024-09-17T01:01:54.380 INFO:tasks.workunit.client.1.smithi099.stdout:9/368: dread - da/d14/f77 zero size 2024-09-17T01:01:54.380 INFO:tasks.workunit.client.1.smithi099.stdout:9/369: readlink da/l28 0 2024-09-17T01:01:54.380 INFO:tasks.workunit.client.1.smithi099.stdout:9/370: creat da/d50/f83 x:0 0 0 2024-09-17T01:01:54.381 INFO:tasks.workunit.client.0.smithi002.stdout:0/170: unlink dd/d19/d1c/d1f/d22/c2d 0 2024-09-17T01:01:54.381 INFO:tasks.workunit.client.1.smithi099.stdout:0/341: mkdir da/df/d1a/d49/d71 0 2024-09-17T01:01:54.382 INFO:tasks.workunit.client.0.smithi002.stdout:8/405: rmdir d2/d26/d2b 39 2024-09-17T01:01:54.384 INFO:tasks.workunit.client.0.smithi002.stdout:3/301: creat d0/d3/d37/d5a/f66 x:0 0 0 2024-09-17T01:01:54.384 INFO:tasks.workunit.client.0.smithi002.stdout:3/302: chown d0/f61 185093254 1 2024-09-17T01:01:54.384 INFO:tasks.workunit.client.0.smithi002.stdout:3/303: write d0/d3/d33/d40/f63 [373366,115105] 0 2024-09-17T01:01:54.385 INFO:tasks.workunit.client.0.smithi002.stdout:3/304: mknod d0/d31/d32/c67 0 2024-09-17T01:01:54.385 INFO:tasks.workunit.client.1.smithi099.stdout:0/342: mkdir da/df/d1a/d56/d72 0 2024-09-17T01:01:54.388 INFO:tasks.workunit.client.0.smithi002.stdout:8/406: read d2/d26/f57 [2530420,26702] 0 2024-09-17T01:01:54.391 INFO:tasks.workunit.client.1.smithi099.stdout:8/350: dwrite d0/d1f/d31/f3b [0,4194304] 0 2024-09-17T01:01:54.392 INFO:tasks.workunit.client.1.smithi099.stdout:3/359: dwrite d9/d15/f63 [0,4194304] 0 2024-09-17T01:01:54.392 INFO:tasks.workunit.client.1.smithi099.stdout:3/360: creat d9/d3b/d44/f6d x:0 0 0 2024-09-17T01:01:54.392 INFO:tasks.workunit.client.1.smithi099.stdout:3/361: truncate d9/d15/d18/d1a/d23/f43 320600 0 2024-09-17T01:01:54.392 INFO:tasks.workunit.client.1.smithi099.stdout:3/362: write d9/d3b/d44/f6d [91139,66259] 0 2024-09-17T01:01:54.392 INFO:tasks.workunit.client.1.smithi099.stdout:3/363: write d9/d3b/d44/d57/f5a [191712,98787] 0 2024-09-17T01:01:54.392 INFO:tasks.workunit.client.0.smithi002.stdout:7/190: dwrite d1/d14/d1d/d29/f2f [0,4194304] 0 2024-09-17T01:01:54.393 INFO:tasks.workunit.client.0.smithi002.stdout:7/191: creat d1/d24/f46 x:0 0 0 2024-09-17T01:01:54.394 INFO:tasks.workunit.client.0.smithi002.stdout:6/292: sync 2024-09-17T01:01:54.395 INFO:tasks.workunit.client.0.smithi002.stdout:1/287: sync 2024-09-17T01:01:54.395 INFO:tasks.workunit.client.0.smithi002.stdout:6/293: write f1 [7245658,26364] 0 2024-09-17T01:01:54.395 INFO:tasks.workunit.client.0.smithi002.stdout:6/294: write d2/f16 [2442151,56261] 0 2024-09-17T01:01:54.397 INFO:tasks.workunit.client.0.smithi002.stdout:0/171: dwrite dd/f14 [0,4194304] 0 2024-09-17T01:01:54.397 INFO:tasks.workunit.client.0.smithi002.stdout:0/172: chown dd/f15 462 1 2024-09-17T01:01:54.397 INFO:tasks.workunit.client.0.smithi002.stdout:0/173: chown c3 228 1 2024-09-17T01:01:54.398 INFO:tasks.workunit.client.0.smithi002.stdout:0/174: chown dd/f15 1625 1 2024-09-17T01:01:54.398 INFO:tasks.workunit.client.0.smithi002.stdout:0/175: creat dd/f36 x:0 0 0 2024-09-17T01:01:54.398 INFO:tasks.workunit.client.0.smithi002.stdout:9/246: sync 2024-09-17T01:01:54.399 INFO:tasks.workunit.client.0.smithi002.stdout:2/301: dwrite d1b/d1d/f33 [0,4194304] 0 2024-09-17T01:01:54.401 INFO:tasks.workunit.client.1.smithi099.stdout:9/371: rmdir da/d21/d2a 39 2024-09-17T01:01:54.404 INFO:tasks.workunit.client.1.smithi099.stdout:9/372: unlink da/d18/d49/f7c 0 2024-09-17T01:01:54.404 INFO:tasks.workunit.client.0.smithi002.stdout:1/288: symlink d4/d11/l68 0 2024-09-17T01:01:54.405 INFO:tasks.workunit.client.0.smithi002.stdout:2/302: dread d1b/f4b [0,4194304] 0 2024-09-17T01:01:54.406 INFO:tasks.workunit.client.1.smithi099.stdout:9/373: mkdir da/d56/d84 0 2024-09-17T01:01:54.406 INFO:tasks.workunit.client.1.smithi099.stdout:9/374: dread - da/d14/f77 zero size 2024-09-17T01:01:54.407 INFO:tasks.workunit.client.1.smithi099.stdout:9/375: creat da/d56/d84/f85 x:0 0 0 2024-09-17T01:01:54.407 INFO:tasks.workunit.client.1.smithi099.stdout:9/376: creat da/d50/f86 x:0 0 0 2024-09-17T01:01:54.407 INFO:tasks.workunit.client.1.smithi099.stdout:9/377: write da/d1b/d3a/d4b/f66 [6375107,112328] 0 2024-09-17T01:01:54.407 INFO:tasks.workunit.client.1.smithi099.stdout:9/378: fsync da/d1b/f78 0 2024-09-17T01:01:54.407 INFO:tasks.workunit.client.1.smithi099.stdout:9/379: stat c8 0 2024-09-17T01:01:54.407 INFO:tasks.workunit.client.0.smithi002.stdout:6/295: mkdir d2/dc/d24/d53 0 2024-09-17T01:01:54.409 INFO:tasks.workunit.client.1.smithi099.stdout:9/380: creat da/d14/d6d/f87 x:0 0 0 2024-09-17T01:01:54.409 INFO:tasks.workunit.client.0.smithi002.stdout:3/305: getdents d0/d31/d32 0 2024-09-17T01:01:54.410 INFO:tasks.workunit.client.1.smithi099.stdout:9/381: symlink da/d56/d84/l88 0 2024-09-17T01:01:54.411 INFO:tasks.workunit.client.0.smithi002.stdout:3/306: read d0/f3e [44800,43661] 0 2024-09-17T01:01:54.411 INFO:tasks.workunit.client.0.smithi002.stdout:0/176: rmdir dd/d19/d1a 39 2024-09-17T01:01:54.411 INFO:tasks.workunit.client.1.smithi099.stdout:1/352: sync 2024-09-17T01:01:54.411 INFO:tasks.workunit.client.1.smithi099.stdout:9/382: mkdir da/d14/d89 0 2024-09-17T01:01:54.412 INFO:tasks.workunit.client.0.smithi002.stdout:9/247: creat d5/dc/d26/d34/f42 x:0 0 0 2024-09-17T01:01:54.413 INFO:tasks.workunit.client.1.smithi099.stdout:9/383: getdents da/d21 0 2024-09-17T01:01:54.414 INFO:tasks.workunit.client.1.smithi099.stdout:9/384: creat da/d14/d6d/f8a x:0 0 0 2024-09-17T01:01:54.415 INFO:tasks.workunit.client.1.smithi099.stdout:7/319: sync 2024-09-17T01:01:54.416 INFO:tasks.workunit.client.0.smithi002.stdout:8/407: dwrite d2/d26/f5c [0,4194304] 0 2024-09-17T01:01:54.416 INFO:tasks.workunit.client.0.smithi002.stdout:8/408: chown d2/d26/f7c 646 1 2024-09-17T01:01:54.416 INFO:tasks.workunit.client.0.smithi002.stdout:8/409: fsync d2/d26/d2b/d4f/d77/d78/f7a 0 2024-09-17T01:01:54.416 INFO:tasks.workunit.client.0.smithi002.stdout:8/410: readlink d2/d26/d2b/d4f/l63 0 2024-09-17T01:01:54.416 INFO:tasks.workunit.client.0.smithi002.stdout:1/289: creat d4/d11/d12/d14/d17/d40/f69 x:0 0 0 2024-09-17T01:01:54.417 INFO:tasks.workunit.client.0.smithi002.stdout:2/303: symlink d1b/d3f/d50/l6b 0 2024-09-17T01:01:54.417 INFO:tasks.workunit.client.1.smithi099.stdout:3/364: dwrite d9/d3b/d44/f48 [0,4194304] 0 2024-09-17T01:01:54.418 INFO:tasks.workunit.client.0.smithi002.stdout:6/296: mkdir d2/d1d/d2d/d54 0 2024-09-17T01:01:54.418 INFO:tasks.workunit.client.0.smithi002.stdout:6/297: fdatasync d2/d1d/d2d/d35/d37/f3a 0 2024-09-17T01:01:54.419 INFO:tasks.workunit.client.1.smithi099.stdout:9/385: dread da/d14/d40/d6f/f70 [0,4194304] 0 2024-09-17T01:01:54.419 INFO:tasks.workunit.client.0.smithi002.stdout:0/177: symlink dd/d19/d1a/d29/l37 0 2024-09-17T01:01:54.419 INFO:tasks.workunit.client.0.smithi002.stdout:0/178: dread - dd/f32 zero size 2024-09-17T01:01:54.420 INFO:tasks.workunit.client.1.smithi099.stdout:9/386: dread da/d18/d5e/f67 [0,4194304] 0 2024-09-17T01:01:54.420 INFO:tasks.workunit.client.1.smithi099.stdout:9/387: rename da to da/d14/d48/d69/d8b 22 2024-09-17T01:01:54.420 INFO:tasks.workunit.client.1.smithi099.stdout:9/388: stat da 0 2024-09-17T01:01:54.420 INFO:tasks.workunit.client.1.smithi099.stdout:9/389: write da/d14/d62/f6b [774584,15853] 0 2024-09-17T01:01:54.420 INFO:tasks.workunit.client.1.smithi099.stdout:0/343: dwrite da/df/d1a/d63/d6a/f6e [0,4194304] 0 2024-09-17T01:01:54.421 INFO:tasks.workunit.client.0.smithi002.stdout:9/248: link d5/dc/c2f d5/dc/d26/d34/d36/c43 0 2024-09-17T01:01:54.422 INFO:tasks.workunit.client.0.smithi002.stdout:9/249: write d5/dc/d26/d34/f42 [824199,91926] 0 2024-09-17T01:01:54.422 INFO:tasks.workunit.client.0.smithi002.stdout:9/250: fsync d5/f10 0 2024-09-17T01:01:54.423 INFO:tasks.workunit.client.1.smithi099.stdout:3/365: mkdir d9/d15/d18/d1a/d23/d5c/d6e 0 2024-09-17T01:01:54.423 INFO:tasks.workunit.client.1.smithi099.stdout:3/366: chown d9/d2b/d52 1354280 1 2024-09-17T01:01:54.423 INFO:tasks.workunit.client.0.smithi002.stdout:8/411: rename d2/d1c/d3b/f4e to d2/d9/dd/f8c 0 2024-09-17T01:01:54.424 INFO:tasks.workunit.client.0.smithi002.stdout:1/290: mknod d4/d11/d12/d30/d43/d67/c6a 0 2024-09-17T01:01:54.425 INFO:tasks.workunit.client.0.smithi002.stdout:2/304: mknod d1b/d3f/c6c 0 2024-09-17T01:01:54.426 INFO:tasks.workunit.client.0.smithi002.stdout:6/298: symlink d2/d1d/d26/l55 0 2024-09-17T01:01:54.426 INFO:tasks.workunit.client.0.smithi002.stdout:6/299: chown d2/f16 2701597 1 2024-09-17T01:01:54.427 INFO:tasks.workunit.client.0.smithi002.stdout:0/179: truncate dd/d19/d1c/d1f/f21 5019428 0 2024-09-17T01:01:54.427 INFO:tasks.workunit.client.0.smithi002.stdout:0/180: stat dd/d19/d1c/d1f/d22 0 2024-09-17T01:01:54.427 INFO:tasks.workunit.client.0.smithi002.stdout:0/181: chown dd/c31 108 1 2024-09-17T01:01:54.427 INFO:tasks.workunit.client.0.smithi002.stdout:9/251: truncate d5/dc/d26/f2e 470737 0 2024-09-17T01:01:54.428 INFO:tasks.workunit.client.0.smithi002.stdout:8/412: mknod d2/d30/d8b/c8d 0 2024-09-17T01:01:54.429 INFO:tasks.workunit.client.0.smithi002.stdout:6/300: dread d2/f19 [0,4194304] 0 2024-09-17T01:01:54.430 INFO:tasks.workunit.client.0.smithi002.stdout:1/291: link d4/d22/c5a d4/d11/d55/c6b 0 2024-09-17T01:01:54.431 INFO:tasks.workunit.client.0.smithi002.stdout:3/307: dwrite d0/d3/d17/f29 [0,4194304] 0 2024-09-17T01:01:54.433 INFO:tasks.workunit.client.0.smithi002.stdout:2/305: rename d1b/f58 to d1b/d3f/d50/f6d 0 2024-09-17T01:01:54.433 INFO:tasks.workunit.client.0.smithi002.stdout:2/306: write d1b/d3f/d50/f6d [886237,8570] 0 2024-09-17T01:01:54.434 INFO:tasks.workunit.client.0.smithi002.stdout:2/307: fdatasync f13 0 2024-09-17T01:01:54.434 INFO:tasks.workunit.client.1.smithi099.stdout:0/344: dread da/df/f4f [0,4194304] 0 2024-09-17T01:01:54.434 INFO:tasks.workunit.client.0.smithi002.stdout:8/413: creat d2/d30/d8b/f8e x:0 0 0 2024-09-17T01:01:54.435 INFO:tasks.workunit.client.0.smithi002.stdout:6/301: truncate d2/f4 3183135 0 2024-09-17T01:01:54.435 INFO:tasks.workunit.client.0.smithi002.stdout:6/302: readlink d2/dc/l14 0 2024-09-17T01:01:54.435 INFO:tasks.workunit.client.1.smithi099.stdout:0/345: write da/d12/f62 [5005717,10424] 0 2024-09-17T01:01:54.436 INFO:tasks.workunit.client.1.smithi099.stdout:0/346: write da/df/d1a/d23/f40 [466534,26750] 0 2024-09-17T01:01:54.436 INFO:tasks.workunit.client.1.smithi099.stdout:0/347: chown l6 1257 1 2024-09-17T01:01:54.436 INFO:tasks.workunit.client.1.smithi099.stdout:0/348: getdents da/d59 0 2024-09-17T01:01:54.437 INFO:tasks.workunit.client.0.smithi002.stdout:3/308: creat d0/d3/d17/f68 x:0 0 0 2024-09-17T01:01:54.437 INFO:tasks.workunit.client.0.smithi002.stdout:3/309: creat d0/d3/d37/d5a/f69 x:0 0 0 2024-09-17T01:01:54.438 INFO:tasks.workunit.client.0.smithi002.stdout:2/308: rename f17 to d1b/d1d/f6e 0 2024-09-17T01:01:54.439 INFO:tasks.workunit.client.0.smithi002.stdout:6/303: mknod d2/d1d/d27/c56 0 2024-09-17T01:01:54.439 INFO:tasks.workunit.client.0.smithi002.stdout:6/304: chown d2/dc/f21 1067413 1 2024-09-17T01:01:54.441 INFO:tasks.workunit.client.0.smithi002.stdout:8/414: rename d2/d9/dd/f18 to d2/d3/d5f/f8f 0 2024-09-17T01:01:54.443 INFO:tasks.workunit.client.1.smithi099.stdout:8/351: dwrite d0/d4/f3a [0,4194304] 0 2024-09-17T01:01:54.443 INFO:tasks.workunit.client.1.smithi099.stdout:8/352: dread - d0/d4/d29/f57 zero size 2024-09-17T01:01:54.448 INFO:tasks.workunit.client.1.smithi099.stdout:7/320: dwrite d1/d2c/d5c/d1c/f61 [0,4194304] 0 2024-09-17T01:01:54.448 INFO:tasks.workunit.client.1.smithi099.stdout:7/321: chown d1/d2c/d5c/d12/l15 45 1 2024-09-17T01:01:54.448 INFO:tasks.workunit.client.1.smithi099.stdout:7/322: write d1/d2c/f40 [4140543,10764] 0 2024-09-17T01:01:54.448 INFO:tasks.workunit.client.1.smithi099.stdout:7/323: chown d1/d2c/d5c/f9 483 1 2024-09-17T01:01:54.448 INFO:tasks.workunit.client.1.smithi099.stdout:1/353: dwrite d0/d8/f65 [0,4194304] 0 2024-09-17T01:01:54.449 INFO:tasks.workunit.client.0.smithi002.stdout:7/192: dwrite d1/f20 [0,4194304] 0 2024-09-17T01:01:54.449 INFO:tasks.workunit.client.0.smithi002.stdout:7/193: read - d1/d14/f3f zero size 2024-09-17T01:01:54.449 INFO:tasks.workunit.client.0.smithi002.stdout:7/194: truncate f0 2291143 0 2024-09-17T01:01:54.450 INFO:tasks.workunit.client.0.smithi002.stdout:7/195: fdatasync d1/d14/d1d/d29/f2f 0 2024-09-17T01:01:54.450 INFO:tasks.workunit.client.0.smithi002.stdout:7/196: chown d1/d14/d1d/d29 15242220 1 2024-09-17T01:01:54.450 INFO:tasks.workunit.client.0.smithi002.stdout:3/310: dread d0/d3/d33/d40/f63 [0,4194304] 0 2024-09-17T01:01:54.450 INFO:tasks.workunit.client.0.smithi002.stdout:7/197: symlink d1/d14/l47 0 2024-09-17T01:01:54.450 INFO:tasks.workunit.client.0.smithi002.stdout:7/198: write d1/d24/f46 [421629,125504] 0 2024-09-17T01:01:54.450 INFO:tasks.workunit.client.1.smithi099.stdout:0/349: write da/df/f47 [2280374,49112] 0 2024-09-17T01:01:54.453 INFO:tasks.workunit.client.0.smithi002.stdout:4/317: sync 2024-09-17T01:01:54.453 INFO:tasks.workunit.client.0.smithi002.stdout:4/318: chown d7/de/f5c 107094539 1 2024-09-17T01:01:54.454 INFO:tasks.workunit.client.0.smithi002.stdout:5/321: sync 2024-09-17T01:01:54.454 INFO:tasks.workunit.client.0.smithi002.stdout:5/322: chown d2/d2d/d10/d14/d19/d39/d48 15 1 2024-09-17T01:01:54.455 INFO:tasks.workunit.client.0.smithi002.stdout:5/323: creat d2/d2d/d10/f66 x:0 0 0 2024-09-17T01:01:54.455 INFO:tasks.workunit.client.0.smithi002.stdout:5/324: readlink d2/d2d/d10/d3b/l5b 0 2024-09-17T01:01:54.460 INFO:tasks.workunit.client.0.smithi002.stdout:7/199: dread d1/d14/d1d/d29/f2f [0,4194304] 0 2024-09-17T01:01:54.460 INFO:tasks.workunit.client.0.smithi002.stdout:7/200: rename d1/d14 to d1/d14/d1d/d28/d2d/d48 22 2024-09-17T01:01:54.460 INFO:tasks.workunit.client.0.smithi002.stdout:7/201: stat d1/f11 0 2024-09-17T01:01:54.461 INFO:tasks.workunit.client.0.smithi002.stdout:4/319: dread d7/f25 [0,4194304] 0 2024-09-17T01:01:54.461 INFO:tasks.workunit.client.0.smithi002.stdout:4/320: fdatasync d7/d19/d2e/f39 0 2024-09-17T01:01:54.461 INFO:tasks.workunit.client.0.smithi002.stdout:4/321: fsync d7/d19/d2e/f46 0 2024-09-17T01:01:54.463 INFO:tasks.workunit.client.0.smithi002.stdout:4/322: mknod d7/de/d3a/c5d 0 2024-09-17T01:01:54.479 INFO:tasks.workunit.client.1.smithi099.stdout:8/353: unlink d0/d4/d29/f73 0 2024-09-17T01:01:54.481 INFO:tasks.workunit.client.1.smithi099.stdout:7/324: creat d1/d2c/f66 x:0 0 0 2024-09-17T01:01:54.486 INFO:tasks.workunit.client.1.smithi099.stdout:0/350: symlink da/d1c/l73 0 2024-09-17T01:01:54.486 INFO:tasks.workunit.client.1.smithi099.stdout:0/351: write da/d12/d22/d52/f58 [76560,128441] 0 2024-09-17T01:01:54.487 INFO:tasks.workunit.client.1.smithi099.stdout:0/352: write da/f27 [3435576,51767] 0 2024-09-17T01:01:54.487 INFO:tasks.workunit.client.0.smithi002.stdout:1/292: dwrite d4/d11/d12/d14/f36 [0,4194304] 0 2024-09-17T01:01:54.488 INFO:tasks.workunit.client.0.smithi002.stdout:1/293: chown d4/d11/d12/d14/c25 2827320 1 2024-09-17T01:01:54.488 INFO:tasks.workunit.client.0.smithi002.stdout:1/294: readlink d4/d11/l68 0 2024-09-17T01:01:54.488 INFO:tasks.workunit.client.0.smithi002.stdout:1/295: fsync d4/f6 0 2024-09-17T01:01:54.488 INFO:tasks.workunit.client.0.smithi002.stdout:0/182: dwrite dd/f36 [0,4194304] 0 2024-09-17T01:01:54.488 INFO:tasks.workunit.client.1.smithi099.stdout:7/325: rename d1/c5f to d1/d37/c67 0 2024-09-17T01:01:54.488 INFO:tasks.workunit.client.0.smithi002.stdout:4/323: dread d7/f14 [0,4194304] 0 2024-09-17T01:01:54.489 INFO:tasks.workunit.client.0.smithi002.stdout:6/305: dwrite d2/d1d/d26/f2a [0,4194304] 0 2024-09-17T01:01:54.490 INFO:tasks.workunit.client.1.smithi099.stdout:0/353: creat da/df/d1a/d56/f74 x:0 0 0 2024-09-17T01:01:54.490 INFO:tasks.workunit.client.0.smithi002.stdout:1/296: creat d4/d11/d1a/f6c x:0 0 0 2024-09-17T01:01:54.490 INFO:tasks.workunit.client.0.smithi002.stdout:1/297: write d4/d11/d12/d30/d43/f4d [526374,11163] 0 2024-09-17T01:01:54.491 INFO:tasks.workunit.client.1.smithi099.stdout:7/326: link d1/d37/l5e d1/d2c/d5c/d3f/l68 0 2024-09-17T01:01:54.492 INFO:tasks.workunit.client.1.smithi099.stdout:0/354: rmdir da/d1c/d1e 39 2024-09-17T01:01:54.492 INFO:tasks.workunit.client.1.smithi099.stdout:0/355: chown da/df/l48 58 1 2024-09-17T01:01:54.493 INFO:tasks.workunit.client.0.smithi002.stdout:0/183: link c3 dd/c38 0 2024-09-17T01:01:54.496 INFO:tasks.workunit.client.0.smithi002.stdout:4/324: creat d7/de/d3a/f5e x:0 0 0 2024-09-17T01:01:54.497 INFO:tasks.workunit.client.1.smithi099.stdout:1/354: dwrite d0/d8/d49/d4e/f50 [0,4194304] 0 2024-09-17T01:01:54.498 INFO:tasks.workunit.client.0.smithi002.stdout:5/325: dwrite d2/f2c [0,4194304] 0 2024-09-17T01:01:54.498 INFO:tasks.workunit.client.0.smithi002.stdout:5/326: dread - d2/de/f34 zero size 2024-09-17T01:01:54.498 INFO:tasks.workunit.client.0.smithi002.stdout:6/306: dread d2/dc/f21 [0,4194304] 0 2024-09-17T01:01:54.498 INFO:tasks.workunit.client.0.smithi002.stdout:2/309: dwrite d1b/d1d/f33 [4194304,4194304] 0 2024-09-17T01:01:54.499 INFO:tasks.workunit.client.1.smithi099.stdout:8/354: dwrite d0/d4/d29/f5f [0,4194304] 0 2024-09-17T01:01:54.499 INFO:tasks.workunit.client.1.smithi099.stdout:8/355: creat d0/f74 x:0 0 0 2024-09-17T01:01:54.499 INFO:tasks.workunit.client.1.smithi099.stdout:8/356: stat d0/d1f/l48 0 2024-09-17T01:01:54.499 INFO:tasks.workunit.client.1.smithi099.stdout:8/357: chown d0/d1f/d31/d4c/f6f 8601115 1 2024-09-17T01:01:54.499 INFO:tasks.workunit.client.1.smithi099.stdout:8/358: chown d0/d4/f50 15 1 2024-09-17T01:01:54.502 INFO:tasks.workunit.client.1.smithi099.stdout:7/327: dread d1/d36/f62 [4194304,4194304] 0 2024-09-17T01:01:54.502 INFO:tasks.workunit.client.0.smithi002.stdout:1/298: unlink d4/f47 0 2024-09-17T01:01:54.503 INFO:tasks.workunit.client.0.smithi002.stdout:1/299: write d4/d11/d12/d23/f35 [4211330,121497] 0 2024-09-17T01:01:54.504 INFO:tasks.workunit.client.0.smithi002.stdout:0/184: mkdir dd/d19/d1c/d1f/d39 0 2024-09-17T01:01:54.504 INFO:tasks.workunit.client.0.smithi002.stdout:0/185: write dd/d19/f1e [261393,71892] 0 2024-09-17T01:01:54.504 INFO:tasks.workunit.client.0.smithi002.stdout:0/186: write dd/d19/f1b [368511,59822] 0 2024-09-17T01:01:54.504 INFO:tasks.workunit.client.0.smithi002.stdout:0/187: dread - dd/d19/f34 zero size 2024-09-17T01:01:54.505 INFO:tasks.workunit.client.0.smithi002.stdout:0/188: chown dd/d19/d1c/d1f/f21 39346786 1 2024-09-17T01:01:54.505 INFO:tasks.workunit.client.0.smithi002.stdout:0/189: fsync dd/d19/f24 0 2024-09-17T01:01:54.505 INFO:tasks.workunit.client.0.smithi002.stdout:4/325: link d7/de/f28 d7/d19/d34/d54/f5f 0 2024-09-17T01:01:54.508 INFO:tasks.workunit.client.1.smithi099.stdout:7/328: creat d1/d2c/d47/d48/f69 x:0 0 0 2024-09-17T01:01:54.509 INFO:tasks.workunit.client.1.smithi099.stdout:1/355: write d0/d8/d49/d4e/f50 [339936,64644] 0 2024-09-17T01:01:54.510 INFO:tasks.workunit.client.1.smithi099.stdout:7/329: mkdir d1/d37/d4f/d6a 0 2024-09-17T01:01:54.511 INFO:tasks.workunit.client.0.smithi002.stdout:2/310: creat d1b/d37/d48/d52/f6f x:0 0 0 2024-09-17T01:01:54.512 INFO:tasks.workunit.client.0.smithi002.stdout:8/415: rmdir d2/d30/d8b 39 2024-09-17T01:01:54.517 INFO:tasks.workunit.client.0.smithi002.stdout:3/311: dwrite d0/f1f [0,4194304] 0 2024-09-17T01:01:54.522 INFO:tasks.workunit.client.0.smithi002.stdout:8/416: read d2/d30/f7f [395198,94736] 0 2024-09-17T01:01:54.522 INFO:tasks.workunit.client.0.smithi002.stdout:8/417: fdatasync d2/f56 0 2024-09-17T01:01:54.522 INFO:tasks.workunit.client.0.smithi002.stdout:8/418: truncate d2/d26/d2b/d4f/d77/d78/f7a 605845 0 2024-09-17T01:01:54.522 INFO:tasks.workunit.client.0.smithi002.stdout:1/300: rename d4/d11/d12/d30/d43/f48 to d4/d11/d12/d14/d17/d40/f6d 0 2024-09-17T01:01:54.523 INFO:tasks.workunit.client.1.smithi099.stdout:7/330: write d1/d2c/d5c/f13 [1857853,52058] 0 2024-09-17T01:01:54.523 INFO:tasks.workunit.client.1.smithi099.stdout:7/331: stat d1/d2c/d5c/f1b 0 2024-09-17T01:01:54.524 INFO:tasks.workunit.client.1.smithi099.stdout:7/332: creat d1/d2c/f6b x:0 0 0 2024-09-17T01:01:54.524 INFO:tasks.workunit.client.0.smithi002.stdout:0/190: creat dd/d19/f3a x:0 0 0 2024-09-17T01:01:54.524 INFO:tasks.workunit.client.0.smithi002.stdout:0/191: chown dd/d19 1009999 1 2024-09-17T01:01:54.524 INFO:tasks.workunit.client.0.smithi002.stdout:0/192: creat dd/d19/f3b x:0 0 0 2024-09-17T01:01:54.524 INFO:tasks.workunit.client.0.smithi002.stdout:0/193: chown dd/d19/f24 1990 1 2024-09-17T01:01:54.525 INFO:tasks.workunit.client.1.smithi099.stdout:0/356: dwrite da/df/d1a/d23/f50 [0,4194304] 0 2024-09-17T01:01:54.525 INFO:tasks.workunit.client.1.smithi099.stdout:0/357: write da/d12/f18 [2855530,80160] 0 2024-09-17T01:01:54.525 INFO:tasks.workunit.client.1.smithi099.stdout:0/358: read da/d12/f16 [1904729,63646] 0 2024-09-17T01:01:54.526 INFO:tasks.workunit.client.0.smithi002.stdout:4/326: mknod d7/de/d32/c60 0 2024-09-17T01:01:54.526 INFO:tasks.workunit.client.1.smithi099.stdout:7/333: creat d1/d2c/d47/f6c x:0 0 0 2024-09-17T01:01:54.528 INFO:tasks.workunit.client.0.smithi002.stdout:2/311: creat d1b/d37/d48/d4e/f70 x:0 0 0 2024-09-17T01:01:54.528 INFO:tasks.workunit.client.0.smithi002.stdout:2/312: stat d1b/d37/d48/d4e/f3b 0 2024-09-17T01:01:54.529 INFO:tasks.workunit.client.0.smithi002.stdout:6/307: dwrite d2/d1d/f3d [4194304,4194304] 0 2024-09-17T01:01:54.530 INFO:tasks.workunit.client.1.smithi099.stdout:6/410: sync 2024-09-17T01:01:54.530 INFO:tasks.workunit.client.1.smithi099.stdout:6/411: fdatasync dc/d27/f81 0 2024-09-17T01:01:54.530 INFO:tasks.workunit.client.1.smithi099.stdout:6/412: write dc/f18 [1549467,125001] 0 2024-09-17T01:01:54.530 INFO:tasks.workunit.client.1.smithi099.stdout:6/413: truncate dc/d1a/f56 283916 0 2024-09-17T01:01:54.530 INFO:tasks.workunit.client.1.smithi099.stdout:0/359: creat da/d59/f75 x:0 0 0 2024-09-17T01:01:54.531 INFO:tasks.workunit.client.0.smithi002.stdout:7/202: rmdir d1/d14 39 2024-09-17T01:01:54.531 INFO:tasks.workunit.client.0.smithi002.stdout:7/203: fsync d1/d24/f31 0 2024-09-17T01:01:54.533 INFO:tasks.workunit.client.0.smithi002.stdout:3/312: write d0/d3/d33/d40/f52 [3085957,35972] 0 2024-09-17T01:01:54.534 INFO:tasks.workunit.client.1.smithi099.stdout:6/414: symlink dc/d1a/d49/l85 0 2024-09-17T01:01:54.535 INFO:tasks.workunit.client.1.smithi099.stdout:6/415: truncate dc/d27/d58/f6e 458355 0 2024-09-17T01:01:54.535 INFO:tasks.workunit.client.1.smithi099.stdout:6/416: stat dc/d2b/d53/f6a 0 2024-09-17T01:01:54.535 INFO:tasks.workunit.client.1.smithi099.stdout:6/417: creat dc/d1a/f86 x:0 0 0 2024-09-17T01:01:54.536 INFO:tasks.workunit.client.1.smithi099.stdout:0/360: rmdir da/d12 39 2024-09-17T01:01:54.537 INFO:tasks.workunit.client.0.smithi002.stdout:8/419: truncate d2/f1d 2521986 0 2024-09-17T01:01:54.537 INFO:tasks.workunit.client.0.smithi002.stdout:8/420: fdatasync d2/d3/f6e 0 2024-09-17T01:01:54.537 INFO:tasks.workunit.client.0.smithi002.stdout:8/421: readlink d2/d30/l3e 0 2024-09-17T01:01:54.538 INFO:tasks.workunit.client.0.smithi002.stdout:0/194: symlink dd/d19/d1c/d1f/d39/l3c 0 2024-09-17T01:01:54.541 INFO:tasks.workunit.client.1.smithi099.stdout:7/334: write d1/d37/f51 [1071858,6641] 0 2024-09-17T01:01:54.541 INFO:tasks.workunit.client.1.smithi099.stdout:7/335: truncate d1/d37/f56 781188 0 2024-09-17T01:01:54.541 INFO:tasks.workunit.client.0.smithi002.stdout:4/327: link d7/d3f/d48/l56 d7/de/d32/d59/l61 0 2024-09-17T01:01:54.543 INFO:tasks.workunit.client.1.smithi099.stdout:7/336: mknod d1/d2c/d47/c6d 0 2024-09-17T01:01:54.544 INFO:tasks.workunit.client.0.smithi002.stdout:6/308: dread d2/f13 [0,4194304] 0 2024-09-17T01:01:54.544 INFO:tasks.workunit.client.1.smithi099.stdout:1/356: dwrite d0/d2/f25 [0,4194304] 0 2024-09-17T01:01:54.545 INFO:tasks.workunit.client.0.smithi002.stdout:1/301: dwrite d4/d11/d1a/f29 [0,4194304] 0 2024-09-17T01:01:54.547 INFO:tasks.workunit.client.0.smithi002.stdout:2/313: symlink d1b/d37/d48/d52/l71 0 2024-09-17T01:01:54.548 INFO:tasks.workunit.client.1.smithi099.stdout:1/357: truncate d0/d2/de/f5c 107990 0 2024-09-17T01:01:54.548 INFO:tasks.workunit.client.1.smithi099.stdout:1/358: chown d0/d2/d18/l62 6 1 2024-09-17T01:01:54.548 INFO:tasks.workunit.client.1.smithi099.stdout:7/337: dread d1/d2c/d5c/d12/f32 [0,4194304] 0 2024-09-17T01:01:54.549 INFO:tasks.workunit.client.1.smithi099.stdout:7/338: stat d1/d2c/d5c/d12/l4c 0 2024-09-17T01:01:54.549 INFO:tasks.workunit.client.1.smithi099.stdout:7/339: write d1/d2c/f6b [799965,76446] 0 2024-09-17T01:01:54.550 INFO:tasks.workunit.client.1.smithi099.stdout:0/361: dread da/df/f28 [4194304,4194304] 0 2024-09-17T01:01:54.550 INFO:tasks.workunit.client.0.smithi002.stdout:3/313: mkdir d0/d3/d17/d6a 0 2024-09-17T01:01:54.550 INFO:tasks.workunit.client.0.smithi002.stdout:3/314: write d0/d3/d17/f29 [4207615,116893] 0 2024-09-17T01:01:54.551 INFO:tasks.workunit.client.0.smithi002.stdout:7/204: dwrite f0 [0,4194304] 0 2024-09-17T01:01:54.552 INFO:tasks.workunit.client.1.smithi099.stdout:0/362: creat da/df/d1a/d70/f76 x:0 0 0 2024-09-17T01:01:54.552 INFO:tasks.workunit.client.0.smithi002.stdout:0/195: mkdir dd/d3d 0 2024-09-17T01:01:54.552 INFO:tasks.workunit.client.0.smithi002.stdout:0/196: write dd/f13 [1905993,105451] 0 2024-09-17T01:01:54.554 INFO:tasks.workunit.client.1.smithi099.stdout:0/363: rename l6 to da/df/d4d/l77 0 2024-09-17T01:01:54.554 INFO:tasks.workunit.client.1.smithi099.stdout:0/364: dread - da/d12/d22/d66/f6d zero size 2024-09-17T01:01:54.555 INFO:tasks.workunit.client.0.smithi002.stdout:1/302: getdents d4/d11/d12/d23 0 2024-09-17T01:01:54.558 INFO:tasks.workunit.client.0.smithi002.stdout:2/314: mkdir d1b/d1d/d38/d72 0 2024-09-17T01:01:54.559 INFO:tasks.workunit.client.0.smithi002.stdout:7/205: dread d1/d24/f31 [0,4194304] 0 2024-09-17T01:01:54.559 INFO:tasks.workunit.client.0.smithi002.stdout:7/206: stat d1/d14/d1d/l2c 0 2024-09-17T01:01:54.561 INFO:tasks.workunit.client.0.smithi002.stdout:4/328: rmdir d7/de/d23 39 2024-09-17T01:01:54.564 INFO:tasks.workunit.client.0.smithi002.stdout:7/207: mknod d1/c49 0 2024-09-17T01:01:54.566 INFO:tasks.workunit.client.1.smithi099.stdout:1/359: dread d0/d2/f25 [0,4194304] 0 2024-09-17T01:01:54.567 INFO:tasks.workunit.client.0.smithi002.stdout:4/329: getdents d7/d19/d4a/d4d 0 2024-09-17T01:01:54.567 INFO:tasks.workunit.client.0.smithi002.stdout:4/330: write d7/f25 [845159,81700] 0 2024-09-17T01:01:54.567 INFO:tasks.workunit.client.0.smithi002.stdout:4/331: write d7/de/d23/f50 [326478,19656] 0 2024-09-17T01:01:54.568 INFO:tasks.workunit.client.1.smithi099.stdout:1/360: creat d0/d2/d9/f6f x:0 0 0 2024-09-17T01:01:54.568 INFO:tasks.workunit.client.0.smithi002.stdout:2/315: rmdir d1b/d37/d48/d4e 39 2024-09-17T01:01:54.568 INFO:tasks.workunit.client.0.smithi002.stdout:2/316: dread - d1b/d37/d48/d4e/f54 zero size 2024-09-17T01:01:54.570 INFO:tasks.workunit.client.0.smithi002.stdout:2/317: chown f16 6184 1 2024-09-17T01:01:54.572 INFO:tasks.workunit.client.0.smithi002.stdout:2/318: mknod d1b/d1d/d38/c73 0 2024-09-17T01:01:54.572 INFO:tasks.workunit.client.0.smithi002.stdout:2/319: write d1b/d37/d48/d4e/f35 [1862983,10248] 0 2024-09-17T01:01:54.573 INFO:tasks.workunit.client.0.smithi002.stdout:2/320: mkdir d1b/d74 0 2024-09-17T01:01:54.573 INFO:tasks.workunit.client.0.smithi002.stdout:2/321: truncate d1b/f1c 4832600 0 2024-09-17T01:01:54.573 INFO:tasks.workunit.client.1.smithi099.stdout:1/361: dread d0/d8/d49/d4e/f50 [0,4194304] 0 2024-09-17T01:01:54.574 INFO:tasks.workunit.client.0.smithi002.stdout:2/322: creat d1b/f75 x:0 0 0 2024-09-17T01:01:54.575 INFO:tasks.workunit.client.0.smithi002.stdout:2/323: fsync d1b/d37/d48/f64 0 2024-09-17T01:01:54.576 INFO:tasks.workunit.client.1.smithi099.stdout:6/418: dwrite dc/d27/d58/f78 [0,4194304] 0 2024-09-17T01:01:54.576 INFO:tasks.workunit.client.0.smithi002.stdout:2/324: creat d1b/d37/d48/d4e/f76 x:0 0 0 2024-09-17T01:01:54.577 INFO:tasks.workunit.client.0.smithi002.stdout:2/325: rename d1b/d37/d48/d4e/c34 to d1b/d74/c77 0 2024-09-17T01:01:54.578 INFO:tasks.workunit.client.0.smithi002.stdout:2/326: mkdir d1b/d37/d48/d78 0 2024-09-17T01:01:54.579 INFO:tasks.workunit.client.0.smithi002.stdout:2/327: truncate ff 82943 0 2024-09-17T01:01:54.580 INFO:tasks.workunit.client.0.smithi002.stdout:2/328: readlink l15 0 2024-09-17T01:01:54.580 INFO:tasks.workunit.client.0.smithi002.stdout:2/329: getdents d1b/d3f/d59 0 2024-09-17T01:01:54.581 INFO:tasks.workunit.client.0.smithi002.stdout:2/330: rename d1b/d3f/d50 to d1b/d1d/d79 0 2024-09-17T01:01:54.582 INFO:tasks.workunit.client.0.smithi002.stdout:8/422: dwrite d2/d1c/d3b/f7e [0,4194304] 0 2024-09-17T01:01:54.582 INFO:tasks.workunit.client.0.smithi002.stdout:8/423: fdatasync d2/d9/f34 0 2024-09-17T01:01:54.584 INFO:tasks.workunit.client.0.smithi002.stdout:2/331: creat d1b/d1d/d79/f7a x:0 0 0 2024-09-17T01:01:54.584 INFO:tasks.workunit.client.0.smithi002.stdout:6/309: dwrite d2/d1d/f25 [0,4194304] 0 2024-09-17T01:01:54.588 INFO:tasks.workunit.client.0.smithi002.stdout:2/332: mknod d1b/d74/c7b 0 2024-09-17T01:01:54.592 INFO:tasks.workunit.client.1.smithi099.stdout:6/419: dread fa [4194304,4194304] 0 2024-09-17T01:01:54.593 INFO:tasks.workunit.client.1.smithi099.stdout:6/420: read - dc/d1a/f86 zero size 2024-09-17T01:01:54.594 INFO:tasks.workunit.client.0.smithi002.stdout:2/333: creat d1b/d1d/f7c x:0 0 0 2024-09-17T01:01:54.594 INFO:tasks.workunit.client.1.smithi099.stdout:6/421: mkdir dc/d5d/d66/d7a/d87 0 2024-09-17T01:01:54.596 INFO:tasks.workunit.client.1.smithi099.stdout:6/422: truncate dc/fe 1228997 0 2024-09-17T01:01:54.596 INFO:tasks.workunit.client.1.smithi099.stdout:6/423: write dc/d2b/f4b [1230755,126283] 0 2024-09-17T01:01:54.597 INFO:tasks.workunit.client.0.smithi002.stdout:2/334: mkdir d1b/d37/d48/d78/d7d 0 2024-09-17T01:01:54.597 INFO:tasks.workunit.client.1.smithi099.stdout:6/424: creat dc/d1a/d82/f88 x:0 0 0 2024-09-17T01:01:54.599 INFO:tasks.workunit.client.1.smithi099.stdout:6/425: creat dc/d27/d7e/f89 x:0 0 0 2024-09-17T01:01:54.599 INFO:tasks.workunit.client.1.smithi099.stdout:6/426: creat dc/d27/d58/f8a x:0 0 0 2024-09-17T01:01:54.600 INFO:tasks.workunit.client.1.smithi099.stdout:0/365: dwrite da/df/d31/f4c [0,4194304] 0 2024-09-17T01:01:54.600 INFO:tasks.workunit.client.1.smithi099.stdout:0/366: write da/df/d31/f54 [1881447,86110] 0 2024-09-17T01:01:54.609 INFO:tasks.workunit.client.0.smithi002.stdout:3/315: dwrite d0/d3/f8 [0,4194304] 0 2024-09-17T01:01:54.610 INFO:tasks.workunit.client.0.smithi002.stdout:3/316: write d0/d31/d32/f42 [604329,50698] 0 2024-09-17T01:01:54.624 INFO:tasks.workunit.client.0.smithi002.stdout:1/303: dwrite d4/d11/d12/f3d [0,4194304] 0 2024-09-17T01:01:54.625 INFO:tasks.workunit.client.0.smithi002.stdout:1/304: dread - d4/d11/d12/d14/d17/d3b/f62 zero size 2024-09-17T01:01:54.626 INFO:tasks.workunit.client.0.smithi002.stdout:1/305: creat d4/d11/d12/d14/d17/d3b/f6e x:0 0 0 2024-09-17T01:01:54.633 INFO:tasks.workunit.client.0.smithi002.stdout:1/306: write d4/d22/f2f [3930525,37564] 0 2024-09-17T01:01:54.638 INFO:tasks.workunit.client.0.smithi002.stdout:3/317: dread d0/f21 [0,4194304] 0 2024-09-17T01:01:54.646 INFO:tasks.workunit.client.1.smithi099.stdout:1/362: dwrite d0/f13 [0,4194304] 0 2024-09-17T01:01:54.647 INFO:tasks.workunit.client.0.smithi002.stdout:6/310: dwrite d2/d1d/d27/d30/f36 [0,4194304] 0 2024-09-17T01:01:54.650 INFO:tasks.workunit.client.0.smithi002.stdout:8/424: dwrite f0 [0,4194304] 0 2024-09-17T01:01:54.651 INFO:tasks.workunit.client.0.smithi002.stdout:7/208: dwrite d1/d14/d1d/d21/d45/f43 [0,4194304] 0 2024-09-17T01:01:54.651 INFO:tasks.workunit.client.0.smithi002.stdout:1/307: dwrite d4/d11/d12/d14/d17/d3b/f62 [0,4194304] 0 2024-09-17T01:01:54.651 INFO:tasks.workunit.client.1.smithi099.stdout:1/363: mkdir d0/d2/de/d70 0 2024-09-17T01:01:54.651 INFO:tasks.workunit.client.1.smithi099.stdout:0/367: dwrite da/df/d1a/d23/f3c [0,4194304] 0 2024-09-17T01:01:54.652 INFO:tasks.workunit.client.0.smithi002.stdout:2/335: dwrite d1b/d1d/f28 [4194304,4194304] 0 2024-09-17T01:01:54.652 INFO:tasks.workunit.client.1.smithi099.stdout:6/427: dwrite dc/d1a/d82/f88 [0,4194304] 0 2024-09-17T01:01:54.652 INFO:tasks.workunit.client.1.smithi099.stdout:6/428: fsync dc/d1a/f26 0 2024-09-17T01:01:54.654 INFO:tasks.workunit.client.1.smithi099.stdout:6/429: write dc/d1a/f79 [9175132,82088] 0 2024-09-17T01:01:54.654 INFO:tasks.workunit.client.0.smithi002.stdout:0/197: dwrite dd/d19/f3a [0,4194304] 0 2024-09-17T01:01:54.654 INFO:tasks.workunit.client.0.smithi002.stdout:3/318: write d0/f2f [2888442,52627] 0 2024-09-17T01:01:54.655 INFO:tasks.workunit.client.1.smithi099.stdout:0/368: dread da/df/f41 [0,4194304] 0 2024-09-17T01:01:54.656 INFO:tasks.workunit.client.0.smithi002.stdout:8/425: read d2/d30/f32 [135880,125570] 0 2024-09-17T01:01:54.656 INFO:tasks.workunit.client.1.smithi099.stdout:6/430: symlink dc/d5d/l8b 0 2024-09-17T01:01:54.658 INFO:tasks.workunit.client.1.smithi099.stdout:0/369: symlink da/d12/l78 0 2024-09-17T01:01:54.659 INFO:tasks.workunit.client.0.smithi002.stdout:6/311: rmdir d2/d1d/d2d 39 2024-09-17T01:01:54.660 INFO:tasks.workunit.client.1.smithi099.stdout:6/431: unlink dc/d2b/l5e 0 2024-09-17T01:01:54.665 INFO:tasks.workunit.client.0.smithi002.stdout:7/209: truncate d1/d14/f15 745725 0 2024-09-17T01:01:54.669 INFO:tasks.workunit.client.0.smithi002.stdout:1/308: rmdir d4/d11/d12/d30/d43/d67 39 2024-09-17T01:01:54.669 INFO:tasks.workunit.client.0.smithi002.stdout:1/309: write d4/d11/d1a/f6c [793272,18482] 0 2024-09-17T01:01:54.669 INFO:tasks.workunit.client.0.smithi002.stdout:1/310: chown d4/d22/f2f 3023 1 2024-09-17T01:01:54.672 INFO:tasks.workunit.client.1.smithi099.stdout:1/364: dwrite d0/d2/ff [0,4194304] 0 2024-09-17T01:01:54.672 INFO:tasks.workunit.client.1.smithi099.stdout:0/370: write da/df/d1a/d23/f2a [273926,130540] 0 2024-09-17T01:01:54.673 INFO:tasks.workunit.client.0.smithi002.stdout:0/198: unlink dd/d19/d1c/d1f/d22/l25 0 2024-09-17T01:01:54.673 INFO:tasks.workunit.client.1.smithi099.stdout:2/310: sync 2024-09-17T01:01:54.673 INFO:tasks.workunit.client.1.smithi099.stdout:4/359: sync 2024-09-17T01:01:54.674 INFO:tasks.workunit.client.1.smithi099.stdout:4/360: creat d7/dd/de/d10/d3a/f81 x:0 0 0 2024-09-17T01:01:54.674 INFO:tasks.workunit.client.1.smithi099.stdout:1/365: symlink d0/d2/d9/d4b/d59/l71 0 2024-09-17T01:01:54.674 INFO:tasks.workunit.client.1.smithi099.stdout:4/361: fdatasync d7/dd/de/d10/d3a/f53 0 2024-09-17T01:01:54.674 INFO:tasks.workunit.client.0.smithi002.stdout:3/319: symlink d0/d3/d37/d5a/l6b 0 2024-09-17T01:01:54.675 INFO:tasks.workunit.client.1.smithi099.stdout:1/366: truncate d0/d8/d38/d56/f57 546927 0 2024-09-17T01:01:54.675 INFO:tasks.workunit.client.1.smithi099.stdout:5/413: sync 2024-09-17T01:01:54.675 INFO:tasks.workunit.client.1.smithi099.stdout:5/414: dread - d2/dc/d14/d19/f75 zero size 2024-09-17T01:01:54.675 INFO:tasks.workunit.client.1.smithi099.stdout:5/415: getdents d2 0 2024-09-17T01:01:54.675 INFO:tasks.workunit.client.1.smithi099.stdout:0/371: symlink da/df/d1a/d63/d6a/l79 0 2024-09-17T01:01:54.675 INFO:tasks.workunit.client.0.smithi002.stdout:7/210: symlink d1/d14/d1d/d29/l4a 0 2024-09-17T01:01:54.676 INFO:tasks.workunit.client.1.smithi099.stdout:2/311: readlink d2/d9/d25/d26/d1b/l3b 0 2024-09-17T01:01:54.676 INFO:tasks.workunit.client.1.smithi099.stdout:2/312: dread - d2/f47 zero size 2024-09-17T01:01:54.676 INFO:tasks.workunit.client.1.smithi099.stdout:9/390: sync 2024-09-17T01:01:54.676 INFO:tasks.workunit.client.1.smithi099.stdout:9/391: write da/f64 [4251815,75346] 0 2024-09-17T01:01:54.677 INFO:tasks.workunit.client.0.smithi002.stdout:1/311: creat d4/d11/d12/d14/d17/d56/f6f x:0 0 0 2024-09-17T01:01:54.677 INFO:tasks.workunit.client.0.smithi002.stdout:1/312: truncate d4/d11/d12/d14/d17/d3b/f6e 1001192 0 2024-09-17T01:01:54.677 INFO:tasks.workunit.client.0.smithi002.stdout:1/313: write d4/d11/d12/d14/f2b [615511,58742] 0 2024-09-17T01:01:54.677 INFO:tasks.workunit.client.1.smithi099.stdout:1/367: dread d0/d8/d49/f5e [0,4194304] 0 2024-09-17T01:01:54.677 INFO:tasks.workunit.client.1.smithi099.stdout:1/368: stat d0/d8/f65 0 2024-09-17T01:01:54.677 INFO:tasks.workunit.client.1.smithi099.stdout:1/369: creat d0/d2/d9/f72 x:0 0 0 2024-09-17T01:01:54.678 INFO:tasks.workunit.client.1.smithi099.stdout:0/372: symlink da/df/d1a/d56/l7a 0 2024-09-17T01:01:54.678 INFO:tasks.workunit.client.0.smithi002.stdout:2/336: link l7 d1b/d37/l7e 0 2024-09-17T01:01:54.679 INFO:tasks.workunit.client.0.smithi002.stdout:0/199: symlink dd/d19/d1c/l3e 0 2024-09-17T01:01:54.680 INFO:tasks.workunit.client.0.smithi002.stdout:3/320: creat d0/d3/d17/d6a/f6c x:0 0 0 2024-09-17T01:01:54.680 INFO:tasks.workunit.client.0.smithi002.stdout:3/321: stat d0/l11 0 2024-09-17T01:01:54.680 INFO:tasks.workunit.client.0.smithi002.stdout:3/322: creat d0/d3/d17/f6d x:0 0 0 2024-09-17T01:01:54.681 INFO:tasks.workunit.client.1.smithi099.stdout:1/370: creat d0/d2/f73 x:0 0 0 2024-09-17T01:01:54.681 INFO:tasks.workunit.client.0.smithi002.stdout:7/211: mkdir d1/d14/d1d/d29/d4b 0 2024-09-17T01:01:54.682 INFO:tasks.workunit.client.1.smithi099.stdout:1/371: creat d0/d8/d49/d5a/f74 x:0 0 0 2024-09-17T01:01:54.682 INFO:tasks.workunit.client.0.smithi002.stdout:1/314: getdents d4/d11/d12/d14/d17 0 2024-09-17T01:01:54.682 INFO:tasks.workunit.client.1.smithi099.stdout:1/372: stat d0/c2b 0 2024-09-17T01:01:54.683 INFO:tasks.workunit.client.0.smithi002.stdout:2/337: mkdir d1b/d3f/d59/d7f 0 2024-09-17T01:01:54.683 INFO:tasks.workunit.client.0.smithi002.stdout:2/338: dread - d1b/d37/d48/d4e/f76 zero size 2024-09-17T01:01:54.683 INFO:tasks.workunit.client.0.smithi002.stdout:2/339: dread - d1b/d1d/d38/f61 zero size 2024-09-17T01:01:54.685 INFO:tasks.workunit.client.0.smithi002.stdout:1/315: mknod d4/d11/d1a/c70 0 2024-09-17T01:01:54.685 INFO:tasks.workunit.client.0.smithi002.stdout:1/316: stat d4/d11/d12/d14/d17/d40/f6d 0 2024-09-17T01:01:54.685 INFO:tasks.workunit.client.0.smithi002.stdout:1/317: write d4/d11/d12/d14/d17/f28 [4291372,112669] 0 2024-09-17T01:01:54.685 INFO:tasks.workunit.client.0.smithi002.stdout:1/318: dread - d4/d11/d12/d14/d17/d40/f69 zero size 2024-09-17T01:01:54.686 INFO:tasks.workunit.client.0.smithi002.stdout:1/319: read d4/ff [206555,91734] 0 2024-09-17T01:01:54.686 INFO:tasks.workunit.client.0.smithi002.stdout:3/323: symlink d0/d3/l6e 0 2024-09-17T01:01:54.686 INFO:tasks.workunit.client.0.smithi002.stdout:3/324: truncate d0/d31/d32/f42 1440368 0 2024-09-17T01:01:54.686 INFO:tasks.workunit.client.0.smithi002.stdout:3/325: creat d0/d3/d17/f6f x:0 0 0 2024-09-17T01:01:54.687 INFO:tasks.workunit.client.0.smithi002.stdout:1/320: rename d4/f3f to d4/d11/f71 0 2024-09-17T01:01:54.688 INFO:tasks.workunit.client.0.smithi002.stdout:3/326: symlink d0/d31/l70 0 2024-09-17T01:01:54.688 INFO:tasks.workunit.client.0.smithi002.stdout:3/327: stat d0/d31/d32/l57 0 2024-09-17T01:01:54.688 INFO:tasks.workunit.client.0.smithi002.stdout:0/200: write dd/d19/d1a/f2b [2392069,58552] 0 2024-09-17T01:01:54.689 INFO:tasks.workunit.client.0.smithi002.stdout:1/321: mkdir d4/d11/d12/d30/d43/d72 0 2024-09-17T01:01:54.689 INFO:tasks.workunit.client.0.smithi002.stdout:1/322: fsync d4/d11/d1a/f29 0 2024-09-17T01:01:54.690 INFO:tasks.workunit.client.1.smithi099.stdout:2/313: read d2/d9/d25/f2d [3880746,34683] 0 2024-09-17T01:01:54.690 INFO:tasks.workunit.client.0.smithi002.stdout:3/328: mknod d0/d3/d37/d5a/c71 0 2024-09-17T01:01:54.691 INFO:tasks.workunit.client.0.smithi002.stdout:0/201: creat dd/d3d/f3f x:0 0 0 2024-09-17T01:01:54.691 INFO:tasks.workunit.client.0.smithi002.stdout:0/202: creat dd/f40 x:0 0 0 2024-09-17T01:01:54.691 INFO:tasks.workunit.client.1.smithi099.stdout:2/314: mkdir d2/d9/d25/d26/d1b/d61 0 2024-09-17T01:01:54.693 INFO:tasks.workunit.client.0.smithi002.stdout:0/203: link c3 dd/d3d/c41 0 2024-09-17T01:01:54.694 INFO:tasks.workunit.client.0.smithi002.stdout:0/204: symlink dd/d19/d1c/d33/l42 0 2024-09-17T01:01:54.694 INFO:tasks.workunit.client.1.smithi099.stdout:0/373: dread da/f14 [0,4194304] 0 2024-09-17T01:01:54.694 INFO:tasks.workunit.client.1.smithi099.stdout:0/374: chown da/df/d1a/d23/l2c 285769998 1 2024-09-17T01:01:54.694 INFO:tasks.workunit.client.1.smithi099.stdout:0/375: stat da/df/d1a/f5f 0 2024-09-17T01:01:54.695 INFO:tasks.workunit.client.0.smithi002.stdout:0/205: mkdir dd/d19/d1c/d1f/d22/d43 0 2024-09-17T01:01:54.695 INFO:tasks.workunit.client.0.smithi002.stdout:0/206: stat cb 0 2024-09-17T01:01:54.695 INFO:tasks.workunit.client.0.smithi002.stdout:0/207: read - dd/f40 zero size 2024-09-17T01:01:54.695 INFO:tasks.workunit.client.0.smithi002.stdout:0/208: fsync dd/d19/f1b 0 2024-09-17T01:01:54.695 INFO:tasks.workunit.client.0.smithi002.stdout:1/323: dread d4/d11/d12/d14/d17/d20/f5b [0,4194304] 0 2024-09-17T01:01:54.696 INFO:tasks.workunit.client.1.smithi099.stdout:0/376: symlink da/d12/d22/d52/l7b 0 2024-09-17T01:01:54.696 INFO:tasks.workunit.client.0.smithi002.stdout:0/209: mkdir dd/d44 0 2024-09-17T01:01:54.696 INFO:tasks.workunit.client.0.smithi002.stdout:0/210: fdatasync dd/d19/d1a/f1d 0 2024-09-17T01:01:54.696 INFO:tasks.workunit.client.0.smithi002.stdout:1/324: mknod d4/d11/d12/d30/d43/d67/c73 0 2024-09-17T01:01:54.697 INFO:tasks.workunit.client.1.smithi099.stdout:2/315: dread f0 [0,4194304] 0 2024-09-17T01:01:54.697 INFO:tasks.workunit.client.0.smithi002.stdout:0/211: symlink dd/d19/d1c/l45 0 2024-09-17T01:01:54.697 INFO:tasks.workunit.client.0.smithi002.stdout:0/212: fdatasync dd/d19/f3b 0 2024-09-17T01:01:54.698 INFO:tasks.workunit.client.1.smithi099.stdout:0/377: dread da/d12/d22/d52/f58 [0,4194304] 0 2024-09-17T01:01:54.698 INFO:tasks.workunit.client.1.smithi099.stdout:2/316: symlink d2/d9/d17/l62 0 2024-09-17T01:01:54.698 INFO:tasks.workunit.client.0.smithi002.stdout:1/325: rename d4/d22/f2f to d4/d11/d12/d14/d17/d51/f74 0 2024-09-17T01:01:54.698 INFO:tasks.workunit.client.1.smithi099.stdout:2/317: creat d2/d9/d17/f63 x:0 0 0 2024-09-17T01:01:54.699 INFO:tasks.workunit.client.1.smithi099.stdout:2/318: creat d2/d9/d25/d26/d1b/d2c/d5d/f64 x:0 0 0 2024-09-17T01:01:54.699 INFO:tasks.workunit.client.0.smithi002.stdout:0/213: mknod dd/d19/d1a/d29/c46 0 2024-09-17T01:01:54.700 INFO:tasks.workunit.client.0.smithi002.stdout:0/214: mknod dd/d19/d1c/d1f/d39/c47 0 2024-09-17T01:01:54.700 INFO:tasks.workunit.client.0.smithi002.stdout:0/215: chown dd/d19/f3b 704 1 2024-09-17T01:01:54.701 INFO:tasks.workunit.client.1.smithi099.stdout:2/319: symlink d2/d9/d17/d58/l65 0 2024-09-17T01:01:54.701 INFO:tasks.workunit.client.1.smithi099.stdout:2/320: readlink d2/d9/d25/d26/d1b/l28 0 2024-09-17T01:01:54.701 INFO:tasks.workunit.client.1.smithi099.stdout:2/321: dread - d2/d9/f60 zero size 2024-09-17T01:01:54.701 INFO:tasks.workunit.client.1.smithi099.stdout:2/322: stat d2/d9/d25/l4a 0 2024-09-17T01:01:54.701 INFO:tasks.workunit.client.0.smithi002.stdout:7/212: dwrite d1/d14/d1d/d28/d2d/f35 [0,4194304] 0 2024-09-17T01:01:54.701 INFO:tasks.workunit.client.0.smithi002.stdout:7/213: chown d1/d14/d1d/d29/l4a 0 1 2024-09-17T01:01:54.702 INFO:tasks.workunit.client.0.smithi002.stdout:7/214: dread - d1/d14/f3f zero size 2024-09-17T01:01:54.714 INFO:tasks.workunit.client.0.smithi002.stdout:0/216: dwrite dd/f13 [4194304,4194304] 0 2024-09-17T01:01:54.715 INFO:tasks.workunit.client.0.smithi002.stdout:0/217: write dd/d19/d1a/f2b [4194794,76638] 0 2024-09-17T01:01:54.716 INFO:tasks.workunit.client.0.smithi002.stdout:0/218: chown dd/d19/f2c 389012786 1 2024-09-17T01:01:54.716 INFO:tasks.workunit.client.0.smithi002.stdout:0/219: link dd/d19/l2e dd/d19/d1a/d29/l48 0 2024-09-17T01:01:54.717 INFO:tasks.workunit.client.0.smithi002.stdout:0/220: read dd/f18 [736401,41585] 0 2024-09-17T01:01:54.717 INFO:tasks.workunit.client.0.smithi002.stdout:0/221: truncate f1 1247342 0 2024-09-17T01:01:54.718 INFO:tasks.workunit.client.0.smithi002.stdout:0/222: link l8 dd/d19/d1c/d1f/l49 0 2024-09-17T01:01:54.718 INFO:tasks.workunit.client.0.smithi002.stdout:0/223: chown dd/f15 10007416 1 2024-09-17T01:01:54.719 INFO:tasks.workunit.client.0.smithi002.stdout:0/224: creat dd/d19/d1a/f4a x:0 0 0 2024-09-17T01:01:54.740 INFO:tasks.workunit.client.0.smithi002.stdout:3/329: dread d0/f21 [0,4194304] 0 2024-09-17T01:01:54.741 INFO:tasks.workunit.client.0.smithi002.stdout:3/330: link d0/d31/d32/c67 d0/d3/d37/d5a/d5b/c72 0 2024-09-17T01:01:54.741 INFO:tasks.workunit.client.0.smithi002.stdout:3/331: getdents d0/d31/d32 0 2024-09-17T01:01:54.741 INFO:tasks.workunit.client.0.smithi002.stdout:3/332: truncate d0/d3/d17/f68 597717 0 2024-09-17T01:01:54.748 INFO:tasks.workunit.client.1.smithi099.stdout:9/392: dread da/ff [0,4194304] 0 2024-09-17T01:01:54.748 INFO:tasks.workunit.client.1.smithi099.stdout:9/393: stat da/ff 0 2024-09-17T01:01:54.748 INFO:tasks.workunit.client.1.smithi099.stdout:9/394: dread - da/d21/d2a/f7f zero size 2024-09-17T01:01:54.750 INFO:tasks.workunit.client.1.smithi099.stdout:9/395: creat da/d21/d2a/f8c x:0 0 0 2024-09-17T01:01:54.752 INFO:tasks.workunit.client.1.smithi099.stdout:1/373: rename d0/d8/d49/d5a to d0/d8/d38/d75 0 2024-09-17T01:01:54.754 INFO:tasks.workunit.client.1.smithi099.stdout:2/323: rename d2/c5a to d2/d9/d25/d26/c66 0 2024-09-17T01:01:54.755 INFO:tasks.workunit.client.1.smithi099.stdout:1/374: link d0/d2/de/d31/l5d d0/d2/de/d31/l76 0 2024-09-17T01:01:54.757 INFO:tasks.workunit.client.1.smithi099.stdout:1/375: symlink d0/d2/d9/l77 0 2024-09-17T01:01:54.760 INFO:tasks.workunit.client.1.smithi099.stdout:9/396: dread da/d18/f7e [0,4194304] 0 2024-09-17T01:01:54.760 INFO:tasks.workunit.client.1.smithi099.stdout:9/397: read da/d21/d2a/f36 [7664697,86700] 0 2024-09-17T01:01:54.760 INFO:tasks.workunit.client.1.smithi099.stdout:9/398: fdatasync da/d50/f82 0 2024-09-17T01:01:54.760 INFO:tasks.workunit.client.1.smithi099.stdout:1/376: mknod d0/d2/c78 0 2024-09-17T01:01:54.760 INFO:tasks.workunit.client.1.smithi099.stdout:1/377: stat d0/d2/d9/l2f 0 2024-09-17T01:01:54.761 INFO:tasks.workunit.client.0.smithi002.stdout:9/252: sync 2024-09-17T01:01:54.761 INFO:tasks.workunit.client.1.smithi099.stdout:9/399: symlink da/d1b/l8d 0 2024-09-17T01:01:54.761 INFO:tasks.workunit.client.1.smithi099.stdout:9/400: stat da/l20 0 2024-09-17T01:01:54.762 INFO:tasks.workunit.client.1.smithi099.stdout:1/378: mkdir d0/d8/d49/d79 0 2024-09-17T01:01:54.762 INFO:tasks.workunit.client.1.smithi099.stdout:1/379: dread - d0/d2/d18/f6b zero size 2024-09-17T01:01:54.762 INFO:tasks.workunit.client.0.smithi002.stdout:9/253: creat d5/f44 x:0 0 0 2024-09-17T01:01:54.762 INFO:tasks.workunit.client.1.smithi099.stdout:9/401: mkdir da/d8e 0 2024-09-17T01:01:54.763 INFO:tasks.workunit.client.1.smithi099.stdout:1/380: unlink d0/d2/d9/d4b/d59/l71 0 2024-09-17T01:01:54.763 INFO:tasks.workunit.client.1.smithi099.stdout:1/381: truncate d0/d2/d9/f6f 285470 0 2024-09-17T01:01:54.763 INFO:tasks.workunit.client.1.smithi099.stdout:1/382: write d0/f13 [4343871,130178] 0 2024-09-17T01:01:54.763 INFO:tasks.workunit.client.1.smithi099.stdout:1/383: dread - d0/d2/d18/f6b zero size 2024-09-17T01:01:54.764 INFO:tasks.workunit.client.0.smithi002.stdout:9/254: truncate d5/f14 792517 0 2024-09-17T01:01:54.764 INFO:tasks.workunit.client.0.smithi002.stdout:9/255: mkdir d5/dc/d26/d34/d36/d45 0 2024-09-17T01:01:54.764 INFO:tasks.workunit.client.1.smithi099.stdout:9/402: creat da/d21/f8f x:0 0 0 2024-09-17T01:01:54.765 INFO:tasks.workunit.client.0.smithi002.stdout:0/225: dwrite dd/f18 [0,4194304] 0 2024-09-17T01:01:54.765 INFO:tasks.workunit.client.1.smithi099.stdout:5/416: dwrite d2/f63 [0,4194304] 0 2024-09-17T01:01:54.766 INFO:tasks.workunit.client.0.smithi002.stdout:9/256: dread d5/dc/f3d [0,4194304] 0 2024-09-17T01:01:54.766 INFO:tasks.workunit.client.0.smithi002.stdout:9/257: chown d5/fb 1004 1 2024-09-17T01:01:54.766 INFO:tasks.workunit.client.0.smithi002.stdout:1/326: dwrite d4/d11/d12/d14/f1b [0,4194304] 0 2024-09-17T01:01:54.766 INFO:tasks.workunit.client.0.smithi002.stdout:6/312: dwrite d2/f16 [0,4194304] 0 2024-09-17T01:01:54.767 INFO:tasks.workunit.client.1.smithi099.stdout:9/403: link da/d18/c1f da/d56/d84/c90 0 2024-09-17T01:01:54.767 INFO:tasks.workunit.client.1.smithi099.stdout:9/404: write da/d21/d2a/f54 [966049,65506] 0 2024-09-17T01:01:54.768 INFO:tasks.workunit.client.1.smithi099.stdout:5/417: creat d2/d45/f7d x:0 0 0 2024-09-17T01:01:54.770 INFO:tasks.workunit.client.0.smithi002.stdout:9/258: unlink d5/f1e 0 2024-09-17T01:01:54.770 INFO:tasks.workunit.client.0.smithi002.stdout:9/259: chown d5/f29 628831310 1 2024-09-17T01:01:54.772 INFO:tasks.workunit.client.1.smithi099.stdout:5/418: write d2/dc/d17/f59 [3553655,125061] 0 2024-09-17T01:01:54.772 INFO:tasks.workunit.client.1.smithi099.stdout:5/419: write d2/f7 [174154,17214] 0 2024-09-17T01:01:54.773 INFO:tasks.workunit.client.1.smithi099.stdout:5/420: stat d2/dc/d17/d3c/d72 0 2024-09-17T01:01:54.773 INFO:tasks.workunit.client.1.smithi099.stdout:5/421: getdents d2 0 2024-09-17T01:01:54.774 INFO:tasks.workunit.client.0.smithi002.stdout:1/327: unlink d4/f18 0 2024-09-17T01:01:54.776 INFO:tasks.workunit.client.0.smithi002.stdout:3/333: dwrite d0/d3/d33/d40/f65 [0,4194304] 0 2024-09-17T01:01:54.776 INFO:tasks.workunit.client.0.smithi002.stdout:3/334: chown d0/d3/d17/l54 1334976 1 2024-09-17T01:01:54.776 INFO:tasks.workunit.client.0.smithi002.stdout:3/335: chown d0/d3/d17/f3a 73834 1 2024-09-17T01:01:54.776 INFO:tasks.workunit.client.0.smithi002.stdout:3/336: chown d0/d3/l9 0 1 2024-09-17T01:01:54.776 INFO:tasks.workunit.client.0.smithi002.stdout:3/337: chown d0/f1f 7 1 2024-09-17T01:01:54.778 INFO:tasks.workunit.client.0.smithi002.stdout:7/215: dwrite d1/d14/f15 [0,4194304] 0 2024-09-17T01:01:54.778 INFO:tasks.workunit.client.0.smithi002.stdout:6/313: creat d2/d1d/f57 x:0 0 0 2024-09-17T01:01:54.778 INFO:tasks.workunit.client.0.smithi002.stdout:5/327: sync 2024-09-17T01:01:54.778 INFO:tasks.workunit.client.0.smithi002.stdout:5/328: read - d2/d2d/d10/f66 zero size 2024-09-17T01:01:54.781 INFO:tasks.workunit.client.0.smithi002.stdout:1/328: dread d4/d11/d12/d14/d17/d51/f74 [0,4194304] 0 2024-09-17T01:01:54.784 INFO:tasks.workunit.client.0.smithi002.stdout:5/329: dread d2/d2d/d10/f58 [0,4194304] 0 2024-09-17T01:01:54.786 INFO:tasks.workunit.client.0.smithi002.stdout:9/260: mkdir d5/dc/d26/d46 0 2024-09-17T01:01:54.786 INFO:tasks.workunit.client.0.smithi002.stdout:9/261: chown d5/dc/l17 2 1 2024-09-17T01:01:54.787 INFO:tasks.workunit.client.0.smithi002.stdout:7/216: dread d1/d14/d1d/d29/f2f [0,4194304] 0 2024-09-17T01:01:54.787 INFO:tasks.workunit.client.0.smithi002.stdout:7/217: chown d1/l12 3305 1 2024-09-17T01:01:54.789 INFO:tasks.workunit.client.0.smithi002.stdout:3/338: link d0/d3/d37/d5a/f5c d0/d3/d37/f73 0 2024-09-17T01:01:54.792 INFO:tasks.workunit.client.0.smithi002.stdout:3/339: dread d0/d3/d17/f68 [0,4194304] 0 2024-09-17T01:01:54.792 INFO:tasks.workunit.client.0.smithi002.stdout:1/329: dread d4/d11/d12/d14/d17/d51/f74 [0,4194304] 0 2024-09-17T01:01:54.792 INFO:tasks.workunit.client.0.smithi002.stdout:3/340: dread - d0/d3/d33/d40/f45 zero size 2024-09-17T01:01:54.792 INFO:tasks.workunit.client.0.smithi002.stdout:6/314: link d2/d1d/d2d/d35/d37/c3b d2/dc/d24/c58 0 2024-09-17T01:01:54.793 INFO:tasks.workunit.client.0.smithi002.stdout:9/262: rename d5/dc/d26/d34/d36/d45 to d5/dc/d26/d46/d47 0 2024-09-17T01:01:54.794 INFO:tasks.workunit.client.0.smithi002.stdout:1/330: rmdir d4/d11/d12/d30/d43/d72 0 2024-09-17T01:01:54.795 INFO:tasks.workunit.client.0.smithi002.stdout:0/226: dwrite dd/f36 [0,4194304] 0 2024-09-17T01:01:54.795 INFO:tasks.workunit.client.1.smithi099.stdout:9/405: dwrite da/d50/f82 [0,4194304] 0 2024-09-17T01:01:54.796 INFO:tasks.workunit.client.0.smithi002.stdout:3/341: rename d0/d3/d37/f73 to d0/d3/d37/f74 0 2024-09-17T01:01:54.798 INFO:tasks.workunit.client.1.smithi099.stdout:9/406: symlink da/d18/d5e/l91 0 2024-09-17T01:01:54.798 INFO:tasks.workunit.client.1.smithi099.stdout:2/324: dwrite d2/d9/d17/f51 [4194304,4194304] 0 2024-09-17T01:01:54.800 INFO:tasks.workunit.client.1.smithi099.stdout:9/407: link da/d21/c55 da/d18/c92 0 2024-09-17T01:01:54.800 INFO:tasks.workunit.client.1.smithi099.stdout:9/408: chown da/d50/f86 4 1 2024-09-17T01:01:54.800 INFO:tasks.workunit.client.0.smithi002.stdout:6/315: rename d2/d1d/c38 to d2/d1d/d2d/d35/c59 0 2024-09-17T01:01:54.800 INFO:tasks.workunit.client.0.smithi002.stdout:6/316: chown d2/d1d/d26/d40/c47 86097 1 2024-09-17T01:01:54.801 INFO:tasks.workunit.client.0.smithi002.stdout:9/263: creat d5/dc/d26/d46/d47/f48 x:0 0 0 2024-09-17T01:01:54.801 INFO:tasks.workunit.client.0.smithi002.stdout:9/264: creat d5/f49 x:0 0 0 2024-09-17T01:01:54.802 INFO:tasks.workunit.client.0.smithi002.stdout:7/218: write f0 [2725909,118169] 0 2024-09-17T01:01:54.803 INFO:tasks.workunit.client.1.smithi099.stdout:2/325: link d2/d9/d25/d26/d1b/d2c/d3f/l56 d2/d9/d25/d26/l67 0 2024-09-17T01:01:54.804 INFO:tasks.workunit.client.1.smithi099.stdout:9/409: mknod da/d1b/d3a/d4b/c93 0 2024-09-17T01:01:54.805 INFO:tasks.workunit.client.1.smithi099.stdout:2/326: mkdir d2/d9/d25/d68 0 2024-09-17T01:01:54.807 INFO:tasks.workunit.client.1.smithi099.stdout:2/327: unlink d2/l5c 0 2024-09-17T01:01:54.807 INFO:tasks.workunit.client.1.smithi099.stdout:7/340: sync 2024-09-17T01:01:54.807 INFO:tasks.workunit.client.1.smithi099.stdout:8/359: sync 2024-09-17T01:01:54.807 INFO:tasks.workunit.client.1.smithi099.stdout:3/367: sync 2024-09-17T01:01:54.807 INFO:tasks.workunit.client.0.smithi002.stdout:3/342: symlink d0/d3/d33/d40/l75 0 2024-09-17T01:01:54.808 INFO:tasks.workunit.client.1.smithi099.stdout:7/341: mknod d1/d37/c6e 0 2024-09-17T01:01:54.810 INFO:tasks.workunit.client.1.smithi099.stdout:8/360: unlink d0/f40 0 2024-09-17T01:01:54.810 INFO:tasks.workunit.client.1.smithi099.stdout:8/361: creat d0/d1f/d31/d4c/f75 x:0 0 0 2024-09-17T01:01:54.810 INFO:tasks.workunit.client.1.smithi099.stdout:8/362: write d0/d1f/d31/f38 [2906361,9499] 0 2024-09-17T01:01:54.810 INFO:tasks.workunit.client.1.smithi099.stdout:8/363: dread - d0/f74 zero size 2024-09-17T01:01:54.811 INFO:tasks.workunit.client.1.smithi099.stdout:3/368: creat d9/d2b/d52/f6f x:0 0 0 2024-09-17T01:01:54.811 INFO:tasks.workunit.client.0.smithi002.stdout:6/317: mkdir d2/d1d/d2d/d5a 0 2024-09-17T01:01:54.811 INFO:tasks.workunit.client.0.smithi002.stdout:6/318: dread - d2/d1d/f57 zero size 2024-09-17T01:01:54.811 INFO:tasks.workunit.client.0.smithi002.stdout:6/319: dread - d2/d1d/f57 zero size 2024-09-17T01:01:54.812 INFO:tasks.workunit.client.0.smithi002.stdout:7/219: symlink d1/d14/d1d/d29/d30/l4c 0 2024-09-17T01:01:54.813 INFO:tasks.workunit.client.1.smithi099.stdout:8/364: rename d0/f1d to d0/d1f/d31/d4c/f76 0 2024-09-17T01:01:54.813 INFO:tasks.workunit.client.0.smithi002.stdout:3/343: symlink d0/d3/d37/d5a/d5b/l76 0 2024-09-17T01:01:54.815 INFO:tasks.workunit.client.1.smithi099.stdout:8/365: rename d0/l5e to d0/l77 0 2024-09-17T01:01:54.815 INFO:tasks.workunit.client.1.smithi099.stdout:8/366: truncate d0/d4/f50 30921 0 2024-09-17T01:01:54.815 INFO:tasks.workunit.client.1.smithi099.stdout:8/367: creat d0/d4/d29/f78 x:0 0 0 2024-09-17T01:01:54.815 INFO:tasks.workunit.client.1.smithi099.stdout:8/368: creat d0/d1f/d31/f79 x:0 0 0 2024-09-17T01:01:54.815 INFO:tasks.workunit.client.0.smithi002.stdout:1/331: rename d4/ld to d4/d11/d12/d23/d32/l75 0 2024-09-17T01:01:54.816 INFO:tasks.workunit.client.1.smithi099.stdout:8/369: symlink d0/d1f/l7a 0 2024-09-17T01:01:54.816 INFO:tasks.workunit.client.1.smithi099.stdout:8/370: dread - d0/d4/d29/f58 zero size 2024-09-17T01:01:54.817 INFO:tasks.workunit.client.1.smithi099.stdout:9/410: dread da/d1b/d3a/f23 [0,4194304] 0 2024-09-17T01:01:54.818 INFO:tasks.workunit.client.0.smithi002.stdout:6/320: truncate d2/f18 3570109 0 2024-09-17T01:01:54.819 INFO:tasks.workunit.client.0.smithi002.stdout:3/344: mkdir d0/d3/d33/d77 0 2024-09-17T01:01:54.820 INFO:tasks.workunit.client.0.smithi002.stdout:1/332: getdents d4/d11 0 2024-09-17T01:01:54.820 INFO:tasks.workunit.client.0.smithi002.stdout:1/333: readlink d4/l21 0 2024-09-17T01:01:54.821 INFO:tasks.workunit.client.0.smithi002.stdout:6/321: mknod d2/d1d/d26/d40/d43/c5b 0 2024-09-17T01:01:54.822 INFO:tasks.workunit.client.1.smithi099.stdout:2/328: write d2/d9/d25/d26/f29 [2483075,11585] 0 2024-09-17T01:01:54.822 INFO:tasks.workunit.client.1.smithi099.stdout:2/329: truncate d2/d9/d25/f4f 318582 0 2024-09-17T01:01:54.822 INFO:tasks.workunit.client.0.smithi002.stdout:3/345: rename d0/d31/f56 to d0/d3/d33/d4a/f78 0 2024-09-17T01:01:54.824 INFO:tasks.workunit.client.0.smithi002.stdout:1/334: unlink d4/d11/d12/d23/f35 0 2024-09-17T01:01:54.826 INFO:tasks.workunit.client.0.smithi002.stdout:6/322: mkdir d2/d1d/d26/d40/d43/d5c 0 2024-09-17T01:01:54.826 INFO:tasks.workunit.client.0.smithi002.stdout:6/323: chown d2/dc/d24 3 1 2024-09-17T01:01:54.826 INFO:tasks.workunit.client.1.smithi099.stdout:1/384: dwrite d0/fc [4194304,4194304] 0 2024-09-17T01:01:54.827 INFO:tasks.workunit.client.0.smithi002.stdout:3/346: rmdir d0/d31/d32 39 2024-09-17T01:01:54.827 INFO:tasks.workunit.client.0.smithi002.stdout:3/347: write d0/d3/d33/d40/f52 [3635428,88042] 0 2024-09-17T01:01:54.827 INFO:tasks.workunit.client.0.smithi002.stdout:1/335: symlink d4/d11/d12/d14/d17/d40/l76 0 2024-09-17T01:01:54.828 INFO:tasks.workunit.client.1.smithi099.stdout:7/342: dread d1/f24 [0,4194304] 0 2024-09-17T01:01:54.828 INFO:tasks.workunit.client.1.smithi099.stdout:7/343: fsync d1/f25 0 2024-09-17T01:01:54.829 INFO:tasks.workunit.client.1.smithi099.stdout:7/344: write d1/d37/f56 [670421,125964] 0 2024-09-17T01:01:54.829 INFO:tasks.workunit.client.0.smithi002.stdout:1/336: unlink d4/d11/d12/d14/d17/d56/l61 0 2024-09-17T01:01:54.832 INFO:tasks.workunit.client.1.smithi099.stdout:7/345: mkdir d1/d2c/d5c/d1c/d5a/d6f 0 2024-09-17T01:01:54.832 INFO:tasks.workunit.client.0.smithi002.stdout:9/265: dwrite d5/f44 [0,4194304] 0 2024-09-17T01:01:54.832 INFO:tasks.workunit.client.0.smithi002.stdout:9/266: chown d5/dc/l39 142226560 1 2024-09-17T01:01:54.833 INFO:tasks.workunit.client.0.smithi002.stdout:9/267: dread - d5/dc/d26/f31 zero size 2024-09-17T01:01:54.833 INFO:tasks.workunit.client.0.smithi002.stdout:9/268: chown d5/dc/d26/c30 36147 1 2024-09-17T01:01:54.833 INFO:tasks.workunit.client.0.smithi002.stdout:1/337: truncate d4/d11/d1a/f6c 486550 0 2024-09-17T01:01:54.833 INFO:tasks.workunit.client.1.smithi099.stdout:5/422: dwrite f0 [0,4194304] 0 2024-09-17T01:01:54.833 INFO:tasks.workunit.client.1.smithi099.stdout:8/371: write d0/f61 [90315,19388] 0 2024-09-17T01:01:54.834 INFO:tasks.workunit.client.1.smithi099.stdout:1/385: dread d0/f64 [0,4194304] 0 2024-09-17T01:01:54.835 INFO:tasks.workunit.client.0.smithi002.stdout:3/348: write d0/d3/f1a [3007562,103037] 0 2024-09-17T01:01:54.835 INFO:tasks.workunit.client.0.smithi002.stdout:3/349: write d0/fd [4676065,74156] 0 2024-09-17T01:01:54.835 INFO:tasks.workunit.client.1.smithi099.stdout:8/372: link d0/d53/f59 d0/d1f/d31/f7b 0 2024-09-17T01:01:54.836 INFO:tasks.workunit.client.1.smithi099.stdout:1/386: creat d0/d2/d61/f7a x:0 0 0 2024-09-17T01:01:54.836 INFO:tasks.workunit.client.1.smithi099.stdout:1/387: chown d0/d2/d51/c5f 14905966 1 2024-09-17T01:01:54.837 INFO:tasks.workunit.client.1.smithi099.stdout:8/373: rename d0/d1f/d31/f3b to d0/f7c 0 2024-09-17T01:01:54.837 INFO:tasks.workunit.client.0.smithi002.stdout:1/338: rename f3 to d4/d11/d12/d30/d5e/f77 0 2024-09-17T01:01:54.839 INFO:tasks.workunit.client.0.smithi002.stdout:7/220: dread d1/d14/d1d/d21/d45/f43 [0,4194304] 0 2024-09-17T01:01:54.839 INFO:tasks.workunit.client.1.smithi099.stdout:1/388: getdents d0 0 2024-09-17T01:01:54.839 INFO:tasks.workunit.client.1.smithi099.stdout:1/389: chown d0/d8/d49/d4e 11102 1 2024-09-17T01:01:54.840 INFO:tasks.workunit.client.0.smithi002.stdout:0/227: dwrite dd/d19/f3a [0,4194304] 0 2024-09-17T01:01:54.843 INFO:tasks.workunit.client.0.smithi002.stdout:9/269: write d5/f44 [2397419,110916] 0 2024-09-17T01:01:54.844 INFO:tasks.workunit.client.1.smithi099.stdout:1/390: getdents d0/d2/d5 0 2024-09-17T01:01:54.847 INFO:tasks.workunit.client.0.smithi002.stdout:1/339: mknod d4/d11/d12/d14/d17/d20/c78 0 2024-09-17T01:01:54.848 INFO:tasks.workunit.client.1.smithi099.stdout:5/423: dread d2/dc/d17/d3c/f46 [0,4194304] 0 2024-09-17T01:01:54.848 INFO:tasks.workunit.client.1.smithi099.stdout:5/424: fdatasync d2/dc/d17/f53 0 2024-09-17T01:01:54.848 INFO:tasks.workunit.client.0.smithi002.stdout:7/221: symlink d1/d14/d1d/d21/d45/l4d 0 2024-09-17T01:01:54.849 INFO:tasks.workunit.client.1.smithi099.stdout:1/391: creat d0/f7b x:0 0 0 2024-09-17T01:01:54.849 INFO:tasks.workunit.client.1.smithi099.stdout:1/392: creat d0/d8/f7c x:0 0 0 2024-09-17T01:01:54.849 INFO:tasks.workunit.client.1.smithi099.stdout:1/393: readlink d0/d2/de/l35 0 2024-09-17T01:01:54.850 INFO:tasks.workunit.client.0.smithi002.stdout:0/228: symlink dd/d3d/l4b 0 2024-09-17T01:01:54.850 INFO:tasks.workunit.client.0.smithi002.stdout:0/229: readlink dd/d19/l23 0 2024-09-17T01:01:54.851 INFO:tasks.workunit.client.1.smithi099.stdout:3/369: dwrite d9/d15/f50 [0,4194304] 0 2024-09-17T01:01:54.851 INFO:tasks.workunit.client.1.smithi099.stdout:3/370: read d9/d15/d18/d1a/d23/f17 [5502698,53894] 0 2024-09-17T01:01:54.853 INFO:tasks.workunit.client.0.smithi002.stdout:1/340: mknod d4/d11/d12/d14/d17/d3b/c79 0 2024-09-17T01:01:54.853 INFO:tasks.workunit.client.0.smithi002.stdout:1/341: chown d4/d11/d12/d14/d17/d51/f5d 160 1 2024-09-17T01:01:54.854 INFO:tasks.workunit.client.0.smithi002.stdout:7/222: creat d1/d14/d1d/d29/d4b/f4e x:0 0 0 2024-09-17T01:01:54.854 INFO:tasks.workunit.client.0.smithi002.stdout:7/223: readlink d1/d14/d1d/l2c 0 2024-09-17T01:01:54.855 INFO:tasks.workunit.client.0.smithi002.stdout:7/224: dread - d1/d14/d1d/d29/d4b/f4e zero size 2024-09-17T01:01:54.855 INFO:tasks.workunit.client.0.smithi002.stdout:7/225: chown d1/d14/d1d/d29/l33 440016 1 2024-09-17T01:01:54.855 INFO:tasks.workunit.client.1.smithi099.stdout:3/371: link d9/d3b/d44/f6d d9/d3b/f70 0 2024-09-17T01:01:54.855 INFO:tasks.workunit.client.1.smithi099.stdout:3/372: dread - d9/d15/d18/d1a/d23/f68 zero size 2024-09-17T01:01:54.855 INFO:tasks.workunit.client.1.smithi099.stdout:3/373: write d9/d15/f40 [80701,48654] 0 2024-09-17T01:01:54.855 INFO:tasks.workunit.client.1.smithi099.stdout:3/374: readlink d9/l6a 0 2024-09-17T01:01:54.855 INFO:tasks.workunit.client.1.smithi099.stdout:2/330: dwrite d2/d9/d25/d26/d1b/d2c/f3d [0,4194304] 0 2024-09-17T01:01:54.855 INFO:tasks.workunit.client.1.smithi099.stdout:2/331: creat d2/d9/d17/f69 x:0 0 0 2024-09-17T01:01:54.856 INFO:tasks.workunit.client.0.smithi002.stdout:0/230: rename l8 to dd/d19/d1c/d1f/d22/l4c 0 2024-09-17T01:01:54.857 INFO:tasks.workunit.client.0.smithi002.stdout:7/226: dread d1/d24/f46 [0,4194304] 0 2024-09-17T01:01:54.857 INFO:tasks.workunit.client.0.smithi002.stdout:7/227: read - d1/d14/d1d/d29/d4b/f4e zero size 2024-09-17T01:01:54.858 INFO:tasks.workunit.client.0.smithi002.stdout:0/231: creat dd/d19/d1c/f4d x:0 0 0 2024-09-17T01:01:54.858 INFO:tasks.workunit.client.0.smithi002.stdout:0/232: truncate dd/d19/d1a/f4a 671292 0 2024-09-17T01:01:54.858 INFO:tasks.workunit.client.0.smithi002.stdout:0/233: creat dd/d19/f4e x:0 0 0 2024-09-17T01:01:54.859 INFO:tasks.workunit.client.0.smithi002.stdout:7/228: creat d1/d14/d1d/d28/f4f x:0 0 0 2024-09-17T01:01:54.861 INFO:tasks.workunit.client.0.smithi002.stdout:0/234: mknod dd/d19/d1c/d1f/d39/c4f 0 2024-09-17T01:01:54.864 INFO:tasks.workunit.client.0.smithi002.stdout:7/229: mkdir d1/d14/d1d/d29/d30/d50 0 2024-09-17T01:01:54.864 INFO:tasks.workunit.client.0.smithi002.stdout:7/230: chown d1/d24/c39 56388 1 2024-09-17T01:01:54.866 INFO:tasks.workunit.client.0.smithi002.stdout:7/231: truncate d1/d14/d1d/d21/d45/f43 4002887 0 2024-09-17T01:01:54.866 INFO:tasks.workunit.client.0.smithi002.stdout:7/232: chown d1/f5 416 1 2024-09-17T01:01:54.867 INFO:tasks.workunit.client.0.smithi002.stdout:7/233: dread - d1/d14/d1d/d29/d4b/f4e zero size 2024-09-17T01:01:54.867 INFO:tasks.workunit.client.0.smithi002.stdout:7/234: chown d1/d14 103768 1 2024-09-17T01:01:54.869 INFO:tasks.workunit.client.0.smithi002.stdout:7/235: mknod d1/d14/d1d/d29/d30/d3c/c51 0 2024-09-17T01:01:54.869 INFO:tasks.workunit.client.0.smithi002.stdout:7/236: fdatasync d1/f5 0 2024-09-17T01:01:54.871 INFO:tasks.workunit.client.0.smithi002.stdout:4/332: sync 2024-09-17T01:01:54.872 INFO:tasks.workunit.client.1.smithi099.stdout:3/375: read d9/d15/f59 [3053090,71950] 0 2024-09-17T01:01:54.873 INFO:tasks.workunit.client.0.smithi002.stdout:4/333: rename d7/d3f/d48 to d7/de/d55/d62 0 2024-09-17T01:01:54.874 INFO:tasks.workunit.client.1.smithi099.stdout:8/374: rmdir d0 39 2024-09-17T01:01:54.874 INFO:tasks.workunit.client.1.smithi099.stdout:2/332: dread f0 [0,4194304] 0 2024-09-17T01:01:54.875 INFO:tasks.workunit.client.1.smithi099.stdout:3/376: symlink d9/d15/l71 0 2024-09-17T01:01:54.876 INFO:tasks.workunit.client.1.smithi099.stdout:2/333: creat d2/d9/d25/d26/d1b/d61/f6a x:0 0 0 2024-09-17T01:01:54.876 INFO:tasks.workunit.client.1.smithi099.stdout:2/334: dread - d2/d9/d17/f69 zero size 2024-09-17T01:01:54.877 INFO:tasks.workunit.client.0.smithi002.stdout:4/334: mknod d7/de/c63 0 2024-09-17T01:01:54.877 INFO:tasks.workunit.client.1.smithi099.stdout:3/377: mkdir d9/d2b/d52/d72 0 2024-09-17T01:01:54.879 INFO:tasks.workunit.client.1.smithi099.stdout:3/378: symlink d9/d15/d18/d1a/d23/l73 0 2024-09-17T01:01:54.880 INFO:tasks.workunit.client.1.smithi099.stdout:2/335: rmdir d2/d9/d25/d26/d1b/d2c/d5d 39 2024-09-17T01:01:54.883 INFO:tasks.workunit.client.1.smithi099.stdout:3/379: rename d9/d3b/f4f to d9/d15/d18/d1a/d23/d4c/f74 0 2024-09-17T01:01:54.883 INFO:tasks.workunit.client.1.smithi099.stdout:3/380: fdatasync d9/d15/f63 0 2024-09-17T01:01:54.883 INFO:tasks.workunit.client.1.smithi099.stdout:3/381: creat d9/d2b/d52/f75 x:0 0 0 2024-09-17T01:01:54.883 INFO:tasks.workunit.client.1.smithi099.stdout:3/382: rename d9/d2b/d6b to d9/d2b/d6b/d76 22 2024-09-17T01:01:54.885 INFO:tasks.workunit.client.1.smithi099.stdout:2/336: unlink d2/d7/l37 0 2024-09-17T01:01:54.886 INFO:tasks.workunit.client.1.smithi099.stdout:7/346: dwrite d1/d36/f62 [0,4194304] 0 2024-09-17T01:01:54.886 INFO:tasks.workunit.client.1.smithi099.stdout:7/347: write d1/d2c/f40 [1932113,7669] 0 2024-09-17T01:01:54.886 INFO:tasks.workunit.client.1.smithi099.stdout:7/348: write d1/d2c/f66 [990432,45157] 0 2024-09-17T01:01:54.888 INFO:tasks.workunit.client.1.smithi099.stdout:7/349: symlink d1/d2c/d5c/d12/l70 0 2024-09-17T01:01:54.902 INFO:tasks.workunit.client.1.smithi099.stdout:8/375: dread d0/f7c [0,4194304] 0 2024-09-17T01:01:54.905 INFO:tasks.workunit.client.1.smithi099.stdout:8/376: dread d0/d1f/f12 [4194304,4194304] 0 2024-09-17T01:01:54.905 INFO:tasks.workunit.client.1.smithi099.stdout:8/377: creat d0/d1f/d31/d4c/f7d x:0 0 0 2024-09-17T01:01:54.907 INFO:tasks.workunit.client.1.smithi099.stdout:8/378: rename d0/d1f/d31/d4c/f75 to d0/d1f/d55/f7e 0 2024-09-17T01:01:54.907 INFO:tasks.workunit.client.1.smithi099.stdout:8/379: mknod d0/d4/d29/c7f 0 2024-09-17T01:01:54.914 INFO:tasks.workunit.client.1.smithi099.stdout:5/425: dwrite d2/d8/f35 [0,4194304] 0 2024-09-17T01:01:54.914 INFO:tasks.workunit.client.1.smithi099.stdout:1/394: dwrite d0/d2/d9/f30 [4194304,4194304] 0 2024-09-17T01:01:54.915 INFO:tasks.workunit.client.0.smithi002.stdout:7/237: dwrite d1/f11 [0,4194304] 0 2024-09-17T01:01:54.915 INFO:tasks.workunit.client.0.smithi002.stdout:7/238: read d1/d24/f31 [479271,42449] 0 2024-09-17T01:01:54.915 INFO:tasks.workunit.client.0.smithi002.stdout:1/342: fsync d4/d11/d12/d14/d17/d3b/f42 0 2024-09-17T01:01:54.915 INFO:tasks.workunit.client.0.smithi002.stdout:1/343: write d4/ff [1243581,85868] 0 2024-09-17T01:01:54.919 INFO:tasks.workunit.client.1.smithi099.stdout:5/426: link d2/dc/d14/d19/f4b d2/dc/d14/d36/f7e 0 2024-09-17T01:01:54.919 INFO:tasks.workunit.client.1.smithi099.stdout:5/427: dread - d2/dc/d17/f70 zero size 2024-09-17T01:01:54.920 INFO:tasks.workunit.client.0.smithi002.stdout:9/270: dwrite d5/dc/d26/f2d [0,4194304] 0 2024-09-17T01:01:54.920 INFO:tasks.workunit.client.0.smithi002.stdout:3/350: dwrite d0/d3/f1a [4194304,4194304] 0 2024-09-17T01:01:54.920 INFO:tasks.workunit.client.0.smithi002.stdout:0/235: dwrite dd/d19/d1a/f1d [0,4194304] 0 2024-09-17T01:01:54.922 INFO:tasks.workunit.client.1.smithi099.stdout:3/383: dwrite d9/d3b/f69 [0,4194304] 0 2024-09-17T01:01:54.922 INFO:tasks.workunit.client.1.smithi099.stdout:1/395: mknod d0/d2/d9/c7d 0 2024-09-17T01:01:54.922 INFO:tasks.workunit.client.1.smithi099.stdout:1/396: creat d0/d8/f7e x:0 0 0 2024-09-17T01:01:54.922 INFO:tasks.workunit.client.1.smithi099.stdout:1/397: chown d0/f13 278280 1 2024-09-17T01:01:54.923 INFO:tasks.workunit.client.0.smithi002.stdout:4/335: dwrite d7/de/d3a/f3c [0,4194304] 0 2024-09-17T01:01:54.925 INFO:tasks.workunit.client.0.smithi002.stdout:9/271: stat d5/dc/c2f 0 2024-09-17T01:01:54.927 INFO:tasks.workunit.client.1.smithi099.stdout:3/384: write d9/d15/d18/d1a/d23/f2c [2973833,107367] 0 2024-09-17T01:01:54.929 INFO:tasks.workunit.client.0.smithi002.stdout:1/344: dread d4/d11/d12/d14/f36 [0,4194304] 0 2024-09-17T01:01:54.932 INFO:tasks.workunit.client.1.smithi099.stdout:1/398: creat d0/d8/d49/d79/f7f x:0 0 0 2024-09-17T01:01:54.936 INFO:tasks.workunit.client.1.smithi099.stdout:1/399: mknod d0/d2/d51/c80 0 2024-09-17T01:01:54.937 INFO:tasks.workunit.client.1.smithi099.stdout:8/380: getdents d0/d4/d29 0 2024-09-17T01:01:54.937 INFO:tasks.workunit.client.0.smithi002.stdout:4/336: dread d7/de/d32/f40 [0,4194304] 0 2024-09-17T01:01:54.937 INFO:tasks.workunit.client.0.smithi002.stdout:0/236: truncate dd/f13 2158561 0 2024-09-17T01:01:54.938 INFO:tasks.workunit.client.1.smithi099.stdout:1/400: symlink d0/d8/d38/d56/l81 0 2024-09-17T01:01:54.940 INFO:tasks.workunit.client.1.smithi099.stdout:8/381: mknod d0/d41/d5a/c80 0 2024-09-17T01:01:54.940 INFO:tasks.workunit.client.1.smithi099.stdout:8/382: chown d0/d1f/d31/f38 60295699 1 2024-09-17T01:01:54.940 INFO:tasks.workunit.client.1.smithi099.stdout:8/383: truncate d0/d1f/f2b 9575847 0 2024-09-17T01:01:54.941 INFO:tasks.workunit.client.0.smithi002.stdout:9/272: mknod d5/dc/d26/c4a 0 2024-09-17T01:01:54.941 INFO:tasks.workunit.client.0.smithi002.stdout:1/345: mkdir d4/d11/d55/d7a 0 2024-09-17T01:01:54.942 INFO:tasks.workunit.client.0.smithi002.stdout:1/346: write d4/d22/f39 [609126,124975] 0 2024-09-17T01:01:54.942 INFO:tasks.workunit.client.0.smithi002.stdout:4/337: rename d7/d19/d34/c37 to d7/de/c64 0 2024-09-17T01:01:54.943 INFO:tasks.workunit.client.0.smithi002.stdout:9/273: dread d5/dc/d26/f2e [0,4194304] 0 2024-09-17T01:01:54.943 INFO:tasks.workunit.client.0.smithi002.stdout:0/237: unlink lc 0 2024-09-17T01:01:54.943 INFO:tasks.workunit.client.0.smithi002.stdout:0/238: creat dd/d3d/f50 x:0 0 0 2024-09-17T01:01:54.944 INFO:tasks.workunit.client.1.smithi099.stdout:8/384: link d0/d53/f66 d0/d1f/f81 0 2024-09-17T01:01:54.945 INFO:tasks.workunit.client.0.smithi002.stdout:1/347: creat d4/d11/d12/f7b x:0 0 0 2024-09-17T01:01:54.945 INFO:tasks.workunit.client.0.smithi002.stdout:1/348: fdatasync d4/d11/d12/f38 0 2024-09-17T01:01:54.950 INFO:tasks.workunit.client.0.smithi002.stdout:0/239: getdents dd/d19/d1a/d29 0 2024-09-17T01:01:54.953 INFO:tasks.workunit.client.0.smithi002.stdout:0/240: link dd/d19/f1b dd/d19/d1c/d1f/d22/f51 0 2024-09-17T01:01:54.955 INFO:tasks.workunit.client.0.smithi002.stdout:0/241: creat dd/d19/d1a/d29/f52 x:0 0 0 2024-09-17T01:01:54.956 INFO:tasks.workunit.client.1.smithi099.stdout:7/350: dwrite d1/d2c/f66 [0,4194304] 0 2024-09-17T01:01:54.956 INFO:tasks.workunit.client.1.smithi099.stdout:7/351: read - d1/d2c/f30 zero size 2024-09-17T01:01:54.959 INFO:tasks.workunit.client.1.smithi099.stdout:7/352: mknod d1/d2c/d5c/c71 0 2024-09-17T01:01:54.959 INFO:tasks.workunit.client.0.smithi002.stdout:1/349: write d4/d11/d55/f65 [254296,54045] 0 2024-09-17T01:01:54.959 INFO:tasks.workunit.client.0.smithi002.stdout:1/350: dread - d4/d11/d12/d14/d17/d40/f69 zero size 2024-09-17T01:01:54.960 INFO:tasks.workunit.client.1.smithi099.stdout:7/353: mkdir d1/d2c/d5c/d1c/d72 0 2024-09-17T01:01:54.960 INFO:tasks.workunit.client.0.smithi002.stdout:0/242: dread dd/d19/f1e [0,4194304] 0 2024-09-17T01:01:54.961 INFO:tasks.workunit.client.0.smithi002.stdout:0/243: mknod dd/d44/c53 0 2024-09-17T01:01:54.961 INFO:tasks.workunit.client.0.smithi002.stdout:0/244: truncate dd/d19/f4e 1022729 0 2024-09-17T01:01:54.961 INFO:tasks.workunit.client.0.smithi002.stdout:0/245: write dd/d19/d1c/d1f/f21 [4472557,10188] 0 2024-09-17T01:01:54.962 INFO:tasks.workunit.client.0.smithi002.stdout:0/246: symlink dd/d3d/l54 0 2024-09-17T01:01:54.963 INFO:tasks.workunit.client.0.smithi002.stdout:0/247: readlink dd/d19/d1c/d1f/d39/l3c 0 2024-09-17T01:01:54.963 INFO:tasks.workunit.client.0.smithi002.stdout:0/248: readlink dd/d19/l2e 0 2024-09-17T01:01:54.963 INFO:tasks.workunit.client.0.smithi002.stdout:0/249: getdents dd/d19/d1c/d1f 0 2024-09-17T01:01:54.964 INFO:tasks.workunit.client.0.smithi002.stdout:0/250: mkdir dd/d19/d1a/d29/d55 0 2024-09-17T01:01:54.965 INFO:tasks.workunit.client.0.smithi002.stdout:3/351: dwrite d0/f2f [0,4194304] 0 2024-09-17T01:01:54.969 INFO:tasks.workunit.client.0.smithi002.stdout:2/340: sync 2024-09-17T01:01:54.969 INFO:tasks.workunit.client.0.smithi002.stdout:8/426: sync 2024-09-17T01:01:54.970 INFO:tasks.workunit.client.1.smithi099.stdout:5/428: dwrite d2/d8/f29 [4194304,4194304] 0 2024-09-17T01:01:54.970 INFO:tasks.workunit.client.1.smithi099.stdout:5/429: chown d2/dc/d17 1116 1 2024-09-17T01:01:54.970 INFO:tasks.workunit.client.0.smithi002.stdout:2/341: rmdir d1b/d37/d48/d78/d7d 0 2024-09-17T01:01:54.970 INFO:tasks.workunit.client.0.smithi002.stdout:8/427: creat d2/d41/f90 x:0 0 0 2024-09-17T01:01:54.971 INFO:tasks.workunit.client.1.smithi099.stdout:1/401: rmdir d0/d8/d49/d79 39 2024-09-17T01:01:54.972 INFO:tasks.workunit.client.0.smithi002.stdout:8/428: rename d2/d1c/d3b/l73 to d2/d3/d5f/d47/l91 0 2024-09-17T01:01:54.973 INFO:tasks.workunit.client.1.smithi099.stdout:5/430: link d2/l65 d2/l7f 0 2024-09-17T01:01:54.974 INFO:tasks.workunit.client.0.smithi002.stdout:8/429: rename d2/d9/dd/f70 to d2/d9/dd/f92 0 2024-09-17T01:01:54.974 INFO:tasks.workunit.client.0.smithi002.stdout:8/430: chown d2/d26/d2b/d4f/l75 243278 1 2024-09-17T01:01:54.974 INFO:tasks.workunit.client.0.smithi002.stdout:8/431: write d2/d1c/f43 [270657,127275] 0 2024-09-17T01:01:54.974 INFO:tasks.workunit.client.1.smithi099.stdout:1/402: creat d0/d8/d49/f82 x:0 0 0 2024-09-17T01:01:54.976 INFO:tasks.workunit.client.1.smithi099.stdout:1/403: rename d0/d2/de/d31/l5d to d0/d8/d49/l83 0 2024-09-17T01:01:54.977 INFO:tasks.workunit.client.1.smithi099.stdout:1/404: symlink d0/l84 0 2024-09-17T01:01:54.977 INFO:tasks.workunit.client.1.smithi099.stdout:1/405: truncate d0/d8/d38/d56/f63 657148 0 2024-09-17T01:01:54.979 INFO:tasks.workunit.client.1.smithi099.stdout:1/406: symlink d0/d8/d49/d79/l85 0 2024-09-17T01:01:54.979 INFO:tasks.workunit.client.1.smithi099.stdout:1/407: chown d0/d2/d51/c5f 0 1 2024-09-17T01:01:54.979 INFO:tasks.workunit.client.1.smithi099.stdout:1/408: write d0/d2/d9/f6f [681352,20460] 0 2024-09-17T01:01:54.979 INFO:tasks.workunit.client.1.smithi099.stdout:1/409: chown d0/d2/d9/f6f 380413480 1 2024-09-17T01:01:54.981 INFO:tasks.workunit.client.0.smithi002.stdout:0/251: read dd/f13 [1269150,90645] 0 2024-09-17T01:01:54.981 INFO:tasks.workunit.client.0.smithi002.stdout:0/252: dread - dd/d19/f34 zero size 2024-09-17T01:01:54.984 INFO:tasks.workunit.client.0.smithi002.stdout:0/253: mkdir dd/d19/d1a/d29/d55/d56 0 2024-09-17T01:01:54.984 INFO:tasks.workunit.client.0.smithi002.stdout:0/254: stat dd/d19/d1c/d1f 0 2024-09-17T01:01:54.984 INFO:tasks.workunit.client.0.smithi002.stdout:3/352: dread d0/d3/d33/d40/f52 [0,4194304] 0 2024-09-17T01:01:54.984 INFO:tasks.workunit.client.0.smithi002.stdout:3/353: chown d0/f62 2 1 2024-09-17T01:01:54.999 INFO:tasks.workunit.client.0.smithi002.stdout:7/239: dwrite d1/d14/d1d/d21/d45/f43 [0,4194304] 0 2024-09-17T01:01:54.999 INFO:tasks.workunit.client.1.smithi099.stdout:3/385: dwrite d9/d3b/f69 [0,4194304] 0 2024-09-17T01:01:54.999 INFO:tasks.workunit.client.0.smithi002.stdout:4/338: dwrite d7/f4f [0,4194304] 0 2024-09-17T01:01:55.000 INFO:tasks.workunit.client.0.smithi002.stdout:4/339: creat d7/f65 x:0 0 0 2024-09-17T01:01:55.003 INFO:tasks.workunit.client.0.smithi002.stdout:7/240: dread d1/d14/d1d/d29/f2f [0,4194304] 0 2024-09-17T01:01:55.003 INFO:tasks.workunit.client.0.smithi002.stdout:7/241: chown d1/l18 106674481 1 2024-09-17T01:01:55.008 INFO:tasks.workunit.client.0.smithi002.stdout:4/340: truncate d7/d19/d2e/f39 303126 0 2024-09-17T01:01:55.008 INFO:tasks.workunit.client.0.smithi002.stdout:7/242: truncate d1/f26 49066 0 2024-09-17T01:01:55.011 INFO:tasks.workunit.client.0.smithi002.stdout:4/341: truncate d7/f18 3219226 0 2024-09-17T01:01:55.012 INFO:tasks.workunit.client.0.smithi002.stdout:7/243: symlink d1/d14/d1d/d29/d30/d50/l52 0 2024-09-17T01:01:55.014 INFO:tasks.workunit.client.0.smithi002.stdout:4/342: unlink d7/de/d55/d62/l56 0 2024-09-17T01:01:55.014 INFO:tasks.workunit.client.0.smithi002.stdout:4/343: readlink d7/de/d23/l30 0 2024-09-17T01:01:55.015 INFO:tasks.workunit.client.0.smithi002.stdout:7/244: creat d1/d14/d1d/d29/d30/f53 x:0 0 0 2024-09-17T01:01:55.016 INFO:tasks.workunit.client.0.smithi002.stdout:4/344: mknod d7/d19/d34/c66 0 2024-09-17T01:01:55.017 INFO:tasks.workunit.client.0.smithi002.stdout:7/245: mkdir d1/d14/d1d/d29/d30/d54 0 2024-09-17T01:01:55.018 INFO:tasks.workunit.client.0.smithi002.stdout:4/345: creat d7/de/f67 x:0 0 0 2024-09-17T01:01:55.023 INFO:tasks.workunit.client.0.smithi002.stdout:4/346: dread d7/de/f27 [0,4194304] 0 2024-09-17T01:01:55.023 INFO:tasks.workunit.client.0.smithi002.stdout:7/246: write d1/f20 [951939,55465] 0 2024-09-17T01:01:55.023 INFO:tasks.workunit.client.0.smithi002.stdout:7/247: creat d1/d14/d1d/d29/d30/f55 x:0 0 0 2024-09-17T01:01:55.025 INFO:tasks.workunit.client.0.smithi002.stdout:9/274: dwrite d5/f18 [0,4194304] 0 2024-09-17T01:01:55.027 INFO:tasks.workunit.client.0.smithi002.stdout:9/275: truncate d5/f29 416698 0 2024-09-17T01:01:55.028 INFO:tasks.workunit.client.0.smithi002.stdout:9/276: creat d5/dc/f4b x:0 0 0 2024-09-17T01:01:55.032 INFO:tasks.workunit.client.1.smithi099.stdout:8/385: dwrite d0/d1f/f4d [0,4194304] 0 2024-09-17T01:01:55.032 INFO:tasks.workunit.client.1.smithi099.stdout:8/386: write d0/d4/f3a [4638006,41223] 0 2024-09-17T01:01:55.032 INFO:tasks.workunit.client.1.smithi099.stdout:8/387: truncate d0/d1f/d31/d4c/f7d 803104 0 2024-09-17T01:01:55.032 INFO:tasks.workunit.client.1.smithi099.stdout:7/354: dwrite d1/d2c/d5c/d12/f18 [0,4194304] 0 2024-09-17T01:01:55.033 INFO:tasks.workunit.client.0.smithi002.stdout:8/432: dwrite d2/d26/f5c [4194304,4194304] 0 2024-09-17T01:01:55.034 INFO:tasks.workunit.client.0.smithi002.stdout:1/351: dwrite d4/d11/d12/f38 [0,4194304] 0 2024-09-17T01:01:55.035 INFO:tasks.workunit.client.1.smithi099.stdout:8/388: symlink d0/d41/l82 0 2024-09-17T01:01:55.035 INFO:tasks.workunit.client.1.smithi099.stdout:8/389: chown d0/d1f/l2f 2948104 1 2024-09-17T01:01:55.035 INFO:tasks.workunit.client.1.smithi099.stdout:8/390: chown d0/d4/f3c 0 1 2024-09-17T01:01:55.036 INFO:tasks.workunit.client.1.smithi099.stdout:5/431: dwrite d2/dc/d14/d19/f6d [4194304,4194304] 0 2024-09-17T01:01:55.036 INFO:tasks.workunit.client.1.smithi099.stdout:1/410: dwrite d0/d8/f7c [0,4194304] 0 2024-09-17T01:01:55.036 INFO:tasks.workunit.client.0.smithi002.stdout:2/342: dwrite d1b/d1d/d79/f5c [0,4194304] 0 2024-09-17T01:01:55.036 INFO:tasks.workunit.client.0.smithi002.stdout:2/343: write d1b/d37/d48/d4e/f2e [515313,15492] 0 2024-09-17T01:01:55.037 INFO:tasks.workunit.client.1.smithi099.stdout:8/391: creat d0/d53/f83 x:0 0 0 2024-09-17T01:01:55.037 INFO:tasks.workunit.client.1.smithi099.stdout:3/386: dwrite d9/d3b/d44/f48 [4194304,4194304] 0 2024-09-17T01:01:55.037 INFO:tasks.workunit.client.1.smithi099.stdout:3/387: stat d9/d15/l71 0 2024-09-17T01:01:55.040 INFO:tasks.workunit.client.1.smithi099.stdout:1/411: creat d0/d2/de/d70/f86 x:0 0 0 2024-09-17T01:01:55.040 INFO:tasks.workunit.client.1.smithi099.stdout:1/412: dread - d0/f7b zero size 2024-09-17T01:01:55.040 INFO:tasks.workunit.client.1.smithi099.stdout:1/413: write d0/d8/f26 [4935107,43545] 0 2024-09-17T01:01:55.041 INFO:tasks.workunit.client.0.smithi002.stdout:8/433: dread d2/d9/dd/f8c [0,4194304] 0 2024-09-17T01:01:55.041 INFO:tasks.workunit.client.0.smithi002.stdout:8/434: fsync d2/f6b 0 2024-09-17T01:01:55.041 INFO:tasks.workunit.client.0.smithi002.stdout:8/435: readlink d2/d30/l3e 0 2024-09-17T01:01:55.041 INFO:tasks.workunit.client.1.smithi099.stdout:8/392: mknod d0/d1f/d31/c84 0 2024-09-17T01:01:55.042 INFO:tasks.workunit.client.0.smithi002.stdout:1/352: truncate d4/d11/d12/d14/d17/d3b/f62 4130649 0 2024-09-17T01:01:55.045 INFO:tasks.workunit.client.1.smithi099.stdout:3/388: rmdir d9/d2b/d52/d72 0 2024-09-17T01:01:55.045 INFO:tasks.workunit.client.1.smithi099.stdout:5/432: dread d2/dc/d14/d19/f21 [0,4194304] 0 2024-09-17T01:01:55.045 INFO:tasks.workunit.client.0.smithi002.stdout:8/436: dread d2/d30/f7f [0,4194304] 0 2024-09-17T01:01:55.045 INFO:tasks.workunit.client.0.smithi002.stdout:8/437: write d2/d1c/d3b/f4c [1264453,51820] 0 2024-09-17T01:01:55.047 INFO:tasks.workunit.client.0.smithi002.stdout:8/438: symlink d2/d3/d5f/d47/l93 0 2024-09-17T01:01:55.047 INFO:tasks.workunit.client.1.smithi099.stdout:1/414: link d0/d2/f25 d0/d2/d9/d4b/d59/f87 0 2024-09-17T01:01:55.050 INFO:tasks.workunit.client.0.smithi002.stdout:5/330: sync 2024-09-17T01:01:55.051 INFO:tasks.workunit.client.1.smithi099.stdout:5/433: getdents d2/dc/d14/d19 0 2024-09-17T01:01:55.053 INFO:tasks.workunit.client.0.smithi002.stdout:7/248: dwrite d1/d14/d1d/d28/d2d/f35 [0,4194304] 0 2024-09-17T01:01:55.055 INFO:tasks.workunit.client.1.smithi099.stdout:6/432: sync 2024-09-17T01:01:55.056 INFO:tasks.workunit.client.1.smithi099.stdout:6/433: readlink dc/d1a/l1c 0 2024-09-17T01:01:55.056 INFO:tasks.workunit.client.0.smithi002.stdout:8/439: rmdir d2/d9 39 2024-09-17T01:01:55.061 INFO:tasks.workunit.client.0.smithi002.stdout:7/249: unlink d1/d14/d1d/d28/c2b 0 2024-09-17T01:01:55.061 INFO:tasks.workunit.client.0.smithi002.stdout:7/250: write d1/d24/f46 [1325980,115112] 0 2024-09-17T01:01:55.061 INFO:tasks.workunit.client.0.smithi002.stdout:7/251: creat d1/d24/f56 x:0 0 0 2024-09-17T01:01:55.062 INFO:tasks.workunit.client.0.smithi002.stdout:7/252: fdatasync d1/d24/f56 0 2024-09-17T01:01:55.062 INFO:tasks.workunit.client.0.smithi002.stdout:7/253: dread - d1/d24/f56 zero size 2024-09-17T01:01:55.062 INFO:tasks.workunit.client.0.smithi002.stdout:7/254: fsync d1/f5 0 2024-09-17T01:01:55.062 INFO:tasks.workunit.client.0.smithi002.stdout:7/255: chown d1/f8 1658383 1 2024-09-17T01:01:55.064 INFO:tasks.workunit.client.0.smithi002.stdout:8/440: creat d2/d26/d2b/d4f/f94 x:0 0 0 2024-09-17T01:01:55.068 INFO:tasks.workunit.client.0.smithi002.stdout:2/344: dread d1b/d37/d48/d4e/f2e [0,4194304] 0 2024-09-17T01:01:55.068 INFO:tasks.workunit.client.0.smithi002.stdout:2/345: chown d1b/d3f/d59/c5b 0 1 2024-09-17T01:01:55.068 INFO:tasks.workunit.client.0.smithi002.stdout:2/346: write d1b/f31 [5916,84142] 0 2024-09-17T01:01:55.069 INFO:tasks.workunit.client.0.smithi002.stdout:7/256: rename d1/d14/d1d/d29/d30/d3c to d1/d14/d1d/d29/d57 0 2024-09-17T01:01:55.070 INFO:tasks.workunit.client.0.smithi002.stdout:8/441: symlink d2/d26/d2b/d4f/d77/l95 0 2024-09-17T01:01:55.070 INFO:tasks.workunit.client.0.smithi002.stdout:6/324: sync 2024-09-17T01:01:55.074 INFO:tasks.workunit.client.0.smithi002.stdout:2/347: creat d1b/d37/f80 x:0 0 0 2024-09-17T01:01:55.074 INFO:tasks.workunit.client.0.smithi002.stdout:2/348: stat d1b/d37/d48/c66 0 2024-09-17T01:01:55.075 INFO:tasks.workunit.client.0.smithi002.stdout:9/277: dwrite d5/f44 [0,4194304] 0 2024-09-17T01:01:55.078 INFO:tasks.workunit.client.0.smithi002.stdout:2/349: link fe d1b/d37/d48/d4e/f81 0 2024-09-17T01:01:55.080 INFO:tasks.workunit.client.0.smithi002.stdout:2/350: symlink d1b/d1d/d38/d72/l82 0 2024-09-17T01:01:55.080 INFO:tasks.workunit.client.0.smithi002.stdout:2/351: write d1b/d1d/f47 [312295,36272] 0 2024-09-17T01:01:55.087 INFO:tasks.workunit.client.1.smithi099.stdout:4/362: sync 2024-09-17T01:01:55.087 INFO:tasks.workunit.client.1.smithi099.stdout:4/363: truncate d7/dd/de/f4e 695880 0 2024-09-17T01:01:55.089 INFO:tasks.workunit.client.1.smithi099.stdout:9/411: sync 2024-09-17T01:01:55.089 INFO:tasks.workunit.client.1.smithi099.stdout:0/378: sync 2024-09-17T01:01:55.090 INFO:tasks.workunit.client.1.smithi099.stdout:0/379: mkdir da/df/d1a/d63/d6a/d7c 0 2024-09-17T01:01:55.092 INFO:tasks.workunit.client.1.smithi099.stdout:0/380: unlink da/df/f47 0 2024-09-17T01:01:55.092 INFO:tasks.workunit.client.1.smithi099.stdout:0/381: chown da/df/c46 160394 1 2024-09-17T01:01:55.095 INFO:tasks.workunit.client.1.smithi099.stdout:7/355: dwrite d1/d2c/f30 [0,4194304] 0 2024-09-17T01:01:55.096 INFO:tasks.workunit.client.1.smithi099.stdout:0/382: truncate da/df/d31/f54 805648 0 2024-09-17T01:01:55.096 INFO:tasks.workunit.client.1.smithi099.stdout:7/356: truncate d1/ff 4974695 0 2024-09-17T01:01:55.096 INFO:tasks.workunit.client.1.smithi099.stdout:0/383: getdents da/df/d1a/d63/d6a/d7c 0 2024-09-17T01:01:55.096 INFO:tasks.workunit.client.1.smithi099.stdout:0/384: chown da/df/d31 408596 1 2024-09-17T01:01:55.098 INFO:tasks.workunit.client.0.smithi002.stdout:4/347: dread d7/f18 [0,4194304] 0 2024-09-17T01:01:55.098 INFO:tasks.workunit.client.1.smithi099.stdout:0/385: mkdir da/d12/d22/d66/d7d 0 2024-09-17T01:01:55.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/353: dwrite d4/d11/d12/f7b [0,4194304] 0 2024-09-17T01:01:55.105 INFO:tasks.workunit.client.0.smithi002.stdout:1/354: mknod d4/d11/d12/d30/d5e/c7c 0 2024-09-17T01:01:55.107 INFO:tasks.workunit.client.0.smithi002.stdout:4/348: dread d7/f4f [0,4194304] 0 2024-09-17T01:01:55.107 INFO:tasks.workunit.client.0.smithi002.stdout:1/355: symlink d4/d11/d12/l7d 0 2024-09-17T01:01:55.108 INFO:tasks.workunit.client.0.smithi002.stdout:4/349: mknod d7/d3f/c68 0 2024-09-17T01:01:55.108 INFO:tasks.workunit.client.0.smithi002.stdout:4/350: dread - d7/de/d3a/f5e zero size 2024-09-17T01:01:55.108 INFO:tasks.workunit.client.0.smithi002.stdout:4/351: write d7/de/d23/f51 [173345,36384] 0 2024-09-17T01:01:55.110 INFO:tasks.workunit.client.0.smithi002.stdout:4/352: rename d7/lf to d7/de/d55/d62/d52/l69 0 2024-09-17T01:01:55.110 INFO:tasks.workunit.client.0.smithi002.stdout:4/353: write d7/d19/d34/f58 [753464,125173] 0 2024-09-17T01:01:55.112 INFO:tasks.workunit.client.1.smithi099.stdout:4/364: dread d7/dd/d21/d7b/f2e [0,4194304] 0 2024-09-17T01:01:55.119 INFO:tasks.workunit.client.0.smithi002.stdout:4/354: read d7/d19/d34/d54/f5f [3351626,96249] 0 2024-09-17T01:01:55.120 INFO:tasks.workunit.client.0.smithi002.stdout:4/355: creat d7/de/d55/d62/f6a x:0 0 0 2024-09-17T01:01:55.121 INFO:tasks.workunit.client.0.smithi002.stdout:4/356: mknod d7/de/d55/d62/d52/c6b 0 2024-09-17T01:01:55.121 INFO:tasks.workunit.client.0.smithi002.stdout:4/357: fsync d7/d19/d2e/f46 0 2024-09-17T01:01:55.122 INFO:tasks.workunit.client.0.smithi002.stdout:4/358: symlink d7/d19/d34/l6c 0 2024-09-17T01:01:55.124 INFO:tasks.workunit.client.1.smithi099.stdout:7/357: write d1/d2c/d5c/d1c/f61 [6142843,69582] 0 2024-09-17T01:01:55.126 INFO:tasks.workunit.client.1.smithi099.stdout:7/358: symlink d1/d2c/d47/d48/d60/l73 0 2024-09-17T01:01:55.126 INFO:tasks.workunit.client.1.smithi099.stdout:7/359: fdatasync d1/d2c/d5c/f13 0 2024-09-17T01:01:55.126 INFO:tasks.workunit.client.1.smithi099.stdout:7/360: fdatasync d1/d2c/d5c/d12/f2b 0 2024-09-17T01:01:55.126 INFO:tasks.workunit.client.1.smithi099.stdout:7/361: chown d1/d37/d4f/d6a 7998729 1 2024-09-17T01:01:55.133 INFO:tasks.workunit.client.0.smithi002.stdout:4/359: dwrite d7/de/d3a/f5e [0,4194304] 0 2024-09-17T01:01:55.135 INFO:tasks.workunit.client.0.smithi002.stdout:4/360: rename d7/l42 to d7/de/d55/d62/d52/l6d 0 2024-09-17T01:01:55.135 INFO:tasks.workunit.client.0.smithi002.stdout:4/361: chown d7/d19/d34/c66 494 1 2024-09-17T01:01:55.136 INFO:tasks.workunit.client.0.smithi002.stdout:4/362: mknod d7/d19/d34/c6e 0 2024-09-17T01:01:55.136 INFO:tasks.workunit.client.0.smithi002.stdout:4/363: readlink d7/d19/d34/l6c 0 2024-09-17T01:01:55.137 INFO:tasks.workunit.client.0.smithi002.stdout:4/364: readlink d7/l1b 0 2024-09-17T01:01:55.137 INFO:tasks.workunit.client.0.smithi002.stdout:4/365: write d7/d19/d2e/f46 [4421049,18124] 0 2024-09-17T01:01:55.145 INFO:tasks.workunit.client.0.smithi002.stdout:5/331: dwrite d2/f54 [0,4194304] 0 2024-09-17T01:01:55.145 INFO:tasks.workunit.client.1.smithi099.stdout:8/393: dwrite d0/d4/f49 [0,4194304] 0 2024-09-17T01:01:55.146 INFO:tasks.workunit.client.0.smithi002.stdout:5/332: unlink d2/d2d/d10/d14/d19/d39/d3f/f46 0 2024-09-17T01:01:55.147 INFO:tasks.workunit.client.0.smithi002.stdout:5/333: symlink d2/d2d/l67 0 2024-09-17T01:01:55.147 INFO:tasks.workunit.client.0.smithi002.stdout:5/334: getdents d2/d2d/d10/d14/d59 0 2024-09-17T01:01:55.149 INFO:tasks.workunit.client.1.smithi099.stdout:8/394: rename d0/f47 to d0/d4/d29/f85 0 2024-09-17T01:01:55.150 INFO:tasks.workunit.client.1.smithi099.stdout:8/395: write d0/d1f/d55/f7e [99242,64697] 0 2024-09-17T01:01:55.150 INFO:tasks.workunit.client.1.smithi099.stdout:8/396: rmdir d0/d1f/d31 39 2024-09-17T01:01:55.150 INFO:tasks.workunit.client.1.smithi099.stdout:8/397: write d0/f74 [24538,27811] 0 2024-09-17T01:01:55.158 INFO:tasks.workunit.client.1.smithi099.stdout:1/415: dwrite d0/f67 [0,4194304] 0 2024-09-17T01:01:55.158 INFO:tasks.workunit.client.1.smithi099.stdout:1/416: truncate d0/d2/f3b 387301 0 2024-09-17T01:01:55.158 INFO:tasks.workunit.client.1.smithi099.stdout:1/417: chown d0/d2/d5 45467 1 2024-09-17T01:01:55.159 INFO:tasks.workunit.client.0.smithi002.stdout:7/257: dwrite d1/d14/d1d/d29/d30/f53 [0,4194304] 0 2024-09-17T01:01:55.159 INFO:tasks.workunit.client.1.smithi099.stdout:6/434: dwrite dc/f36 [0,4194304] 0 2024-09-17T01:01:55.159 INFO:tasks.workunit.client.1.smithi099.stdout:8/398: dread d0/d4/f49 [0,4194304] 0 2024-09-17T01:01:55.159 INFO:tasks.workunit.client.1.smithi099.stdout:8/399: stat d0/d53/f66 0 2024-09-17T01:01:55.160 INFO:tasks.workunit.client.1.smithi099.stdout:1/418: creat d0/d2/f88 x:0 0 0 2024-09-17T01:01:55.161 INFO:tasks.workunit.client.1.smithi099.stdout:1/419: fdatasync d0/d2/d18/f6b 0 2024-09-17T01:01:55.161 INFO:tasks.workunit.client.1.smithi099.stdout:0/386: dwrite da/df/d1a/d56/f65 [0,4194304] 0 2024-09-17T01:01:55.162 INFO:tasks.workunit.client.0.smithi002.stdout:8/442: dwrite d2/d26/f57 [0,4194304] 0 2024-09-17T01:01:55.162 INFO:tasks.workunit.client.0.smithi002.stdout:8/443: dread - d2/d26/d2b/d4f/f94 zero size 2024-09-17T01:01:55.162 INFO:tasks.workunit.client.0.smithi002.stdout:8/444: write d2/d3/f1b [532151,59503] 0 2024-09-17T01:01:55.162 INFO:tasks.workunit.client.0.smithi002.stdout:8/445: creat d2/d26/d2b/d4f/f96 x:0 0 0 2024-09-17T01:01:55.162 INFO:tasks.workunit.client.0.smithi002.stdout:6/325: dwrite d2/d1d/d27/d30/f36 [0,4194304] 0 2024-09-17T01:01:55.162 INFO:tasks.workunit.client.0.smithi002.stdout:9/278: dwrite d5/dc/d26/f2d [0,4194304] 0 2024-09-17T01:01:55.162 INFO:tasks.workunit.client.0.smithi002.stdout:6/326: chown d2/d1d/d2d/d35/d37/c3b 708 1 2024-09-17T01:01:55.162 INFO:tasks.workunit.client.0.smithi002.stdout:6/327: fdatasync d2/d1d/d2d/f4f 0 2024-09-17T01:01:55.162 INFO:tasks.workunit.client.0.smithi002.stdout:9/279: fdatasync d5/f3e 0 2024-09-17T01:01:55.162 INFO:tasks.workunit.client.0.smithi002.stdout:2/352: dwrite d1b/f26 [0,4194304] 0 2024-09-17T01:01:55.162 INFO:tasks.workunit.client.0.smithi002.stdout:2/353: readlink d1b/d1d/d79/l6b 0 2024-09-17T01:01:55.163 INFO:tasks.workunit.client.0.smithi002.stdout:1/356: dwrite d4/d11/d12/d14/d17/d20/f5b [0,4194304] 0 2024-09-17T01:01:55.163 INFO:tasks.workunit.client.1.smithi099.stdout:9/412: dwrite da/d50/f60 [0,4194304] 0 2024-09-17T01:01:55.163 INFO:tasks.workunit.client.1.smithi099.stdout:9/413: dread - da/d50/f86 zero size 2024-09-17T01:01:55.163 INFO:tasks.workunit.client.1.smithi099.stdout:4/365: dwrite d7/dd/de/d17/f52 [0,4194304] 0 2024-09-17T01:01:55.165 INFO:tasks.workunit.client.0.smithi002.stdout:4/366: dwrite d7/d19/f21 [4194304,4194304] 0 2024-09-17T01:01:55.165 INFO:tasks.workunit.client.0.smithi002.stdout:4/367: chown d7/f4f 359993 1 2024-09-17T01:01:55.165 INFO:tasks.workunit.client.0.smithi002.stdout:4/368: stat d7/de/d23/f50 0 2024-09-17T01:01:55.166 INFO:tasks.workunit.client.1.smithi099.stdout:8/400: rename d0/d41/c6d to d0/d4/d29/c86 0 2024-09-17T01:01:55.167 INFO:tasks.workunit.client.1.smithi099.stdout:1/420: mknod d0/d2/de/d31/c89 0 2024-09-17T01:01:55.170 INFO:tasks.workunit.client.0.smithi002.stdout:5/335: dwrite d2/f2c [0,4194304] 0 2024-09-17T01:01:55.171 INFO:tasks.workunit.client.1.smithi099.stdout:0/387: creat da/d12/d22/f7e x:0 0 0 2024-09-17T01:01:55.171 INFO:tasks.workunit.client.1.smithi099.stdout:0/388: readlink da/d1c/l73 0 2024-09-17T01:01:55.171 INFO:tasks.workunit.client.1.smithi099.stdout:7/362: getdents d1/d2c/d47/d48/d60 0 2024-09-17T01:01:55.173 INFO:tasks.workunit.client.0.smithi002.stdout:9/280: creat d5/dc/d26/d46/f4c x:0 0 0 2024-09-17T01:01:55.175 INFO:tasks.workunit.client.1.smithi099.stdout:9/414: unlink f4 0 2024-09-17T01:01:55.175 INFO:tasks.workunit.client.1.smithi099.stdout:9/415: chown da/d56/d84/l88 280665 1 2024-09-17T01:01:55.175 INFO:tasks.workunit.client.1.smithi099.stdout:2/337: sync 2024-09-17T01:01:55.177 INFO:tasks.workunit.client.1.smithi099.stdout:8/401: stat d0/d4/l9 0 2024-09-17T01:01:55.178 INFO:tasks.workunit.client.0.smithi002.stdout:2/354: creat d1b/d37/d48/d78/f83 x:0 0 0 2024-09-17T01:01:55.178 INFO:tasks.workunit.client.0.smithi002.stdout:2/355: fdatasync d1b/d37/d48/d52/f5d 0 2024-09-17T01:01:55.178 INFO:tasks.workunit.client.1.smithi099.stdout:1/421: mkdir d0/d8/d38/d8a 0 2024-09-17T01:01:55.180 INFO:tasks.workunit.client.1.smithi099.stdout:9/416: dread da/d1b/d3a/f23 [0,4194304] 0 2024-09-17T01:01:55.180 INFO:tasks.workunit.client.1.smithi099.stdout:9/417: chown da/d1b/d3a/c4a 1225 1 2024-09-17T01:01:55.180 INFO:tasks.workunit.client.1.smithi099.stdout:9/418: chown da/lb 480100 1 2024-09-17T01:01:55.180 INFO:tasks.workunit.client.1.smithi099.stdout:9/419: readlink da/d1b/d3a/d4b/l57 0 2024-09-17T01:01:55.181 INFO:tasks.workunit.client.1.smithi099.stdout:9/420: readlink da/d1b/d3a/l3f 0 2024-09-17T01:01:55.181 INFO:tasks.workunit.client.1.smithi099.stdout:0/389: creat da/df/d1a/d49/d68/f7f x:0 0 0 2024-09-17T01:01:55.181 INFO:tasks.workunit.client.1.smithi099.stdout:0/390: write da/df/f41 [628837,80026] 0 2024-09-17T01:01:55.182 INFO:tasks.workunit.client.1.smithi099.stdout:7/363: creat d1/d2c/d5c/d12/f74 x:0 0 0 2024-09-17T01:01:55.182 INFO:tasks.workunit.client.1.smithi099.stdout:7/364: readlink d1/l1f 0 2024-09-17T01:01:55.182 INFO:tasks.workunit.client.1.smithi099.stdout:7/365: chown d1/d37/l5e 37400465 1 2024-09-17T01:01:55.182 INFO:tasks.workunit.client.1.smithi099.stdout:7/366: write d1/d2c/d5c/d12/f4b [139217,53299] 0 2024-09-17T01:01:55.182 INFO:tasks.workunit.client.1.smithi099.stdout:7/367: readlink d1/d37/l4d 0 2024-09-17T01:01:55.183 INFO:tasks.workunit.client.1.smithi099.stdout:2/338: creat d2/d9/d25/d26/f6b x:0 0 0 2024-09-17T01:01:55.184 INFO:tasks.workunit.client.0.smithi002.stdout:6/328: dwrite d2/d1d/d2d/d35/d37/f41 [0,4194304] 0 2024-09-17T01:01:55.185 INFO:tasks.workunit.client.1.smithi099.stdout:8/402: mknod d0/d41/d5a/c87 0 2024-09-17T01:01:55.185 INFO:tasks.workunit.client.1.smithi099.stdout:8/403: readlink d0/d1f/d31/l56 0 2024-09-17T01:01:55.186 INFO:tasks.workunit.client.1.smithi099.stdout:4/366: write d7/dd/d21/d7b/d4b/f1d [2870508,44027] 0 2024-09-17T01:01:55.187 INFO:tasks.workunit.client.1.smithi099.stdout:9/421: mknod da/d14/d6d/c94 0 2024-09-17T01:01:55.187 INFO:tasks.workunit.client.1.smithi099.stdout:9/422: fsync da/d1b/f3d 0 2024-09-17T01:01:55.188 INFO:tasks.workunit.client.1.smithi099.stdout:0/391: mkdir da/d59/d80 0 2024-09-17T01:01:55.190 INFO:tasks.workunit.client.1.smithi099.stdout:2/339: creat d2/d9/d25/d26/d1b/d2c/f6c x:0 0 0 2024-09-17T01:01:55.190 INFO:tasks.workunit.client.1.smithi099.stdout:6/435: dwrite dc/d1a/d49/d4c/f5f [0,4194304] 0 2024-09-17T01:01:55.193 INFO:tasks.workunit.client.1.smithi099.stdout:8/404: symlink d0/d1f/d55/l88 0 2024-09-17T01:01:55.193 INFO:tasks.workunit.client.1.smithi099.stdout:8/405: stat d0/d4/d29/d4b/l4f 0 2024-09-17T01:01:55.194 INFO:tasks.workunit.client.0.smithi002.stdout:7/258: dwrite d1/d24/f46 [0,4194304] 0 2024-09-17T01:01:55.194 INFO:tasks.workunit.client.0.smithi002.stdout:7/259: fdatasync d1/f26 0 2024-09-17T01:01:55.194 INFO:tasks.workunit.client.0.smithi002.stdout:7/260: readlink d1/l12 0 2024-09-17T01:01:55.194 INFO:tasks.workunit.client.1.smithi099.stdout:0/392: rename da/df/d1a/d70/f76 to da/d12/d22/d66/d7d/f81 0 2024-09-17T01:01:55.195 INFO:tasks.workunit.client.1.smithi099.stdout:0/393: fsync da/df/d31/f39 0 2024-09-17T01:01:55.196 INFO:tasks.workunit.client.0.smithi002.stdout:1/357: symlink d4/d11/d12/d30/d43/d67/l7e 0 2024-09-17T01:01:55.196 INFO:tasks.workunit.client.0.smithi002.stdout:1/358: write d4/d11/d55/f65 [550245,75002] 0 2024-09-17T01:01:55.196 INFO:tasks.workunit.client.0.smithi002.stdout:1/359: truncate d4/d11/d55/f65 4466208 0 2024-09-17T01:01:55.197 INFO:tasks.workunit.client.0.smithi002.stdout:5/336: dwrite d2/d2d/d10/d14/d19/d39/f3c [0,4194304] 0 2024-09-17T01:01:55.198 INFO:tasks.workunit.client.0.smithi002.stdout:4/369: unlink d7/d19/d34/f41 0 2024-09-17T01:01:55.199 INFO:tasks.workunit.client.0.smithi002.stdout:4/370: stat d7/de/d32/f40 0 2024-09-17T01:01:55.199 INFO:tasks.workunit.client.0.smithi002.stdout:4/371: chown d7/de/f2a 72 1 2024-09-17T01:01:55.199 INFO:tasks.workunit.client.0.smithi002.stdout:4/372: write d7/de/d55/d62/f6a [776834,58893] 0 2024-09-17T01:01:55.199 INFO:tasks.workunit.client.1.smithi099.stdout:4/367: dread d7/dd/d21/d26/f32 [0,4194304] 0 2024-09-17T01:01:55.200 INFO:tasks.workunit.client.0.smithi002.stdout:8/446: creat d2/d9/f97 x:0 0 0 2024-09-17T01:01:55.200 INFO:tasks.workunit.client.1.smithi099.stdout:6/436: mkdir dc/d27/d7e/d8c 0 2024-09-17T01:01:55.200 INFO:tasks.workunit.client.1.smithi099.stdout:6/437: read f7 [94991,12889] 0 2024-09-17T01:01:55.202 INFO:tasks.workunit.client.1.smithi099.stdout:8/406: mknod d0/d1f/d31/c89 0 2024-09-17T01:01:55.202 INFO:tasks.workunit.client.0.smithi002.stdout:2/356: creat d1b/d1d/d38/d72/f84 x:0 0 0 2024-09-17T01:01:55.204 INFO:tasks.workunit.client.0.smithi002.stdout:6/329: truncate d2/dc/f21 3855083 0 2024-09-17T01:01:55.205 INFO:tasks.workunit.client.0.smithi002.stdout:6/330: chown d2/d1d/d27/d30/f36 2899855 1 2024-09-17T01:01:55.205 INFO:tasks.workunit.client.0.smithi002.stdout:6/331: getdents d2/dc/d24/d53 0 2024-09-17T01:01:55.205 INFO:tasks.workunit.client.1.smithi099.stdout:0/394: creat da/f82 x:0 0 0 2024-09-17T01:01:55.205 INFO:tasks.workunit.client.1.smithi099.stdout:0/395: chown da/df/d1a/d70 0 1 2024-09-17T01:01:55.205 INFO:tasks.workunit.client.1.smithi099.stdout:2/340: getdents d2/d7 0 2024-09-17T01:01:55.206 INFO:tasks.workunit.client.0.smithi002.stdout:7/261: getdents d1/d14/d1d 0 2024-09-17T01:01:55.206 INFO:tasks.workunit.client.1.smithi099.stdout:4/368: getdents d7/dd/d21/d7b/d74 0 2024-09-17T01:01:55.206 INFO:tasks.workunit.client.1.smithi099.stdout:4/369: chown d7/fc 77626850 1 2024-09-17T01:01:55.207 INFO:tasks.workunit.client.1.smithi099.stdout:0/396: truncate f8 2679116 0 2024-09-17T01:01:55.208 INFO:tasks.workunit.client.0.smithi002.stdout:1/360: creat d4/d11/d12/d30/f7f x:0 0 0 2024-09-17T01:01:55.208 INFO:tasks.workunit.client.1.smithi099.stdout:2/341: mknod d2/d9/d25/d26/d1b/d2c/c6d 0 2024-09-17T01:01:55.210 INFO:tasks.workunit.client.1.smithi099.stdout:4/370: mkdir d7/dd/de/d10/d6b/d82 0 2024-09-17T01:01:55.211 INFO:tasks.workunit.client.1.smithi099.stdout:2/342: symlink d2/d9/d25/d26/d1b/d2c/d5d/l6e 0 2024-09-17T01:01:55.211 INFO:tasks.workunit.client.1.smithi099.stdout:2/343: dread - d2/d9/d17/f63 zero size 2024-09-17T01:01:55.212 INFO:tasks.workunit.client.0.smithi002.stdout:5/337: mknod d2/d2d/d10/d14/d19/d39/d25/c68 0 2024-09-17T01:01:55.212 INFO:tasks.workunit.client.0.smithi002.stdout:4/373: unlink d7/f25 0 2024-09-17T01:01:55.215 INFO:tasks.workunit.client.0.smithi002.stdout:8/447: mkdir d2/d3/d5f/d98 0 2024-09-17T01:01:55.215 INFO:tasks.workunit.client.0.smithi002.stdout:2/357: mknod d1b/d1d/d79/c85 0 2024-09-17T01:01:55.215 INFO:tasks.workunit.client.0.smithi002.stdout:2/358: dread - d1b/d37/d48/d4e/f54 zero size 2024-09-17T01:01:55.216 INFO:tasks.workunit.client.0.smithi002.stdout:6/332: mknod d2/d1d/d27/d30/c5d 0 2024-09-17T01:01:55.216 INFO:tasks.workunit.client.0.smithi002.stdout:6/333: write d2/dc/f20 [570542,94555] 0 2024-09-17T01:01:55.218 INFO:tasks.workunit.client.0.smithi002.stdout:1/361: creat d4/d11/d55/d7a/f80 x:0 0 0 2024-09-17T01:01:55.218 INFO:tasks.workunit.client.0.smithi002.stdout:1/362: chown d4/d11/d12/d23/d32 0 1 2024-09-17T01:01:55.218 INFO:tasks.workunit.client.0.smithi002.stdout:1/363: write d4/d11/d12/d30/d5e/f60 [8395499,121792] 0 2024-09-17T01:01:55.218 INFO:tasks.workunit.client.0.smithi002.stdout:5/338: mknod d2/d2d/d10/d14/d19/d39/d25/c69 0 2024-09-17T01:01:55.222 INFO:tasks.workunit.client.0.smithi002.stdout:8/448: unlink d2/d1c/f82 0 2024-09-17T01:01:55.223 INFO:tasks.workunit.client.0.smithi002.stdout:2/359: symlink d1b/d74/l86 0 2024-09-17T01:01:55.223 INFO:tasks.workunit.client.0.smithi002.stdout:8/449: stat d2/d3/f72 0 2024-09-17T01:01:55.223 INFO:tasks.workunit.client.0.smithi002.stdout:2/360: write d1b/d37/d48/d4e/f3b [704459,71810] 0 2024-09-17T01:01:55.224 INFO:tasks.workunit.client.0.smithi002.stdout:6/334: creat d2/f5e x:0 0 0 2024-09-17T01:01:55.225 INFO:tasks.workunit.client.0.smithi002.stdout:1/364: mknod d4/d11/d12/d14/d17/d51/c81 0 2024-09-17T01:01:55.225 INFO:tasks.workunit.client.0.smithi002.stdout:5/339: truncate d2/f4 8642634 0 2024-09-17T01:01:55.225 INFO:tasks.workunit.client.0.smithi002.stdout:1/365: chown d4/d11/d12/d14/d17/d3b 859606 1 2024-09-17T01:01:55.225 INFO:tasks.workunit.client.0.smithi002.stdout:1/366: fdatasync d4/d22/f39 0 2024-09-17T01:01:55.226 INFO:tasks.workunit.client.0.smithi002.stdout:8/450: rename d2/d26/d2b/d4f/d77/l84 to d2/d26/d2b/d71/l99 0 2024-09-17T01:01:55.226 INFO:tasks.workunit.client.0.smithi002.stdout:8/451: chown d2/d26/f5c 3 1 2024-09-17T01:01:55.226 INFO:tasks.workunit.client.0.smithi002.stdout:8/452: truncate d2/d26/d2b/d4f/d77/d78/f87 297204 0 2024-09-17T01:01:55.227 INFO:tasks.workunit.client.1.smithi099.stdout:7/368: dwrite d1/d36/f45 [0,4194304] 0 2024-09-17T01:01:55.227 INFO:tasks.workunit.client.1.smithi099.stdout:7/369: read d1/d37/f51 [2644086,89643] 0 2024-09-17T01:01:55.228 INFO:tasks.workunit.client.0.smithi002.stdout:6/335: dread d2/d1d/d2d/f2e [0,4194304] 0 2024-09-17T01:01:55.228 INFO:tasks.workunit.client.0.smithi002.stdout:2/361: creat d1b/d1d/d38/f87 x:0 0 0 2024-09-17T01:01:55.228 INFO:tasks.workunit.client.0.smithi002.stdout:2/362: dread - d1b/d1d/f4f zero size 2024-09-17T01:01:55.229 INFO:tasks.workunit.client.0.smithi002.stdout:6/336: mkdir d2/dc/d34/d5f 0 2024-09-17T01:01:55.231 INFO:tasks.workunit.client.0.smithi002.stdout:1/367: dread d4/d11/d12/d14/d17/d3b/f6e [0,4194304] 0 2024-09-17T01:01:55.231 INFO:tasks.workunit.client.0.smithi002.stdout:5/340: dread d2/d2d/d10/d14/d19/d39/f52 [0,4194304] 0 2024-09-17T01:01:55.232 INFO:tasks.workunit.client.0.smithi002.stdout:2/363: creat d1b/d74/f88 x:0 0 0 2024-09-17T01:01:55.233 INFO:tasks.workunit.client.1.smithi099.stdout:1/422: dwrite d0/d2/d18/f34 [0,4194304] 0 2024-09-17T01:01:55.233 INFO:tasks.workunit.client.1.smithi099.stdout:7/370: unlink d1/d36/c43 0 2024-09-17T01:01:55.234 INFO:tasks.workunit.client.0.smithi002.stdout:6/337: mknod d2/d4b/c60 0 2024-09-17T01:01:55.236 INFO:tasks.workunit.client.1.smithi099.stdout:9/423: dwrite da/ff [0,4194304] 0 2024-09-17T01:01:55.236 INFO:tasks.workunit.client.1.smithi099.stdout:9/424: chown da/d50/f83 120983 1 2024-09-17T01:01:55.236 INFO:tasks.workunit.client.1.smithi099.stdout:9/425: truncate da/d21/d2a/f7f 197799 0 2024-09-17T01:01:55.237 INFO:tasks.workunit.client.1.smithi099.stdout:9/426: write da/d1b/f78 [180650,129202] 0 2024-09-17T01:01:55.237 INFO:tasks.workunit.client.1.smithi099.stdout:8/407: dwrite d0/d1f/d31/f38 [0,4194304] 0 2024-09-17T01:01:55.237 INFO:tasks.workunit.client.0.smithi002.stdout:5/341: mkdir d2/d2d/d10/d23/d6a 0 2024-09-17T01:01:55.237 INFO:tasks.workunit.client.1.smithi099.stdout:1/423: rename d0/d8/d49/d79 to d0/d2/de/d8b 0 2024-09-17T01:01:55.238 INFO:tasks.workunit.client.0.smithi002.stdout:2/364: unlink d1b/f31 0 2024-09-17T01:01:55.238 INFO:tasks.workunit.client.0.smithi002.stdout:9/281: rmdir d5/dc/d26/d46 39 2024-09-17T01:01:55.238 INFO:tasks.workunit.client.1.smithi099.stdout:6/438: dwrite dc/d5d/d66/f67 [0,4194304] 0 2024-09-17T01:01:55.238 INFO:tasks.workunit.client.1.smithi099.stdout:6/439: write dc/d2b/d53/f5a [640182,101081] 0 2024-09-17T01:01:55.240 INFO:tasks.workunit.client.0.smithi002.stdout:2/365: mkdir d1b/d74/d89 0 2024-09-17T01:01:55.241 INFO:tasks.workunit.client.1.smithi099.stdout:6/440: dread dc/d1a/d49/f62 [0,4194304] 0 2024-09-17T01:01:55.242 INFO:tasks.workunit.client.1.smithi099.stdout:9/427: mknod da/d1b/d3a/d4b/c95 0 2024-09-17T01:01:55.242 INFO:tasks.workunit.client.0.smithi002.stdout:9/282: write d5/fb [792644,3645] 0 2024-09-17T01:01:55.244 INFO:tasks.workunit.client.0.smithi002.stdout:9/283: write d5/dc/d26/d34/f42 [466234,100845] 0 2024-09-17T01:01:55.245 INFO:tasks.workunit.client.0.smithi002.stdout:9/284: write d5/f10 [6698123,46664] 0 2024-09-17T01:01:55.245 INFO:tasks.workunit.client.0.smithi002.stdout:9/285: dread - d5/dc/f32 zero size 2024-09-17T01:01:55.245 INFO:tasks.workunit.client.0.smithi002.stdout:2/366: unlink d1b/d37/d48/c65 0 2024-09-17T01:01:55.245 INFO:tasks.workunit.client.1.smithi099.stdout:7/371: rename d1/d2c/d5c/d12/l70 to d1/d37/d4f/l75 0 2024-09-17T01:01:55.245 INFO:tasks.workunit.client.0.smithi002.stdout:1/368: dread d4/d11/d12/d14/d17/d3b/f62 [0,4194304] 0 2024-09-17T01:01:55.247 INFO:tasks.workunit.client.0.smithi002.stdout:1/369: truncate d4/ff 499143 0 2024-09-17T01:01:55.248 INFO:tasks.workunit.client.0.smithi002.stdout:1/370: creat d4/d11/f82 x:0 0 0 2024-09-17T01:01:55.248 INFO:tasks.workunit.client.1.smithi099.stdout:1/424: unlink d0/d8/d38/d75/f74 0 2024-09-17T01:01:55.250 INFO:tasks.workunit.client.0.smithi002.stdout:1/371: rename d4/c7 to d4/d11/d12/d14/d17/d40/c83 0 2024-09-17T01:01:55.251 INFO:tasks.workunit.client.0.smithi002.stdout:1/372: creat d4/d11/d12/d23/d32/f84 x:0 0 0 2024-09-17T01:01:55.252 INFO:tasks.workunit.client.1.smithi099.stdout:9/428: rename da/d14/d89 to da/d8e/d96 0 2024-09-17T01:01:55.252 INFO:tasks.workunit.client.1.smithi099.stdout:9/429: chown da/d14/d62/f6b 1206 1 2024-09-17T01:01:55.253 INFO:tasks.workunit.client.1.smithi099.stdout:7/372: mkdir d1/d2c/d5c/d1c/d5a/d76 0 2024-09-17T01:01:55.253 INFO:tasks.workunit.client.0.smithi002.stdout:9/286: dread d5/f14 [0,4194304] 0 2024-09-17T01:01:55.254 INFO:tasks.workunit.client.0.smithi002.stdout:1/373: creat d4/d11/d12/d23/f85 x:0 0 0 2024-09-17T01:01:55.254 INFO:tasks.workunit.client.1.smithi099.stdout:1/425: mkdir d0/d8c 0 2024-09-17T01:01:55.254 INFO:tasks.workunit.client.1.smithi099.stdout:1/426: stat d0/d2/d5/l1b 0 2024-09-17T01:01:55.254 INFO:tasks.workunit.client.1.smithi099.stdout:1/427: chown d0/d2 3965 1 2024-09-17T01:01:55.255 INFO:tasks.workunit.client.0.smithi002.stdout:0/255: sync 2024-09-17T01:01:55.255 INFO:tasks.workunit.client.0.smithi002.stdout:3/354: sync 2024-09-17T01:01:55.256 INFO:tasks.workunit.client.1.smithi099.stdout:9/430: dread da/d1b/d3a/f23 [0,4194304] 0 2024-09-17T01:01:55.256 INFO:tasks.workunit.client.1.smithi099.stdout:1/428: rename d0/d8/l20 to d0/d2/d5/l8d 0 2024-09-17T01:01:55.259 INFO:tasks.workunit.client.1.smithi099.stdout:1/429: rename d0/d2/d18/f52 to d0/d2/d51/f8e 0 2024-09-17T01:01:55.259 INFO:tasks.workunit.client.1.smithi099.stdout:1/430: symlink d0/d2/d61/l8f 0 2024-09-17T01:01:55.260 INFO:tasks.workunit.client.0.smithi002.stdout:2/367: write d1b/f26 [859905,35144] 0 2024-09-17T01:01:55.261 INFO:tasks.workunit.client.0.smithi002.stdout:3/355: getdents d0 0 2024-09-17T01:01:55.261 INFO:tasks.workunit.client.0.smithi002.stdout:3/356: dread - d0/d3/d33/d4a/f78 zero size 2024-09-17T01:01:55.263 INFO:tasks.workunit.client.0.smithi002.stdout:0/256: rename dd/d19/d1c/f4d to dd/f57 0 2024-09-17T01:01:55.263 INFO:tasks.workunit.client.0.smithi002.stdout:9/287: write d5/dc/d26/f3b [726489,1452] 0 2024-09-17T01:01:55.263 INFO:tasks.workunit.client.0.smithi002.stdout:9/288: fdatasync d5/dc/f4b 0 2024-09-17T01:01:55.263 INFO:tasks.workunit.client.0.smithi002.stdout:9/289: stat d5/dc/d26/d34 0 2024-09-17T01:01:55.264 INFO:tasks.workunit.client.0.smithi002.stdout:9/290: chown d5/dc/d26/d46 1028 1 2024-09-17T01:01:55.265 INFO:tasks.workunit.client.0.smithi002.stdout:3/357: mknod d0/d3/d33/d40/c79 0 2024-09-17T01:01:55.265 INFO:tasks.workunit.client.0.smithi002.stdout:3/358: dread - d0/d31/f43 zero size 2024-09-17T01:01:55.265 INFO:tasks.workunit.client.0.smithi002.stdout:0/257: dread - dd/d3d/f50 zero size 2024-09-17T01:01:55.269 INFO:tasks.workunit.client.0.smithi002.stdout:9/291: rename d5/c21 to d5/dc/d26/d34/c4d 0 2024-09-17T01:01:55.270 INFO:tasks.workunit.client.1.smithi099.stdout:9/431: write da/d50/f82 [4068722,21255] 0 2024-09-17T01:01:55.271 INFO:tasks.workunit.client.0.smithi002.stdout:3/359: stat d0/d3/d17/c27 0 2024-09-17T01:01:55.271 INFO:tasks.workunit.client.0.smithi002.stdout:0/258: fsync dd/f13 0 2024-09-17T01:01:55.272 INFO:tasks.workunit.client.1.smithi099.stdout:9/432: truncate f6 1995090 0 2024-09-17T01:01:55.272 INFO:tasks.workunit.client.1.smithi099.stdout:9/433: truncate da/d18/d5e/f67 280878 0 2024-09-17T01:01:55.272 INFO:tasks.workunit.client.1.smithi099.stdout:9/434: creat da/d14/d40/f97 x:0 0 0 2024-09-17T01:01:55.272 INFO:tasks.workunit.client.1.smithi099.stdout:9/435: write da/d21/f8f [71363,39170] 0 2024-09-17T01:01:55.272 INFO:tasks.workunit.client.1.smithi099.stdout:9/436: creat da/d18/d49/f98 x:0 0 0 2024-09-17T01:01:55.273 INFO:tasks.workunit.client.1.smithi099.stdout:9/437: read da/d21/d2a/f7f [51874,116659] 0 2024-09-17T01:01:55.273 INFO:tasks.workunit.client.1.smithi099.stdout:9/438: truncate da/d14/d48/d69/f79 567199 0 2024-09-17T01:01:55.273 INFO:tasks.workunit.client.1.smithi099.stdout:9/439: readlink da/lb 0 2024-09-17T01:01:55.283 INFO:tasks.workunit.client.0.smithi002.stdout:3/360: dread d0/f21 [0,4194304] 0 2024-09-17T01:01:55.283 INFO:tasks.workunit.client.0.smithi002.stdout:4/374: dwrite d7/de/d55/f5a [0,4194304] 0 2024-09-17T01:01:55.283 INFO:tasks.workunit.client.1.smithi099.stdout:6/441: dwrite dc/d27/d58/f6e [0,4194304] 0 2024-09-17T01:01:55.284 INFO:tasks.workunit.client.0.smithi002.stdout:7/262: dwrite d1/d24/f46 [0,4194304] 0 2024-09-17T01:01:55.284 INFO:tasks.workunit.client.0.smithi002.stdout:7/263: dread - d1/d14/d1d/d29/d4b/f4e zero size 2024-09-17T01:01:55.284 INFO:tasks.workunit.client.0.smithi002.stdout:7/264: readlink d1/d14/l47 0 2024-09-17T01:01:55.285 INFO:tasks.workunit.client.1.smithi099.stdout:4/371: dwrite d7/d35/f78 [0,4194304] 0 2024-09-17T01:01:55.285 INFO:tasks.workunit.client.1.smithi099.stdout:0/397: dwrite da/d12/d2b/f37 [0,4194304] 0 2024-09-17T01:01:55.285 INFO:tasks.workunit.client.1.smithi099.stdout:0/398: creat da/df/d20/f83 x:0 0 0 2024-09-17T01:01:55.285 INFO:tasks.workunit.client.0.smithi002.stdout:3/361: unlink d0/d3/d17/l22 0 2024-09-17T01:01:55.288 INFO:tasks.workunit.client.0.smithi002.stdout:0/259: write dd/d19/f3a [1034887,13148] 0 2024-09-17T01:01:55.290 INFO:tasks.workunit.client.1.smithi099.stdout:8/408: truncate d0/d1f/d55/f7e 105448 0 2024-09-17T01:01:55.290 INFO:tasks.workunit.client.0.smithi002.stdout:0/260: symlink dd/d19/d1c/d1f/l58 0 2024-09-17T01:01:55.291 INFO:tasks.workunit.client.0.smithi002.stdout:0/261: mknod dd/d19/c59 0 2024-09-17T01:01:55.293 INFO:tasks.workunit.client.1.smithi099.stdout:0/399: mknod da/df/d1a/d63/d6a/d7c/c84 0 2024-09-17T01:01:55.293 INFO:tasks.workunit.client.1.smithi099.stdout:0/400: fsync da/df/d1a/d23/f2a 0 2024-09-17T01:01:55.294 INFO:tasks.workunit.client.0.smithi002.stdout:0/262: creat dd/f5a x:0 0 0 2024-09-17T01:01:55.295 INFO:tasks.workunit.client.1.smithi099.stdout:4/372: write f1 [1500468,4417] 0 2024-09-17T01:01:55.296 INFO:tasks.workunit.client.0.smithi002.stdout:0/263: truncate dd/f36 78933 0 2024-09-17T01:01:55.296 INFO:tasks.workunit.client.0.smithi002.stdout:0/264: readlink dd/d19/d1c/d33/l42 0 2024-09-17T01:01:55.296 INFO:tasks.workunit.client.0.smithi002.stdout:0/265: truncate dd/d19/d1c/d1f/d22/f51 44176 0 2024-09-17T01:01:55.298 INFO:tasks.workunit.client.0.smithi002.stdout:0/266: creat dd/d19/d1a/d29/d55/f5b x:0 0 0 2024-09-17T01:01:55.298 INFO:tasks.workunit.client.1.smithi099.stdout:4/373: dread d7/dd/d21/d26/f65 [0,4194304] 0 2024-09-17T01:01:55.300 INFO:tasks.workunit.client.1.smithi099.stdout:4/374: truncate d7/dd/de/d10/d6b/f73 2165259 0 2024-09-17T01:01:55.300 INFO:tasks.workunit.client.0.smithi002.stdout:0/267: symlink dd/d19/d1a/d29/l5c 0 2024-09-17T01:01:55.300 INFO:tasks.workunit.client.0.smithi002.stdout:0/268: write f1 [1879975,41364] 0 2024-09-17T01:01:55.300 INFO:tasks.workunit.client.1.smithi099.stdout:4/375: getdents d7/dd/d21/d26/d3f/d5b 0 2024-09-17T01:01:55.301 INFO:tasks.workunit.client.0.smithi002.stdout:4/375: write d7/d19/f21 [6800343,126666] 0 2024-09-17T01:01:55.301 INFO:tasks.workunit.client.0.smithi002.stdout:4/376: creat d7/de/d55/d62/f6f x:0 0 0 2024-09-17T01:01:55.302 INFO:tasks.workunit.client.0.smithi002.stdout:4/377: creat d7/d19/d2e/f70 x:0 0 0 2024-09-17T01:01:55.302 INFO:tasks.workunit.client.0.smithi002.stdout:0/269: write dd/f32 [1000932,64151] 0 2024-09-17T01:01:55.305 INFO:tasks.workunit.client.0.smithi002.stdout:7/265: dwrite d1/d14/d1d/d28/f3d [0,4194304] 0 2024-09-17T01:01:55.307 INFO:tasks.workunit.client.0.smithi002.stdout:7/266: mkdir d1/d14/d1d/d28/d40/d58 0 2024-09-17T01:01:55.307 INFO:tasks.workunit.client.0.smithi002.stdout:7/267: mknod d1/d14/c59 0 2024-09-17T01:01:55.307 INFO:tasks.workunit.client.0.smithi002.stdout:7/268: dread - d1/d14/d1d/d28/f4f zero size 2024-09-17T01:01:55.307 INFO:tasks.workunit.client.0.smithi002.stdout:7/269: write d1/d14/d1d/d29/d30/f55 [887527,79303] 0 2024-09-17T01:01:55.309 INFO:tasks.workunit.client.0.smithi002.stdout:5/342: dwrite d2/d2d/d10/f66 [0,4194304] 0 2024-09-17T01:01:55.309 INFO:tasks.workunit.client.0.smithi002.stdout:1/374: dwrite d4/d11/d12/d30/d43/f4d [0,4194304] 0 2024-09-17T01:01:55.310 INFO:tasks.workunit.client.1.smithi099.stdout:6/442: write dc/d5d/f69 [1298527,99006] 0 2024-09-17T01:01:55.311 INFO:tasks.workunit.client.0.smithi002.stdout:5/343: truncate d2/d2d/d10/d14/d19/f1c 3353081 0 2024-09-17T01:01:55.311 INFO:tasks.workunit.client.0.smithi002.stdout:5/344: dread - d2/de/f34 zero size 2024-09-17T01:01:55.312 INFO:tasks.workunit.client.1.smithi099.stdout:6/443: truncate dc/d1a/d49/f62 3351279 0 2024-09-17T01:01:55.312 INFO:tasks.workunit.client.1.smithi099.stdout:8/409: dread d0/d1f/f62 [0,4194304] 0 2024-09-17T01:01:55.312 INFO:tasks.workunit.client.1.smithi099.stdout:6/444: mknod dc/d2b/d3f/c8d 0 2024-09-17T01:01:55.312 INFO:tasks.workunit.client.1.smithi099.stdout:6/445: readlink dc/d1a/d49/l75 0 2024-09-17T01:01:55.313 INFO:tasks.workunit.client.1.smithi099.stdout:8/410: mknod d0/d1f/c8a 0 2024-09-17T01:01:55.314 INFO:tasks.workunit.client.1.smithi099.stdout:6/446: truncate dc/d27/d58/f78 1424028 0 2024-09-17T01:01:55.314 INFO:tasks.workunit.client.1.smithi099.stdout:6/447: write dc/d1a/d49/f73 [70991,78821] 0 2024-09-17T01:01:55.323 INFO:tasks.workunit.client.0.smithi002.stdout:2/368: dwrite d1b/f68 [0,4194304] 0 2024-09-17T01:01:55.323 INFO:tasks.workunit.client.0.smithi002.stdout:2/369: stat d1b/d37/d48/d4e/f3b 0 2024-09-17T01:01:55.326 INFO:tasks.workunit.client.0.smithi002.stdout:2/370: mkdir d1b/d8a 0 2024-09-17T01:01:55.326 INFO:tasks.workunit.client.0.smithi002.stdout:2/371: chown d1b/d37/d48/d4e/f70 7 1 2024-09-17T01:01:55.327 INFO:tasks.workunit.client.1.smithi099.stdout:1/431: dwrite d0/d2/d9/d4b/d59/f87 [0,4194304] 0 2024-09-17T01:01:55.327 INFO:tasks.workunit.client.0.smithi002.stdout:2/372: mkdir d1b/d8b 0 2024-09-17T01:01:55.327 INFO:tasks.workunit.client.0.smithi002.stdout:2/373: truncate d1b/d1d/d79/f6d 1561828 0 2024-09-17T01:01:55.328 INFO:tasks.workunit.client.0.smithi002.stdout:9/292: dwrite d5/f49 [0,4194304] 0 2024-09-17T01:01:55.329 INFO:tasks.workunit.client.1.smithi099.stdout:1/432: mknod d0/d2/d9/d4b/d59/c90 0 2024-09-17T01:01:55.330 INFO:tasks.workunit.client.1.smithi099.stdout:0/401: dread da/d12/f62 [0,4194304] 0 2024-09-17T01:01:55.333 INFO:tasks.workunit.client.1.smithi099.stdout:1/433: rename d0/d2/f3f to d0/d2/d9/d4b/d59/f91 0 2024-09-17T01:01:55.333 INFO:tasks.workunit.client.1.smithi099.stdout:0/402: mkdir da/d12/d85 0 2024-09-17T01:01:55.333 INFO:tasks.workunit.client.0.smithi002.stdout:7/270: write d1/d14/d1d/d29/d30/f53 [801809,59506] 0 2024-09-17T01:01:55.334 INFO:tasks.workunit.client.1.smithi099.stdout:1/434: mknod d0/d8/d38/d75/c92 0 2024-09-17T01:01:55.335 INFO:tasks.workunit.client.1.smithi099.stdout:0/403: symlink da/df/d1a/l86 0 2024-09-17T01:01:55.336 INFO:tasks.workunit.client.1.smithi099.stdout:1/435: mkdir d0/d8/d38/d56/d93 0 2024-09-17T01:01:55.336 INFO:tasks.workunit.client.1.smithi099.stdout:1/436: write d0/d2/d9/f72 [459513,68399] 0 2024-09-17T01:01:55.336 INFO:tasks.workunit.client.0.smithi002.stdout:9/293: dread d5/dc/d26/f3b [0,4194304] 0 2024-09-17T01:01:55.336 INFO:tasks.workunit.client.0.smithi002.stdout:9/294: stat d5/dc/d26/c4a 0 2024-09-17T01:01:55.337 INFO:tasks.workunit.client.0.smithi002.stdout:9/295: creat d5/dc/f4e x:0 0 0 2024-09-17T01:01:55.337 INFO:tasks.workunit.client.1.smithi099.stdout:0/404: unlink da/d12/f13 0 2024-09-17T01:01:55.337 INFO:tasks.workunit.client.1.smithi099.stdout:1/437: dread d0/d2/de/f5c [0,4194304] 0 2024-09-17T01:01:55.338 INFO:tasks.workunit.client.0.smithi002.stdout:5/345: read d2/d2d/f53 [3450159,57086] 0 2024-09-17T01:01:55.342 INFO:tasks.workunit.client.0.smithi002.stdout:1/375: dwrite d4/d11/d12/d14/f2b [0,4194304] 0 2024-09-17T01:01:55.347 INFO:tasks.workunit.client.0.smithi002.stdout:7/271: rename d1/d14/d1d/d29/l36 to d1/d14/d1d/d28/d40/d58/l5a 0 2024-09-17T01:01:55.347 INFO:tasks.workunit.client.0.smithi002.stdout:7/272: write d1/d14/d1d/d28/f4f [1011609,5052] 0 2024-09-17T01:01:55.348 INFO:tasks.workunit.client.0.smithi002.stdout:7/273: dread d1/f26 [0,4194304] 0 2024-09-17T01:01:55.348 INFO:tasks.workunit.client.0.smithi002.stdout:7/274: chown d1/d14/d1d/d21/l23 125337578 1 2024-09-17T01:01:55.348 INFO:tasks.workunit.client.0.smithi002.stdout:7/275: dread - d1/d14/f3f zero size 2024-09-17T01:01:55.348 INFO:tasks.workunit.client.0.smithi002.stdout:7/276: write d1/d14/d1d/d29/d30/f53 [2080681,6372] 0 2024-09-17T01:01:55.352 INFO:tasks.workunit.client.0.smithi002.stdout:3/362: dwrite d0/d3/d33/d40/f63 [0,4194304] 0 2024-09-17T01:01:55.352 INFO:tasks.workunit.client.0.smithi002.stdout:3/363: chown d0/d3/d37/d5a/c71 11733 1 2024-09-17T01:01:55.353 INFO:tasks.workunit.client.0.smithi002.stdout:3/364: write d0/d3/f3c [1033246,14012] 0 2024-09-17T01:01:55.353 INFO:tasks.workunit.client.1.smithi099.stdout:8/411: dwrite d0/f18 [0,4194304] 0 2024-09-17T01:01:55.353 INFO:tasks.workunit.client.1.smithi099.stdout:4/376: dwrite d7/dd/d21/d7b/d4b/f39 [0,4194304] 0 2024-09-17T01:01:55.356 INFO:tasks.workunit.client.1.smithi099.stdout:6/448: dwrite dc/d27/d7e/f89 [0,4194304] 0 2024-09-17T01:01:55.361 INFO:tasks.workunit.client.0.smithi002.stdout:1/376: getdents d4/d11/d55 0 2024-09-17T01:01:55.362 INFO:tasks.workunit.client.1.smithi099.stdout:8/412: dread d0/d4/d29/f85 [0,4194304] 0 2024-09-17T01:01:55.363 INFO:tasks.workunit.client.1.smithi099.stdout:0/405: dwrite da/f1b [0,4194304] 0 2024-09-17T01:01:55.364 INFO:tasks.workunit.client.0.smithi002.stdout:5/346: rename d2/d2d/f18 to d2/d2d/d10/d23/d44/f6b 0 2024-09-17T01:01:55.365 INFO:tasks.workunit.client.0.smithi002.stdout:7/277: truncate d1/f8 6854601 0 2024-09-17T01:01:55.365 INFO:tasks.workunit.client.0.smithi002.stdout:7/278: truncate d1/f5 2241720 0 2024-09-17T01:01:55.365 INFO:tasks.workunit.client.0.smithi002.stdout:7/279: chown d1/lb 509751 1 2024-09-17T01:01:55.367 INFO:tasks.workunit.client.0.smithi002.stdout:9/296: getdents d5 0 2024-09-17T01:01:55.367 INFO:tasks.workunit.client.1.smithi099.stdout:1/438: rename d0/d2/d9 to d0/d8/d49/d94 0 2024-09-17T01:01:55.372 INFO:tasks.workunit.client.0.smithi002.stdout:3/365: symlink d0/d31/d32/l7a 0 2024-09-17T01:01:55.374 INFO:tasks.workunit.client.1.smithi099.stdout:8/413: rename d0/d1f/c3f to d0/c8b 0 2024-09-17T01:01:55.374 INFO:tasks.workunit.client.1.smithi099.stdout:8/414: write d0/d4/d29/f78 [360193,16067] 0 2024-09-17T01:01:55.374 INFO:tasks.workunit.client.1.smithi099.stdout:8/415: truncate d0/d4/d29/f58 369643 0 2024-09-17T01:01:55.375 INFO:tasks.workunit.client.1.smithi099.stdout:8/416: rmdir d0/d1f/d55 39 2024-09-17T01:01:55.376 INFO:tasks.workunit.client.0.smithi002.stdout:0/270: getdents dd/d19/d1a/d29 0 2024-09-17T01:01:55.376 INFO:tasks.workunit.client.0.smithi002.stdout:0/271: fdatasync dd/d19/f24 0 2024-09-17T01:01:55.376 INFO:tasks.workunit.client.0.smithi002.stdout:0/272: chown dd/d3d/l4b 96 1 2024-09-17T01:01:55.376 INFO:tasks.workunit.client.0.smithi002.stdout:0/273: chown dd/d19/d1c/d1f/l49 72 1 2024-09-17T01:01:55.377 INFO:tasks.workunit.client.1.smithi099.stdout:1/439: mknod d0/d2/c95 0 2024-09-17T01:01:55.377 INFO:tasks.workunit.client.1.smithi099.stdout:1/440: creat d0/d2/d18/f96 x:0 0 0 2024-09-17T01:01:55.377 INFO:tasks.workunit.client.1.smithi099.stdout:8/417: getdents d0/d41/d5a 0 2024-09-17T01:01:55.378 INFO:tasks.workunit.client.0.smithi002.stdout:1/377: mkdir d4/d11/d12/d23/d32/d86 0 2024-09-17T01:01:55.379 INFO:tasks.workunit.client.1.smithi099.stdout:1/441: mknod d0/d2/de/d31/c97 0 2024-09-17T01:01:55.379 INFO:tasks.workunit.client.1.smithi099.stdout:8/418: dread d0/d1f/f12 [4194304,4194304] 0 2024-09-17T01:01:55.380 INFO:tasks.workunit.client.0.smithi002.stdout:5/347: truncate d2/f6 638814 0 2024-09-17T01:01:55.380 INFO:tasks.workunit.client.0.smithi002.stdout:5/348: fsync d2/d2d/d10/d14/d19/d39/d25/d32/f40 0 2024-09-17T01:01:55.380 INFO:tasks.workunit.client.0.smithi002.stdout:5/349: write d2/d2d/d10/d20/d24/f2e [5203650,48733] 0 2024-09-17T01:01:55.381 INFO:tasks.workunit.client.1.smithi099.stdout:1/442: mkdir d0/d2/d51/d98 0 2024-09-17T01:01:55.381 INFO:tasks.workunit.client.0.smithi002.stdout:7/280: unlink d1/lc 0 2024-09-17T01:01:55.381 INFO:tasks.workunit.client.0.smithi002.stdout:7/281: fsync f0 0 2024-09-17T01:01:55.382 INFO:tasks.workunit.client.1.smithi099.stdout:4/377: dwrite d7/fb [4194304,4194304] 0 2024-09-17T01:01:55.382 INFO:tasks.workunit.client.1.smithi099.stdout:4/378: write d7/dd/d21/f77 [123945,49835] 0 2024-09-17T01:01:55.382 INFO:tasks.workunit.client.1.smithi099.stdout:4/379: chown l5 1162644378 1 2024-09-17T01:01:55.382 INFO:tasks.workunit.client.1.smithi099.stdout:4/380: readlink d7/dd/d21/d26/d3f/d5b/l24 0 2024-09-17T01:01:55.382 INFO:tasks.workunit.client.1.smithi099.stdout:4/381: chown d7/dd/de/d10/d3a/f53 1998388 1 2024-09-17T01:01:55.382 INFO:tasks.workunit.client.1.smithi099.stdout:1/443: creat d0/d8c/f99 x:0 0 0 2024-09-17T01:01:55.383 INFO:tasks.workunit.client.0.smithi002.stdout:9/297: creat d5/f4f x:0 0 0 2024-09-17T01:01:55.383 INFO:tasks.workunit.client.1.smithi099.stdout:4/382: mkdir d7/d35/d80/d83 0 2024-09-17T01:01:55.383 INFO:tasks.workunit.client.1.smithi099.stdout:4/383: fsync d7/dd/d21/d26/d3f/d5b/f37 0 2024-09-17T01:01:55.383 INFO:tasks.workunit.client.1.smithi099.stdout:4/384: write d7/dd/d21/d26/f6c [876899,87318] 0 2024-09-17T01:01:55.384 INFO:tasks.workunit.client.0.smithi002.stdout:3/366: creat d0/d3/d33/f7b x:0 0 0 2024-09-17T01:01:55.384 INFO:tasks.workunit.client.0.smithi002.stdout:1/378: read d4/d11/d12/d14/f36 [3993637,109254] 0 2024-09-17T01:01:55.385 INFO:tasks.workunit.client.1.smithi099.stdout:1/444: truncate d0/d8/f26 300755 0 2024-09-17T01:01:55.385 INFO:tasks.workunit.client.0.smithi002.stdout:0/274: symlink dd/d3d/l5d 0 2024-09-17T01:01:55.385 INFO:tasks.workunit.client.0.smithi002.stdout:0/275: truncate dd/d19/f3b 540899 0 2024-09-17T01:01:55.385 INFO:tasks.workunit.client.1.smithi099.stdout:4/385: symlink d7/d35/l84 0 2024-09-17T01:01:55.385 INFO:tasks.workunit.client.1.smithi099.stdout:0/406: write da/d12/d2b/f37 [3747668,69215] 0 2024-09-17T01:01:55.386 INFO:tasks.workunit.client.1.smithi099.stdout:0/407: write da/df/d1a/d49/f51 [1718993,61482] 0 2024-09-17T01:01:55.386 INFO:tasks.workunit.client.1.smithi099.stdout:0/408: dread - da/d59/f75 zero size 2024-09-17T01:01:55.386 INFO:tasks.workunit.client.1.smithi099.stdout:6/449: dwrite dc/d1a/d49/f5b [0,4194304] 0 2024-09-17T01:01:55.387 INFO:tasks.workunit.client.0.smithi002.stdout:7/282: getdents d1/d14/d1d/d28/d2d 0 2024-09-17T01:01:55.388 INFO:tasks.workunit.client.0.smithi002.stdout:5/350: dread d2/d2d/d10/d14/d19/d39/f3c [0,4194304] 0 2024-09-17T01:01:55.389 INFO:tasks.workunit.client.1.smithi099.stdout:1/445: creat d0/d2/de/d8b/f9a x:0 0 0 2024-09-17T01:01:55.394 INFO:tasks.workunit.client.1.smithi099.stdout:1/446: rename d0/d8/f7c to d0/d8/d38/d75/f9b 0 2024-09-17T01:01:55.394 INFO:tasks.workunit.client.1.smithi099.stdout:1/447: write d0/d2/f88 [346006,51353] 0 2024-09-17T01:01:55.394 INFO:tasks.workunit.client.0.smithi002.stdout:3/367: dread d0/d3/d17/f2c [0,4194304] 0 2024-09-17T01:01:55.394 INFO:tasks.workunit.client.0.smithi002.stdout:3/368: creat d0/d3/d37/d5a/f7c x:0 0 0 2024-09-17T01:01:55.394 INFO:tasks.workunit.client.0.smithi002.stdout:7/283: symlink d1/d14/d1d/l5b 0 2024-09-17T01:01:55.395 INFO:tasks.workunit.client.1.smithi099.stdout:1/448: readlink d0/d2/l3e 0 2024-09-17T01:01:55.395 INFO:tasks.workunit.client.1.smithi099.stdout:1/449: creat d0/d8/f9c x:0 0 0 2024-09-17T01:01:55.395 INFO:tasks.workunit.client.1.smithi099.stdout:1/450: chown d0/d2/d51/c5f 12288 1 2024-09-17T01:01:55.395 INFO:tasks.workunit.client.1.smithi099.stdout:1/451: fdatasync d0/d2/de/d70/f86 0 2024-09-17T01:01:55.397 INFO:tasks.workunit.client.1.smithi099.stdout:1/452: getdents d0/d8/d38 0 2024-09-17T01:01:55.397 INFO:tasks.workunit.client.1.smithi099.stdout:1/453: write d0/d2/d18/f28 [1459373,95342] 0 2024-09-17T01:01:55.397 INFO:tasks.workunit.client.1.smithi099.stdout:1/454: chown d0/d2/f24 239454 1 2024-09-17T01:01:55.397 INFO:tasks.workunit.client.1.smithi099.stdout:1/455: creat d0/d8c/f9d x:0 0 0 2024-09-17T01:01:55.398 INFO:tasks.workunit.client.0.smithi002.stdout:9/298: link d5/dc/d26/f3b d5/dc/d26/d46/f50 0 2024-09-17T01:01:55.398 INFO:tasks.workunit.client.0.smithi002.stdout:9/299: read - d5/dc/f4b zero size 2024-09-17T01:01:55.398 INFO:tasks.workunit.client.0.smithi002.stdout:5/351: dread d2/de/f4a [0,4194304] 0 2024-09-17T01:01:55.399 INFO:tasks.workunit.client.0.smithi002.stdout:5/352: fsync d2/d2d/d10/d14/d19/d39/f3c 0 2024-09-17T01:01:55.399 INFO:tasks.workunit.client.1.smithi099.stdout:4/386: write d7/dd/d21/d7b/f42 [515201,31117] 0 2024-09-17T01:01:55.399 INFO:tasks.workunit.client.1.smithi099.stdout:4/387: fdatasync d7/dd/d21/d7b/d4b/f1d 0 2024-09-17T01:01:55.400 INFO:tasks.workunit.client.0.smithi002.stdout:1/379: rename d4/d11/d55/c6b to d4/d11/d12/d14/d17/d3b/c87 0 2024-09-17T01:01:55.401 INFO:tasks.workunit.client.0.smithi002.stdout:2/374: rmdir d1b 39 2024-09-17T01:01:55.403 INFO:tasks.workunit.client.1.smithi099.stdout:8/419: dwrite d0/d1f/f62 [0,4194304] 0 2024-09-17T01:01:55.403 INFO:tasks.workunit.client.1.smithi099.stdout:4/388: dread d7/dd/f28 [0,4194304] 0 2024-09-17T01:01:55.403 INFO:tasks.workunit.client.1.smithi099.stdout:4/389: fdatasync d7/dd/de/d10/f61 0 2024-09-17T01:01:55.404 INFO:tasks.workunit.client.0.smithi002.stdout:0/276: rmdir dd/d19 39 2024-09-17T01:01:55.405 INFO:tasks.workunit.client.1.smithi099.stdout:8/420: mkdir d0/d1f/d31/d4c/d8c 0 2024-09-17T01:01:55.406 INFO:tasks.workunit.client.1.smithi099.stdout:4/390: mkdir d7/dd/de/d10/d85 0 2024-09-17T01:01:55.408 INFO:tasks.workunit.client.0.smithi002.stdout:3/369: link d0/d3/d17/f2c d0/d3/d33/f7d 0 2024-09-17T01:01:55.408 INFO:tasks.workunit.client.0.smithi002.stdout:3/370: chown d0/d3/l9 3026288 1 2024-09-17T01:01:55.408 INFO:tasks.workunit.client.0.smithi002.stdout:3/371: creat d0/d3/d37/f7e x:0 0 0 2024-09-17T01:01:55.408 INFO:tasks.workunit.client.1.smithi099.stdout:1/456: write d0/f13 [2711309,110755] 0 2024-09-17T01:01:55.410 INFO:tasks.workunit.client.1.smithi099.stdout:1/457: mkdir d0/d8c/d9e 0 2024-09-17T01:01:55.412 INFO:tasks.workunit.client.0.smithi002.stdout:5/353: symlink d2/d2d/d10/d20/l6c 0 2024-09-17T01:01:55.412 INFO:tasks.workunit.client.0.smithi002.stdout:5/354: write d2/d2d/d10/d20/d24/f31 [4600695,75784] 0 2024-09-17T01:01:55.413 INFO:tasks.workunit.client.0.smithi002.stdout:1/380: mkdir d4/d11/d12/d14/d17/d51/d88 0 2024-09-17T01:01:55.413 INFO:tasks.workunit.client.0.smithi002.stdout:1/381: creat d4/d11/d12/d23/f89 x:0 0 0 2024-09-17T01:01:55.413 INFO:tasks.workunit.client.1.smithi099.stdout:0/409: dwrite da/d12/f5a [0,4194304] 0 2024-09-17T01:01:55.413 INFO:tasks.workunit.client.1.smithi099.stdout:0/410: write da/d12/f62 [335905,93690] 0 2024-09-17T01:01:55.413 INFO:tasks.workunit.client.1.smithi099.stdout:6/450: dwrite dc/d5d/f69 [0,4194304] 0 2024-09-17T01:01:55.414 INFO:tasks.workunit.client.0.smithi002.stdout:2/375: getdents d1b/d37/d48/d4e 0 2024-09-17T01:01:55.417 INFO:tasks.workunit.client.1.smithi099.stdout:8/421: dread d0/d4/d29/f78 [0,4194304] 0 2024-09-17T01:01:55.418 INFO:tasks.workunit.client.0.smithi002.stdout:3/372: truncate d0/d3/d33/d40/f52 1163690 0 2024-09-17T01:01:55.418 INFO:tasks.workunit.client.0.smithi002.stdout:7/284: getdents d1/d14/d1d/d29/d4b 0 2024-09-17T01:01:55.418 INFO:tasks.workunit.client.0.smithi002.stdout:7/285: chown d1/d14/d1d/d29/d57/c51 25480 1 2024-09-17T01:01:55.419 INFO:tasks.workunit.client.1.smithi099.stdout:0/411: mknod da/d12/d22/d52/c87 0 2024-09-17T01:01:55.419 INFO:tasks.workunit.client.1.smithi099.stdout:0/412: fsync da/d12/d2b/f37 0 2024-09-17T01:01:55.422 INFO:tasks.workunit.client.1.smithi099.stdout:8/422: creat d0/d4/d64/f8d x:0 0 0 2024-09-17T01:01:55.422 INFO:tasks.workunit.client.1.smithi099.stdout:8/423: write d0/d1f/d31/f7b [646324,61878] 0 2024-09-17T01:01:55.422 INFO:tasks.workunit.client.1.smithi099.stdout:8/424: write d0/d4/d29/f57 [1018557,49114] 0 2024-09-17T01:01:55.422 INFO:tasks.workunit.client.1.smithi099.stdout:8/425: write d0/d1f/f2c [2876512,61607] 0 2024-09-17T01:01:55.423 INFO:tasks.workunit.client.0.smithi002.stdout:9/300: dread d5/f20 [4194304,4194304] 0 2024-09-17T01:01:55.423 INFO:tasks.workunit.client.1.smithi099.stdout:0/413: symlink da/d3b/l88 0 2024-09-17T01:01:55.426 INFO:tasks.workunit.client.0.smithi002.stdout:5/355: symlink d2/d2d/l6d 0 2024-09-17T01:01:55.428 INFO:tasks.workunit.client.1.smithi099.stdout:0/414: creat da/d12/d22/d52/f89 x:0 0 0 2024-09-17T01:01:55.431 INFO:tasks.workunit.client.0.smithi002.stdout:2/376: creat d1b/d8a/f8c x:0 0 0 2024-09-17T01:01:55.431 INFO:tasks.workunit.client.0.smithi002.stdout:2/377: chown d1b/d37/d48/d4e/f54 31518866 1 2024-09-17T01:01:55.432 INFO:tasks.workunit.client.0.smithi002.stdout:3/373: write d0/f1f [1021479,75293] 0 2024-09-17T01:01:55.432 INFO:tasks.workunit.client.0.smithi002.stdout:3/374: dread - d0/d3/d37/d5a/f66 zero size 2024-09-17T01:01:55.432 INFO:tasks.workunit.client.0.smithi002.stdout:3/375: write d0/f23 [1642515,70241] 0 2024-09-17T01:01:55.434 INFO:tasks.workunit.client.0.smithi002.stdout:1/382: dread d4/d11/d12/d14/f2b [0,4194304] 0 2024-09-17T01:01:55.435 INFO:tasks.workunit.client.0.smithi002.stdout:1/383: fsync d4/d11/f71 0 2024-09-17T01:01:55.435 INFO:tasks.workunit.client.0.smithi002.stdout:3/376: creat d0/d3/d33/d77/f7f x:0 0 0 2024-09-17T01:01:55.437 INFO:tasks.workunit.client.0.smithi002.stdout:1/384: symlink d4/d11/d12/d23/d32/l8a 0 2024-09-17T01:01:55.437 INFO:tasks.workunit.client.0.smithi002.stdout:1/385: chown d4/d11/c52 504 1 2024-09-17T01:01:55.437 INFO:tasks.workunit.client.0.smithi002.stdout:1/386: truncate d4/d11/d12/d23/f89 421167 0 2024-09-17T01:01:55.442 INFO:tasks.workunit.client.0.smithi002.stdout:1/387: creat d4/d11/d12/d23/d32/d86/f8b x:0 0 0 2024-09-17T01:01:55.444 INFO:tasks.workunit.client.1.smithi099.stdout:1/458: dwrite d0/d8/d49/d4e/f6c [0,4194304] 0 2024-09-17T01:01:55.449 INFO:tasks.workunit.client.1.smithi099.stdout:6/451: dwrite dc/d2b/f4b [0,4194304] 0 2024-09-17T01:01:55.450 INFO:tasks.workunit.client.0.smithi002.stdout:8/453: sync 2024-09-17T01:01:55.451 INFO:tasks.workunit.client.1.smithi099.stdout:6/452: creat dc/d2b/d3f/f8e x:0 0 0 2024-09-17T01:01:55.452 INFO:tasks.workunit.client.0.smithi002.stdout:8/454: creat d2/f9a x:0 0 0 2024-09-17T01:01:55.453 INFO:tasks.workunit.client.1.smithi099.stdout:6/453: mknod dc/d5d/d66/c8f 0 2024-09-17T01:01:55.454 INFO:tasks.workunit.client.0.smithi002.stdout:8/455: rename d2/d3/d5f/c83 to d2/d26/d2b/d71/d89/c9b 0 2024-09-17T01:01:55.454 INFO:tasks.workunit.client.0.smithi002.stdout:0/277: dwrite dd/f14 [0,4194304] 0 2024-09-17T01:01:55.455 INFO:tasks.workunit.client.1.smithi099.stdout:8/426: dwrite d0/f61 [0,4194304] 0 2024-09-17T01:01:55.455 INFO:tasks.workunit.client.1.smithi099.stdout:8/427: dread - d0/d4/d64/f8d zero size 2024-09-17T01:01:55.455 INFO:tasks.workunit.client.1.smithi099.stdout:8/428: write d0/d4/f6c [308868,81915] 0 2024-09-17T01:01:55.456 INFO:tasks.workunit.client.0.smithi002.stdout:0/278: stat dd/d19/l2e 0 2024-09-17T01:01:55.456 INFO:tasks.workunit.client.1.smithi099.stdout:8/429: creat d0/d4/d29/f8e x:0 0 0 2024-09-17T01:01:55.457 INFO:tasks.workunit.client.0.smithi002.stdout:8/456: mkdir d2/d9/d9c 0 2024-09-17T01:01:55.457 INFO:tasks.workunit.client.0.smithi002.stdout:8/457: readlink d2/d3/d5f/d47/l91 0 2024-09-17T01:01:55.457 INFO:tasks.workunit.client.0.smithi002.stdout:8/458: write d2/d41/f90 [820219,16538] 0 2024-09-17T01:01:55.457 INFO:tasks.workunit.client.0.smithi002.stdout:1/388: dread d4/d11/f15 [0,4194304] 0 2024-09-17T01:01:55.458 INFO:tasks.workunit.client.1.smithi099.stdout:8/430: creat d0/d4/d29/d4b/f8f x:0 0 0 2024-09-17T01:01:55.458 INFO:tasks.workunit.client.1.smithi099.stdout:8/431: chown d0/d1f/d31/d4c/f7d 24559541 1 2024-09-17T01:01:55.459 INFO:tasks.workunit.client.0.smithi002.stdout:1/389: mkdir d4/d11/d12/d30/d5e/d8c 0 2024-09-17T01:01:55.460 INFO:tasks.workunit.client.0.smithi002.stdout:0/279: symlink dd/l5e 0 2024-09-17T01:01:55.460 INFO:tasks.workunit.client.0.smithi002.stdout:0/280: write dd/d19/f34 [871072,73753] 0 2024-09-17T01:01:55.461 INFO:tasks.workunit.client.0.smithi002.stdout:0/281: write dd/d19/d1c/d1f/d22/f51 [209442,38839] 0 2024-09-17T01:01:55.461 INFO:tasks.workunit.client.0.smithi002.stdout:0/282: fsync dd/f14 0 2024-09-17T01:01:55.461 INFO:tasks.workunit.client.0.smithi002.stdout:1/390: mkdir d4/d22/d8d 0 2024-09-17T01:01:55.462 INFO:tasks.workunit.client.0.smithi002.stdout:0/283: creat dd/d19/d1a/f5f x:0 0 0 2024-09-17T01:01:55.465 INFO:tasks.workunit.client.0.smithi002.stdout:1/391: link d4/d11/d1a/f29 d4/d11/d12/d14/d17/d56/f8e 0 2024-09-17T01:01:55.465 INFO:tasks.workunit.client.0.smithi002.stdout:1/392: fdatasync d4/d11/d12/d14/d17/d20/f5b 0 2024-09-17T01:01:55.467 INFO:tasks.workunit.client.0.smithi002.stdout:0/284: getdents dd/d19 0 2024-09-17T01:01:55.467 INFO:tasks.workunit.client.0.smithi002.stdout:0/285: chown dd/d19/d1a/f4a 125542 1 2024-09-17T01:01:55.467 INFO:tasks.workunit.client.0.smithi002.stdout:0/286: write dd/d3d/f3f [134790,8459] 0 2024-09-17T01:01:55.467 INFO:tasks.workunit.client.0.smithi002.stdout:0/287: dread - dd/d3d/f50 zero size 2024-09-17T01:01:55.469 INFO:tasks.workunit.client.0.smithi002.stdout:9/301: dwrite d5/dc/f32 [0,4194304] 0 2024-09-17T01:01:55.470 INFO:tasks.workunit.client.1.smithi099.stdout:0/415: dwrite da/d12/f16 [4194304,4194304] 0 2024-09-17T01:01:55.470 INFO:tasks.workunit.client.1.smithi099.stdout:0/416: write da/df/f28 [740189,61833] 0 2024-09-17T01:01:55.470 INFO:tasks.workunit.client.1.smithi099.stdout:0/417: read - da/d12/d22/d52/f89 zero size 2024-09-17T01:01:55.470 INFO:tasks.workunit.client.1.smithi099.stdout:0/418: truncate da/df/d1a/d56/f74 226641 0 2024-09-17T01:01:55.474 INFO:tasks.workunit.client.1.smithi099.stdout:0/419: rename da/df/d1a/f2d to da/df/d1a/d63/d6a/f8a 0 2024-09-17T01:01:55.474 INFO:tasks.workunit.client.1.smithi099.stdout:0/420: readlink da/l2e 0 2024-09-17T01:01:55.474 INFO:tasks.workunit.client.1.smithi099.stdout:1/459: dwrite d0/d2/f88 [0,4194304] 0 2024-09-17T01:01:55.474 INFO:tasks.workunit.client.1.smithi099.stdout:1/460: creat d0/d2/d61/f9f x:0 0 0 2024-09-17T01:01:55.474 INFO:tasks.workunit.client.1.smithi099.stdout:1/461: readlink d0/d2/de/l35 0 2024-09-17T01:01:55.474 INFO:tasks.workunit.client.0.smithi002.stdout:5/356: dwrite d2/de/f34 [0,4194304] 0 2024-09-17T01:01:55.475 INFO:tasks.workunit.client.0.smithi002.stdout:5/357: dread d2/f6 [0,4194304] 0 2024-09-17T01:01:55.477 INFO:tasks.workunit.client.0.smithi002.stdout:3/377: dread d0/f23 [0,4194304] 0 2024-09-17T01:01:55.482 INFO:tasks.workunit.client.0.smithi002.stdout:3/378: unlink d0/d3/d37/c39 0 2024-09-17T01:01:55.482 INFO:tasks.workunit.client.0.smithi002.stdout:3/379: write d0/d3/d33/d40/f63 [4527888,123630] 0 2024-09-17T01:01:55.486 INFO:tasks.workunit.client.1.smithi099.stdout:1/462: symlink d0/d8/d49/d94/la0 0 2024-09-17T01:01:55.486 INFO:tasks.workunit.client.1.smithi099.stdout:1/463: write d0/f40 [4351277,77471] 0 2024-09-17T01:01:55.486 INFO:tasks.workunit.client.0.smithi002.stdout:3/380: mkdir d0/d3/d80 0 2024-09-17T01:01:55.487 INFO:tasks.workunit.client.1.smithi099.stdout:0/421: getdents da/df/d4d 0 2024-09-17T01:01:55.488 INFO:tasks.workunit.client.1.smithi099.stdout:1/464: mknod d0/d8/d38/d75/ca1 0 2024-09-17T01:01:55.491 INFO:tasks.workunit.client.1.smithi099.stdout:1/465: symlink d0/la2 0 2024-09-17T01:01:55.495 INFO:tasks.workunit.client.1.smithi099.stdout:8/432: dwrite d0/d1f/d31/d4c/f70 [0,4194304] 0 2024-09-17T01:01:55.495 INFO:tasks.workunit.client.1.smithi099.stdout:8/433: chown d0/d1f/c8a 1 1 2024-09-17T01:01:55.495 INFO:tasks.workunit.client.1.smithi099.stdout:8/434: readlink d0/d1f/d55/l88 0 2024-09-17T01:01:55.501 INFO:tasks.workunit.client.1.smithi099.stdout:6/454: dwrite dc/d1a/d49/f73 [0,4194304] 0 2024-09-17T01:01:55.503 INFO:tasks.workunit.client.1.smithi099.stdout:6/455: symlink dc/d27/l90 0 2024-09-17T01:01:55.517 INFO:tasks.workunit.client.0.smithi002.stdout:9/302: dwrite d5/dc/d26/f31 [0,4194304] 0 2024-09-17T01:01:55.517 INFO:tasks.workunit.client.0.smithi002.stdout:9/303: chown d5/dc/d26/d46/d47/f48 437377277 1 2024-09-17T01:01:55.518 INFO:tasks.workunit.client.0.smithi002.stdout:9/304: mknod d5/dc/d26/d34/c51 0 2024-09-17T01:01:55.521 INFO:tasks.workunit.client.0.smithi002.stdout:9/305: dread d5/dc/d26/d46/f50 [0,4194304] 0 2024-09-17T01:01:55.522 INFO:tasks.workunit.client.0.smithi002.stdout:9/306: symlink d5/l52 0 2024-09-17T01:01:55.527 INFO:tasks.workunit.client.0.smithi002.stdout:1/393: dwrite d4/fa [0,4194304] 0 2024-09-17T01:01:55.527 INFO:tasks.workunit.client.0.smithi002.stdout:1/394: creat d4/d11/d12/d23/d32/f8f x:0 0 0 2024-09-17T01:01:55.528 INFO:tasks.workunit.client.0.smithi002.stdout:5/358: dwrite d2/d2d/d10/d23/d44/f6b [4194304,4194304] 0 2024-09-17T01:01:55.528 INFO:tasks.workunit.client.0.smithi002.stdout:3/381: dwrite d0/d3/d37/f7e [0,4194304] 0 2024-09-17T01:01:55.528 INFO:tasks.workunit.client.0.smithi002.stdout:5/359: chown d2/d2d/d10/d14/c45 88294607 1 2024-09-17T01:01:55.531 INFO:tasks.workunit.client.0.smithi002.stdout:1/395: unlink d4/f6 0 2024-09-17T01:01:55.531 INFO:tasks.workunit.client.0.smithi002.stdout:1/396: write d4/d11/f82 [959091,118101] 0 2024-09-17T01:01:55.531 INFO:tasks.workunit.client.0.smithi002.stdout:1/397: write d4/d11/f5c [262710,93503] 0 2024-09-17T01:01:55.531 INFO:tasks.workunit.client.0.smithi002.stdout:1/398: rename d4/d11/d12/d23/d32 to d4/d11/d12/d23/d32/d90 22 2024-09-17T01:01:55.531 INFO:tasks.workunit.client.0.smithi002.stdout:1/399: write d4/d11/d12/d14/d17/d56/f6f [996846,121760] 0 2024-09-17T01:01:55.536 INFO:tasks.workunit.client.0.smithi002.stdout:1/400: link d4/d11/d12/d14/l33 d4/d11/d12/d23/d32/l91 0 2024-09-17T01:01:55.536 INFO:tasks.workunit.client.0.smithi002.stdout:1/401: dread - d4/d11/d12/d14/d17/d20/f50 zero size 2024-09-17T01:01:55.540 INFO:tasks.workunit.client.1.smithi099.stdout:1/466: dwrite d0/d2/d61/f7a [0,4194304] 0 2024-09-17T01:01:55.540 INFO:tasks.workunit.client.0.smithi002.stdout:0/288: dwrite dd/f5a [0,4194304] 0 2024-09-17T01:01:55.540 INFO:tasks.workunit.client.0.smithi002.stdout:0/289: chown dd/d19/l23 11283 1 2024-09-17T01:01:55.541 INFO:tasks.workunit.client.0.smithi002.stdout:1/402: creat d4/d11/d55/f92 x:0 0 0 2024-09-17T01:01:55.542 INFO:tasks.workunit.client.1.smithi099.stdout:1/467: symlink d0/d2/d51/la3 0 2024-09-17T01:01:55.542 INFO:tasks.workunit.client.1.smithi099.stdout:1/468: chown d0/d2/d5/c60 583418 1 2024-09-17T01:01:55.544 INFO:tasks.workunit.client.1.smithi099.stdout:1/469: rename d0/d8/d49/d94/l2f to d0/d8/d49/d94/d4b/la4 0 2024-09-17T01:01:55.544 INFO:tasks.workunit.client.0.smithi002.stdout:9/307: dwrite d5/dc/d26/d46/d47/f48 [0,4194304] 0 2024-09-17T01:01:55.545 INFO:tasks.workunit.client.1.smithi099.stdout:1/470: symlink d0/d2/la5 0 2024-09-17T01:01:55.545 INFO:tasks.workunit.client.0.smithi002.stdout:3/382: rmdir d0/d3 39 2024-09-17T01:01:55.548 INFO:tasks.workunit.client.1.smithi099.stdout:1/471: dread d0/d2/d18/f28 [0,4194304] 0 2024-09-17T01:01:55.549 INFO:tasks.workunit.client.1.smithi099.stdout:1/472: creat d0/d2/fa6 x:0 0 0 2024-09-17T01:01:55.550 INFO:tasks.workunit.client.0.smithi002.stdout:0/290: mknod dd/d19/d1a/d29/d55/d56/c60 0 2024-09-17T01:01:55.552 INFO:tasks.workunit.client.0.smithi002.stdout:1/403: rmdir d4/d11/d12/d30/d5e 39 2024-09-17T01:01:55.552 INFO:tasks.workunit.client.0.smithi002.stdout:5/360: dwrite d2/de/f34 [0,4194304] 0 2024-09-17T01:01:55.553 INFO:tasks.workunit.client.1.smithi099.stdout:1/473: rename d0/d2/d51 to d0/d2/de/d8b/da7 0 2024-09-17T01:01:55.554 INFO:tasks.workunit.client.0.smithi002.stdout:9/308: read d5/f19 [25132,49339] 0 2024-09-17T01:01:55.554 INFO:tasks.workunit.client.0.smithi002.stdout:9/309: chown d5/dc/c12 70 1 2024-09-17T01:01:55.554 INFO:tasks.workunit.client.0.smithi002.stdout:9/310: dread - d5/f4f zero size 2024-09-17T01:01:55.555 INFO:tasks.workunit.client.0.smithi002.stdout:9/311: write d5/dc/d26/d46/f50 [2186082,18469] 0 2024-09-17T01:01:55.555 INFO:tasks.workunit.client.1.smithi099.stdout:1/474: creat d0/d2/de/d8b/da7/d98/fa8 x:0 0 0 2024-09-17T01:01:55.556 INFO:tasks.workunit.client.1.smithi099.stdout:1/475: rename d0/d2/d61/f7a to d0/d8/d38/d75/fa9 0 2024-09-17T01:01:55.557 INFO:tasks.workunit.client.0.smithi002.stdout:3/383: creat d0/d31/d32/f81 x:0 0 0 2024-09-17T01:01:55.557 INFO:tasks.workunit.client.0.smithi002.stdout:3/384: truncate d0/d3/d37/f4d 50422 0 2024-09-17T01:01:55.560 INFO:tasks.workunit.client.0.smithi002.stdout:1/404: mknod d4/d11/d12/d14/c93 0 2024-09-17T01:01:55.561 INFO:tasks.workunit.client.0.smithi002.stdout:5/361: rename d2/d2d/d10/d23/d44 to d2/d2d/d10/d23/d6e 0 2024-09-17T01:01:55.563 INFO:tasks.workunit.client.0.smithi002.stdout:9/312: stat d5/f49 0 2024-09-17T01:01:55.564 INFO:tasks.workunit.client.0.smithi002.stdout:3/385: symlink d0/d3/d17/d35/l82 0 2024-09-17T01:01:55.567 INFO:tasks.workunit.client.0.smithi002.stdout:1/405: mknod d4/d11/d12/d14/d17/d40/c94 0 2024-09-17T01:01:55.567 INFO:tasks.workunit.client.0.smithi002.stdout:4/378: sync 2024-09-17T01:01:55.567 INFO:tasks.workunit.client.0.smithi002.stdout:4/379: chown d7 429 1 2024-09-17T01:01:55.567 INFO:tasks.workunit.client.0.smithi002.stdout:4/380: getdents d7/d19/d4a/d4d 0 2024-09-17T01:01:55.567 INFO:tasks.workunit.client.0.smithi002.stdout:6/338: sync 2024-09-17T01:01:55.568 INFO:tasks.workunit.client.0.smithi002.stdout:0/291: dwrite dd/d19/d1c/d1f/f21 [0,4194304] 0 2024-09-17T01:01:55.569 INFO:tasks.workunit.client.0.smithi002.stdout:5/362: rename d2/d2d/l6d to d2/d2d/d10/d23/d6e/l6f 0 2024-09-17T01:01:55.571 INFO:tasks.workunit.client.0.smithi002.stdout:4/381: mkdir d7/d71 0 2024-09-17T01:01:55.573 INFO:tasks.workunit.client.0.smithi002.stdout:6/339: link d2/c10 d2/dc/d24/d53/c61 0 2024-09-17T01:01:55.574 INFO:tasks.workunit.client.0.smithi002.stdout:0/292: mkdir dd/d19/d1a/d29/d55/d61 0 2024-09-17T01:01:55.574 INFO:tasks.workunit.client.0.smithi002.stdout:9/313: symlink d5/l53 0 2024-09-17T01:01:55.575 INFO:tasks.workunit.client.0.smithi002.stdout:4/382: mknod d7/de/d55/c72 0 2024-09-17T01:01:55.576 INFO:tasks.workunit.client.0.smithi002.stdout:1/406: dread d4/d11/d12/d14/f1b [0,4194304] 0 2024-09-17T01:01:55.576 INFO:tasks.workunit.client.0.smithi002.stdout:6/340: getdents d2/d1d/d26/d40/d43 0 2024-09-17T01:01:55.579 INFO:tasks.workunit.client.0.smithi002.stdout:9/314: mknod d5/dc/d26/d46/c54 0 2024-09-17T01:01:55.579 INFO:tasks.workunit.client.0.smithi002.stdout:4/383: rename d7/de/d32/f53 to d7/de/d32/f73 0 2024-09-17T01:01:55.579 INFO:tasks.workunit.client.0.smithi002.stdout:4/384: dread - d7/de/d32/f73 zero size 2024-09-17T01:01:55.580 INFO:tasks.workunit.client.1.smithi099.stdout:1/476: dwrite d0/d8/d49/d4e/f6d [0,4194304] 0 2024-09-17T01:01:55.580 INFO:tasks.workunit.client.1.smithi099.stdout:1/477: fsync d0/d8/d49/d4e/f50 0 2024-09-17T01:01:55.580 INFO:tasks.workunit.client.1.smithi099.stdout:1/478: truncate d0/d2/d5/f4d 772208 0 2024-09-17T01:01:55.580 INFO:tasks.workunit.client.1.smithi099.stdout:1/479: dread - d0/d2/de/d8b/da7/d98/fa8 zero size 2024-09-17T01:01:55.580 INFO:tasks.workunit.client.1.smithi099.stdout:1/480: write d0/d2/f73 [246873,93776] 0 2024-09-17T01:01:55.580 INFO:tasks.workunit.client.1.smithi099.stdout:1/481: fsync d0/d8c/f99 0 2024-09-17T01:01:55.580 INFO:tasks.workunit.client.1.smithi099.stdout:1/482: creat d0/d8c/faa x:0 0 0 2024-09-17T01:01:55.580 INFO:tasks.workunit.client.1.smithi099.stdout:1/483: creat d0/d2/d61/fab x:0 0 0 2024-09-17T01:01:55.581 INFO:tasks.workunit.client.0.smithi002.stdout:1/407: unlink d4/d11/d12/d30/d5e/c7c 0 2024-09-17T01:01:55.581 INFO:tasks.workunit.client.0.smithi002.stdout:1/408: chown d4/d22/c54 10985 1 2024-09-17T01:01:55.581 INFO:tasks.workunit.client.0.smithi002.stdout:6/341: creat d2/d4b/d4c/f62 x:0 0 0 2024-09-17T01:01:55.582 INFO:tasks.workunit.client.0.smithi002.stdout:1/409: mkdir d4/d11/d1a/d95 0 2024-09-17T01:01:55.582 INFO:tasks.workunit.client.0.smithi002.stdout:1/410: chown d4/d11/d12/d14/d17/d40/c46 451 1 2024-09-17T01:01:55.582 INFO:tasks.workunit.client.1.smithi099.stdout:1/484: mknod d0/d8/d38/d75/cac 0 2024-09-17T01:01:55.583 INFO:tasks.workunit.client.1.smithi099.stdout:1/485: write d0/d8/d49/d94/f6f [129817,111819] 0 2024-09-17T01:01:55.586 INFO:tasks.workunit.client.1.smithi099.stdout:1/486: symlink d0/d8/d38/d56/d93/lad 0 2024-09-17T01:01:55.587 INFO:tasks.workunit.client.0.smithi002.stdout:5/363: write d2/d2d/d10/d14/d19/d39/f35 [755052,75073] 0 2024-09-17T01:01:55.587 INFO:tasks.workunit.client.0.smithi002.stdout:4/385: dread d7/de/d3a/f3c [0,4194304] 0 2024-09-17T01:01:55.589 INFO:tasks.workunit.client.0.smithi002.stdout:5/364: creat d2/d2d/d10/d14/d19/d39/d64/f70 x:0 0 0 2024-09-17T01:01:55.589 INFO:tasks.workunit.client.0.smithi002.stdout:5/365: creat d2/d2d/d10/f71 x:0 0 0 2024-09-17T01:01:55.589 INFO:tasks.workunit.client.0.smithi002.stdout:4/386: symlink d7/de/l74 0 2024-09-17T01:01:55.591 INFO:tasks.workunit.client.0.smithi002.stdout:5/366: symlink d2/d2d/d10/d20/d24/l72 0 2024-09-17T01:01:55.592 INFO:tasks.workunit.client.0.smithi002.stdout:5/367: symlink d2/d2d/d10/d20/d24/l73 0 2024-09-17T01:01:55.592 INFO:tasks.workunit.client.0.smithi002.stdout:5/368: creat d2/d2d/d10/d14/d19/d39/d25/d32/f74 x:0 0 0 2024-09-17T01:01:55.600 INFO:tasks.workunit.client.0.smithi002.stdout:0/293: dwrite dd/d3d/f3f [0,4194304] 0 2024-09-17T01:01:55.600 INFO:tasks.workunit.client.0.smithi002.stdout:0/294: dread - dd/d19/f2c zero size 2024-09-17T01:01:55.608 INFO:tasks.workunit.client.0.smithi002.stdout:4/387: dread d7/f12 [0,4194304] 0 2024-09-17T01:01:55.608 INFO:tasks.workunit.client.0.smithi002.stdout:1/411: dwrite d4/d11/d12/f7b [4194304,4194304] 0 2024-09-17T01:01:55.608 INFO:tasks.workunit.client.0.smithi002.stdout:1/412: stat d4/d11/d12/d30/d43/d67/c6a 0 2024-09-17T01:01:55.609 INFO:tasks.workunit.client.0.smithi002.stdout:4/388: truncate d7/de/d55/d62/f31 537301 0 2024-09-17T01:01:55.611 INFO:tasks.workunit.client.0.smithi002.stdout:4/389: getdents d7/d19 0 2024-09-17T01:01:55.613 INFO:tasks.workunit.client.0.smithi002.stdout:0/295: dread dd/f18 [0,4194304] 0 2024-09-17T01:01:55.613 INFO:tasks.workunit.client.0.smithi002.stdout:0/296: write dd/f57 [941607,15087] 0 2024-09-17T01:01:55.613 INFO:tasks.workunit.client.0.smithi002.stdout:0/297: chown dd/f18 146 1 2024-09-17T01:01:55.613 INFO:tasks.workunit.client.0.smithi002.stdout:0/298: read - dd/d19/f24 zero size 2024-09-17T01:01:55.613 INFO:tasks.workunit.client.0.smithi002.stdout:0/299: fdatasync dd/d19/f1e 0 2024-09-17T01:01:55.614 INFO:tasks.workunit.client.0.smithi002.stdout:0/300: symlink dd/d19/d1c/l62 0 2024-09-17T01:01:55.614 INFO:tasks.workunit.client.0.smithi002.stdout:0/301: rmdir dd/d19/d1c/d1f/d39 39 2024-09-17T01:01:55.615 INFO:tasks.workunit.client.0.smithi002.stdout:5/369: dwrite d2/d2d/d10/d20/d24/f2e [0,4194304] 0 2024-09-17T01:01:55.615 INFO:tasks.workunit.client.0.smithi002.stdout:4/390: dread d7/d19/d34/d54/f5f [0,4194304] 0 2024-09-17T01:01:55.615 INFO:tasks.workunit.client.0.smithi002.stdout:4/391: write d7/de/d3a/f5e [4711814,119705] 0 2024-09-17T01:01:55.616 INFO:tasks.workunit.client.1.smithi099.stdout:1/487: dwrite d0/d2/f73 [0,4194304] 0 2024-09-17T01:01:55.616 INFO:tasks.workunit.client.1.smithi099.stdout:1/488: read d0/d2/f3b [202834,30538] 0 2024-09-17T01:01:55.617 INFO:tasks.workunit.client.0.smithi002.stdout:5/370: symlink d2/d2d/d10/d14/d19/d39/d3f/l75 0 2024-09-17T01:01:55.619 INFO:tasks.workunit.client.0.smithi002.stdout:4/392: unlink d7/d19/d34/c66 0 2024-09-17T01:01:55.622 INFO:tasks.workunit.client.0.smithi002.stdout:5/371: creat d2/d2d/d10/d23/f76 x:0 0 0 2024-09-17T01:01:55.624 INFO:tasks.workunit.client.0.smithi002.stdout:5/372: link d2/d2d/f17 d2/d2d/d10/d20/d24/f77 0 2024-09-17T01:01:55.625 INFO:tasks.workunit.client.0.smithi002.stdout:5/373: link d2/de/c49 d2/d2d/d10/d23/d6e/c78 0 2024-09-17T01:01:55.625 INFO:tasks.workunit.client.0.smithi002.stdout:5/374: dread - d2/d2d/d10/d14/d19/d39/d25/d32/f74 zero size 2024-09-17T01:01:55.630 INFO:tasks.workunit.client.0.smithi002.stdout:5/375: getdents d2/d2d/d10/d14/d19/d39/d25/d32 0 2024-09-17T01:01:55.631 INFO:tasks.workunit.client.0.smithi002.stdout:5/376: creat d2/d2d/d10/d14/d19/d39/d51/f79 x:0 0 0 2024-09-17T01:01:55.632 INFO:tasks.workunit.client.0.smithi002.stdout:5/377: creat d2/d2d/d10/d20/d24/f7a x:0 0 0 2024-09-17T01:01:55.633 INFO:tasks.workunit.client.0.smithi002.stdout:4/393: write d7/d19/f1c [982066,76464] 0 2024-09-17T01:01:55.635 INFO:tasks.workunit.client.0.smithi002.stdout:4/394: symlink d7/de/d32/d59/l75 0 2024-09-17T01:01:55.635 INFO:tasks.workunit.client.1.smithi099.stdout:1/489: dwrite d0/d2/f73 [0,4194304] 0 2024-09-17T01:01:55.636 INFO:tasks.workunit.client.0.smithi002.stdout:4/395: rename d7/de/d3a/c5d to d7/d19/d4a/d4d/c76 0 2024-09-17T01:01:55.637 INFO:tasks.workunit.client.0.smithi002.stdout:4/396: readlink d7/l1b 0 2024-09-17T01:01:55.637 INFO:tasks.workunit.client.1.smithi099.stdout:1/490: rename d0/d2/l3e to d0/d8c/d9e/lae 0 2024-09-17T01:01:55.638 INFO:tasks.workunit.client.0.smithi002.stdout:4/397: mkdir d7/d19/d4a/d4d/d77 0 2024-09-17T01:01:55.638 INFO:tasks.workunit.client.0.smithi002.stdout:4/398: chown d7/d19/c49 6 1 2024-09-17T01:01:55.638 INFO:tasks.workunit.client.1.smithi099.stdout:1/491: unlink d0/d2/de/f5c 0 2024-09-17T01:01:55.639 INFO:tasks.workunit.client.0.smithi002.stdout:4/399: creat d7/d19/f78 x:0 0 0 2024-09-17T01:01:55.642 INFO:tasks.workunit.client.1.smithi099.stdout:1/492: fdatasync d0/d8/d49/d94/f6f 0 2024-09-17T01:01:55.642 INFO:tasks.workunit.client.1.smithi099.stdout:1/493: stat d0/d8/ca 0 2024-09-17T01:01:55.643 INFO:tasks.workunit.client.1.smithi099.stdout:1/494: rename d0/d8/f26 to d0/d8/d49/d94/d4b/faf 0 2024-09-17T01:01:55.644 INFO:tasks.workunit.client.1.smithi099.stdout:1/495: rmdir d0/d8/d38 39 2024-09-17T01:01:55.644 INFO:tasks.workunit.client.1.smithi099.stdout:1/496: creat d0/d2/d61/fb0 x:0 0 0 2024-09-17T01:01:55.645 INFO:tasks.workunit.client.1.smithi099.stdout:1/497: write d0/d2/d61/fb0 [339634,122478] 0 2024-09-17T01:01:55.647 INFO:tasks.workunit.client.0.smithi002.stdout:4/400: getdents d7/d19 0 2024-09-17T01:01:55.647 INFO:tasks.workunit.client.0.smithi002.stdout:4/401: getdents d7/d71 0 2024-09-17T01:01:55.647 INFO:tasks.workunit.client.0.smithi002.stdout:4/402: creat d7/de/f79 x:0 0 0 2024-09-17T01:01:55.647 INFO:tasks.workunit.client.0.smithi002.stdout:4/403: write d7/de/f67 [554081,26673] 0 2024-09-17T01:01:55.647 INFO:tasks.workunit.client.0.smithi002.stdout:4/404: dread - d7/d19/d2e/f70 zero size 2024-09-17T01:01:55.650 INFO:tasks.workunit.client.0.smithi002.stdout:5/378: dwrite d2/d2d/d10/d14/d19/f1c [0,4194304] 0 2024-09-17T01:01:55.664 INFO:tasks.workunit.client.1.smithi099.stdout:1/498: dwrite d0/d8/d49/d94/f6f [0,4194304] 0 2024-09-17T01:01:55.668 INFO:tasks.workunit.client.0.smithi002.stdout:4/405: dwrite d7/d19/d2e/f46 [4194304,4194304] 0 2024-09-17T01:01:55.669 INFO:tasks.workunit.client.0.smithi002.stdout:4/406: fsync d7/de/f67 0 2024-09-17T01:01:55.672 INFO:tasks.workunit.client.0.smithi002.stdout:4/407: dread d7/f4f [0,4194304] 0 2024-09-17T01:01:55.672 INFO:tasks.workunit.client.0.smithi002.stdout:4/408: chown d7/d19/f21 15872157 1 2024-09-17T01:01:55.672 INFO:tasks.workunit.client.0.smithi002.stdout:4/409: creat d7/de/d3a/f7a x:0 0 0 2024-09-17T01:01:55.674 INFO:tasks.workunit.client.1.smithi099.stdout:1/499: read d0/d8/d49/d94/f6f [1022155,113584] 0 2024-09-17T01:01:55.674 INFO:tasks.workunit.client.1.smithi099.stdout:1/500: write d0/d8/f9c [96937,113324] 0 2024-09-17T01:01:55.675 INFO:tasks.workunit.client.1.smithi099.stdout:1/501: mknod d0/d2/de/d70/cb1 0 2024-09-17T01:01:55.676 INFO:tasks.workunit.client.1.smithi099.stdout:1/502: symlink d0/d8/d49/lb2 0 2024-09-17T01:01:55.677 INFO:tasks.workunit.client.1.smithi099.stdout:1/503: rename d0/d8/d49/d94/c7d to d0/d8/d49/d94/d4b/cb3 0 2024-09-17T01:01:55.682 INFO:tasks.workunit.client.0.smithi002.stdout:4/410: write d7/de/f15 [5068129,43213] 0 2024-09-17T01:01:55.684 INFO:tasks.workunit.client.0.smithi002.stdout:4/411: unlink d7/de/f67 0 2024-09-17T01:01:55.684 INFO:tasks.workunit.client.0.smithi002.stdout:4/412: stat d7/de/c38 0 2024-09-17T01:01:55.691 INFO:tasks.workunit.client.1.smithi099.stdout:1/504: dwrite d0/d2/f88 [0,4194304] 0 2024-09-17T01:01:55.693 INFO:tasks.workunit.client.1.smithi099.stdout:1/505: symlink d0/d8/d38/d56/d93/lb4 0 2024-09-17T01:01:55.693 INFO:tasks.workunit.client.1.smithi099.stdout:1/506: truncate d0/d8c/faa 1031263 0 2024-09-17T01:01:55.693 INFO:tasks.workunit.client.1.smithi099.stdout:1/507: fsync d0/d8/d38/d56/f57 0 2024-09-17T01:01:55.693 INFO:tasks.workunit.client.1.smithi099.stdout:1/508: unlink d0/d2/de/l42 0 2024-09-17T01:01:55.694 INFO:tasks.workunit.client.1.smithi099.stdout:1/509: fsync d0/d8/d49/f5e 0 2024-09-17T01:01:55.694 INFO:tasks.workunit.client.1.smithi099.stdout:1/510: readlink d0/d2/de/l21 0 2024-09-17T01:01:55.694 INFO:tasks.workunit.client.1.smithi099.stdout:1/511: readlink d0/d2/d5/l8d 0 2024-09-17T01:01:55.694 INFO:tasks.workunit.client.1.smithi099.stdout:1/512: mknod d0/d2/de/d8b/cb5 0 2024-09-17T01:01:55.694 INFO:tasks.workunit.client.1.smithi099.stdout:1/513: mkdir d0/db6 0 2024-09-17T01:01:55.712 INFO:tasks.workunit.client.0.smithi002.stdout:4/413: dwrite d7/de/f79 [0,4194304] 0 2024-09-17T01:01:55.713 INFO:tasks.workunit.client.0.smithi002.stdout:4/414: write d7/de/d23/f51 [685147,110469] 0 2024-09-17T01:01:55.713 INFO:tasks.workunit.client.0.smithi002.stdout:4/415: fdatasync d7/de/d32/f40 0 2024-09-17T01:01:55.714 INFO:tasks.workunit.client.0.smithi002.stdout:4/416: unlink d7/de/d23/f51 0 2024-09-17T01:01:55.715 INFO:tasks.workunit.client.0.smithi002.stdout:4/417: symlink d7/de/d23/l7b 0 2024-09-17T01:01:55.716 INFO:tasks.workunit.client.0.smithi002.stdout:4/418: truncate d7/de/d55/f5a 942901 0 2024-09-17T01:01:55.718 INFO:tasks.workunit.client.0.smithi002.stdout:4/419: fdatasync d7/de/f15 0 2024-09-17T01:01:55.718 INFO:tasks.workunit.client.0.smithi002.stdout:4/420: truncate d7/de/d55/d62/f6f 248335 0 2024-09-17T01:01:55.733 INFO:tasks.workunit.client.1.smithi099.stdout:5/434: sync 2024-09-17T01:01:55.734 INFO:tasks.workunit.client.0.smithi002.stdout:4/421: dwrite d7/de/f79 [0,4194304] 0 2024-09-17T01:01:55.734 INFO:tasks.workunit.client.0.smithi002.stdout:4/422: fdatasync d7/d19/f1c 0 2024-09-17T01:01:55.736 INFO:tasks.workunit.client.0.smithi002.stdout:7/286: sync 2024-09-17T01:01:55.740 INFO:tasks.workunit.client.1.smithi099.stdout:2/344: sync 2024-09-17T01:01:55.740 INFO:tasks.workunit.client.1.smithi099.stdout:3/389: sync 2024-09-17T01:01:55.740 INFO:tasks.workunit.client.1.smithi099.stdout:3/390: fdatasync d9/d15/d18/f2a 0 2024-09-17T01:01:55.741 INFO:tasks.workunit.client.1.smithi099.stdout:3/391: fdatasync d9/d15/d18/f35 0 2024-09-17T01:01:55.742 INFO:tasks.workunit.client.1.smithi099.stdout:3/392: unlink d9/d15/d18/d1a/d23/f49 0 2024-09-17T01:01:55.742 INFO:tasks.workunit.client.1.smithi099.stdout:3/393: fsync d9/f25 0 2024-09-17T01:01:55.744 INFO:tasks.workunit.client.1.smithi099.stdout:3/394: mknod d9/d15/d18/d1a/c77 0 2024-09-17T01:01:55.745 INFO:tasks.workunit.client.1.smithi099.stdout:7/373: sync 2024-09-17T01:01:55.745 INFO:tasks.workunit.client.1.smithi099.stdout:5/435: dread d2/dc/d14/d19/f3f [0,4194304] 0 2024-09-17T01:01:55.745 INFO:tasks.workunit.client.1.smithi099.stdout:7/374: dread - d1/d2c/d5c/d12/f29 zero size 2024-09-17T01:01:55.746 INFO:tasks.workunit.client.1.smithi099.stdout:5/436: symlink d2/dc/d14/d19/l80 0 2024-09-17T01:01:55.747 INFO:tasks.workunit.client.1.smithi099.stdout:7/375: symlink d1/d2c/d47/l77 0 2024-09-17T01:01:55.747 INFO:tasks.workunit.client.1.smithi099.stdout:7/376: fsync d1/d2c/d5c/d1c/f61 0 2024-09-17T01:01:55.748 INFO:tasks.workunit.client.1.smithi099.stdout:7/377: write d1/d2c/d47/f50 [5089559,93087] 0 2024-09-17T01:01:55.748 INFO:tasks.workunit.client.1.smithi099.stdout:5/437: mkdir d2/dc/d17/d3c/d81 0 2024-09-17T01:01:55.751 INFO:tasks.workunit.client.1.smithi099.stdout:7/378: mkdir d1/d37/d78 0 2024-09-17T01:01:55.752 INFO:tasks.workunit.client.1.smithi099.stdout:5/438: mknod d2/dc/d6c/c82 0 2024-09-17T01:01:55.755 INFO:tasks.workunit.client.1.smithi099.stdout:3/395: read d9/d3b/d44/f48 [6747580,85247] 0 2024-09-17T01:01:55.755 INFO:tasks.workunit.client.1.smithi099.stdout:7/379: link d1/d2c/d5c/d1c/l33 d1/d2c/d5c/l79 0 2024-09-17T01:01:55.755 INFO:tasks.workunit.client.1.smithi099.stdout:7/380: chown d1/d37/l3d 130131394 1 2024-09-17T01:01:55.756 INFO:tasks.workunit.client.1.smithi099.stdout:7/381: read d1/d2c/d5c/d12/f16 [254108,21605] 0 2024-09-17T01:01:55.756 INFO:tasks.workunit.client.1.smithi099.stdout:3/396: link d9/d15/d38/c65 d9/d3b/d44/c78 0 2024-09-17T01:01:55.772 INFO:tasks.workunit.client.0.smithi002.stdout:4/423: dwrite d7/de/d3a/f7a [0,4194304] 0 2024-09-17T01:01:55.774 INFO:tasks.workunit.client.0.smithi002.stdout:4/424: symlink d7/de/d3a/l7c 0 2024-09-17T01:01:55.783 INFO:tasks.workunit.client.1.smithi099.stdout:2/345: dwrite d2/d9/f60 [0,4194304] 0 2024-09-17T01:01:55.783 INFO:tasks.workunit.client.1.smithi099.stdout:2/346: chown d2/d9/d25/d26/d1b/d2c/d3f/l56 24065 1 2024-09-17T01:01:55.784 INFO:tasks.workunit.client.0.smithi002.stdout:7/287: dwrite d1/d24/f31 [0,4194304] 0 2024-09-17T01:01:55.784 INFO:tasks.workunit.client.1.smithi099.stdout:7/382: dwrite d1/d2c/d5c/f1b [4194304,4194304] 0 2024-09-17T01:01:55.784 INFO:tasks.workunit.client.1.smithi099.stdout:7/383: dread - d1/d2c/d47/f6c zero size 2024-09-17T01:01:55.785 INFO:tasks.workunit.client.0.smithi002.stdout:7/288: creat d1/d14/d1d/d29/d30/d54/f5c x:0 0 0 2024-09-17T01:01:55.785 INFO:tasks.workunit.client.1.smithi099.stdout:5/439: dwrite f0 [0,4194304] 0 2024-09-17T01:01:55.785 INFO:tasks.workunit.client.0.smithi002.stdout:7/289: mkdir d1/d14/d1d/d29/d30/d50/d5d 0 2024-09-17T01:01:55.786 INFO:tasks.workunit.client.0.smithi002.stdout:7/290: mkdir d1/d14/d1d/d29/d30/d5e 0 2024-09-17T01:01:55.787 INFO:tasks.workunit.client.1.smithi099.stdout:3/397: dwrite d9/d15/d18/d1a/f1b [8388608,4194304] 0 2024-09-17T01:01:55.787 INFO:tasks.workunit.client.1.smithi099.stdout:3/398: creat d9/f79 x:0 0 0 2024-09-17T01:01:55.787 INFO:tasks.workunit.client.1.smithi099.stdout:3/399: getdents d9/d2b/d52/d5e 0 2024-09-17T01:01:55.787 INFO:tasks.workunit.client.1.smithi099.stdout:3/400: fdatasync d9/d15/d18/d1a/f1b 0 2024-09-17T01:01:55.787 INFO:tasks.workunit.client.1.smithi099.stdout:3/401: chown d9/d15/d18/d1a/d23/c28 7019313 1 2024-09-17T01:01:55.787 INFO:tasks.workunit.client.1.smithi099.stdout:2/347: rmdir d2/d9/d25/d26/d1b/d2c/d5d 39 2024-09-17T01:01:55.788 INFO:tasks.workunit.client.1.smithi099.stdout:2/348: creat d2/d9/d25/d26/d1b/d61/f6f x:0 0 0 2024-09-17T01:01:55.789 INFO:tasks.workunit.client.1.smithi099.stdout:7/384: mkdir d1/d2c/d7a 0 2024-09-17T01:01:55.789 INFO:tasks.workunit.client.1.smithi099.stdout:5/440: creat d2/d26/f83 x:0 0 0 2024-09-17T01:01:55.792 INFO:tasks.workunit.client.1.smithi099.stdout:5/441: creat d2/dc/d17/d3c/d81/f84 x:0 0 0 2024-09-17T01:01:55.794 INFO:tasks.workunit.client.1.smithi099.stdout:5/442: rmdir d2/d8 39 2024-09-17T01:01:55.794 INFO:tasks.workunit.client.1.smithi099.stdout:3/402: dread d9/d2b/f56 [0,4194304] 0 2024-09-17T01:01:55.795 INFO:tasks.workunit.client.0.smithi002.stdout:4/425: dwrite d7/d19/d2e/f70 [0,4194304] 0 2024-09-17T01:01:55.796 INFO:tasks.workunit.client.0.smithi002.stdout:4/426: truncate d7/de/d55/f5a 752955 0 2024-09-17T01:01:55.799 INFO:tasks.workunit.client.1.smithi099.stdout:5/443: link d2/l50 d2/dc/d17/d3c/d81/l85 0 2024-09-17T01:01:55.801 INFO:tasks.workunit.client.1.smithi099.stdout:3/403: rename d9/d3b/f70 to d9/f7a 0 2024-09-17T01:01:55.801 INFO:tasks.workunit.client.1.smithi099.stdout:7/385: rmdir d1/d2c 39 2024-09-17T01:01:55.802 INFO:tasks.workunit.client.1.smithi099.stdout:5/444: mknod d2/d26/c86 0 2024-09-17T01:01:55.803 INFO:tasks.workunit.client.1.smithi099.stdout:7/386: symlink d1/d2c/d47/l7b 0 2024-09-17T01:01:55.804 INFO:tasks.workunit.client.1.smithi099.stdout:7/387: stat d1/d2c/d5c/d1c/l33 0 2024-09-17T01:01:55.805 INFO:tasks.workunit.client.1.smithi099.stdout:7/388: read - d1/d2c/d5c/d12/f53 zero size 2024-09-17T01:01:55.807 INFO:tasks.workunit.client.1.smithi099.stdout:7/389: rename d1/d37/f58 to d1/d2c/d7a/f7c 0 2024-09-17T01:01:55.807 INFO:tasks.workunit.client.1.smithi099.stdout:5/445: read d2/dc/d14/d19/f3f [1929105,69773] 0 2024-09-17T01:01:55.807 INFO:tasks.workunit.client.1.smithi099.stdout:5/446: write d2/dc/d17/d3c/d72/f79 [276222,43859] 0 2024-09-17T01:01:55.815 INFO:tasks.workunit.client.0.smithi002.stdout:4/427: dwrite d7/f4f [0,4194304] 0 2024-09-17T01:01:55.815 INFO:tasks.workunit.client.1.smithi099.stdout:3/404: dread d9/f10 [0,4194304] 0 2024-09-17T01:01:55.815 INFO:tasks.workunit.client.1.smithi099.stdout:3/405: stat d9/d15/l71 0 2024-09-17T01:01:55.815 INFO:tasks.workunit.client.1.smithi099.stdout:3/406: truncate d9/d2b/d52/f6f 588751 0 2024-09-17T01:01:55.815 INFO:tasks.workunit.client.1.smithi099.stdout:3/407: readlink d9/l1d 0 2024-09-17T01:01:55.816 INFO:tasks.workunit.client.1.smithi099.stdout:3/408: write d9/d3b/f62 [292921,33197] 0 2024-09-17T01:01:55.816 INFO:tasks.workunit.client.1.smithi099.stdout:3/409: link d9/f12 d9/d3b/d44/f7b 0 2024-09-17T01:01:55.818 INFO:tasks.workunit.client.0.smithi002.stdout:4/428: rename d7/de/d32/d59/l61 to d7/de/d23/l7d 0 2024-09-17T01:01:55.818 INFO:tasks.workunit.client.0.smithi002.stdout:4/429: stat d7/d3f/c68 0 2024-09-17T01:01:55.818 INFO:tasks.workunit.client.1.smithi099.stdout:7/390: write d1/d36/f62 [2191015,12238] 0 2024-09-17T01:01:55.819 INFO:tasks.workunit.client.0.smithi002.stdout:8/459: sync 2024-09-17T01:01:55.820 INFO:tasks.workunit.client.0.smithi002.stdout:2/378: sync 2024-09-17T01:01:55.820 INFO:tasks.workunit.client.0.smithi002.stdout:2/379: creat d1b/d8b/f8d x:0 0 0 2024-09-17T01:01:55.824 INFO:tasks.workunit.client.0.smithi002.stdout:4/430: rename d7/de/d23 to d7/d19/d4a/d4d/d77/d7e 0 2024-09-17T01:01:55.824 INFO:tasks.workunit.client.0.smithi002.stdout:4/431: fsync d7/de/f15 0 2024-09-17T01:01:55.825 INFO:tasks.workunit.client.0.smithi002.stdout:8/460: rename d2/d30/l35 to d2/d26/d2b/d4f/d77/d78/l9d 0 2024-09-17T01:01:55.826 INFO:tasks.workunit.client.0.smithi002.stdout:4/432: read d7/d19/f1c [751526,49687] 0 2024-09-17T01:01:55.826 INFO:tasks.workunit.client.0.smithi002.stdout:8/461: rmdir d2/d26/d2b/d4f/d77/d78 39 2024-09-17T01:01:55.827 INFO:tasks.workunit.client.0.smithi002.stdout:4/433: truncate d7/d19/d34/f58 221827 0 2024-09-17T01:01:55.828 INFO:tasks.workunit.client.0.smithi002.stdout:8/462: symlink d2/d26/d2b/d71/l9e 0 2024-09-17T01:01:55.831 INFO:tasks.workunit.client.0.smithi002.stdout:2/380: write f19 [437606,120484] 0 2024-09-17T01:01:55.831 INFO:tasks.workunit.client.0.smithi002.stdout:2/381: write d1b/d37/d48/d52/f5e [385077,99505] 0 2024-09-17T01:01:55.831 INFO:tasks.workunit.client.0.smithi002.stdout:4/434: unlink d7/de/d3a/l7c 0 2024-09-17T01:01:55.834 INFO:tasks.workunit.client.0.smithi002.stdout:2/382: unlink d1b/d37/d48/c66 0 2024-09-17T01:01:55.834 INFO:tasks.workunit.client.0.smithi002.stdout:2/383: stat d1b/d1d/d38/f3c 0 2024-09-17T01:01:55.834 INFO:tasks.workunit.client.0.smithi002.stdout:2/384: dread - d1b/d37/f6a zero size 2024-09-17T01:01:55.836 INFO:tasks.workunit.client.0.smithi002.stdout:2/385: creat d1b/d37/d48/d78/f8e x:0 0 0 2024-09-17T01:01:55.837 INFO:tasks.workunit.client.0.smithi002.stdout:4/435: link d7/d19/d4a/d4d/d77/d7e/l30 d7/de/d32/l7f 0 2024-09-17T01:01:55.839 INFO:tasks.workunit.client.1.smithi099.stdout:3/410: dwrite d9/d15/d18/d1a/f4d [4194304,4194304] 0 2024-09-17T01:01:55.840 INFO:tasks.workunit.client.0.smithi002.stdout:4/436: rename d7/de/d55 to d7/d19/d34/d80 0 2024-09-17T01:01:55.840 INFO:tasks.workunit.client.1.smithi099.stdout:3/411: truncate d9/d15/d18/f2a 2925651 0 2024-09-17T01:01:55.842 INFO:tasks.workunit.client.1.smithi099.stdout:3/412: truncate d9/d15/d18/f2f 1703785 0 2024-09-17T01:01:55.842 INFO:tasks.workunit.client.1.smithi099.stdout:3/413: write d9/d2b/f56 [5044402,68090] 0 2024-09-17T01:01:55.842 INFO:tasks.workunit.client.0.smithi002.stdout:4/437: dread d7/d19/d34/d80/d62/f6f [0,4194304] 0 2024-09-17T01:01:55.843 INFO:tasks.workunit.client.1.smithi099.stdout:7/391: dwrite d1/d2c/d5c/f1d [4194304,4194304] 0 2024-09-17T01:01:55.843 INFO:tasks.workunit.client.1.smithi099.stdout:7/392: fdatasync d1/d2c/d47/d48/f69 0 2024-09-17T01:01:55.844 INFO:tasks.workunit.client.1.smithi099.stdout:7/393: write d1/d2c/d5c/f34 [5231742,50816] 0 2024-09-17T01:01:55.844 INFO:tasks.workunit.client.1.smithi099.stdout:3/414: truncate d9/f25 1117602 0 2024-09-17T01:01:55.844 INFO:tasks.workunit.client.0.smithi002.stdout:4/438: creat d7/d19/d34/d54/f81 x:0 0 0 2024-09-17T01:01:55.845 INFO:tasks.workunit.client.0.smithi002.stdout:4/439: creat d7/f82 x:0 0 0 2024-09-17T01:01:55.845 INFO:tasks.workunit.client.0.smithi002.stdout:4/440: write d7/f65 [519957,23124] 0 2024-09-17T01:01:55.845 INFO:tasks.workunit.client.1.smithi099.stdout:7/394: symlink d1/d2c/d5c/d3f/l7d 0 2024-09-17T01:01:55.846 INFO:tasks.workunit.client.1.smithi099.stdout:3/415: truncate d9/f27 2141048 0 2024-09-17T01:01:55.847 INFO:tasks.workunit.client.0.smithi002.stdout:4/441: symlink d7/d19/d4a/d4d/d77/l83 0 2024-09-17T01:01:55.847 INFO:tasks.workunit.client.1.smithi099.stdout:7/395: getdents d1/d37/d4f 0 2024-09-17T01:01:55.848 INFO:tasks.workunit.client.0.smithi002.stdout:4/442: mknod d7/de/c84 0 2024-09-17T01:01:55.849 INFO:tasks.workunit.client.0.smithi002.stdout:8/463: dwrite d2/d26/d2b/d4f/f94 [0,4194304] 0 2024-09-17T01:01:55.849 INFO:tasks.workunit.client.0.smithi002.stdout:8/464: chown d2/d26/d2b/d71 267 1 2024-09-17T01:01:55.850 INFO:tasks.workunit.client.1.smithi099.stdout:3/416: rename d9/d2b/c54 to d9/d15/d18/d1a/d23/d5c/c7c 0 2024-09-17T01:01:55.850 INFO:tasks.workunit.client.1.smithi099.stdout:3/417: write d9/d15/d18/d1a/d23/f2c [1025943,83528] 0 2024-09-17T01:01:55.850 INFO:tasks.workunit.client.1.smithi099.stdout:3/418: write d9/d15/f40 [590033,9739] 0 2024-09-17T01:01:55.850 INFO:tasks.workunit.client.1.smithi099.stdout:3/419: write d9/d15/f63 [5214129,113969] 0 2024-09-17T01:01:55.851 INFO:tasks.workunit.client.1.smithi099.stdout:3/420: write d9/d3b/d44/d57/f5a [173322,117505] 0 2024-09-17T01:01:55.851 INFO:tasks.workunit.client.0.smithi002.stdout:2/386: dwrite d1b/d37/d48/d52/f5d [0,4194304] 0 2024-09-17T01:01:55.853 INFO:tasks.workunit.client.0.smithi002.stdout:8/465: mknod d2/d26/d2b/d4f/d58/c9f 0 2024-09-17T01:01:55.854 INFO:tasks.workunit.client.1.smithi099.stdout:7/396: rmdir d1/d36 39 2024-09-17T01:01:55.856 INFO:tasks.workunit.client.1.smithi099.stdout:3/421: getdents d9/d3b/d44 0 2024-09-17T01:01:55.856 INFO:tasks.workunit.client.1.smithi099.stdout:3/422: dread - d9/d2b/d52/f75 zero size 2024-09-17T01:01:55.856 INFO:tasks.workunit.client.1.smithi099.stdout:3/423: readlink d9/lf 0 2024-09-17T01:01:55.858 INFO:tasks.workunit.client.0.smithi002.stdout:2/387: rename d1b/l32 to d1b/d1d/d38/l8f 0 2024-09-17T01:01:55.858 INFO:tasks.workunit.client.0.smithi002.stdout:2/388: stat d1b/d37/d48/c55 0 2024-09-17T01:01:55.858 INFO:tasks.workunit.client.0.smithi002.stdout:2/389: truncate ff 212644 0 2024-09-17T01:01:55.858 INFO:tasks.workunit.client.0.smithi002.stdout:2/390: write f5 [229900,108046] 0 2024-09-17T01:01:55.858 INFO:tasks.workunit.client.0.smithi002.stdout:2/391: write d1b/f29 [62247,15977] 0 2024-09-17T01:01:55.858 INFO:tasks.workunit.client.0.smithi002.stdout:2/392: fdatasync d1b/d37/d48/d4e/f3b 0 2024-09-17T01:01:55.859 INFO:tasks.workunit.client.1.smithi099.stdout:3/424: mkdir d9/d15/d7d 0 2024-09-17T01:01:55.860 INFO:tasks.workunit.client.0.smithi002.stdout:2/393: creat d1b/d37/d48/d4e/f90 x:0 0 0 2024-09-17T01:01:55.861 INFO:tasks.workunit.client.1.smithi099.stdout:3/425: mkdir d9/d15/d18/d1a/d23/d5c/d6e/d7e 0 2024-09-17T01:01:55.863 INFO:tasks.workunit.client.1.smithi099.stdout:3/426: dread d9/d3b/d44/f6d [0,4194304] 0 2024-09-17T01:01:55.863 INFO:tasks.workunit.client.0.smithi002.stdout:2/394: creat d1b/d37/f91 x:0 0 0 2024-09-17T01:01:55.863 INFO:tasks.workunit.client.0.smithi002.stdout:2/395: chown d1b/d1d/f1f 438406550 1 2024-09-17T01:01:55.864 INFO:tasks.workunit.client.0.smithi002.stdout:4/443: dwrite d7/d19/d34/d54/f5f [4194304,4194304] 0 2024-09-17T01:01:55.864 INFO:tasks.workunit.client.0.smithi002.stdout:4/444: read d7/f18 [1860299,93185] 0 2024-09-17T01:01:55.865 INFO:tasks.workunit.client.0.smithi002.stdout:2/396: mkdir d1b/d8a/d92 0 2024-09-17T01:01:55.865 INFO:tasks.workunit.client.0.smithi002.stdout:2/397: read - d1b/d37/d48/d4e/f70 zero size 2024-09-17T01:01:55.865 INFO:tasks.workunit.client.1.smithi099.stdout:3/427: mknod d9/d15/d18/d1a/d23/d5c/d6e/d7e/c7f 0 2024-09-17T01:01:55.866 INFO:tasks.workunit.client.1.smithi099.stdout:3/428: read - d9/d15/d18/f42 zero size 2024-09-17T01:01:55.866 INFO:tasks.workunit.client.1.smithi099.stdout:3/429: chown d9/d15/f50 12 1 2024-09-17T01:01:55.867 INFO:tasks.workunit.client.0.smithi002.stdout:8/466: dread d2/d26/f61 [0,4194304] 0 2024-09-17T01:01:55.867 INFO:tasks.workunit.client.0.smithi002.stdout:2/398: getdents d1b/d1d 0 2024-09-17T01:01:55.871 INFO:tasks.workunit.client.1.smithi099.stdout:3/430: write d9/d15/f34 [2076916,35014] 0 2024-09-17T01:01:55.872 INFO:tasks.workunit.client.0.smithi002.stdout:4/445: dread d7/de/f28 [4194304,4194304] 0 2024-09-17T01:01:55.873 INFO:tasks.workunit.client.0.smithi002.stdout:4/446: symlink d7/d19/d2e/l85 0 2024-09-17T01:01:55.873 INFO:tasks.workunit.client.0.smithi002.stdout:4/447: chown d7/de/c47 207187865 1 2024-09-17T01:01:55.873 INFO:tasks.workunit.client.0.smithi002.stdout:4/448: chown d7/de/c13 242512435 1 2024-09-17T01:01:55.875 INFO:tasks.workunit.client.0.smithi002.stdout:4/449: mknod d7/d19/d4a/d4d/d77/c86 0 2024-09-17T01:01:55.878 INFO:tasks.workunit.client.1.smithi099.stdout:3/431: mknod d9/d15/d38/c80 0 2024-09-17T01:01:55.882 INFO:tasks.workunit.client.0.smithi002.stdout:2/399: dread d1b/f26 [0,4194304] 0 2024-09-17T01:01:55.889 INFO:tasks.workunit.client.1.smithi099.stdout:7/397: dwrite d1/d2c/d47/f50 [0,4194304] 0 2024-09-17T01:01:55.889 INFO:tasks.workunit.client.1.smithi099.stdout:7/398: write d1/d2c/d5c/d12/f32 [1445226,5338] 0 2024-09-17T01:01:55.891 INFO:tasks.workunit.client.0.smithi002.stdout:8/467: dwrite d2/d3/d5f/f46 [0,4194304] 0 2024-09-17T01:01:55.891 INFO:tasks.workunit.client.0.smithi002.stdout:4/450: dread d7/de/d3a/f7a [0,4194304] 0 2024-09-17T01:01:55.891 INFO:tasks.workunit.client.0.smithi002.stdout:4/451: fdatasync d7/d19/d2e/f46 0 2024-09-17T01:01:55.892 INFO:tasks.workunit.client.1.smithi099.stdout:7/399: creat d1/d2c/d5c/d1c/d72/f7e x:0 0 0 2024-09-17T01:01:55.894 INFO:tasks.workunit.client.0.smithi002.stdout:8/468: unlink d2/d1c/d3b/f7e 0 2024-09-17T01:01:55.895 INFO:tasks.workunit.client.0.smithi002.stdout:4/452: mknod d7/de/d3a/c87 0 2024-09-17T01:01:55.900 INFO:tasks.workunit.client.1.smithi099.stdout:7/400: dread d1/d36/f62 [4194304,4194304] 0 2024-09-17T01:01:55.905 INFO:tasks.workunit.client.0.smithi002.stdout:2/400: dwrite d1b/d37/f4d [0,4194304] 0 2024-09-17T01:01:55.906 INFO:tasks.workunit.client.1.smithi099.stdout:3/432: dwrite d9/d15/d18/d1a/d23/f17 [8388608,4194304] 0 2024-09-17T01:01:55.914 INFO:tasks.workunit.client.0.smithi002.stdout:3/386: sync 2024-09-17T01:01:55.915 INFO:tasks.workunit.client.1.smithi099.stdout:7/401: dread d1/f11 [0,4194304] 0 2024-09-17T01:01:55.917 INFO:tasks.workunit.client.1.smithi099.stdout:3/433: dread d9/d15/d18/d1a/d23/f2c [0,4194304] 0 2024-09-17T01:01:55.918 INFO:tasks.workunit.client.0.smithi002.stdout:4/453: dwrite d7/de/d3a/f3c [0,4194304] 0 2024-09-17T01:01:55.918 INFO:tasks.workunit.client.0.smithi002.stdout:8/469: dwrite d2/d1c/f43 [0,4194304] 0 2024-09-17T01:01:55.919 INFO:tasks.workunit.client.0.smithi002.stdout:4/454: mknod d7/de/d32/c88 0 2024-09-17T01:01:55.921 INFO:tasks.workunit.client.0.smithi002.stdout:8/470: mkdir d2/d1c/d28/da0 0 2024-09-17T01:01:55.921 INFO:tasks.workunit.client.0.smithi002.stdout:4/455: mkdir d7/d19/d34/d54/d89 0 2024-09-17T01:01:55.922 INFO:tasks.workunit.client.0.smithi002.stdout:4/456: write d7/d19/d4a/d4d/d77/d7e/f50 [1104576,82167] 0 2024-09-17T01:01:55.923 INFO:tasks.workunit.client.0.smithi002.stdout:4/457: rename d7/d19/d4a/d4d to d7/de/d32/d8a 0 2024-09-17T01:01:55.924 INFO:tasks.workunit.client.0.smithi002.stdout:4/458: mkdir d7/d71/d8b 0 2024-09-17T01:01:55.924 INFO:tasks.workunit.client.0.smithi002.stdout:4/459: write d7/d19/d34/d54/f81 [232569,74141] 0 2024-09-17T01:01:55.925 INFO:tasks.workunit.client.0.smithi002.stdout:4/460: mknod d7/d19/d2e/c8c 0 2024-09-17T01:01:55.926 INFO:tasks.workunit.client.0.smithi002.stdout:4/461: unlink d7/f65 0 2024-09-17T01:01:55.926 INFO:tasks.workunit.client.0.smithi002.stdout:4/462: stat d7/d19/d2e/c8c 0 2024-09-17T01:01:55.927 INFO:tasks.workunit.client.0.smithi002.stdout:4/463: rename d7/de/d32/d8a/d77/d7e/l30 to d7/d19/d34/d80/d62/d52/l8d 0 2024-09-17T01:01:55.927 INFO:tasks.workunit.client.0.smithi002.stdout:4/464: truncate d7/d19/d2e/f3d 90380 0 2024-09-17T01:01:55.928 INFO:tasks.workunit.client.1.smithi099.stdout:7/402: dread d1/f10 [0,4194304] 0 2024-09-17T01:01:55.928 INFO:tasks.workunit.client.1.smithi099.stdout:7/403: chown d1/d37/d4f/d6a 47 1 2024-09-17T01:01:55.929 INFO:tasks.workunit.client.0.smithi002.stdout:4/465: mkdir d7/d71/d8e 0 2024-09-17T01:01:55.929 INFO:tasks.workunit.client.0.smithi002.stdout:4/466: fsync d7/d19/d34/f58 0 2024-09-17T01:01:55.929 INFO:tasks.workunit.client.0.smithi002.stdout:4/467: readlink d7/d19/d34/d80/d62/l43 0 2024-09-17T01:01:55.929 INFO:tasks.workunit.client.0.smithi002.stdout:4/468: chown d7/de/d32/c60 14702829 1 2024-09-17T01:01:55.929 INFO:tasks.workunit.client.0.smithi002.stdout:4/469: truncate d7/de/d32/d8a/d77/d7e/f50 1756773 0 2024-09-17T01:01:55.929 INFO:tasks.workunit.client.0.smithi002.stdout:4/470: fdatasync d7/d19/d34/d80/d62/f6a 0 2024-09-17T01:01:55.930 INFO:tasks.workunit.client.0.smithi002.stdout:2/401: dwrite d1b/f26 [0,4194304] 0 2024-09-17T01:01:55.933 INFO:tasks.workunit.client.0.smithi002.stdout:2/402: mkdir d1b/d74/d93 0 2024-09-17T01:01:55.933 INFO:tasks.workunit.client.0.smithi002.stdout:2/403: write d1b/f5f [682239,2110] 0 2024-09-17T01:01:55.941 INFO:tasks.workunit.client.1.smithi099.stdout:3/434: fsync d9/d15/f34 0 2024-09-17T01:01:55.942 INFO:tasks.workunit.client.0.smithi002.stdout:3/387: dwrite d0/d3/f3c [0,4194304] 0 2024-09-17T01:01:55.942 INFO:tasks.workunit.client.0.smithi002.stdout:3/388: chown d0/d3/d33/d40/f65 25030 1 2024-09-17T01:01:55.942 INFO:tasks.workunit.client.0.smithi002.stdout:3/389: stat d0/d3/d33/d40/c59 0 2024-09-17T01:01:55.942 INFO:tasks.workunit.client.1.smithi099.stdout:3/435: symlink d9/d2b/d6b/l81 0 2024-09-17T01:01:55.944 INFO:tasks.workunit.client.0.smithi002.stdout:3/390: unlink d0/d3/d33/d77/f7f 0 2024-09-17T01:01:55.944 INFO:tasks.workunit.client.0.smithi002.stdout:3/391: dread - d0/d3/d17/f6f zero size 2024-09-17T01:01:55.944 INFO:tasks.workunit.client.0.smithi002.stdout:3/392: rmdir d0/d3 39 2024-09-17T01:01:55.950 INFO:tasks.workunit.client.0.smithi002.stdout:4/471: getdents d7/d71 0 2024-09-17T01:01:55.951 INFO:tasks.workunit.client.0.smithi002.stdout:4/472: symlink d7/d19/d34/d54/l8f 0 2024-09-17T01:01:55.952 INFO:tasks.workunit.client.0.smithi002.stdout:8/471: dwrite d2/d26/f69 [0,4194304] 0 2024-09-17T01:01:55.953 INFO:tasks.workunit.client.0.smithi002.stdout:4/473: rename d7/de/d32/d8a/d77/d7e to d7/d71/d90 0 2024-09-17T01:01:55.953 INFO:tasks.workunit.client.0.smithi002.stdout:0/302: sync 2024-09-17T01:01:55.953 INFO:tasks.workunit.client.0.smithi002.stdout:6/342: sync 2024-09-17T01:01:55.953 INFO:tasks.workunit.client.0.smithi002.stdout:9/315: sync 2024-09-17T01:01:55.953 INFO:tasks.workunit.client.0.smithi002.stdout:0/303: dread - dd/d19/d1a/d29/d55/f5b zero size 2024-09-17T01:01:55.953 INFO:tasks.workunit.client.0.smithi002.stdout:6/343: truncate d2/f15 4392754 0 2024-09-17T01:01:55.953 INFO:tasks.workunit.client.0.smithi002.stdout:1/413: sync 2024-09-17T01:01:55.953 INFO:tasks.workunit.client.0.smithi002.stdout:7/291: sync 2024-09-17T01:01:55.954 INFO:tasks.workunit.client.0.smithi002.stdout:5/379: sync 2024-09-17T01:01:55.954 INFO:tasks.workunit.client.1.smithi099.stdout:3/436: dread d9/d3b/f69 [0,4194304] 0 2024-09-17T01:01:55.955 INFO:tasks.workunit.client.1.smithi099.stdout:3/437: creat d9/d15/d18/f82 x:0 0 0 2024-09-17T01:01:55.955 INFO:tasks.workunit.client.1.smithi099.stdout:3/438: creat d9/f83 x:0 0 0 2024-09-17T01:01:55.955 INFO:tasks.workunit.client.1.smithi099.stdout:3/439: chown d9/d15/c3d 369 1 2024-09-17T01:01:55.955 INFO:tasks.workunit.client.1.smithi099.stdout:3/440: write d9/d3b/d44/d57/f5a [1213534,34659] 0 2024-09-17T01:01:55.955 INFO:tasks.workunit.client.1.smithi099.stdout:7/404: dwrite d1/d2c/f6b [0,4194304] 0 2024-09-17T01:01:55.956 INFO:tasks.workunit.client.1.smithi099.stdout:3/441: symlink d9/d15/d38/l84 0 2024-09-17T01:01:55.956 INFO:tasks.workunit.client.1.smithi099.stdout:3/442: write d9/f10 [406147,55180] 0 2024-09-17T01:01:55.956 INFO:tasks.workunit.client.1.smithi099.stdout:3/443: fdatasync d9/d15/d18/f2a 0 2024-09-17T01:01:55.958 INFO:tasks.workunit.client.1.smithi099.stdout:7/405: creat d1/d2c/d5c/d12/f7f x:0 0 0 2024-09-17T01:01:55.958 INFO:tasks.workunit.client.1.smithi099.stdout:7/406: chown d1/c38 1 1 2024-09-17T01:01:55.959 INFO:tasks.workunit.client.0.smithi002.stdout:9/316: mkdir d5/dc/d55 0 2024-09-17T01:01:55.959 INFO:tasks.workunit.client.0.smithi002.stdout:0/304: mknod dd/d19/d1a/d29/c63 0 2024-09-17T01:01:55.959 INFO:tasks.workunit.client.0.smithi002.stdout:0/305: fsync dd/f14 0 2024-09-17T01:01:55.959 INFO:tasks.workunit.client.1.smithi099.stdout:3/444: creat d9/d15/d18/d1a/d23/d5c/f85 x:0 0 0 2024-09-17T01:01:55.960 INFO:tasks.workunit.client.1.smithi099.stdout:7/407: rmdir d1/d37/d4f/d6a 0 2024-09-17T01:01:55.960 INFO:tasks.workunit.client.0.smithi002.stdout:6/344: symlink d2/l63 0 2024-09-17T01:01:55.960 INFO:tasks.workunit.client.0.smithi002.stdout:5/380: mknod d2/de/d1d/c7b 0 2024-09-17T01:01:55.962 INFO:tasks.workunit.client.0.smithi002.stdout:1/414: symlink d4/d11/d12/l96 0 2024-09-17T01:01:55.962 INFO:tasks.workunit.client.0.smithi002.stdout:1/415: chown d4/d11/d12 18475 1 2024-09-17T01:01:55.962 INFO:tasks.workunit.client.0.smithi002.stdout:1/416: chown d4/d11/d12/d14/d17/d40/c46 247 1 2024-09-17T01:01:55.963 INFO:tasks.workunit.client.1.smithi099.stdout:3/445: read d9/d15/f40 [194378,124393] 0 2024-09-17T01:01:55.964 INFO:tasks.workunit.client.1.smithi099.stdout:3/446: truncate d9/d3b/d44/f6d 1114923 0 2024-09-17T01:01:55.964 INFO:tasks.workunit.client.1.smithi099.stdout:3/447: chown d9/d15/d18/d1a/d23/d5c/d6e/d7e 296453685 1 2024-09-17T01:01:55.966 INFO:tasks.workunit.client.1.smithi099.stdout:7/408: rename d1/c8 to d1/d2c/d5c/c80 0 2024-09-17T01:01:55.967 INFO:tasks.workunit.client.1.smithi099.stdout:7/409: truncate d1/d2c/d5c/f1b 6348065 0 2024-09-17T01:01:55.968 INFO:tasks.workunit.client.0.smithi002.stdout:0/306: symlink dd/d19/d1a/d29/d55/d56/l64 0 2024-09-17T01:01:55.968 INFO:tasks.workunit.client.0.smithi002.stdout:6/345: symlink d2/d1d/d26/l64 0 2024-09-17T01:01:55.968 INFO:tasks.workunit.client.0.smithi002.stdout:1/417: mknod d4/d11/d12/d14/d17/c97 0 2024-09-17T01:01:55.968 INFO:tasks.workunit.client.0.smithi002.stdout:5/381: link d2/d2d/f53 d2/d2d/d10/d14/d19/d39/d25/d32/d33/f7c 0 2024-09-17T01:01:55.968 INFO:tasks.workunit.client.0.smithi002.stdout:1/418: readlink d4/d11/l68 0 2024-09-17T01:01:55.969 INFO:tasks.workunit.client.0.smithi002.stdout:7/292: write d1/d24/f31 [3111589,108405] 0 2024-09-17T01:01:55.969 INFO:tasks.workunit.client.0.smithi002.stdout:0/307: mkdir dd/d19/d1c/d1f/d39/d65 0 2024-09-17T01:01:55.971 INFO:tasks.workunit.client.0.smithi002.stdout:1/419: unlink d4/d11/d12/d14/d17/d20/f5b 0 2024-09-17T01:01:55.973 INFO:tasks.workunit.client.0.smithi002.stdout:3/393: dwrite d0/d3/d33/d40/f52 [0,4194304] 0 2024-09-17T01:01:55.975 INFO:tasks.workunit.client.0.smithi002.stdout:0/308: creat dd/d19/d1c/d1f/d22/d43/f66 x:0 0 0 2024-09-17T01:01:55.976 INFO:tasks.workunit.client.0.smithi002.stdout:3/394: unlink d0/d3/d17/f2c 0 2024-09-17T01:01:55.976 INFO:tasks.workunit.client.0.smithi002.stdout:3/395: chown d0/d3/d80 107360 1 2024-09-17T01:01:55.978 INFO:tasks.workunit.client.0.smithi002.stdout:7/293: dread d1/f5 [0,4194304] 0 2024-09-17T01:01:55.979 INFO:tasks.workunit.client.0.smithi002.stdout:8/472: dwrite d2/d1c/f43 [0,4194304] 0 2024-09-17T01:01:55.979 INFO:tasks.workunit.client.0.smithi002.stdout:8/473: creat d2/d26/d2b/d4f/fa1 x:0 0 0 2024-09-17T01:01:55.980 INFO:tasks.workunit.client.0.smithi002.stdout:7/294: creat d1/d14/d1d/d28/d40/f5f x:0 0 0 2024-09-17T01:01:55.980 INFO:tasks.workunit.client.0.smithi002.stdout:7/295: write d1/d24/f56 [91892,85801] 0 2024-09-17T01:01:55.982 INFO:tasks.workunit.client.0.smithi002.stdout:8/474: truncate d2/d9/dd/f92 2419036 0 2024-09-17T01:01:55.983 INFO:tasks.workunit.client.0.smithi002.stdout:0/309: dread dd/f18 [0,4194304] 0 2024-09-17T01:01:55.989 INFO:tasks.workunit.client.0.smithi002.stdout:5/382: dread d2/d2d/d10/d14/d19/d39/f3c [0,4194304] 0 2024-09-17T01:01:55.990 INFO:tasks.workunit.client.0.smithi002.stdout:8/475: creat d2/d26/d2b/d71/fa2 x:0 0 0 2024-09-17T01:01:55.990 INFO:tasks.workunit.client.0.smithi002.stdout:3/396: write d0/d3/d33/f55 [3609278,49242] 0 2024-09-17T01:01:55.991 INFO:tasks.workunit.client.0.smithi002.stdout:9/317: dwrite d5/dc/f4e [0,4194304] 0 2024-09-17T01:01:55.991 INFO:tasks.workunit.client.0.smithi002.stdout:9/318: creat d5/dc/d26/d34/f56 x:0 0 0 2024-09-17T01:01:55.991 INFO:tasks.workunit.client.0.smithi002.stdout:6/346: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:01:55.991 INFO:tasks.workunit.client.0.smithi002.stdout:5/383: truncate d2/d2d/d10/d20/f3e 492240 0 2024-09-17T01:01:55.993 INFO:tasks.workunit.client.0.smithi002.stdout:7/296: dread d1/d14/d1d/d29/f2f [0,4194304] 0 2024-09-17T01:01:55.993 INFO:tasks.workunit.client.0.smithi002.stdout:8/476: symlink d2/d1c/d3b/la3 0 2024-09-17T01:01:55.994 INFO:tasks.workunit.client.0.smithi002.stdout:8/477: fsync d2/d1c/f43 0 2024-09-17T01:01:55.996 INFO:tasks.workunit.client.0.smithi002.stdout:4/474: dwrite d7/de/d32/f73 [0,4194304] 0 2024-09-17T01:01:55.996 INFO:tasks.workunit.client.0.smithi002.stdout:1/420: dwrite d4/d11/d12/d14/d17/d3b/f62 [0,4194304] 0 2024-09-17T01:01:55.996 INFO:tasks.workunit.client.0.smithi002.stdout:6/347: write d2/f13 [2735061,51521] 0 2024-09-17T01:01:55.996 INFO:tasks.workunit.client.0.smithi002.stdout:6/348: write d2/f15 [3685356,12886] 0 2024-09-17T01:01:55.996 INFO:tasks.workunit.client.0.smithi002.stdout:6/349: chown d2/dc/d24 1942879 1 2024-09-17T01:01:56.002 INFO:tasks.workunit.client.0.smithi002.stdout:9/319: write d5/f29 [1311725,65973] 0 2024-09-17T01:01:56.003 INFO:tasks.workunit.client.0.smithi002.stdout:7/297: rename d1/d14/d1d/d28/l2a to d1/d14/d1d/d29/d30/d54/l60 0 2024-09-17T01:01:56.004 INFO:tasks.workunit.client.1.smithi099.stdout:7/410: dwrite d1/d2c/d5c/d12/f4b [0,4194304] 0 2024-09-17T01:01:56.004 INFO:tasks.workunit.client.1.smithi099.stdout:7/411: write d1/d2c/d5c/f13 [5119707,105087] 0 2024-09-17T01:01:56.007 INFO:tasks.workunit.client.1.smithi099.stdout:7/412: symlink d1/d36/l81 0 2024-09-17T01:01:56.011 INFO:tasks.workunit.client.0.smithi002.stdout:6/350: creat d2/d1d/d26/d40/d43/f65 x:0 0 0 2024-09-17T01:01:56.013 INFO:tasks.workunit.client.0.smithi002.stdout:7/298: truncate d1/d14/d1d/d28/f3d 1949159 0 2024-09-17T01:01:56.016 INFO:tasks.workunit.client.0.smithi002.stdout:7/299: dread d1/d14/d1d/d29/d30/f55 [0,4194304] 0 2024-09-17T01:01:56.017 INFO:tasks.workunit.client.0.smithi002.stdout:7/300: creat d1/d14/d1d/d21/f61 x:0 0 0 2024-09-17T01:01:56.020 INFO:tasks.workunit.client.1.smithi099.stdout:7/413: dread d1/d37/f51 [0,4194304] 0 2024-09-17T01:01:56.020 INFO:tasks.workunit.client.1.smithi099.stdout:7/414: stat d1/f4 0 2024-09-17T01:01:56.021 INFO:tasks.workunit.client.0.smithi002.stdout:3/397: dwrite d0/f3e [0,4194304] 0 2024-09-17T01:01:56.022 INFO:tasks.workunit.client.1.smithi099.stdout:7/415: creat d1/d2c/d5c/d1c/d5a/f82 x:0 0 0 2024-09-17T01:01:56.022 INFO:tasks.workunit.client.1.smithi099.stdout:7/416: fsync d1/f25 0 2024-09-17T01:01:56.022 INFO:tasks.workunit.client.1.smithi099.stdout:7/417: write d1/f19 [41291,37525] 0 2024-09-17T01:01:56.024 INFO:tasks.workunit.client.0.smithi002.stdout:3/398: creat d0/d3/d37/d5a/f83 x:0 0 0 2024-09-17T01:01:56.024 INFO:tasks.workunit.client.0.smithi002.stdout:3/399: chown d0/d31/d32/c5e 1578446 1 2024-09-17T01:01:56.024 INFO:tasks.workunit.client.0.smithi002.stdout:6/351: dread d2/d1d/d2d/d35/d37/f41 [0,4194304] 0 2024-09-17T01:01:56.024 INFO:tasks.workunit.client.0.smithi002.stdout:3/400: write d0/d3/d33/d40/f65 [5170081,87575] 0 2024-09-17T01:01:56.025 INFO:tasks.workunit.client.0.smithi002.stdout:6/352: creat d2/d1d/d2d/d35/f66 x:0 0 0 2024-09-17T01:01:56.027 INFO:tasks.workunit.client.0.smithi002.stdout:3/401: mkdir d0/d3/d17/d84 0 2024-09-17T01:01:56.028 INFO:tasks.workunit.client.0.smithi002.stdout:6/353: creat d2/d1d/d26/f67 x:0 0 0 2024-09-17T01:01:56.028 INFO:tasks.workunit.client.0.smithi002.stdout:4/475: dwrite d7/f14 [0,4194304] 0 2024-09-17T01:01:56.030 INFO:tasks.workunit.client.0.smithi002.stdout:3/402: truncate d0/d3/d33/d40/f63 2633145 0 2024-09-17T01:01:56.030 INFO:tasks.workunit.client.0.smithi002.stdout:3/403: chown d0/f61 105 1 2024-09-17T01:01:56.030 INFO:tasks.workunit.client.0.smithi002.stdout:3/404: truncate d0/f62 1036727 0 2024-09-17T01:01:56.031 INFO:tasks.workunit.client.0.smithi002.stdout:3/405: stat d0/d31/l44 0 2024-09-17T01:01:56.031 INFO:tasks.workunit.client.0.smithi002.stdout:3/406: unlink d0/d3/d37/c4c 0 2024-09-17T01:01:56.032 INFO:tasks.workunit.client.0.smithi002.stdout:3/407: write d0/d31/f43 [676352,10933] 0 2024-09-17T01:01:56.032 INFO:tasks.workunit.client.0.smithi002.stdout:7/301: dread d1/d14/d1d/d28/d2d/f35 [0,4194304] 0 2024-09-17T01:01:56.033 INFO:tasks.workunit.client.0.smithi002.stdout:7/302: read d1/f20 [1037555,48433] 0 2024-09-17T01:01:56.033 INFO:tasks.workunit.client.0.smithi002.stdout:3/408: mknod d0/d3/d17/c85 0 2024-09-17T01:01:56.033 INFO:tasks.workunit.client.0.smithi002.stdout:3/409: write d0/d3/d37/f4d [51865,91537] 0 2024-09-17T01:01:56.036 INFO:tasks.workunit.client.0.smithi002.stdout:4/476: dread d7/f4f [0,4194304] 0 2024-09-17T01:01:56.038 INFO:tasks.workunit.client.0.smithi002.stdout:7/303: rmdir d1/d14/d1d/d28 39 2024-09-17T01:01:56.041 INFO:tasks.workunit.client.1.smithi099.stdout:7/418: dwrite d1/d2c/d5c/f34 [4194304,4194304] 0 2024-09-17T01:01:56.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:55 smithi099 ceph-mon[34357]: pgmap v251: 65 pgs: 65 active+clean; 781 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 65 MiB/s rd, 79 MiB/s wr, 447 op/s 2024-09-17T01:01:56.042 INFO:tasks.workunit.client.1.smithi099.stdout:7/419: rename d1/d2c/d47/d48/l64 to d1/d2c/d47/d48/d60/l83 0 2024-09-17T01:01:56.046 INFO:tasks.workunit.client.0.smithi002.stdout:4/477: rmdir d7/de 39 2024-09-17T01:01:56.048 INFO:tasks.workunit.client.0.smithi002.stdout:4/478: truncate d7/de/f5c 469276 0 2024-09-17T01:01:56.049 INFO:tasks.workunit.client.0.smithi002.stdout:4/479: getdents d7 0 2024-09-17T01:01:56.051 INFO:tasks.workunit.client.0.smithi002.stdout:4/480: mknod d7/d19/c91 0 2024-09-17T01:01:56.055 INFO:tasks.workunit.client.0.smithi002.stdout:3/410: dread d0/f2f [0,4194304] 0 2024-09-17T01:01:56.055 INFO:tasks.workunit.client.0.smithi002.stdout:6/354: dwrite d2/d1d/f57 [0,4194304] 0 2024-09-17T01:01:56.056 INFO:tasks.workunit.client.0.smithi002.stdout:6/355: fsync d2/d1d/d26/d40/d43/f65 0 2024-09-17T01:01:56.056 INFO:tasks.workunit.client.0.smithi002.stdout:6/356: chown d2/dc/d24/ca 258111437 1 2024-09-17T01:01:56.058 INFO:tasks.workunit.client.0.smithi002.stdout:6/357: dread d2/d1d/d26/f2b [0,4194304] 0 2024-09-17T01:01:56.058 INFO:tasks.workunit.client.0.smithi002.stdout:6/358: fdatasync d2/dc/f20 0 2024-09-17T01:01:56.058 INFO:tasks.workunit.client.0.smithi002.stdout:3/411: creat d0/d3/d33/f86 x:0 0 0 2024-09-17T01:01:56.060 INFO:tasks.workunit.client.0.smithi002.stdout:3/412: mkdir d0/d3/d17/d87 0 2024-09-17T01:01:56.061 INFO:tasks.workunit.client.0.smithi002.stdout:3/413: rename d0/d3 to d0/d3/d33/d88 22 2024-09-17T01:01:56.061 INFO:tasks.workunit.client.0.smithi002.stdout:4/481: dread d7/de/f28 [0,4194304] 0 2024-09-17T01:01:56.061 INFO:tasks.workunit.client.0.smithi002.stdout:4/482: stat d7/d19/d2e/c8c 0 2024-09-17T01:01:56.062 INFO:tasks.workunit.client.0.smithi002.stdout:4/483: write d7/de/f27 [1620662,117046] 0 2024-09-17T01:01:56.064 INFO:tasks.workunit.client.0.smithi002.stdout:4/484: link d7/de/d32/d8a/c76 d7/c92 0 2024-09-17T01:01:56.066 INFO:tasks.workunit.client.1.smithi099.stdout:7/420: dwrite d1/d2c/d7a/f7c [0,4194304] 0 2024-09-17T01:01:56.066 INFO:tasks.workunit.client.0.smithi002.stdout:3/414: dread d0/f21 [0,4194304] 0 2024-09-17T01:01:56.067 INFO:tasks.workunit.client.0.smithi002.stdout:3/415: chown d0/d3/d37/f51 155 1 2024-09-17T01:01:56.067 INFO:tasks.workunit.client.0.smithi002.stdout:3/416: creat d0/d3/d37/d5a/f89 x:0 0 0 2024-09-17T01:01:56.067 INFO:tasks.workunit.client.0.smithi002.stdout:3/417: truncate d0/d3/d33/f86 698503 0 2024-09-17T01:01:56.067 INFO:tasks.workunit.client.0.smithi002.stdout:3/418: write d0/d3/d33/d40/f45 [854077,3531] 0 2024-09-17T01:01:56.068 INFO:tasks.workunit.client.1.smithi099.stdout:7/421: rename d1/d2c/d5c/d1c/c5d to d1/d36/c84 0 2024-09-17T01:01:56.071 INFO:tasks.workunit.client.0.smithi002.stdout:4/485: mknod d7/de/d32/d59/c93 0 2024-09-17T01:01:56.078 INFO:tasks.workunit.client.0.smithi002.stdout:3/419: read d0/fd [2894322,16271] 0 2024-09-17T01:01:56.079 INFO:tasks.workunit.client.0.smithi002.stdout:3/420: mknod d0/d3/d33/d4f/c8a 0 2024-09-17T01:01:56.080 INFO:tasks.workunit.client.0.smithi002.stdout:3/421: readlink d0/d3/l9 0 2024-09-17T01:01:56.081 INFO:tasks.workunit.client.0.smithi002.stdout:6/359: dwrite d2/d1d/d27/d30/f36 [0,4194304] 0 2024-09-17T01:01:56.082 INFO:tasks.workunit.client.1.smithi099.stdout:7/422: dwrite d1/d2c/d5c/d12/f74 [0,4194304] 0 2024-09-17T01:01:56.082 INFO:tasks.workunit.client.1.smithi099.stdout:7/423: stat d1/f4 0 2024-09-17T01:01:56.083 INFO:tasks.workunit.client.0.smithi002.stdout:6/360: mknod d2/d1d/d26/d40/d43/d5c/c68 0 2024-09-17T01:01:56.084 INFO:tasks.workunit.client.0.smithi002.stdout:6/361: creat d2/d1d/d2d/d54/f69 x:0 0 0 2024-09-17T01:01:56.085 INFO:tasks.workunit.client.0.smithi002.stdout:6/362: symlink d2/d4b/d4c/l6a 0 2024-09-17T01:01:56.085 INFO:tasks.workunit.client.0.smithi002.stdout:6/363: write f1 [1861788,111504] 0 2024-09-17T01:01:56.086 INFO:tasks.workunit.client.0.smithi002.stdout:6/364: rename d2/dc/l23 to d2/d1d/d2d/d35/l6b 0 2024-09-17T01:01:56.086 INFO:tasks.workunit.client.0.smithi002.stdout:3/422: dread d0/d3/d37/f74 [0,4194304] 0 2024-09-17T01:01:56.086 INFO:tasks.workunit.client.0.smithi002.stdout:6/365: rmdir d2/d1d/d2d 39 2024-09-17T01:01:56.087 INFO:tasks.workunit.client.0.smithi002.stdout:6/366: getdents d2/d1d/d27 0 2024-09-17T01:01:56.087 INFO:tasks.workunit.client.0.smithi002.stdout:6/367: creat d2/f6c x:0 0 0 2024-09-17T01:01:56.088 INFO:tasks.workunit.client.0.smithi002.stdout:6/368: mkdir d2/d1d/d2d/d35/d6d 0 2024-09-17T01:01:56.093 INFO:tasks.workunit.client.0.smithi002.stdout:4/486: dread d7/d19/d34/d80/d62/f6f [0,4194304] 0 2024-09-17T01:01:56.099 INFO:tasks.workunit.client.1.smithi099.stdout:7/424: dwrite d1/d2c/d5c/fe [0,4194304] 0 2024-09-17T01:01:56.099 INFO:tasks.workunit.client.1.smithi099.stdout:7/425: write d1/d2c/d5c/d1c/f61 [7566655,117829] 0 2024-09-17T01:01:56.100 INFO:tasks.workunit.client.0.smithi002.stdout:3/423: dwrite d0/d3/d17/d6a/f6c [0,4194304] 0 2024-09-17T01:01:56.102 INFO:tasks.workunit.client.0.smithi002.stdout:3/424: mkdir d0/d31/d8b 0 2024-09-17T01:01:56.103 INFO:tasks.workunit.client.0.smithi002.stdout:3/425: symlink d0/d3/d33/d77/l8c 0 2024-09-17T01:01:56.104 INFO:tasks.workunit.client.0.smithi002.stdout:3/426: write d0/d3/d33/f55 [1930435,50917] 0 2024-09-17T01:01:56.105 INFO:tasks.workunit.client.0.smithi002.stdout:3/427: mkdir d0/d3/d8d 0 2024-09-17T01:01:56.105 INFO:tasks.workunit.client.0.smithi002.stdout:3/428: mknod d0/d31/c8e 0 2024-09-17T01:01:56.106 INFO:tasks.workunit.client.1.smithi099.stdout:7/426: dread d1/d36/f62 [4194304,4194304] 0 2024-09-17T01:01:56.107 INFO:tasks.workunit.client.1.smithi099.stdout:9/440: sync 2024-09-17T01:01:56.107 INFO:tasks.workunit.client.1.smithi099.stdout:9/441: getdents da/d8e 0 2024-09-17T01:01:56.108 INFO:tasks.workunit.client.1.smithi099.stdout:9/442: symlink da/d14/d6d/l99 0 2024-09-17T01:01:56.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:55 smithi002 ceph-mon[27650]: pgmap v251: 65 pgs: 65 active+clean; 781 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 65 MiB/s rd, 79 MiB/s wr, 447 op/s 2024-09-17T01:01:56.162 INFO:tasks.workunit.client.0.smithi002.stdout:7/304: dwrite d1/f27 [0,4194304] 0 2024-09-17T01:01:56.169 INFO:tasks.workunit.client.0.smithi002.stdout:6/369: dwrite d2/f18 [0,4194304] 0 2024-09-17T01:01:56.171 INFO:tasks.workunit.client.0.smithi002.stdout:3/429: dread d0/d3/d33/d40/f45 [0,4194304] 0 2024-09-17T01:01:56.173 INFO:tasks.workunit.client.0.smithi002.stdout:3/430: creat d0/d3/d37/d5a/d5b/f8f x:0 0 0 2024-09-17T01:01:56.177 INFO:tasks.workunit.client.0.smithi002.stdout:3/431: mkdir d0/d31/d32/d90 0 2024-09-17T01:01:56.177 INFO:tasks.workunit.client.0.smithi002.stdout:6/370: dread d2/f18 [0,4194304] 0 2024-09-17T01:01:56.178 INFO:tasks.workunit.client.0.smithi002.stdout:6/371: creat d2/d1d/d26/d49/f6e x:0 0 0 2024-09-17T01:01:56.178 INFO:tasks.workunit.client.0.smithi002.stdout:6/372: getdents d2/d1d/d27 0 2024-09-17T01:01:56.178 INFO:tasks.workunit.client.0.smithi002.stdout:6/373: write d2/dc/f20 [450536,21867] 0 2024-09-17T01:01:56.186 INFO:tasks.workunit.client.0.smithi002.stdout:6/374: dread d2/f16 [0,4194304] 0 2024-09-17T01:01:56.187 INFO:tasks.workunit.client.0.smithi002.stdout:6/375: symlink d2/dc/d24/d53/l6f 0 2024-09-17T01:01:56.188 INFO:tasks.workunit.client.0.smithi002.stdout:6/376: unlink d2/d1d/d2d/d35/f66 0 2024-09-17T01:01:56.189 INFO:tasks.workunit.client.0.smithi002.stdout:6/377: rmdir d2/d1d/d2d/d54 39 2024-09-17T01:01:56.189 INFO:tasks.workunit.client.0.smithi002.stdout:6/378: creat d2/f70 x:0 0 0 2024-09-17T01:01:56.190 INFO:tasks.workunit.client.0.smithi002.stdout:6/379: mkdir d2/d1d/d2d/d5a/d71 0 2024-09-17T01:01:56.190 INFO:tasks.workunit.client.0.smithi002.stdout:6/380: creat d2/d1d/d26/d49/f72 x:0 0 0 2024-09-17T01:01:56.191 INFO:tasks.workunit.client.0.smithi002.stdout:6/381: mkdir d2/d1d/d2d/d73 0 2024-09-17T01:01:56.191 INFO:tasks.workunit.client.0.smithi002.stdout:6/382: readlink d2/l4e 0 2024-09-17T01:01:56.191 INFO:tasks.workunit.client.0.smithi002.stdout:6/383: mkdir d2/d1d/d2d/d73/d74 0 2024-09-17T01:01:56.206 INFO:tasks.workunit.client.0.smithi002.stdout:2/404: sync 2024-09-17T01:01:56.208 INFO:tasks.workunit.client.0.smithi002.stdout:2/405: rename d1b/d74/d89 to d1b/d74/d93/d94 0 2024-09-17T01:01:56.208 INFO:tasks.workunit.client.0.smithi002.stdout:2/406: write f5 [3007047,18798] 0 2024-09-17T01:01:56.208 INFO:tasks.workunit.client.0.smithi002.stdout:2/407: truncate d1b/d37/f60 443100 0 2024-09-17T01:01:56.208 INFO:tasks.workunit.client.0.smithi002.stdout:2/408: fdatasync d1b/f2d 0 2024-09-17T01:01:56.208 INFO:tasks.workunit.client.0.smithi002.stdout:2/409: readlink l15 0 2024-09-17T01:01:56.209 INFO:tasks.workunit.client.0.smithi002.stdout:2/410: mknod d1b/d37/d48/d52/c95 0 2024-09-17T01:01:56.210 INFO:tasks.workunit.client.0.smithi002.stdout:2/411: creat d1b/d8a/d92/f96 x:0 0 0 2024-09-17T01:01:56.211 INFO:tasks.workunit.client.0.smithi002.stdout:2/412: symlink d1b/d8a/d92/l97 0 2024-09-17T01:01:56.211 INFO:tasks.workunit.client.0.smithi002.stdout:2/413: dread - d1b/d37/d48/d4e/f76 zero size 2024-09-17T01:01:56.212 INFO:tasks.workunit.client.0.smithi002.stdout:2/414: creat d1b/d1d/f98 x:0 0 0 2024-09-17T01:01:56.212 INFO:tasks.workunit.client.0.smithi002.stdout:2/415: fsync d1b/f1c 0 2024-09-17T01:01:56.212 INFO:tasks.workunit.client.0.smithi002.stdout:2/416: creat d1b/d74/f99 x:0 0 0 2024-09-17T01:01:56.213 INFO:tasks.workunit.client.0.smithi002.stdout:2/417: link d1b/d37/d48/d78/f83 d1b/d37/d48/d52/f9a 0 2024-09-17T01:01:56.214 INFO:tasks.workunit.client.0.smithi002.stdout:2/418: fsync d1b/d1d/f1f 0 2024-09-17T01:01:56.214 INFO:tasks.workunit.client.0.smithi002.stdout:2/419: write d1b/f29 [926499,67782] 0 2024-09-17T01:01:56.215 INFO:tasks.workunit.client.0.smithi002.stdout:4/487: dwrite d7/d19/d2e/f33 [0,4194304] 0 2024-09-17T01:01:56.215 INFO:tasks.workunit.client.0.smithi002.stdout:4/488: chown d7/l1b 65495861 1 2024-09-17T01:01:56.215 INFO:tasks.workunit.client.0.smithi002.stdout:2/420: rename d1b/d1d/f47 to d1b/d37/d48/f9b 0 2024-09-17T01:01:56.215 INFO:tasks.workunit.client.0.smithi002.stdout:4/489: chown d7/d19/d34/d80/d62/l43 1 1 2024-09-17T01:01:56.215 INFO:tasks.workunit.client.0.smithi002.stdout:2/421: creat d1b/d37/f9c x:0 0 0 2024-09-17T01:01:56.216 INFO:tasks.workunit.client.0.smithi002.stdout:4/490: symlink d7/d19/d34/d54/l94 0 2024-09-17T01:01:56.216 INFO:tasks.workunit.client.0.smithi002.stdout:4/491: stat d7/d3f/c68 0 2024-09-17T01:01:56.217 INFO:tasks.workunit.client.0.smithi002.stdout:4/492: mkdir d7/d71/d8e/d95 0 2024-09-17T01:01:56.217 INFO:tasks.workunit.client.1.smithi099.stdout:7/427: dwrite d1/d37/f56 [0,4194304] 0 2024-09-17T01:01:56.221 INFO:tasks.workunit.client.1.smithi099.stdout:7/428: rename d1/d2c/d5c/l79 to d1/d2c/l85 0 2024-09-17T01:01:56.222 INFO:tasks.workunit.client.0.smithi002.stdout:7/305: dwrite d1/d24/f56 [0,4194304] 0 2024-09-17T01:01:56.222 INFO:tasks.workunit.client.0.smithi002.stdout:2/422: dread d1b/f3a [0,4194304] 0 2024-09-17T01:01:56.222 INFO:tasks.workunit.client.1.smithi099.stdout:9/443: dwrite da/d21/d2a/f54 [0,4194304] 0 2024-09-17T01:01:56.223 INFO:tasks.workunit.client.0.smithi002.stdout:3/432: dwrite d0/d3/d17/f20 [4194304,4194304] 0 2024-09-17T01:01:56.227 INFO:tasks.workunit.client.0.smithi002.stdout:2/423: rename f5 to d1b/d1d/f9d 0 2024-09-17T01:01:56.228 INFO:tasks.workunit.client.1.smithi099.stdout:9/444: dread da/d14/d62/f6b [0,4194304] 0 2024-09-17T01:01:56.229 INFO:tasks.workunit.client.0.smithi002.stdout:6/384: dwrite d2/d4b/d4c/f62 [0,4194304] 0 2024-09-17T01:01:56.229 INFO:tasks.workunit.client.0.smithi002.stdout:6/385: stat d2/d1d/d27/c56 0 2024-09-17T01:01:56.230 INFO:tasks.workunit.client.0.smithi002.stdout:7/306: dread d1/f5 [0,4194304] 0 2024-09-17T01:01:56.232 INFO:tasks.workunit.client.0.smithi002.stdout:3/433: unlink d0/d3/d37/d5a/f83 0 2024-09-17T01:01:56.233 INFO:tasks.workunit.client.1.smithi099.stdout:1/514: sync 2024-09-17T01:01:56.233 INFO:tasks.workunit.client.1.smithi099.stdout:0/422: sync 2024-09-17T01:01:56.234 INFO:tasks.workunit.client.1.smithi099.stdout:3/448: sync 2024-09-17T01:01:56.234 INFO:tasks.workunit.client.1.smithi099.stdout:5/447: sync 2024-09-17T01:01:56.234 INFO:tasks.workunit.client.1.smithi099.stdout:2/349: sync 2024-09-17T01:01:56.234 INFO:tasks.workunit.client.1.smithi099.stdout:2/350: fdatasync d2/d9/d25/d26/f33 0 2024-09-17T01:01:56.234 INFO:tasks.workunit.client.1.smithi099.stdout:6/456: sync 2024-09-17T01:01:56.234 INFO:tasks.workunit.client.1.smithi099.stdout:4/391: sync 2024-09-17T01:01:56.234 INFO:tasks.workunit.client.1.smithi099.stdout:6/457: readlink dc/d1a/l59 0 2024-09-17T01:01:56.234 INFO:tasks.workunit.client.1.smithi099.stdout:8/435: sync 2024-09-17T01:01:56.234 INFO:tasks.workunit.client.1.smithi099.stdout:8/436: write d0/d1f/d31/f79 [101468,112970] 0 2024-09-17T01:01:56.234 INFO:tasks.workunit.client.1.smithi099.stdout:8/437: chown d0/d1f/d31 5430058 1 2024-09-17T01:01:56.235 INFO:tasks.workunit.client.1.smithi099.stdout:0/423: unlink da/df/l60 0 2024-09-17T01:01:56.236 INFO:tasks.workunit.client.0.smithi002.stdout:4/493: dwrite d7/de/f28 [0,4194304] 0 2024-09-17T01:01:56.237 INFO:tasks.workunit.client.0.smithi002.stdout:2/424: write d1b/d37/d48/d4e/f81 [1995705,107701] 0 2024-09-17T01:01:56.237 INFO:tasks.workunit.client.0.smithi002.stdout:2/425: write d1b/d74/f99 [484580,116980] 0 2024-09-17T01:01:56.237 INFO:tasks.workunit.client.0.smithi002.stdout:2/426: dread - d1b/d1d/d38/d72/f84 zero size 2024-09-17T01:01:56.237 INFO:tasks.workunit.client.0.smithi002.stdout:2/427: readlink l15 0 2024-09-17T01:01:56.237 INFO:tasks.workunit.client.0.smithi002.stdout:2/428: stat d1b/d1d/f98 0 2024-09-17T01:01:56.237 INFO:tasks.workunit.client.0.smithi002.stdout:2/429: chown d1b/d37/d48/d4e 15187 1 2024-09-17T01:01:56.237 INFO:tasks.workunit.client.0.smithi002.stdout:2/430: dread - d1b/d8a/f8c zero size 2024-09-17T01:01:56.238 INFO:tasks.workunit.client.1.smithi099.stdout:9/445: write da/d18/f7e [1777829,56710] 0 2024-09-17T01:01:56.238 INFO:tasks.workunit.client.1.smithi099.stdout:9/446: truncate da/d14/d40/f97 982985 0 2024-09-17T01:01:56.240 INFO:tasks.workunit.client.1.smithi099.stdout:0/424: rename da/d12/d22/d66/d7d to da/df/d31/d8b 0 2024-09-17T01:01:56.242 INFO:tasks.workunit.client.0.smithi002.stdout:3/434: write d0/d3/d37/f47 [165448,78025] 0 2024-09-17T01:01:56.242 INFO:tasks.workunit.client.0.smithi002.stdout:3/435: dread - d0/d31/d32/f81 zero size 2024-09-17T01:01:56.243 INFO:tasks.workunit.client.1.smithi099.stdout:0/425: mkdir da/d59/d80/d8c 0 2024-09-17T01:01:56.243 INFO:tasks.workunit.client.1.smithi099.stdout:7/429: dwrite d1/d2c/d5c/d12/f2b [0,4194304] 0 2024-09-17T01:01:56.244 INFO:tasks.workunit.client.1.smithi099.stdout:7/430: stat d1/d2c/d5c/d12/l39 0 2024-09-17T01:01:56.244 INFO:tasks.workunit.client.1.smithi099.stdout:7/431: readlink d1/d2c/d5c/d3f/l68 0 2024-09-17T01:01:56.244 INFO:tasks.workunit.client.1.smithi099.stdout:7/432: truncate d1/d2c/f40 5144708 0 2024-09-17T01:01:56.244 INFO:tasks.workunit.client.1.smithi099.stdout:7/433: creat d1/d2c/d5c/d1c/d72/f86 x:0 0 0 2024-09-17T01:01:56.245 INFO:tasks.workunit.client.0.smithi002.stdout:6/386: link d2/l63 d2/d1d/l75 0 2024-09-17T01:01:56.245 INFO:tasks.workunit.client.0.smithi002.stdout:7/307: creat d1/d14/d1d/d28/d40/d58/f62 x:0 0 0 2024-09-17T01:01:56.245 INFO:tasks.workunit.client.0.smithi002.stdout:7/308: fdatasync d1/d14/d1d/d29/d4b/f4e 0 2024-09-17T01:01:56.245 INFO:tasks.workunit.client.0.smithi002.stdout:7/309: read - d1/d14/d1d/d28/d40/f5f zero size 2024-09-17T01:01:56.245 INFO:tasks.workunit.client.0.smithi002.stdout:7/310: creat d1/d14/d1d/d21/f63 x:0 0 0 2024-09-17T01:01:56.245 INFO:tasks.workunit.client.0.smithi002.stdout:4/494: creat d7/d19/d34/d80/f96 x:0 0 0 2024-09-17T01:01:56.245 INFO:tasks.workunit.client.0.smithi002.stdout:4/495: fsync d7/de/d32/f40 0 2024-09-17T01:01:56.248 INFO:tasks.workunit.client.1.smithi099.stdout:0/426: rmdir da/d12/d2b 39 2024-09-17T01:01:56.249 INFO:tasks.workunit.client.0.smithi002.stdout:2/431: symlink d1b/d37/d48/d4e/l9e 0 2024-09-17T01:01:56.249 INFO:tasks.workunit.client.1.smithi099.stdout:7/434: symlink d1/d2c/d5c/d1c/d5a/d6f/l87 0 2024-09-17T01:01:56.249 INFO:tasks.workunit.client.1.smithi099.stdout:7/435: chown d1/d2c/d5c/d12/f74 4 1 2024-09-17T01:01:56.249 INFO:tasks.workunit.client.1.smithi099.stdout:7/436: fsync d1/d37/f51 0 2024-09-17T01:01:56.250 INFO:tasks.workunit.client.1.smithi099.stdout:9/447: rename da/d1b to da/d9a 0 2024-09-17T01:01:56.250 INFO:tasks.workunit.client.1.smithi099.stdout:9/448: chown da/d14/d6d/f8a 13 1 2024-09-17T01:01:56.250 INFO:tasks.workunit.client.1.smithi099.stdout:9/449: dread - da/d50/f86 zero size 2024-09-17T01:01:56.252 INFO:tasks.workunit.client.1.smithi099.stdout:0/427: mknod da/d12/d2b/c8d 0 2024-09-17T01:01:56.253 INFO:tasks.workunit.client.0.smithi002.stdout:6/387: creat d2/d1d/d26/d49/d51/f76 x:0 0 0 2024-09-17T01:01:56.255 INFO:tasks.workunit.client.0.smithi002.stdout:6/388: creat d2/d1d/d27/d30/f77 x:0 0 0 2024-09-17T01:01:56.255 INFO:tasks.workunit.client.0.smithi002.stdout:6/389: readlink d2/d1d/d26/d40/d43/l45 0 2024-09-17T01:01:56.255 INFO:tasks.workunit.client.0.smithi002.stdout:6/390: write d2/f70 [848718,100801] 0 2024-09-17T01:01:56.255 INFO:tasks.workunit.client.1.smithi099.stdout:7/437: unlink d1/c38 0 2024-09-17T01:01:56.256 INFO:tasks.workunit.client.0.smithi002.stdout:7/311: symlink d1/d14/d1d/d29/l64 0 2024-09-17T01:01:56.256 INFO:tasks.workunit.client.0.smithi002.stdout:7/312: chown d1/le 84661 1 2024-09-17T01:01:56.256 INFO:tasks.workunit.client.0.smithi002.stdout:7/313: chown d1/d14/d1d/d28/f4f 75 1 2024-09-17T01:01:56.256 INFO:tasks.workunit.client.0.smithi002.stdout:7/314: write d1/f27 [5201193,75553] 0 2024-09-17T01:01:56.256 INFO:tasks.workunit.client.1.smithi099.stdout:1/515: write d0/d8/d49/d4e/f6c [1993128,54964] 0 2024-09-17T01:01:56.257 INFO:tasks.workunit.client.0.smithi002.stdout:2/432: rename d1b/f67 to d1b/d74/f9f 0 2024-09-17T01:01:56.258 INFO:tasks.workunit.client.1.smithi099.stdout:0/428: rename da/d12/l78 to da/df/d1a/d70/l8e 0 2024-09-17T01:01:56.260 INFO:tasks.workunit.client.0.smithi002.stdout:6/391: unlink d2/f5e 0 2024-09-17T01:01:56.262 INFO:tasks.workunit.client.0.smithi002.stdout:7/315: mknod d1/d14/d1d/d29/d57/c65 0 2024-09-17T01:01:56.262 INFO:tasks.workunit.client.0.smithi002.stdout:7/316: creat d1/d14/d1d/d29/d30/d54/f66 x:0 0 0 2024-09-17T01:01:56.263 INFO:tasks.workunit.client.0.smithi002.stdout:6/392: dread d2/dc/f20 [0,4194304] 0 2024-09-17T01:01:56.264 INFO:tasks.workunit.client.0.smithi002.stdout:7/317: rename d1/d14/d1d/d29/d30/d50/d5d to d1/d14/d67 0 2024-09-17T01:01:56.266 INFO:tasks.workunit.client.1.smithi099.stdout:5/448: dread d2/dc/d14/d19/f6d [0,4194304] 0 2024-09-17T01:01:56.268 INFO:tasks.workunit.client.1.smithi099.stdout:0/429: getdents da/df/d1a 0 2024-09-17T01:01:56.268 INFO:tasks.workunit.client.1.smithi099.stdout:0/430: chown da/df/d1a/d70 139 1 2024-09-17T01:01:56.273 INFO:tasks.workunit.client.1.smithi099.stdout:5/449: link d2/dc/d14/d19/l6a d2/d45/l87 0 2024-09-17T01:01:56.276 INFO:tasks.workunit.client.1.smithi099.stdout:8/438: dread d0/d4/d29/d4b/f5c [0,4194304] 0 2024-09-17T01:01:56.280 INFO:tasks.workunit.client.1.smithi099.stdout:5/450: mknod d2/dc/d6c/c88 0 2024-09-17T01:01:56.280 INFO:tasks.workunit.client.1.smithi099.stdout:5/451: truncate d2/dc/d14/d19/f75 102024 0 2024-09-17T01:01:56.280 INFO:tasks.workunit.client.1.smithi099.stdout:8/439: mkdir d0/d1f/d90 0 2024-09-17T01:01:56.280 INFO:tasks.workunit.client.1.smithi099.stdout:8/440: stat d0/d4/d64/f8d 0 2024-09-17T01:01:56.280 INFO:tasks.workunit.client.1.smithi099.stdout:8/441: chown d0/d4/d29/f5f 1258 1 2024-09-17T01:01:56.280 INFO:tasks.workunit.client.1.smithi099.stdout:8/442: truncate d0/d53/f66 1024022 0 2024-09-17T01:01:56.280 INFO:tasks.workunit.client.1.smithi099.stdout:8/443: readlink d0/d1f/d31/l56 0 2024-09-17T01:01:56.281 INFO:tasks.workunit.client.1.smithi099.stdout:8/444: stat d0/d4/d29/l6b 0 2024-09-17T01:01:56.281 INFO:tasks.workunit.client.0.smithi002.stdout:6/393: write d2/d1d/f57 [3419800,31160] 0 2024-09-17T01:01:56.281 INFO:tasks.workunit.client.0.smithi002.stdout:6/394: creat d2/d1d/d27/d30/f78 x:0 0 0 2024-09-17T01:01:56.283 INFO:tasks.workunit.client.0.smithi002.stdout:6/395: mkdir d2/d1d/d2d/d35/d79 0 2024-09-17T01:01:56.284 INFO:tasks.workunit.client.0.smithi002.stdout:0/310: sync 2024-09-17T01:01:56.286 INFO:tasks.workunit.client.1.smithi099.stdout:8/445: dread d0/d4/d29/f57 [0,4194304] 0 2024-09-17T01:01:56.286 INFO:tasks.workunit.client.1.smithi099.stdout:8/446: chown d0/d4/d29/d4b/f5c 2 1 2024-09-17T01:01:56.286 INFO:tasks.workunit.client.1.smithi099.stdout:9/450: dread da/d9a/d3a/d4b/f66 [4194304,4194304] 0 2024-09-17T01:01:56.286 INFO:tasks.workunit.client.1.smithi099.stdout:4/392: dwrite d7/f16 [0,4194304] 0 2024-09-17T01:01:56.286 INFO:tasks.workunit.client.0.smithi002.stdout:6/396: rename d2/d1d/d26/d40/d43/f65 to d2/d1d/d26/f7a 0 2024-09-17T01:01:56.287 INFO:tasks.workunit.client.0.smithi002.stdout:6/397: chown d2/d1d/f57 659 1 2024-09-17T01:01:56.287 INFO:tasks.workunit.client.0.smithi002.stdout:6/398: readlink d2/d1d/d27/d30/l44 0 2024-09-17T01:01:56.287 INFO:tasks.workunit.client.0.smithi002.stdout:6/399: unlink d2/d1d/d26/l55 0 2024-09-17T01:01:56.287 INFO:tasks.workunit.client.0.smithi002.stdout:6/400: chown d2/d1d/d26/f67 105 1 2024-09-17T01:01:56.288 INFO:tasks.workunit.client.0.smithi002.stdout:6/401: fsync d2/dc/f21 0 2024-09-17T01:01:56.288 INFO:tasks.workunit.client.1.smithi099.stdout:4/393: link d7/dd/d21/d7b/f43 d7/dd/de/d10/f86 0 2024-09-17T01:01:56.289 INFO:tasks.workunit.client.0.smithi002.stdout:6/402: creat d2/d1d/d2d/d73/d74/f7b x:0 0 0 2024-09-17T01:01:56.289 INFO:tasks.workunit.client.0.smithi002.stdout:6/403: dread - d2/d1d/d26/f7a zero size 2024-09-17T01:01:56.289 INFO:tasks.workunit.client.0.smithi002.stdout:6/404: chown d2/d1d/d26/d49/f72 1898906335 1 2024-09-17T01:01:56.289 INFO:tasks.workunit.client.0.smithi002.stdout:6/405: write d2/d1d/d26/d49/f6e [25622,70662] 0 2024-09-17T01:01:56.289 INFO:tasks.workunit.client.0.smithi002.stdout:6/406: truncate d2/d1d/d26/f7a 354760 0 2024-09-17T01:01:56.289 INFO:tasks.workunit.client.0.smithi002.stdout:6/407: link d2/d1d/d2d/f4f d2/d1d/d2d/d35/d6d/f7c 0 2024-09-17T01:01:56.290 INFO:tasks.workunit.client.1.smithi099.stdout:8/447: dread d0/d4/f6c [0,4194304] 0 2024-09-17T01:01:56.290 INFO:tasks.workunit.client.1.smithi099.stdout:8/448: fdatasync d0/d4/d29/d4b/f4e 0 2024-09-17T01:01:56.291 INFO:tasks.workunit.client.1.smithi099.stdout:4/394: getdents d7/dd/d21 0 2024-09-17T01:01:56.293 INFO:tasks.workunit.client.1.smithi099.stdout:5/452: write d2/dc/d17/f3a [1412356,90841] 0 2024-09-17T01:01:56.293 INFO:tasks.workunit.client.1.smithi099.stdout:8/449: creat d0/d41/f91 x:0 0 0 2024-09-17T01:01:56.293 INFO:tasks.workunit.client.1.smithi099.stdout:8/450: readlink d0/d41/l52 0 2024-09-17T01:01:56.293 INFO:tasks.workunit.client.1.smithi099.stdout:8/451: read d0/d1f/f81 [918326,39109] 0 2024-09-17T01:01:56.297 INFO:tasks.workunit.client.1.smithi099.stdout:8/452: symlink d0/d41/d5a/l92 0 2024-09-17T01:01:56.297 INFO:tasks.workunit.client.1.smithi099.stdout:8/453: creat d0/d4/d64/f93 x:0 0 0 2024-09-17T01:01:56.297 INFO:tasks.workunit.client.1.smithi099.stdout:8/454: truncate d0/d1f/d31/d4c/f67 402688 0 2024-09-17T01:01:56.297 INFO:tasks.workunit.client.1.smithi099.stdout:4/395: dread d7/dd/d21/d26/d3f/d5b/f2c [0,4194304] 0 2024-09-17T01:01:56.297 INFO:tasks.workunit.client.1.smithi099.stdout:5/453: rmdir d2/d26 39 2024-09-17T01:01:56.299 INFO:tasks.workunit.client.1.smithi099.stdout:3/449: dwrite d9/d15/d38/f51 [0,4194304] 0 2024-09-17T01:01:56.299 INFO:tasks.workunit.client.1.smithi099.stdout:4/396: link d7/dd/d21/c47 d7/dd/d21/d26/d3f/d5b/c87 0 2024-09-17T01:01:56.300 INFO:tasks.workunit.client.1.smithi099.stdout:5/454: mkdir d2/dc/d14/d89 0 2024-09-17T01:01:56.304 INFO:tasks.workunit.client.1.smithi099.stdout:4/397: truncate d7/dd/d21/f38 3422768 0 2024-09-17T01:01:56.305 INFO:tasks.workunit.client.1.smithi099.stdout:5/455: symlink d2/dc/d17/d3c/d60/l8a 0 2024-09-17T01:01:56.308 INFO:tasks.workunit.client.1.smithi099.stdout:3/450: rmdir d9/d15 39 2024-09-17T01:01:56.309 INFO:tasks.workunit.client.1.smithi099.stdout:5/456: rmdir d2/dc/d14 39 2024-09-17T01:01:56.309 INFO:tasks.workunit.client.1.smithi099.stdout:8/455: read d0/d4/f49 [3184377,115204] 0 2024-09-17T01:01:56.311 INFO:tasks.workunit.client.1.smithi099.stdout:8/456: creat d0/d41/d5a/f94 x:0 0 0 2024-09-17T01:01:56.313 INFO:tasks.workunit.client.1.smithi099.stdout:3/451: rmdir d9 39 2024-09-17T01:01:56.315 INFO:tasks.workunit.client.0.smithi002.stdout:3/436: dwrite d0/f2f [0,4194304] 0 2024-09-17T01:01:56.315 INFO:tasks.workunit.client.1.smithi099.stdout:0/431: dwrite da/d12/d2b/f37 [0,4194304] 0 2024-09-17T01:01:56.318 INFO:tasks.workunit.client.1.smithi099.stdout:4/398: write f2 [16622584,122297] 0 2024-09-17T01:01:56.318 INFO:tasks.workunit.client.1.smithi099.stdout:6/458: dwrite dc/d27/f7d [0,4194304] 0 2024-09-17T01:01:56.319 INFO:tasks.workunit.client.1.smithi099.stdout:1/516: dwrite d0/d2/de/d8b/f9a [0,4194304] 0 2024-09-17T01:01:56.319 INFO:tasks.workunit.client.1.smithi099.stdout:1/517: chown d0/d8/d38/d56/d93/lb4 15 1 2024-09-17T01:01:56.319 INFO:tasks.workunit.client.1.smithi099.stdout:1/518: fsync d0/d8/d38/d56/f57 0 2024-09-17T01:01:56.319 INFO:tasks.workunit.client.0.smithi002.stdout:6/408: dwrite d2/d1d/d27/d30/f78 [0,4194304] 0 2024-09-17T01:01:56.320 INFO:tasks.workunit.client.1.smithi099.stdout:9/451: dwrite da/d9a/d3a/f26 [4194304,4194304] 0 2024-09-17T01:01:56.320 INFO:tasks.workunit.client.1.smithi099.stdout:9/452: chown da/d9a/l3e 977 1 2024-09-17T01:01:56.324 INFO:tasks.workunit.client.1.smithi099.stdout:3/452: write d9/d15/f50 [2218722,38317] 0 2024-09-17T01:01:56.326 INFO:tasks.workunit.client.0.smithi002.stdout:4/496: dwrite d7/d19/d2e/f70 [0,4194304] 0 2024-09-17T01:01:56.399 INFO:tasks.workunit.client.1.smithi099.stdout:6/459: rename dc/l4e to dc/d1a/l91 0 2024-09-17T01:01:56.406 INFO:tasks.workunit.client.1.smithi099.stdout:3/453: symlink d9/d15/d18/l86 0 2024-09-17T01:01:56.407 INFO:tasks.workunit.client.1.smithi099.stdout:1/519: rename d0/d8/ca to d0/d2/de/cb7 0 2024-09-17T01:01:56.408 INFO:tasks.workunit.client.1.smithi099.stdout:4/399: dread f2 [0,4194304] 0 2024-09-17T01:01:56.409 INFO:tasks.workunit.client.1.smithi099.stdout:3/454: truncate d9/d15/d18/d1a/d23/f4a 3383259 0 2024-09-17T01:01:56.412 INFO:tasks.workunit.client.1.smithi099.stdout:4/400: rename d7/dd/d21/d26/d3f/f6d to d7/d35/d80/f88 0 2024-09-17T01:01:56.412 INFO:tasks.workunit.client.1.smithi099.stdout:4/401: stat d7/dd/d21/d7b/d4b/f27 0 2024-09-17T01:01:56.412 INFO:tasks.workunit.client.1.smithi099.stdout:4/402: read - d7/dd/de/d10/d3a/f81 zero size 2024-09-17T01:01:56.412 INFO:tasks.workunit.client.1.smithi099.stdout:4/403: write d7/dd/de/d10/d3a/f53 [238266,11885] 0 2024-09-17T01:01:56.413 INFO:tasks.workunit.client.1.smithi099.stdout:3/455: getdents d9/d15/d18/d1a 0 2024-09-17T01:01:56.414 INFO:tasks.workunit.client.1.smithi099.stdout:3/456: symlink d9/d2b/d52/d5e/l87 0 2024-09-17T01:01:56.414 INFO:tasks.workunit.client.1.smithi099.stdout:3/457: truncate d9/d15/f40 1401541 0 2024-09-17T01:01:56.578 INFO:tasks.workunit.client.1.smithi099.stdout:5/457: rmdir d2/d45 39 2024-09-17T01:01:56.579 INFO:tasks.workunit.client.1.smithi099.stdout:3/458: dread d9/d3b/d44/d57/f5a [0,4194304] 0 2024-09-17T01:01:56.579 INFO:tasks.workunit.client.1.smithi099.stdout:5/458: rename d2/d8/l1d to d2/dc/d17/d6b/l8b 0 2024-09-17T01:01:56.579 INFO:tasks.workunit.client.1.smithi099.stdout:5/459: chown d2/dc/d14/d19/c71 21074 1 2024-09-17T01:01:56.579 INFO:tasks.workunit.client.1.smithi099.stdout:3/459: creat d9/d15/d18/f88 x:0 0 0 2024-09-17T01:01:56.579 INFO:tasks.workunit.client.1.smithi099.stdout:3/460: fsync d9/d2b/d52/f6f 0 2024-09-17T01:01:56.579 INFO:tasks.workunit.client.1.smithi099.stdout:5/460: mknod d2/dc/d17/d3c/d60/c8c 0 2024-09-17T01:01:56.579 INFO:tasks.workunit.client.1.smithi099.stdout:5/461: symlink d2/dc/d6c/l8d 0 2024-09-17T01:01:56.579 INFO:tasks.workunit.client.1.smithi099.stdout:5/462: mkdir d2/dc/d14/d19/d8e 0 2024-09-17T01:01:56.579 INFO:tasks.workunit.client.1.smithi099.stdout:4/404: dread d7/dd/d21/d7b/d4b/f34 [0,4194304] 0 2024-09-17T01:01:56.579 INFO:tasks.workunit.client.1.smithi099.stdout:5/463: creat d2/dc/d17/d3c/f8f x:0 0 0 2024-09-17T01:01:56.579 INFO:tasks.workunit.client.1.smithi099.stdout:4/405: creat d7/dd/d21/d7b/f89 x:0 0 0 2024-09-17T01:01:56.579 INFO:tasks.workunit.client.1.smithi099.stdout:5/464: mkdir d2/dc/d17/d3c/d60/d90 0 2024-09-17T01:01:56.580 INFO:tasks.workunit.client.1.smithi099.stdout:4/406: unlink d7/dd/d21/d26/d3f/d5b/l24 0 2024-09-17T01:01:56.580 INFO:tasks.workunit.client.1.smithi099.stdout:4/407: truncate d7/dd/de/f3c 638733 0 2024-09-17T01:01:56.580 INFO:tasks.workunit.client.1.smithi099.stdout:0/432: dwrite da/df/d31/d8b/f81 [0,4194304] 0 2024-09-17T01:01:56.580 INFO:tasks.workunit.client.1.smithi099.stdout:4/408: write d7/d35/d80/f88 [500344,58301] 0 2024-09-17T01:01:56.580 INFO:tasks.workunit.client.1.smithi099.stdout:3/461: read d9/d15/d18/f20 [1829310,29211] 0 2024-09-17T01:01:56.580 INFO:tasks.workunit.client.1.smithi099.stdout:0/433: mknod da/c8f 0 2024-09-17T01:01:56.580 INFO:tasks.workunit.client.1.smithi099.stdout:3/462: read d9/d3b/d44/f6d [298526,11962] 0 2024-09-17T01:01:56.580 INFO:tasks.workunit.client.1.smithi099.stdout:0/434: dread da/df/d31/f34 [0,4194304] 0 2024-09-17T01:01:56.580 INFO:tasks.workunit.client.1.smithi099.stdout:0/435: write da/df/d1a/d49/f51 [2443681,120093] 0 2024-09-17T01:01:56.580 INFO:tasks.workunit.client.1.smithi099.stdout:3/463: rename d9/d15/d18/d1a/d23/c41 to d9/d15/d18/d1a/d23/d4c/d64/c89 0 2024-09-17T01:01:56.580 INFO:tasks.workunit.client.1.smithi099.stdout:3/464: truncate d9/d3b/d44/f7b 4537914 0 2024-09-17T01:01:56.580 INFO:tasks.workunit.client.1.smithi099.stdout:3/465: chown d9/d15/d18/d1a/d23 486135 1 2024-09-17T01:01:56.581 INFO:tasks.workunit.client.1.smithi099.stdout:9/453: dwrite da/f64 [0,4194304] 0 2024-09-17T01:01:56.581 INFO:tasks.workunit.client.1.smithi099.stdout:4/409: getdents d7/dd 0 2024-09-17T01:01:56.581 INFO:tasks.workunit.client.1.smithi099.stdout:4/410: write d7/dd/d21/d26/f32 [2362362,46211] 0 2024-09-17T01:01:56.581 INFO:tasks.workunit.client.1.smithi099.stdout:5/465: write d2/dc/d17/f5d [3088120,12652] 0 2024-09-17T01:01:56.581 INFO:tasks.workunit.client.1.smithi099.stdout:6/460: dwrite dc/d1a/f79 [0,4194304] 0 2024-09-17T01:01:56.581 INFO:tasks.workunit.client.1.smithi099.stdout:9/454: dread da/d18/f7e [0,4194304] 0 2024-09-17T01:01:56.581 INFO:tasks.workunit.client.1.smithi099.stdout:3/466: rename d9/d15/d18/d1a/f1f to d9/d15/d7d/f8a 0 2024-09-17T01:01:56.581 INFO:tasks.workunit.client.1.smithi099.stdout:5/466: dread d2/dc/d17/f3a [0,4194304] 0 2024-09-17T01:01:56.581 INFO:tasks.workunit.client.1.smithi099.stdout:6/461: dread dc/d5d/f69 [0,4194304] 0 2024-09-17T01:01:56.581 INFO:tasks.workunit.client.1.smithi099.stdout:0/436: dwrite da/df/d1a/d63/d6a/f8a [0,4194304] 0 2024-09-17T01:01:56.581 INFO:tasks.workunit.client.1.smithi099.stdout:6/462: creat dc/d1a/f92 x:0 0 0 2024-09-17T01:01:56.581 INFO:tasks.workunit.client.1.smithi099.stdout:6/463: dread - dc/d2b/f76 zero size 2024-09-17T01:01:56.581 INFO:tasks.workunit.client.1.smithi099.stdout:6/464: readlink dc/d1a/l41 0 2024-09-17T01:01:56.582 INFO:tasks.workunit.client.1.smithi099.stdout:4/411: mkdir d7/dd/de/d10/d6b/d82/d8a 0 2024-09-17T01:01:56.582 INFO:tasks.workunit.client.1.smithi099.stdout:9/455: rename da/d14/d40/d80 to da/d9b 0 2024-09-17T01:01:56.582 INFO:tasks.workunit.client.1.smithi099.stdout:9/456: write da/d18/f7e [2212462,121592] 0 2024-09-17T01:01:56.582 INFO:tasks.workunit.client.1.smithi099.stdout:5/467: symlink d2/dc/d14/d19/l91 0 2024-09-17T01:01:56.582 INFO:tasks.workunit.client.1.smithi099.stdout:5/468: fsync d2/d26/f4e 0 2024-09-17T01:01:56.582 INFO:tasks.workunit.client.1.smithi099.stdout:6/465: dread dc/d1a/d49/f73 [0,4194304] 0 2024-09-17T01:01:56.582 INFO:tasks.workunit.client.1.smithi099.stdout:6/466: readlink dc/d1a/d49/l6f 0 2024-09-17T01:01:56.582 INFO:tasks.workunit.client.1.smithi099.stdout:3/467: dwrite d9/d15/d7d/f8a [0,4194304] 0 2024-09-17T01:01:56.582 INFO:tasks.workunit.client.1.smithi099.stdout:3/468: dread d9/f7a [0,4194304] 0 2024-09-17T01:01:56.582 INFO:tasks.workunit.client.1.smithi099.stdout:3/469: fdatasync d9/d15/f40 0 2024-09-17T01:01:56.582 INFO:tasks.workunit.client.1.smithi099.stdout:4/412: unlink d7/f16 0 2024-09-17T01:01:56.583 INFO:tasks.workunit.client.1.smithi099.stdout:4/413: chown d7/dd/de/d17 2133234 1 2024-09-17T01:01:56.583 INFO:tasks.workunit.client.1.smithi099.stdout:4/414: chown d7/dd/d21/d26/d3f/d5b/f2c 205 1 2024-09-17T01:01:56.583 INFO:tasks.workunit.client.1.smithi099.stdout:4/415: chown d7/dd/d21/d26/f51 7 1 2024-09-17T01:01:56.583 INFO:tasks.workunit.client.1.smithi099.stdout:9/457: rename da/f2c to da/d56/d84/f9c 0 2024-09-17T01:01:56.583 INFO:tasks.workunit.client.1.smithi099.stdout:5/469: unlink d2/d45/c51 0 2024-09-17T01:01:56.583 INFO:tasks.workunit.client.1.smithi099.stdout:6/467: mknod dc/d27/d58/d74/c93 0 2024-09-17T01:01:56.583 INFO:tasks.workunit.client.1.smithi099.stdout:6/468: write dc/d2b/d3f/f8e [769058,23184] 0 2024-09-17T01:01:56.583 INFO:tasks.workunit.client.1.smithi099.stdout:4/416: creat d7/dd/de/d10/d6b/f8b x:0 0 0 2024-09-17T01:01:56.583 INFO:tasks.workunit.client.1.smithi099.stdout:4/417: dread - d7/dd/de/d10/d3a/f81 zero size 2024-09-17T01:01:56.584 INFO:tasks.workunit.client.1.smithi099.stdout:4/418: chown d7/dd/de/d10/d6b/d82 38 1 2024-09-17T01:01:56.584 INFO:tasks.workunit.client.1.smithi099.stdout:9/458: link da/d9a/d3a/c45 da/d14/d40/d6f/c9d 0 2024-09-17T01:01:56.584 INFO:tasks.workunit.client.1.smithi099.stdout:9/459: creat da/d18/d5e/f9e x:0 0 0 2024-09-17T01:01:56.584 INFO:tasks.workunit.client.1.smithi099.stdout:5/470: symlink d2/dc/d14/d89/l92 0 2024-09-17T01:01:56.584 INFO:tasks.workunit.client.1.smithi099.stdout:4/419: mknod d7/dd/d21/d7b/d74/c8c 0 2024-09-17T01:01:56.584 INFO:tasks.workunit.client.1.smithi099.stdout:4/420: unlink d7/d35/f36 0 2024-09-17T01:01:56.584 INFO:tasks.workunit.client.1.smithi099.stdout:6/469: read dc/d1a/d49/d4c/f6d [4949665,35381] 0 2024-09-17T01:01:56.584 INFO:tasks.workunit.client.1.smithi099.stdout:6/470: creat dc/d27/d7e/f94 x:0 0 0 2024-09-17T01:01:56.585 INFO:tasks.workunit.client.1.smithi099.stdout:6/471: creat dc/f95 x:0 0 0 2024-09-17T01:01:56.588 INFO:tasks.workunit.client.1.smithi099.stdout:0/437: dwrite da/d12/d22/f7e [0,4194304] 0 2024-09-17T01:01:56.588 INFO:tasks.workunit.client.1.smithi099.stdout:0/438: stat da/d12/f5a 0 2024-09-17T01:01:56.588 INFO:tasks.workunit.client.1.smithi099.stdout:0/439: truncate da/d59/f75 356799 0 2024-09-17T01:01:56.588 INFO:tasks.workunit.client.1.smithi099.stdout:0/440: mknod da/d12/d22/d53/c90 0 2024-09-17T01:01:56.588 INFO:tasks.workunit.client.1.smithi099.stdout:0/441: stat da/f27 0 2024-09-17T01:01:56.588 INFO:tasks.workunit.client.1.smithi099.stdout:0/442: unlink da/f14 0 2024-09-17T01:01:56.589 INFO:tasks.workunit.client.1.smithi099.stdout:3/470: dwrite d9/d15/d18/d1a/d23/f17 [4194304,4194304] 0 2024-09-17T01:01:56.589 INFO:tasks.workunit.client.1.smithi099.stdout:3/471: chown d9/f79 4726831 1 2024-09-17T01:01:56.589 INFO:tasks.workunit.client.1.smithi099.stdout:3/472: read d9/d15/f40 [312267,62240] 0 2024-09-17T01:01:56.589 INFO:tasks.workunit.client.1.smithi099.stdout:3/473: mknod d9/d2b/d52/d5e/c8b 0 2024-09-17T01:01:56.589 INFO:tasks.workunit.client.1.smithi099.stdout:3/474: dread - d9/f83 zero size 2024-09-17T01:01:56.589 INFO:tasks.workunit.client.1.smithi099.stdout:3/475: creat d9/f8c x:0 0 0 2024-09-17T01:01:56.589 INFO:tasks.workunit.client.1.smithi099.stdout:3/476: symlink d9/l8d 0 2024-09-17T01:01:56.589 INFO:tasks.workunit.client.1.smithi099.stdout:6/472: dwrite dc/d27/d7e/f94 [0,4194304] 0 2024-09-17T01:01:56.590 INFO:tasks.workunit.client.1.smithi099.stdout:6/473: chown dc/d5d/l8b 92 1 2024-09-17T01:01:56.590 INFO:tasks.workunit.client.1.smithi099.stdout:6/474: truncate dc/d2b/d3f/f47 1255320 0 2024-09-17T01:01:56.592 INFO:tasks.workunit.client.0.smithi002.stdout:2/433: dwrite d1b/d37/d48/d4e/f81 [0,4194304] 0 2024-09-17T01:01:56.592 INFO:tasks.workunit.client.0.smithi002.stdout:2/434: chown d1b/d37/d48/d4e/f2e 30180060 1 2024-09-17T01:01:56.592 INFO:tasks.workunit.client.0.smithi002.stdout:2/435: chown d1b/d74/f88 1 1 2024-09-17T01:01:56.592 INFO:tasks.workunit.client.0.smithi002.stdout:2/436: truncate f16 880733 0 2024-09-17T01:01:56.593 INFO:tasks.workunit.client.0.smithi002.stdout:3/437: dwrite d0/f16 [0,4194304] 0 2024-09-17T01:01:56.593 INFO:tasks.workunit.client.0.smithi002.stdout:3/438: write d0/d3/f19 [1150958,42925] 0 2024-09-17T01:01:56.593 INFO:tasks.workunit.client.0.smithi002.stdout:2/437: getdents d1b/d8b 0 2024-09-17T01:01:56.593 INFO:tasks.workunit.client.0.smithi002.stdout:3/439: mknod d0/d3/d80/c91 0 2024-09-17T01:01:56.593 INFO:tasks.workunit.client.0.smithi002.stdout:3/440: mkdir d0/d31/d32/d92 0 2024-09-17T01:01:56.593 INFO:tasks.workunit.client.0.smithi002.stdout:3/441: mkdir d0/d3/d33/d93 0 2024-09-17T01:01:56.593 INFO:tasks.workunit.client.0.smithi002.stdout:2/438: dread d1b/d3f/d59/f63 [0,4194304] 0 2024-09-17T01:01:56.593 INFO:tasks.workunit.client.0.smithi002.stdout:6/409: rename d2/d1d/d2d/d73/d74 to d2/d1d/d26/d49/d7d 0 2024-09-17T01:01:56.593 INFO:tasks.workunit.client.0.smithi002.stdout:4/497: rename d7/de/f15 to d7/de/d3a/f97 0 2024-09-17T01:01:56.593 INFO:tasks.workunit.client.0.smithi002.stdout:6/410: mkdir d2/d1d/d2d/d5a/d71/d7e 0 2024-09-17T01:01:56.593 INFO:tasks.workunit.client.0.smithi002.stdout:6/411: fsync d2/d1d/d26/f7a 0 2024-09-17T01:01:56.594 INFO:tasks.workunit.client.0.smithi002.stdout:4/498: getdents d7/de/d3a 0 2024-09-17T01:01:56.594 INFO:tasks.workunit.client.0.smithi002.stdout:4/499: readlink d7/d19/d34/d80/d62/d52/l6d 0 2024-09-17T01:01:56.594 INFO:tasks.workunit.client.0.smithi002.stdout:1/421: sync 2024-09-17T01:01:56.594 INFO:tasks.workunit.client.0.smithi002.stdout:0/311: sync 2024-09-17T01:01:56.594 INFO:tasks.workunit.client.0.smithi002.stdout:8/478: sync 2024-09-17T01:01:56.594 INFO:tasks.workunit.client.0.smithi002.stdout:9/320: sync 2024-09-17T01:01:56.594 INFO:tasks.workunit.client.0.smithi002.stdout:5/384: sync 2024-09-17T01:01:56.594 INFO:tasks.workunit.client.0.smithi002.stdout:9/321: chown d5/dc/d26/c2a 56 1 2024-09-17T01:01:56.594 INFO:tasks.workunit.client.0.smithi002.stdout:7/318: sync 2024-09-17T01:01:56.594 INFO:tasks.workunit.client.0.smithi002.stdout:7/319: chown d1/l3a 398588 1 2024-09-17T01:01:56.594 INFO:tasks.workunit.client.0.smithi002.stdout:4/500: creat d7/d19/d34/d80/d62/f98 x:0 0 0 2024-09-17T01:01:56.594 INFO:tasks.workunit.client.0.smithi002.stdout:1/422: creat d4/d11/d12/d30/d43/d67/f98 x:0 0 0 2024-09-17T01:01:56.594 INFO:tasks.workunit.client.0.smithi002.stdout:8/479: symlink d2/d3/d5f/la4 0 2024-09-17T01:01:56.594 INFO:tasks.workunit.client.0.smithi002.stdout:8/480: dread - d2/f6b zero size 2024-09-17T01:01:56.595 INFO:tasks.workunit.client.0.smithi002.stdout:8/481: fsync d2/d1c/d3b/f4c 0 2024-09-17T01:01:56.595 INFO:tasks.workunit.client.0.smithi002.stdout:5/385: mkdir d2/d2d/d10/d14/d7d 0 2024-09-17T01:01:56.595 INFO:tasks.workunit.client.0.smithi002.stdout:5/386: chown d2/d2d/d10/l27 33265934 1 2024-09-17T01:01:56.595 INFO:tasks.workunit.client.0.smithi002.stdout:4/501: mkdir d7/de/d3a/d99 0 2024-09-17T01:01:56.595 INFO:tasks.workunit.client.0.smithi002.stdout:4/502: creat d7/d71/d90/f9a x:0 0 0 2024-09-17T01:01:56.595 INFO:tasks.workunit.client.0.smithi002.stdout:7/320: dread d1/d14/d1d/d28/d2d/f35 [0,4194304] 0 2024-09-17T01:01:56.595 INFO:tasks.workunit.client.0.smithi002.stdout:7/321: chown d1/f5 3511318 1 2024-09-17T01:01:56.595 INFO:tasks.workunit.client.0.smithi002.stdout:8/482: read d2/d26/f5c [382857,42384] 0 2024-09-17T01:01:56.595 INFO:tasks.workunit.client.0.smithi002.stdout:8/483: stat d2/d9/dd 0 2024-09-17T01:01:56.595 INFO:tasks.workunit.client.0.smithi002.stdout:3/442: dwrite d0/d3/f3c [0,4194304] 0 2024-09-17T01:01:56.595 INFO:tasks.workunit.client.0.smithi002.stdout:3/443: creat d0/d31/f94 x:0 0 0 2024-09-17T01:01:56.595 INFO:tasks.workunit.client.0.smithi002.stdout:8/484: dread d2/d9/dd/f8c [0,4194304] 0 2024-09-17T01:01:56.595 INFO:tasks.workunit.client.0.smithi002.stdout:7/322: unlink d1/d14/d1d/d28/f3d 0 2024-09-17T01:01:56.595 INFO:tasks.workunit.client.0.smithi002.stdout:3/444: rename d0/d31/d32/l30 to d0/l95 0 2024-09-17T01:01:56.596 INFO:tasks.workunit.client.0.smithi002.stdout:3/445: stat d0/f2f 0 2024-09-17T01:01:56.596 INFO:tasks.workunit.client.0.smithi002.stdout:7/323: creat d1/d14/d1d/d28/d2d/f68 x:0 0 0 2024-09-17T01:01:56.596 INFO:tasks.workunit.client.0.smithi002.stdout:3/446: mkdir d0/d3/d17/d87/d96 0 2024-09-17T01:01:56.596 INFO:tasks.workunit.client.0.smithi002.stdout:7/324: link d1/f5 d1/d14/d1d/d29/d30/f69 0 2024-09-17T01:01:56.596 INFO:tasks.workunit.client.0.smithi002.stdout:8/485: rename d2/d26/d2b to d2/d3/d5f/d98/da5 0 2024-09-17T01:01:56.596 INFO:tasks.workunit.client.0.smithi002.stdout:8/486: stat d2/d30 0 2024-09-17T01:01:56.596 INFO:tasks.workunit.client.0.smithi002.stdout:8/487: write d2/d1c/d3b/f4c [2150753,103371] 0 2024-09-17T01:01:56.596 INFO:tasks.workunit.client.0.smithi002.stdout:3/447: creat d0/f97 x:0 0 0 2024-09-17T01:01:56.596 INFO:tasks.workunit.client.0.smithi002.stdout:8/488: dread d2/d3/d5f/d98/da5/d4f/d77/d78/f87 [0,4194304] 0 2024-09-17T01:01:56.596 INFO:tasks.workunit.client.0.smithi002.stdout:3/448: creat d0/d31/d32/f98 x:0 0 0 2024-09-17T01:01:56.596 INFO:tasks.workunit.client.0.smithi002.stdout:3/449: chown d0/d3/d37/d5a 425 1 2024-09-17T01:01:56.596 INFO:tasks.workunit.client.0.smithi002.stdout:3/450: fsync d0/d3/f3c 0 2024-09-17T01:01:56.596 INFO:tasks.workunit.client.0.smithi002.stdout:3/451: dread - d0/f97 zero size 2024-09-17T01:01:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/325: rename d1/lf to d1/d14/d1d/d28/d40/d58/l6a 0 2024-09-17T01:01:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:3/452: truncate d0/d3/d37/d5a/f5c 9101839 0 2024-09-17T01:01:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:3/453: fsync d0/d3/d17/f3a 0 2024-09-17T01:01:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/326: mkdir d1/d14/d1d/d28/d6b 0 2024-09-17T01:01:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/327: fsync d1/d14/f15 0 2024-09-17T01:01:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/328: stat d1/d14/d1d/d21/l23 0 2024-09-17T01:01:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/329: chown d1/d14/d1d/d21/l3b 10143 1 2024-09-17T01:01:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:3/454: mkdir d0/d3/d33/d99 0 2024-09-17T01:01:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:8/489: read d2/d3/f11 [1280699,97036] 0 2024-09-17T01:01:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:8/490: write d2/f6b [792328,27544] 0 2024-09-17T01:01:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/330: write d1/f5 [601634,64793] 0 2024-09-17T01:01:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/331: rmdir d1/d14/d1d/d29/d30/d54 39 2024-09-17T01:01:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/332: creat d1/d14/f6c x:0 0 0 2024-09-17T01:01:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/333: read d1/f20 [2698654,6825] 0 2024-09-17T01:01:56.598 INFO:tasks.workunit.client.0.smithi002.stdout:6/412: dwrite d2/d1d/d2d/d35/d37/f41 [0,4194304] 0 2024-09-17T01:01:56.598 INFO:tasks.workunit.client.0.smithi002.stdout:6/413: dread - d2/d1d/d27/d30/f77 zero size 2024-09-17T01:01:56.598 INFO:tasks.workunit.client.0.smithi002.stdout:6/414: write d2/d1d/d27/d30/f77 [35615,84853] 0 2024-09-17T01:01:56.598 INFO:tasks.workunit.client.0.smithi002.stdout:6/415: readlink d2/dc/d24/l1f 0 2024-09-17T01:01:56.598 INFO:tasks.workunit.client.0.smithi002.stdout:6/416: symlink d2/d4b/l7f 0 2024-09-17T01:01:56.598 INFO:tasks.workunit.client.0.smithi002.stdout:6/417: unlink d2/d1d/d2d/d35/d37/f3a 0 2024-09-17T01:01:56.598 INFO:tasks.workunit.client.0.smithi002.stdout:6/418: mkdir d2/d1d/d27/d80 0 2024-09-17T01:01:56.598 INFO:tasks.workunit.client.0.smithi002.stdout:2/439: dwrite d1b/f26 [4194304,4194304] 0 2024-09-17T01:01:56.598 INFO:tasks.workunit.client.0.smithi002.stdout:2/440: rename d1b/d37/d48/f64 to d1b/d37/d48/d4e/fa0 0 2024-09-17T01:01:56.598 INFO:tasks.workunit.client.0.smithi002.stdout:2/441: creat d1b/d74/d93/fa1 x:0 0 0 2024-09-17T01:01:56.598 INFO:tasks.workunit.client.0.smithi002.stdout:8/491: dread d2/d3/d5f/d98/da5/f36 [0,4194304] 0 2024-09-17T01:01:56.599 INFO:tasks.workunit.client.0.smithi002.stdout:5/387: dwrite d2/d2d/d10/d3b/f5e [0,4194304] 0 2024-09-17T01:01:56.599 INFO:tasks.workunit.client.0.smithi002.stdout:4/503: dwrite d7/d71/d90/f50 [0,4194304] 0 2024-09-17T01:01:56.599 INFO:tasks.workunit.client.0.smithi002.stdout:0/312: dwrite dd/d19/f1b [0,4194304] 0 2024-09-17T01:01:56.599 INFO:tasks.workunit.client.0.smithi002.stdout:9/322: dwrite d5/dc/f3d [0,4194304] 0 2024-09-17T01:01:56.599 INFO:tasks.workunit.client.0.smithi002.stdout:9/323: fsync d5/f4f 0 2024-09-17T01:01:56.599 INFO:tasks.workunit.client.0.smithi002.stdout:5/388: unlink d2/d2d/d10/d20/l6c 0 2024-09-17T01:01:56.600 INFO:tasks.workunit.client.0.smithi002.stdout:8/492: dread d2/d3/d5f/f46 [0,4194304] 0 2024-09-17T01:01:56.600 INFO:tasks.workunit.client.0.smithi002.stdout:8/493: dread d2/d41/f54 [0,4194304] 0 2024-09-17T01:01:56.600 INFO:tasks.workunit.client.0.smithi002.stdout:6/419: dwrite d2/d1d/d2d/f2e [0,4194304] 0 2024-09-17T01:01:56.600 INFO:tasks.workunit.client.0.smithi002.stdout:6/420: chown d2/d1d/d26/d40/d43/c5b 1061 1 2024-09-17T01:01:56.600 INFO:tasks.workunit.client.0.smithi002.stdout:0/313: dread dd/d19/d1a/f1d [0,4194304] 0 2024-09-17T01:01:56.600 INFO:tasks.workunit.client.0.smithi002.stdout:6/421: mkdir d2/d1d/d26/d49/d51/d81 0 2024-09-17T01:01:56.601 INFO:tasks.workunit.client.0.smithi002.stdout:8/494: dread d2/f1d [0,4194304] 0 2024-09-17T01:01:56.601 INFO:tasks.workunit.client.0.smithi002.stdout:8/495: dread - d2/d3/d5f/d98/da5/d4f/d77/d78/f88 zero size 2024-09-17T01:01:56.601 INFO:tasks.workunit.client.0.smithi002.stdout:8/496: write d2/d3/f1b [1625499,118023] 0 2024-09-17T01:01:56.601 INFO:tasks.workunit.client.0.smithi002.stdout:3/455: getdents d0 0 2024-09-17T01:01:56.601 INFO:tasks.workunit.client.0.smithi002.stdout:2/442: dwrite d1b/d74/d93/fa1 [0,4194304] 0 2024-09-17T01:01:56.601 INFO:tasks.workunit.client.0.smithi002.stdout:5/389: getdents d2 0 2024-09-17T01:01:56.601 INFO:tasks.workunit.client.0.smithi002.stdout:5/390: chown d2/d2d/d10/d23/d6e/d60 3892610 1 2024-09-17T01:01:56.604 INFO:tasks.workunit.client.1.smithi099.stdout:9/460: dwrite da/d50/f5c [0,4194304] 0 2024-09-17T01:01:56.604 INFO:tasks.workunit.client.1.smithi099.stdout:4/421: dwrite d7/dd/d21/d7b/d4b/f34 [0,4194304] 0 2024-09-17T01:01:56.604 INFO:tasks.workunit.client.1.smithi099.stdout:5/471: dwrite d2/dc/d17/f53 [0,4194304] 0 2024-09-17T01:01:56.604 INFO:tasks.workunit.client.1.smithi099.stdout:3/477: dwrite d9/d15/d18/f82 [0,4194304] 0 2024-09-17T01:01:56.605 INFO:tasks.workunit.client.1.smithi099.stdout:3/478: fdatasync d9/d15/d7d/f8a 0 2024-09-17T01:01:56.605 INFO:tasks.workunit.client.1.smithi099.stdout:2/351: sync 2024-09-17T01:01:56.605 INFO:tasks.workunit.client.1.smithi099.stdout:3/479: mknod d9/d2b/d52/d5e/c8e 0 2024-09-17T01:01:56.605 INFO:tasks.workunit.client.1.smithi099.stdout:3/480: mkdir d9/d15/d8f 0 2024-09-17T01:01:56.606 INFO:tasks.workunit.client.0.smithi002.stdout:7/334: fdatasync d1/f5 0 2024-09-17T01:01:56.606 INFO:tasks.workunit.client.0.smithi002.stdout:7/335: chown d1/d14/d1d/d29/d57/c65 36 1 2024-09-17T01:01:56.606 INFO:tasks.workunit.client.0.smithi002.stdout:7/336: write d1/f26 [604196,12284] 0 2024-09-17T01:01:56.606 INFO:tasks.workunit.client.0.smithi002.stdout:1/423: dwrite d4/d11/f5c [0,4194304] 0 2024-09-17T01:01:56.607 INFO:tasks.workunit.client.0.smithi002.stdout:1/424: creat d4/d11/d12/d23/f99 x:0 0 0 2024-09-17T01:01:56.607 INFO:tasks.workunit.client.0.smithi002.stdout:4/504: rename d7/d71/d90 to d7/de/d32/d8a/d77/d9b 0 2024-09-17T01:01:56.607 INFO:tasks.workunit.client.0.smithi002.stdout:4/505: write d7/de/f27 [1186820,13679] 0 2024-09-17T01:01:56.607 INFO:tasks.workunit.client.0.smithi002.stdout:8/497: link d2/d3/d5f/d98/da5/d4f/d77/d78/f87 d2/d3/d5f/fa6 0 2024-09-17T01:01:56.607 INFO:tasks.workunit.client.0.smithi002.stdout:8/498: fsync d2/f6b 0 2024-09-17T01:01:56.607 INFO:tasks.workunit.client.0.smithi002.stdout:8/499: truncate d2/d26/f61 5140337 0 2024-09-17T01:01:56.607 INFO:tasks.workunit.client.0.smithi002.stdout:3/456: unlink d0/le 0 2024-09-17T01:01:56.608 INFO:tasks.workunit.client.0.smithi002.stdout:5/391: truncate d2/d2d/d10/d20/d24/f2e 2836665 0 2024-09-17T01:01:56.608 INFO:tasks.workunit.client.0.smithi002.stdout:5/392: write d2/d2d/d10/d14/d19/d39/d64/f70 [67745,87159] 0 2024-09-17T01:01:56.608 INFO:tasks.workunit.client.0.smithi002.stdout:5/393: chown d2/d2d/d10/d14/d19/d39/d25/d32 10 1 2024-09-17T01:01:56.608 INFO:tasks.workunit.client.0.smithi002.stdout:7/337: creat d1/d14/d1d/d28/d40/f6d x:0 0 0 2024-09-17T01:01:56.608 INFO:tasks.workunit.client.1.smithi099.stdout:2/352: dread d2/d9/d17/f21 [0,4194304] 0 2024-09-17T01:01:56.609 INFO:tasks.workunit.client.1.smithi099.stdout:2/353: chown d2/d9 383 1 2024-09-17T01:01:56.609 INFO:tasks.workunit.client.1.smithi099.stdout:3/481: creat d9/d15/d18/d1a/d23/d4c/f90 x:0 0 0 2024-09-17T01:01:56.609 INFO:tasks.workunit.client.1.smithi099.stdout:9/461: dread da/d21/f3b [0,4194304] 0 2024-09-17T01:01:56.609 INFO:tasks.workunit.client.1.smithi099.stdout:8/457: sync 2024-09-17T01:01:56.610 INFO:tasks.workunit.client.1.smithi099.stdout:7/438: sync 2024-09-17T01:01:56.611 INFO:tasks.workunit.client.1.smithi099.stdout:5/472: write d2/dc/d14/d19/f6d [174453,93165] 0 2024-09-17T01:01:56.611 INFO:tasks.workunit.client.1.smithi099.stdout:5/473: write d2/d26/d64/f68 [896318,28906] 0 2024-09-17T01:01:56.611 INFO:tasks.workunit.client.1.smithi099.stdout:5/474: truncate d2/d26/f2a 5148638 0 2024-09-17T01:01:56.611 INFO:tasks.workunit.client.1.smithi099.stdout:5/475: chown d2/d8/c55 458592 1 2024-09-17T01:01:56.614 INFO:tasks.workunit.client.1.smithi099.stdout:3/482: rename d9/f12 to d9/d2b/f91 0 2024-09-17T01:01:56.617 INFO:tasks.workunit.client.1.smithi099.stdout:7/439: mknod d1/d2c/d5c/d1c/d5a/d76/c88 0 2024-09-17T01:01:56.617 INFO:tasks.workunit.client.1.smithi099.stdout:4/422: dwrite d7/dd/d21/d26/f60 [0,4194304] 0 2024-09-17T01:01:56.617 INFO:tasks.workunit.client.1.smithi099.stdout:4/423: read d7/dd/d21/f38 [2699391,7001] 0 2024-09-17T01:01:56.617 INFO:tasks.workunit.client.1.smithi099.stdout:4/424: write d7/dd/d21/d26/d3f/d5b/f2d [511894,106526] 0 2024-09-17T01:01:56.617 INFO:tasks.workunit.client.0.smithi002.stdout:9/324: rename d5/dc/d55 to d5/dc/d26/d34/d57 0 2024-09-17T01:01:56.618 INFO:tasks.workunit.client.1.smithi099.stdout:3/483: mknod d9/d2b/d52/d5e/c92 0 2024-09-17T01:01:56.620 INFO:tasks.workunit.client.1.smithi099.stdout:5/476: rename d2/d8/f15 to d2/dc/f93 0 2024-09-17T01:01:56.620 INFO:tasks.workunit.client.1.smithi099.stdout:5/477: dread - d2/d45/f7d zero size 2024-09-17T01:01:56.621 INFO:tasks.workunit.client.0.smithi002.stdout:4/506: mkdir d7/d19/d9c 0 2024-09-17T01:01:56.621 INFO:tasks.workunit.client.0.smithi002.stdout:4/507: truncate d7/f82 372570 0 2024-09-17T01:01:56.621 INFO:tasks.workunit.client.1.smithi099.stdout:2/354: dread d2/d9/f60 [0,4194304] 0 2024-09-17T01:01:56.621 INFO:tasks.workunit.client.1.smithi099.stdout:7/440: rmdir d1/d37 39 2024-09-17T01:01:56.624 INFO:tasks.workunit.client.1.smithi099.stdout:2/355: mknod d2/d9/d25/d26/d1b/c70 0 2024-09-17T01:01:56.624 INFO:tasks.workunit.client.1.smithi099.stdout:2/356: chown d2/d9/d25/d26/f6b 97519 1 2024-09-17T01:01:56.628 INFO:tasks.workunit.client.1.smithi099.stdout:2/357: link d2/d9/f1f d2/d9/d17/d58/f71 0 2024-09-17T01:01:56.629 INFO:tasks.workunit.client.0.smithi002.stdout:7/338: unlink d1/le 0 2024-09-17T01:01:56.631 INFO:tasks.workunit.client.0.smithi002.stdout:1/425: getdents d4/d11/d12/d23/d32/d86 0 2024-09-17T01:01:56.632 INFO:tasks.workunit.client.0.smithi002.stdout:1/426: chown d4/d11/d12/d23/l58 215272 1 2024-09-17T01:01:56.632 INFO:tasks.workunit.client.0.smithi002.stdout:1/427: readlink d4/d11/d12/d14/d17/d40/l76 0 2024-09-17T01:01:56.632 INFO:tasks.workunit.client.1.smithi099.stdout:4/425: write d7/dd/d21/d26/d3f/d5b/f2c [737088,99273] 0 2024-09-17T01:01:56.633 INFO:tasks.workunit.client.0.smithi002.stdout:8/500: dwrite d2/d1c/d3b/f4c [0,4194304] 0 2024-09-17T01:01:56.634 INFO:tasks.workunit.client.1.smithi099.stdout:4/426: mknod d7/c8d 0 2024-09-17T01:01:56.637 INFO:tasks.workunit.client.1.smithi099.stdout:4/427: creat d7/dd/d21/f8e x:0 0 0 2024-09-17T01:01:56.637 INFO:tasks.workunit.client.1.smithi099.stdout:4/428: creat d7/dd/d21/d26/d3f/f8f x:0 0 0 2024-09-17T01:01:56.639 INFO:tasks.workunit.client.1.smithi099.stdout:8/458: dwrite d0/d53/f83 [0,4194304] 0 2024-09-17T01:01:56.639 INFO:tasks.workunit.client.1.smithi099.stdout:8/459: chown d0/d1f/d31/l60 353321 1 2024-09-17T01:01:56.639 INFO:tasks.workunit.client.1.smithi099.stdout:8/460: fsync d0/d41/d5a/f94 0 2024-09-17T01:01:56.639 INFO:tasks.workunit.client.1.smithi099.stdout:4/429: mknod d7/dd/de/d10/d6b/d82/d8a/c90 0 2024-09-17T01:01:56.641 INFO:tasks.workunit.client.1.smithi099.stdout:8/461: mkdir d0/d1f/d55/d95 0 2024-09-17T01:01:56.642 INFO:tasks.workunit.client.0.smithi002.stdout:9/325: creat d5/dc/d26/d46/f58 x:0 0 0 2024-09-17T01:01:56.642 INFO:tasks.workunit.client.0.smithi002.stdout:9/326: dread - d5/dc/d26/d34/f56 zero size 2024-09-17T01:01:56.643 INFO:tasks.workunit.client.1.smithi099.stdout:8/462: rename d0/d1f/d31/d4c/f6f to d0/d4/d29/d4b/f96 0 2024-09-17T01:01:56.644 INFO:tasks.workunit.client.1.smithi099.stdout:8/463: symlink d0/d1f/d55/l97 0 2024-09-17T01:01:56.646 INFO:tasks.workunit.client.1.smithi099.stdout:8/464: creat d0/d1f/d90/f98 x:0 0 0 2024-09-17T01:01:56.647 INFO:tasks.workunit.client.1.smithi099.stdout:8/465: creat d0/d1f/d55/d95/f99 x:0 0 0 2024-09-17T01:01:56.649 INFO:tasks.workunit.client.0.smithi002.stdout:7/339: truncate d1/d14/f15 4005055 0 2024-09-17T01:01:56.649 INFO:tasks.workunit.client.0.smithi002.stdout:7/340: fsync d1/d14/d1d/d21/f61 0 2024-09-17T01:01:56.654 INFO:tasks.workunit.client.0.smithi002.stdout:4/508: rmdir d7/d19/d34/d54 39 2024-09-17T01:01:56.654 INFO:tasks.workunit.client.0.smithi002.stdout:4/509: fdatasync d7/de/f2a 0 2024-09-17T01:01:56.654 INFO:tasks.workunit.client.1.smithi099.stdout:4/430: dread d7/dd/d21/d7b/d4b/f39 [0,4194304] 0 2024-09-17T01:01:56.655 INFO:tasks.workunit.client.1.smithi099.stdout:4/431: write d7/dd/de/d10/d6b/f8b [39412,49968] 0 2024-09-17T01:01:56.655 INFO:tasks.workunit.client.1.smithi099.stdout:4/432: truncate d7/dd/d21/d26/d3f/d5b/f2d 845383 0 2024-09-17T01:01:56.656 INFO:tasks.workunit.client.1.smithi099.stdout:4/433: unlink d7/dd/de/d10/d6b/f73 0 2024-09-17T01:01:56.656 INFO:tasks.workunit.client.1.smithi099.stdout:4/434: write d7/dd/d21/d7b/d74/f75 [309628,2270] 0 2024-09-17T01:01:56.656 INFO:tasks.workunit.client.1.smithi099.stdout:4/435: creat d7/dd/de/d17/f91 x:0 0 0 2024-09-17T01:01:56.656 INFO:tasks.workunit.client.1.smithi099.stdout:5/478: dwrite d2/f18 [4194304,4194304] 0 2024-09-17T01:01:56.656 INFO:tasks.workunit.client.0.smithi002.stdout:7/341: unlink d1/d14/d1d/d28/d40/f6d 0 2024-09-17T01:01:56.657 INFO:tasks.workunit.client.0.smithi002.stdout:0/314: rename dd/d19/d1c/d1f/d22/d43 to dd/d19/d1c/d33/d67 0 2024-09-17T01:01:56.658 INFO:tasks.workunit.client.1.smithi099.stdout:5/479: rename d2/d8/fb to d2/dc/d14/f94 0 2024-09-17T01:01:56.659 INFO:tasks.workunit.client.0.smithi002.stdout:2/443: write f16 [823938,118698] 0 2024-09-17T01:01:56.662 INFO:tasks.workunit.client.1.smithi099.stdout:7/441: dwrite d1/d2c/d5c/d1c/d72/f86 [0,4194304] 0 2024-09-17T01:01:56.662 INFO:tasks.workunit.client.0.smithi002.stdout:5/394: rename d2/d2d/f53 to d2/d2d/d10/d20/f7e 0 2024-09-17T01:01:56.664 INFO:tasks.workunit.client.1.smithi099.stdout:7/442: mknod d1/d2c/d47/d48/c89 0 2024-09-17T01:01:56.665 INFO:tasks.workunit.client.1.smithi099.stdout:7/443: mknod d1/d2c/d5c/d3f/c8a 0 2024-09-17T01:01:56.667 INFO:tasks.workunit.client.0.smithi002.stdout:1/428: rename d4/d11/d12/d14/d17/d3b/f6e to d4/d11/d55/d7a/f9a 0 2024-09-17T01:01:56.667 INFO:tasks.workunit.client.0.smithi002.stdout:3/457: dwrite d0/d3/d37/d5a/f7c [0,4194304] 0 2024-09-17T01:01:56.668 INFO:tasks.workunit.client.1.smithi099.stdout:7/444: unlink d1/d2c/d5c/d1c/d5a/f82 0 2024-09-17T01:01:56.668 INFO:tasks.workunit.client.1.smithi099.stdout:3/484: dwrite d9/d3b/d44/f48 [4194304,4194304] 0 2024-09-17T01:01:56.668 INFO:tasks.workunit.client.1.smithi099.stdout:7/445: truncate d1/d2c/d5c/d12/f4b 4609502 0 2024-09-17T01:01:56.668 INFO:tasks.workunit.client.1.smithi099.stdout:3/485: write d9/f83 [262968,52056] 0 2024-09-17T01:01:56.668 INFO:tasks.workunit.client.1.smithi099.stdout:3/486: write d9/f8c [829746,39671] 0 2024-09-17T01:01:56.668 INFO:tasks.workunit.client.1.smithi099.stdout:3/487: fsync d9/d15/f40 0 2024-09-17T01:01:56.669 INFO:tasks.workunit.client.0.smithi002.stdout:1/429: dread d4/ff [0,4194304] 0 2024-09-17T01:01:56.669 INFO:tasks.workunit.client.0.smithi002.stdout:1/430: getdents d4/d11/d1a/d95 0 2024-09-17T01:01:56.669 INFO:tasks.workunit.client.0.smithi002.stdout:8/501: dwrite d2/d41/f7d [4194304,4194304] 0 2024-09-17T01:01:56.670 INFO:tasks.workunit.client.1.smithi099.stdout:2/358: dwrite d2/d7/f40 [4194304,4194304] 0 2024-09-17T01:01:56.671 INFO:tasks.workunit.client.1.smithi099.stdout:7/446: unlink d1/d2c/d5c/c80 0 2024-09-17T01:01:56.671 INFO:tasks.workunit.client.1.smithi099.stdout:9/462: dwrite da/d56/d84/f85 [0,4194304] 0 2024-09-17T01:01:56.672 INFO:tasks.workunit.client.1.smithi099.stdout:9/463: fsync da/d50/f5c 0 2024-09-17T01:01:56.672 INFO:tasks.workunit.client.1.smithi099.stdout:3/488: mkdir d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93 0 2024-09-17T01:01:56.674 INFO:tasks.workunit.client.0.smithi002.stdout:3/458: truncate d0/d31/d32/f42 1857276 0 2024-09-17T01:01:56.675 INFO:tasks.workunit.client.1.smithi099.stdout:2/359: rmdir d2/d9/d25/d26/d1b 39 2024-09-17T01:01:56.675 INFO:tasks.workunit.client.0.smithi002.stdout:4/510: write d7/de/d3a/f97 [2321623,96807] 0 2024-09-17T01:01:56.677 INFO:tasks.workunit.client.0.smithi002.stdout:8/502: symlink d2/d3/d5f/d98/da5/d4f/la7 0 2024-09-17T01:01:56.678 INFO:tasks.workunit.client.1.smithi099.stdout:9/464: symlink da/d56/d84/l9f 0 2024-09-17T01:01:56.680 INFO:tasks.workunit.client.1.smithi099.stdout:3/489: getdents d9/d15/d18 0 2024-09-17T01:01:56.682 INFO:tasks.workunit.client.1.smithi099.stdout:8/466: rmdir d0/d4/d29 39 2024-09-17T01:01:56.682 INFO:tasks.workunit.client.1.smithi099.stdout:7/447: read d1/d2c/d7a/f7c [3887549,96106] 0 2024-09-17T01:01:56.683 INFO:tasks.workunit.client.1.smithi099.stdout:8/467: chown d0/d1f/f20 49859163 1 2024-09-17T01:01:56.683 INFO:tasks.workunit.client.1.smithi099.stdout:8/468: creat d0/d41/f9a x:0 0 0 2024-09-17T01:01:56.686 INFO:tasks.workunit.client.0.smithi002.stdout:9/327: rename d5/l1a to d5/dc/l59 0 2024-09-17T01:01:56.687 INFO:tasks.workunit.client.1.smithi099.stdout:8/469: rename d0/d53/f59 to d0/d41/f9b 0 2024-09-17T01:01:56.687 INFO:tasks.workunit.client.1.smithi099.stdout:8/470: dread - d0/d4/d29/d4b/f96 zero size 2024-09-17T01:01:56.687 INFO:tasks.workunit.client.1.smithi099.stdout:8/471: dread - d0/d4/d29/d4b/f96 zero size 2024-09-17T01:01:56.687 INFO:tasks.workunit.client.1.smithi099.stdout:8/472: chown d0/f74 20096 1 2024-09-17T01:01:56.687 INFO:tasks.workunit.client.1.smithi099.stdout:2/360: dread d2/d9/f1f [0,4194304] 0 2024-09-17T01:01:56.689 INFO:tasks.workunit.client.1.smithi099.stdout:8/473: mkdir d0/d4/d29/d9c 0 2024-09-17T01:01:56.693 INFO:tasks.workunit.client.0.smithi002.stdout:8/503: creat d2/d3/d5f/d98/da5/d71/d89/fa8 x:0 0 0 2024-09-17T01:01:56.693 INFO:tasks.workunit.client.0.smithi002.stdout:7/342: dwrite d1/f27 [0,4194304] 0 2024-09-17T01:01:56.694 INFO:tasks.workunit.client.1.smithi099.stdout:3/490: dread d9/d15/f50 [0,4194304] 0 2024-09-17T01:01:56.694 INFO:tasks.workunit.client.1.smithi099.stdout:9/465: write da/d50/f5c [727335,27156] 0 2024-09-17T01:01:56.694 INFO:tasks.workunit.client.1.smithi099.stdout:5/480: dwrite d2/dc/d17/d3c/f8f [0,4194304] 0 2024-09-17T01:01:56.694 INFO:tasks.workunit.client.1.smithi099.stdout:5/481: chown d2/d8/f7a 194603089 1 2024-09-17T01:01:56.695 INFO:tasks.workunit.client.0.smithi002.stdout:2/444: dwrite d1b/d37/f9c [0,4194304] 0 2024-09-17T01:01:56.695 INFO:tasks.workunit.client.1.smithi099.stdout:2/361: unlink d2/c13 0 2024-09-17T01:01:56.696 INFO:tasks.workunit.client.1.smithi099.stdout:2/362: chown d2/d9/d25/d26/d1b/d2c/f48 7545924 1 2024-09-17T01:01:56.696 INFO:tasks.workunit.client.0.smithi002.stdout:4/511: dread d7/de/d32/f73 [0,4194304] 0 2024-09-17T01:01:56.697 INFO:tasks.workunit.client.0.smithi002.stdout:8/504: creat d2/d3/d5f/d98/da5/d4f/d77/d78/fa9 x:0 0 0 2024-09-17T01:01:56.698 INFO:tasks.workunit.client.1.smithi099.stdout:4/436: truncate d7/dd/d21/d26/d3f/d5b/f2d 275920 0 2024-09-17T01:01:56.698 INFO:tasks.workunit.client.0.smithi002.stdout:7/343: creat d1/d14/d1d/d28/f6e x:0 0 0 2024-09-17T01:01:56.702 INFO:tasks.workunit.client.1.smithi099.stdout:9/466: rename da/d9a/d3a/f23 to da/d9b/fa0 0 2024-09-17T01:01:56.704 INFO:tasks.workunit.client.0.smithi002.stdout:9/328: dread d5/fb [0,4194304] 0 2024-09-17T01:01:56.704 INFO:tasks.workunit.client.0.smithi002.stdout:9/329: creat d5/dc/d26/d34/f5a x:0 0 0 2024-09-17T01:01:56.705 INFO:tasks.workunit.client.1.smithi099.stdout:5/482: mknod d2/dc/d17/d3c/d72/c95 0 2024-09-17T01:01:56.707 INFO:tasks.workunit.client.1.smithi099.stdout:4/437: mkdir d7/dd/d92 0 2024-09-17T01:01:56.707 INFO:tasks.workunit.client.1.smithi099.stdout:8/474: dread d0/f61 [0,4194304] 0 2024-09-17T01:01:56.707 INFO:tasks.workunit.client.1.smithi099.stdout:8/475: read - d0/d41/d5a/f94 zero size 2024-09-17T01:01:56.707 INFO:tasks.workunit.client.0.smithi002.stdout:4/512: mkdir d7/d19/d34/d9d 0 2024-09-17T01:01:56.708 INFO:tasks.workunit.client.1.smithi099.stdout:9/467: truncate da/d21/f3b 181652 0 2024-09-17T01:01:56.708 INFO:tasks.workunit.client.1.smithi099.stdout:5/483: symlink d2/d26/l96 0 2024-09-17T01:01:56.709 INFO:tasks.workunit.client.0.smithi002.stdout:7/344: unlink d1/d14/d1d/d29/d30/d54/f5c 0 2024-09-17T01:01:56.709 INFO:tasks.workunit.client.1.smithi099.stdout:7/448: dwrite d1/d2c/d5c/d12/f7f [0,4194304] 0 2024-09-17T01:01:56.710 INFO:tasks.workunit.client.1.smithi099.stdout:7/449: chown d1/d37/f51 26403 1 2024-09-17T01:01:56.710 INFO:tasks.workunit.client.1.smithi099.stdout:7/450: write d1/ff [118111,92373] 0 2024-09-17T01:01:56.710 INFO:tasks.workunit.client.0.smithi002.stdout:3/459: rename d0/d3/d37/d5a to d0/d3/d17/d9a 0 2024-09-17T01:01:56.713 INFO:tasks.workunit.client.1.smithi099.stdout:8/476: rename d0/d1f/f2c to d0/d41/f9d 0 2024-09-17T01:01:56.713 INFO:tasks.workunit.client.1.smithi099.stdout:9/468: truncate da/d9a/d3a/f26 1173440 0 2024-09-17T01:01:56.713 INFO:tasks.workunit.client.1.smithi099.stdout:9/469: fsync da/f64 0 2024-09-17T01:01:56.713 INFO:tasks.workunit.client.0.smithi002.stdout:2/445: getdents d1b/d37 0 2024-09-17T01:01:56.715 INFO:tasks.workunit.client.0.smithi002.stdout:4/513: mknod d7/d19/d34/d80/c9e 0 2024-09-17T01:01:56.715 INFO:tasks.workunit.client.0.smithi002.stdout:4/514: fsync d7/d19/d34/d80/d62/f31 0 2024-09-17T01:01:56.716 INFO:tasks.workunit.client.0.smithi002.stdout:7/345: mknod d1/d14/d1d/d21/c6f 0 2024-09-17T01:01:56.716 INFO:tasks.workunit.client.0.smithi002.stdout:7/346: readlink d1/d14/d1d/d21/d45/l4d 0 2024-09-17T01:01:56.716 INFO:tasks.workunit.client.0.smithi002.stdout:7/347: creat d1/d14/d1d/d28/d2d/f70 x:0 0 0 2024-09-17T01:01:56.717 INFO:tasks.workunit.client.0.smithi002.stdout:7/348: write d1/f27 [5612151,50936] 0 2024-09-17T01:01:56.718 INFO:tasks.workunit.client.1.smithi099.stdout:5/484: mkdir d2/dc/d97 0 2024-09-17T01:01:56.718 INFO:tasks.workunit.client.1.smithi099.stdout:5/485: chown d2/dc/d14/d19/l76 7415473 1 2024-09-17T01:01:56.718 INFO:tasks.workunit.client.1.smithi099.stdout:2/363: dwrite d2/d9/d25/d26/f5b [0,4194304] 0 2024-09-17T01:01:56.718 INFO:tasks.workunit.client.1.smithi099.stdout:2/364: write d2/d9/f1f [4503047,18678] 0 2024-09-17T01:01:56.718 INFO:tasks.workunit.client.1.smithi099.stdout:9/470: truncate da/d21/d2a/f36 7718663 0 2024-09-17T01:01:56.720 INFO:tasks.workunit.client.1.smithi099.stdout:2/365: rename d2/d9/d17/c57 to d2/d9/d25/d26/d1b/d61/c72 0 2024-09-17T01:01:56.720 INFO:tasks.workunit.client.1.smithi099.stdout:2/366: write d2/d9/d17/f69 [426742,107671] 0 2024-09-17T01:01:56.720 INFO:tasks.workunit.client.1.smithi099.stdout:4/438: write d7/dd/d21/d26/f56 [784736,105831] 0 2024-09-17T01:01:56.720 INFO:tasks.workunit.client.1.smithi099.stdout:5/486: dread d2/dc/d14/d36/f7e [0,4194304] 0 2024-09-17T01:01:56.721 INFO:tasks.workunit.client.1.smithi099.stdout:9/471: truncate da/ff 1004942 0 2024-09-17T01:01:56.722 INFO:tasks.workunit.client.0.smithi002.stdout:9/330: write d5/f44 [58655,47872] 0 2024-09-17T01:01:56.722 INFO:tasks.workunit.client.0.smithi002.stdout:9/331: creat d5/dc/d26/d46/f5b x:0 0 0 2024-09-17T01:01:56.722 INFO:tasks.workunit.client.1.smithi099.stdout:3/491: dwrite d9/d3b/f62 [0,4194304] 0 2024-09-17T01:01:56.722 INFO:tasks.workunit.client.1.smithi099.stdout:2/367: symlink d2/l73 0 2024-09-17T01:01:56.724 INFO:tasks.workunit.client.1.smithi099.stdout:4/439: unlink d7/dd/d21/d7b/d74/c8c 0 2024-09-17T01:01:56.724 INFO:tasks.workunit.client.1.smithi099.stdout:5/487: mknod d2/dc/d14/d19/d8e/c98 0 2024-09-17T01:01:56.725 INFO:tasks.workunit.client.1.smithi099.stdout:9/472: creat da/d9b/fa1 x:0 0 0 2024-09-17T01:01:56.730 INFO:tasks.workunit.client.1.smithi099.stdout:3/492: mkdir d9/d15/d18/d1a/d23/d5c/d6e/d94 0 2024-09-17T01:01:56.731 INFO:tasks.workunit.client.1.smithi099.stdout:4/440: link d7/l46 d7/dd/de/d10/d6b/l93 0 2024-09-17T01:01:56.731 INFO:tasks.workunit.client.1.smithi099.stdout:4/441: stat d7/dd/d21/d26/c33 0 2024-09-17T01:01:56.731 INFO:tasks.workunit.client.1.smithi099.stdout:4/442: creat d7/dd/d21/d26/d3f/f94 x:0 0 0 2024-09-17T01:01:56.731 INFO:tasks.workunit.client.1.smithi099.stdout:4/443: creat d7/dd/de/d10/d6b/f95 x:0 0 0 2024-09-17T01:01:56.731 INFO:tasks.workunit.client.1.smithi099.stdout:4/444: readlink d7/dd/d21/d26/l48 0 2024-09-17T01:01:56.732 INFO:tasks.workunit.client.1.smithi099.stdout:9/473: creat da/d14/d48/d69/d6c/fa2 x:0 0 0 2024-09-17T01:01:56.732 INFO:tasks.workunit.client.1.smithi099.stdout:9/474: write da/d56/d84/f9c [2640526,79384] 0 2024-09-17T01:01:56.732 INFO:tasks.workunit.client.1.smithi099.stdout:9/475: write da/d14/d6d/f8a [995713,81973] 0 2024-09-17T01:01:56.733 INFO:tasks.workunit.client.1.smithi099.stdout:3/493: truncate d9/d15/d18/f2a 1980576 0 2024-09-17T01:01:56.735 INFO:tasks.workunit.client.1.smithi099.stdout:4/445: mknod d7/dd/d21/d26/d3f/d5b/c96 0 2024-09-17T01:01:56.735 INFO:tasks.workunit.client.1.smithi099.stdout:4/446: fsync d7/dd/de/d10/f86 0 2024-09-17T01:01:56.736 INFO:tasks.workunit.client.1.smithi099.stdout:3/494: mknod d9/d15/d18/d1a/d23/d4c/c95 0 2024-09-17T01:01:56.736 INFO:tasks.workunit.client.1.smithi099.stdout:3/495: truncate d9/d15/d18/d1a/d23/d4c/f90 214461 0 2024-09-17T01:01:56.736 INFO:tasks.workunit.client.1.smithi099.stdout:3/496: fsync d9/d15/d18/f2f 0 2024-09-17T01:01:56.737 INFO:tasks.workunit.client.1.smithi099.stdout:3/497: creat d9/d15/d18/d1a/d23/d5c/d6e/f96 x:0 0 0 2024-09-17T01:01:56.738 INFO:tasks.workunit.client.1.smithi099.stdout:4/447: write d7/dd/de/d10/f86 [91817,84138] 0 2024-09-17T01:01:56.749 INFO:tasks.workunit.client.1.smithi099.stdout:3/498: dread d9/d15/d18/d1a/d23/f2c [0,4194304] 0 2024-09-17T01:01:56.749 INFO:tasks.workunit.client.1.smithi099.stdout:3/499: chown d9/d15/d7d 2495024 1 2024-09-17T01:01:56.750 INFO:tasks.workunit.client.1.smithi099.stdout:3/500: mkdir d9/d15/d8f/d97 0 2024-09-17T01:01:56.751 INFO:tasks.workunit.client.1.smithi099.stdout:3/501: mknod d9/d3b/d44/d57/c98 0 2024-09-17T01:01:56.752 INFO:tasks.workunit.client.1.smithi099.stdout:3/502: mkdir d9/d15/d18/d1a/d23/d5c/d99 0 2024-09-17T01:01:56.754 INFO:tasks.workunit.client.1.smithi099.stdout:3/503: unlink d9/d3b/d44/c78 0 2024-09-17T01:01:56.758 INFO:tasks.workunit.client.1.smithi099.stdout:3/504: dread d9/d15/d18/f20 [0,4194304] 0 2024-09-17T01:01:56.758 INFO:tasks.workunit.client.1.smithi099.stdout:3/505: creat d9/f9a x:0 0 0 2024-09-17T01:01:56.759 INFO:tasks.workunit.client.1.smithi099.stdout:3/506: rename d9/d15/d38/f51 to d9/d15/d18/d1a/d23/d5c/d6e/d94/f9b 0 2024-09-17T01:01:56.766 INFO:tasks.workunit.client.1.smithi099.stdout:7/451: dwrite d1/d2c/f40 [0,4194304] 0 2024-09-17T01:01:56.768 INFO:tasks.workunit.client.1.smithi099.stdout:2/368: dwrite d2/d9/d25/d26/d1b/d2c/f48 [0,4194304] 0 2024-09-17T01:01:56.768 INFO:tasks.workunit.client.1.smithi099.stdout:7/452: mknod d1/d2c/d5c/c8b 0 2024-09-17T01:01:56.768 INFO:tasks.workunit.client.1.smithi099.stdout:7/453: fsync d1/d2c/d5c/fe 0 2024-09-17T01:01:56.768 INFO:tasks.workunit.client.0.smithi002.stdout:8/505: dwrite d2/d9/dd/f15 [0,4194304] 0 2024-09-17T01:01:56.769 INFO:tasks.workunit.client.1.smithi099.stdout:8/477: dwrite d0/d4/d29/d4b/f5c [0,4194304] 0 2024-09-17T01:01:56.770 INFO:tasks.workunit.client.1.smithi099.stdout:4/448: dwrite d7/fb [12582912,4194304] 0 2024-09-17T01:01:56.770 INFO:tasks.workunit.client.1.smithi099.stdout:5/488: dwrite d2/dc/d14/d19/f4b [0,4194304] 0 2024-09-17T01:01:56.775 INFO:tasks.workunit.client.1.smithi099.stdout:8/478: link d0/d1f/l28 d0/d4/d64/l9e 0 2024-09-17T01:01:56.775 INFO:tasks.workunit.client.1.smithi099.stdout:8/479: truncate d0/d4/d64/f93 416122 0 2024-09-17T01:01:56.777 INFO:tasks.workunit.client.1.smithi099.stdout:7/454: rename d1/l23 to d1/d2c/d5c/d1c/l8c 0 2024-09-17T01:01:56.777 INFO:tasks.workunit.client.1.smithi099.stdout:7/455: write d1/f10 [968528,121424] 0 2024-09-17T01:01:56.783 INFO:tasks.workunit.client.1.smithi099.stdout:2/369: dread d2/d9/d25/f2d [0,4194304] 0 2024-09-17T01:01:56.789 INFO:tasks.workunit.client.0.smithi002.stdout:3/460: symlink d0/d3/d8d/l9b 0 2024-09-17T01:01:56.792 INFO:tasks.workunit.client.0.smithi002.stdout:2/446: creat d1b/d37/d48/d52/fa2 x:0 0 0 2024-09-17T01:01:56.792 INFO:tasks.workunit.client.0.smithi002.stdout:2/447: creat d1b/d74/d93/fa3 x:0 0 0 2024-09-17T01:01:56.793 INFO:tasks.workunit.client.0.smithi002.stdout:2/448: chown d1b/d37/f62 40209 1 2024-09-17T01:01:56.793 INFO:tasks.workunit.client.0.smithi002.stdout:2/449: creat d1b/d74/d93/fa4 x:0 0 0 2024-09-17T01:01:56.793 INFO:tasks.workunit.client.0.smithi002.stdout:4/515: unlink d7/d19/d34/d80/d62/f98 0 2024-09-17T01:01:56.795 INFO:tasks.workunit.client.0.smithi002.stdout:9/332: getdents d5/dc/d26 0 2024-09-17T01:01:56.795 INFO:tasks.workunit.client.0.smithi002.stdout:9/333: write d5/f4f [398297,119367] 0 2024-09-17T01:01:56.797 INFO:tasks.workunit.client.0.smithi002.stdout:9/334: dread d5/dc/d26/d34/f42 [0,4194304] 0 2024-09-17T01:01:56.799 INFO:tasks.workunit.client.0.smithi002.stdout:8/506: link d2/d3/cc d2/d1c/d28/caa 0 2024-09-17T01:01:56.799 INFO:tasks.workunit.client.0.smithi002.stdout:8/507: read d2/d26/f5c [550855,91170] 0 2024-09-17T01:01:56.800 INFO:tasks.workunit.client.0.smithi002.stdout:3/461: creat d0/d3/d8d/f9c x:0 0 0 2024-09-17T01:01:56.802 INFO:tasks.workunit.client.0.smithi002.stdout:2/450: creat d1b/d37/fa5 x:0 0 0 2024-09-17T01:01:56.802 INFO:tasks.workunit.client.1.smithi099.stdout:8/480: getdents d0 0 2024-09-17T01:01:56.802 INFO:tasks.workunit.client.1.smithi099.stdout:8/481: chown d0/d4/lc 3022 1 2024-09-17T01:01:56.803 INFO:tasks.workunit.client.0.smithi002.stdout:4/516: unlink d7/de/d3a/f7a 0 2024-09-17T01:01:56.803 INFO:tasks.workunit.client.0.smithi002.stdout:7/349: getdents d1/d14 0 2024-09-17T01:01:56.804 INFO:tasks.workunit.client.1.smithi099.stdout:4/449: dwrite d7/dd/de/f4f [0,4194304] 0 2024-09-17T01:01:56.804 INFO:tasks.workunit.client.1.smithi099.stdout:4/450: creat d7/dd/de/d17/f97 x:0 0 0 2024-09-17T01:01:56.804 INFO:tasks.workunit.client.1.smithi099.stdout:9/476: dwrite da/d14/d40/d6f/f70 [0,4194304] 0 2024-09-17T01:01:56.805 INFO:tasks.workunit.client.1.smithi099.stdout:9/477: dread - da/d18/d49/f63 zero size 2024-09-17T01:01:56.806 INFO:tasks.workunit.client.0.smithi002.stdout:8/508: mkdir d2/d3/d5f/d98/dab 0 2024-09-17T01:01:56.806 INFO:tasks.workunit.client.0.smithi002.stdout:3/462: mkdir d0/d31/d8b/d9d 0 2024-09-17T01:01:56.806 INFO:tasks.workunit.client.1.smithi099.stdout:5/489: dwrite d2/dc/f66 [0,4194304] 0 2024-09-17T01:01:56.806 INFO:tasks.workunit.client.1.smithi099.stdout:5/490: write d2/d26/f4e [955200,55221] 0 2024-09-17T01:01:56.806 INFO:tasks.workunit.client.1.smithi099.stdout:7/456: unlink d1/d2c/l85 0 2024-09-17T01:01:56.806 INFO:tasks.workunit.client.1.smithi099.stdout:7/457: write d1/f35 [1210255,94716] 0 2024-09-17T01:01:56.807 INFO:tasks.workunit.client.0.smithi002.stdout:2/451: truncate d1b/f3a 1519284 0 2024-09-17T01:01:56.807 INFO:tasks.workunit.client.0.smithi002.stdout:7/350: mknod d1/d14/d1d/d21/c71 0 2024-09-17T01:01:56.808 INFO:tasks.workunit.client.1.smithi099.stdout:2/370: creat d2/d9/d25/d26/d1b/f74 x:0 0 0 2024-09-17T01:01:56.808 INFO:tasks.workunit.client.1.smithi099.stdout:2/371: readlink d2/d9/d25/d26/d1b/l3b 0 2024-09-17T01:01:56.809 INFO:tasks.workunit.client.1.smithi099.stdout:8/482: symlink d0/d41/d5a/l9f 0 2024-09-17T01:01:56.809 INFO:tasks.workunit.client.1.smithi099.stdout:8/483: chown d0/d4/c2d 1 1 2024-09-17T01:01:56.809 INFO:tasks.workunit.client.1.smithi099.stdout:8/484: fdatasync d0/f18 0 2024-09-17T01:01:56.809 INFO:tasks.workunit.client.1.smithi099.stdout:8/485: fsync d0/d41/f9a 0 2024-09-17T01:01:56.809 INFO:tasks.workunit.client.1.smithi099.stdout:8/486: chown d0/d1f/d31/d4c/f76 115 1 2024-09-17T01:01:56.810 INFO:tasks.workunit.client.0.smithi002.stdout:4/517: read d7/de/d32/d8a/d77/d9b/f50 [3560373,101562] 0 2024-09-17T01:01:56.811 INFO:tasks.workunit.client.0.smithi002.stdout:8/509: mknod d2/d1c/d28/da0/cac 0 2024-09-17T01:01:56.812 INFO:tasks.workunit.client.0.smithi002.stdout:2/452: creat d1b/d1d/d38/fa6 x:0 0 0 2024-09-17T01:01:56.812 INFO:tasks.workunit.client.1.smithi099.stdout:4/451: mkdir d7/d35/d98 0 2024-09-17T01:01:56.813 INFO:tasks.workunit.client.0.smithi002.stdout:7/351: rmdir d1/d14/d1d 39 2024-09-17T01:01:56.813 INFO:tasks.workunit.client.0.smithi002.stdout:7/352: chown d1/d14/d1d/d29/d30/d54/f66 59 1 2024-09-17T01:01:56.814 INFO:tasks.workunit.client.0.smithi002.stdout:2/453: rename f16 to d1b/d8a/d92/fa7 0 2024-09-17T01:01:56.816 INFO:tasks.workunit.client.0.smithi002.stdout:7/353: rename d1/d14/d1d/d29/d4b/f4e to d1/d14/d1d/d28/d6b/f72 0 2024-09-17T01:01:56.817 INFO:tasks.workunit.client.0.smithi002.stdout:2/454: creat d1b/d8b/fa8 x:0 0 0 2024-09-17T01:01:56.817 INFO:tasks.workunit.client.1.smithi099.stdout:9/478: rename c8 to da/d14/ca3 0 2024-09-17T01:01:56.819 INFO:tasks.workunit.client.0.smithi002.stdout:7/354: rmdir d1/d14/d1d/d29/d57 39 2024-09-17T01:01:56.819 INFO:tasks.workunit.client.0.smithi002.stdout:7/355: stat d1/d14/d1d/d29/d57/c65 0 2024-09-17T01:01:56.820 INFO:tasks.workunit.client.1.smithi099.stdout:5/491: dread d2/dc/d14/d19/f54 [0,4194304] 0 2024-09-17T01:01:56.821 INFO:tasks.workunit.client.1.smithi099.stdout:5/492: fsync d2/dc/d14/f20 0 2024-09-17T01:01:56.821 INFO:tasks.workunit.client.0.smithi002.stdout:2/455: link d1b/d37/d48/d78/f8e d1b/d74/d93/fa9 0 2024-09-17T01:01:56.821 INFO:tasks.workunit.client.0.smithi002.stdout:7/356: creat d1/d14/d1d/d29/d30/d54/f73 x:0 0 0 2024-09-17T01:01:56.823 INFO:tasks.workunit.client.1.smithi099.stdout:7/458: mkdir d1/d36/d8d 0 2024-09-17T01:01:56.823 INFO:tasks.workunit.client.1.smithi099.stdout:7/459: read - d1/d2c/d5c/d12/f29 zero size 2024-09-17T01:01:56.823 INFO:tasks.workunit.client.0.smithi002.stdout:9/335: getdents d5/dc/d26/d46 0 2024-09-17T01:01:56.824 INFO:tasks.workunit.client.1.smithi099.stdout:2/372: dread d2/d9/d25/d26/f33 [0,4194304] 0 2024-09-17T01:01:56.824 INFO:tasks.workunit.client.1.smithi099.stdout:4/452: symlink d7/dd/de/d17/l99 0 2024-09-17T01:01:56.825 INFO:tasks.workunit.client.0.smithi002.stdout:7/357: symlink d1/d14/d1d/d28/d6b/l74 0 2024-09-17T01:01:56.825 INFO:tasks.workunit.client.0.smithi002.stdout:7/358: fdatasync d1/d14/d1d/d28/f4f 0 2024-09-17T01:01:56.825 INFO:tasks.workunit.client.0.smithi002.stdout:7/359: chown d1/d14/d1d/d28/f4f 27449 1 2024-09-17T01:01:56.825 INFO:tasks.workunit.client.0.smithi002.stdout:7/360: chown d1/d14/d1d/d28/d2d/f68 2948806 1 2024-09-17T01:01:56.826 INFO:tasks.workunit.client.0.smithi002.stdout:9/336: write d5/f14 [1100962,69383] 0 2024-09-17T01:01:56.826 INFO:tasks.workunit.client.1.smithi099.stdout:9/479: mknod da/d8e/d96/ca4 0 2024-09-17T01:01:56.826 INFO:tasks.workunit.client.1.smithi099.stdout:9/480: write da/d9b/fa1 [354705,52789] 0 2024-09-17T01:01:56.827 INFO:tasks.workunit.client.1.smithi099.stdout:5/493: mkdir d2/dc/d17/d3c/d60/d99 0 2024-09-17T01:01:56.827 INFO:tasks.workunit.client.0.smithi002.stdout:7/361: creat d1/d14/d67/f75 x:0 0 0 2024-09-17T01:01:56.828 INFO:tasks.workunit.client.1.smithi099.stdout:7/460: creat d1/d2c/d5c/d1c/d5a/d6f/f8e x:0 0 0 2024-09-17T01:01:56.830 INFO:tasks.workunit.client.0.smithi002.stdout:7/362: dread d1/f27 [4194304,4194304] 0 2024-09-17T01:01:56.830 INFO:tasks.workunit.client.0.smithi002.stdout:7/363: truncate d1/d14/d1d/d29/d30/d54/f66 991269 0 2024-09-17T01:01:56.831 INFO:tasks.workunit.client.1.smithi099.stdout:2/373: creat d2/d9/d25/f75 x:0 0 0 2024-09-17T01:01:56.831 INFO:tasks.workunit.client.0.smithi002.stdout:7/364: creat d1/d14/d1d/d21/f76 x:0 0 0 2024-09-17T01:01:56.831 INFO:tasks.workunit.client.0.smithi002.stdout:7/365: readlink d1/d14/d1d/d28/d40/d58/l5a 0 2024-09-17T01:01:56.832 INFO:tasks.workunit.client.1.smithi099.stdout:4/453: mkdir d7/dd/de/d10/d6b/d82/d8a/d9a 0 2024-09-17T01:01:56.832 INFO:tasks.workunit.client.0.smithi002.stdout:8/510: dread d2/d3/d5f/d98/da5/d4f/f94 [0,4194304] 0 2024-09-17T01:01:56.833 INFO:tasks.workunit.client.1.smithi099.stdout:9/481: mkdir da/d56/da5 0 2024-09-17T01:01:56.834 INFO:tasks.workunit.client.1.smithi099.stdout:9/482: truncate da/d56/f6e 494504 0 2024-09-17T01:01:56.834 INFO:tasks.workunit.client.0.smithi002.stdout:8/511: mkdir d2/d1c/d28/dad 0 2024-09-17T01:01:56.834 INFO:tasks.workunit.client.0.smithi002.stdout:8/512: fsync d2/d3/d5f/d98/da5/d4f/d77/d78/f87 0 2024-09-17T01:01:56.834 INFO:tasks.workunit.client.0.smithi002.stdout:8/513: fdatasync d2/d3/d5f/d47/f62 0 2024-09-17T01:01:56.834 INFO:tasks.workunit.client.0.smithi002.stdout:8/514: fsync d2/d1c/d28/f55 0 2024-09-17T01:01:56.835 INFO:tasks.workunit.client.0.smithi002.stdout:8/515: write d2/d3/d5f/d47/f62 [142263,41537] 0 2024-09-17T01:01:56.835 INFO:tasks.workunit.client.0.smithi002.stdout:8/516: creat d2/d30/fae x:0 0 0 2024-09-17T01:01:56.835 INFO:tasks.workunit.client.0.smithi002.stdout:8/517: stat d2/d1c/d28 0 2024-09-17T01:01:56.836 INFO:tasks.workunit.client.1.smithi099.stdout:5/494: mkdir d2/dc/d14/d36/d9a 0 2024-09-17T01:01:56.836 INFO:tasks.workunit.client.1.smithi099.stdout:5/495: chown d2/f5 2260 1 2024-09-17T01:01:56.837 INFO:tasks.workunit.client.1.smithi099.stdout:8/487: dwrite d0/d1f/f62 [0,4194304] 0 2024-09-17T01:01:56.837 INFO:tasks.workunit.client.1.smithi099.stdout:8/488: read d0/f18 [7735682,21262] 0 2024-09-17T01:01:56.837 INFO:tasks.workunit.client.1.smithi099.stdout:8/489: creat d0/d41/d5a/fa0 x:0 0 0 2024-09-17T01:01:56.837 INFO:tasks.workunit.client.1.smithi099.stdout:7/461: mkdir d1/d8f 0 2024-09-17T01:01:56.838 INFO:tasks.workunit.client.1.smithi099.stdout:8/490: dread d0/d1f/d31/f43 [0,4194304] 0 2024-09-17T01:01:56.838 INFO:tasks.workunit.client.1.smithi099.stdout:8/491: chown d0/c2a 3029376 1 2024-09-17T01:01:56.838 INFO:tasks.workunit.client.1.smithi099.stdout:8/492: chown d0/d41/d5a/l92 96 1 2024-09-17T01:01:56.838 INFO:tasks.workunit.client.1.smithi099.stdout:8/493: fsync d0/d4/d29/d4b/f96 0 2024-09-17T01:01:56.839 INFO:tasks.workunit.client.0.smithi002.stdout:4/518: dwrite d7/d19/f78 [0,4194304] 0 2024-09-17T01:01:56.839 INFO:tasks.workunit.client.1.smithi099.stdout:7/462: dread d1/f19 [0,4194304] 0 2024-09-17T01:01:56.840 INFO:tasks.workunit.client.1.smithi099.stdout:2/374: rename d2/d9/d25/d26/d1b/d2c/f6c to d2/d9/d17/f76 0 2024-09-17T01:01:56.841 INFO:tasks.workunit.client.1.smithi099.stdout:4/454: mkdir d7/dd/de/d10/d6b/d82/d8a/d9b 0 2024-09-17T01:01:56.844 INFO:tasks.workunit.client.1.smithi099.stdout:5/496: link d2/dc/d6c/c82 d2/dc/d97/c9b 0 2024-09-17T01:01:56.847 INFO:tasks.workunit.client.1.smithi099.stdout:6/475: sync 2024-09-17T01:01:56.847 INFO:tasks.workunit.client.1.smithi099.stdout:1/520: sync 2024-09-17T01:01:56.848 INFO:tasks.workunit.client.1.smithi099.stdout:0/443: sync 2024-09-17T01:01:56.848 INFO:tasks.workunit.client.1.smithi099.stdout:0/444: stat da/df/c46 0 2024-09-17T01:01:56.848 INFO:tasks.workunit.client.1.smithi099.stdout:6/476: write dc/d1a/f1e [243310,111314] 0 2024-09-17T01:01:56.848 INFO:tasks.workunit.client.0.smithi002.stdout:4/519: rename d7/d19/d34 to d7/d19/d9f 0 2024-09-17T01:01:56.850 INFO:tasks.workunit.client.0.smithi002.stdout:8/518: dread d2/d26/f40 [0,4194304] 0 2024-09-17T01:01:56.850 INFO:tasks.workunit.client.0.smithi002.stdout:8/519: readlink d2/d3/d5f/d98/da5/d4f/l75 0 2024-09-17T01:01:56.850 INFO:tasks.workunit.client.0.smithi002.stdout:9/337: dwrite d5/f29 [0,4194304] 0 2024-09-17T01:01:56.850 INFO:tasks.workunit.client.0.smithi002.stdout:9/338: getdents d5/dc/d26 0 2024-09-17T01:01:56.851 INFO:tasks.workunit.client.1.smithi099.stdout:0/445: dread da/df/d31/f39 [0,4194304] 0 2024-09-17T01:01:56.851 INFO:tasks.workunit.client.0.smithi002.stdout:2/456: rename d1b/d1d/d38 to d1b/d37/d48/d78/daa 0 2024-09-17T01:01:56.851 INFO:tasks.workunit.client.1.smithi099.stdout:4/455: rename d7/dd/de/d10/c6a to d7/dd/de/d17/c9c 0 2024-09-17T01:01:56.852 INFO:tasks.workunit.client.0.smithi002.stdout:8/520: truncate d2/d26/f5c 8273874 0 2024-09-17T01:01:56.852 INFO:tasks.workunit.client.0.smithi002.stdout:8/521: truncate d2/d9/dd/f8c 1180007 0 2024-09-17T01:01:56.852 INFO:tasks.workunit.client.0.smithi002.stdout:8/522: write d2/d9/dd/f15 [4903404,73002] 0 2024-09-17T01:01:56.853 INFO:tasks.workunit.client.0.smithi002.stdout:8/523: write d2/d3/d5f/d98/da5/f7b [127301,42074] 0 2024-09-17T01:01:56.853 INFO:tasks.workunit.client.1.smithi099.stdout:9/483: dwrite da/d14/d6d/f8a [0,4194304] 0 2024-09-17T01:01:56.853 INFO:tasks.workunit.client.1.smithi099.stdout:9/484: write da/d14/d48/d69/f79 [600949,94413] 0 2024-09-17T01:01:56.854 INFO:tasks.workunit.client.0.smithi002.stdout:7/366: rmdir d1/d14/d1d/d29/d30/d54 39 2024-09-17T01:01:56.855 INFO:tasks.workunit.client.1.smithi099.stdout:5/497: rmdir d2/dc/d6c 39 2024-09-17T01:01:56.856 INFO:tasks.workunit.client.1.smithi099.stdout:8/494: getdents d0/d1f/d55/d95 0 2024-09-17T01:01:56.857 INFO:tasks.workunit.client.1.smithi099.stdout:7/463: getdents d1/d2c/d5c 0 2024-09-17T01:01:56.859 INFO:tasks.workunit.client.1.smithi099.stdout:1/521: creat d0/d8c/d9e/fb8 x:0 0 0 2024-09-17T01:01:56.859 INFO:tasks.workunit.client.0.smithi002.stdout:8/524: mknod d2/d3/d5f/d98/da5/d4f/caf 0 2024-09-17T01:01:56.861 INFO:tasks.workunit.client.0.smithi002.stdout:7/367: truncate d1/f27 4360020 0 2024-09-17T01:01:56.863 INFO:tasks.workunit.client.0.smithi002.stdout:8/525: mkdir d2/d3/d5f/d98/da5/d4f/d77/db0 0 2024-09-17T01:01:56.863 INFO:tasks.workunit.client.1.smithi099.stdout:0/446: unlink da/df/f41 0 2024-09-17T01:01:56.865 INFO:tasks.workunit.client.0.smithi002.stdout:7/368: mknod d1/d14/d1d/d29/d57/c77 0 2024-09-17T01:01:56.865 INFO:tasks.workunit.client.0.smithi002.stdout:4/520: write d7/f14 [1703187,95637] 0 2024-09-17T01:01:56.868 INFO:tasks.workunit.client.1.smithi099.stdout:4/456: creat d7/dd/f9d x:0 0 0 2024-09-17T01:01:56.868 INFO:tasks.workunit.client.0.smithi002.stdout:7/369: mknod d1/c78 0 2024-09-17T01:01:56.868 INFO:tasks.workunit.client.0.smithi002.stdout:7/370: write d1/f5 [1220804,17768] 0 2024-09-17T01:01:56.870 INFO:tasks.workunit.client.0.smithi002.stdout:8/526: getdents d2/d26 0 2024-09-17T01:01:56.874 INFO:tasks.workunit.client.1.smithi099.stdout:5/498: truncate d2/d26/f27 70027 0 2024-09-17T01:01:56.874 INFO:tasks.workunit.client.1.smithi099.stdout:5/499: write d2/f3 [4271412,32675] 0 2024-09-17T01:01:56.874 INFO:tasks.workunit.client.1.smithi099.stdout:5/500: getdents d2/dc/d14/d36/d9a 0 2024-09-17T01:01:56.875 INFO:tasks.workunit.client.0.smithi002.stdout:7/371: unlink d1/d14/d1d/d29/d30/f55 0 2024-09-17T01:01:56.875 INFO:tasks.workunit.client.0.smithi002.stdout:7/372: creat d1/d14/d1d/d28/f79 x:0 0 0 2024-09-17T01:01:56.875 INFO:tasks.workunit.client.1.smithi099.stdout:8/495: symlink d0/la1 0 2024-09-17T01:01:56.878 INFO:tasks.workunit.client.0.smithi002.stdout:7/373: symlink d1/d14/d67/l7a 0 2024-09-17T01:01:56.878 INFO:tasks.workunit.client.0.smithi002.stdout:7/374: truncate d1/d14/d1d/d21/f61 288067 0 2024-09-17T01:01:56.878 INFO:tasks.workunit.client.0.smithi002.stdout:7/375: stat d1/d14/d1d/d28/d2d/f35 0 2024-09-17T01:01:56.881 INFO:tasks.workunit.client.0.smithi002.stdout:7/376: dread d1/d14/d1d/d28/f4f [0,4194304] 0 2024-09-17T01:01:56.882 INFO:tasks.workunit.client.1.smithi099.stdout:1/522: truncate d0/f64 88104 0 2024-09-17T01:01:56.884 INFO:tasks.workunit.client.1.smithi099.stdout:0/447: mknod da/d12/d22/d52/c91 0 2024-09-17T01:01:56.884 INFO:tasks.workunit.client.1.smithi099.stdout:7/464: dwrite d1/d2c/d5c/f13 [4194304,4194304] 0 2024-09-17T01:01:56.886 INFO:tasks.workunit.client.1.smithi099.stdout:4/457: link d7/dd/d21/d7b/f43 d7/dd/d92/f9e 0 2024-09-17T01:01:56.887 INFO:tasks.workunit.client.1.smithi099.stdout:4/458: write d7/dd/f28 [98933,101614] 0 2024-09-17T01:01:56.889 INFO:tasks.workunit.client.1.smithi099.stdout:5/501: mkdir d2/dc/d14/d19/d9c 0 2024-09-17T01:01:56.889 INFO:tasks.workunit.client.1.smithi099.stdout:5/502: stat d2/d8/f29 0 2024-09-17T01:01:56.889 INFO:tasks.workunit.client.1.smithi099.stdout:8/496: mknod d0/d1f/d55/ca2 0 2024-09-17T01:01:56.889 INFO:tasks.workunit.client.1.smithi099.stdout:8/497: creat d0/d41/d5a/fa3 x:0 0 0 2024-09-17T01:01:56.893 INFO:tasks.workunit.client.1.smithi099.stdout:1/523: mkdir d0/d8/d49/d94/d4b/d59/db9 0 2024-09-17T01:01:56.893 INFO:tasks.workunit.client.1.smithi099.stdout:6/477: rename dc/d2b/d3f to dc/d2b/d53/d96 0 2024-09-17T01:01:56.895 INFO:tasks.workunit.client.1.smithi099.stdout:1/524: mkdir d0/d2/d5/dba 0 2024-09-17T01:01:56.895 INFO:tasks.workunit.client.1.smithi099.stdout:1/525: write d0/f13 [1471557,38879] 0 2024-09-17T01:01:56.895 INFO:tasks.workunit.client.1.smithi099.stdout:1/526: stat d0/d2/c78 0 2024-09-17T01:01:56.897 INFO:tasks.workunit.client.0.smithi002.stdout:6/422: sync 2024-09-17T01:01:56.898 INFO:tasks.workunit.client.1.smithi099.stdout:1/527: link d0/d2/de/d31/c39 d0/d2/cbb 0 2024-09-17T01:01:56.899 INFO:tasks.workunit.client.1.smithi099.stdout:1/528: mkdir d0/dbc 0 2024-09-17T01:01:56.900 INFO:tasks.workunit.client.1.smithi099.stdout:1/529: truncate d0/d8c/faa 906081 0 2024-09-17T01:01:56.904 INFO:tasks.workunit.client.1.smithi099.stdout:6/478: dread dc/d5d/d66/f67 [0,4194304] 0 2024-09-17T01:01:56.905 INFO:tasks.workunit.client.1.smithi099.stdout:9/485: dwrite da/d18/d49/f63 [0,4194304] 0 2024-09-17T01:01:56.905 INFO:tasks.workunit.client.1.smithi099.stdout:9/486: write da/d21/d2a/f7f [113493,109820] 0 2024-09-17T01:01:56.905 INFO:tasks.workunit.client.1.smithi099.stdout:9/487: truncate f6 2985257 0 2024-09-17T01:01:56.906 INFO:tasks.workunit.client.0.smithi002.stdout:6/423: write d2/f16 [4083492,92558] 0 2024-09-17T01:01:56.906 INFO:tasks.workunit.client.0.smithi002.stdout:9/339: dwrite d5/f10 [4194304,4194304] 0 2024-09-17T01:01:56.906 INFO:tasks.workunit.client.0.smithi002.stdout:9/340: read - d5/dc/d26/d46/f5b zero size 2024-09-17T01:01:56.907 INFO:tasks.workunit.client.0.smithi002.stdout:9/341: chown d5/dc/l59 1 1 2024-09-17T01:01:56.907 INFO:tasks.workunit.client.0.smithi002.stdout:4/521: dwrite d7/de/d32/d8a/d77/d9b/f9a [0,4194304] 0 2024-09-17T01:01:56.907 INFO:tasks.workunit.client.1.smithi099.stdout:8/498: dread d0/d1f/f68 [0,4194304] 0 2024-09-17T01:01:56.909 INFO:tasks.workunit.client.0.smithi002.stdout:6/424: mknod d2/d1d/d27/c82 0 2024-09-17T01:01:56.909 INFO:tasks.workunit.client.0.smithi002.stdout:7/377: dwrite d1/d14/d1d/d21/f61 [0,4194304] 0 2024-09-17T01:01:56.909 INFO:tasks.workunit.client.0.smithi002.stdout:7/378: chown d1/d14/d1d/d28/f4f 3075806 1 2024-09-17T01:01:56.910 INFO:tasks.workunit.client.0.smithi002.stdout:4/522: creat d7/d3f/fa0 x:0 0 0 2024-09-17T01:01:56.910 INFO:tasks.workunit.client.0.smithi002.stdout:8/527: dwrite d2/d3/d5f/d98/da5/f65 [0,4194304] 0 2024-09-17T01:01:56.913 INFO:tasks.workunit.client.0.smithi002.stdout:8/528: creat d2/d9/dd/fb1 x:0 0 0 2024-09-17T01:01:56.914 INFO:tasks.workunit.client.1.smithi099.stdout:1/530: dread d0/d2/f88 [0,4194304] 0 2024-09-17T01:01:56.915 INFO:tasks.workunit.client.1.smithi099.stdout:5/503: dwrite d2/dc/d14/d19/f75 [0,4194304] 0 2024-09-17T01:01:56.915 INFO:tasks.workunit.client.1.smithi099.stdout:5/504: getdents d2/dc/d17/d3c/d60/d99 0 2024-09-17T01:01:56.916 INFO:tasks.workunit.client.0.smithi002.stdout:7/379: rmdir d1/d14/d1d/d28/d40/d58 39 2024-09-17T01:01:56.917 INFO:tasks.workunit.client.0.smithi002.stdout:7/380: creat d1/d14/d1d/d28/d40/f7b x:0 0 0 2024-09-17T01:01:56.918 INFO:tasks.workunit.client.0.smithi002.stdout:8/529: mknod d2/d9/dd/cb2 0 2024-09-17T01:01:56.922 INFO:tasks.workunit.client.0.smithi002.stdout:6/425: write d2/d1d/d2d/d35/d37/f41 [1603114,30434] 0 2024-09-17T01:01:56.922 INFO:tasks.workunit.client.0.smithi002.stdout:6/426: dread - d2/f6c zero size 2024-09-17T01:01:56.922 INFO:tasks.workunit.client.0.smithi002.stdout:6/427: truncate d2/d1d/d27/d30/f36 4457926 0 2024-09-17T01:01:56.924 INFO:tasks.workunit.client.1.smithi099.stdout:5/505: readlink d2/dc/l11 0 2024-09-17T01:01:56.927 INFO:tasks.workunit.client.0.smithi002.stdout:8/530: dread d2/d9/f38 [0,4194304] 0 2024-09-17T01:01:56.928 INFO:tasks.workunit.client.1.smithi099.stdout:5/506: symlink d2/d8/l9d 0 2024-09-17T01:01:56.929 INFO:tasks.workunit.client.0.smithi002.stdout:8/531: rmdir d2/d3/d5f/d98/da5/d71/d89 39 2024-09-17T01:01:56.929 INFO:tasks.workunit.client.0.smithi002.stdout:8/532: write d2/d3/d5f/f8f [2700614,8087] 0 2024-09-17T01:01:56.930 INFO:tasks.workunit.client.0.smithi002.stdout:8/533: creat d2/d3/d5f/fb3 x:0 0 0 2024-09-17T01:01:56.931 INFO:tasks.workunit.client.0.smithi002.stdout:8/534: mknod d2/d3/d5f/d98/da5/d4f/d58/cb4 0 2024-09-17T01:01:56.932 INFO:tasks.workunit.client.0.smithi002.stdout:7/381: read d1/d14/d1d/d21/d45/f43 [1945233,76918] 0 2024-09-17T01:01:56.932 INFO:tasks.workunit.client.0.smithi002.stdout:8/535: symlink d2/d1c/lb5 0 2024-09-17T01:01:56.933 INFO:tasks.workunit.client.1.smithi099.stdout:5/507: rename d2/dc/d17/d3c/d60/l8a to d2/dc/d14/d19/d8e/l9e 0 2024-09-17T01:01:56.933 INFO:tasks.workunit.client.1.smithi099.stdout:5/508: write d2/d8/f7a [23896,10455] 0 2024-09-17T01:01:56.934 INFO:tasks.workunit.client.1.smithi099.stdout:7/465: truncate d1/d2c/d5c/f13 5338917 0 2024-09-17T01:01:56.934 INFO:tasks.workunit.client.0.smithi002.stdout:8/536: unlink d2/d3/d5f/d98/da5/d4f/d58/f6a 0 2024-09-17T01:01:56.935 INFO:tasks.workunit.client.1.smithi099.stdout:7/466: creat d1/d2c/d5c/d1c/d5a/d76/f90 x:0 0 0 2024-09-17T01:01:56.935 INFO:tasks.workunit.client.1.smithi099.stdout:7/467: readlink d1/d37/l3d 0 2024-09-17T01:01:56.935 INFO:tasks.workunit.client.0.smithi002.stdout:8/537: symlink d2/d3/d5f/d47/d80/lb6 0 2024-09-17T01:01:56.936 INFO:tasks.workunit.client.1.smithi099.stdout:7/468: creat d1/d2c/d47/d48/d60/f91 x:0 0 0 2024-09-17T01:01:56.944 INFO:tasks.workunit.client.0.smithi002.stdout:8/538: write d2/d3/d5f/d98/da5/f36 [4179947,1568] 0 2024-09-17T01:01:56.945 INFO:tasks.workunit.client.0.smithi002.stdout:7/382: dread d1/f11 [0,4194304] 0 2024-09-17T01:01:56.945 INFO:tasks.workunit.client.0.smithi002.stdout:7/383: stat d1/d14/d1d/l22 0 2024-09-17T01:01:56.945 INFO:tasks.workunit.client.0.smithi002.stdout:7/384: write d1/d14/d1d/d21/f63 [425680,97001] 0 2024-09-17T01:01:56.945 INFO:tasks.workunit.client.0.smithi002.stdout:7/385: fdatasync d1/d14/f6c 0 2024-09-17T01:01:56.946 INFO:tasks.workunit.client.0.smithi002.stdout:7/386: read - d1/d14/d1d/d28/d40/f5f zero size 2024-09-17T01:01:56.946 INFO:tasks.workunit.client.0.smithi002.stdout:7/387: fsync d1/d24/f31 0 2024-09-17T01:01:56.946 INFO:tasks.workunit.client.0.smithi002.stdout:7/388: write d1/d14/d1d/d28/d40/f7b [100277,3466] 0 2024-09-17T01:01:56.946 INFO:tasks.workunit.client.1.smithi099.stdout:5/509: dread d2/dc/d14/d19/f4b [0,4194304] 0 2024-09-17T01:01:56.947 INFO:tasks.workunit.client.0.smithi002.stdout:6/428: dwrite d2/d1d/d2d/f4f [0,4194304] 0 2024-09-17T01:01:56.947 INFO:tasks.workunit.client.0.smithi002.stdout:8/539: creat d2/d3/d5f/d98/fb7 x:0 0 0 2024-09-17T01:01:56.948 INFO:tasks.workunit.client.0.smithi002.stdout:7/389: rename d1/d14/d1d/d29/d30/d54/l60 to d1/d14/d1d/d29/d30/d5e/l7c 0 2024-09-17T01:01:56.949 INFO:tasks.workunit.client.0.smithi002.stdout:4/523: dwrite d7/d19/f21 [4194304,4194304] 0 2024-09-17T01:01:56.949 INFO:tasks.workunit.client.0.smithi002.stdout:9/342: dwrite d5/dc/d26/d34/f5a [0,4194304] 0 2024-09-17T01:01:56.949 INFO:tasks.workunit.client.0.smithi002.stdout:4/524: chown d7/f18 13423 1 2024-09-17T01:01:56.952 INFO:tasks.workunit.client.1.smithi099.stdout:7/469: dread d1/d36/f62 [0,4194304] 0 2024-09-17T01:01:56.952 INFO:tasks.workunit.client.0.smithi002.stdout:6/429: mkdir d2/dc/d24/d53/d83 0 2024-09-17T01:01:56.953 INFO:tasks.workunit.client.0.smithi002.stdout:4/525: dread d7/d19/d2e/f39 [0,4194304] 0 2024-09-17T01:01:56.954 INFO:tasks.workunit.client.1.smithi099.stdout:7/470: creat d1/d2c/d5c/d3f/f92 x:0 0 0 2024-09-17T01:01:56.954 INFO:tasks.workunit.client.1.smithi099.stdout:7/471: readlink d1/d2c/d5c/d12/l4c 0 2024-09-17T01:01:56.956 INFO:tasks.workunit.client.1.smithi099.stdout:5/510: write d2/dc/d14/d36/f7e [1413396,112994] 0 2024-09-17T01:01:56.957 INFO:tasks.workunit.client.1.smithi099.stdout:8/499: dwrite d0/d4/d64/f93 [0,4194304] 0 2024-09-17T01:01:56.957 INFO:tasks.workunit.client.1.smithi099.stdout:5/511: fsync d2/f32 0 2024-09-17T01:01:56.957 INFO:tasks.workunit.client.0.smithi002.stdout:6/430: mknod d2/d1d/d2d/d73/c84 0 2024-09-17T01:01:56.957 INFO:tasks.workunit.client.0.smithi002.stdout:4/526: symlink d7/d3f/la1 0 2024-09-17T01:01:56.957 INFO:tasks.workunit.client.1.smithi099.stdout:7/472: creat d1/d37/d78/f93 x:0 0 0 2024-09-17T01:01:56.959 INFO:tasks.workunit.client.0.smithi002.stdout:6/431: link d2/d1d/d27/d30/f78 d2/d1d/d2d/d5a/d71/d7e/f85 0 2024-09-17T01:01:56.960 INFO:tasks.workunit.client.0.smithi002.stdout:6/432: write f1 [8478805,31000] 0 2024-09-17T01:01:56.960 INFO:tasks.workunit.client.0.smithi002.stdout:6/433: write d2/d1d/d27/d30/f78 [4656121,7874] 0 2024-09-17T01:01:56.963 INFO:tasks.workunit.client.1.smithi099.stdout:7/473: rename d1/d37/l4d to d1/d8f/l94 0 2024-09-17T01:01:56.964 INFO:tasks.workunit.client.0.smithi002.stdout:6/434: creat d2/d1d/d2d/d5a/d71/d7e/f86 x:0 0 0 2024-09-17T01:01:56.965 INFO:tasks.workunit.client.1.smithi099.stdout:7/474: creat d1/d8f/f95 x:0 0 0 2024-09-17T01:01:56.967 INFO:tasks.workunit.client.0.smithi002.stdout:6/435: mkdir d2/d1d/d27/d87 0 2024-09-17T01:01:56.968 INFO:tasks.workunit.client.1.smithi099.stdout:7/475: symlink d1/d2c/d5c/d1c/l96 0 2024-09-17T01:01:56.968 INFO:tasks.workunit.client.0.smithi002.stdout:9/343: dwrite d5/dc/d26/d46/f58 [0,4194304] 0 2024-09-17T01:01:56.968 INFO:tasks.workunit.client.0.smithi002.stdout:6/436: getdents d2/d1d/d2d/d5a 0 2024-09-17T01:01:56.968 INFO:tasks.workunit.client.0.smithi002.stdout:7/390: dread d1/d24/f56 [0,4194304] 0 2024-09-17T01:01:56.970 INFO:tasks.workunit.client.1.smithi099.stdout:5/512: dread d2/f22 [0,4194304] 0 2024-09-17T01:01:56.970 INFO:tasks.workunit.client.1.smithi099.stdout:5/513: creat d2/dc/d17/d3c/d72/f9f x:0 0 0 2024-09-17T01:01:56.972 INFO:tasks.workunit.client.0.smithi002.stdout:9/344: mkdir d5/dc/d26/d5c 0 2024-09-17T01:01:56.973 INFO:tasks.workunit.client.1.smithi099.stdout:5/514: symlink d2/dc/la0 0 2024-09-17T01:01:56.973 INFO:tasks.workunit.client.1.smithi099.stdout:5/515: write d2/d45/f7d [218314,44624] 0 2024-09-17T01:01:56.973 INFO:tasks.workunit.client.1.smithi099.stdout:5/516: getdents d2/dc/d97 0 2024-09-17T01:01:56.974 INFO:tasks.workunit.client.0.smithi002.stdout:7/391: mknod d1/d14/d1d/d29/d30/d5e/c7d 0 2024-09-17T01:01:56.974 INFO:tasks.workunit.client.1.smithi099.stdout:5/517: symlink d2/dc/d14/d36/d9a/la1 0 2024-09-17T01:01:56.974 INFO:tasks.workunit.client.1.smithi099.stdout:5/518: link d2/dc/f66 d2/fa2 0 2024-09-17T01:01:56.975 INFO:tasks.workunit.client.0.smithi002.stdout:9/345: creat d5/dc/d26/d34/d57/f5d x:0 0 0 2024-09-17T01:01:56.975 INFO:tasks.workunit.client.1.smithi099.stdout:5/519: link d2/dc/d14/l56 d2/dc/d17/d3c/d81/la3 0 2024-09-17T01:01:56.976 INFO:tasks.workunit.client.0.smithi002.stdout:9/346: mknod d5/dc/c5e 0 2024-09-17T01:01:56.977 INFO:tasks.workunit.client.1.smithi099.stdout:5/520: rename d2/dc/d14/d19 to d2/dc/d17/d3c/d60/d90/da4 0 2024-09-17T01:01:56.977 INFO:tasks.workunit.client.0.smithi002.stdout:9/347: rename d5/dc/c2f to d5/dc/d26/d34/c5f 0 2024-09-17T01:01:56.977 INFO:tasks.workunit.client.0.smithi002.stdout:6/437: write d2/d1d/f25 [1552392,3862] 0 2024-09-17T01:01:56.980 INFO:tasks.workunit.client.0.smithi002.stdout:6/438: rename d2/dc/d24/c2f to d2/dc/d24/d53/d83/c88 0 2024-09-17T01:01:56.982 INFO:tasks.workunit.client.0.smithi002.stdout:6/439: unlink d2/dc/l14 0 2024-09-17T01:01:56.982 INFO:tasks.workunit.client.1.smithi099.stdout:7/476: dread d1/d2c/d5c/d12/f2b [0,4194304] 0 2024-09-17T01:01:56.983 INFO:tasks.workunit.client.1.smithi099.stdout:7/477: truncate d1/d37/f51 1714990 0 2024-09-17T01:01:56.983 INFO:tasks.workunit.client.0.smithi002.stdout:6/440: creat d2/d1d/d2d/d54/f89 x:0 0 0 2024-09-17T01:01:56.983 INFO:tasks.workunit.client.0.smithi002.stdout:6/441: chown d2/d1d/f3d 66082350 1 2024-09-17T01:01:56.984 INFO:tasks.workunit.client.1.smithi099.stdout:7/478: truncate d1/d2c/f6b 2001019 0 2024-09-17T01:01:56.984 INFO:tasks.workunit.client.1.smithi099.stdout:7/479: mknod d1/d37/c97 0 2024-09-17T01:01:56.984 INFO:tasks.workunit.client.1.smithi099.stdout:7/480: write d1/d2c/d5c/d3f/f92 [832707,92267] 0 2024-09-17T01:01:56.985 INFO:tasks.workunit.client.0.smithi002.stdout:8/540: dwrite d2/d41/f7d [0,4194304] 0 2024-09-17T01:01:56.985 INFO:tasks.workunit.client.0.smithi002.stdout:8/541: stat d2/d3/d5f/d98/da5 0 2024-09-17T01:01:56.985 INFO:tasks.workunit.client.0.smithi002.stdout:8/542: fdatasync d2/d1c/d3b/f4c 0 2024-09-17T01:01:56.987 INFO:tasks.workunit.client.1.smithi099.stdout:8/500: dwrite d0/d41/f9d [0,4194304] 0 2024-09-17T01:01:56.987 INFO:tasks.workunit.client.1.smithi099.stdout:8/501: chown d0/f7c 142165 1 2024-09-17T01:01:56.987 INFO:tasks.workunit.client.0.smithi002.stdout:8/543: creat d2/d3/d5f/d98/da5/d4f/d58/fb8 x:0 0 0 2024-09-17T01:01:56.987 INFO:tasks.workunit.client.0.smithi002.stdout:8/544: fdatasync d2/d9/f97 0 2024-09-17T01:01:56.987 INFO:tasks.workunit.client.0.smithi002.stdout:8/545: fdatasync d2/d9/dd/fb1 0 2024-09-17T01:01:56.987 INFO:tasks.workunit.client.0.smithi002.stdout:8/546: creat d2/d1c/d3b/fb9 x:0 0 0 2024-09-17T01:01:56.987 INFO:tasks.workunit.client.0.smithi002.stdout:8/547: dread - d2/d3/d5f/d98/da5/d4f/f96 zero size 2024-09-17T01:01:56.988 INFO:tasks.workunit.client.0.smithi002.stdout:4/527: dwrite d7/de/f27 [0,4194304] 0 2024-09-17T01:01:56.989 INFO:tasks.workunit.client.0.smithi002.stdout:8/548: link d2/d3/d5f/d98/da5/d4f/l75 d2/d41/lba 0 2024-09-17T01:01:56.989 INFO:tasks.workunit.client.0.smithi002.stdout:8/549: fsync d2/d3/d5f/d98/da5/f7b 0 2024-09-17T01:01:56.989 INFO:tasks.workunit.client.0.smithi002.stdout:8/550: write d2/d3/d5f/d98/da5/d4f/d77/d78/fa9 [1026358,87907] 0 2024-09-17T01:01:56.996 INFO:tasks.workunit.client.0.smithi002.stdout:7/392: dwrite d1/d14/d1d/d28/d40/f7b [0,4194304] 0 2024-09-17T01:01:57.000 INFO:tasks.workunit.client.1.smithi099.stdout:7/481: dread d1/d37/f56 [0,4194304] 0 2024-09-17T01:01:57.001 INFO:tasks.workunit.client.0.smithi002.stdout:4/528: creat d7/d19/d9f/d9d/fa2 x:0 0 0 2024-09-17T01:01:57.001 INFO:tasks.workunit.client.0.smithi002.stdout:4/529: readlink d7/d3f/la1 0 2024-09-17T01:01:57.002 INFO:tasks.workunit.client.0.smithi002.stdout:8/551: mkdir d2/d26/dbb 0 2024-09-17T01:01:57.004 INFO:tasks.workunit.client.0.smithi002.stdout:4/530: rename d7/de/d32/d59/l75 to d7/d71/d8e/la3 0 2024-09-17T01:01:57.004 INFO:tasks.workunit.client.0.smithi002.stdout:4/531: truncate d7/d19/d9f/d80/d62/f6f 350754 0 2024-09-17T01:01:57.006 INFO:tasks.workunit.client.0.smithi002.stdout:8/552: unlink d2/d26/c67 0 2024-09-17T01:01:57.006 INFO:tasks.workunit.client.0.smithi002.stdout:8/553: creat d2/d3/d5f/d98/da5/d4f/d58/fbc x:0 0 0 2024-09-17T01:01:57.007 INFO:tasks.workunit.client.0.smithi002.stdout:9/348: getdents d5/dc/d26/d34 0 2024-09-17T01:01:57.007 INFO:tasks.workunit.client.0.smithi002.stdout:9/349: dread - d5/dc/f4b zero size 2024-09-17T01:01:57.008 INFO:tasks.workunit.client.0.smithi002.stdout:7/393: dread d1/d14/d1d/d29/d30/f53 [0,4194304] 0 2024-09-17T01:01:57.009 INFO:tasks.workunit.client.0.smithi002.stdout:6/442: dwrite d2/d1d/d27/d30/f78 [0,4194304] 0 2024-09-17T01:01:57.010 INFO:tasks.workunit.client.0.smithi002.stdout:6/443: read d2/f19 [734040,98081] 0 2024-09-17T01:01:57.010 INFO:tasks.workunit.client.0.smithi002.stdout:6/444: creat d2/dc/f8a x:0 0 0 2024-09-17T01:01:57.011 INFO:tasks.workunit.client.0.smithi002.stdout:4/532: mkdir d7/d19/d9f/d9d/da4 0 2024-09-17T01:01:57.015 INFO:tasks.workunit.client.0.smithi002.stdout:8/554: getdents d2/d1c/d28/da0 0 2024-09-17T01:01:57.015 INFO:tasks.workunit.client.0.smithi002.stdout:8/555: fdatasync d2/d3/d5f/fa6 0 2024-09-17T01:01:57.018 INFO:tasks.workunit.client.0.smithi002.stdout:7/394: creat d1/d14/d1d/d28/d40/d58/f7e x:0 0 0 2024-09-17T01:01:57.020 INFO:tasks.workunit.client.0.smithi002.stdout:6/445: dread d2/f16 [0,4194304] 0 2024-09-17T01:01:57.020 INFO:tasks.workunit.client.0.smithi002.stdout:4/533: mkdir d7/d19/d4a/da5 0 2024-09-17T01:01:57.021 INFO:tasks.workunit.client.0.smithi002.stdout:8/556: mkdir d2/d3/d5f/d98/da5/d4f/d58/dbd 0 2024-09-17T01:01:57.022 INFO:tasks.workunit.client.1.smithi099.stdout:7/482: dwrite d1/d2c/d47/d48/d60/f91 [0,4194304] 0 2024-09-17T01:01:57.022 INFO:tasks.workunit.client.0.smithi002.stdout:6/446: creat d2/d1d/d2d/d35/d37/f8b x:0 0 0 2024-09-17T01:01:57.022 INFO:tasks.workunit.client.0.smithi002.stdout:6/447: readlink d2/dc/d24/d53/l6f 0 2024-09-17T01:01:57.023 INFO:tasks.workunit.client.0.smithi002.stdout:6/448: fsync f1 0 2024-09-17T01:01:57.023 INFO:tasks.workunit.client.0.smithi002.stdout:6/449: fdatasync d2/d1d/d26/f2a 0 2024-09-17T01:01:57.023 INFO:tasks.workunit.client.0.smithi002.stdout:6/450: stat d2/d1d/f25 0 2024-09-17T01:01:57.024 INFO:tasks.workunit.client.1.smithi099.stdout:7/483: creat d1/d2c/d5c/f98 x:0 0 0 2024-09-17T01:01:57.025 INFO:tasks.workunit.client.1.smithi099.stdout:7/484: dread - d1/d2c/d5c/d12/f53 zero size 2024-09-17T01:01:57.025 INFO:tasks.workunit.client.1.smithi099.stdout:7/485: dread - d1/d2c/f2d zero size 2024-09-17T01:01:57.025 INFO:tasks.workunit.client.0.smithi002.stdout:4/534: creat d7/de/fa6 x:0 0 0 2024-09-17T01:01:57.025 INFO:tasks.workunit.client.0.smithi002.stdout:4/535: chown d7/f18 2373858 1 2024-09-17T01:01:57.025 INFO:tasks.workunit.client.0.smithi002.stdout:4/536: write d7/de/d3a/f97 [2076031,77768] 0 2024-09-17T01:01:57.025 INFO:tasks.workunit.client.0.smithi002.stdout:4/537: dread - d7/d19/d9f/d9d/fa2 zero size 2024-09-17T01:01:57.025 INFO:tasks.workunit.client.0.smithi002.stdout:9/350: dwrite d5/dc/d26/d34/f42 [0,4194304] 0 2024-09-17T01:01:57.026 INFO:tasks.workunit.client.1.smithi099.stdout:7/486: truncate d1/d2c/d5c/fe 1091862 0 2024-09-17T01:01:57.038 INFO:tasks.workunit.client.0.smithi002.stdout:7/395: dwrite d1/d14/f15 [0,4194304] 0 2024-09-17T01:01:57.046 INFO:tasks.workunit.client.0.smithi002.stdout:8/557: symlink d2/d3/d5f/d98/da5/lbe 0 2024-09-17T01:01:57.046 INFO:tasks.workunit.client.1.smithi099.stdout:7/487: symlink d1/d37/l99 0 2024-09-17T01:01:57.046 INFO:tasks.workunit.client.1.smithi099.stdout:7/488: dread - d1/d2c/d5c/d1c/d72/f7e zero size 2024-09-17T01:01:57.047 INFO:tasks.workunit.client.1.smithi099.stdout:7/489: chown d1/d2c/d47/f50 4376474 1 2024-09-17T01:01:57.047 INFO:tasks.workunit.client.1.smithi099.stdout:7/490: truncate d1/d2c/d47/f6c 871026 0 2024-09-17T01:01:57.047 INFO:tasks.workunit.client.0.smithi002.stdout:6/451: dwrite d2/f15 [4194304,4194304] 0 2024-09-17T01:01:57.047 INFO:tasks.workunit.client.0.smithi002.stdout:6/452: chown d2/d4b/l7f 22846601 1 2024-09-17T01:01:57.047 INFO:tasks.workunit.client.0.smithi002.stdout:6/453: chown d2/d1d/d27/d30/c5d 44 1 2024-09-17T01:01:57.048 INFO:tasks.workunit.client.0.smithi002.stdout:6/454: dread d2/d1d/d27/d30/f77 [0,4194304] 0 2024-09-17T01:01:57.048 INFO:tasks.workunit.client.0.smithi002.stdout:6/455: chown d2/d1d/d2d/d54/f89 9454 1 2024-09-17T01:01:57.048 INFO:tasks.workunit.client.0.smithi002.stdout:0/315: sync 2024-09-17T01:01:57.048 INFO:tasks.workunit.client.0.smithi002.stdout:5/395: sync 2024-09-17T01:01:57.049 INFO:tasks.workunit.client.1.smithi099.stdout:7/491: rename d1/d2c/d5c/d12/l3a to d1/d2c/d7a/l9a 0 2024-09-17T01:01:57.050 INFO:tasks.workunit.client.1.smithi099.stdout:7/492: symlink d1/d37/l9b 0 2024-09-17T01:01:57.052 INFO:tasks.workunit.client.0.smithi002.stdout:9/351: symlink d5/dc/d26/d34/d36/l60 0 2024-09-17T01:01:57.053 INFO:tasks.workunit.client.0.smithi002.stdout:7/396: rename d1/d14/d1d/d29/l64 to d1/d14/d1d/d29/d30/d50/l7f 0 2024-09-17T01:01:57.074 INFO:tasks.workunit.client.1.smithi099.stdout:7/493: unlink d1/d37/d78/f93 0 2024-09-17T01:01:57.074 INFO:tasks.workunit.client.1.smithi099.stdout:7/494: fdatasync d1/d2c/d47/d48/d60/f91 0 2024-09-17T01:01:57.075 INFO:tasks.workunit.client.1.smithi099.stdout:7/495: symlink d1/d2c/d5c/d1c/d72/l9c 0 2024-09-17T01:01:57.080 INFO:tasks.workunit.client.0.smithi002.stdout:8/558: truncate d2/d9/dd/f8c 1144442 0 2024-09-17T01:01:57.082 INFO:tasks.workunit.client.0.smithi002.stdout:4/538: getdents d7/de/d3a 0 2024-09-17T01:01:57.083 INFO:tasks.workunit.client.0.smithi002.stdout:6/456: mkdir d2/d1d/d26/d49/d7d/d8c 0 2024-09-17T01:01:57.084 INFO:tasks.workunit.client.0.smithi002.stdout:0/316: mkdir dd/d19/d1c/d33/d67/d68 0 2024-09-17T01:01:57.088 INFO:tasks.workunit.client.0.smithi002.stdout:9/352: creat d5/dc/d26/d5c/f61 x:0 0 0 2024-09-17T01:01:57.091 INFO:tasks.workunit.client.0.smithi002.stdout:8/559: link d2/d41/f90 d2/d3/d5f/d98/da5/d71/fbf 0 2024-09-17T01:01:57.094 INFO:tasks.workunit.client.0.smithi002.stdout:4/539: mknod d7/d19/d2e/ca7 0 2024-09-17T01:01:57.094 INFO:tasks.workunit.client.0.smithi002.stdout:4/540: fdatasync d7/de/f28 0 2024-09-17T01:01:57.094 INFO:tasks.workunit.client.0.smithi002.stdout:7/397: rmdir d1/d14/d1d/d28/d40/d58 39 2024-09-17T01:01:57.095 INFO:tasks.workunit.client.0.smithi002.stdout:8/560: creat d2/d1c/d28/da0/fc0 x:0 0 0 2024-09-17T01:01:57.095 INFO:tasks.workunit.client.0.smithi002.stdout:8/561: chown d2/d3/d5f/d98/da5/f7b 15586 1 2024-09-17T01:01:57.096 INFO:tasks.workunit.client.0.smithi002.stdout:4/541: mknod d7/d19/d9c/ca8 0 2024-09-17T01:01:57.098 INFO:tasks.workunit.client.0.smithi002.stdout:4/542: mkdir d7/d3f/da9 0 2024-09-17T01:01:57.098 INFO:tasks.workunit.client.0.smithi002.stdout:1/431: sync 2024-09-17T01:01:57.099 INFO:tasks.workunit.client.0.smithi002.stdout:3/463: sync 2024-09-17T01:01:57.100 INFO:tasks.workunit.client.0.smithi002.stdout:1/432: link d4/d11/d12/d30/d5e/f77 d4/d11/d1a/d95/f9b 0 2024-09-17T01:01:57.101 INFO:tasks.workunit.client.0.smithi002.stdout:1/433: chown d4/c10 282 1 2024-09-17T01:01:57.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/434: symlink d4/d22/l9c 0 2024-09-17T01:01:57.108 INFO:tasks.workunit.client.0.smithi002.stdout:9/353: dread d5/f49 [0,4194304] 0 2024-09-17T01:01:57.117 INFO:tasks.workunit.client.0.smithi002.stdout:3/464: dread d0/d3/f24 [0,4194304] 0 2024-09-17T01:01:57.118 INFO:tasks.workunit.client.0.smithi002.stdout:3/465: mkdir d0/d3/d17/d87/d9e 0 2024-09-17T01:01:57.126 INFO:tasks.workunit.client.0.smithi002.stdout:9/354: dread d5/dc/d26/f31 [0,4194304] 0 2024-09-17T01:01:57.126 INFO:tasks.workunit.client.0.smithi002.stdout:9/355: read d5/dc/d26/d46/f50 [3772990,58148] 0 2024-09-17T01:01:57.128 INFO:tasks.workunit.client.0.smithi002.stdout:0/317: dwrite dd/d3d/f3f [4194304,4194304] 0 2024-09-17T01:01:57.129 INFO:tasks.workunit.client.0.smithi002.stdout:8/562: dwrite d2/d1c/d3b/f4c [0,4194304] 0 2024-09-17T01:01:57.130 INFO:tasks.workunit.client.0.smithi002.stdout:6/457: dwrite d2/dc/d34/f39 [0,4194304] 0 2024-09-17T01:01:57.131 INFO:tasks.workunit.client.0.smithi002.stdout:6/458: write d2/f6c [281411,87547] 0 2024-09-17T01:01:57.136 INFO:tasks.workunit.client.0.smithi002.stdout:0/318: symlink dd/d44/l69 0 2024-09-17T01:01:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:2/457: sync 2024-09-17T01:01:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:2/458: chown d1b/d74 1017 1 2024-09-17T01:01:57.142 INFO:tasks.workunit.client.0.smithi002.stdout:7/398: rename d1/d14/d1d/d29/d57/c65 to d1/d14/d1d/c80 0 2024-09-17T01:01:57.143 INFO:tasks.workunit.client.0.smithi002.stdout:5/396: mknod d2/d2d/d10/d14/d19/d39/d25/c7f 0 2024-09-17T01:01:57.144 INFO:tasks.workunit.client.0.smithi002.stdout:8/563: dread d2/d26/f61 [0,4194304] 0 2024-09-17T01:01:57.145 INFO:tasks.workunit.client.0.smithi002.stdout:7/399: symlink d1/d14/d1d/d28/d6b/l81 0 2024-09-17T01:01:57.145 INFO:tasks.workunit.client.0.smithi002.stdout:7/400: fsync d1/d14/d1d/d28/d2d/f68 0 2024-09-17T01:01:57.146 INFO:tasks.workunit.client.0.smithi002.stdout:5/397: truncate d2/f54 77538 0 2024-09-17T01:01:57.146 INFO:tasks.workunit.client.0.smithi002.stdout:5/398: write d2/d2d/d10/f66 [4736094,17498] 0 2024-09-17T01:01:57.146 INFO:tasks.workunit.client.0.smithi002.stdout:6/459: read d2/dc/d34/f39 [710398,16539] 0 2024-09-17T01:01:57.147 INFO:tasks.workunit.client.1.smithi099.stdout:3/507: sync 2024-09-17T01:01:57.147 INFO:tasks.workunit.client.0.smithi002.stdout:3/466: dwrite d0/d3/d33/f7b [0,4194304] 0 2024-09-17T01:01:57.147 INFO:tasks.workunit.client.0.smithi002.stdout:3/467: stat d0/d3/d17/d9a/d5b/f8f 0 2024-09-17T01:01:57.147 INFO:tasks.workunit.client.0.smithi002.stdout:9/356: dwrite d5/dc/d26/d46/f4c [0,4194304] 0 2024-09-17T01:01:57.147 INFO:tasks.workunit.client.0.smithi002.stdout:0/319: write dd/f14 [3664604,57271] 0 2024-09-17T01:01:57.148 INFO:tasks.workunit.client.0.smithi002.stdout:8/564: mknod d2/d3/d5f/d47/cc1 0 2024-09-17T01:01:57.148 INFO:tasks.workunit.client.0.smithi002.stdout:8/565: dread - d2/d3/d5f/d98/da5/d4f/d77/d78/f88 zero size 2024-09-17T01:01:57.148 INFO:tasks.workunit.client.0.smithi002.stdout:5/399: rmdir d2/d2d/d10/d14/d19/d39/d25/d32 39 2024-09-17T01:01:57.151 INFO:tasks.workunit.client.0.smithi002.stdout:4/543: unlink d7/d19/f78 0 2024-09-17T01:01:57.151 INFO:tasks.workunit.client.0.smithi002.stdout:4/544: chown d7/de/f79 0 1 2024-09-17T01:01:57.151 INFO:tasks.workunit.client.0.smithi002.stdout:2/459: dread d1b/d1d/d79/f5c [0,4194304] 0 2024-09-17T01:01:57.152 INFO:tasks.workunit.client.0.smithi002.stdout:8/566: symlink d2/d3/d5f/d98/lc2 0 2024-09-17T01:01:57.153 INFO:tasks.workunit.client.0.smithi002.stdout:8/567: write d2/d1c/d28/f55 [1565099,45424] 0 2024-09-17T01:01:57.153 INFO:tasks.workunit.client.0.smithi002.stdout:8/568: chown d2/d3/f11 126165151 1 2024-09-17T01:01:57.153 INFO:tasks.workunit.client.0.smithi002.stdout:5/400: mkdir d2/de/d57/d80 0 2024-09-17T01:01:57.153 INFO:tasks.workunit.client.0.smithi002.stdout:5/401: readlink d2/de/d1d/l3d 0 2024-09-17T01:01:57.155 INFO:tasks.workunit.client.0.smithi002.stdout:2/460: mkdir d1b/d8a/dab 0 2024-09-17T01:01:57.156 INFO:tasks.workunit.client.0.smithi002.stdout:1/435: rename d4/d11/d1a/c70 to d4/d11/d12/c9d 0 2024-09-17T01:01:57.157 INFO:tasks.workunit.client.1.smithi099.stdout:3/508: dread d9/d15/d18/d1a/d23/d4c/f74 [4194304,4194304] 0 2024-09-17T01:01:57.157 INFO:tasks.workunit.client.0.smithi002.stdout:2/461: mkdir d1b/d37/d48/d78/daa/dac 0 2024-09-17T01:01:57.157 INFO:tasks.workunit.client.0.smithi002.stdout:2/462: chown d1b/f5a 6 1 2024-09-17T01:01:57.159 INFO:tasks.workunit.client.0.smithi002.stdout:7/401: rename d1/d14/d1d/d21/l23 to d1/d14/d1d/d28/d40/l82 0 2024-09-17T01:01:57.162 INFO:tasks.workunit.client.0.smithi002.stdout:5/402: getdents d2/d2d/d10/d20/d24 0 2024-09-17T01:01:57.162 INFO:tasks.workunit.client.0.smithi002.stdout:8/569: fdatasync d2/d3/d5f/d98/da5/d4f/d77/d78/fa9 0 2024-09-17T01:01:57.162 INFO:tasks.workunit.client.0.smithi002.stdout:2/463: symlink d1b/d37/d48/lad 0 2024-09-17T01:01:57.164 INFO:tasks.workunit.client.0.smithi002.stdout:4/545: dread d7/de/d32/d8a/d77/d9b/f57 [0,4194304] 0 2024-09-17T01:01:57.165 INFO:tasks.workunit.client.0.smithi002.stdout:5/403: creat d2/d2d/d10/d14/d7d/f81 x:0 0 0 2024-09-17T01:01:57.167 INFO:tasks.workunit.client.0.smithi002.stdout:9/357: dwrite d5/dc/d26/d46/d47/f48 [0,4194304] 0 2024-09-17T01:01:57.167 INFO:tasks.workunit.client.0.smithi002.stdout:9/358: fdatasync d5/dc/d26/f2d 0 2024-09-17T01:01:57.167 INFO:tasks.workunit.client.0.smithi002.stdout:8/570: mknod d2/d3/d5f/d98/dab/cc3 0 2024-09-17T01:01:57.167 INFO:tasks.workunit.client.0.smithi002.stdout:8/571: creat d2/d3/d5f/d98/fc4 x:0 0 0 2024-09-17T01:01:57.167 INFO:tasks.workunit.client.0.smithi002.stdout:8/572: write d2/d3/d5f/d98/da5/d4f/d77/d78/fa9 [2016487,121787] 0 2024-09-17T01:01:57.167 INFO:tasks.workunit.client.0.smithi002.stdout:8/573: creat d2/d3/d5f/d98/da5/d4f/d77/d78/fc5 x:0 0 0 2024-09-17T01:01:57.168 INFO:tasks.workunit.client.0.smithi002.stdout:2/464: mkdir d1b/d8a/d92/dae 0 2024-09-17T01:01:57.169 INFO:tasks.workunit.client.0.smithi002.stdout:7/402: write d1/d24/f46 [2556395,67713] 0 2024-09-17T01:01:57.169 INFO:tasks.workunit.client.0.smithi002.stdout:7/403: fdatasync d1/d14/d1d/d28/d2d/f35 0 2024-09-17T01:01:57.169 INFO:tasks.workunit.client.0.smithi002.stdout:2/465: write d1b/d37/d48/f9b [108657,37060] 0 2024-09-17T01:01:57.170 INFO:tasks.workunit.client.0.smithi002.stdout:2/466: write d1b/d1d/f1f [377595,36663] 0 2024-09-17T01:01:57.170 INFO:tasks.workunit.client.0.smithi002.stdout:5/404: dread d2/d2d/d10/d20/f3e [0,4194304] 0 2024-09-17T01:01:57.170 INFO:tasks.workunit.client.0.smithi002.stdout:6/460: rename d2/d1d/d26/d40 to d2/d1d/d2d/d35/d8d 0 2024-09-17T01:01:57.170 INFO:tasks.workunit.client.0.smithi002.stdout:6/461: chown d2/d1d/d27/d30/f77 0 1 2024-09-17T01:01:57.172 INFO:tasks.workunit.client.0.smithi002.stdout:4/546: mknod d7/d19/d9c/caa 0 2024-09-17T01:01:57.174 INFO:tasks.workunit.client.1.smithi099.stdout:3/509: dwrite d9/d3b/d44/f7b [0,4194304] 0 2024-09-17T01:01:57.174 INFO:tasks.workunit.client.1.smithi099.stdout:3/510: chown d9/d15/d18/d1a/d23/f4a 82 1 2024-09-17T01:01:57.178 INFO:tasks.workunit.client.0.smithi002.stdout:7/404: creat d1/d14/d1d/d28/d6b/f83 x:0 0 0 2024-09-17T01:01:57.178 INFO:tasks.workunit.client.0.smithi002.stdout:7/405: chown d1/d14/c1a 3 1 2024-09-17T01:01:57.178 INFO:tasks.workunit.client.0.smithi002.stdout:7/406: truncate d1/d14/d1d/d29/d30/d54/f73 246276 0 2024-09-17T01:01:57.178 INFO:tasks.workunit.client.0.smithi002.stdout:7/407: chown d1/d24/f56 1 1 2024-09-17T01:01:57.178 INFO:tasks.workunit.client.0.smithi002.stdout:7/408: creat d1/d14/d1d/d29/d30/f84 x:0 0 0 2024-09-17T01:01:57.181 INFO:tasks.workunit.client.0.smithi002.stdout:5/405: mkdir d2/d2d/d10/d14/d7d/d82 0 2024-09-17T01:01:57.183 INFO:tasks.workunit.client.0.smithi002.stdout:3/468: rename d0/d3/d17/d9a/d5b/c72 to d0/d3/d37/c9f 0 2024-09-17T01:01:57.184 INFO:tasks.workunit.client.0.smithi002.stdout:3/469: creat d0/d3/d8d/fa0 x:0 0 0 2024-09-17T01:01:57.186 INFO:tasks.workunit.client.0.smithi002.stdout:7/409: truncate f0 1969918 0 2024-09-17T01:01:57.188 INFO:tasks.workunit.client.0.smithi002.stdout:5/406: creat d2/de/d1d/f83 x:0 0 0 2024-09-17T01:01:57.189 INFO:tasks.workunit.client.0.smithi002.stdout:0/320: rename cb to dd/d19/d1c/d1f/d39/c6a 0 2024-09-17T01:01:57.191 INFO:tasks.workunit.client.0.smithi002.stdout:3/470: mkdir d0/d3/d80/da1 0 2024-09-17T01:01:57.193 INFO:tasks.workunit.client.0.smithi002.stdout:7/410: creat d1/d14/d1d/d29/f85 x:0 0 0 2024-09-17T01:01:57.194 INFO:tasks.workunit.client.0.smithi002.stdout:5/407: mknod d2/c84 0 2024-09-17T01:01:57.194 INFO:tasks.workunit.client.0.smithi002.stdout:5/408: chown d2/d2d/d10/d14/c45 812621 1 2024-09-17T01:01:57.195 INFO:tasks.workunit.client.0.smithi002.stdout:1/436: rename d4/d11/d55/d7a/f80 to d4/d11/d1a/f9e 0 2024-09-17T01:01:57.195 INFO:tasks.workunit.client.0.smithi002.stdout:1/437: fdatasync d4/d11/f71 0 2024-09-17T01:01:57.197 INFO:tasks.workunit.client.0.smithi002.stdout:0/321: creat dd/d19/d1c/d1f/d22/f6b x:0 0 0 2024-09-17T01:01:57.200 INFO:tasks.workunit.client.0.smithi002.stdout:3/471: creat d0/d3/d80/da1/fa2 x:0 0 0 2024-09-17T01:01:57.200 INFO:tasks.workunit.client.0.smithi002.stdout:7/411: mkdir d1/d14/d1d/d28/d86 0 2024-09-17T01:01:57.201 INFO:tasks.workunit.client.0.smithi002.stdout:7/412: dread - d1/d14/d1d/d28/d40/d58/f7e zero size 2024-09-17T01:01:57.202 INFO:tasks.workunit.client.0.smithi002.stdout:8/574: rename d2/d3/cc to d2/d3/d5f/d98/da5/d4f/d58/dbd/cc6 0 2024-09-17T01:01:57.202 INFO:tasks.workunit.client.0.smithi002.stdout:8/575: write d2/d9/dd/f92 [1416742,96679] 0 2024-09-17T01:01:57.203 INFO:tasks.workunit.client.0.smithi002.stdout:0/322: creat dd/d19/d1a/d29/d55/d61/f6c x:0 0 0 2024-09-17T01:01:57.205 INFO:tasks.workunit.client.0.smithi002.stdout:3/472: mknod d0/d31/d32/ca3 0 2024-09-17T01:01:57.206 INFO:tasks.workunit.client.0.smithi002.stdout:7/413: mknod d1/d14/d1d/d28/d40/d58/c87 0 2024-09-17T01:01:57.206 INFO:tasks.workunit.client.0.smithi002.stdout:7/414: chown d1/d24/c39 206 1 2024-09-17T01:01:57.206 INFO:tasks.workunit.client.0.smithi002.stdout:7/415: write d1/f20 [3341971,85066] 0 2024-09-17T01:01:57.206 INFO:tasks.workunit.client.0.smithi002.stdout:7/416: read - d1/d14/d1d/d28/d6b/f72 zero size 2024-09-17T01:01:57.206 INFO:tasks.workunit.client.0.smithi002.stdout:7/417: truncate d1/d14/d1d/d28/f6e 91375 0 2024-09-17T01:01:57.207 INFO:tasks.workunit.client.0.smithi002.stdout:7/418: fsync d1/d14/d1d/d21/f63 0 2024-09-17T01:01:57.207 INFO:tasks.workunit.client.0.smithi002.stdout:7/419: readlink d1/d14/d1d/d29/l4a 0 2024-09-17T01:01:57.207 INFO:tasks.workunit.client.0.smithi002.stdout:8/576: creat d2/d30/d8b/fc7 x:0 0 0 2024-09-17T01:01:57.207 INFO:tasks.workunit.client.0.smithi002.stdout:8/577: read d2/d3/d5f/d98/da5/f36 [3885905,114880] 0 2024-09-17T01:01:57.208 INFO:tasks.workunit.client.0.smithi002.stdout:0/323: symlink dd/d19/d1c/d1f/d39/l6d 0 2024-09-17T01:01:57.210 INFO:tasks.workunit.client.0.smithi002.stdout:1/438: dread d4/d11/d12/d14/d17/f27 [0,4194304] 0 2024-09-17T01:01:57.210 INFO:tasks.workunit.client.0.smithi002.stdout:3/473: creat d0/d31/d32/d92/fa4 x:0 0 0 2024-09-17T01:01:57.210 INFO:tasks.workunit.client.0.smithi002.stdout:3/474: readlink d0/d3/l4b 0 2024-09-17T01:01:57.213 INFO:tasks.workunit.client.0.smithi002.stdout:3/475: chown d0/f2f 4088 1 2024-09-17T01:01:57.214 INFO:tasks.workunit.client.0.smithi002.stdout:3/476: creat d0/d31/d8b/d9d/fa5 x:0 0 0 2024-09-17T01:01:57.215 INFO:tasks.workunit.client.0.smithi002.stdout:7/420: dread d1/d14/d1d/d29/d30/f53 [0,4194304] 0 2024-09-17T01:01:57.216 INFO:tasks.workunit.client.0.smithi002.stdout:0/324: dread dd/f18 [0,4194304] 0 2024-09-17T01:01:57.217 INFO:tasks.workunit.client.0.smithi002.stdout:2/467: dwrite d1b/d8a/f8c [0,4194304] 0 2024-09-17T01:01:57.218 INFO:tasks.workunit.client.0.smithi002.stdout:2/468: read d1b/f3a [1081200,92524] 0 2024-09-17T01:01:57.218 INFO:tasks.workunit.client.0.smithi002.stdout:2/469: chown d1b/d37/d48/d4e/f70 1 1 2024-09-17T01:01:57.218 INFO:tasks.workunit.client.0.smithi002.stdout:7/421: creat d1/d14/d1d/f88 x:0 0 0 2024-09-17T01:01:57.218 INFO:tasks.workunit.client.0.smithi002.stdout:0/325: truncate dd/d19/d1c/d1f/d22/f51 3880117 0 2024-09-17T01:01:57.220 INFO:tasks.workunit.client.1.smithi099.stdout:3/511: dwrite d9/f30 [0,4194304] 0 2024-09-17T01:01:57.221 INFO:tasks.workunit.client.1.smithi099.stdout:3/512: write d9/d15/f59 [1409410,111905] 0 2024-09-17T01:01:57.221 INFO:tasks.workunit.client.1.smithi099.stdout:3/513: fdatasync d9/f9a 0 2024-09-17T01:01:57.222 INFO:tasks.workunit.client.0.smithi002.stdout:9/359: dwrite d5/f3e [0,4194304] 0 2024-09-17T01:01:57.222 INFO:tasks.workunit.client.0.smithi002.stdout:9/360: chown d5/dc/l27 230 1 2024-09-17T01:01:57.223 INFO:tasks.workunit.client.0.smithi002.stdout:5/409: dwrite d2/d2d/d10/d14/d19/d39/d51/f79 [0,4194304] 0 2024-09-17T01:01:57.223 INFO:tasks.workunit.client.0.smithi002.stdout:5/410: chown d2/de/f4a 22517 1 2024-09-17T01:01:57.223 INFO:tasks.workunit.client.0.smithi002.stdout:5/411: chown d2/d2d/d10/d23/d6a 135 1 2024-09-17T01:01:57.224 INFO:tasks.workunit.client.0.smithi002.stdout:7/422: truncate d1/f11 3005412 0 2024-09-17T01:01:57.225 INFO:tasks.workunit.client.0.smithi002.stdout:1/439: write d4/d11/d12/d14/d17/d51/f74 [1544817,17289] 0 2024-09-17T01:01:57.225 INFO:tasks.workunit.client.0.smithi002.stdout:1/440: dread - d4/d11/d12/d23/f99 zero size 2024-09-17T01:01:57.225 INFO:tasks.workunit.client.0.smithi002.stdout:6/462: dwrite d2/d1d/d26/f2a [4194304,4194304] 0 2024-09-17T01:01:57.226 INFO:tasks.workunit.client.0.smithi002.stdout:0/326: creat dd/d44/f6e x:0 0 0 2024-09-17T01:01:57.231 INFO:tasks.workunit.client.0.smithi002.stdout:7/423: mknod d1/d14/d1d/d29/d30/d5e/c89 0 2024-09-17T01:01:57.234 INFO:tasks.workunit.client.0.smithi002.stdout:6/463: write d2/d1d/d2d/d5a/d71/d7e/f85 [1679621,80117] 0 2024-09-17T01:01:57.237 INFO:tasks.workunit.client.0.smithi002.stdout:1/441: write d4/d11/d12/d14/d17/d3b/f62 [2245089,32566] 0 2024-09-17T01:01:57.238 INFO:tasks.workunit.client.0.smithi002.stdout:4/547: dwrite d7/f14 [0,4194304] 0 2024-09-17T01:01:57.238 INFO:tasks.workunit.client.0.smithi002.stdout:0/327: creat dd/d19/f6f x:0 0 0 2024-09-17T01:01:57.239 INFO:tasks.workunit.client.0.smithi002.stdout:0/328: stat dd/f36 0 2024-09-17T01:01:57.239 INFO:tasks.workunit.client.0.smithi002.stdout:0/329: chown dd/d19/f1b 204902 1 2024-09-17T01:01:57.240 INFO:tasks.workunit.client.0.smithi002.stdout:7/424: creat d1/d14/f8a x:0 0 0 2024-09-17T01:01:57.241 INFO:tasks.workunit.client.0.smithi002.stdout:6/464: mknod d2/dc/c8e 0 2024-09-17T01:01:57.241 INFO:tasks.workunit.client.1.smithi099.stdout:3/514: dread d9/d15/d18/d1a/f1b [4194304,4194304] 0 2024-09-17T01:01:57.242 INFO:tasks.workunit.client.1.smithi099.stdout:3/515: stat d9/f30 0 2024-09-17T01:01:57.244 INFO:tasks.workunit.client.1.smithi099.stdout:3/516: rename d9/d15/d18/d1a/d23/d4c/d64/c89 to d9/d3b/d44/c9c 0 2024-09-17T01:01:57.244 INFO:tasks.workunit.client.1.smithi099.stdout:3/517: chown d9/d15/d18/d1a 63116490 1 2024-09-17T01:01:57.245 INFO:tasks.workunit.client.1.smithi099.stdout:3/518: symlink d9/d15/d18/d1a/d23/l9d 0 2024-09-17T01:01:57.246 INFO:tasks.workunit.client.0.smithi002.stdout:7/425: unlink d1/d14/d1d/d29/l33 0 2024-09-17T01:01:57.246 INFO:tasks.workunit.client.0.smithi002.stdout:7/426: chown d1/d24/c39 0 1 2024-09-17T01:01:57.246 INFO:tasks.workunit.client.0.smithi002.stdout:7/427: write d1/d24/f46 [5164597,118450] 0 2024-09-17T01:01:57.246 INFO:tasks.workunit.client.0.smithi002.stdout:7/428: fsync d1/f20 0 2024-09-17T01:01:57.246 INFO:tasks.workunit.client.0.smithi002.stdout:7/429: chown d1/d14/d1d/d28/f79 1 1 2024-09-17T01:01:57.246 INFO:tasks.workunit.client.0.smithi002.stdout:7/430: read - d1/d14/d1d/d21/f76 zero size 2024-09-17T01:01:57.246 INFO:tasks.workunit.client.0.smithi002.stdout:4/548: write d7/d19/d2e/f70 [3064768,66239] 0 2024-09-17T01:01:57.247 INFO:tasks.workunit.client.0.smithi002.stdout:1/442: getdents d4/d11/d12/d14/d17/d56 0 2024-09-17T01:01:57.248 INFO:tasks.workunit.client.0.smithi002.stdout:1/443: creat d4/d11/d55/d7a/f9f x:0 0 0 2024-09-17T01:01:57.248 INFO:tasks.workunit.client.0.smithi002.stdout:5/412: dread d2/d2d/d10/d14/d19/d39/d25/d32/d33/f7c [0,4194304] 0 2024-09-17T01:01:57.248 INFO:tasks.workunit.client.0.smithi002.stdout:5/413: stat d2/d2d/d10/d14/d59 0 2024-09-17T01:01:57.248 INFO:tasks.workunit.client.1.smithi099.stdout:3/519: creat d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/f9e x:0 0 0 2024-09-17T01:01:57.248 INFO:tasks.workunit.client.1.smithi099.stdout:3/520: fsync d9/f8c 0 2024-09-17T01:01:57.248 INFO:tasks.workunit.client.1.smithi099.stdout:3/521: chown d9/d15/d18/f2a 1 1 2024-09-17T01:01:57.248 INFO:tasks.workunit.client.1.smithi099.stdout:3/522: write d9/d15/d18/d1a/d23/d4c/f90 [685304,12675] 0 2024-09-17T01:01:57.248 INFO:tasks.workunit.client.1.smithi099.stdout:3/523: rename d9/d15/d18/d1a/d23/d5c/f85 to d9/d15/d8f/f9f 0 2024-09-17T01:01:57.249 INFO:tasks.workunit.client.0.smithi002.stdout:7/431: mknod d1/d14/d1d/d29/c8b 0 2024-09-17T01:01:57.249 INFO:tasks.workunit.client.1.smithi099.stdout:3/524: unlink d9/f10 0 2024-09-17T01:01:57.249 INFO:tasks.workunit.client.1.smithi099.stdout:3/525: read - d9/d2b/f58 zero size 2024-09-17T01:01:57.249 INFO:tasks.workunit.client.1.smithi099.stdout:3/526: symlink d9/d15/d18/la0 0 2024-09-17T01:01:57.249 INFO:tasks.workunit.client.1.smithi099.stdout:3/527: write d9/d15/f34 [1779304,107385] 0 2024-09-17T01:01:57.250 INFO:tasks.workunit.client.1.smithi099.stdout:3/528: creat d9/d15/d18/d1a/d23/d5c/fa1 x:0 0 0 2024-09-17T01:01:57.251 INFO:tasks.workunit.client.0.smithi002.stdout:4/549: mkdir d7/d19/d2e/dab 0 2024-09-17T01:01:57.251 INFO:tasks.workunit.client.0.smithi002.stdout:4/550: read d7/d19/d9f/d80/d62/f31 [998704,54528] 0 2024-09-17T01:01:57.251 INFO:tasks.workunit.client.0.smithi002.stdout:3/477: dwrite d0/d3/f1a [4194304,4194304] 0 2024-09-17T01:01:57.252 INFO:tasks.workunit.client.0.smithi002.stdout:4/551: dread d7/d19/d2e/f3d [0,4194304] 0 2024-09-17T01:01:57.258 INFO:tasks.workunit.client.0.smithi002.stdout:2/470: dwrite d1b/d37/d48/d4e/f3b [0,4194304] 0 2024-09-17T01:01:57.258 INFO:tasks.workunit.client.0.smithi002.stdout:2/471: truncate d1b/d3f/d59/f63 4993016 0 2024-09-17T01:01:57.258 INFO:tasks.workunit.client.0.smithi002.stdout:2/472: readlink d1b/d8a/d92/l97 0 2024-09-17T01:01:57.259 INFO:tasks.workunit.client.1.smithi099.stdout:3/529: dread d9/f27 [0,4194304] 0 2024-09-17T01:01:57.261 INFO:tasks.workunit.client.1.smithi099.stdout:3/530: rmdir d9/d3b/d44/d57 39 2024-09-17T01:01:57.261 INFO:tasks.workunit.client.1.smithi099.stdout:3/531: fdatasync d9/d15/d18/f88 0 2024-09-17T01:01:57.261 INFO:tasks.workunit.client.1.smithi099.stdout:3/532: chown d9/d15/c16 16349641 1 2024-09-17T01:01:57.262 INFO:tasks.workunit.client.0.smithi002.stdout:2/473: unlink d1b/d37/c53 0 2024-09-17T01:01:57.262 INFO:tasks.workunit.client.0.smithi002.stdout:2/474: write d1b/d37/d48/d4e/f35 [2767795,21815] 0 2024-09-17T01:01:57.262 INFO:tasks.workunit.client.0.smithi002.stdout:2/475: write d1b/d37/d48/d4e/f2e [539604,102692] 0 2024-09-17T01:01:57.265 INFO:tasks.workunit.client.0.smithi002.stdout:4/552: dread d7/f12 [0,4194304] 0 2024-09-17T01:01:57.266 INFO:tasks.workunit.client.0.smithi002.stdout:5/414: write d2/d2d/d10/d20/d24/f77 [519829,95750] 0 2024-09-17T01:01:57.266 INFO:tasks.workunit.client.0.smithi002.stdout:1/444: dwrite d4/d11/d1a/f29 [0,4194304] 0 2024-09-17T01:01:57.266 INFO:tasks.workunit.client.0.smithi002.stdout:2/476: link c10 d1b/d3f/d59/d7f/caf 0 2024-09-17T01:01:57.267 INFO:tasks.workunit.client.0.smithi002.stdout:4/553: mkdir d7/de/d3a/dac 0 2024-09-17T01:01:57.270 INFO:tasks.workunit.client.0.smithi002.stdout:2/477: link d1b/f5f d1b/d74/d93/d94/fb0 0 2024-09-17T01:01:57.270 INFO:tasks.workunit.client.0.smithi002.stdout:5/415: rmdir d2/d2d/d10/d14/d19/d39/d51 39 2024-09-17T01:01:57.271 INFO:tasks.workunit.client.0.smithi002.stdout:5/416: stat d2/d2d/d10/d14/d19/d39/d43/l56 0 2024-09-17T01:01:57.271 INFO:tasks.workunit.client.0.smithi002.stdout:5/417: creat d2/d2d/d10/d3b/f85 x:0 0 0 2024-09-17T01:01:57.272 INFO:tasks.workunit.client.0.smithi002.stdout:2/478: mkdir d1b/d37/d48/db1 0 2024-09-17T01:01:57.272 INFO:tasks.workunit.client.0.smithi002.stdout:2/479: fsync d1b/d37/d48/d78/f83 0 2024-09-17T01:01:57.272 INFO:tasks.workunit.client.0.smithi002.stdout:2/480: stat d1b/d37/c44 0 2024-09-17T01:01:57.272 INFO:tasks.workunit.client.0.smithi002.stdout:2/481: stat d1b/d37/d48/d78/daa/dac 0 2024-09-17T01:01:57.272 INFO:tasks.workunit.client.0.smithi002.stdout:2/482: chown d1b/d8a/d92/l97 1668 1 2024-09-17T01:01:57.272 INFO:tasks.workunit.client.0.smithi002.stdout:4/554: dread d7/de/d32/d8a/d77/d9b/f57 [0,4194304] 0 2024-09-17T01:01:57.273 INFO:tasks.workunit.client.0.smithi002.stdout:5/418: truncate d2/de/f4a 2497995 0 2024-09-17T01:01:57.273 INFO:tasks.workunit.client.0.smithi002.stdout:2/483: creat d1b/d1d/d79/fb2 x:0 0 0 2024-09-17T01:01:57.275 INFO:tasks.workunit.client.0.smithi002.stdout:4/555: unlink d7/d19/d9f/l6c 0 2024-09-17T01:01:57.275 INFO:tasks.workunit.client.0.smithi002.stdout:4/556: chown d7/d19/d9f/d9d/fa2 198923 1 2024-09-17T01:01:57.275 INFO:tasks.workunit.client.0.smithi002.stdout:4/557: chown d7/de/d32/l7f 1 1 2024-09-17T01:01:57.276 INFO:tasks.workunit.client.0.smithi002.stdout:4/558: truncate d7/de/f79 1320259 0 2024-09-17T01:01:57.278 INFO:tasks.workunit.client.0.smithi002.stdout:1/445: dread d4/d11/d12/d30/d5e/f60 [4194304,4194304] 0 2024-09-17T01:01:57.278 INFO:tasks.workunit.client.0.smithi002.stdout:4/559: mknod d7/de/d32/d8a/d77/d9b/cad 0 2024-09-17T01:01:57.278 INFO:tasks.workunit.client.0.smithi002.stdout:4/560: truncate d7/de/fa6 799538 0 2024-09-17T01:01:57.278 INFO:tasks.workunit.client.0.smithi002.stdout:1/446: truncate d4/d11/d12/d14/f2b 32227 0 2024-09-17T01:01:57.278 INFO:tasks.workunit.client.0.smithi002.stdout:1/447: fdatasync d4/d11/d12/d23/f64 0 2024-09-17T01:01:57.279 INFO:tasks.workunit.client.0.smithi002.stdout:1/448: write d4/d11/d12/d30/d43/d67/f98 [470508,99233] 0 2024-09-17T01:01:57.279 INFO:tasks.workunit.client.0.smithi002.stdout:4/561: dread d7/d19/d9f/d54/f81 [0,4194304] 0 2024-09-17T01:01:57.279 INFO:tasks.workunit.client.0.smithi002.stdout:4/562: stat d7/de/d3a/d99 0 2024-09-17T01:01:57.280 INFO:tasks.workunit.client.0.smithi002.stdout:5/419: write d2/d2d/d10/f66 [2408502,11322] 0 2024-09-17T01:01:57.280 INFO:tasks.workunit.client.0.smithi002.stdout:5/420: chown d2/d2d/d10/d14/d19/d39/d43/c47 1119169 1 2024-09-17T01:01:57.280 INFO:tasks.workunit.client.0.smithi002.stdout:4/563: creat d7/de/fae x:0 0 0 2024-09-17T01:01:57.283 INFO:tasks.workunit.client.0.smithi002.stdout:5/421: fdatasync d2/d2d/d10/d20/d24/f77 0 2024-09-17T01:01:57.287 INFO:tasks.workunit.client.0.smithi002.stdout:4/564: dread d7/f4f [0,4194304] 0 2024-09-17T01:01:57.287 INFO:tasks.workunit.client.0.smithi002.stdout:4/565: chown d7/d19/d9f/c3e 3107 1 2024-09-17T01:01:57.311 INFO:tasks.workunit.client.0.smithi002.stdout:1/449: write d4/d11/d12/d14/d17/d56/f6f [276434,28813] 0 2024-09-17T01:01:57.311 INFO:tasks.workunit.client.0.smithi002.stdout:9/361: dwrite d5/dc/d26/d46/d47/f48 [0,4194304] 0 2024-09-17T01:01:57.312 INFO:tasks.workunit.client.1.smithi099.stdout:0/448: sync 2024-09-17T01:01:57.312 INFO:tasks.workunit.client.1.smithi099.stdout:2/375: sync 2024-09-17T01:01:57.312 INFO:tasks.workunit.client.1.smithi099.stdout:2/376: chown d2/d9/d25/d26/f32 1945242 1 2024-09-17T01:01:57.312 INFO:tasks.workunit.client.1.smithi099.stdout:2/377: chown d2/d9/d25/d26/d1b/d61/c72 168 1 2024-09-17T01:01:57.314 INFO:tasks.workunit.client.1.smithi099.stdout:2/378: rmdir d2/d9/d25/d26/d1b/d2c/d3f 39 2024-09-17T01:01:57.314 INFO:tasks.workunit.client.1.smithi099.stdout:2/379: creat d2/d9/d25/d26/d1b/d2c/f77 x:0 0 0 2024-09-17T01:01:57.314 INFO:tasks.workunit.client.1.smithi099.stdout:2/380: chown d2/d9/d25/d26/d1b/c70 115664002 1 2024-09-17T01:01:57.316 INFO:tasks.workunit.client.0.smithi002.stdout:7/432: rename d1/f11 to d1/d14/d1d/d28/d40/d58/f8c 0 2024-09-17T01:01:57.318 INFO:tasks.workunit.client.0.smithi002.stdout:4/566: rename d7/d19/d9f/d80/d62/c2b to d7/d19/caf 0 2024-09-17T01:01:57.321 INFO:tasks.workunit.client.0.smithi002.stdout:7/433: symlink d1/d14/d1d/d28/d6b/l8d 0 2024-09-17T01:01:57.323 INFO:tasks.workunit.client.0.smithi002.stdout:4/567: dread d7/d19/d9f/d54/f81 [0,4194304] 0 2024-09-17T01:01:57.323 INFO:tasks.workunit.client.0.smithi002.stdout:3/478: dwrite d0/d3/f1a [8388608,4194304] 0 2024-09-17T01:01:57.323 INFO:tasks.workunit.client.0.smithi002.stdout:9/362: rename d5/dc/d26/d5c/f61 to d5/dc/d26/d34/f62 0 2024-09-17T01:01:57.323 INFO:tasks.workunit.client.0.smithi002.stdout:9/363: readlink d5/dc/d26/d34/d36/l60 0 2024-09-17T01:01:57.323 INFO:tasks.workunit.client.0.smithi002.stdout:9/364: chown d5/dc/c5e 391 1 2024-09-17T01:01:57.324 INFO:tasks.workunit.client.0.smithi002.stdout:9/365: fdatasync d5/dc/d26/f2d 0 2024-09-17T01:01:57.327 INFO:tasks.workunit.client.0.smithi002.stdout:9/366: mkdir d5/dc/d26/d63 0 2024-09-17T01:01:57.331 INFO:tasks.workunit.client.0.smithi002.stdout:9/367: creat d5/dc/d26/d34/d57/f64 x:0 0 0 2024-09-17T01:01:57.332 INFO:tasks.workunit.client.0.smithi002.stdout:9/368: mknod d5/dc/c65 0 2024-09-17T01:01:57.333 INFO:tasks.workunit.client.0.smithi002.stdout:3/479: write d0/d3/f24 [2899052,46670] 0 2024-09-17T01:01:57.333 INFO:tasks.workunit.client.0.smithi002.stdout:3/480: stat d0/d3/d80/da1 0 2024-09-17T01:01:57.334 INFO:tasks.workunit.client.0.smithi002.stdout:2/484: write d1b/d1d/f6e [4978659,92514] 0 2024-09-17T01:01:57.335 INFO:tasks.workunit.client.0.smithi002.stdout:2/485: symlink d1b/d1d/lb3 0 2024-09-17T01:01:57.336 INFO:tasks.workunit.client.0.smithi002.stdout:3/481: getdents d0/d3/d33 0 2024-09-17T01:01:57.339 INFO:tasks.workunit.client.0.smithi002.stdout:2/486: unlink d1b/d37/d48/d78/daa/l8f 0 2024-09-17T01:01:57.341 INFO:tasks.workunit.client.0.smithi002.stdout:3/482: write d0/f23 [412068,75933] 0 2024-09-17T01:01:57.341 INFO:tasks.workunit.client.0.smithi002.stdout:2/487: mknod d1b/d74/d93/cb4 0 2024-09-17T01:01:57.342 INFO:tasks.workunit.client.0.smithi002.stdout:3/483: mknod d0/d3/d33/d4a/ca6 0 2024-09-17T01:01:57.345 INFO:tasks.workunit.client.0.smithi002.stdout:2/488: getdents d1b/d37/d48/d4e 0 2024-09-17T01:01:57.348 INFO:tasks.workunit.client.0.smithi002.stdout:2/489: mkdir d1b/d37/d48/d52/db5 0 2024-09-17T01:01:57.348 INFO:tasks.workunit.client.0.smithi002.stdout:2/490: write d1b/d37/d48/d52/fa2 [195195,20268] 0 2024-09-17T01:01:57.349 INFO:tasks.workunit.client.0.smithi002.stdout:2/491: symlink d1b/d8a/dab/lb6 0 2024-09-17T01:01:57.351 INFO:tasks.workunit.client.0.smithi002.stdout:5/422: truncate d2/d2d/d10/d20/d24/f77 4007750 0 2024-09-17T01:01:57.354 INFO:tasks.workunit.client.1.smithi099.stdout:0/449: dwrite da/df/d1a/d56/f74 [0,4194304] 0 2024-09-17T01:01:57.356 INFO:tasks.workunit.client.1.smithi099.stdout:0/450: mkdir da/df/d1a/d23/d92 0 2024-09-17T01:01:57.358 INFO:tasks.workunit.client.0.smithi002.stdout:7/434: dwrite d1/d14/d1d/d28/d40/d58/f62 [0,4194304] 0 2024-09-17T01:01:57.358 INFO:tasks.workunit.client.0.smithi002.stdout:7/435: write d1/d14/d1d/d28/d6b/f83 [126862,69868] 0 2024-09-17T01:01:57.359 INFO:tasks.workunit.client.1.smithi099.stdout:0/451: rename da/df/d31/f54 to da/df/d1a/d56/d72/f93 0 2024-09-17T01:01:57.359 INFO:tasks.workunit.client.1.smithi099.stdout:2/381: dwrite d2/d9/d17/f76 [0,4194304] 0 2024-09-17T01:01:57.359 INFO:tasks.workunit.client.1.smithi099.stdout:2/382: creat d2/d9/d17/f78 x:0 0 0 2024-09-17T01:01:57.359 INFO:tasks.workunit.client.1.smithi099.stdout:2/383: creat d2/d9/d25/d26/d1b/d2c/f79 x:0 0 0 2024-09-17T01:01:57.359 INFO:tasks.workunit.client.1.smithi099.stdout:2/384: write d2/d9/d25/f75 [543984,45337] 0 2024-09-17T01:01:57.360 INFO:tasks.workunit.client.0.smithi002.stdout:4/568: dwrite d7/de/f2a [4194304,4194304] 0 2024-09-17T01:01:57.361 INFO:tasks.workunit.client.0.smithi002.stdout:7/436: mknod d1/d14/d1d/d29/d30/d54/c8e 0 2024-09-17T01:01:57.361 INFO:tasks.workunit.client.0.smithi002.stdout:7/437: write d1/d24/f31 [1567216,33509] 0 2024-09-17T01:01:57.362 INFO:tasks.workunit.client.0.smithi002.stdout:7/438: mkdir d1/d14/d1d/d28/d8f 0 2024-09-17T01:01:57.362 INFO:tasks.workunit.client.0.smithi002.stdout:7/439: readlink d1/d14/d1d/d29/l4a 0 2024-09-17T01:01:57.362 INFO:tasks.workunit.client.0.smithi002.stdout:7/440: fsync d1/d14/d1d/d28/f79 0 2024-09-17T01:01:57.362 INFO:tasks.workunit.client.0.smithi002.stdout:1/450: dwrite d4/d11/d12/d30/d43/f4d [0,4194304] 0 2024-09-17T01:01:57.363 INFO:tasks.workunit.client.0.smithi002.stdout:7/441: creat d1/d14/d1d/d29/d30/f90 x:0 0 0 2024-09-17T01:01:57.364 INFO:tasks.workunit.client.1.smithi099.stdout:2/385: getdents d2/d9/d25 0 2024-09-17T01:01:57.364 INFO:tasks.workunit.client.1.smithi099.stdout:2/386: rename d2/d9 to d2/d9/d25/d26/d1b/d2c/d5d/d7a 22 2024-09-17T01:01:57.364 INFO:tasks.workunit.client.1.smithi099.stdout:2/387: fdatasync d2/d9/d25/d26/d1b/d2c/d5d/f64 0 2024-09-17T01:01:57.364 INFO:tasks.workunit.client.0.smithi002.stdout:7/442: creat d1/d14/d1d/d29/d57/f91 x:0 0 0 2024-09-17T01:01:57.364 INFO:tasks.workunit.client.0.smithi002.stdout:7/443: fdatasync d1/d14/d1d/d28/d2d/f68 0 2024-09-17T01:01:57.365 INFO:tasks.workunit.client.1.smithi099.stdout:2/388: truncate d2/d9/d25/d26/f32 759005 0 2024-09-17T01:01:57.365 INFO:tasks.workunit.client.1.smithi099.stdout:2/389: dread - d2/d9/d25/d26/d1b/d2c/f79 zero size 2024-09-17T01:01:57.366 INFO:tasks.workunit.client.1.smithi099.stdout:2/390: creat d2/d9/d25/f7b x:0 0 0 2024-09-17T01:01:57.366 INFO:tasks.workunit.client.0.smithi002.stdout:5/423: dread d2/de/f1f [0,4194304] 0 2024-09-17T01:01:57.366 INFO:tasks.workunit.client.0.smithi002.stdout:5/424: read d2/f6 [429549,47755] 0 2024-09-17T01:01:57.371 INFO:tasks.workunit.client.0.smithi002.stdout:1/451: dread d4/d11/d12/d14/d17/d56/f8e [0,4194304] 0 2024-09-17T01:01:57.371 INFO:tasks.workunit.client.0.smithi002.stdout:1/452: write d4/d11/d12/f3d [4752755,46998] 0 2024-09-17T01:01:57.372 INFO:tasks.workunit.client.0.smithi002.stdout:1/453: readlink d4/d11/d12/d14/l33 0 2024-09-17T01:01:57.372 INFO:tasks.workunit.client.1.smithi099.stdout:0/452: dread da/df/d1a/d23/f40 [0,4194304] 0 2024-09-17T01:01:57.373 INFO:tasks.workunit.client.1.smithi099.stdout:0/453: truncate da/f27 4153401 0 2024-09-17T01:01:57.373 INFO:tasks.workunit.client.0.smithi002.stdout:9/369: fsync d5/dc/d26/d34/d57/f64 0 2024-09-17T01:01:57.375 INFO:tasks.workunit.client.0.smithi002.stdout:2/492: dwrite ff [0,4194304] 0 2024-09-17T01:01:57.378 INFO:tasks.workunit.client.1.smithi099.stdout:2/391: dread d2/d9/d25/d26/f29 [0,4194304] 0 2024-09-17T01:01:57.379 INFO:tasks.workunit.client.1.smithi099.stdout:2/392: creat d2/d9/d25/d26/d1b/f7c x:0 0 0 2024-09-17T01:01:57.380 INFO:tasks.workunit.client.1.smithi099.stdout:2/393: mkdir d2/d9/d25/d26/d1b/d61/d7d 0 2024-09-17T01:01:57.380 INFO:tasks.workunit.client.1.smithi099.stdout:2/394: write d2/d9/d25/d26/f6b [795191,16860] 0 2024-09-17T01:01:57.381 INFO:tasks.workunit.client.0.smithi002.stdout:7/444: link d1/d14/d1d/d28/d2d/f70 d1/d14/d1d/d28/d40/f92 0 2024-09-17T01:01:57.384 INFO:tasks.workunit.client.0.smithi002.stdout:9/370: dread d5/dc/d26/d46/f58 [0,4194304] 0 2024-09-17T01:01:57.384 INFO:tasks.workunit.client.0.smithi002.stdout:9/371: fdatasync d5/dc/f4e 0 2024-09-17T01:01:57.385 INFO:tasks.workunit.client.0.smithi002.stdout:2/493: symlink d1b/d8a/d92/lb7 0 2024-09-17T01:01:57.386 INFO:tasks.workunit.client.0.smithi002.stdout:2/494: read d1b/d37/f60 [235504,102924] 0 2024-09-17T01:01:57.387 INFO:tasks.workunit.client.0.smithi002.stdout:7/445: symlink d1/d14/d1d/d28/d6b/l93 0 2024-09-17T01:01:57.388 INFO:tasks.workunit.client.0.smithi002.stdout:4/569: dwrite d7/de/fa6 [0,4194304] 0 2024-09-17T01:01:57.391 INFO:tasks.workunit.client.0.smithi002.stdout:1/454: dwrite d4/d11/d12/d30/f7f [0,4194304] 0 2024-09-17T01:01:57.391 INFO:tasks.workunit.client.0.smithi002.stdout:1/455: read d4/fa [326982,7615] 0 2024-09-17T01:01:57.393 INFO:tasks.workunit.client.0.smithi002.stdout:2/495: mknod d1b/d3f/d59/cb8 0 2024-09-17T01:01:57.398 INFO:tasks.workunit.client.0.smithi002.stdout:4/570: dread d7/de/f79 [0,4194304] 0 2024-09-17T01:01:57.399 INFO:tasks.workunit.client.0.smithi002.stdout:1/456: creat d4/d11/d12/d14/fa0 x:0 0 0 2024-09-17T01:01:57.400 INFO:tasks.workunit.client.0.smithi002.stdout:1/457: readlink d4/d11/d12/d14/d17/l4a 0 2024-09-17T01:01:57.401 INFO:tasks.workunit.client.0.smithi002.stdout:2/496: dread d1b/d37/d48/d78/daa/f46 [0,4194304] 0 2024-09-17T01:01:57.401 INFO:tasks.workunit.client.0.smithi002.stdout:4/571: creat d7/d71/d8e/d95/fb0 x:0 0 0 2024-09-17T01:01:57.402 INFO:tasks.workunit.client.0.smithi002.stdout:1/458: truncate d4/d11/d12/d30/d5e/f60 4825414 0 2024-09-17T01:01:57.403 INFO:tasks.workunit.client.0.smithi002.stdout:1/459: getdents d4/d11/d12/d14/d17/d51/d88 0 2024-09-17T01:01:57.403 INFO:tasks.workunit.client.1.smithi099.stdout:2/395: dwrite d2/d9/d17/f78 [0,4194304] 0 2024-09-17T01:01:57.403 INFO:tasks.workunit.client.1.smithi099.stdout:2/396: readlink d2/d9/d25/d26/d1b/l3b 0 2024-09-17T01:01:57.404 INFO:tasks.workunit.client.0.smithi002.stdout:2/497: creat d1b/d74/d93/d94/fb9 x:0 0 0 2024-09-17T01:01:57.404 INFO:tasks.workunit.client.0.smithi002.stdout:2/498: chown d1b/d74/d93/d94 53532073 1 2024-09-17T01:01:57.405 INFO:tasks.workunit.client.1.smithi099.stdout:2/397: mknod d2/d9/d25/c7e 0 2024-09-17T01:01:57.405 INFO:tasks.workunit.client.1.smithi099.stdout:2/398: dread - d2/d9/d25/d26/d1b/d61/f6f zero size 2024-09-17T01:01:57.409 INFO:tasks.workunit.client.1.smithi099.stdout:2/399: getdents d2/d9/d17 0 2024-09-17T01:01:57.409 INFO:tasks.workunit.client.1.smithi099.stdout:2/400: truncate d2/d9/d17/f69 1120749 0 2024-09-17T01:01:57.409 INFO:tasks.workunit.client.1.smithi099.stdout:2/401: fdatasync d2/d9/d25/f75 0 2024-09-17T01:01:57.409 INFO:tasks.workunit.client.1.smithi099.stdout:2/402: truncate d2/d9/d17/f78 4432914 0 2024-09-17T01:01:57.410 INFO:tasks.workunit.client.1.smithi099.stdout:2/403: symlink d2/d9/l7f 0 2024-09-17T01:01:57.410 INFO:tasks.workunit.client.1.smithi099.stdout:2/404: stat d2/d9/f60 0 2024-09-17T01:01:57.410 INFO:tasks.workunit.client.1.smithi099.stdout:2/405: mknod d2/d9/d25/d26/d1b/d2c/d5d/c80 0 2024-09-17T01:01:57.410 INFO:tasks.workunit.client.0.smithi002.stdout:2/499: unlink d1b/c20 0 2024-09-17T01:01:57.411 INFO:tasks.workunit.client.0.smithi002.stdout:2/500: truncate d1b/f1c 4412024 0 2024-09-17T01:01:57.411 INFO:tasks.workunit.client.0.smithi002.stdout:2/501: write d1b/d37/f42 [631378,83219] 0 2024-09-17T01:01:57.411 INFO:tasks.workunit.client.0.smithi002.stdout:2/502: link d1b/d8b/fa8 d1b/d37/d48/fba 0 2024-09-17T01:01:57.413 INFO:tasks.workunit.client.0.smithi002.stdout:1/460: dread d4/d11/d12/d14/d17/f28 [0,4194304] 0 2024-09-17T01:01:57.414 INFO:tasks.workunit.client.0.smithi002.stdout:7/446: rmdir d1/d14/d1d/d28/d2d 39 2024-09-17T01:01:57.414 INFO:tasks.workunit.client.0.smithi002.stdout:7/447: write d1/d14/d1d/d29/d30/f53 [1088056,110587] 0 2024-09-17T01:01:57.415 INFO:tasks.workunit.client.0.smithi002.stdout:1/461: symlink d4/d11/d55/d7a/la1 0 2024-09-17T01:01:57.416 INFO:tasks.workunit.client.0.smithi002.stdout:4/572: dwrite d7/f4f [0,4194304] 0 2024-09-17T01:01:57.418 INFO:tasks.workunit.client.0.smithi002.stdout:9/372: dwrite d5/f18 [4194304,4194304] 0 2024-09-17T01:01:57.419 INFO:tasks.workunit.client.1.smithi099.stdout:2/406: write d2/d9/d17/f76 [2727068,40364] 0 2024-09-17T01:01:57.419 INFO:tasks.workunit.client.1.smithi099.stdout:2/407: write d2/d9/d25/d26/d1b/d61/f6f [417323,6656] 0 2024-09-17T01:01:57.419 INFO:tasks.workunit.client.1.smithi099.stdout:2/408: chown d2/d9/d25/d26/f20 2326206 1 2024-09-17T01:01:57.419 INFO:tasks.workunit.client.1.smithi099.stdout:2/409: fdatasync d2/d9/d25/d26/f33 0 2024-09-17T01:01:57.420 INFO:tasks.workunit.client.1.smithi099.stdout:2/410: read - d2/d9/d25/d26/d1b/f7c zero size 2024-09-17T01:01:57.421 INFO:tasks.workunit.client.1.smithi099.stdout:2/411: getdents d2/d9/d25/d26 0 2024-09-17T01:01:57.421 INFO:tasks.workunit.client.1.smithi099.stdout:2/412: chown d2/d9/d25/d26/f29 22474 1 2024-09-17T01:01:57.421 INFO:tasks.workunit.client.1.smithi099.stdout:2/413: write d2/d9/d25/f75 [1376576,16881] 0 2024-09-17T01:01:57.426 INFO:tasks.workunit.client.0.smithi002.stdout:9/373: mkdir d5/dc/d26/d63/d66 0 2024-09-17T01:01:57.426 INFO:tasks.workunit.client.0.smithi002.stdout:9/374: read - d5/dc/d26/d34/f56 zero size 2024-09-17T01:01:57.427 INFO:tasks.workunit.client.0.smithi002.stdout:7/448: dread d1/f20 [0,4194304] 0 2024-09-17T01:01:57.428 INFO:tasks.workunit.client.0.smithi002.stdout:9/375: creat d5/dc/d26/d34/d36/f67 x:0 0 0 2024-09-17T01:01:57.428 INFO:tasks.workunit.client.0.smithi002.stdout:9/376: write d5/dc/d26/d34/d57/f64 [316014,55898] 0 2024-09-17T01:01:57.428 INFO:tasks.workunit.client.0.smithi002.stdout:9/377: creat d5/dc/f68 x:0 0 0 2024-09-17T01:01:57.431 INFO:tasks.workunit.client.0.smithi002.stdout:2/503: dwrite d1b/d74/d93/d94/fb9 [0,4194304] 0 2024-09-17T01:01:57.437 INFO:tasks.workunit.client.0.smithi002.stdout:2/504: mkdir d1b/d37/d48/db1/dbb 0 2024-09-17T01:01:57.438 INFO:tasks.workunit.client.0.smithi002.stdout:7/449: truncate d1/d14/d1d/d29/d30/f53 980169 0 2024-09-17T01:01:57.440 INFO:tasks.workunit.client.0.smithi002.stdout:7/450: symlink d1/d14/d1d/d21/d45/l94 0 2024-09-17T01:01:57.441 INFO:tasks.workunit.client.0.smithi002.stdout:7/451: mknod d1/d14/d1d/d28/d86/c95 0 2024-09-17T01:01:57.442 INFO:tasks.workunit.client.0.smithi002.stdout:7/452: truncate d1/d14/d1d/d29/f2f 1659895 0 2024-09-17T01:01:57.443 INFO:tasks.workunit.client.0.smithi002.stdout:7/453: write d1/d14/d1d/d21/f63 [191092,37526] 0 2024-09-17T01:01:57.446 INFO:tasks.workunit.client.0.smithi002.stdout:2/505: dread ff [0,4194304] 0 2024-09-17T01:01:57.449 INFO:tasks.workunit.client.0.smithi002.stdout:2/506: rename d1b/d1d/d79/f5c to d1b/d37/d48/d78/daa/dac/fbc 0 2024-09-17T01:01:57.453 INFO:tasks.workunit.client.0.smithi002.stdout:1/462: dwrite d4/d11/d12/d14/fa0 [0,4194304] 0 2024-09-17T01:01:57.453 INFO:tasks.workunit.client.0.smithi002.stdout:9/378: dwrite d5/dc/d26/f3b [0,4194304] 0 2024-09-17T01:01:57.454 INFO:tasks.workunit.client.1.smithi099.stdout:2/414: dwrite d2/d9/d25/d26/d1b/d2c/f36 [4194304,4194304] 0 2024-09-17T01:01:57.454 INFO:tasks.workunit.client.1.smithi099.stdout:2/415: truncate d2/d9/d25/f2e 5175135 0 2024-09-17T01:01:57.454 INFO:tasks.workunit.client.0.smithi002.stdout:4/573: dwrite d7/de/d32/d8a/d77/d9b/f50 [4194304,4194304] 0 2024-09-17T01:01:57.454 INFO:tasks.workunit.client.0.smithi002.stdout:4/574: stat d7/de/d32/d8a/d77/l83 0 2024-09-17T01:01:57.454 INFO:tasks.workunit.client.0.smithi002.stdout:4/575: stat d7/de/d3a/dac 0 2024-09-17T01:01:57.454 INFO:tasks.workunit.client.0.smithi002.stdout:7/454: dread d1/d14/d1d/d28/d2d/f35 [0,4194304] 0 2024-09-17T01:01:57.455 INFO:tasks.workunit.client.1.smithi099.stdout:4/459: sync 2024-09-17T01:01:57.455 INFO:tasks.workunit.client.1.smithi099.stdout:4/460: chown d7/dd/d21/d26/d3f/l5f 640719038 1 2024-09-17T01:01:57.456 INFO:tasks.workunit.client.1.smithi099.stdout:4/461: mknod d7/dd/d21/d7b/c9f 0 2024-09-17T01:01:57.458 INFO:tasks.workunit.client.0.smithi002.stdout:2/507: write d1b/d1d/f33 [59683,69715] 0 2024-09-17T01:01:57.459 INFO:tasks.workunit.client.0.smithi002.stdout:2/508: fdatasync d1b/d37/fa5 0 2024-09-17T01:01:57.460 INFO:tasks.workunit.client.0.smithi002.stdout:9/379: dread d5/f4f [0,4194304] 0 2024-09-17T01:01:57.460 INFO:tasks.workunit.client.0.smithi002.stdout:9/380: stat d5/dc/d26/f31 0 2024-09-17T01:01:57.460 INFO:tasks.workunit.client.0.smithi002.stdout:9/381: dread - d5/dc/d26/d34/d36/f67 zero size 2024-09-17T01:01:57.463 INFO:tasks.workunit.client.0.smithi002.stdout:7/455: rmdir d1/d14/d1d/d28/d6b 39 2024-09-17T01:01:57.463 INFO:tasks.workunit.client.0.smithi002.stdout:7/456: write d1/d14/d1d/d21/d45/f43 [3641263,95057] 0 2024-09-17T01:01:57.463 INFO:tasks.workunit.client.0.smithi002.stdout:4/576: read d7/d19/d2e/f46 [1240585,27554] 0 2024-09-17T01:01:57.463 INFO:tasks.workunit.client.0.smithi002.stdout:4/577: readlink d7/d19/l4e 0 2024-09-17T01:01:57.463 INFO:tasks.workunit.client.1.smithi099.stdout:4/462: rename d7/dd/d21/d7b/f43 to d7/dd/de/d10/d85/fa0 0 2024-09-17T01:01:57.465 INFO:tasks.workunit.client.0.smithi002.stdout:9/382: link d5/dc/d26/d34/f3c d5/dc/f69 0 2024-09-17T01:01:57.471 INFO:tasks.workunit.client.1.smithi099.stdout:2/416: dwrite d2/d9/d25/d26/d1b/d2c/f3d [0,4194304] 0 2024-09-17T01:01:57.471 INFO:tasks.workunit.client.1.smithi099.stdout:2/417: chown d2/d9/d25/d26/d1b/l28 6479 1 2024-09-17T01:01:57.471 INFO:tasks.workunit.client.1.smithi099.stdout:2/418: fdatasync d2/d9/d25/d26/f50 0 2024-09-17T01:01:57.473 INFO:tasks.workunit.client.0.smithi002.stdout:7/457: link d1/d14/d1d/d28/d40/d58/c87 d1/d14/d1d/d28/d2d/c96 0 2024-09-17T01:01:57.476 INFO:tasks.workunit.client.1.smithi099.stdout:2/419: dread d2/d9/d25/f2d [0,4194304] 0 2024-09-17T01:01:57.476 INFO:tasks.workunit.client.1.smithi099.stdout:2/420: chown d2/d9/d17/d58/c5f 161 1 2024-09-17T01:01:57.476 INFO:tasks.workunit.client.1.smithi099.stdout:2/421: fsync d2/d9/d25/d26/d1b/d2c/f48 0 2024-09-17T01:01:57.478 INFO:tasks.workunit.client.1.smithi099.stdout:2/422: symlink d2/l81 0 2024-09-17T01:01:57.478 INFO:tasks.workunit.client.1.smithi099.stdout:4/463: dread d7/fc [4194304,4194304] 0 2024-09-17T01:01:57.479 INFO:tasks.workunit.client.0.smithi002.stdout:1/463: dwrite d4/d11/d12/d14/d17/d40/f69 [0,4194304] 0 2024-09-17T01:01:57.481 INFO:tasks.workunit.client.1.smithi099.stdout:2/423: rename d2/d9/d25/d26/d1b/d2c/d3f/l4c to d2/l82 0 2024-09-17T01:01:57.482 INFO:tasks.workunit.client.0.smithi002.stdout:7/458: write d1/d14/d1d/d28/d2d/f35 [2514013,83592] 0 2024-09-17T01:01:57.482 INFO:tasks.workunit.client.0.smithi002.stdout:7/459: write d1/d14/d1d/d28/d40/d58/f62 [4252235,2641] 0 2024-09-17T01:01:57.482 INFO:tasks.workunit.client.0.smithi002.stdout:7/460: truncate d1/d14/d1d/d29/d30/d54/f73 1274112 0 2024-09-17T01:01:57.483 INFO:tasks.workunit.client.1.smithi099.stdout:4/464: truncate d7/dd/de/ff 7502905 0 2024-09-17T01:01:57.483 INFO:tasks.workunit.client.0.smithi002.stdout:1/464: creat d4/d11/d12/d14/d17/d20/fa2 x:0 0 0 2024-09-17T01:01:57.483 INFO:tasks.workunit.client.1.smithi099.stdout:4/465: symlink d7/dd/de/d10/d6b/la1 0 2024-09-17T01:01:57.484 INFO:tasks.workunit.client.1.smithi099.stdout:4/466: write d7/dd/de/f4e [1738868,119405] 0 2024-09-17T01:01:57.485 INFO:tasks.workunit.client.1.smithi099.stdout:2/424: dread d2/d9/d25/d26/d1b/d61/f6f [0,4194304] 0 2024-09-17T01:01:57.485 INFO:tasks.workunit.client.0.smithi002.stdout:1/465: mkdir d4/d11/d12/d14/d17/d51/d88/da3 0 2024-09-17T01:01:57.485 INFO:tasks.workunit.client.0.smithi002.stdout:1/466: write - open d4/d11/d12/d14/d17/d3b/f42 failed 14 2024-09-17T01:01:57.486 INFO:tasks.workunit.client.0.smithi002.stdout:1/467: fsync d4/d11/d12/d23/d32/f84 0 2024-09-17T01:01:57.486 INFO:tasks.workunit.client.0.smithi002.stdout:1/468: fsync d4/d11/d12/d30/d43/f4d 0 2024-09-17T01:01:57.486 INFO:tasks.workunit.client.1.smithi099.stdout:2/425: mkdir d2/d9/d17/d83 0 2024-09-17T01:01:57.492 INFO:tasks.workunit.client.0.smithi002.stdout:2/509: dwrite d1b/d37/fa5 [0,4194304] 0 2024-09-17T01:01:57.492 INFO:tasks.workunit.client.0.smithi002.stdout:9/383: dwrite d5/dc/f4e [0,4194304] 0 2024-09-17T01:01:57.492 INFO:tasks.workunit.client.0.smithi002.stdout:1/469: dread d4/d22/f39 [0,4194304] 0 2024-09-17T01:01:57.492 INFO:tasks.workunit.client.0.smithi002.stdout:1/470: dread - d4/d11/d12/d23/f85 zero size 2024-09-17T01:01:57.493 INFO:tasks.workunit.client.0.smithi002.stdout:4/578: dwrite d7/f18 [0,4194304] 0 2024-09-17T01:01:57.493 INFO:tasks.workunit.client.0.smithi002.stdout:4/579: chown d7/d19/d2e/f33 3370193 1 2024-09-17T01:01:57.494 INFO:tasks.workunit.client.0.smithi002.stdout:2/510: mkdir d1b/d37/d48/d78/daa/dac/dbd 0 2024-09-17T01:01:57.495 INFO:tasks.workunit.client.0.smithi002.stdout:9/384: mkdir d5/dc/d26/d34/d57/d6a 0 2024-09-17T01:01:57.496 INFO:tasks.workunit.client.0.smithi002.stdout:1/471: mknod d4/d11/d12/d14/ca4 0 2024-09-17T01:01:57.497 INFO:tasks.workunit.client.0.smithi002.stdout:1/472: read - d4/d11/d12/d23/d32/f84 zero size 2024-09-17T01:01:57.497 INFO:tasks.workunit.client.0.smithi002.stdout:1/473: creat d4/d11/d55/d7a/fa5 x:0 0 0 2024-09-17T01:01:57.497 INFO:tasks.workunit.client.0.smithi002.stdout:1/474: write d4/d11/d12/d14/f2b [587850,67485] 0 2024-09-17T01:01:57.499 INFO:tasks.workunit.client.1.smithi099.stdout:2/426: getdents d2/d9/d25/d26/d1b/d2c/d3f 0 2024-09-17T01:01:57.499 INFO:tasks.workunit.client.1.smithi099.stdout:2/427: fdatasync d2/d9/d25/f75 0 2024-09-17T01:01:57.499 INFO:tasks.workunit.client.0.smithi002.stdout:9/385: mkdir d5/dc/d26/d5c/d6b 0 2024-09-17T01:01:57.499 INFO:tasks.workunit.client.0.smithi002.stdout:9/386: write d5/dc/f3d [4706100,75281] 0 2024-09-17T01:01:57.499 INFO:tasks.workunit.client.0.smithi002.stdout:9/387: truncate d5/dc/f68 369828 0 2024-09-17T01:01:57.500 INFO:tasks.workunit.client.1.smithi099.stdout:4/467: write f2 [7638470,91200] 0 2024-09-17T01:01:57.500 INFO:tasks.workunit.client.1.smithi099.stdout:4/468: dread - d7/dd/f9d zero size 2024-09-17T01:01:57.503 INFO:tasks.workunit.client.0.smithi002.stdout:1/475: rename d4/d11/d1c/c2c to d4/d22/d8d/ca6 0 2024-09-17T01:01:57.504 INFO:tasks.workunit.client.1.smithi099.stdout:4/469: truncate d7/dd/d21/d7b/d4b/f3e 1899987 0 2024-09-17T01:01:57.506 INFO:tasks.workunit.client.0.smithi002.stdout:9/388: mkdir d5/dc/d26/d5c/d6c 0 2024-09-17T01:01:57.506 INFO:tasks.workunit.client.0.smithi002.stdout:9/389: fdatasync d5/dc/d26/d34/f62 0 2024-09-17T01:01:57.506 INFO:tasks.workunit.client.0.smithi002.stdout:6/465: sync 2024-09-17T01:01:57.506 INFO:tasks.workunit.client.0.smithi002.stdout:8/578: sync 2024-09-17T01:01:57.506 INFO:tasks.workunit.client.0.smithi002.stdout:0/330: sync 2024-09-17T01:01:57.506 INFO:tasks.workunit.client.0.smithi002.stdout:3/484: sync 2024-09-17T01:01:57.508 INFO:tasks.workunit.client.0.smithi002.stdout:7/461: dwrite d1/d14/d1d/d29/d30/d54/f66 [0,4194304] 0 2024-09-17T01:01:57.511 INFO:tasks.workunit.client.0.smithi002.stdout:0/331: unlink l6 0 2024-09-17T01:01:57.511 INFO:tasks.workunit.client.0.smithi002.stdout:0/332: read - dd/d19/d1c/d1f/d22/f6b zero size 2024-09-17T01:01:57.511 INFO:tasks.workunit.client.0.smithi002.stdout:0/333: chown dd/d19/f24 2 1 2024-09-17T01:01:57.513 INFO:tasks.workunit.client.0.smithi002.stdout:8/579: creat d2/d1c/fc8 x:0 0 0 2024-09-17T01:01:57.513 INFO:tasks.workunit.client.0.smithi002.stdout:8/580: read - d2/d3/d5f/d98/da5/d4f/d77/d78/fc5 zero size 2024-09-17T01:01:57.517 INFO:tasks.workunit.client.0.smithi002.stdout:3/485: dread d0/d3/f8 [0,4194304] 0 2024-09-17T01:01:57.517 INFO:tasks.workunit.client.0.smithi002.stdout:3/486: readlink d0/d3/l41 0 2024-09-17T01:01:57.517 INFO:tasks.workunit.client.0.smithi002.stdout:3/487: dread - d0/d31/d8b/d9d/fa5 zero size 2024-09-17T01:01:57.519 INFO:tasks.workunit.client.0.smithi002.stdout:7/462: creat d1/d14/d1d/d28/d86/f97 x:0 0 0 2024-09-17T01:01:57.519 INFO:tasks.workunit.client.0.smithi002.stdout:7/463: stat d1/d14/d1d 0 2024-09-17T01:01:57.520 INFO:tasks.workunit.client.0.smithi002.stdout:8/581: symlink d2/d3/d5f/d98/da5/lc9 0 2024-09-17T01:01:57.520 INFO:tasks.workunit.client.0.smithi002.stdout:8/582: stat d2/d3/d5f/d98/da5/f65 0 2024-09-17T01:01:57.520 INFO:tasks.workunit.client.0.smithi002.stdout:8/583: readlink d2/d3/d5f/d98/da5/lc9 0 2024-09-17T01:01:57.521 INFO:tasks.workunit.client.1.smithi099.stdout:2/428: dwrite d2/f47 [0,4194304] 0 2024-09-17T01:01:57.521 INFO:tasks.workunit.client.0.smithi002.stdout:0/334: write dd/d19/f1b [830522,18223] 0 2024-09-17T01:01:57.521 INFO:tasks.workunit.client.0.smithi002.stdout:0/335: readlink dd/d44/l69 0 2024-09-17T01:01:57.522 INFO:tasks.workunit.client.0.smithi002.stdout:0/336: creat dd/d19/d1a/f70 x:0 0 0 2024-09-17T01:01:57.522 INFO:tasks.workunit.client.0.smithi002.stdout:0/337: creat dd/d3d/f71 x:0 0 0 2024-09-17T01:01:57.522 INFO:tasks.workunit.client.0.smithi002.stdout:0/338: write dd/d19/f24 [1042615,121149] 0 2024-09-17T01:01:57.522 INFO:tasks.workunit.client.0.smithi002.stdout:3/488: mkdir d0/d31/da7 0 2024-09-17T01:01:57.522 INFO:tasks.workunit.client.0.smithi002.stdout:7/464: mkdir d1/d14/d1d/d29/d98 0 2024-09-17T01:01:57.523 INFO:tasks.workunit.client.0.smithi002.stdout:9/390: write d5/f1d [1849779,1432] 0 2024-09-17T01:01:57.524 INFO:tasks.workunit.client.1.smithi099.stdout:2/429: mknod d2/d9/d17/c84 0 2024-09-17T01:01:57.524 INFO:tasks.workunit.client.1.smithi099.stdout:2/430: write d2/d7/f3a [709652,82188] 0 2024-09-17T01:01:57.524 INFO:tasks.workunit.client.1.smithi099.stdout:2/431: write d2/d9/d25/d26/f32 [1177064,90858] 0 2024-09-17T01:01:57.524 INFO:tasks.workunit.client.0.smithi002.stdout:8/584: symlink d2/d30/lca 0 2024-09-17T01:01:57.524 INFO:tasks.workunit.client.0.smithi002.stdout:8/585: fdatasync d2/d41/f54 0 2024-09-17T01:01:57.525 INFO:tasks.workunit.client.1.smithi099.stdout:2/432: mkdir d2/d9/d25/d26/d1b/d61/d7d/d85 0 2024-09-17T01:01:57.526 INFO:tasks.workunit.client.0.smithi002.stdout:5/425: sync 2024-09-17T01:01:57.531 INFO:tasks.workunit.client.0.smithi002.stdout:7/465: mknod d1/d24/c99 0 2024-09-17T01:01:57.531 INFO:tasks.workunit.client.0.smithi002.stdout:7/466: chown d1/d14/d1d/d29/d30/f53 1265 1 2024-09-17T01:01:57.533 INFO:tasks.workunit.client.0.smithi002.stdout:9/391: unlink d5/dc/d26/c30 0 2024-09-17T01:01:57.535 INFO:tasks.workunit.client.0.smithi002.stdout:8/586: rmdir d2/d3/d5f/d98/da5/d71/d89 39 2024-09-17T01:01:57.536 INFO:tasks.workunit.client.0.smithi002.stdout:5/426: symlink d2/d2d/d10/d3b/l86 0 2024-09-17T01:01:57.537 INFO:tasks.workunit.client.0.smithi002.stdout:3/489: mkdir d0/d3/da8 0 2024-09-17T01:01:57.538 INFO:tasks.workunit.client.0.smithi002.stdout:7/467: rename d1/d14/d1d/d29/l4a to d1/d14/d1d/d28/l9a 0 2024-09-17T01:01:57.539 INFO:tasks.workunit.client.0.smithi002.stdout:9/392: rmdir d5/dc/d26/d34/d57/d6a 0 2024-09-17T01:01:57.541 INFO:tasks.workunit.client.0.smithi002.stdout:8/587: unlink d2/d9/dd/f15 0 2024-09-17T01:01:57.541 INFO:tasks.workunit.client.0.smithi002.stdout:8/588: stat d2/d3/d5f/d98/da5/d4f/d77/d78 0 2024-09-17T01:01:57.541 INFO:tasks.workunit.client.0.smithi002.stdout:8/589: write d2/d9/dd/fb1 [546361,20014] 0 2024-09-17T01:01:57.542 INFO:tasks.workunit.client.0.smithi002.stdout:5/427: link d2/d2d/d10/d14/d19/d39/d43/c47 d2/de/c87 0 2024-09-17T01:01:57.542 INFO:tasks.workunit.client.0.smithi002.stdout:5/428: fsync d2/d2d/d10/d14/d19/d39/d25/d32/f40 0 2024-09-17T01:01:57.547 INFO:tasks.workunit.client.0.smithi002.stdout:7/468: unlink d1/d14/d1d/d28/d40/l82 0 2024-09-17T01:01:57.547 INFO:tasks.workunit.client.0.smithi002.stdout:7/469: readlink d1/d14/d67/l7a 0 2024-09-17T01:01:57.547 INFO:tasks.workunit.client.0.smithi002.stdout:8/590: mkdir d2/d30/d8b/dcb 0 2024-09-17T01:01:57.551 INFO:tasks.workunit.client.0.smithi002.stdout:5/429: dread d2/d2d/d10/d20/d24/f31 [0,4194304] 0 2024-09-17T01:01:57.551 INFO:tasks.workunit.client.0.smithi002.stdout:8/591: rmdir d2/d3/d5f/d98/da5/d4f/d77 39 2024-09-17T01:01:57.551 INFO:tasks.workunit.client.0.smithi002.stdout:5/430: truncate d2/f3a 1069219 0 2024-09-17T01:01:57.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/431: creat d2/d2d/d10/d14/f88 x:0 0 0 2024-09-17T01:01:57.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/432: readlink d2/de/d1d/l30 0 2024-09-17T01:01:57.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/433: read - d2/d2d/d10/f71 zero size 2024-09-17T01:01:57.553 INFO:tasks.workunit.client.0.smithi002.stdout:3/490: read d0/d3/d17/d9a/f7c [3947877,100192] 0 2024-09-17T01:01:57.554 INFO:tasks.workunit.client.0.smithi002.stdout:5/434: mknod d2/de/d57/c89 0 2024-09-17T01:01:57.557 INFO:tasks.workunit.client.0.smithi002.stdout:5/435: creat d2/d2d/d10/f8a x:0 0 0 2024-09-17T01:01:57.557 INFO:tasks.workunit.client.0.smithi002.stdout:6/466: dwrite d2/d1d/d26/d49/f6e [0,4194304] 0 2024-09-17T01:01:57.558 INFO:tasks.workunit.client.1.smithi099.stdout:4/470: dwrite f1 [4194304,4194304] 0 2024-09-17T01:01:57.558 INFO:tasks.workunit.client.1.smithi099.stdout:4/471: read d7/dd/d21/d26/f32 [3836407,109084] 0 2024-09-17T01:01:57.559 INFO:tasks.workunit.client.0.smithi002.stdout:0/339: dwrite dd/d19/d1c/d1f/d22/f6b [0,4194304] 0 2024-09-17T01:01:57.559 INFO:tasks.workunit.client.1.smithi099.stdout:4/472: getdents d7/d35/d80 0 2024-09-17T01:01:57.559 INFO:tasks.workunit.client.1.smithi099.stdout:4/473: write d7/dd/de/f62 [637722,4635] 0 2024-09-17T01:01:57.562 INFO:tasks.workunit.client.1.smithi099.stdout:4/474: rename d7/dd/de/d10/c19 to d7/dd/de/d10/d6b/d82/d8a/d9a/ca2 0 2024-09-17T01:01:57.567 INFO:tasks.workunit.client.0.smithi002.stdout:5/436: dread d2/de/f1f [0,4194304] 0 2024-09-17T01:01:57.567 INFO:tasks.workunit.client.0.smithi002.stdout:5/437: read d2/de/f1f [599421,126335] 0 2024-09-17T01:01:57.568 INFO:tasks.workunit.client.0.smithi002.stdout:6/467: rmdir d2/d4b/d4c 39 2024-09-17T01:01:57.568 INFO:tasks.workunit.client.0.smithi002.stdout:6/468: chown d2/dc/d24 112 1 2024-09-17T01:01:57.568 INFO:tasks.workunit.client.0.smithi002.stdout:6/469: read - d2/d1d/d2d/d54/f69 zero size 2024-09-17T01:01:57.569 INFO:tasks.workunit.client.1.smithi099.stdout:2/433: dwrite d2/d9/d17/d58/f71 [0,4194304] 0 2024-09-17T01:01:57.569 INFO:tasks.workunit.client.1.smithi099.stdout:2/434: readlink d2/d7/la 0 2024-09-17T01:01:57.581 INFO:tasks.workunit.client.0.smithi002.stdout:9/393: dwrite d5/f20 [4194304,4194304] 0 2024-09-17T01:01:57.582 INFO:tasks.workunit.client.0.smithi002.stdout:5/438: dread d2/d2d/d10/d14/d19/d39/d51/f79 [0,4194304] 0 2024-09-17T01:01:57.583 INFO:tasks.workunit.client.0.smithi002.stdout:0/340: dread dd/d19/d1c/d1f/f21 [0,4194304] 0 2024-09-17T01:01:57.583 INFO:tasks.workunit.client.0.smithi002.stdout:8/592: dwrite d2/d3/d5f/d98/da5/d4f/d77/d78/fc5 [0,4194304] 0 2024-09-17T01:01:57.584 INFO:tasks.workunit.client.0.smithi002.stdout:5/439: dread d2/d2d/d10/d23/d6e/f6b [0,4194304] 0 2024-09-17T01:01:57.585 INFO:tasks.workunit.client.0.smithi002.stdout:7/470: dwrite d1/d14/d1d/d28/d2d/f35 [0,4194304] 0 2024-09-17T01:01:57.585 INFO:tasks.workunit.client.0.smithi002.stdout:3/491: dwrite d0/f23 [0,4194304] 0 2024-09-17T01:01:57.589 INFO:tasks.workunit.client.0.smithi002.stdout:8/593: unlink d2/d3/d5f/d98/da5/d4f/caf 0 2024-09-17T01:01:57.592 INFO:tasks.workunit.client.0.smithi002.stdout:0/341: rename dd/d3d/f71 to dd/d19/d1a/d29/f72 0 2024-09-17T01:01:57.594 INFO:tasks.workunit.client.0.smithi002.stdout:3/492: write d0/f61 [285946,70904] 0 2024-09-17T01:01:57.595 INFO:tasks.workunit.client.0.smithi002.stdout:3/493: dread - d0/d31/d32/f98 zero size 2024-09-17T01:01:57.595 INFO:tasks.workunit.client.0.smithi002.stdout:9/394: link d5/l2c d5/dc/d26/d34/l6d 0 2024-09-17T01:01:57.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/471: getdents d1/d14/d1d/d21 0 2024-09-17T01:01:57.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/472: chown d1/d14/d1d/d28/d40/d58/f62 548999 1 2024-09-17T01:01:57.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/473: write d1/f5 [1454288,108040] 0 2024-09-17T01:01:57.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/474: chown d1/d14/d1d/d28/d8f 18 1 2024-09-17T01:01:57.598 INFO:tasks.workunit.client.0.smithi002.stdout:3/494: rename d0/d31/d8b/d9d/fa5 to d0/d3/d17/d87/d9e/fa9 0 2024-09-17T01:01:57.598 INFO:tasks.workunit.client.0.smithi002.stdout:3/495: chown d0/d3/l41 130 1 2024-09-17T01:01:57.598 INFO:tasks.workunit.client.1.smithi099.stdout:6/479: sync 2024-09-17T01:01:57.599 INFO:tasks.workunit.client.0.smithi002.stdout:0/342: getdents dd/d19/d1c/d1f/d22 0 2024-09-17T01:01:57.599 INFO:tasks.workunit.client.0.smithi002.stdout:0/343: getdents dd/d19/d1c/d1f/d39/d65 0 2024-09-17T01:01:57.599 INFO:tasks.workunit.client.0.smithi002.stdout:7/475: mknod d1/d14/d1d/d28/d2d/c9b 0 2024-09-17T01:01:57.600 INFO:tasks.workunit.client.1.smithi099.stdout:6/480: unlink dc/d1a/l59 0 2024-09-17T01:01:57.600 INFO:tasks.workunit.client.1.smithi099.stdout:6/481: chown dc/d27/d58/f8a 298085605 1 2024-09-17T01:01:57.600 INFO:tasks.workunit.client.0.smithi002.stdout:3/496: rename d0/d3/d17/d9a/d5b to d0/d3/d17/d9a/daa 0 2024-09-17T01:01:57.601 INFO:tasks.workunit.client.1.smithi099.stdout:6/482: mknod dc/d1a/c97 0 2024-09-17T01:01:57.601 INFO:tasks.workunit.client.1.smithi099.stdout:6/483: chown dc/d1a/c50 125389 1 2024-09-17T01:01:57.601 INFO:tasks.workunit.client.0.smithi002.stdout:0/344: symlink dd/d19/d1a/d29/d55/d56/l73 0 2024-09-17T01:01:57.601 INFO:tasks.workunit.client.0.smithi002.stdout:7/476: creat d1/d14/d1d/d28/d8f/f9c x:0 0 0 2024-09-17T01:01:57.602 INFO:tasks.workunit.client.1.smithi099.stdout:6/484: rename dc/d1a/d49/c4a to dc/d2b/c98 0 2024-09-17T01:01:57.602 INFO:tasks.workunit.client.0.smithi002.stdout:3/497: unlink d0/d3/f24 0 2024-09-17T01:01:57.603 INFO:tasks.workunit.client.0.smithi002.stdout:3/498: readlink d0/d3/d17/d9a/l6b 0 2024-09-17T01:01:57.603 INFO:tasks.workunit.client.1.smithi099.stdout:6/485: creat dc/d2b/d53/d96/f99 x:0 0 0 2024-09-17T01:01:57.603 INFO:tasks.workunit.client.1.smithi099.stdout:6/486: truncate dc/fe 1230918 0 2024-09-17T01:01:57.603 INFO:tasks.workunit.client.1.smithi099.stdout:4/475: dwrite d7/dd/d21/f38 [0,4194304] 0 2024-09-17T01:01:57.604 INFO:tasks.workunit.client.0.smithi002.stdout:0/345: creat dd/d19/d1c/d33/d67/f74 x:0 0 0 2024-09-17T01:01:57.604 INFO:tasks.workunit.client.0.smithi002.stdout:6/470: dwrite d2/dc/d34/f39 [0,4194304] 0 2024-09-17T01:01:57.604 INFO:tasks.workunit.client.0.smithi002.stdout:3/499: mkdir d0/d3/d33/d99/dab 0 2024-09-17T01:01:57.605 INFO:tasks.workunit.client.0.smithi002.stdout:3/500: chown d0/f61 8138 1 2024-09-17T01:01:57.605 INFO:tasks.workunit.client.1.smithi099.stdout:4/476: symlink d7/dd/de/d10/d6b/la3 0 2024-09-17T01:01:57.605 INFO:tasks.workunit.client.0.smithi002.stdout:0/346: symlink dd/d19/d1a/d29/d55/l75 0 2024-09-17T01:01:57.612 INFO:tasks.workunit.client.0.smithi002.stdout:0/347: mkdir dd/d19/d1c/d1f/d76 0 2024-09-17T01:01:57.613 INFO:tasks.workunit.client.0.smithi002.stdout:9/395: write d5/dc/d26/f2d [2762424,127593] 0 2024-09-17T01:01:57.614 INFO:tasks.workunit.client.1.smithi099.stdout:4/477: rename d7/dd/de/d10/d3a to d7/dd/d21/d26/d3f/d5b/da4 0 2024-09-17T01:01:57.614 INFO:tasks.workunit.client.1.smithi099.stdout:4/478: write d7/dd/d21/d26/d3f/d5b/f2d [922328,39921] 0 2024-09-17T01:01:57.614 INFO:tasks.workunit.client.1.smithi099.stdout:4/479: write d7/dd/d21/f41 [675083,54536] 0 2024-09-17T01:01:57.614 INFO:tasks.workunit.client.1.smithi099.stdout:4/480: chown d7/dd/de/f14 3 1 2024-09-17T01:01:57.614 INFO:tasks.workunit.client.1.smithi099.stdout:4/481: symlink d7/dd/d21/d26/d3f/la5 0 2024-09-17T01:01:57.614 INFO:tasks.workunit.client.1.smithi099.stdout:4/482: fsync d7/dd/d21/d26/d3f/f94 0 2024-09-17T01:01:57.614 INFO:tasks.workunit.client.1.smithi099.stdout:2/435: dwrite d2/d9/d25/f7b [0,4194304] 0 2024-09-17T01:01:57.614 INFO:tasks.workunit.client.1.smithi099.stdout:4/483: mkdir d7/dd/de/d10/d6b/d82/d8a/d9a/da6 0 2024-09-17T01:01:57.614 INFO:tasks.workunit.client.1.smithi099.stdout:4/484: chown d7/dd/d21/d26/f65 32570 1 2024-09-17T01:01:57.615 INFO:tasks.workunit.client.1.smithi099.stdout:6/487: write dc/d27/d7e/f89 [2253921,44740] 0 2024-09-17T01:01:57.615 INFO:tasks.workunit.client.1.smithi099.stdout:6/488: write dc/d1a/d49/f7f [397003,7017] 0 2024-09-17T01:01:57.615 INFO:tasks.workunit.client.1.smithi099.stdout:6/489: truncate dc/d1a/f86 90559 0 2024-09-17T01:01:57.615 INFO:tasks.workunit.client.0.smithi002.stdout:3/501: rename d0/d3/d80 to d0/d3/d37/dac 0 2024-09-17T01:01:57.615 INFO:tasks.workunit.client.0.smithi002.stdout:6/471: dread d2/d1d/d2d/d5a/d71/d7e/f85 [0,4194304] 0 2024-09-17T01:01:57.615 INFO:tasks.workunit.client.0.smithi002.stdout:9/396: creat d5/dc/d26/d5c/d6b/f6e x:0 0 0 2024-09-17T01:01:57.616 INFO:tasks.workunit.client.1.smithi099.stdout:2/436: truncate d2/d9/d25/d26/f29 1493307 0 2024-09-17T01:01:57.617 INFO:tasks.workunit.client.1.smithi099.stdout:4/485: symlink d7/dd/de/d10/d6b/la7 0 2024-09-17T01:01:57.617 INFO:tasks.workunit.client.1.smithi099.stdout:4/486: fsync d7/dd/de/d10/d6b/f95 0 2024-09-17T01:01:57.618 INFO:tasks.workunit.client.1.smithi099.stdout:2/437: mknod d2/d9/d25/d26/d1b/d2c/d5d/c86 0 2024-09-17T01:01:57.618 INFO:tasks.workunit.client.1.smithi099.stdout:2/438: truncate d2/d9/d25/d26/d1b/d2c/f77 576151 0 2024-09-17T01:01:57.619 INFO:tasks.workunit.client.1.smithi099.stdout:2/439: stat d2/d9/d25/d26/d1b/d61/f6a 0 2024-09-17T01:01:57.619 INFO:tasks.workunit.client.1.smithi099.stdout:4/487: symlink d7/dd/de/la8 0 2024-09-17T01:01:57.620 INFO:tasks.workunit.client.0.smithi002.stdout:3/502: getdents d0/d3/d17/d35 0 2024-09-17T01:01:57.620 INFO:tasks.workunit.client.0.smithi002.stdout:3/503: chown d0/d3/d17/d9a/f69 0 1 2024-09-17T01:01:57.621 INFO:tasks.workunit.client.0.smithi002.stdout:6/472: creat d2/dc/d34/f8f x:0 0 0 2024-09-17T01:01:57.621 INFO:tasks.workunit.client.1.smithi099.stdout:4/488: creat d7/dd/d21/d7b/d4b/fa9 x:0 0 0 2024-09-17T01:01:57.621 INFO:tasks.workunit.client.1.smithi099.stdout:6/490: write dc/f18 [453895,93232] 0 2024-09-17T01:01:57.623 INFO:tasks.workunit.client.1.smithi099.stdout:2/440: dread d2/d7/fe [0,4194304] 0 2024-09-17T01:01:57.624 INFO:tasks.workunit.client.1.smithi099.stdout:6/491: truncate dc/d27/d58/f6e 16333 0 2024-09-17T01:01:57.625 INFO:tasks.workunit.client.1.smithi099.stdout:7/496: sync 2024-09-17T01:01:57.625 INFO:tasks.workunit.client.1.smithi099.stdout:1/531: sync 2024-09-17T01:01:57.625 INFO:tasks.workunit.client.1.smithi099.stdout:9/488: sync 2024-09-17T01:01:57.625 INFO:tasks.workunit.client.1.smithi099.stdout:0/454: sync 2024-09-17T01:01:57.625 INFO:tasks.workunit.client.1.smithi099.stdout:0/455: chown da/f1b 27 1 2024-09-17T01:01:57.625 INFO:tasks.workunit.client.1.smithi099.stdout:9/489: write da/d21/f3b [159978,3195] 0 2024-09-17T01:01:57.625 INFO:tasks.workunit.client.1.smithi099.stdout:9/490: dread - da/d50/f86 zero size 2024-09-17T01:01:57.625 INFO:tasks.workunit.client.1.smithi099.stdout:9/491: chown da/d14/d48/l4d 162 1 2024-09-17T01:01:57.625 INFO:tasks.workunit.client.1.smithi099.stdout:8/502: sync 2024-09-17T01:01:57.626 INFO:tasks.workunit.client.1.smithi099.stdout:3/533: sync 2024-09-17T01:01:57.627 INFO:tasks.workunit.client.1.smithi099.stdout:5/521: sync 2024-09-17T01:01:57.634 INFO:tasks.workunit.client.1.smithi099.stdout:0/456: dread - da/df/d1a/d49/f4a zero size 2024-09-17T01:01:57.635 INFO:tasks.workunit.client.1.smithi099.stdout:9/492: creat da/d56/da5/fa6 x:0 0 0 2024-09-17T01:01:57.635 INFO:tasks.workunit.client.1.smithi099.stdout:3/534: write d9/d15/d18/d1a/d23/f68 [746190,76767] 0 2024-09-17T01:01:57.638 INFO:tasks.workunit.client.1.smithi099.stdout:3/535: creat d9/d15/d18/d1a/d23/d5c/d99/fa2 x:0 0 0 2024-09-17T01:01:57.639 INFO:tasks.workunit.client.1.smithi099.stdout:3/536: dread - d9/f9a zero size 2024-09-17T01:01:57.640 INFO:tasks.workunit.client.1.smithi099.stdout:4/489: dread d7/dd/d21/d26/f60 [0,4194304] 0 2024-09-17T01:01:57.641 INFO:tasks.workunit.client.1.smithi099.stdout:3/537: symlink d9/d2b/d6b/la3 0 2024-09-17T01:01:57.643 INFO:tasks.workunit.client.1.smithi099.stdout:4/490: rename d7/dd/d21/f8e to d7/dd/de/d17/d72/faa 0 2024-09-17T01:01:57.643 INFO:tasks.workunit.client.1.smithi099.stdout:4/491: fdatasync d7/dd/d21/d26/d3f/d5b/da4/f81 0 2024-09-17T01:01:57.644 INFO:tasks.workunit.client.1.smithi099.stdout:3/538: unlink d9/d15/d18/d1a/d23/d5c/d99/fa2 0 2024-09-17T01:01:57.644 INFO:tasks.workunit.client.1.smithi099.stdout:3/539: truncate d9/d15/d8f/f9f 779936 0 2024-09-17T01:01:57.646 INFO:tasks.workunit.client.1.smithi099.stdout:5/522: dread d2/dc/d17/f52 [0,4194304] 0 2024-09-17T01:01:57.646 INFO:tasks.workunit.client.1.smithi099.stdout:5/523: readlink d2/dc/d14/l56 0 2024-09-17T01:01:57.647 INFO:tasks.workunit.client.1.smithi099.stdout:3/540: link d9/d2b/f91 d9/d2b/d52/d5e/fa4 0 2024-09-17T01:01:57.647 INFO:tasks.workunit.client.1.smithi099.stdout:3/541: write d9/f79 [372058,31909] 0 2024-09-17T01:01:57.647 INFO:tasks.workunit.client.1.smithi099.stdout:3/542: dread - d9/d2b/f58 zero size 2024-09-17T01:01:57.647 INFO:tasks.workunit.client.1.smithi099.stdout:4/492: getdents d7/dd/d21/d7b 0 2024-09-17T01:01:57.649 INFO:tasks.workunit.client.1.smithi099.stdout:5/524: creat d2/dc/d17/d3c/d60/fa5 x:0 0 0 2024-09-17T01:01:57.649 INFO:tasks.workunit.client.1.smithi099.stdout:5/525: chown d2/f7 39220730 1 2024-09-17T01:01:57.651 INFO:tasks.workunit.client.1.smithi099.stdout:5/526: mkdir d2/dc/d14/d36/da6 0 2024-09-17T01:01:57.653 INFO:tasks.workunit.client.1.smithi099.stdout:3/543: rename d9/d15/d18/d1a/d23/d4c/f74 to d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/fa5 0 2024-09-17T01:01:57.654 INFO:tasks.workunit.client.1.smithi099.stdout:5/527: truncate d2/dc/d17/d3c/f8f 2907725 0 2024-09-17T01:01:57.655 INFO:tasks.workunit.client.1.smithi099.stdout:3/544: mknod d9/ca6 0 2024-09-17T01:01:57.655 INFO:tasks.workunit.client.1.smithi099.stdout:3/545: fsync d9/d15/f63 0 2024-09-17T01:01:57.656 INFO:tasks.workunit.client.1.smithi099.stdout:5/528: creat d2/d45/fa7 x:0 0 0 2024-09-17T01:01:57.657 INFO:tasks.workunit.client.1.smithi099.stdout:5/529: mkdir d2/dc/d17/d3c/da8 0 2024-09-17T01:01:57.657 INFO:tasks.workunit.client.1.smithi099.stdout:5/530: chown d2/dc/d17/d3c 385214941 1 2024-09-17T01:01:57.659 INFO:tasks.workunit.client.0.smithi002.stdout:0/348: dwrite dd/d19/f3b [0,4194304] 0 2024-09-17T01:01:57.659 INFO:tasks.workunit.client.0.smithi002.stdout:0/349: chown dd/d19/d1c/d1f/l58 45 1 2024-09-17T01:01:57.659 INFO:tasks.workunit.client.0.smithi002.stdout:0/350: stat dd/d19/d1c/d1f/d22/f6b 0 2024-09-17T01:01:57.659 INFO:tasks.workunit.client.0.smithi002.stdout:0/351: chown dd/d19/d1a/f5f 11858 1 2024-09-17T01:01:57.659 INFO:tasks.workunit.client.0.smithi002.stdout:0/352: chown f1 20 1 2024-09-17T01:01:57.660 INFO:tasks.workunit.client.1.smithi099.stdout:5/531: rename d2/d45/f7d to d2/dc/d17/d3c/fa9 0 2024-09-17T01:01:57.660 INFO:tasks.workunit.client.1.smithi099.stdout:5/532: readlink d2/l7f 0 2024-09-17T01:01:57.660 INFO:tasks.workunit.client.1.smithi099.stdout:5/533: fsync d2/dc/d14/d36/f7e 0 2024-09-17T01:01:57.660 INFO:tasks.workunit.client.1.smithi099.stdout:5/534: mkdir d2/dc/d14/d36/d9a/daa 0 2024-09-17T01:01:57.662 INFO:tasks.workunit.client.0.smithi002.stdout:0/353: creat dd/d19/d1c/d1f/f77 x:0 0 0 2024-09-17T01:01:57.663 INFO:tasks.workunit.client.0.smithi002.stdout:0/354: mkdir dd/d19/d1c/d78 0 2024-09-17T01:01:57.664 INFO:tasks.workunit.client.1.smithi099.stdout:4/493: write d7/dd/de/f4f [2945982,71100] 0 2024-09-17T01:01:57.664 INFO:tasks.workunit.client.1.smithi099.stdout:4/494: dread - d7/dd/de/d10/f61 zero size 2024-09-17T01:01:57.667 INFO:tasks.workunit.client.0.smithi002.stdout:0/355: dread dd/d19/f1e [0,4194304] 0 2024-09-17T01:01:57.668 INFO:tasks.workunit.client.0.smithi002.stdout:0/356: creat dd/d19/d1c/f79 x:0 0 0 2024-09-17T01:01:57.668 INFO:tasks.workunit.client.0.smithi002.stdout:0/357: mknod dd/d44/c7a 0 2024-09-17T01:01:57.673 INFO:tasks.workunit.client.0.smithi002.stdout:0/358: dread dd/f18 [0,4194304] 0 2024-09-17T01:01:57.673 INFO:tasks.workunit.client.0.smithi002.stdout:0/359: chown dd/d19/d1c/d1f/l58 8 1 2024-09-17T01:01:57.675 INFO:tasks.workunit.client.0.smithi002.stdout:9/397: dwrite d5/f29 [0,4194304] 0 2024-09-17T01:01:57.682 INFO:tasks.workunit.client.0.smithi002.stdout:9/398: read d5/dc/f3d [1331283,74592] 0 2024-09-17T01:01:57.683 INFO:tasks.workunit.client.0.smithi002.stdout:9/399: creat d5/dc/d26/d46/f6f x:0 0 0 2024-09-17T01:01:57.685 INFO:tasks.workunit.client.0.smithi002.stdout:9/400: dread d5/f4f [0,4194304] 0 2024-09-17T01:01:57.686 INFO:tasks.workunit.client.0.smithi002.stdout:9/401: mknod d5/dc/d26/d34/c70 0 2024-09-17T01:01:57.686 INFO:tasks.workunit.client.0.smithi002.stdout:9/402: truncate d5/dc/d26/d5c/d6b/f6e 79028 0 2024-09-17T01:01:57.688 INFO:tasks.workunit.client.1.smithi099.stdout:2/441: dwrite d2/d9/f1f [0,4194304] 0 2024-09-17T01:01:57.688 INFO:tasks.workunit.client.1.smithi099.stdout:2/442: stat d2/d7 0 2024-09-17T01:01:57.688 INFO:tasks.workunit.client.0.smithi002.stdout:3/504: dwrite d0/d3/d33/f86 [0,4194304] 0 2024-09-17T01:01:57.688 INFO:tasks.workunit.client.0.smithi002.stdout:3/505: dread - d0/d3/d17/d9a/f89 zero size 2024-09-17T01:01:57.688 INFO:tasks.workunit.client.0.smithi002.stdout:3/506: creat d0/d3/d8d/fad x:0 0 0 2024-09-17T01:01:57.699 INFO:tasks.workunit.client.0.smithi002.stdout:9/403: write d5/dc/d26/d34/f5a [2473589,11573] 0 2024-09-17T01:01:57.700 INFO:tasks.workunit.client.0.smithi002.stdout:9/404: symlink d5/dc/d26/d34/d36/l71 0 2024-09-17T01:01:57.700 INFO:tasks.workunit.client.1.smithi099.stdout:2/443: write d2/d9/d25/d26/d1b/d2c/d3f/f45 [2069351,65266] 0 2024-09-17T01:01:57.702 INFO:tasks.workunit.client.1.smithi099.stdout:2/444: mknod d2/d9/d25/d26/d1b/d61/d7d/c87 0 2024-09-17T01:01:57.702 INFO:tasks.workunit.client.1.smithi099.stdout:2/445: write d2/d9/d25/d26/f50 [922821,80821] 0 2024-09-17T01:01:57.702 INFO:tasks.workunit.client.0.smithi002.stdout:3/507: dread d0/d3/f3c [0,4194304] 0 2024-09-17T01:01:57.703 INFO:tasks.workunit.client.1.smithi099.stdout:2/446: creat d2/d9/d25/d26/f88 x:0 0 0 2024-09-17T01:01:57.703 INFO:tasks.workunit.client.0.smithi002.stdout:3/508: symlink d0/d3/d33/d99/lae 0 2024-09-17T01:01:57.703 INFO:tasks.workunit.client.0.smithi002.stdout:3/509: write d0/d3/d37/dac/da1/fa2 [272641,27813] 0 2024-09-17T01:01:57.708 INFO:tasks.workunit.client.1.smithi099.stdout:0/457: dwrite da/df/d1a/d63/d6a/f8a [0,4194304] 0 2024-09-17T01:01:57.710 INFO:tasks.workunit.client.1.smithi099.stdout:9/493: dwrite da/d14/d40/d6f/f70 [0,4194304] 0 2024-09-17T01:01:57.710 INFO:tasks.workunit.client.1.smithi099.stdout:9/494: chown da/d21 1347992 1 2024-09-17T01:01:57.710 INFO:tasks.workunit.client.1.smithi099.stdout:8/503: dwrite d0/d1f/d31/f79 [0,4194304] 0 2024-09-17T01:01:57.711 INFO:tasks.workunit.client.1.smithi099.stdout:3/546: dwrite d9/d3b/d44/f67 [0,4194304] 0 2024-09-17T01:01:57.711 INFO:tasks.workunit.client.1.smithi099.stdout:0/458: unlink da/df/d1a/d23/f2a 0 2024-09-17T01:01:57.713 INFO:tasks.workunit.client.0.smithi002.stdout:0/360: dwrite dd/f5a [0,4194304] 0 2024-09-17T01:01:57.713 INFO:tasks.workunit.client.0.smithi002.stdout:0/361: stat dd/d19/d1c/d1f/d22 0 2024-09-17T01:01:57.713 INFO:tasks.workunit.client.0.smithi002.stdout:6/473: dwrite d2/d1d/d27/d30/f78 [4194304,4194304] 0 2024-09-17T01:01:57.715 INFO:tasks.workunit.client.1.smithi099.stdout:9/495: link da/d9a/d3a/l74 da/d9a/d3a/d4b/la7 0 2024-09-17T01:01:57.718 INFO:tasks.workunit.client.0.smithi002.stdout:6/474: mknod d2/d1d/d2d/d35/d79/c90 0 2024-09-17T01:01:57.719 INFO:tasks.workunit.client.0.smithi002.stdout:6/475: creat d2/d1d/d2d/d35/d8d/d43/d5c/f91 x:0 0 0 2024-09-17T01:01:57.720 INFO:tasks.workunit.client.0.smithi002.stdout:6/476: link d2/dc/d24/d53/c61 d2/dc/d34/c92 0 2024-09-17T01:01:57.723 INFO:tasks.workunit.client.1.smithi099.stdout:0/459: creat da/df/f94 x:0 0 0 2024-09-17T01:01:57.723 INFO:tasks.workunit.client.1.smithi099.stdout:0/460: readlink da/d12/d22/d52/l69 0 2024-09-17T01:01:57.728 INFO:tasks.workunit.client.1.smithi099.stdout:8/504: read d0/d53/f83 [698679,105803] 0 2024-09-17T01:01:57.730 INFO:tasks.workunit.client.1.smithi099.stdout:8/505: mkdir d0/d41/da4 0 2024-09-17T01:01:57.732 INFO:tasks.workunit.client.1.smithi099.stdout:8/506: rename d0/d1f/c27 to d0/d1f/d55/ca5 0 2024-09-17T01:01:57.733 INFO:tasks.workunit.client.0.smithi002.stdout:0/362: dread dd/d19/d1a/f1d [0,4194304] 0 2024-09-17T01:01:57.735 INFO:tasks.workunit.client.1.smithi099.stdout:8/507: rename d0/f61 to d0/d4/d29/d4b/fa6 0 2024-09-17T01:01:57.735 INFO:tasks.workunit.client.0.smithi002.stdout:0/363: write dd/d19/f4e [561481,4082] 0 2024-09-17T01:01:57.735 INFO:tasks.workunit.client.0.smithi002.stdout:0/364: creat dd/d19/d1c/d33/f7b x:0 0 0 2024-09-17T01:01:57.737 INFO:tasks.workunit.client.1.smithi099.stdout:8/508: rename d0/l77 to d0/d1f/d90/la7 0 2024-09-17T01:01:57.737 INFO:tasks.workunit.client.1.smithi099.stdout:8/509: chown d0/d1f/d31/l60 314 1 2024-09-17T01:01:57.737 INFO:tasks.workunit.client.1.smithi099.stdout:8/510: chown d0/d53 1418231678 1 2024-09-17T01:01:57.737 INFO:tasks.workunit.client.1.smithi099.stdout:8/511: creat d0/d4/d64/fa8 x:0 0 0 2024-09-17T01:01:57.737 INFO:tasks.workunit.client.0.smithi002.stdout:0/365: creat dd/d19/d1c/d1f/d76/f7c x:0 0 0 2024-09-17T01:01:57.738 INFO:tasks.workunit.client.0.smithi002.stdout:0/366: dread - dd/d19/d1c/d1f/f77 zero size 2024-09-17T01:01:57.738 INFO:tasks.workunit.client.1.smithi099.stdout:0/461: read da/df/d1a/d56/f74 [3672519,3782] 0 2024-09-17T01:01:57.739 INFO:tasks.workunit.client.1.smithi099.stdout:0/462: read da/d12/d22/d52/f58 [108951,59321] 0 2024-09-17T01:01:57.739 INFO:tasks.workunit.client.1.smithi099.stdout:8/512: link d0/d1f/d31/c84 d0/d1f/d31/ca9 0 2024-09-17T01:01:57.739 INFO:tasks.workunit.client.1.smithi099.stdout:8/513: read - d0/d4/d29/d4b/f96 zero size 2024-09-17T01:01:57.740 INFO:tasks.workunit.client.1.smithi099.stdout:0/463: symlink da/df/d31/l95 0 2024-09-17T01:01:57.740 INFO:tasks.workunit.client.1.smithi099.stdout:0/464: stat da/df/d1a/d70 0 2024-09-17T01:01:57.741 INFO:tasks.workunit.client.1.smithi099.stdout:8/514: creat d0/d4/d29/d9c/faa x:0 0 0 2024-09-17T01:01:57.741 INFO:tasks.workunit.client.1.smithi099.stdout:8/515: fsync d0/d1f/f2b 0 2024-09-17T01:01:57.741 INFO:tasks.workunit.client.1.smithi099.stdout:8/516: creat d0/d53/fab x:0 0 0 2024-09-17T01:01:57.741 INFO:tasks.workunit.client.1.smithi099.stdout:8/517: write d0/d4/f50 [631182,34439] 0 2024-09-17T01:01:57.743 INFO:tasks.workunit.client.1.smithi099.stdout:8/518: dread d0/d41/f9b [0,4194304] 0 2024-09-17T01:01:57.750 INFO:tasks.workunit.client.1.smithi099.stdout:2/447: dwrite d2/d9/d25/f2d [4194304,4194304] 0 2024-09-17T01:01:57.750 INFO:tasks.workunit.client.0.smithi002.stdout:3/510: dwrite d0/f21 [0,4194304] 0 2024-09-17T01:01:57.751 INFO:tasks.workunit.client.1.smithi099.stdout:0/465: write da/df/d1a/d63/d6a/f8a [3397988,40423] 0 2024-09-17T01:01:57.751 INFO:tasks.workunit.client.1.smithi099.stdout:0/466: truncate da/df/d31/f39 512757 0 2024-09-17T01:01:57.753 INFO:tasks.workunit.client.1.smithi099.stdout:0/467: write da/df/d1a/d56/d72/f93 [760716,9006] 0 2024-09-17T01:01:57.753 INFO:tasks.workunit.client.1.smithi099.stdout:3/547: dwrite d9/d15/d18/d1a/d23/f17 [4194304,4194304] 0 2024-09-17T01:01:57.753 INFO:tasks.workunit.client.1.smithi099.stdout:2/448: dread d2/d9/d17/f69 [0,4194304] 0 2024-09-17T01:01:57.754 INFO:tasks.workunit.client.0.smithi002.stdout:3/511: creat d0/d31/faf x:0 0 0 2024-09-17T01:01:57.756 INFO:tasks.workunit.client.1.smithi099.stdout:9/496: dwrite da/d56/d84/f9c [0,4194304] 0 2024-09-17T01:01:57.756 INFO:tasks.workunit.client.1.smithi099.stdout:0/468: creat da/df/d1a/d56/d72/f96 x:0 0 0 2024-09-17T01:01:57.758 INFO:tasks.workunit.client.0.smithi002.stdout:3/512: link d0/f62 d0/d3/d33/d93/fb0 0 2024-09-17T01:01:57.759 INFO:tasks.workunit.client.1.smithi099.stdout:3/548: dread d9/f8c [0,4194304] 0 2024-09-17T01:01:57.759 INFO:tasks.workunit.client.1.smithi099.stdout:2/449: mknod d2/d9/d17/c89 0 2024-09-17T01:01:57.760 INFO:tasks.workunit.client.0.smithi002.stdout:3/513: creat d0/d3/d17/d9a/daa/fb1 x:0 0 0 2024-09-17T01:01:57.762 INFO:tasks.workunit.client.1.smithi099.stdout:9/497: rename da/d21/c30 to da/d8e/ca8 0 2024-09-17T01:01:57.762 INFO:tasks.workunit.client.0.smithi002.stdout:3/514: creat d0/d3/fb2 x:0 0 0 2024-09-17T01:01:57.763 INFO:tasks.workunit.client.1.smithi099.stdout:8/519: dwrite d0/d4/d64/f8d [0,4194304] 0 2024-09-17T01:01:57.763 INFO:tasks.workunit.client.1.smithi099.stdout:2/450: creat d2/d9/d17/d83/f8a x:0 0 0 2024-09-17T01:01:57.768 INFO:tasks.workunit.client.1.smithi099.stdout:0/469: rename da/d12/d85 to da/d59/d80/d8c/d97 0 2024-09-17T01:01:57.770 INFO:tasks.workunit.client.1.smithi099.stdout:9/498: mknod da/d8e/d96/ca9 0 2024-09-17T01:01:57.770 INFO:tasks.workunit.client.1.smithi099.stdout:9/499: write da/d18/d49/f98 [527966,12813] 0 2024-09-17T01:01:57.770 INFO:tasks.workunit.client.1.smithi099.stdout:9/500: write da/d50/f82 [4510189,80782] 0 2024-09-17T01:01:57.775 INFO:tasks.workunit.client.0.smithi002.stdout:4/580: sync 2024-09-17T01:01:57.777 INFO:tasks.workunit.client.0.smithi002.stdout:4/581: rename d7/d19/d9f/d80/f96 to d7/d3f/fb1 0 2024-09-17T01:01:57.778 INFO:tasks.workunit.client.0.smithi002.stdout:4/582: mkdir d7/d19/d9f/db2 0 2024-09-17T01:01:57.779 INFO:tasks.workunit.client.1.smithi099.stdout:9/501: write da/d14/f29 [5946443,106359] 0 2024-09-17T01:01:57.779 INFO:tasks.workunit.client.1.smithi099.stdout:9/502: truncate da/d14/d6d/f87 337922 0 2024-09-17T01:01:57.781 INFO:tasks.workunit.client.1.smithi099.stdout:0/470: creat da/df/d1a/d49/d68/f98 x:0 0 0 2024-09-17T01:01:57.782 INFO:tasks.workunit.client.1.smithi099.stdout:0/471: readlink da/df/d31/l43 0 2024-09-17T01:01:57.782 INFO:tasks.workunit.client.1.smithi099.stdout:0/472: readlink da/d3b/l88 0 2024-09-17T01:01:57.783 INFO:tasks.workunit.client.1.smithi099.stdout:2/451: dwrite d2/d9/d25/f4f [0,4194304] 0 2024-09-17T01:01:57.787 INFO:tasks.workunit.client.1.smithi099.stdout:3/549: dwrite d9/d3b/d44/f67 [0,4194304] 0 2024-09-17T01:01:57.787 INFO:tasks.workunit.client.1.smithi099.stdout:3/550: readlink l7 0 2024-09-17T01:01:57.787 INFO:tasks.workunit.client.1.smithi099.stdout:8/520: fsync d0/d53/fab 0 2024-09-17T01:01:57.787 INFO:tasks.workunit.client.1.smithi099.stdout:8/521: chown d0/d4/d29/d4b/l4f 3175751 1 2024-09-17T01:01:57.787 INFO:tasks.workunit.client.1.smithi099.stdout:8/522: creat d0/d1f/d90/fac x:0 0 0 2024-09-17T01:01:57.788 INFO:tasks.workunit.client.1.smithi099.stdout:0/473: link da/d59/l61 da/df/d1a/d70/l99 0 2024-09-17T01:01:57.788 INFO:tasks.workunit.client.1.smithi099.stdout:0/474: write da/df/d1a/d56/d72/f96 [985402,128377] 0 2024-09-17T01:01:57.790 INFO:tasks.workunit.client.1.smithi099.stdout:2/452: getdents d2/d9/d25/d26/d1b/d2c/d5d 0 2024-09-17T01:01:57.792 INFO:tasks.workunit.client.1.smithi099.stdout:9/503: getdents da/d8e 0 2024-09-17T01:01:57.793 INFO:tasks.workunit.client.1.smithi099.stdout:9/504: read da/d14/d6d/f87 [92865,65104] 0 2024-09-17T01:01:57.794 INFO:tasks.workunit.client.1.smithi099.stdout:8/523: symlink d0/d1f/lad 0 2024-09-17T01:01:57.796 INFO:tasks.workunit.client.1.smithi099.stdout:3/551: link d9/d15/c3d d9/d15/d18/d1a/d23/ca7 0 2024-09-17T01:01:57.796 INFO:tasks.workunit.client.1.smithi099.stdout:8/524: dread d0/d4/d29/d4b/f4e [0,4194304] 0 2024-09-17T01:01:57.797 INFO:tasks.workunit.client.1.smithi099.stdout:9/505: mknod da/d9a/d3a/d4b/caa 0 2024-09-17T01:01:57.798 INFO:tasks.workunit.client.1.smithi099.stdout:3/552: creat d9/d15/d18/d1a/fa8 x:0 0 0 2024-09-17T01:01:57.800 INFO:tasks.workunit.client.1.smithi099.stdout:8/525: truncate d0/d1f/f20 6898362 0 2024-09-17T01:01:57.800 INFO:tasks.workunit.client.1.smithi099.stdout:8/526: getdents d0/d41/da4 0 2024-09-17T01:01:57.803 INFO:tasks.workunit.client.1.smithi099.stdout:2/453: write d2/d9/d25/f7b [58531,130212] 0 2024-09-17T01:01:57.803 INFO:tasks.workunit.client.1.smithi099.stdout:2/454: truncate d2/d9/d25/d26/f88 632606 0 2024-09-17T01:01:57.812 INFO:tasks.workunit.client.1.smithi099.stdout:9/506: symlink da/d14/d62/lab 0 2024-09-17T01:01:57.812 INFO:tasks.workunit.client.1.smithi099.stdout:9/507: fsync da/d9a/d3a/f26 0 2024-09-17T01:01:57.814 INFO:tasks.workunit.client.1.smithi099.stdout:3/553: chown d9/d15/d18/d1a/d23/c28 0 1 2024-09-17T01:01:57.817 INFO:tasks.workunit.client.1.smithi099.stdout:0/475: dwrite da/d1c/f3d [0,4194304] 0 2024-09-17T01:01:57.837 INFO:tasks.workunit.client.1.smithi099.stdout:9/508: dwrite da/d50/f86 [0,4194304] 0 2024-09-17T01:01:57.854 INFO:tasks.workunit.client.1.smithi099.stdout:9/509: dwrite da/d9b/fa0 [8388608,4194304] 0 2024-09-17T01:01:57.854 INFO:tasks.workunit.client.1.smithi099.stdout:9/510: write da/d14/d40/f97 [1600659,95909] 0 2024-09-17T01:01:57.858 INFO:tasks.workunit.client.0.smithi002.stdout:2/511: sync 2024-09-17T01:01:57.858 INFO:tasks.workunit.client.0.smithi002.stdout:1/476: sync 2024-09-17T01:01:57.858 INFO:tasks.workunit.client.0.smithi002.stdout:2/512: fdatasync d1b/d8b/fa8 0 2024-09-17T01:01:57.858 INFO:tasks.workunit.client.0.smithi002.stdout:1/477: truncate d4/d11/d12/d14/d17/d51/f5d 189998 0 2024-09-17T01:01:57.859 INFO:tasks.workunit.client.0.smithi002.stdout:2/513: rename d1b/d74/f88 to d1b/d1d/d79/fbe 0 2024-09-17T01:01:57.860 INFO:tasks.workunit.client.0.smithi002.stdout:1/478: creat d4/d11/d12/fa7 x:0 0 0 2024-09-17T01:01:57.863 INFO:tasks.workunit.client.1.smithi099.stdout:9/511: read da/d21/d2a/f54 [2159168,24187] 0 2024-09-17T01:01:57.863 INFO:tasks.workunit.client.1.smithi099.stdout:9/512: chown da/d14/d40/d6f/l76 1 1 2024-09-17T01:01:57.863 INFO:tasks.workunit.client.1.smithi099.stdout:9/513: chown da/d56/d84/l9f 330800414 1 2024-09-17T01:01:57.866 INFO:tasks.workunit.client.0.smithi002.stdout:2/514: write d1b/d8a/f8c [2019988,189] 0 2024-09-17T01:01:57.873 INFO:tasks.workunit.client.1.smithi099.stdout:8/527: mknod d0/d4/d29/d4b/cae 0 2024-09-17T01:01:57.873 INFO:tasks.workunit.client.1.smithi099.stdout:8/528: write d0/d4/d29/d4b/f8f [1035751,55982] 0 2024-09-17T01:01:57.873 INFO:tasks.workunit.client.1.smithi099.stdout:8/529: chown d0/d1f/d31/f43 1 1 2024-09-17T01:01:57.876 INFO:tasks.workunit.client.1.smithi099.stdout:2/455: link d2/d9/d25/d26/d1b/c22 d2/d9/d25/d68/c8b 0 2024-09-17T01:01:57.879 INFO:tasks.workunit.client.0.smithi002.stdout:2/515: dwrite d1b/d1d/d79/f6d [0,4194304] 0 2024-09-17T01:01:57.880 INFO:tasks.workunit.client.0.smithi002.stdout:2/516: creat d1b/d1d/d79/fbf x:0 0 0 2024-09-17T01:01:57.880 INFO:tasks.workunit.client.0.smithi002.stdout:2/517: fsync d1b/d37/d48/d4e/f54 0 2024-09-17T01:01:57.881 INFO:tasks.workunit.client.0.smithi002.stdout:2/518: creat d1b/d8a/d92/dae/fc0 x:0 0 0 2024-09-17T01:01:57.882 INFO:tasks.workunit.client.0.smithi002.stdout:2/519: mkdir d1b/d37/dc1 0 2024-09-17T01:01:57.882 INFO:tasks.workunit.client.0.smithi002.stdout:2/520: mknod d1b/d8b/cc2 0 2024-09-17T01:01:57.884 INFO:tasks.workunit.client.1.smithi099.stdout:9/514: mkdir da/d9b/dac 0 2024-09-17T01:01:57.884 INFO:tasks.workunit.client.1.smithi099.stdout:9/515: write da/d18/f7e [1732104,65165] 0 2024-09-17T01:01:57.886 INFO:tasks.workunit.client.1.smithi099.stdout:8/530: creat d0/d1f/d55/faf x:0 0 0 2024-09-17T01:01:57.890 INFO:tasks.workunit.client.1.smithi099.stdout:9/516: getdents da/d21/d2a 0 2024-09-17T01:01:57.890 INFO:tasks.workunit.client.0.smithi002.stdout:2/521: dread fe [0,4194304] 0 2024-09-17T01:01:57.891 INFO:tasks.workunit.client.0.smithi002.stdout:2/522: stat d1b/d1d/f28 0 2024-09-17T01:01:57.892 INFO:tasks.workunit.client.0.smithi002.stdout:2/523: truncate d1b/d1d/f6e 6501874 0 2024-09-17T01:01:57.950 INFO:tasks.workunit.client.1.smithi099.stdout:2/456: link d2/d9/d25/d26/d1b/d61/c72 d2/d9/c8c 0 2024-09-17T01:01:57.952 INFO:tasks.workunit.client.1.smithi099.stdout:2/457: getdents d2/d9/d25/d26/d1b/d2c 0 2024-09-17T01:01:57.952 INFO:tasks.workunit.client.0.smithi002.stdout:2/524: dwrite d1b/d37/d48/d78/daa/f61 [0,4194304] 0 2024-09-17T01:01:57.954 INFO:tasks.workunit.client.0.smithi002.stdout:2/525: mkdir d1b/d37/d48/d78/daa/dac/dbd/dc3 0 2024-09-17T01:01:57.955 INFO:tasks.workunit.client.1.smithi099.stdout:8/531: dwrite d0/d4/d64/f93 [0,4194304] 0 2024-09-17T01:01:57.955 INFO:tasks.workunit.client.1.smithi099.stdout:8/532: dread - d0/d41/f91 zero size 2024-09-17T01:01:57.955 INFO:tasks.workunit.client.1.smithi099.stdout:2/458: dread d2/d9/d17/f69 [0,4194304] 0 2024-09-17T01:01:57.955 INFO:tasks.workunit.client.1.smithi099.stdout:2/459: write d2/d9/d25/d26/f5b [2107131,124295] 0 2024-09-17T01:01:57.955 INFO:tasks.workunit.client.1.smithi099.stdout:3/554: rename d9/d15/f63 to d9/d15/d18/d1a/d23/d5c/d6e/fa9 0 2024-09-17T01:01:57.955 INFO:tasks.workunit.client.1.smithi099.stdout:3/555: write d9/d2b/d52/f6f [1250021,56474] 0 2024-09-17T01:01:57.956 INFO:tasks.workunit.client.0.smithi002.stdout:2/526: unlink d1b/d8a/d92/dae/fc0 0 2024-09-17T01:01:57.959 INFO:tasks.workunit.client.1.smithi099.stdout:9/517: rmdir da/d9a 39 2024-09-17T01:01:57.963 INFO:tasks.workunit.client.1.smithi099.stdout:0/476: rename da/df/f15 to da/d12/d22/f9a 0 2024-09-17T01:01:57.967 INFO:tasks.workunit.client.1.smithi099.stdout:8/533: write d0/d1f/f20 [2680945,35879] 0 2024-09-17T01:01:57.967 INFO:tasks.workunit.client.1.smithi099.stdout:8/534: chown d0/d41/f91 5190725 1 2024-09-17T01:01:57.968 INFO:tasks.workunit.client.1.smithi099.stdout:0/477: symlink da/df/d31/l9b 0 2024-09-17T01:01:57.968 INFO:tasks.workunit.client.1.smithi099.stdout:3/556: write d9/d15/d18/d1a/f4d [3681391,7769] 0 2024-09-17T01:01:57.969 INFO:tasks.workunit.client.1.smithi099.stdout:2/460: rmdir d2/d9/d25/d26/d1b 39 2024-09-17T01:01:57.969 INFO:tasks.workunit.client.1.smithi099.stdout:2/461: truncate d2/d9/d25/d26/d1b/d2c/d3f/f45 4244840 0 2024-09-17T01:01:57.972 INFO:tasks.workunit.client.1.smithi099.stdout:0/478: truncate da/f27 2991326 0 2024-09-17T01:01:57.972 INFO:tasks.workunit.client.1.smithi099.stdout:0/479: readlink da/d1c/l73 0 2024-09-17T01:01:57.972 INFO:tasks.workunit.client.1.smithi099.stdout:1/532: sync 2024-09-17T01:01:57.972 INFO:tasks.workunit.client.1.smithi099.stdout:1/533: chown d0/d8/d49/d94/d4b 1 1 2024-09-17T01:01:57.972 INFO:tasks.workunit.client.1.smithi099.stdout:6/492: sync 2024-09-17T01:01:57.972 INFO:tasks.workunit.client.1.smithi099.stdout:2/462: mkdir d2/d9/d17/d83/d8d 0 2024-09-17T01:01:57.972 INFO:tasks.workunit.client.1.smithi099.stdout:5/535: sync 2024-09-17T01:01:57.973 INFO:tasks.workunit.client.1.smithi099.stdout:7/497: sync 2024-09-17T01:01:57.973 INFO:tasks.workunit.client.1.smithi099.stdout:4/495: sync 2024-09-17T01:01:57.974 INFO:tasks.workunit.client.1.smithi099.stdout:3/557: dread d9/d15/d18/d1a/d23/f68 [0,4194304] 0 2024-09-17T01:01:57.975 INFO:tasks.workunit.client.1.smithi099.stdout:8/535: link d0/d4/d29/d4b/l4f d0/d4/d29/d4b/lb0 0 2024-09-17T01:01:57.975 INFO:tasks.workunit.client.0.smithi002.stdout:2/527: dwrite d1b/d74/d93/fa3 [0,4194304] 0 2024-09-17T01:01:57.976 INFO:tasks.workunit.client.1.smithi099.stdout:0/480: rename da/df/d31/l43 to da/d1c/d1e/l9c 0 2024-09-17T01:01:57.976 INFO:tasks.workunit.client.1.smithi099.stdout:0/481: fdatasync da/df/d31/d8b/f81 0 2024-09-17T01:01:57.976 INFO:tasks.workunit.client.1.smithi099.stdout:8/536: write d0/d1f/d31/d4c/f67 [249138,41316] 0 2024-09-17T01:01:57.976 INFO:tasks.workunit.client.1.smithi099.stdout:1/534: symlink d0/d8c/lbd 0 2024-09-17T01:01:57.980 INFO:tasks.workunit.client.1.smithi099.stdout:3/558: mknod d9/d2b/d52/caa 0 2024-09-17T01:01:57.980 INFO:tasks.workunit.client.1.smithi099.stdout:3/559: creat d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/fab x:0 0 0 2024-09-17T01:01:57.980 INFO:tasks.workunit.client.1.smithi099.stdout:3/560: dread - d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/fab zero size 2024-09-17T01:01:57.982 INFO:tasks.workunit.client.1.smithi099.stdout:7/498: rename d1/d2c/d5c/d3f/c8a to d1/d8f/c9d 0 2024-09-17T01:01:57.983 INFO:tasks.workunit.client.1.smithi099.stdout:0/482: creat da/d1c/d1e/f9d x:0 0 0 2024-09-17T01:01:57.983 INFO:tasks.workunit.client.1.smithi099.stdout:0/483: readlink da/l3f 0 2024-09-17T01:01:57.984 INFO:tasks.workunit.client.1.smithi099.stdout:8/537: link d0/d1f/d31/c46 d0/d1f/d31/d4c/d8c/cb1 0 2024-09-17T01:01:57.986 INFO:tasks.workunit.client.1.smithi099.stdout:1/535: creat d0/d8/fbe x:0 0 0 2024-09-17T01:01:57.987 INFO:tasks.workunit.client.1.smithi099.stdout:5/536: rmdir d2/dc/d17/d3c/d72 39 2024-09-17T01:01:57.989 INFO:tasks.workunit.client.0.smithi002.stdout:2/528: getdents d1b/d37/d48/d78/daa/dac/dbd 0 2024-09-17T01:01:57.989 INFO:tasks.workunit.client.0.smithi002.stdout:2/529: stat d1b/d1d/f6e 0 2024-09-17T01:01:57.989 INFO:tasks.workunit.client.0.smithi002.stdout:2/530: write d1b/f1c [5318200,112103] 0 2024-09-17T01:01:57.989 INFO:tasks.workunit.client.0.smithi002.stdout:2/531: creat d1b/d8b/fc4 x:0 0 0 2024-09-17T01:01:57.991 INFO:tasks.workunit.client.0.smithi002.stdout:2/532: mkdir d1b/d37/d48/d4e/dc5 0 2024-09-17T01:01:57.991 INFO:tasks.workunit.client.0.smithi002.stdout:2/533: chown d1b/f29 1894356069 1 2024-09-17T01:01:57.991 INFO:tasks.workunit.client.1.smithi099.stdout:3/561: creat d9/d15/d8f/fac x:0 0 0 2024-09-17T01:01:57.995 INFO:tasks.workunit.client.1.smithi099.stdout:6/493: dwrite dc/d27/d58/f78 [0,4194304] 0 2024-09-17T01:01:57.995 INFO:tasks.workunit.client.1.smithi099.stdout:6/494: read dc/d1a/d49/f62 [752726,73772] 0 2024-09-17T01:01:57.995 INFO:tasks.workunit.client.1.smithi099.stdout:6/495: creat dc/d27/d7e/f9a x:0 0 0 2024-09-17T01:01:57.995 INFO:tasks.workunit.client.1.smithi099.stdout:7/499: mknod d1/d2c/c9e 0 2024-09-17T01:01:57.995 INFO:tasks.workunit.client.1.smithi099.stdout:0/484: mknod da/df/d1a/d63/d6a/d7c/c9e 0 2024-09-17T01:01:57.995 INFO:tasks.workunit.client.1.smithi099.stdout:0/485: dread - da/df/d1a/f5f zero size 2024-09-17T01:01:57.995 INFO:tasks.workunit.client.1.smithi099.stdout:0/486: chown da/f27 39106 1 2024-09-17T01:01:57.995 INFO:tasks.workunit.client.1.smithi099.stdout:0/487: stat da/l2e 0 2024-09-17T01:01:57.995 INFO:tasks.workunit.client.1.smithi099.stdout:4/496: dwrite d7/dd/d21/d26/d3f/d5b/f37 [0,4194304] 0 2024-09-17T01:01:57.996 INFO:tasks.workunit.client.1.smithi099.stdout:8/538: mkdir d0/d41/d5a/db2 0 2024-09-17T01:01:57.996 INFO:tasks.workunit.client.1.smithi099.stdout:8/539: chown d0/d4/l24 37541240 1 2024-09-17T01:01:57.996 INFO:tasks.workunit.client.0.smithi002.stdout:2/534: write d1b/d37/d48/d4e/f81 [1429207,115252] 0 2024-09-17T01:01:57.996 INFO:tasks.workunit.client.0.smithi002.stdout:2/535: write d1b/d8b/f8d [890277,105274] 0 2024-09-17T01:01:57.997 INFO:tasks.workunit.client.0.smithi002.stdout:2/536: write d1b/d37/f4d [4840023,98457] 0 2024-09-17T01:01:57.997 INFO:tasks.workunit.client.0.smithi002.stdout:8/594: sync 2024-09-17T01:01:57.997 INFO:tasks.workunit.client.0.smithi002.stdout:5/440: sync 2024-09-17T01:01:57.997 INFO:tasks.workunit.client.0.smithi002.stdout:5/441: dread - d2/d2d/d10/d14/f88 zero size 2024-09-17T01:01:57.998 INFO:tasks.workunit.client.1.smithi099.stdout:1/536: mkdir d0/d8/dbf 0 2024-09-17T01:01:57.999 INFO:tasks.workunit.client.0.smithi002.stdout:8/595: symlink d2/d30/d8b/lcc 0 2024-09-17T01:01:58.000 INFO:tasks.workunit.client.0.smithi002.stdout:5/442: mknod d2/c8b 0 2024-09-17T01:01:58.001 INFO:tasks.workunit.client.1.smithi099.stdout:5/537: link d2/l7f d2/dc/d17/d3c/d60/d90/da4/d9c/lab 0 2024-09-17T01:01:58.003 INFO:tasks.workunit.client.1.smithi099.stdout:3/562: stat d9/d15/d18/d1a/d23/f5f 0 2024-09-17T01:01:58.003 INFO:tasks.workunit.client.1.smithi099.stdout:3/563: readlink d9/d2b/d6b/la3 0 2024-09-17T01:01:58.003 INFO:tasks.workunit.client.1.smithi099.stdout:3/564: fdatasync d9/d3b/d44/d57/f5a 0 2024-09-17T01:01:58.003 INFO:tasks.workunit.client.1.smithi099.stdout:3/565: write d9/d15/d7d/f8a [5804912,110862] 0 2024-09-17T01:01:58.003 INFO:tasks.workunit.client.1.smithi099.stdout:3/566: fsync d9/d15/d18/f2f 0 2024-09-17T01:01:58.004 INFO:tasks.workunit.client.0.smithi002.stdout:8/596: mkdir d2/d1c/d28/dad/dcd 0 2024-09-17T01:01:58.005 INFO:tasks.workunit.client.1.smithi099.stdout:6/496: dread dc/d1a/d82/f88 [0,4194304] 0 2024-09-17T01:01:58.005 INFO:tasks.workunit.client.1.smithi099.stdout:7/500: mknod d1/d2c/d7a/c9f 0 2024-09-17T01:01:58.005 INFO:tasks.workunit.client.0.smithi002.stdout:5/443: link d2/d2d/d10/d14/d19/d39/d51/f79 d2/d2d/d10/d14/f8c 0 2024-09-17T01:01:58.005 INFO:tasks.workunit.client.0.smithi002.stdout:5/444: read - d2/d2d/d10/d14/d7d/f81 zero size 2024-09-17T01:01:58.006 INFO:tasks.workunit.client.0.smithi002.stdout:5/445: write d2/d2d/d10/f71 [60433,10985] 0 2024-09-17T01:01:58.006 INFO:tasks.workunit.client.1.smithi099.stdout:0/488: mkdir da/df/d1a/d49/d68/d9f 0 2024-09-17T01:01:58.007 INFO:tasks.workunit.client.0.smithi002.stdout:8/597: rmdir d2/d3/d5f/d47/d80 39 2024-09-17T01:01:58.007 INFO:tasks.workunit.client.0.smithi002.stdout:8/598: creat d2/d3/d5f/d98/da5/d4f/d77/d78/fce x:0 0 0 2024-09-17T01:01:58.008 INFO:tasks.workunit.client.1.smithi099.stdout:1/537: mknod d0/d8/d49/d94/d4b/cc0 0 2024-09-17T01:01:58.008 INFO:tasks.workunit.client.1.smithi099.stdout:1/538: fsync d0/f13 0 2024-09-17T01:01:58.009 INFO:tasks.workunit.client.0.smithi002.stdout:5/446: rename d2/d2d/d10/d3b/f85 to d2/d2d/d10/d14/d7d/f8d 0 2024-09-17T01:01:58.009 INFO:tasks.workunit.client.0.smithi002.stdout:5/447: chown d2/d2d/d10/d14/d19/d39/d25/c69 87016 1 2024-09-17T01:01:58.010 INFO:tasks.workunit.client.1.smithi099.stdout:5/538: unlink d2/d26/c3b 0 2024-09-17T01:01:58.010 INFO:tasks.workunit.client.1.smithi099.stdout:5/539: fsync d2/d8/f5b 0 2024-09-17T01:01:58.011 INFO:tasks.workunit.client.0.smithi002.stdout:5/448: creat d2/d2d/d10/d23/d6e/d60/f8e x:0 0 0 2024-09-17T01:01:58.012 INFO:tasks.workunit.client.1.smithi099.stdout:3/567: mkdir d9/d15/d7d/dad 0 2024-09-17T01:01:58.012 INFO:tasks.workunit.client.1.smithi099.stdout:3/568: chown d9/d15/f34 26317217 1 2024-09-17T01:01:58.012 INFO:tasks.workunit.client.0.smithi002.stdout:8/599: mknod d2/d9/ccf 0 2024-09-17T01:01:58.013 INFO:tasks.workunit.client.1.smithi099.stdout:6/497: truncate dc/d2b/f2c 1795255 0 2024-09-17T01:01:58.013 INFO:tasks.workunit.client.1.smithi099.stdout:6/498: write dc/d2b/d53/d96/f99 [593691,68096] 0 2024-09-17T01:01:58.013 INFO:tasks.workunit.client.1.smithi099.stdout:0/489: creat da/df/d1a/d49/fa0 x:0 0 0 2024-09-17T01:01:58.014 INFO:tasks.workunit.client.0.smithi002.stdout:8/600: creat d2/d26/dbb/fd0 x:0 0 0 2024-09-17T01:01:58.014 INFO:tasks.workunit.client.1.smithi099.stdout:3/569: truncate d9/d15/d18/d1a/d23/f43 1102614 0 2024-09-17T01:01:58.015 INFO:tasks.workunit.client.1.smithi099.stdout:6/499: creat dc/d2b/d53/d96/d60/f9b x:0 0 0 2024-09-17T01:01:58.016 INFO:tasks.workunit.client.1.smithi099.stdout:0/490: truncate da/d12/d22/f9a 2756285 0 2024-09-17T01:01:58.016 INFO:tasks.workunit.client.0.smithi002.stdout:8/601: unlink d2/d3/d5f/d98/da5/d71/l99 0 2024-09-17T01:01:58.016 INFO:tasks.workunit.client.0.smithi002.stdout:8/602: stat d2/d3/d5f/d98/da5/d4f/c53 0 2024-09-17T01:01:58.016 INFO:tasks.workunit.client.0.smithi002.stdout:8/603: truncate d2/d30/f32 894898 0 2024-09-17T01:01:58.016 INFO:tasks.workunit.client.0.smithi002.stdout:8/604: chown d2/f6b 10 1 2024-09-17T01:01:58.017 INFO:tasks.workunit.client.0.smithi002.stdout:8/605: write d2/f56 [1031548,19532] 0 2024-09-17T01:01:58.017 INFO:tasks.workunit.client.1.smithi099.stdout:3/570: mkdir d9/d2b/d6b/dae 0 2024-09-17T01:01:58.017 INFO:tasks.workunit.client.1.smithi099.stdout:6/500: mknod dc/d1a/d49/c9c 0 2024-09-17T01:01:58.017 INFO:tasks.workunit.client.1.smithi099.stdout:6/501: creat dc/d1a/d49/d4c/f9d x:0 0 0 2024-09-17T01:01:58.018 INFO:tasks.workunit.client.1.smithi099.stdout:0/491: mknod da/d12/d22/d52/ca1 0 2024-09-17T01:01:58.021 INFO:tasks.workunit.client.0.smithi002.stdout:5/449: dread d2/de/f4a [0,4194304] 0 2024-09-17T01:01:58.021 INFO:tasks.workunit.client.0.smithi002.stdout:5/450: chown d2/d2d/d10/d20/d24/f77 5216301 1 2024-09-17T01:01:58.021 INFO:tasks.workunit.client.0.smithi002.stdout:5/451: chown d2/d2d/d10/d14/d19/d39/d25/d32/f74 0 1 2024-09-17T01:01:58.021 INFO:tasks.workunit.client.1.smithi099.stdout:3/571: getdents d9/d15/d18/d1a/d23/d5c/d6e/d94 0 2024-09-17T01:01:58.021 INFO:tasks.workunit.client.1.smithi099.stdout:4/497: dwrite d7/dd/d21/f38 [0,4194304] 0 2024-09-17T01:01:58.021 INFO:tasks.workunit.client.1.smithi099.stdout:5/540: write d2/d8/f5b [431906,24977] 0 2024-09-17T01:01:58.021 INFO:tasks.workunit.client.1.smithi099.stdout:6/502: creat dc/d2b/f9e x:0 0 0 2024-09-17T01:01:58.022 INFO:tasks.workunit.client.1.smithi099.stdout:6/503: dread - dc/d27/f81 zero size 2024-09-17T01:01:58.022 INFO:tasks.workunit.client.1.smithi099.stdout:0/492: unlink da/d12/c45 0 2024-09-17T01:01:58.022 INFO:tasks.workunit.client.1.smithi099.stdout:8/540: dwrite d0/d41/f91 [0,4194304] 0 2024-09-17T01:01:58.025 INFO:tasks.workunit.client.1.smithi099.stdout:4/498: getdents d7/dd/de/d10/d85 0 2024-09-17T01:01:58.027 INFO:tasks.workunit.client.1.smithi099.stdout:6/504: symlink dc/d2b/d53/l9f 0 2024-09-17T01:01:58.027 INFO:tasks.workunit.client.1.smithi099.stdout:6/505: fsync dc/d2b/f76 0 2024-09-17T01:01:58.028 INFO:tasks.workunit.client.1.smithi099.stdout:0/493: rmdir da/df/d1a/d63/d6a/d7c 39 2024-09-17T01:01:58.034 INFO:tasks.workunit.client.1.smithi099.stdout:1/539: dwrite d0/d8/d49/d94/d4b/d59/f87 [0,4194304] 0 2024-09-17T01:01:58.036 INFO:tasks.workunit.client.1.smithi099.stdout:5/541: dread d2/f63 [0,4194304] 0 2024-09-17T01:01:58.037 INFO:tasks.workunit.client.1.smithi099.stdout:4/499: dread d7/dd/d21/d7b/f42 [0,4194304] 0 2024-09-17T01:01:58.037 INFO:tasks.workunit.client.1.smithi099.stdout:6/506: mknod dc/d1a/d82/ca0 0 2024-09-17T01:01:58.039 INFO:tasks.workunit.client.1.smithi099.stdout:8/541: mkdir d0/d4/d29/d4b/db3 0 2024-09-17T01:01:58.042 INFO:tasks.workunit.client.1.smithi099.stdout:5/542: creat d2/dc/d6c/fac x:0 0 0 2024-09-17T01:01:58.042 INFO:tasks.workunit.client.1.smithi099.stdout:5/543: write d2/d26/f2a [3752664,50129] 0 2024-09-17T01:01:58.042 INFO:tasks.workunit.client.1.smithi099.stdout:0/494: dread da/d1c/f3d [0,4194304] 0 2024-09-17T01:01:58.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:57 smithi099 ceph-mon[34357]: pgmap v252: 65 pgs: 65 active+clean; 1.7 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 193 MiB/s rd, 236 MiB/s wr, 646 op/s 2024-09-17T01:01:58.044 INFO:tasks.workunit.client.1.smithi099.stdout:4/500: creat d7/dd/d21/d7b/fab x:0 0 0 2024-09-17T01:01:58.044 INFO:tasks.workunit.client.1.smithi099.stdout:4/501: getdents d7/dd/de/d10/d6b/d82/d8a/d9b 0 2024-09-17T01:01:58.044 INFO:tasks.workunit.client.1.smithi099.stdout:6/507: symlink dc/d27/la1 0 2024-09-17T01:01:58.045 INFO:tasks.workunit.client.1.smithi099.stdout:5/544: mkdir d2/dc/d17/d3c/d60/dad 0 2024-09-17T01:01:58.047 INFO:tasks.workunit.client.1.smithi099.stdout:0/495: read da/df/d31/f4c [3099590,23198] 0 2024-09-17T01:01:58.048 INFO:tasks.workunit.client.1.smithi099.stdout:0/496: creat da/d12/d22/d52/fa2 x:0 0 0 2024-09-17T01:01:58.050 INFO:tasks.workunit.client.1.smithi099.stdout:1/540: dread d0/d8/f65 [0,4194304] 0 2024-09-17T01:01:58.126 INFO:tasks.workunit.client.1.smithi099.stdout:6/508: creat dc/d2b/d53/fa2 x:0 0 0 2024-09-17T01:01:58.127 INFO:tasks.workunit.client.1.smithi099.stdout:3/572: dwrite d9/d15/d18/d1a/d23/f2c [4194304,4194304] 0 2024-09-17T01:01:58.128 INFO:tasks.workunit.client.1.smithi099.stdout:0/497: dread da/df/d31/f4c [0,4194304] 0 2024-09-17T01:01:58.138 INFO:tasks.workunit.client.0.smithi002.stdout:8/606: dwrite f0 [0,4194304] 0 2024-09-17T01:01:58.138 INFO:tasks.workunit.client.0.smithi002.stdout:8/607: stat d2/d3/d5f/d98/da5/d4f/d77/d78/fce 0 2024-09-17T01:01:58.138 INFO:tasks.workunit.client.0.smithi002.stdout:8/608: fsync d2/d3/d5f/d98/fc4 0 2024-09-17T01:01:58.138 INFO:tasks.workunit.client.0.smithi002.stdout:5/452: dwrite d2/d2d/d10/d20/d24/f31 [4194304,4194304] 0 2024-09-17T01:01:58.139 INFO:tasks.workunit.client.0.smithi002.stdout:8/609: mkdir d2/d1c/d28/dad/dcd/dd1 0 2024-09-17T01:01:58.139 INFO:tasks.workunit.client.0.smithi002.stdout:5/453: read d2/f54 [32948,9378] 0 2024-09-17T01:01:58.141 INFO:tasks.workunit.client.1.smithi099.stdout:4/502: getdents d7/dd/de/d10/d6b 0 2024-09-17T01:01:58.143 INFO:tasks.workunit.client.0.smithi002.stdout:8/610: link d2/d3/d5f/d98/da5/d4f/la7 d2/d3/d5f/d98/da5/ld2 0 2024-09-17T01:01:58.144 INFO:tasks.workunit.client.0.smithi002.stdout:5/454: creat d2/d2d/d10/d14/d59/f8f x:0 0 0 2024-09-17T01:01:58.144 INFO:tasks.workunit.client.0.smithi002.stdout:5/455: readlink d2/d2d/l2f 0 2024-09-17T01:01:58.144 INFO:tasks.workunit.client.0.smithi002.stdout:5/456: fdatasync d2/d2d/d10/d14/d19/d39/f52 0 2024-09-17T01:01:58.144 INFO:tasks.workunit.client.0.smithi002.stdout:5/457: write d2/d2d/d10/d20/d24/f77 [3513836,84770] 0 2024-09-17T01:01:58.144 INFO:tasks.workunit.client.1.smithi099.stdout:3/573: mkdir d9/d2b/d52/d5e/daf 0 2024-09-17T01:01:58.145 INFO:tasks.workunit.client.0.smithi002.stdout:5/458: link d2/de/d1d/l3d d2/d2d/d10/d14/d19/d39/d3f/l90 0 2024-09-17T01:01:58.146 INFO:tasks.workunit.client.1.smithi099.stdout:4/503: unlink d7/dd/d21/d7b/fab 0 2024-09-17T01:01:58.148 INFO:tasks.workunit.client.1.smithi099.stdout:1/541: rename d0/d8/d38/d56/d93/lad to d0/d2/lc1 0 2024-09-17T01:01:58.149 INFO:tasks.workunit.client.1.smithi099.stdout:3/574: creat d9/d2b/fb0 x:0 0 0 2024-09-17T01:01:58.151 INFO:tasks.workunit.client.1.smithi099.stdout:4/504: rename d7/dd/d21/l4a to d7/dd/d21/lac 0 2024-09-17T01:01:58.153 INFO:tasks.workunit.client.1.smithi099.stdout:0/498: rename da/df/d4d/l77 to da/d1c/d1e/la3 0 2024-09-17T01:01:58.154 INFO:tasks.workunit.client.1.smithi099.stdout:6/509: dwrite dc/d1a/f40 [0,4194304] 0 2024-09-17T01:01:58.154 INFO:tasks.workunit.client.1.smithi099.stdout:8/542: dwrite d0/d1f/d55/d95/f99 [0,4194304] 0 2024-09-17T01:01:58.154 INFO:tasks.workunit.client.1.smithi099.stdout:3/575: dread d9/d15/d18/f2a [0,4194304] 0 2024-09-17T01:01:58.154 INFO:tasks.workunit.client.1.smithi099.stdout:8/543: chown d0/f18 635798621 1 2024-09-17T01:01:58.154 INFO:tasks.workunit.client.1.smithi099.stdout:6/510: dread - dc/d1a/f92 zero size 2024-09-17T01:01:58.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:57 smithi002 ceph-mon[27650]: pgmap v252: 65 pgs: 65 active+clean; 1.7 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 193 MiB/s rd, 236 MiB/s wr, 646 op/s 2024-09-17T01:01:58.158 INFO:tasks.workunit.client.1.smithi099.stdout:1/542: symlink d0/d8/d38/d56/d93/lc2 0 2024-09-17T01:01:58.160 INFO:tasks.workunit.client.1.smithi099.stdout:4/505: unlink d7/dd/d21/d26/d3f/d5b/da4/f81 0 2024-09-17T01:01:58.160 INFO:tasks.workunit.client.1.smithi099.stdout:4/506: write d7/dd/d21/f77 [950182,77168] 0 2024-09-17T01:01:58.163 INFO:tasks.workunit.client.0.smithi002.stdout:0/367: sync 2024-09-17T01:01:58.163 INFO:tasks.workunit.client.0.smithi002.stdout:3/515: sync 2024-09-17T01:01:58.164 INFO:tasks.workunit.client.0.smithi002.stdout:7/477: sync 2024-09-17T01:01:58.164 INFO:tasks.workunit.client.0.smithi002.stdout:2/537: sync 2024-09-17T01:01:58.164 INFO:tasks.workunit.client.0.smithi002.stdout:9/405: sync 2024-09-17T01:01:58.164 INFO:tasks.workunit.client.0.smithi002.stdout:0/368: dread - dd/d19/d1a/f70 zero size 2024-09-17T01:01:58.164 INFO:tasks.workunit.client.0.smithi002.stdout:9/406: rename d5/dc/d26/d34/d57 to d5/dc/d26/d34/d57/d72 22 2024-09-17T01:01:58.164 INFO:tasks.workunit.client.0.smithi002.stdout:7/478: write d1/d14/f3f [263664,24121] 0 2024-09-17T01:01:58.164 INFO:tasks.workunit.client.0.smithi002.stdout:4/583: sync 2024-09-17T01:01:58.165 INFO:tasks.workunit.client.0.smithi002.stdout:4/584: write d7/d19/d9f/f58 [1203144,98948] 0 2024-09-17T01:01:58.165 INFO:tasks.workunit.client.0.smithi002.stdout:4/585: fdatasync d7/d19/d9f/d80/d62/f31 0 2024-09-17T01:01:58.165 INFO:tasks.workunit.client.0.smithi002.stdout:4/586: write d7/d19/d2e/f39 [743090,1358] 0 2024-09-17T01:01:58.165 INFO:tasks.workunit.client.0.smithi002.stdout:1/479: sync 2024-09-17T01:01:58.165 INFO:tasks.workunit.client.0.smithi002.stdout:6/477: sync 2024-09-17T01:01:58.165 INFO:tasks.workunit.client.0.smithi002.stdout:3/516: rmdir d0/d3/d37/dac 39 2024-09-17T01:01:58.167 INFO:tasks.workunit.client.0.smithi002.stdout:7/479: unlink d1/d14/d1d/d21/d45/l94 0 2024-09-17T01:01:58.167 INFO:tasks.workunit.client.0.smithi002.stdout:7/480: chown d1/d14/d1d/d28/d40/d58/c87 216846 1 2024-09-17T01:01:58.169 INFO:tasks.workunit.client.0.smithi002.stdout:1/480: unlink d4/d11/d12/l16 0 2024-09-17T01:01:58.170 INFO:tasks.workunit.client.0.smithi002.stdout:1/481: write d4/d22/f39 [1255310,129012] 0 2024-09-17T01:01:58.171 INFO:tasks.workunit.client.0.smithi002.stdout:6/478: mkdir d2/d1d/d27/d80/d93 0 2024-09-17T01:01:58.173 INFO:tasks.workunit.client.0.smithi002.stdout:3/517: mkdir d0/d3/d8d/db3 0 2024-09-17T01:01:58.173 INFO:tasks.workunit.client.0.smithi002.stdout:3/518: dread - d0/d3/d17/f6f zero size 2024-09-17T01:01:58.174 INFO:tasks.workunit.client.0.smithi002.stdout:2/538: getdents d1b/d8a/d92 0 2024-09-17T01:01:58.174 INFO:tasks.workunit.client.0.smithi002.stdout:2/539: truncate d1b/d74/d93/fa9 848918 0 2024-09-17T01:01:58.174 INFO:tasks.workunit.client.0.smithi002.stdout:2/540: truncate d1b/d37/d48/fba 361798 0 2024-09-17T01:01:58.174 INFO:tasks.workunit.client.0.smithi002.stdout:9/407: dread d5/f18 [0,4194304] 0 2024-09-17T01:01:58.178 INFO:tasks.workunit.client.0.smithi002.stdout:1/482: rename d4/d11/d12/d30/f7f to d4/d11/fa8 0 2024-09-17T01:01:58.178 INFO:tasks.workunit.client.0.smithi002.stdout:3/519: mknod d0/d3/d33/d4f/cb4 0 2024-09-17T01:01:58.180 INFO:tasks.workunit.client.0.smithi002.stdout:8/611: dwrite d2/d3/d5f/d98/da5/d4f/d77/d78/f87 [0,4194304] 0 2024-09-17T01:01:58.181 INFO:tasks.workunit.client.0.smithi002.stdout:2/541: symlink d1b/d37/dc1/lc6 0 2024-09-17T01:01:58.181 INFO:tasks.workunit.client.0.smithi002.stdout:6/479: dread d2/f18 [0,4194304] 0 2024-09-17T01:01:58.182 INFO:tasks.workunit.client.0.smithi002.stdout:7/481: getdents d1/d14/d1d/d29 0 2024-09-17T01:01:58.184 INFO:tasks.workunit.client.0.smithi002.stdout:8/612: unlink f0 0 2024-09-17T01:01:58.185 INFO:tasks.workunit.client.0.smithi002.stdout:7/482: creat d1/d14/d67/f9d x:0 0 0 2024-09-17T01:01:58.185 INFO:tasks.workunit.client.0.smithi002.stdout:7/483: write f0 [281962,95132] 0 2024-09-17T01:01:58.189 INFO:tasks.workunit.client.0.smithi002.stdout:7/484: dread d1/d14/d1d/d28/d6b/f83 [0,4194304] 0 2024-09-17T01:01:58.190 INFO:tasks.workunit.client.0.smithi002.stdout:7/485: getdents d1/d14/d1d/d29/d57 0 2024-09-17T01:01:58.191 INFO:tasks.workunit.client.0.smithi002.stdout:0/369: dwrite dd/f36 [0,4194304] 0 2024-09-17T01:01:58.192 INFO:tasks.workunit.client.0.smithi002.stdout:5/459: dwrite d2/d2d/d10/d14/d19/d39/f3c [4194304,4194304] 0 2024-09-17T01:01:58.193 INFO:tasks.workunit.client.0.smithi002.stdout:0/370: mknod dd/d19/d1c/d1f/d76/c7d 0 2024-09-17T01:01:58.194 INFO:tasks.workunit.client.0.smithi002.stdout:0/371: dread - dd/f40 zero size 2024-09-17T01:01:58.195 INFO:tasks.workunit.client.1.smithi099.stdout:0/499: dwrite da/df/d1a/d63/d6a/f8a [0,4194304] 0 2024-09-17T01:01:58.195 INFO:tasks.workunit.client.1.smithi099.stdout:0/500: chown da/d1c/d1e/la3 81389 1 2024-09-17T01:01:58.196 INFO:tasks.workunit.client.0.smithi002.stdout:0/372: mknod dd/d19/d1c/d33/d67/d68/c7e 0 2024-09-17T01:01:58.196 INFO:tasks.workunit.client.0.smithi002.stdout:0/373: creat dd/d19/d1c/d33/d67/f7f x:0 0 0 2024-09-17T01:01:58.196 INFO:tasks.workunit.client.0.smithi002.stdout:0/374: dread - dd/d19/d1c/d33/d67/f66 zero size 2024-09-17T01:01:58.196 INFO:tasks.workunit.client.0.smithi002.stdout:0/375: creat dd/d19/d1c/d1f/d76/f80 x:0 0 0 2024-09-17T01:01:58.197 INFO:tasks.workunit.client.0.smithi002.stdout:0/376: truncate dd/d19/d1c/d33/d67/f66 454696 0 2024-09-17T01:01:58.197 INFO:tasks.workunit.client.0.smithi002.stdout:4/587: dwrite d7/d19/d9f/d9d/fa2 [0,4194304] 0 2024-09-17T01:01:58.202 INFO:tasks.workunit.client.0.smithi002.stdout:4/588: creat d7/d19/d9f/fb3 x:0 0 0 2024-09-17T01:01:58.204 INFO:tasks.workunit.client.0.smithi002.stdout:4/589: symlink d7/d19/d9f/d9d/da4/lb4 0 2024-09-17T01:01:58.204 INFO:tasks.workunit.client.0.smithi002.stdout:4/590: dread - d7/d19/d9f/fb3 zero size 2024-09-17T01:01:58.206 INFO:tasks.workunit.client.0.smithi002.stdout:7/486: dread d1/d14/d1d/d21/f61 [0,4194304] 0 2024-09-17T01:01:58.206 INFO:tasks.workunit.client.0.smithi002.stdout:7/487: chown d1/d14/d1d/d29 7296880 1 2024-09-17T01:01:58.206 INFO:tasks.workunit.client.0.smithi002.stdout:7/488: fsync d1/d14/d1d/d28/d2d/f35 0 2024-09-17T01:01:58.206 INFO:tasks.workunit.client.0.smithi002.stdout:7/489: write f0 [1236174,108906] 0 2024-09-17T01:01:58.211 INFO:tasks.workunit.client.0.smithi002.stdout:4/591: dread d7/d19/d2e/f33 [0,4194304] 0 2024-09-17T01:01:58.213 INFO:tasks.workunit.client.0.smithi002.stdout:4/592: creat d7/d19/d9f/d80/fb5 x:0 0 0 2024-09-17T01:01:58.213 INFO:tasks.workunit.client.0.smithi002.stdout:5/460: dread d2/d2d/d10/d14/d19/d39/d43/f16 [0,4194304] 0 2024-09-17T01:01:58.213 INFO:tasks.workunit.client.0.smithi002.stdout:5/461: truncate d2/f54 600697 0 2024-09-17T01:01:58.213 INFO:tasks.workunit.client.0.smithi002.stdout:5/462: creat d2/d2d/d10/d14/d19/d39/d64/f91 x:0 0 0 2024-09-17T01:01:58.215 INFO:tasks.workunit.client.1.smithi099.stdout:3/576: link d9/d15/d18/d1a/d23/d4c/c95 d9/d15/cb1 0 2024-09-17T01:01:58.215 INFO:tasks.workunit.client.0.smithi002.stdout:5/463: creat d2/f92 x:0 0 0 2024-09-17T01:01:58.216 INFO:tasks.workunit.client.0.smithi002.stdout:9/408: dwrite d5/f1d [0,4194304] 0 2024-09-17T01:01:58.216 INFO:tasks.workunit.client.0.smithi002.stdout:4/593: link d7/d19/d9f/d80/d62/d52/l6d d7/de/d32/d8a/d77/d9b/lb6 0 2024-09-17T01:01:58.217 INFO:tasks.workunit.client.1.smithi099.stdout:6/511: symlink dc/d1a/d82/la3 0 2024-09-17T01:01:58.219 INFO:tasks.workunit.client.1.smithi099.stdout:1/543: mkdir d0/d8/d49/d94/d4b/d59/dc3 0 2024-09-17T01:01:58.219 INFO:tasks.workunit.client.1.smithi099.stdout:1/544: chown d0/d8/d49/d94/d4b/d59/dc3 25531499 1 2024-09-17T01:01:58.219 INFO:tasks.workunit.client.1.smithi099.stdout:1/545: write d0/d8/d49/d94/f72 [632065,79164] 0 2024-09-17T01:01:58.219 INFO:tasks.workunit.client.0.smithi002.stdout:5/464: rename d2/d2d/d10/d3b/c4b to d2/d2d/d10/d20/d24/c93 0 2024-09-17T01:01:58.224 INFO:tasks.workunit.client.0.smithi002.stdout:9/409: rename d5/dc/d26/c2a to d5/dc/d26/d34/c73 0 2024-09-17T01:01:58.225 INFO:tasks.workunit.client.0.smithi002.stdout:9/410: chown d5/dc/d26/d34/d57/f64 14878 1 2024-09-17T01:01:58.225 INFO:tasks.workunit.client.0.smithi002.stdout:4/594: read d7/de/d32/f40 [3801318,125094] 0 2024-09-17T01:01:58.225 INFO:tasks.workunit.client.0.smithi002.stdout:5/465: symlink d2/d2d/d10/d14/d19/d39/d3f/l94 0 2024-09-17T01:01:58.225 INFO:tasks.workunit.client.0.smithi002.stdout:5/466: mkdir d2/d2d/d10/d95 0 2024-09-17T01:01:58.225 INFO:tasks.workunit.client.0.smithi002.stdout:5/467: fdatasync d2/d2d/d10/d14/d19/d39/f35 0 2024-09-17T01:01:58.225 INFO:tasks.workunit.client.0.smithi002.stdout:5/468: dread - d2/d2d/d10/d14/d59/f8f zero size 2024-09-17T01:01:58.226 INFO:tasks.workunit.client.0.smithi002.stdout:5/469: mkdir d2/d2d/d10/d95/d96 0 2024-09-17T01:01:58.226 INFO:tasks.workunit.client.0.smithi002.stdout:5/470: dread - d2/d2d/d10/d14/d19/d39/d64/f91 zero size 2024-09-17T01:01:58.227 INFO:tasks.workunit.client.0.smithi002.stdout:4/595: dread d7/d19/d2e/f33 [0,4194304] 0 2024-09-17T01:01:58.227 INFO:tasks.workunit.client.0.smithi002.stdout:4/596: fdatasync d7/de/d3a/f5e 0 2024-09-17T01:01:58.227 INFO:tasks.workunit.client.0.smithi002.stdout:4/597: read d7/d19/d9f/d80/d62/f6f [96422,60456] 0 2024-09-17T01:01:58.232 INFO:tasks.workunit.client.0.smithi002.stdout:9/411: dread d5/dc/d26/d46/f50 [0,4194304] 0 2024-09-17T01:01:58.232 INFO:tasks.workunit.client.0.smithi002.stdout:9/412: write d5/dc/d26/d34/f3c [590009,93457] 0 2024-09-17T01:01:58.234 INFO:tasks.workunit.client.0.smithi002.stdout:9/413: symlink d5/dc/d26/l74 0 2024-09-17T01:01:58.244 INFO:tasks.workunit.client.0.smithi002.stdout:1/483: dwrite d4/fa [4194304,4194304] 0 2024-09-17T01:01:58.244 INFO:tasks.workunit.client.0.smithi002.stdout:1/484: stat d4/d11/d12/d14/d17/d51/d88/da3 0 2024-09-17T01:01:58.246 INFO:tasks.workunit.client.0.smithi002.stdout:1/485: mkdir d4/d22/d8d/da9 0 2024-09-17T01:01:58.250 INFO:tasks.workunit.client.0.smithi002.stdout:3/520: dwrite d0/d3/d33/f7b [0,4194304] 0 2024-09-17T01:01:58.250 INFO:tasks.workunit.client.0.smithi002.stdout:6/480: dwrite d2/d1d/d27/d30/f78 [0,4194304] 0 2024-09-17T01:01:58.251 INFO:tasks.workunit.client.0.smithi002.stdout:6/481: fdatasync d2/f18 0 2024-09-17T01:01:58.251 INFO:tasks.workunit.client.0.smithi002.stdout:6/482: fsync d2/d1d/d2d/f4f 0 2024-09-17T01:01:58.251 INFO:tasks.workunit.client.0.smithi002.stdout:6/483: write d2/d1d/d26/d49/f72 [64469,57839] 0 2024-09-17T01:01:58.251 INFO:tasks.workunit.client.0.smithi002.stdout:3/521: creat d0/d3/fb5 x:0 0 0 2024-09-17T01:01:58.251 INFO:tasks.workunit.client.0.smithi002.stdout:3/522: write d0/d3/d33/f86 [4942938,103171] 0 2024-09-17T01:01:58.251 INFO:tasks.workunit.client.0.smithi002.stdout:3/523: write d0/d3/fb2 [91100,9391] 0 2024-09-17T01:01:58.251 INFO:tasks.workunit.client.0.smithi002.stdout:3/524: read - d0/d3/d17/d9a/f89 zero size 2024-09-17T01:01:58.251 INFO:tasks.workunit.client.0.smithi002.stdout:2/542: dwrite d1b/f1c [4194304,4194304] 0 2024-09-17T01:01:58.251 INFO:tasks.workunit.client.0.smithi002.stdout:2/543: read d1b/d1d/f33 [3624869,22794] 0 2024-09-17T01:01:58.251 INFO:tasks.workunit.client.0.smithi002.stdout:2/544: chown d1b/d8a/d92/l97 1628275 1 2024-09-17T01:01:58.251 INFO:tasks.workunit.client.0.smithi002.stdout:0/377: dwrite dd/d19/d1a/f1d [0,4194304] 0 2024-09-17T01:01:58.253 INFO:tasks.workunit.client.0.smithi002.stdout:3/525: creat d0/d3/d37/dac/da1/fb6 x:0 0 0 2024-09-17T01:01:58.254 INFO:tasks.workunit.client.0.smithi002.stdout:2/545: mknod d1b/d37/d48/d4e/dc5/cc7 0 2024-09-17T01:01:58.254 INFO:tasks.workunit.client.0.smithi002.stdout:0/378: mknod dd/d19/d1a/c81 0 2024-09-17T01:01:58.263 INFO:tasks.workunit.client.0.smithi002.stdout:3/526: rename d0/d3/d17/d9a/f5c to d0/d3/d17/d6a/fb7 0 2024-09-17T01:01:58.265 INFO:tasks.workunit.client.0.smithi002.stdout:3/527: mkdir d0/d31/d32/db8 0 2024-09-17T01:01:58.267 INFO:tasks.workunit.client.0.smithi002.stdout:3/528: rename d0/d3/d17/d9a/f69 to d0/d31/d32/fb9 0 2024-09-17T01:01:58.267 INFO:tasks.workunit.client.0.smithi002.stdout:0/379: rmdir dd/d19/d1c/d1f/d39/d65 0 2024-09-17T01:01:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:3/529: dread d0/d3/d17/f68 [0,4194304] 0 2024-09-17T01:01:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:3/530: chown d0/d31/d32/c67 579 1 2024-09-17T01:01:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:0/380: creat dd/d19/f82 x:0 0 0 2024-09-17T01:01:58.270 INFO:tasks.workunit.client.0.smithi002.stdout:7/490: dwrite d1/d14/d1d/d29/d30/f53 [0,4194304] 0 2024-09-17T01:01:58.270 INFO:tasks.workunit.client.0.smithi002.stdout:3/531: creat d0/d31/da7/fba x:0 0 0 2024-09-17T01:01:58.270 INFO:tasks.workunit.client.0.smithi002.stdout:5/471: dwrite d2/d2d/d10/d14/d7d/f8d [0,4194304] 0 2024-09-17T01:01:58.270 INFO:tasks.workunit.client.0.smithi002.stdout:5/472: readlink d2/d2d/d10/d14/d19/d39/d43/l12 0 2024-09-17T01:01:58.271 INFO:tasks.workunit.client.0.smithi002.stdout:5/473: stat d2/d2d/d10/d14/d19/d39/d43/l56 0 2024-09-17T01:01:58.271 INFO:tasks.workunit.client.0.smithi002.stdout:5/474: chown d2/d2d/d10/d20/d24/f31 25912703 1 2024-09-17T01:01:58.272 INFO:tasks.workunit.client.0.smithi002.stdout:7/491: truncate d1/d14/d1d/d28/f4f 793060 0 2024-09-17T01:01:58.272 INFO:tasks.workunit.client.0.smithi002.stdout:5/475: dread d2/de/f4a [0,4194304] 0 2024-09-17T01:01:58.273 INFO:tasks.workunit.client.0.smithi002.stdout:5/476: mkdir d2/d2d/d10/d14/d19/d39/d97 0 2024-09-17T01:01:58.274 INFO:tasks.workunit.client.0.smithi002.stdout:3/532: dread d0/f61 [0,4194304] 0 2024-09-17T01:01:58.275 INFO:tasks.workunit.client.0.smithi002.stdout:7/492: rename d1/d14/d1d/d29/d30 to d1/d14/d1d/d28/d6b/d9e 0 2024-09-17T01:01:58.275 INFO:tasks.workunit.client.0.smithi002.stdout:3/533: rmdir d0/d3/d17/d35 39 2024-09-17T01:01:58.279 INFO:tasks.workunit.client.0.smithi002.stdout:1/486: dwrite d4/d11/d12/d14/f2b [0,4194304] 0 2024-09-17T01:01:58.280 INFO:tasks.workunit.client.0.smithi002.stdout:9/414: dwrite d5/f14 [0,4194304] 0 2024-09-17T01:01:58.280 INFO:tasks.workunit.client.0.smithi002.stdout:4/598: dwrite d7/d19/d9f/d80/d62/f6f [0,4194304] 0 2024-09-17T01:01:58.280 INFO:tasks.workunit.client.0.smithi002.stdout:4/599: stat d7/d19/d9c/ca8 0 2024-09-17T01:01:58.281 INFO:tasks.workunit.client.0.smithi002.stdout:2/546: dwrite d1b/d37/f91 [0,4194304] 0 2024-09-17T01:01:58.281 INFO:tasks.workunit.client.0.smithi002.stdout:2/547: truncate d1b/d37/d48/d4e/f90 708422 0 2024-09-17T01:01:58.287 INFO:tasks.workunit.client.0.smithi002.stdout:2/548: dread d1b/d37/d48/d4e/f81 [0,4194304] 0 2024-09-17T01:01:58.287 INFO:tasks.workunit.client.0.smithi002.stdout:0/381: dread dd/d19/f3a [0,4194304] 0 2024-09-17T01:01:58.287 INFO:tasks.workunit.client.0.smithi002.stdout:9/415: readlink d5/dc/l27 0 2024-09-17T01:01:58.287 INFO:tasks.workunit.client.0.smithi002.stdout:4/600: dread d7/de/f79 [0,4194304] 0 2024-09-17T01:01:58.287 INFO:tasks.workunit.client.1.smithi099.stdout:4/507: truncate d7/dd/d21/d26/d3f/d5b/f2d 312814 0 2024-09-17T01:01:58.290 INFO:tasks.workunit.client.0.smithi002.stdout:2/549: truncate d1b/d1d/f98 930512 0 2024-09-17T01:01:58.293 INFO:tasks.workunit.client.0.smithi002.stdout:4/601: unlink d7/de/d32/d8a/d77/d9b/f50 0 2024-09-17T01:01:58.293 INFO:tasks.workunit.client.0.smithi002.stdout:4/602: chown d7/d71/d8e/la3 5998161 1 2024-09-17T01:01:58.295 INFO:tasks.workunit.client.0.smithi002.stdout:0/382: rmdir dd/d19/d1c/d33 39 2024-09-17T01:01:58.295 INFO:tasks.workunit.client.0.smithi002.stdout:2/550: dread d1b/d74/d93/d94/fb0 [0,4194304] 0 2024-09-17T01:01:58.298 INFO:tasks.workunit.client.1.smithi099.stdout:3/577: rename d9/d2b/d52/d5e to d9/d3b/db2 0 2024-09-17T01:01:58.298 INFO:tasks.workunit.client.0.smithi002.stdout:2/551: mkdir d1b/d1d/dc8 0 2024-09-17T01:01:58.301 INFO:tasks.workunit.client.1.smithi099.stdout:6/512: link dc/d2b/d53/d96/c54 dc/d5d/d66/d7a/ca4 0 2024-09-17T01:01:58.302 INFO:tasks.workunit.client.0.smithi002.stdout:2/552: unlink d1b/d74/d93/fa9 0 2024-09-17T01:01:58.302 INFO:tasks.workunit.client.1.smithi099.stdout:4/508: write d7/dd/de/ff [4739253,73121] 0 2024-09-17T01:01:58.303 INFO:tasks.workunit.client.1.smithi099.stdout:1/546: unlink d0/d8/d49/d94/l17 0 2024-09-17T01:01:58.306 INFO:tasks.workunit.client.0.smithi002.stdout:9/416: dread d5/f20 [4194304,4194304] 0 2024-09-17T01:01:58.306 INFO:tasks.workunit.client.0.smithi002.stdout:0/383: write dd/f32 [691765,42100] 0 2024-09-17T01:01:58.306 INFO:tasks.workunit.client.0.smithi002.stdout:0/384: truncate dd/d19/d1a/f5f 140241 0 2024-09-17T01:01:58.307 INFO:tasks.workunit.client.1.smithi099.stdout:0/501: rmdir da/df/d1a/d56 39 2024-09-17T01:01:58.310 INFO:tasks.workunit.client.1.smithi099.stdout:4/509: link d7/dd/d21/d7b/c9f d7/dd/de/d10/d6b/cad 0 2024-09-17T01:01:58.311 INFO:tasks.workunit.client.0.smithi002.stdout:9/417: rename d5/dc/d26/d34 to d5/dc/d26/d5c/d6b/d75 0 2024-09-17T01:01:58.312 INFO:tasks.workunit.client.1.smithi099.stdout:0/502: mkdir da/df/d1a/d63/d6a/da4 0 2024-09-17T01:01:58.312 INFO:tasks.workunit.client.0.smithi002.stdout:1/487: dwrite d4/d22/f39 [0,4194304] 0 2024-09-17T01:01:58.312 INFO:tasks.workunit.client.0.smithi002.stdout:1/488: truncate d4/d11/d12/d23/f89 1236438 0 2024-09-17T01:01:58.315 INFO:tasks.workunit.client.1.smithi099.stdout:4/510: link d7/dd/d21/d26/d3f/la5 d7/dd/de/d10/d6b/d82/d8a/lae 0 2024-09-17T01:01:58.316 INFO:tasks.workunit.client.1.smithi099.stdout:4/511: readlink d7/dd/d21/d26/d3f/d5b/l45 0 2024-09-17T01:01:58.316 INFO:tasks.workunit.client.1.smithi099.stdout:4/512: write d7/fb [2365039,57726] 0 2024-09-17T01:01:58.316 INFO:tasks.workunit.client.1.smithi099.stdout:4/513: write f2 [6585894,56627] 0 2024-09-17T01:01:58.316 INFO:tasks.workunit.client.0.smithi002.stdout:2/553: read d1b/d37/f4d [1633386,126720] 0 2024-09-17T01:01:58.317 INFO:tasks.workunit.client.0.smithi002.stdout:9/418: dread d5/f20 [4194304,4194304] 0 2024-09-17T01:01:58.317 INFO:tasks.workunit.client.1.smithi099.stdout:0/503: link da/df/d1a/d49/d68/f98 da/df/d1a/d56/d72/fa5 0 2024-09-17T01:01:58.317 INFO:tasks.workunit.client.0.smithi002.stdout:1/489: truncate d4/d11/d55/d7a/f9a 909449 0 2024-09-17T01:01:58.318 INFO:tasks.workunit.client.1.smithi099.stdout:0/504: creat da/d12/fa6 x:0 0 0 2024-09-17T01:01:58.318 INFO:tasks.workunit.client.0.smithi002.stdout:2/554: chown d1b/d1d/f1f 226119 1 2024-09-17T01:01:58.320 INFO:tasks.workunit.client.0.smithi002.stdout:9/419: unlink d5/f18 0 2024-09-17T01:01:58.320 INFO:tasks.workunit.client.0.smithi002.stdout:9/420: fsync d5/dc/d26/d46/f50 0 2024-09-17T01:01:58.320 INFO:tasks.workunit.client.1.smithi099.stdout:0/505: unlink da/df/d1a/d56/d72/fa5 0 2024-09-17T01:01:58.321 INFO:tasks.workunit.client.0.smithi002.stdout:1/490: mkdir d4/d11/d1a/daa 0 2024-09-17T01:01:58.322 INFO:tasks.workunit.client.1.smithi099.stdout:1/547: write d0/d2/ff [2769373,5480] 0 2024-09-17T01:01:58.323 INFO:tasks.workunit.client.1.smithi099.stdout:5/545: dwrite d2/d26/f27 [0,4194304] 0 2024-09-17T01:01:58.323 INFO:tasks.workunit.client.0.smithi002.stdout:9/421: creat d5/dc/d26/d5c/d6b/d75/f76 x:0 0 0 2024-09-17T01:01:58.324 INFO:tasks.workunit.client.1.smithi099.stdout:3/578: dwrite d9/d3b/db2/fa4 [0,4194304] 0 2024-09-17T01:01:58.325 INFO:tasks.workunit.client.0.smithi002.stdout:1/491: rmdir d4 39 2024-09-17T01:01:58.325 INFO:tasks.workunit.client.0.smithi002.stdout:1/492: chown d4/d11/d1c/l5f 1204 1 2024-09-17T01:01:58.325 INFO:tasks.workunit.client.1.smithi099.stdout:5/546: dread d2/f1b [0,4194304] 0 2024-09-17T01:01:58.326 INFO:tasks.workunit.client.1.smithi099.stdout:6/513: dwrite dc/d1a/d82/f88 [4194304,4194304] 0 2024-09-17T01:01:58.326 INFO:tasks.workunit.client.1.smithi099.stdout:6/514: dread - dc/d27/d7e/f9a zero size 2024-09-17T01:01:58.326 INFO:tasks.workunit.client.0.smithi002.stdout:4/603: truncate d7/d19/d9f/d80/d62/f6f 1495691 0 2024-09-17T01:01:58.327 INFO:tasks.workunit.client.0.smithi002.stdout:9/422: chown d5/dc/l59 1502168113 1 2024-09-17T01:01:58.327 INFO:tasks.workunit.client.0.smithi002.stdout:9/423: write d5/dc/d26/d5c/d6b/f6e [116959,51827] 0 2024-09-17T01:01:58.329 INFO:tasks.workunit.client.0.smithi002.stdout:2/555: rename d1b/d37/d48/d78/daa to d1b/d3f/d59/d7f/dc9 0 2024-09-17T01:01:58.329 INFO:tasks.workunit.client.1.smithi099.stdout:1/548: stat d0/d2/cbb 0 2024-09-17T01:01:58.329 INFO:tasks.workunit.client.1.smithi099.stdout:1/549: write d0/d8/d49/f5e [2097410,60996] 0 2024-09-17T01:01:58.329 INFO:tasks.workunit.client.1.smithi099.stdout:1/550: truncate d0/d2/de/d8b/f9a 4278712 0 2024-09-17T01:01:58.335 INFO:tasks.workunit.client.1.smithi099.stdout:4/514: dread d7/fb [0,4194304] 0 2024-09-17T01:01:58.335 INFO:tasks.workunit.client.1.smithi099.stdout:5/547: rename d2/dc/d14/l56 to d2/dc/d17/d3c/d60/lae 0 2024-09-17T01:01:58.338 INFO:tasks.workunit.client.1.smithi099.stdout:6/515: truncate fa 2538987 0 2024-09-17T01:01:58.338 INFO:tasks.workunit.client.1.smithi099.stdout:6/516: write dc/d27/d58/f8a [470549,115197] 0 2024-09-17T01:01:58.341 INFO:tasks.workunit.client.1.smithi099.stdout:4/515: mknod d7/dd/de/d17/caf 0 2024-09-17T01:01:58.341 INFO:tasks.workunit.client.0.smithi002.stdout:9/424: dwrite d5/dc/d26/d5c/d6b/d75/f42 [0,4194304] 0 2024-09-17T01:01:58.341 INFO:tasks.workunit.client.0.smithi002.stdout:9/425: read d5/f44 [492961,102864] 0 2024-09-17T01:01:58.342 INFO:tasks.workunit.client.1.smithi099.stdout:3/579: write d9/d15/d18/f82 [1767125,30435] 0 2024-09-17T01:01:58.343 INFO:tasks.workunit.client.1.smithi099.stdout:1/551: rename d0/d2/f88 to d0/d2/de/d70/fc4 0 2024-09-17T01:01:58.343 INFO:tasks.workunit.client.1.smithi099.stdout:1/552: write d0/d2/d61/fab [179748,58298] 0 2024-09-17T01:01:58.343 INFO:tasks.workunit.client.1.smithi099.stdout:5/548: getdents d2/d8 0 2024-09-17T01:01:58.344 INFO:tasks.workunit.client.1.smithi099.stdout:1/553: dread d0/d2/d5/f4d [0,4194304] 0 2024-09-17T01:01:58.346 INFO:tasks.workunit.client.0.smithi002.stdout:2/556: dwrite d1b/d37/d48/d4e/f2e [0,4194304] 0 2024-09-17T01:01:58.346 INFO:tasks.workunit.client.1.smithi099.stdout:6/517: unlink dc/d27/la1 0 2024-09-17T01:01:58.348 INFO:tasks.workunit.client.1.smithi099.stdout:3/580: creat d9/d15/d18/d1a/d23/fb3 x:0 0 0 2024-09-17T01:01:58.350 INFO:tasks.workunit.client.1.smithi099.stdout:1/554: symlink d0/d8/d38/d8a/lc5 0 2024-09-17T01:01:58.350 INFO:tasks.workunit.client.1.smithi099.stdout:1/555: creat d0/d8c/fc6 x:0 0 0 2024-09-17T01:01:58.353 INFO:tasks.workunit.client.1.smithi099.stdout:4/516: rename d7/dd/d21/d7b/d4b/f34 to d7/dd/fb0 0 2024-09-17T01:01:58.353 INFO:tasks.workunit.client.1.smithi099.stdout:4/517: write d7/dd/d21/d26/f6c [1888372,53615] 0 2024-09-17T01:01:58.354 INFO:tasks.workunit.client.1.smithi099.stdout:4/518: fsync d7/dd/d21/d26/f65 0 2024-09-17T01:01:58.354 INFO:tasks.workunit.client.1.smithi099.stdout:4/519: dread d7/dd/de/f3c [0,4194304] 0 2024-09-17T01:01:58.355 INFO:tasks.workunit.client.1.smithi099.stdout:1/556: mkdir d0/d8/d49/d94/d4b/d59/db9/dc7 0 2024-09-17T01:01:58.357 INFO:tasks.workunit.client.1.smithi099.stdout:1/557: mkdir d0/d8/d49/d94/d4b/d59/db9/dc8 0 2024-09-17T01:01:58.358 INFO:tasks.workunit.client.1.smithi099.stdout:1/558: getdents d0/d8/d38/d75 0 2024-09-17T01:01:58.361 INFO:tasks.workunit.client.1.smithi099.stdout:5/549: dwrite d2/f1b [0,4194304] 0 2024-09-17T01:01:58.361 INFO:tasks.workunit.client.1.smithi099.stdout:5/550: chown d2/dc/d17/d3c/d81/f84 10902344 1 2024-09-17T01:01:58.361 INFO:tasks.workunit.client.1.smithi099.stdout:5/551: write d2/dc/d14/f4f [936488,111702] 0 2024-09-17T01:01:58.362 INFO:tasks.workunit.client.1.smithi099.stdout:1/559: rename d0/d2/de/d8b/l85 to d0/d8c/lc9 0 2024-09-17T01:01:58.366 INFO:tasks.workunit.client.1.smithi099.stdout:4/520: write d7/dd/d21/d26/f60 [548187,81731] 0 2024-09-17T01:01:58.366 INFO:tasks.workunit.client.1.smithi099.stdout:4/521: creat d7/dd/d21/d7b/fb1 x:0 0 0 2024-09-17T01:01:58.367 INFO:tasks.workunit.client.1.smithi099.stdout:4/522: write d7/dd/d21/d26/f6c [1083414,113595] 0 2024-09-17T01:01:58.369 INFO:tasks.workunit.client.1.smithi099.stdout:4/523: unlink d7/dd/de/la8 0 2024-09-17T01:01:58.369 INFO:tasks.workunit.client.1.smithi099.stdout:4/524: readlink d7/dd/de/d10/d6b/d82/d8a/lae 0 2024-09-17T01:01:58.369 INFO:tasks.workunit.client.1.smithi099.stdout:4/525: fsync d7/dd/f28 0 2024-09-17T01:01:58.370 INFO:tasks.workunit.client.1.smithi099.stdout:4/526: link d7/dd/d21/d26/f56 d7/dd/d21/fb2 0 2024-09-17T01:01:58.371 INFO:tasks.workunit.client.1.smithi099.stdout:6/518: dwrite dc/d27/d58/f8a [0,4194304] 0 2024-09-17T01:01:58.371 INFO:tasks.workunit.client.1.smithi099.stdout:6/519: chown dc/d2b/d53/d96/d60/f9b 11 1 2024-09-17T01:01:58.374 INFO:tasks.workunit.client.1.smithi099.stdout:1/560: dread d0/d2/de/d8b/f9a [0,4194304] 0 2024-09-17T01:01:58.374 INFO:tasks.workunit.client.1.smithi099.stdout:3/581: dwrite d9/d3b/db2/fa4 [0,4194304] 0 2024-09-17T01:01:58.374 INFO:tasks.workunit.client.1.smithi099.stdout:4/527: fsync d7/dd/d21/d26/f60 0 2024-09-17T01:01:58.374 INFO:tasks.workunit.client.1.smithi099.stdout:4/528: truncate d7/dd/de/d17/d72/faa 123575 0 2024-09-17T01:01:58.375 INFO:tasks.workunit.client.1.smithi099.stdout:6/520: rename l6 to dc/d2b/d53/d96/la5 0 2024-09-17T01:01:58.375 INFO:tasks.workunit.client.1.smithi099.stdout:5/552: dread d2/dc/d17/d3c/d60/d90/da4/f54 [0,4194304] 0 2024-09-17T01:01:58.377 INFO:tasks.workunit.client.0.smithi002.stdout:4/604: symlink d7/d19/d9f/d9d/da4/lb7 0 2024-09-17T01:01:58.378 INFO:tasks.workunit.client.0.smithi002.stdout:1/493: rmdir d4/d11/d12/d23/d32 39 2024-09-17T01:01:58.379 INFO:tasks.workunit.client.0.smithi002.stdout:1/494: chown d4/d11/d12/d14/d17/d20/c78 19 1 2024-09-17T01:01:58.379 INFO:tasks.workunit.client.0.smithi002.stdout:1/495: stat d4/d11/d12/d14/d17/d40/l76 0 2024-09-17T01:01:58.379 INFO:tasks.workunit.client.1.smithi099.stdout:1/561: rmdir d0/d2/de/d31 39 2024-09-17T01:01:58.386 INFO:tasks.workunit.client.1.smithi099.stdout:4/529: link d7/dd/d21/d7b/d4b/c55 d7/dd/d21/d7b/cb3 0 2024-09-17T01:01:58.388 INFO:tasks.workunit.client.0.smithi002.stdout:9/426: rename d5/dc/d26/d5c/d6b/d75/l6d to d5/dc/d26/d5c/d6b/d75/d36/l77 0 2024-09-17T01:01:58.392 INFO:tasks.workunit.client.1.smithi099.stdout:1/562: read d0/d8/d49/d94/d4b/d59/f87 [4136803,127599] 0 2024-09-17T01:01:58.392 INFO:tasks.workunit.client.1.smithi099.stdout:4/530: symlink d7/dd/d21/lb4 0 2024-09-17T01:01:58.394 INFO:tasks.workunit.client.0.smithi002.stdout:4/605: creat d7/d71/d8e/fb8 x:0 0 0 2024-09-17T01:01:58.395 INFO:tasks.workunit.client.1.smithi099.stdout:4/531: creat d7/dd/de/d10/d6b/d82/d8a/d9a/da6/fb5 x:0 0 0 2024-09-17T01:01:58.395 INFO:tasks.workunit.client.0.smithi002.stdout:1/496: symlink d4/d11/d12/d30/d5e/lab 0 2024-09-17T01:01:58.395 INFO:tasks.workunit.client.0.smithi002.stdout:1/497: dread - d4/d11/d55/f92 zero size 2024-09-17T01:01:58.396 INFO:tasks.workunit.client.1.smithi099.stdout:5/553: write d2/d8/f5b [5841629,19630] 0 2024-09-17T01:01:58.397 INFO:tasks.workunit.client.1.smithi099.stdout:1/563: write d0/d8/f65 [2271916,687] 0 2024-09-17T01:01:58.398 INFO:tasks.workunit.client.0.smithi002.stdout:4/606: symlink d7/de/d3a/lb9 0 2024-09-17T01:01:58.398 INFO:tasks.workunit.client.0.smithi002.stdout:4/607: creat d7/d71/d8e/fba x:0 0 0 2024-09-17T01:01:58.399 INFO:tasks.workunit.client.0.smithi002.stdout:9/427: write d5/dc/d26/f31 [829414,22417] 0 2024-09-17T01:01:58.400 INFO:tasks.workunit.client.1.smithi099.stdout:6/521: dread dc/d1a/d49/f73 [0,4194304] 0 2024-09-17T01:01:58.400 INFO:tasks.workunit.client.1.smithi099.stdout:3/582: dwrite d9/d15/f34 [4194304,4194304] 0 2024-09-17T01:01:58.400 INFO:tasks.workunit.client.1.smithi099.stdout:6/522: readlink dc/d27/l90 0 2024-09-17T01:01:58.401 INFO:tasks.workunit.client.0.smithi002.stdout:1/498: link d4/d11/d12/l96 d4/d11/d1a/daa/lac 0 2024-09-17T01:01:58.403 INFO:tasks.workunit.client.1.smithi099.stdout:5/554: creat d2/faf x:0 0 0 2024-09-17T01:01:58.405 INFO:tasks.workunit.client.0.smithi002.stdout:9/428: unlink d5/dc/d26/d46/f5b 0 2024-09-17T01:01:58.407 INFO:tasks.workunit.client.1.smithi099.stdout:1/564: rename d0/d2/de/d31/c97 to d0/d8/d38/d56/cca 0 2024-09-17T01:01:58.407 INFO:tasks.workunit.client.1.smithi099.stdout:1/565: truncate d0/f13 4539941 0 2024-09-17T01:01:58.407 INFO:tasks.workunit.client.1.smithi099.stdout:1/566: write d0/d8/d38/d56/f63 [922245,38182] 0 2024-09-17T01:01:58.407 INFO:tasks.workunit.client.1.smithi099.stdout:1/567: fsync d0/d2/ff 0 2024-09-17T01:01:58.408 INFO:tasks.workunit.client.0.smithi002.stdout:9/429: creat d5/dc/d26/d63/d66/f78 x:0 0 0 2024-09-17T01:01:58.410 INFO:tasks.workunit.client.0.smithi002.stdout:9/430: getdents d5/dc/d26/d5c/d6b/d75 0 2024-09-17T01:01:58.410 INFO:tasks.workunit.client.0.smithi002.stdout:9/431: chown d5/dc/d26/d5c/d6b/d75/d36/l71 34 1 2024-09-17T01:01:58.411 INFO:tasks.workunit.client.1.smithi099.stdout:5/555: mknod d2/dc/d97/cb0 0 2024-09-17T01:01:58.411 INFO:tasks.workunit.client.1.smithi099.stdout:3/583: truncate d9/d15/d18/f20 4239073 0 2024-09-17T01:01:58.413 INFO:tasks.workunit.client.0.smithi002.stdout:8/613: sync 2024-09-17T01:01:58.413 INFO:tasks.workunit.client.0.smithi002.stdout:8/614: chown d2/d30/f7f 6 1 2024-09-17T01:01:58.413 INFO:tasks.workunit.client.1.smithi099.stdout:1/568: mknod d0/d8/d38/d56/d93/ccb 0 2024-09-17T01:01:58.414 INFO:tasks.workunit.client.1.smithi099.stdout:1/569: fdatasync d0/d2/de/f15 0 2024-09-17T01:01:58.414 INFO:tasks.workunit.client.1.smithi099.stdout:1/570: chown d0/d8/l22 1362 1 2024-09-17T01:01:58.414 INFO:tasks.workunit.client.1.smithi099.stdout:1/571: read d0/d2/d61/fb0 [451100,86288] 0 2024-09-17T01:01:58.414 INFO:tasks.workunit.client.1.smithi099.stdout:5/556: mkdir d2/dc/d14/d89/db1 0 2024-09-17T01:01:58.416 INFO:tasks.workunit.client.0.smithi002.stdout:8/615: symlink d2/d3/d5f/d98/da5/d4f/d58/dbd/ld3 0 2024-09-17T01:01:58.416 INFO:tasks.workunit.client.0.smithi002.stdout:8/616: write d2/d1c/d28/f55 [1731443,46608] 0 2024-09-17T01:01:58.416 INFO:tasks.workunit.client.0.smithi002.stdout:8/617: write d2/d26/dbb/fd0 [1011428,24840] 0 2024-09-17T01:01:58.417 INFO:tasks.workunit.client.0.smithi002.stdout:8/618: mkdir d2/d1c/dd4 0 2024-09-17T01:01:58.418 INFO:tasks.workunit.client.1.smithi099.stdout:3/584: mknod d9/d15/d18/d1a/d23/d5c/d99/cb4 0 2024-09-17T01:01:58.418 INFO:tasks.workunit.client.1.smithi099.stdout:3/585: write d9/d15/d8f/fac [451190,52135] 0 2024-09-17T01:01:58.418 INFO:tasks.workunit.client.1.smithi099.stdout:1/572: mknod d0/d8/d49/ccc 0 2024-09-17T01:01:58.418 INFO:tasks.workunit.client.1.smithi099.stdout:1/573: fdatasync d0/d8/d49/d94/f72 0 2024-09-17T01:01:58.420 INFO:tasks.workunit.client.0.smithi002.stdout:4/608: dwrite d7/de/f5c [0,4194304] 0 2024-09-17T01:01:58.420 INFO:tasks.workunit.client.0.smithi002.stdout:8/619: getdents d2/d3/d5f/d98/da5/d4f/d77/d78 0 2024-09-17T01:01:58.420 INFO:tasks.workunit.client.1.smithi099.stdout:5/557: getdents d2/dc/d17/d3c/d60/d90/da4 0 2024-09-17T01:01:58.422 INFO:tasks.workunit.client.0.smithi002.stdout:4/609: mknod d7/cbb 0 2024-09-17T01:01:58.422 INFO:tasks.workunit.client.1.smithi099.stdout:3/586: unlink d9/d15/f40 0 2024-09-17T01:01:58.422 INFO:tasks.workunit.client.1.smithi099.stdout:3/587: dread - d9/d2b/fb0 zero size 2024-09-17T01:01:58.423 INFO:tasks.workunit.client.0.smithi002.stdout:4/610: creat d7/d3f/da9/fbc x:0 0 0 2024-09-17T01:01:58.423 INFO:tasks.workunit.client.0.smithi002.stdout:4/611: fsync d7/d19/d9f/d80/f5a 0 2024-09-17T01:01:58.424 INFO:tasks.workunit.client.0.smithi002.stdout:4/612: fsync d7/d19/d2e/f70 0 2024-09-17T01:01:58.424 INFO:tasks.workunit.client.1.smithi099.stdout:5/558: truncate d2/dc/d17/d3c/d60/d90/da4/f75 319081 0 2024-09-17T01:01:58.426 INFO:tasks.workunit.client.1.smithi099.stdout:3/588: mkdir d9/d2b/d52/db5 0 2024-09-17T01:01:58.426 INFO:tasks.workunit.client.0.smithi002.stdout:4/613: rmdir d7/d19/d9f/d9d/da4 39 2024-09-17T01:01:58.428 INFO:tasks.workunit.client.1.smithi099.stdout:5/559: mkdir d2/dc/d14/d89/db1/db2 0 2024-09-17T01:01:58.431 INFO:tasks.workunit.client.0.smithi002.stdout:1/499: dwrite d4/d11/d12/d14/d17/f27 [0,4194304] 0 2024-09-17T01:01:58.433 INFO:tasks.workunit.client.1.smithi099.stdout:6/523: dwrite dc/d1a/f79 [0,4194304] 0 2024-09-17T01:01:58.433 INFO:tasks.workunit.client.1.smithi099.stdout:6/524: creat dc/d2b/fa6 x:0 0 0 2024-09-17T01:01:58.433 INFO:tasks.workunit.client.1.smithi099.stdout:6/525: chown dc/d1a/d49/f7f 2 1 2024-09-17T01:01:58.434 INFO:tasks.workunit.client.0.smithi002.stdout:1/500: dread d4/ff [0,4194304] 0 2024-09-17T01:01:58.438 INFO:tasks.workunit.client.0.smithi002.stdout:9/432: dwrite d5/f49 [0,4194304] 0 2024-09-17T01:01:58.438 INFO:tasks.workunit.client.0.smithi002.stdout:1/501: truncate d4/d11/d12/d30/d5e/f77 3005344 0 2024-09-17T01:01:58.440 INFO:tasks.workunit.client.0.smithi002.stdout:9/433: rmdir d5/dc/d26/d5c/d6c 0 2024-09-17T01:01:58.442 INFO:tasks.workunit.client.0.smithi002.stdout:1/502: symlink d4/d11/d12/d14/lad 0 2024-09-17T01:01:58.443 INFO:tasks.workunit.client.0.smithi002.stdout:9/434: rmdir d5/dc/d26/d5c/d6b/d75/d57 39 2024-09-17T01:01:58.445 INFO:tasks.workunit.client.1.smithi099.stdout:4/532: write d7/dd/fb0 [4694640,14088] 0 2024-09-17T01:01:58.445 INFO:tasks.workunit.client.0.smithi002.stdout:1/503: mkdir d4/d11/d12/d23/dae 0 2024-09-17T01:01:58.445 INFO:tasks.workunit.client.0.smithi002.stdout:1/504: write d4/d11/d12/d23/d32/f84 [549042,61154] 0 2024-09-17T01:01:58.445 INFO:tasks.workunit.client.0.smithi002.stdout:9/435: chown d5/dc/l35 255389120 1 2024-09-17T01:01:58.448 INFO:tasks.workunit.client.1.smithi099.stdout:4/533: link d7/dd/c40 d7/dd/de/d10/d85/cb6 0 2024-09-17T01:01:58.450 INFO:tasks.workunit.client.0.smithi002.stdout:1/505: write d4/d11/d12/d14/d17/d3b/f42 [56912,45266] 0 2024-09-17T01:01:58.457 INFO:tasks.workunit.client.1.smithi099.stdout:6/526: rmdir dc/d2b 39 2024-09-17T01:01:58.458 INFO:tasks.workunit.client.1.smithi099.stdout:6/527: read dc/d1a/d49/f45 [1171230,121570] 0 2024-09-17T01:01:58.461 INFO:tasks.workunit.client.0.smithi002.stdout:4/614: dwrite d7/f4f [0,4194304] 0 2024-09-17T01:01:58.461 INFO:tasks.workunit.client.0.smithi002.stdout:4/615: creat d7/d19/d2e/fbd x:0 0 0 2024-09-17T01:01:58.461 INFO:tasks.workunit.client.1.smithi099.stdout:5/560: dwrite d2/f22 [0,4194304] 0 2024-09-17T01:01:58.463 INFO:tasks.workunit.client.1.smithi099.stdout:5/561: mkdir d2/dc/d17/d3c/db3 0 2024-09-17T01:01:58.464 INFO:tasks.workunit.client.0.smithi002.stdout:9/436: getdents d5/dc/d26/d5c 0 2024-09-17T01:01:58.465 INFO:tasks.workunit.client.0.smithi002.stdout:8/620: dwrite d2/f37 [0,4194304] 0 2024-09-17T01:01:58.466 INFO:tasks.workunit.client.1.smithi099.stdout:5/562: rmdir d2/d45 39 2024-09-17T01:01:58.466 INFO:tasks.workunit.client.1.smithi099.stdout:5/563: truncate d2/dc/d14/f4f 1823249 0 2024-09-17T01:01:58.467 INFO:tasks.workunit.client.1.smithi099.stdout:3/589: dwrite d9/d15/d8f/fac [0,4194304] 0 2024-09-17T01:01:58.467 INFO:tasks.workunit.client.0.smithi002.stdout:9/437: dread d5/dc/f69 [0,4194304] 0 2024-09-17T01:01:58.469 INFO:tasks.workunit.client.0.smithi002.stdout:8/621: symlink d2/d26/dbb/ld5 0 2024-09-17T01:01:58.474 INFO:tasks.workunit.client.0.smithi002.stdout:9/438: unlink d5/dc/d26/d46/d47/f48 0 2024-09-17T01:01:58.474 INFO:tasks.workunit.client.0.smithi002.stdout:9/439: creat d5/dc/d26/d46/f79 x:0 0 0 2024-09-17T01:01:58.475 INFO:tasks.workunit.client.0.smithi002.stdout:8/622: mknod d2/d3/d5f/cd6 0 2024-09-17T01:01:58.476 INFO:tasks.workunit.client.0.smithi002.stdout:9/440: dread d5/dc/d26/f2e [0,4194304] 0 2024-09-17T01:01:58.477 INFO:tasks.workunit.client.0.smithi002.stdout:8/623: creat d2/d30/d8b/dcb/fd7 x:0 0 0 2024-09-17T01:01:58.477 INFO:tasks.workunit.client.0.smithi002.stdout:8/624: readlink d2/l2f 0 2024-09-17T01:01:58.478 INFO:tasks.workunit.client.0.smithi002.stdout:8/625: getdents d2/d3/d5f/d98/da5 0 2024-09-17T01:01:58.480 INFO:tasks.workunit.client.0.smithi002.stdout:8/626: unlink d2/d9/ccf 0 2024-09-17T01:01:58.480 INFO:tasks.workunit.client.0.smithi002.stdout:9/441: read d5/dc/f69 [526785,121573] 0 2024-09-17T01:01:58.480 INFO:tasks.workunit.client.0.smithi002.stdout:8/627: unlink d2/d1c/d3b/fb9 0 2024-09-17T01:01:58.481 INFO:tasks.workunit.client.0.smithi002.stdout:9/442: unlink d5/dc/d26/d46/f79 0 2024-09-17T01:01:58.482 INFO:tasks.workunit.client.1.smithi099.stdout:6/528: dwrite dc/d1a/f1b [0,4194304] 0 2024-09-17T01:01:58.482 INFO:tasks.workunit.client.0.smithi002.stdout:8/628: creat d2/d3/d5f/d98/da5/d4f/fd8 x:0 0 0 2024-09-17T01:01:58.483 INFO:tasks.workunit.client.0.smithi002.stdout:9/443: mkdir d5/dc/d26/d5c/d6b/d75/d57/d7a 0 2024-09-17T01:01:58.483 INFO:tasks.workunit.client.1.smithi099.stdout:6/529: mknod dc/d5d/d66/ca7 0 2024-09-17T01:01:58.484 INFO:tasks.workunit.client.0.smithi002.stdout:8/629: truncate d2/d9/f38 4445028 0 2024-09-17T01:01:58.488 INFO:tasks.workunit.client.1.smithi099.stdout:6/530: dread dc/d2b/d53/f5a [0,4194304] 0 2024-09-17T01:01:58.489 INFO:tasks.workunit.client.1.smithi099.stdout:6/531: mkdir dc/d1a/d49/da8 0 2024-09-17T01:01:58.489 INFO:tasks.workunit.client.1.smithi099.stdout:6/532: write f7 [9342356,44769] 0 2024-09-17T01:01:58.489 INFO:tasks.workunit.client.0.smithi002.stdout:9/444: creat d5/dc/d26/d5c/f7b x:0 0 0 2024-09-17T01:01:58.490 INFO:tasks.workunit.client.0.smithi002.stdout:9/445: dread - d5/dc/d26/d5c/f7b zero size 2024-09-17T01:01:58.490 INFO:tasks.workunit.client.1.smithi099.stdout:6/533: mknod dc/d5d/d66/d7a/ca9 0 2024-09-17T01:01:58.490 INFO:tasks.workunit.client.0.smithi002.stdout:9/446: mknod d5/dc/d26/d5c/d6b/d75/c7c 0 2024-09-17T01:01:58.495 INFO:tasks.workunit.client.1.smithi099.stdout:4/534: dwrite d7/dd/de/d10/d85/fa0 [0,4194304] 0 2024-09-17T01:01:58.497 INFO:tasks.workunit.client.1.smithi099.stdout:4/535: readlink d7/dd/d21/d7b/d4b/l23 0 2024-09-17T01:01:58.497 INFO:tasks.workunit.client.0.smithi002.stdout:1/506: dwrite d4/d11/d12/d14/fa0 [0,4194304] 0 2024-09-17T01:01:58.501 INFO:tasks.workunit.client.0.smithi002.stdout:1/507: unlink d4/c9 0 2024-09-17T01:01:58.502 INFO:tasks.workunit.client.1.smithi099.stdout:4/536: getdents d7/dd/d21/d7b/d4b 0 2024-09-17T01:01:58.502 INFO:tasks.workunit.client.1.smithi099.stdout:5/564: dwrite d2/dc/d6c/fac [0,4194304] 0 2024-09-17T01:01:58.502 INFO:tasks.workunit.client.0.smithi002.stdout:1/508: creat d4/d11/d12/d30/d5e/d8c/faf x:0 0 0 2024-09-17T01:01:58.502 INFO:tasks.workunit.client.0.smithi002.stdout:1/509: write d4/d11/d12/d14/d17/d3b/f62 [3141641,106430] 0 2024-09-17T01:01:58.503 INFO:tasks.workunit.client.0.smithi002.stdout:8/630: dread d2/d26/f69 [0,4194304] 0 2024-09-17T01:01:58.503 INFO:tasks.workunit.client.1.smithi099.stdout:3/590: dwrite d9/d3b/f62 [4194304,4194304] 0 2024-09-17T01:01:58.503 INFO:tasks.workunit.client.1.smithi099.stdout:3/591: chown d9/d15/d18/la0 242 1 2024-09-17T01:01:58.506 INFO:tasks.workunit.client.1.smithi099.stdout:3/592: mknod d9/d15/d7d/dad/cb6 0 2024-09-17T01:01:58.506 INFO:tasks.workunit.client.1.smithi099.stdout:3/593: truncate d9/d3b/d44/d57/f5a 1770523 0 2024-09-17T01:01:58.513 INFO:tasks.workunit.client.1.smithi099.stdout:6/534: dwrite dc/d2b/f4b [0,4194304] 0 2024-09-17T01:01:58.514 INFO:tasks.workunit.client.0.smithi002.stdout:9/447: dwrite d5/dc/d26/d46/f4c [0,4194304] 0 2024-09-17T01:01:58.516 INFO:tasks.workunit.client.0.smithi002.stdout:9/448: mkdir d5/dc/d26/d46/d47/d7d 0 2024-09-17T01:01:58.518 INFO:tasks.workunit.client.1.smithi099.stdout:4/537: dread d7/dd/d21/fb2 [0,4194304] 0 2024-09-17T01:01:58.519 INFO:tasks.workunit.client.0.smithi002.stdout:9/449: rename d5/dc/d26/d46/f4c to d5/dc/d26/f7e 0 2024-09-17T01:01:58.520 INFO:tasks.workunit.client.1.smithi099.stdout:4/538: link d7/dd/d21/d7b/f2e d7/dd/d21/d26/d3f/d5b/da4/fb7 0 2024-09-17T01:01:58.520 INFO:tasks.workunit.client.1.smithi099.stdout:4/539: write d7/d35/d80/f88 [1407591,36073] 0 2024-09-17T01:01:58.524 INFO:tasks.workunit.client.1.smithi099.stdout:4/540: unlink d7/dd/de/d10/d6b/d82/d8a/d9a/da6/fb5 0 2024-09-17T01:01:58.531 INFO:tasks.workunit.client.0.smithi002.stdout:6/484: sync 2024-09-17T01:01:58.532 INFO:tasks.workunit.client.0.smithi002.stdout:5/477: sync 2024-09-17T01:01:58.532 INFO:tasks.workunit.client.0.smithi002.stdout:6/485: rmdir d2/d1d/d2d/d35/d79 39 2024-09-17T01:01:58.534 INFO:tasks.workunit.client.0.smithi002.stdout:6/486: rmdir d2/d1d/d26/d49/d51/d81 0 2024-09-17T01:01:58.536 INFO:tasks.workunit.client.1.smithi099.stdout:3/594: dwrite d9/d2b/d52/f75 [0,4194304] 0 2024-09-17T01:01:58.537 INFO:tasks.workunit.client.1.smithi099.stdout:3/595: rmdir d9/d15/d18 39 2024-09-17T01:01:58.538 INFO:tasks.workunit.client.1.smithi099.stdout:3/596: symlink d9/d3b/lb7 0 2024-09-17T01:01:58.541 INFO:tasks.workunit.client.0.smithi002.stdout:6/487: dread d2/d1d/d2d/f4f [0,4194304] 0 2024-09-17T01:01:58.542 INFO:tasks.workunit.client.1.smithi099.stdout:3/597: dread d9/d3b/d44/d57/f5a [0,4194304] 0 2024-09-17T01:01:58.543 INFO:tasks.workunit.client.1.smithi099.stdout:3/598: creat d9/d15/fb8 x:0 0 0 2024-09-17T01:01:58.563 INFO:tasks.workunit.client.1.smithi099.stdout:5/565: dwrite d2/d26/f4e [0,4194304] 0 2024-09-17T01:01:58.564 INFO:tasks.workunit.client.1.smithi099.stdout:5/566: mknod d2/dc/d14/d36/d9a/cb4 0 2024-09-17T01:01:58.565 INFO:tasks.workunit.client.1.smithi099.stdout:5/567: creat d2/dc/d14/d89/db1/db2/fb5 x:0 0 0 2024-09-17T01:01:58.569 INFO:tasks.workunit.client.0.smithi002.stdout:8/631: dwrite d2/d3/d5f/d47/f62 [0,4194304] 0 2024-09-17T01:01:58.570 INFO:tasks.workunit.client.1.smithi099.stdout:6/535: dwrite dc/d1a/f1e [0,4194304] 0 2024-09-17T01:01:58.570 INFO:tasks.workunit.client.1.smithi099.stdout:5/568: dread d2/dc/d17/f53 [4194304,4194304] 0 2024-09-17T01:01:58.571 INFO:tasks.workunit.client.1.smithi099.stdout:4/541: dwrite d7/dd/fb0 [0,4194304] 0 2024-09-17T01:01:58.571 INFO:tasks.workunit.client.0.smithi002.stdout:9/450: dwrite d5/dc/d26/d5c/f7b [0,4194304] 0 2024-09-17T01:01:58.571 INFO:tasks.workunit.client.0.smithi002.stdout:5/478: dwrite d2/d2d/d10/d14/d19/d39/f35 [0,4194304] 0 2024-09-17T01:01:58.571 INFO:tasks.workunit.client.0.smithi002.stdout:6/488: dwrite d2/f4 [0,4194304] 0 2024-09-17T01:01:58.572 INFO:tasks.workunit.client.0.smithi002.stdout:9/451: dread d5/dc/f69 [0,4194304] 0 2024-09-17T01:01:58.580 INFO:tasks.workunit.client.0.smithi002.stdout:9/452: mknod d5/dc/d26/c7f 0 2024-09-17T01:01:58.581 INFO:tasks.workunit.client.0.smithi002.stdout:9/453: mknod d5/dc/d26/d46/c80 0 2024-09-17T01:01:58.583 INFO:tasks.workunit.client.1.smithi099.stdout:5/569: write d2/f1b [2327981,22979] 0 2024-09-17T01:01:58.583 INFO:tasks.workunit.client.0.smithi002.stdout:5/479: dread d2/d2d/f17 [0,4194304] 0 2024-09-17T01:01:58.585 INFO:tasks.workunit.client.1.smithi099.stdout:5/570: rename d2/faf to d2/dc/d14/d89/db1/fb6 0 2024-09-17T01:01:58.585 INFO:tasks.workunit.client.0.smithi002.stdout:9/454: creat d5/dc/d26/f81 x:0 0 0 2024-09-17T01:01:58.586 INFO:tasks.workunit.client.0.smithi002.stdout:5/480: mknod d2/d2d/d10/d14/d19/d39/d25/d32/c98 0 2024-09-17T01:01:58.587 INFO:tasks.workunit.client.0.smithi002.stdout:5/481: fdatasync d2/de/f4f 0 2024-09-17T01:01:58.587 INFO:tasks.workunit.client.1.smithi099.stdout:5/571: dread d2/dc/d17/d3c/d72/f79 [0,4194304] 0 2024-09-17T01:01:58.588 INFO:tasks.workunit.client.0.smithi002.stdout:9/455: readlink d5/l6 0 2024-09-17T01:01:58.588 INFO:tasks.workunit.client.1.smithi099.stdout:5/572: mknod d2/dc/d17/d3c/db3/cb7 0 2024-09-17T01:01:58.588 INFO:tasks.workunit.client.1.smithi099.stdout:5/573: fdatasync d2/dc/d14/f16 0 2024-09-17T01:01:58.589 INFO:tasks.workunit.client.1.smithi099.stdout:5/574: chown d2/dc/d97/c9b 2756 1 2024-09-17T01:01:58.589 INFO:tasks.workunit.client.1.smithi099.stdout:5/575: truncate d2/dc/d17/f59 4964771 0 2024-09-17T01:01:58.590 INFO:tasks.workunit.client.0.smithi002.stdout:5/482: mkdir d2/d99 0 2024-09-17T01:01:58.590 INFO:tasks.workunit.client.0.smithi002.stdout:8/632: read d2/d3/d5f/f46 [3237817,12376] 0 2024-09-17T01:01:58.590 INFO:tasks.workunit.client.0.smithi002.stdout:9/456: read d5/dc/f68 [347175,85034] 0 2024-09-17T01:01:58.590 INFO:tasks.workunit.client.0.smithi002.stdout:9/457: write d5/f19 [1580518,71857] 0 2024-09-17T01:01:58.592 INFO:tasks.workunit.client.0.smithi002.stdout:9/458: symlink d5/dc/d26/d46/d47/d7d/l82 0 2024-09-17T01:01:58.592 INFO:tasks.workunit.client.1.smithi099.stdout:4/542: dwrite d7/dd/d21/d26/d3f/d5b/f37 [0,4194304] 0 2024-09-17T01:01:58.593 INFO:tasks.workunit.client.1.smithi099.stdout:4/543: rmdir d7/dd 39 2024-09-17T01:01:58.593 INFO:tasks.workunit.client.0.smithi002.stdout:9/459: creat d5/dc/d26/d46/d47/d7d/f83 x:0 0 0 2024-09-17T01:01:58.593 INFO:tasks.workunit.client.1.smithi099.stdout:4/544: rmdir d7/dd/d21/d26/d3f/d5b/da4 39 2024-09-17T01:01:58.594 INFO:tasks.workunit.client.0.smithi002.stdout:9/460: getdents d5/dc/d26/d5c/d6b/d75 0 2024-09-17T01:01:58.596 INFO:tasks.workunit.client.0.smithi002.stdout:9/461: unlink d5/c23 0 2024-09-17T01:01:58.598 INFO:tasks.workunit.client.0.smithi002.stdout:9/462: getdents d5/dc/d26/d5c 0 2024-09-17T01:01:58.598 INFO:tasks.workunit.client.0.smithi002.stdout:9/463: fdatasync d5/dc/f3d 0 2024-09-17T01:01:58.599 INFO:tasks.workunit.client.0.smithi002.stdout:5/483: dread d2/d2d/d10/d20/d24/f2e [0,4194304] 0 2024-09-17T01:01:58.599 INFO:tasks.workunit.client.0.smithi002.stdout:5/484: dread - d2/d2d/d10/d14/f88 zero size 2024-09-17T01:01:58.599 INFO:tasks.workunit.client.0.smithi002.stdout:5/485: fdatasync d2/d2d/d10/d14/d59/f8f 0 2024-09-17T01:01:58.599 INFO:tasks.workunit.client.0.smithi002.stdout:5/486: chown d2/d2d/d10/d23/d6e/d60/f8e 217 1 2024-09-17T01:01:58.599 INFO:tasks.workunit.client.0.smithi002.stdout:5/487: dread - d2/d2d/d10/d14/f88 zero size 2024-09-17T01:01:58.599 INFO:tasks.workunit.client.1.smithi099.stdout:0/506: sync 2024-09-17T01:01:58.600 INFO:tasks.workunit.client.1.smithi099.stdout:9/518: sync 2024-09-17T01:01:58.600 INFO:tasks.workunit.client.1.smithi099.stdout:7/501: sync 2024-09-17T01:01:58.600 INFO:tasks.workunit.client.0.smithi002.stdout:9/464: truncate d5/f4f 58087 0 2024-09-17T01:01:58.600 INFO:tasks.workunit.client.0.smithi002.stdout:6/489: dwrite d2/d1d/d2d/d35/d37/f41 [0,4194304] 0 2024-09-17T01:01:58.600 INFO:tasks.workunit.client.0.smithi002.stdout:6/490: write d2/d1d/d26/d49/d51/f76 [966022,92354] 0 2024-09-17T01:01:58.601 INFO:tasks.workunit.client.1.smithi099.stdout:0/507: truncate da/d12/f5a 475235 0 2024-09-17T01:01:58.601 INFO:tasks.workunit.client.1.smithi099.stdout:0/508: stat da/d12/f18 0 2024-09-17T01:01:58.601 INFO:tasks.workunit.client.1.smithi099.stdout:2/463: sync 2024-09-17T01:01:58.601 INFO:tasks.workunit.client.1.smithi099.stdout:8/544: sync 2024-09-17T01:01:58.602 INFO:tasks.workunit.client.0.smithi002.stdout:5/488: rmdir d2/d2d/d10/d14/d7d/d82 0 2024-09-17T01:01:58.602 INFO:tasks.workunit.client.1.smithi099.stdout:9/519: mkdir da/d14/d62/dad 0 2024-09-17T01:01:58.602 INFO:tasks.workunit.client.1.smithi099.stdout:9/520: fsync da/f64 0 2024-09-17T01:01:58.603 INFO:tasks.workunit.client.1.smithi099.stdout:6/536: dwrite dc/d27/d7e/f94 [0,4194304] 0 2024-09-17T01:01:58.603 INFO:tasks.workunit.client.0.smithi002.stdout:6/491: mkdir d2/d1d/d27/d87/d94 0 2024-09-17T01:01:58.604 INFO:tasks.workunit.client.0.smithi002.stdout:8/633: dread d2/d26/f61 [0,4194304] 0 2024-09-17T01:01:58.606 INFO:tasks.workunit.client.0.smithi002.stdout:6/492: mkdir d2/d95 0 2024-09-17T01:01:58.606 INFO:tasks.workunit.client.1.smithi099.stdout:2/464: unlink d2/d7/c3c 0 2024-09-17T01:01:58.606 INFO:tasks.workunit.client.1.smithi099.stdout:8/545: creat d0/d1f/fb4 x:0 0 0 2024-09-17T01:01:58.607 INFO:tasks.workunit.client.1.smithi099.stdout:5/576: read d2/d8/f77 [97351,82525] 0 2024-09-17T01:01:58.607 INFO:tasks.workunit.client.1.smithi099.stdout:5/577: write d2/f3 [4311311,79175] 0 2024-09-17T01:01:58.607 INFO:tasks.workunit.client.0.smithi002.stdout:8/634: mkdir d2/d3/d5f/d98/da5/d4f/d77/dd9 0 2024-09-17T01:01:58.608 INFO:tasks.workunit.client.0.smithi002.stdout:9/465: dread d5/dc/d26/d46/f50 [0,4194304] 0 2024-09-17T01:01:58.608 INFO:tasks.workunit.client.0.smithi002.stdout:6/493: rmdir d2/d1d/d2d/d73 39 2024-09-17T01:01:58.609 INFO:tasks.workunit.client.0.smithi002.stdout:9/466: creat d5/dc/f84 x:0 0 0 2024-09-17T01:01:58.609 INFO:tasks.workunit.client.0.smithi002.stdout:9/467: stat d5/dc/l59 0 2024-09-17T01:01:58.609 INFO:tasks.workunit.client.1.smithi099.stdout:2/465: write d2/d9/d25/d26/f6b [421759,120131] 0 2024-09-17T01:01:58.609 INFO:tasks.workunit.client.1.smithi099.stdout:2/466: chown d2/d9/d25/d26/d1b/d61/f6f 526 1 2024-09-17T01:01:58.610 INFO:tasks.workunit.client.1.smithi099.stdout:9/521: rename da/d9a/l3e to da/d14/d48/d69/lae 0 2024-09-17T01:01:58.611 INFO:tasks.workunit.client.0.smithi002.stdout:6/494: rename d2/f6c to d2/d1d/d26/d49/d51/f96 0 2024-09-17T01:01:58.613 INFO:tasks.workunit.client.1.smithi099.stdout:2/467: dread d2/d9/d25/f75 [0,4194304] 0 2024-09-17T01:01:58.613 INFO:tasks.workunit.client.1.smithi099.stdout:2/468: truncate d2/d9/d25/d26/d1b/f7c 604056 0 2024-09-17T01:01:58.615 INFO:tasks.workunit.client.1.smithi099.stdout:6/537: rmdir dc/d5d 39 2024-09-17T01:01:58.615 INFO:tasks.workunit.client.1.smithi099.stdout:6/538: readlink dc/d27/d58/l64 0 2024-09-17T01:01:58.615 INFO:tasks.workunit.client.1.smithi099.stdout:5/578: symlink d2/dc/d14/d36/lb8 0 2024-09-17T01:01:58.616 INFO:tasks.workunit.client.1.smithi099.stdout:2/469: rename d2/d9/d25/f53 to d2/d9/d17/d58/f8e 0 2024-09-17T01:01:58.617 INFO:tasks.workunit.client.0.smithi002.stdout:9/468: dread d5/dc/d26/d46/f50 [0,4194304] 0 2024-09-17T01:01:58.617 INFO:tasks.workunit.client.0.smithi002.stdout:9/469: chown d5/l53 58055022 1 2024-09-17T01:01:58.617 INFO:tasks.workunit.client.1.smithi099.stdout:9/522: write da/d14/d40/f65 [2683728,11666] 0 2024-09-17T01:01:58.617 INFO:tasks.workunit.client.1.smithi099.stdout:9/523: chown da/d9a/d3a/d4b/c93 202 1 2024-09-17T01:01:58.617 INFO:tasks.workunit.client.1.smithi099.stdout:9/524: chown da/d18 138 1 2024-09-17T01:01:58.619 INFO:tasks.workunit.client.1.smithi099.stdout:5/579: link d2/d8/c13 d2/dc/d14/d36/cb9 0 2024-09-17T01:01:58.620 INFO:tasks.workunit.client.1.smithi099.stdout:5/580: write d2/dc/f93 [206312,35044] 0 2024-09-17T01:01:58.620 INFO:tasks.workunit.client.1.smithi099.stdout:2/470: mkdir d2/d9/d17/d83/d8d/d8f 0 2024-09-17T01:01:58.621 INFO:tasks.workunit.client.1.smithi099.stdout:5/581: truncate d2/d8/f5b 6105604 0 2024-09-17T01:01:58.622 INFO:tasks.workunit.client.1.smithi099.stdout:2/471: mknod d2/d9/c90 0 2024-09-17T01:01:58.632 INFO:tasks.workunit.client.1.smithi099.stdout:7/502: dwrite d1/d2c/d5c/d1c/d5a/d6f/f8e [0,4194304] 0 2024-09-17T01:01:58.636 INFO:tasks.workunit.client.1.smithi099.stdout:9/525: write da/d9b/fa0 [11556918,27849] 0 2024-09-17T01:01:58.638 INFO:tasks.workunit.client.1.smithi099.stdout:9/526: symlink da/d14/laf 0 2024-09-17T01:01:58.643 INFO:tasks.workunit.client.1.smithi099.stdout:2/472: dread d2/d9/d25/f7b [0,4194304] 0 2024-09-17T01:01:58.643 INFO:tasks.workunit.client.0.smithi002.stdout:3/534: sync 2024-09-17T01:01:58.644 INFO:tasks.workunit.client.1.smithi099.stdout:2/473: creat d2/d9/d17/d83/d8d/f91 x:0 0 0 2024-09-17T01:01:58.645 INFO:tasks.workunit.client.0.smithi002.stdout:7/493: sync 2024-09-17T01:01:58.649 INFO:tasks.workunit.client.1.smithi099.stdout:0/509: dwrite da/df/d31/f4c [0,4194304] 0 2024-09-17T01:01:58.650 INFO:tasks.workunit.client.1.smithi099.stdout:0/510: stat da/d12/d22/d53 0 2024-09-17T01:01:58.652 INFO:tasks.workunit.client.1.smithi099.stdout:8/546: dwrite d0/f18 [0,4194304] 0 2024-09-17T01:01:58.656 INFO:tasks.workunit.client.0.smithi002.stdout:6/495: dwrite d2/d1d/d26/d49/f6e [0,4194304] 0 2024-09-17T01:01:58.659 INFO:tasks.workunit.client.0.smithi002.stdout:6/496: symlink d2/d1d/d2d/d35/d6d/l97 0 2024-09-17T01:01:58.660 INFO:tasks.workunit.client.0.smithi002.stdout:6/497: mkdir d2/d1d/d27/d30/d98 0 2024-09-17T01:01:58.661 INFO:tasks.workunit.client.0.smithi002.stdout:6/498: mkdir d2/d1d/d99 0 2024-09-17T01:01:58.662 INFO:tasks.workunit.client.1.smithi099.stdout:2/474: write d2/d7/f40 [7412625,70981] 0 2024-09-17T01:01:58.662 INFO:tasks.workunit.client.1.smithi099.stdout:2/475: write d2/d9/d17/f21 [2047880,39345] 0 2024-09-17T01:01:58.662 INFO:tasks.workunit.client.0.smithi002.stdout:6/499: link d2/d1d/d2d/d35/d6d/f7c d2/d4b/f9a 0 2024-09-17T01:01:58.662 INFO:tasks.workunit.client.0.smithi002.stdout:6/500: truncate d2/d1d/d26/d49/d51/f76 1596540 0 2024-09-17T01:01:58.663 INFO:tasks.workunit.client.0.smithi002.stdout:9/470: dwrite d5/dc/d26/d5c/d6b/d75/f5a [0,4194304] 0 2024-09-17T01:01:58.663 INFO:tasks.workunit.client.1.smithi099.stdout:2/476: symlink d2/d9/d25/l92 0 2024-09-17T01:01:58.663 INFO:tasks.workunit.client.1.smithi099.stdout:0/511: write da/d1c/d1e/f38 [4185166,9547] 0 2024-09-17T01:01:58.665 INFO:tasks.workunit.client.0.smithi002.stdout:9/471: creat d5/dc/d26/d5c/d6b/d75/d57/f85 x:0 0 0 2024-09-17T01:01:58.665 INFO:tasks.workunit.client.0.smithi002.stdout:9/472: write d5/dc/d26/d5c/d6b/f6e [169800,111438] 0 2024-09-17T01:01:58.667 INFO:tasks.workunit.client.0.smithi002.stdout:6/501: read d2/d1d/d2d/d35/d6d/f7c [2085213,96380] 0 2024-09-17T01:01:58.668 INFO:tasks.workunit.client.0.smithi002.stdout:6/502: symlink d2/d1d/d2d/d35/l9b 0 2024-09-17T01:01:58.668 INFO:tasks.workunit.client.1.smithi099.stdout:7/503: dwrite d1/d2c/d5c/f4a [0,4194304] 0 2024-09-17T01:01:58.668 INFO:tasks.workunit.client.1.smithi099.stdout:7/504: chown d1/d2c/d5c/d1c/l2e 4710 1 2024-09-17T01:01:58.669 INFO:tasks.workunit.client.0.smithi002.stdout:6/503: symlink d2/d95/l9c 0 2024-09-17T01:01:58.669 INFO:tasks.workunit.client.0.smithi002.stdout:6/504: dread - d2/d1d/d2d/d54/f89 zero size 2024-09-17T01:01:58.669 INFO:tasks.workunit.client.0.smithi002.stdout:6/505: fsync d2/d1d/d26/f2b 0 2024-09-17T01:01:58.669 INFO:tasks.workunit.client.0.smithi002.stdout:6/506: write d2/f70 [1720199,98314] 0 2024-09-17T01:01:58.670 INFO:tasks.workunit.client.0.smithi002.stdout:6/507: unlink d2/d1d/d2d/d35/c42 0 2024-09-17T01:01:58.670 INFO:tasks.workunit.client.0.smithi002.stdout:6/508: write d2/d1d/d2d/f4f [2772465,83607] 0 2024-09-17T01:01:58.678 INFO:tasks.workunit.client.1.smithi099.stdout:5/582: dwrite d2/dc/d17/d3c/d60/d90/da4/f6d [0,4194304] 0 2024-09-17T01:01:58.678 INFO:tasks.workunit.client.1.smithi099.stdout:6/539: dwrite dc/d27/d7e/f94 [4194304,4194304] 0 2024-09-17T01:01:58.681 INFO:tasks.workunit.client.1.smithi099.stdout:6/540: rename dc/d2b/c3b to dc/caa 0 2024-09-17T01:01:58.681 INFO:tasks.workunit.client.1.smithi099.stdout:6/541: truncate dc/d2b/d53/d96/d60/f9b 916663 0 2024-09-17T01:01:58.683 INFO:tasks.workunit.client.1.smithi099.stdout:5/583: creat d2/d8/fba x:0 0 0 2024-09-17T01:01:58.683 INFO:tasks.workunit.client.1.smithi099.stdout:9/527: dwrite da/d50/f82 [4194304,4194304] 0 2024-09-17T01:01:58.689 INFO:tasks.workunit.client.0.smithi002.stdout:3/535: dwrite d0/d3/d8d/fad [0,4194304] 0 2024-09-17T01:01:58.689 INFO:tasks.workunit.client.0.smithi002.stdout:3/536: truncate d0/d3/d33/d40/f63 2873308 0 2024-09-17T01:01:58.692 INFO:tasks.workunit.client.0.smithi002.stdout:3/537: symlink d0/d3/d37/dac/da1/lbb 0 2024-09-17T01:01:58.692 INFO:tasks.workunit.client.0.smithi002.stdout:3/538: dread - d0/d3/d8d/f9c zero size 2024-09-17T01:01:58.694 INFO:tasks.workunit.client.0.smithi002.stdout:3/539: rename d0/d3/l6e to d0/d3/d37/lbc 0 2024-09-17T01:01:58.694 INFO:tasks.workunit.client.0.smithi002.stdout:7/494: dwrite d1/d14/d1d/d28/d40/f5f [0,4194304] 0 2024-09-17T01:01:58.695 INFO:tasks.workunit.client.0.smithi002.stdout:3/540: mknod d0/d3/d17/d87/d9e/cbd 0 2024-09-17T01:01:58.697 INFO:tasks.workunit.client.0.smithi002.stdout:7/495: symlink d1/l9f 0 2024-09-17T01:01:58.697 INFO:tasks.workunit.client.0.smithi002.stdout:7/496: dread - d1/d14/d1d/d28/d2d/f70 zero size 2024-09-17T01:01:58.698 INFO:tasks.workunit.client.0.smithi002.stdout:3/541: truncate d0/d3/d37/f74 3919201 0 2024-09-17T01:01:58.698 INFO:tasks.workunit.client.0.smithi002.stdout:7/497: symlink d1/d14/d1d/d29/d4b/la0 0 2024-09-17T01:01:58.699 INFO:tasks.workunit.client.0.smithi002.stdout:7/498: stat d1/d14/d1d/d28/d6b/d9e/d50 0 2024-09-17T01:01:58.716 INFO:tasks.workunit.client.0.smithi002.stdout:9/473: dwrite d5/dc/d26/f2e [0,4194304] 0 2024-09-17T01:01:58.716 INFO:tasks.workunit.client.0.smithi002.stdout:9/474: creat d5/dc/d26/f86 x:0 0 0 2024-09-17T01:01:58.718 INFO:tasks.workunit.client.0.smithi002.stdout:9/475: symlink d5/dc/d26/d46/l87 0 2024-09-17T01:01:58.718 INFO:tasks.workunit.client.0.smithi002.stdout:9/476: chown d5/dc/f4e 46 1 2024-09-17T01:01:58.724 INFO:tasks.workunit.client.1.smithi099.stdout:2/477: dwrite d2/d9/f1f [0,4194304] 0 2024-09-17T01:01:58.724 INFO:tasks.workunit.client.1.smithi099.stdout:7/505: dwrite d1/d2c/d5c/f98 [0,4194304] 0 2024-09-17T01:01:58.724 INFO:tasks.workunit.client.1.smithi099.stdout:9/528: dwrite da/d56/d84/f85 [0,4194304] 0 2024-09-17T01:01:58.724 INFO:tasks.workunit.client.1.smithi099.stdout:0/512: dwrite da/d1c/d1e/f24 [0,4194304] 0 2024-09-17T01:01:58.726 INFO:tasks.workunit.client.1.smithi099.stdout:7/506: dread d1/d2c/d5c/d3f/f92 [0,4194304] 0 2024-09-17T01:01:58.726 INFO:tasks.workunit.client.1.smithi099.stdout:7/507: stat d1/d2c/d47/f6c 0 2024-09-17T01:01:58.727 INFO:tasks.workunit.client.1.smithi099.stdout:2/478: creat d2/d9/d17/f93 x:0 0 0 2024-09-17T01:01:58.727 INFO:tasks.workunit.client.1.smithi099.stdout:2/479: chown d2/d9/d25/f7b 430505 1 2024-09-17T01:01:58.727 INFO:tasks.workunit.client.1.smithi099.stdout:2/480: stat d2/d9/d25/d26 0 2024-09-17T01:01:58.727 INFO:tasks.workunit.client.1.smithi099.stdout:9/529: mkdir da/d14/d6d/db0 0 2024-09-17T01:01:58.729 INFO:tasks.workunit.client.0.smithi002.stdout:6/509: dwrite d2/d1d/d27/d30/f78 [4194304,4194304] 0 2024-09-17T01:01:58.730 INFO:tasks.workunit.client.0.smithi002.stdout:7/499: dwrite d1/d14/d1d/d28/d6b/f83 [0,4194304] 0 2024-09-17T01:01:58.730 INFO:tasks.workunit.client.1.smithi099.stdout:0/513: creat da/df/d31/d8b/fa7 x:0 0 0 2024-09-17T01:01:58.730 INFO:tasks.workunit.client.1.smithi099.stdout:6/542: dwrite dc/d2b/d53/fa2 [0,4194304] 0 2024-09-17T01:01:58.730 INFO:tasks.workunit.client.1.smithi099.stdout:6/543: write dc/d1a/f56 [1291534,96722] 0 2024-09-17T01:01:58.730 INFO:tasks.workunit.client.1.smithi099.stdout:5/584: dwrite d2/dc/d17/f5d [0,4194304] 0 2024-09-17T01:01:58.731 INFO:tasks.workunit.client.1.smithi099.stdout:7/508: truncate d1/d2c/d5c/d3f/f92 849782 0 2024-09-17T01:01:58.732 INFO:tasks.workunit.client.0.smithi002.stdout:6/510: creat d2/d1d/d99/f9d x:0 0 0 2024-09-17T01:01:58.732 INFO:tasks.workunit.client.1.smithi099.stdout:9/530: rename da/d14/d40/d6f/f70 to da/d21/d5b/fb1 0 2024-09-17T01:01:58.733 INFO:tasks.workunit.client.1.smithi099.stdout:0/514: creat da/d12/d2b/fa8 x:0 0 0 2024-09-17T01:01:58.733 INFO:tasks.workunit.client.1.smithi099.stdout:0/515: chown da/df/d1a/d49/f4a 3243 1 2024-09-17T01:01:58.735 INFO:tasks.workunit.client.1.smithi099.stdout:1/574: sync 2024-09-17T01:01:58.738 INFO:tasks.workunit.client.0.smithi002.stdout:9/477: dread d5/dc/d26/d5c/d6b/f6e [0,4194304] 0 2024-09-17T01:01:58.738 INFO:tasks.workunit.client.1.smithi099.stdout:6/544: symlink dc/d27/d7e/d8c/lab 0 2024-09-17T01:01:58.741 INFO:tasks.workunit.client.0.smithi002.stdout:6/511: mkdir d2/dc/d24/d53/d9e 0 2024-09-17T01:01:58.741 INFO:tasks.workunit.client.0.smithi002.stdout:6/512: readlink d2/l4e 0 2024-09-17T01:01:58.742 INFO:tasks.workunit.client.1.smithi099.stdout:5/585: dread d2/f22 [0,4194304] 0 2024-09-17T01:01:58.744 INFO:tasks.workunit.client.1.smithi099.stdout:7/509: rename d1/d2c/d5c/c71 to d1/d37/d4f/ca0 0 2024-09-17T01:01:58.744 INFO:tasks.workunit.client.0.smithi002.stdout:6/513: mkdir d2/d1d/d26/d49/d9f 0 2024-09-17T01:01:58.744 INFO:tasks.workunit.client.0.smithi002.stdout:6/514: fsync d2/d1d/d2d/d35/d37/f8b 0 2024-09-17T01:01:58.746 INFO:tasks.workunit.client.0.smithi002.stdout:9/478: getdents d5/dc 0 2024-09-17T01:01:58.746 INFO:tasks.workunit.client.0.smithi002.stdout:9/479: truncate d5/dc/d26/d5c/d6b/d75/f56 117556 0 2024-09-17T01:01:58.746 INFO:tasks.workunit.client.0.smithi002.stdout:9/480: creat d5/dc/d26/d63/d66/f88 x:0 0 0 2024-09-17T01:01:58.747 INFO:tasks.workunit.client.1.smithi099.stdout:1/575: creat d0/d8/d49/d94/d4b/d59/db9/dc8/fcd x:0 0 0 2024-09-17T01:01:58.747 INFO:tasks.workunit.client.1.smithi099.stdout:6/545: symlink dc/d1a/d82/lac 0 2024-09-17T01:01:58.749 INFO:tasks.workunit.client.1.smithi099.stdout:1/576: getdents d0/d2/d5 0 2024-09-17T01:01:58.750 INFO:tasks.workunit.client.1.smithi099.stdout:6/546: mkdir dc/d27/d7e/dad 0 2024-09-17T01:01:58.752 INFO:tasks.workunit.client.1.smithi099.stdout:1/577: dread d0/d8/d49/d94/f72 [0,4194304] 0 2024-09-17T01:01:58.759 INFO:tasks.workunit.client.1.smithi099.stdout:9/531: dwrite da/d21/d2a/f54 [4194304,4194304] 0 2024-09-17T01:01:58.761 INFO:tasks.workunit.client.0.smithi002.stdout:7/500: dwrite d1/d14/d1d/d21/f61 [0,4194304] 0 2024-09-17T01:01:58.763 INFO:tasks.workunit.client.1.smithi099.stdout:6/547: dread dc/d1a/d49/f45 [0,4194304] 0 2024-09-17T01:01:58.763 INFO:tasks.workunit.client.0.smithi002.stdout:2/557: sync 2024-09-17T01:01:58.763 INFO:tasks.workunit.client.0.smithi002.stdout:4/616: sync 2024-09-17T01:01:58.763 INFO:tasks.workunit.client.0.smithi002.stdout:0/385: sync 2024-09-17T01:01:58.764 INFO:tasks.workunit.client.0.smithi002.stdout:0/386: write dd/d19/d1c/d33/d67/f74 [290437,101467] 0 2024-09-17T01:01:58.764 INFO:tasks.workunit.client.0.smithi002.stdout:0/387: write dd/d44/f6e [742273,43630] 0 2024-09-17T01:01:58.764 INFO:tasks.workunit.client.1.smithi099.stdout:9/532: rename da/d14/l7b to da/d9b/dac/lb2 0 2024-09-17T01:01:58.766 INFO:tasks.workunit.client.0.smithi002.stdout:4/617: rmdir d7/d19/d4a/da5 0 2024-09-17T01:01:58.768 INFO:tasks.workunit.client.0.smithi002.stdout:0/388: unlink dd/d19/f82 0 2024-09-17T01:01:58.769 INFO:tasks.workunit.client.0.smithi002.stdout:4/618: mkdir d7/d19/d9f/d80/d62/dbe 0 2024-09-17T01:01:58.769 INFO:tasks.workunit.client.0.smithi002.stdout:4/619: readlink d7/d19/d9f/d80/d62/d52/l8d 0 2024-09-17T01:01:58.770 INFO:tasks.workunit.client.0.smithi002.stdout:0/389: getdents dd/d19/d1c/d33 0 2024-09-17T01:01:58.770 INFO:tasks.workunit.client.0.smithi002.stdout:2/558: dread d1b/d1d/f9d [0,4194304] 0 2024-09-17T01:01:58.770 INFO:tasks.workunit.client.0.smithi002.stdout:2/559: write d1b/d8b/fc4 [757645,22070] 0 2024-09-17T01:01:58.771 INFO:tasks.workunit.client.1.smithi099.stdout:1/578: write d0/fc [1244316,74285] 0 2024-09-17T01:01:58.771 INFO:tasks.workunit.client.1.smithi099.stdout:1/579: stat d0/d2/de/d8b/f9a 0 2024-09-17T01:01:58.771 INFO:tasks.workunit.client.1.smithi099.stdout:1/580: readlink d0/d8/d49/d94/d4b/la4 0 2024-09-17T01:01:58.771 INFO:tasks.workunit.client.1.smithi099.stdout:1/581: write d0/d8/d49/d94/d4b/d59/db9/dc8/fcd [876493,101906] 0 2024-09-17T01:01:58.771 INFO:tasks.workunit.client.1.smithi099.stdout:1/582: chown d0/d2/d5/l6a 13557195 1 2024-09-17T01:01:58.772 INFO:tasks.workunit.client.1.smithi099.stdout:1/583: chown d0/d2/de/d8b/cb5 10124312 1 2024-09-17T01:01:58.772 INFO:tasks.workunit.client.1.smithi099.stdout:1/584: dread - d0/d2/d18/f96 zero size 2024-09-17T01:01:58.772 INFO:tasks.workunit.client.1.smithi099.stdout:1/585: write d0/d8/d49/d4e/f6c [904758,106106] 0 2024-09-17T01:01:58.772 INFO:tasks.workunit.client.0.smithi002.stdout:4/620: creat d7/de/d3a/d99/fbf x:0 0 0 2024-09-17T01:01:58.773 INFO:tasks.workunit.client.0.smithi002.stdout:0/390: mknod dd/d19/d1a/d29/c83 0 2024-09-17T01:01:58.773 INFO:tasks.workunit.client.0.smithi002.stdout:4/621: mkdir d7/d19/d2e/dc0 0 2024-09-17T01:01:58.787 INFO:tasks.workunit.client.0.smithi002.stdout:7/501: dread d1/d14/d1d/d28/d6b/d9e/d54/f66 [0,4194304] 0 2024-09-17T01:01:58.788 INFO:tasks.workunit.client.0.smithi002.stdout:7/502: link d1/d14/d1d/d28/d6b/l93 d1/d14/d1d/d28/d6b/d9e/d50/la1 0 2024-09-17T01:01:58.788 INFO:tasks.workunit.client.0.smithi002.stdout:7/503: write d1/d14/d67/f75 [696905,84071] 0 2024-09-17T01:01:58.796 INFO:tasks.workunit.client.1.smithi099.stdout:0/516: dwrite da/d12/d2b/f37 [4194304,4194304] 0 2024-09-17T01:01:58.796 INFO:tasks.workunit.client.1.smithi099.stdout:0/517: creat da/d12/d22/fa9 x:0 0 0 2024-09-17T01:01:58.799 INFO:tasks.workunit.client.1.smithi099.stdout:6/548: write dc/d1a/f1e [246492,59020] 0 2024-09-17T01:01:58.799 INFO:tasks.workunit.client.1.smithi099.stdout:6/549: readlink dc/d5d/l65 0 2024-09-17T01:01:58.801 INFO:tasks.workunit.client.1.smithi099.stdout:6/550: dread dc/d2b/d53/d96/f8e [0,4194304] 0 2024-09-17T01:01:58.802 INFO:tasks.workunit.client.1.smithi099.stdout:6/551: rename dc/d2b/d53 to dc/d5d/dae 0 2024-09-17T01:01:58.803 INFO:tasks.workunit.client.1.smithi099.stdout:6/552: creat dc/d1a/d49/faf x:0 0 0 2024-09-17T01:01:58.812 INFO:tasks.workunit.client.1.smithi099.stdout:6/553: read dc/d1a/d49/f5b [346629,124676] 0 2024-09-17T01:01:58.837 INFO:tasks.workunit.client.1.smithi099.stdout:7/510: dwrite d1/f4 [0,4194304] 0 2024-09-17T01:01:58.837 INFO:tasks.workunit.client.1.smithi099.stdout:5/586: dwrite d2/dc/d17/d3c/d60/d90/da4/f6d [4194304,4194304] 0 2024-09-17T01:01:58.837 INFO:tasks.workunit.client.1.smithi099.stdout:6/554: dwrite dc/f34 [8388608,4194304] 0 2024-09-17T01:01:58.837 INFO:tasks.workunit.client.0.smithi002.stdout:6/515: dwrite d2/d1d/d2d/d5a/d71/d7e/f86 [0,4194304] 0 2024-09-17T01:01:58.838 INFO:tasks.workunit.client.0.smithi002.stdout:6/516: creat d2/d1d/d26/d49/fa0 x:0 0 0 2024-09-17T01:01:58.838 INFO:tasks.workunit.client.0.smithi002.stdout:6/517: dread - d2/d1d/d99/f9d zero size 2024-09-17T01:01:58.838 INFO:tasks.workunit.client.0.smithi002.stdout:6/518: write d2/d1d/f25 [1995193,94277] 0 2024-09-17T01:01:58.838 INFO:tasks.workunit.client.0.smithi002.stdout:6/519: write d2/f18 [4447941,80762] 0 2024-09-17T01:01:58.838 INFO:tasks.workunit.client.0.smithi002.stdout:9/481: dwrite d5/dc/d26/d63/d66/f78 [0,4194304] 0 2024-09-17T01:01:58.838 INFO:tasks.workunit.client.0.smithi002.stdout:4/622: dwrite d7/d3f/fa0 [0,4194304] 0 2024-09-17T01:01:58.839 INFO:tasks.workunit.client.1.smithi099.stdout:9/533: dwrite da/d21/d2a/f8c [0,4194304] 0 2024-09-17T01:01:58.839 INFO:tasks.workunit.client.1.smithi099.stdout:1/586: dwrite d0/d8c/f99 [0,4194304] 0 2024-09-17T01:01:58.839 INFO:tasks.workunit.client.1.smithi099.stdout:1/587: chown d0/l3d 2487 1 2024-09-17T01:01:58.839 INFO:tasks.workunit.client.1.smithi099.stdout:1/588: getdents d0/dbc 0 2024-09-17T01:01:58.840 INFO:tasks.workunit.client.0.smithi002.stdout:6/520: unlink d2/d1d/d2d/l52 0 2024-09-17T01:01:58.840 INFO:tasks.workunit.client.0.smithi002.stdout:6/521: chown d2/d4b/c60 39074954 1 2024-09-17T01:01:58.841 INFO:tasks.workunit.client.1.smithi099.stdout:0/518: dwrite da/df/d1a/d56/d72/f96 [0,4194304] 0 2024-09-17T01:01:58.844 INFO:tasks.workunit.client.1.smithi099.stdout:9/534: dread da/d18/d49/f98 [0,4194304] 0 2024-09-17T01:01:58.844 INFO:tasks.workunit.client.1.smithi099.stdout:9/535: chown da/d18 106836911 1 2024-09-17T01:01:58.845 INFO:tasks.workunit.client.1.smithi099.stdout:6/555: link dc/d5d/l8b dc/d27/d58/d74/lb0 0 2024-09-17T01:01:58.846 INFO:tasks.workunit.client.1.smithi099.stdout:7/511: dread d1/d2c/d5c/d12/f7f [0,4194304] 0 2024-09-17T01:01:58.846 INFO:tasks.workunit.client.1.smithi099.stdout:7/512: write d1/d2c/f2d [962336,47883] 0 2024-09-17T01:01:58.847 INFO:tasks.workunit.client.0.smithi002.stdout:7/504: dwrite d1/f26 [0,4194304] 0 2024-09-17T01:01:58.853 INFO:tasks.workunit.client.1.smithi099.stdout:1/589: creat d0/d8/d38/fce x:0 0 0 2024-09-17T01:01:58.854 INFO:tasks.workunit.client.0.smithi002.stdout:4/623: creat d7/d19/d9f/db2/fc1 x:0 0 0 2024-09-17T01:01:58.855 INFO:tasks.workunit.client.0.smithi002.stdout:6/522: creat d2/d1d/d2d/d35/d6d/fa1 x:0 0 0 2024-09-17T01:01:58.857 INFO:tasks.workunit.client.1.smithi099.stdout:0/519: mkdir da/d12/d22/d66/daa 0 2024-09-17T01:01:58.857 INFO:tasks.workunit.client.1.smithi099.stdout:0/520: chown da/df/d1a/d63/d6a/d7c 139413737 1 2024-09-17T01:01:58.858 INFO:tasks.workunit.client.0.smithi002.stdout:9/482: rmdir d5/dc/d26/d5c/d6b/d75/d57 39 2024-09-17T01:01:58.860 INFO:tasks.workunit.client.1.smithi099.stdout:6/556: write dc/d1a/f79 [2072538,120269] 0 2024-09-17T01:01:58.861 INFO:tasks.workunit.client.1.smithi099.stdout:6/557: write dc/f21 [789145,98699] 0 2024-09-17T01:01:58.862 INFO:tasks.workunit.client.1.smithi099.stdout:9/536: rename da/d14/d6d/db0 to da/d18/db3 0 2024-09-17T01:01:58.862 INFO:tasks.workunit.client.1.smithi099.stdout:7/513: truncate d1/d2c/d47/f50 3870128 0 2024-09-17T01:01:58.862 INFO:tasks.workunit.client.1.smithi099.stdout:1/590: rmdir d0/d8/d38/d75 39 2024-09-17T01:01:58.862 INFO:tasks.workunit.client.1.smithi099.stdout:9/537: dread da/d14/d6d/f87 [0,4194304] 0 2024-09-17T01:01:58.863 INFO:tasks.workunit.client.0.smithi002.stdout:9/483: mkdir d5/dc/d26/d46/d47/d89 0 2024-09-17T01:01:58.864 INFO:tasks.workunit.client.1.smithi099.stdout:6/558: creat dc/d27/d7e/dad/fb1 x:0 0 0 2024-09-17T01:01:58.865 INFO:tasks.workunit.client.1.smithi099.stdout:7/514: rename d1/d37/l9b to d1/d2c/d7a/la1 0 2024-09-17T01:01:58.866 INFO:tasks.workunit.client.0.smithi002.stdout:4/624: dread d7/de/d3a/f3c [0,4194304] 0 2024-09-17T01:01:58.866 INFO:tasks.workunit.client.1.smithi099.stdout:5/587: dwrite d2/dc/d17/f70 [0,4194304] 0 2024-09-17T01:01:58.867 INFO:tasks.workunit.client.0.smithi002.stdout:9/484: mkdir d5/d8a 0 2024-09-17T01:01:58.867 INFO:tasks.workunit.client.1.smithi099.stdout:9/538: getdents da/d14/d40 0 2024-09-17T01:01:58.868 INFO:tasks.workunit.client.0.smithi002.stdout:4/625: mkdir d7/d19/d9f/dc2 0 2024-09-17T01:01:58.869 INFO:tasks.workunit.client.0.smithi002.stdout:4/626: fdatasync d7/de/f27 0 2024-09-17T01:01:58.869 INFO:tasks.workunit.client.0.smithi002.stdout:4/627: chown d7/d3f/fb1 602702955 1 2024-09-17T01:01:58.869 INFO:tasks.workunit.client.0.smithi002.stdout:4/628: write d7/de/d3a/d99/fbf [925089,129688] 0 2024-09-17T01:01:58.869 INFO:tasks.workunit.client.0.smithi002.stdout:4/629: write d7/d3f/da9/fbc [568349,26691] 0 2024-09-17T01:01:58.869 INFO:tasks.workunit.client.0.smithi002.stdout:4/630: stat d7/d19/d2e/f33 0 2024-09-17T01:01:58.869 INFO:tasks.workunit.client.0.smithi002.stdout:4/631: fdatasync d7/f12 0 2024-09-17T01:01:58.876 INFO:tasks.workunit.client.0.smithi002.stdout:7/505: dwrite d1/d14/d1d/d28/d2d/f70 [0,4194304] 0 2024-09-17T01:01:58.876 INFO:tasks.workunit.client.0.smithi002.stdout:7/506: creat d1/d14/d1d/d28/d8f/fa2 x:0 0 0 2024-09-17T01:01:58.876 INFO:tasks.workunit.client.0.smithi002.stdout:7/507: write d1/d14/f8a [454115,56268] 0 2024-09-17T01:01:58.876 INFO:tasks.workunit.client.0.smithi002.stdout:7/508: fsync d1/f20 0 2024-09-17T01:01:58.876 INFO:tasks.workunit.client.0.smithi002.stdout:1/510: sync 2024-09-17T01:01:58.877 INFO:tasks.workunit.client.0.smithi002.stdout:1/511: readlink d4/d11/d1a/daa/lac 0 2024-09-17T01:01:58.878 INFO:tasks.workunit.client.0.smithi002.stdout:4/632: getdents d7/de 0 2024-09-17T01:01:58.879 INFO:tasks.workunit.client.1.smithi099.stdout:8/547: sync 2024-09-17T01:01:58.881 INFO:tasks.workunit.client.1.smithi099.stdout:1/591: dread d0/d8/d49/f4c [0,4194304] 0 2024-09-17T01:01:58.881 INFO:tasks.workunit.client.1.smithi099.stdout:3/599: sync 2024-09-17T01:01:58.881 INFO:tasks.workunit.client.1.smithi099.stdout:4/545: sync 2024-09-17T01:01:58.882 INFO:tasks.workunit.client.0.smithi002.stdout:9/485: write d5/dc/d26/d46/f58 [738888,10889] 0 2024-09-17T01:01:58.882 INFO:tasks.workunit.client.1.smithi099.stdout:8/548: rename d0/d41/da4 to d0/d1f/db5 0 2024-09-17T01:01:58.883 INFO:tasks.workunit.client.1.smithi099.stdout:1/592: truncate d0/d8/d38/d75/f9b 1177120 0 2024-09-17T01:01:58.884 INFO:tasks.workunit.client.1.smithi099.stdout:3/600: truncate d9/d15/d18/d1a/d23/d4c/f90 1098368 0 2024-09-17T01:01:58.884 INFO:tasks.workunit.client.0.smithi002.stdout:7/509: mknod d1/d14/d1d/d28/d6b/d9e/ca3 0 2024-09-17T01:01:58.886 INFO:tasks.workunit.client.1.smithi099.stdout:8/549: rename d0/d1f/d55/c5b to d0/d4/d29/d9c/cb6 0 2024-09-17T01:01:58.886 INFO:tasks.workunit.client.1.smithi099.stdout:8/550: creat d0/d1f/d90/fb7 x:0 0 0 2024-09-17T01:01:58.887 INFO:tasks.workunit.client.0.smithi002.stdout:4/633: creat d7/d19/d9f/d54/fc3 x:0 0 0 2024-09-17T01:01:58.887 INFO:tasks.workunit.client.0.smithi002.stdout:4/634: truncate d7/d71/d8e/fb8 752258 0 2024-09-17T01:01:58.887 INFO:tasks.workunit.client.1.smithi099.stdout:6/559: dread dc/d1a/f1e [0,4194304] 0 2024-09-17T01:01:58.888 INFO:tasks.workunit.client.0.smithi002.stdout:6/523: dwrite d2/f13 [0,4194304] 0 2024-09-17T01:01:58.888 INFO:tasks.workunit.client.1.smithi099.stdout:5/588: dread d2/dc/d14/f16 [0,4194304] 0 2024-09-17T01:01:58.888 INFO:tasks.workunit.client.1.smithi099.stdout:5/589: truncate d2/dc/d14/f4f 2671822 0 2024-09-17T01:01:58.888 INFO:tasks.workunit.client.1.smithi099.stdout:1/593: creat d0/d2/de/fcf x:0 0 0 2024-09-17T01:01:58.889 INFO:tasks.workunit.client.1.smithi099.stdout:4/546: dread d7/dd/d21/f77 [0,4194304] 0 2024-09-17T01:01:58.890 INFO:tasks.workunit.client.0.smithi002.stdout:1/512: link d4/d11/d12/d14/d17/f27 d4/fb0 0 2024-09-17T01:01:58.890 INFO:tasks.workunit.client.0.smithi002.stdout:4/635: rmdir d7/de/d32/d8a/d77 39 2024-09-17T01:01:58.890 INFO:tasks.workunit.client.0.smithi002.stdout:1/513: creat d4/d11/d12/d30/fb1 x:0 0 0 2024-09-17T01:01:58.890 INFO:tasks.workunit.client.0.smithi002.stdout:1/514: chown d4/d11/d12/l7d 251 1 2024-09-17T01:01:58.890 INFO:tasks.workunit.client.0.smithi002.stdout:1/515: chown d4/d11/d12/d14/f2b 36 1 2024-09-17T01:01:58.890 INFO:tasks.workunit.client.0.smithi002.stdout:1/516: creat d4/d11/d55/fb2 x:0 0 0 2024-09-17T01:01:58.890 INFO:tasks.workunit.client.0.smithi002.stdout:1/517: chown d4/d11/d1c 12230787 1 2024-09-17T01:01:58.890 INFO:tasks.workunit.client.0.smithi002.stdout:1/518: truncate d4/d11/d1c/f66 927974 0 2024-09-17T01:01:58.890 INFO:tasks.workunit.client.0.smithi002.stdout:1/519: fsync d4/d11/d12/d14/d17/f28 0 2024-09-17T01:01:58.891 INFO:tasks.workunit.client.1.smithi099.stdout:6/560: mknod dc/d5d/d66/d7a/d87/cb2 0 2024-09-17T01:01:58.891 INFO:tasks.workunit.client.1.smithi099.stdout:1/594: mkdir d0/d8/d38/d8a/dd0 0 2024-09-17T01:01:58.892 INFO:tasks.workunit.client.0.smithi002.stdout:1/520: creat d4/d11/d1a/d95/fb3 x:0 0 0 2024-09-17T01:01:58.892 INFO:tasks.workunit.client.0.smithi002.stdout:4/636: mknod d7/de/d32/d59/cc4 0 2024-09-17T01:01:58.892 INFO:tasks.workunit.client.0.smithi002.stdout:4/637: fdatasync d7/d71/d8e/d95/fb0 0 2024-09-17T01:01:58.893 INFO:tasks.workunit.client.1.smithi099.stdout:3/601: mknod d9/d15/d18/d1a/d23/d5c/d99/cb9 0 2024-09-17T01:01:58.893 INFO:tasks.workunit.client.0.smithi002.stdout:1/521: rmdir d4/d11/d12/d30/d43 39 2024-09-17T01:01:58.895 INFO:tasks.workunit.client.1.smithi099.stdout:4/547: creat d7/dd/de/fb8 x:0 0 0 2024-09-17T01:01:58.896 INFO:tasks.workunit.client.1.smithi099.stdout:6/561: mkdir dc/d1a/d49/da8/db3 0 2024-09-17T01:01:58.896 INFO:tasks.workunit.client.1.smithi099.stdout:6/562: dread - dc/d1a/d49/d4c/f9d zero size 2024-09-17T01:01:58.896 INFO:tasks.workunit.client.1.smithi099.stdout:4/548: getdents d7 0 2024-09-17T01:01:58.898 INFO:tasks.workunit.client.0.smithi002.stdout:1/522: dread d4/d11/d55/d7a/f9a [0,4194304] 0 2024-09-17T01:01:58.898 INFO:tasks.workunit.client.0.smithi002.stdout:1/523: creat d4/d11/d1a/fb4 x:0 0 0 2024-09-17T01:01:58.899 INFO:tasks.workunit.client.1.smithi099.stdout:6/563: rename dc/d27/l44 to dc/d27/d7e/dad/lb4 0 2024-09-17T01:01:58.899 INFO:tasks.workunit.client.1.smithi099.stdout:6/564: chown dc/d27/f81 0 1 2024-09-17T01:01:58.899 INFO:tasks.workunit.client.1.smithi099.stdout:4/549: mknod d7/dd/d21/d7b/cb9 0 2024-09-17T01:01:58.900 INFO:tasks.workunit.client.1.smithi099.stdout:6/565: creat dc/d5d/d66/d7a/d87/fb5 x:0 0 0 2024-09-17T01:01:58.900 INFO:tasks.workunit.client.1.smithi099.stdout:6/566: fsync f7 0 2024-09-17T01:01:58.900 INFO:tasks.workunit.client.1.smithi099.stdout:6/567: write fa [124358,57561] 0 2024-09-17T01:01:58.902 INFO:tasks.workunit.client.0.smithi002.stdout:1/524: rename d4/d11/d12/d14/c93 to d4/d11/d12/d30/d5e/cb5 0 2024-09-17T01:01:58.903 INFO:tasks.workunit.client.1.smithi099.stdout:1/595: dread d0/d8/d49/f4c [0,4194304] 0 2024-09-17T01:01:58.905 INFO:tasks.workunit.client.1.smithi099.stdout:1/596: symlink d0/d8/ld1 0 2024-09-17T01:01:58.905 INFO:tasks.workunit.client.1.smithi099.stdout:1/597: truncate d0/d8/d38/d56/f63 1106057 0 2024-09-17T01:01:58.907 INFO:tasks.workunit.client.1.smithi099.stdout:1/598: creat d0/d8/d49/d94/d4b/d59/db9/dc7/fd2 x:0 0 0 2024-09-17T01:01:58.908 INFO:tasks.workunit.client.0.smithi002.stdout:6/524: write d2/d1d/d2d/d35/d37/f41 [1840929,45873] 0 2024-09-17T01:01:58.908 INFO:tasks.workunit.client.0.smithi002.stdout:6/525: creat d2/d1d/d27/d30/fa2 x:0 0 0 2024-09-17T01:01:58.909 INFO:tasks.workunit.client.1.smithi099.stdout:1/599: truncate d0/d8/d49/d94/d4b/faf 92258 0 2024-09-17T01:01:58.911 INFO:tasks.workunit.client.1.smithi099.stdout:1/600: mkdir d0/d2/d5/dd3 0 2024-09-17T01:01:58.911 INFO:tasks.workunit.client.1.smithi099.stdout:1/601: truncate d0/d8/f7e 955536 0 2024-09-17T01:01:58.911 INFO:tasks.workunit.client.1.smithi099.stdout:1/602: truncate d0/d8/f65 4236320 0 2024-09-17T01:01:58.911 INFO:tasks.workunit.client.0.smithi002.stdout:6/526: creat d2/d1d/fa3 x:0 0 0 2024-09-17T01:01:58.912 INFO:tasks.workunit.client.0.smithi002.stdout:6/527: symlink d2/d1d/d2d/d35/d79/la4 0 2024-09-17T01:01:58.912 INFO:tasks.workunit.client.0.smithi002.stdout:6/528: read f1 [7153724,72232] 0 2024-09-17T01:01:58.912 INFO:tasks.workunit.client.0.smithi002.stdout:6/529: write d2/d1d/d2d/d35/d6d/fa1 [370501,53336] 0 2024-09-17T01:01:58.912 INFO:tasks.workunit.client.0.smithi002.stdout:6/530: read d2/d1d/d26/d49/d51/f96 [327082,119495] 0 2024-09-17T01:01:58.912 INFO:tasks.workunit.client.0.smithi002.stdout:6/531: fsync d2/f18 0 2024-09-17T01:01:58.912 INFO:tasks.workunit.client.0.smithi002.stdout:6/532: write d2/d1d/d2d/d54/f89 [238489,39354] 0 2024-09-17T01:01:58.913 INFO:tasks.workunit.client.1.smithi099.stdout:1/603: symlink d0/d8/dbf/ld4 0 2024-09-17T01:01:58.913 INFO:tasks.workunit.client.1.smithi099.stdout:1/604: write d0/d2/f3b [238062,490] 0 2024-09-17T01:01:58.913 INFO:tasks.workunit.client.1.smithi099.stdout:1/605: symlink d0/d8/d49/d4e/ld5 0 2024-09-17T01:01:58.914 INFO:tasks.workunit.client.1.smithi099.stdout:1/606: read d0/d2/ff [4736178,32036] 0 2024-09-17T01:01:58.914 INFO:tasks.workunit.client.1.smithi099.stdout:1/607: fsync d0/d2/d5/f58 0 2024-09-17T01:01:58.914 INFO:tasks.workunit.client.1.smithi099.stdout:1/608: write d0/d8/f65 [4116579,70704] 0 2024-09-17T01:01:58.914 INFO:tasks.workunit.client.1.smithi099.stdout:1/609: rmdir d0/d8/dbf 39 2024-09-17T01:01:58.915 INFO:tasks.workunit.client.1.smithi099.stdout:1/610: stat d0/d2/de 0 2024-09-17T01:01:58.915 INFO:tasks.workunit.client.1.smithi099.stdout:1/611: unlink d0/d2/de/d70/fc4 0 2024-09-17T01:01:58.916 INFO:tasks.workunit.client.1.smithi099.stdout:1/612: mkdir d0/d2/d61/dd6 0 2024-09-17T01:01:58.917 INFO:tasks.workunit.client.1.smithi099.stdout:1/613: creat d0/d8/d49/d94/fd7 x:0 0 0 2024-09-17T01:01:58.917 INFO:tasks.workunit.client.1.smithi099.stdout:0/521: dwrite da/d12/fa6 [0,4194304] 0 2024-09-17T01:01:58.919 INFO:tasks.workunit.client.1.smithi099.stdout:0/522: mkdir da/d12/d2b/dab 0 2024-09-17T01:01:58.920 INFO:tasks.workunit.client.0.smithi002.stdout:6/533: dread d2/d1d/d2d/f4f [0,4194304] 0 2024-09-17T01:01:58.924 INFO:tasks.workunit.client.0.smithi002.stdout:6/534: dread d2/d4b/f9a [0,4194304] 0 2024-09-17T01:01:58.925 INFO:tasks.workunit.client.0.smithi002.stdout:6/535: mknod d2/d1d/d27/d80/d93/ca5 0 2024-09-17T01:01:58.925 INFO:tasks.workunit.client.0.smithi002.stdout:6/536: chown d2/d1d/d27 1 1 2024-09-17T01:01:58.925 INFO:tasks.workunit.client.0.smithi002.stdout:6/537: mkdir d2/d1d/d27/d87/da6 0 2024-09-17T01:01:58.930 INFO:tasks.workunit.client.0.smithi002.stdout:7/510: dwrite d1/f27 [0,4194304] 0 2024-09-17T01:01:58.930 INFO:tasks.workunit.client.0.smithi002.stdout:7/511: dread - d1/d14/f6c zero size 2024-09-17T01:01:58.933 INFO:tasks.workunit.client.0.smithi002.stdout:6/538: read d2/d1d/d2d/f2e [4108703,33948] 0 2024-09-17T01:01:58.934 INFO:tasks.workunit.client.0.smithi002.stdout:6/539: mknod d2/d1d/d26/d49/d51/ca7 0 2024-09-17T01:01:58.934 INFO:tasks.workunit.client.0.smithi002.stdout:1/525: dwrite d4/d11/d1a/fb4 [0,4194304] 0 2024-09-17T01:01:58.941 INFO:tasks.workunit.client.0.smithi002.stdout:6/540: rename d2/d1d/d2d/d54 to d2/d1d/d2d/d35/d79/da8 0 2024-09-17T01:01:58.943 INFO:tasks.workunit.client.0.smithi002.stdout:6/541: write d2/f70 [1358553,122855] 0 2024-09-17T01:01:58.949 INFO:tasks.workunit.client.0.smithi002.stdout:1/526: dwrite d4/d11/d1a/d95/fb3 [0,4194304] 0 2024-09-17T01:01:58.950 INFO:tasks.workunit.client.0.smithi002.stdout:1/527: creat d4/d11/d12/d30/fb6 x:0 0 0 2024-09-17T01:01:58.950 INFO:tasks.workunit.client.0.smithi002.stdout:1/528: fsync d4/ff 0 2024-09-17T01:01:58.958 INFO:tasks.workunit.client.0.smithi002.stdout:6/542: dwrite d2/d4b/d4c/f62 [0,4194304] 0 2024-09-17T01:01:58.977 INFO:tasks.workunit.client.0.smithi002.stdout:6/543: dwrite d2/d1d/f57 [0,4194304] 0 2024-09-17T01:01:58.979 INFO:tasks.workunit.client.0.smithi002.stdout:6/544: rename d2/d4b to d2/dc/d24/d53/d83/da9 0 2024-09-17T01:01:58.980 INFO:tasks.workunit.client.0.smithi002.stdout:6/545: creat d2/d1d/d2d/d35/d79/faa x:0 0 0 2024-09-17T01:01:58.980 INFO:tasks.workunit.client.0.smithi002.stdout:6/546: stat d2/d1d/d27/d80/d93 0 2024-09-17T01:01:58.980 INFO:tasks.workunit.client.0.smithi002.stdout:6/547: fdatasync d2/d1d/d26/d49/d7d/f7b 0 2024-09-17T01:01:58.982 INFO:tasks.workunit.client.0.smithi002.stdout:6/548: dread d2/d1d/d26/d49/d51/f76 [0,4194304] 0 2024-09-17T01:01:58.994 INFO:tasks.workunit.client.1.smithi099.stdout:7/515: dwrite d1/d2c/d5c/d12/f4b [0,4194304] 0 2024-09-17T01:01:58.996 INFO:tasks.workunit.client.1.smithi099.stdout:8/551: dwrite d0/d1f/f62 [0,4194304] 0 2024-09-17T01:01:58.996 INFO:tasks.workunit.client.1.smithi099.stdout:9/539: dwrite da/d14/d40/f97 [0,4194304] 0 2024-09-17T01:01:58.996 INFO:tasks.workunit.client.1.smithi099.stdout:7/516: creat d1/d2c/d5c/d1c/fa2 x:0 0 0 2024-09-17T01:01:58.996 INFO:tasks.workunit.client.1.smithi099.stdout:7/517: write d1/f19 [1180952,49369] 0 2024-09-17T01:01:58.997 INFO:tasks.workunit.client.0.smithi002.stdout:6/549: dread d2/d1d/d26/d49/f72 [0,4194304] 0 2024-09-17T01:01:58.998 INFO:tasks.workunit.client.0.smithi002.stdout:5/489: sync 2024-09-17T01:01:58.998 INFO:tasks.workunit.client.0.smithi002.stdout:8/635: sync 2024-09-17T01:01:58.998 INFO:tasks.workunit.client.0.smithi002.stdout:3/542: sync 2024-09-17T01:01:58.998 INFO:tasks.workunit.client.0.smithi002.stdout:3/543: stat d0/d31/l70 0 2024-09-17T01:01:58.998 INFO:tasks.workunit.client.0.smithi002.stdout:3/544: chown d0/d3/l7 9 1 2024-09-17T01:01:58.998 INFO:tasks.workunit.client.0.smithi002.stdout:8/636: fdatasync d2/d3/d5f/d98/da5/d4f/d77/d78/f87 0 2024-09-17T01:01:58.998 INFO:tasks.workunit.client.0.smithi002.stdout:8/637: dread - d2/d3/d5f/d98/da5/d4f/d58/fbc zero size 2024-09-17T01:01:58.999 INFO:tasks.workunit.client.0.smithi002.stdout:6/550: mkdir d2/d1d/d2d/d35/d8d/dab 0 2024-09-17T01:01:58.999 INFO:tasks.workunit.client.1.smithi099.stdout:9/540: rmdir da/d18 39 2024-09-17T01:01:58.999 INFO:tasks.workunit.client.1.smithi099.stdout:9/541: stat da/d9a/d3a/d4b/c93 0 2024-09-17T01:01:58.999 INFO:tasks.workunit.client.0.smithi002.stdout:8/638: write d2/d9/dd/f2c [5038258,123572] 0 2024-09-17T01:01:59.000 INFO:tasks.workunit.client.0.smithi002.stdout:8/639: dread - d2/d30/fae zero size 2024-09-17T01:01:59.000 INFO:tasks.workunit.client.0.smithi002.stdout:5/490: mknod d2/d2d/d10/d14/d19/d39/d64/c9a 0 2024-09-17T01:01:59.000 INFO:tasks.workunit.client.0.smithi002.stdout:5/491: mkdir d2/d2d/d10/d9b 0 2024-09-17T01:01:59.000 INFO:tasks.workunit.client.0.smithi002.stdout:5/492: stat d2/de 0 2024-09-17T01:01:59.002 INFO:tasks.workunit.client.0.smithi002.stdout:5/493: symlink d2/d2d/d10/d14/d19/l9c 0 2024-09-17T01:01:59.002 INFO:tasks.workunit.client.0.smithi002.stdout:5/494: write d2/f54 [902425,66899] 0 2024-09-17T01:01:59.002 INFO:tasks.workunit.client.1.smithi099.stdout:0/523: write f8 [76922,123003] 0 2024-09-17T01:01:59.002 INFO:tasks.workunit.client.1.smithi099.stdout:9/542: link da/d8e/d96/ca9 da/d21/d5b/cb4 0 2024-09-17T01:01:59.003 INFO:tasks.workunit.client.1.smithi099.stdout:9/543: stat da/d9a/d3a/c45 0 2024-09-17T01:01:59.003 INFO:tasks.workunit.client.1.smithi099.stdout:9/544: chown da/d9a/l2d 4 1 2024-09-17T01:01:59.005 INFO:tasks.workunit.client.1.smithi099.stdout:9/545: unlink da/d9a/l2d 0 2024-09-17T01:01:59.005 INFO:tasks.workunit.client.1.smithi099.stdout:9/546: dread - da/d18/d5e/f9e zero size 2024-09-17T01:01:59.006 INFO:tasks.workunit.client.1.smithi099.stdout:9/547: truncate da/fe 1433936 0 2024-09-17T01:01:59.006 INFO:tasks.workunit.client.1.smithi099.stdout:9/548: read da/d14/d6d/f87 [212243,108731] 0 2024-09-17T01:01:59.006 INFO:tasks.workunit.client.1.smithi099.stdout:9/549: chown da/c17 0 1 2024-09-17T01:01:59.006 INFO:tasks.workunit.client.0.smithi002.stdout:3/545: dread d0/d3/d17/d6a/fb7 [0,4194304] 0 2024-09-17T01:01:59.007 INFO:tasks.workunit.client.0.smithi002.stdout:3/546: symlink d0/d3/lbe 0 2024-09-17T01:01:59.008 INFO:tasks.workunit.client.0.smithi002.stdout:3/547: write d0/d3/d33/d40/f45 [571703,10976] 0 2024-09-17T01:01:59.010 INFO:tasks.workunit.client.0.smithi002.stdout:3/548: mknod d0/cbf 0 2024-09-17T01:01:59.011 INFO:tasks.workunit.client.0.smithi002.stdout:3/549: rename d0/d3/d17/d87/d9e/fa9 to d0/d3/d17/d9a/fc0 0 2024-09-17T01:01:59.011 INFO:tasks.workunit.client.0.smithi002.stdout:3/550: fsync d0/d3/d33/d4a/f78 0 2024-09-17T01:01:59.011 INFO:tasks.workunit.client.0.smithi002.stdout:3/551: readlink d0/d31/d32/l10 0 2024-09-17T01:01:59.013 INFO:tasks.workunit.client.1.smithi099.stdout:6/568: dwrite dc/d1a/f86 [0,4194304] 0 2024-09-17T01:01:59.014 INFO:tasks.workunit.client.0.smithi002.stdout:6/551: write d2/d1d/f3d [4286881,43418] 0 2024-09-17T01:01:59.015 INFO:tasks.workunit.client.1.smithi099.stdout:0/524: dread f7 [4194304,4194304] 0 2024-09-17T01:01:59.016 INFO:tasks.workunit.client.0.smithi002.stdout:6/552: creat d2/d1d/d27/d87/fac x:0 0 0 2024-09-17T01:01:59.016 INFO:tasks.workunit.client.0.smithi002.stdout:6/553: chown d2/d1d/d2d/d35/d8d/d43 45170 1 2024-09-17T01:01:59.016 INFO:tasks.workunit.client.0.smithi002.stdout:6/554: chown d2/l1e 426204 1 2024-09-17T01:01:59.016 INFO:tasks.workunit.client.0.smithi002.stdout:6/555: stat d2/d1d/d2d/d35/d6d/fa1 0 2024-09-17T01:01:59.017 INFO:tasks.workunit.client.0.smithi002.stdout:6/556: symlink d2/d1d/d2d/d35/d37/lad 0 2024-09-17T01:01:59.017 INFO:tasks.workunit.client.0.smithi002.stdout:6/557: dread - d2/d1d/d26/f67 zero size 2024-09-17T01:01:59.018 INFO:tasks.workunit.client.0.smithi002.stdout:6/558: mknod d2/d1d/d26/cae 0 2024-09-17T01:01:59.018 INFO:tasks.workunit.client.1.smithi099.stdout:6/569: rename dc/d27/d7e/d8c to dc/d5d/d66/d7a/d87/db6 0 2024-09-17T01:01:59.018 INFO:tasks.workunit.client.0.smithi002.stdout:6/559: creat d2/d1d/d26/d49/d7d/d8c/faf x:0 0 0 2024-09-17T01:01:59.021 INFO:tasks.workunit.client.1.smithi099.stdout:5/590: dwrite d2/dc/d14/f4f [0,4194304] 0 2024-09-17T01:01:59.021 INFO:tasks.workunit.client.1.smithi099.stdout:5/591: readlink d2/dc/d17/d6b/l8b 0 2024-09-17T01:01:59.022 INFO:tasks.workunit.client.0.smithi002.stdout:7/512: dwrite d1/f5 [0,4194304] 0 2024-09-17T01:01:59.022 INFO:tasks.workunit.client.0.smithi002.stdout:7/513: write d1/f20 [2982023,50141] 0 2024-09-17T01:01:59.022 INFO:tasks.workunit.client.0.smithi002.stdout:7/514: dread - d1/d14/d1d/d28/d8f/f9c zero size 2024-09-17T01:01:59.022 INFO:tasks.workunit.client.0.smithi002.stdout:6/560: dread d2/f18 [0,4194304] 0 2024-09-17T01:01:59.023 INFO:tasks.workunit.client.0.smithi002.stdout:4/638: dwrite d7/d19/f1c [0,4194304] 0 2024-09-17T01:01:59.023 INFO:tasks.workunit.client.1.smithi099.stdout:8/552: rmdir d0/d1f/d55 39 2024-09-17T01:01:59.023 INFO:tasks.workunit.client.0.smithi002.stdout:8/640: dwrite d2/d3/d5f/d98/da5/d4f/d77/d78/fc5 [0,4194304] 0 2024-09-17T01:01:59.024 INFO:tasks.workunit.client.0.smithi002.stdout:7/515: creat d1/d14/d1d/d28/d2d/fa4 x:0 0 0 2024-09-17T01:01:59.024 INFO:tasks.workunit.client.0.smithi002.stdout:7/516: stat d1/d14/d1d/d28/f4f 0 2024-09-17T01:01:59.024 INFO:tasks.workunit.client.0.smithi002.stdout:7/517: chown d1/d14/d1d/d28/d6b/d9e/d54/f73 31909 1 2024-09-17T01:01:59.032 INFO:tasks.workunit.client.1.smithi099.stdout:9/550: dwrite da/f64 [0,4194304] 0 2024-09-17T01:01:59.032 INFO:tasks.workunit.client.1.smithi099.stdout:9/551: readlink da/d21/l35 0 2024-09-17T01:01:59.032 INFO:tasks.workunit.client.1.smithi099.stdout:8/553: dread d0/d1f/d55/f7e [0,4194304] 0 2024-09-17T01:01:59.033 INFO:tasks.workunit.client.0.smithi002.stdout:8/641: dread d2/d3/f1b [0,4194304] 0 2024-09-17T01:01:59.033 INFO:tasks.workunit.client.0.smithi002.stdout:8/642: chown d2/d3/d5f/d98/da5/d4f/d77/d78 8259750 1 2024-09-17T01:01:59.033 INFO:tasks.workunit.client.0.smithi002.stdout:8/643: chown d2/d3/d5f/d98/da5/f7b 3760 1 2024-09-17T01:01:59.033 INFO:tasks.workunit.client.1.smithi099.stdout:6/570: dread dc/d27/f7d [0,4194304] 0 2024-09-17T01:01:59.033 INFO:tasks.workunit.client.1.smithi099.stdout:0/525: dread da/d12/f62 [0,4194304] 0 2024-09-17T01:01:59.034 INFO:tasks.workunit.client.0.smithi002.stdout:7/518: rename d1/d14/d1d/d28/d2d/f68 to d1/d14/fa5 0 2024-09-17T01:01:59.034 INFO:tasks.workunit.client.0.smithi002.stdout:7/519: fsync d1/d14/d1d/d28/d40/f5f 0 2024-09-17T01:01:59.036 INFO:tasks.workunit.client.1.smithi099.stdout:6/571: dread dc/d5d/dae/d96/f47 [0,4194304] 0 2024-09-17T01:01:59.041 INFO:tasks.workunit.client.0.smithi002.stdout:8/644: creat d2/d3/d5f/d98/da5/d4f/d77/db0/fda x:0 0 0 2024-09-17T01:01:59.041 INFO:tasks.workunit.client.0.smithi002.stdout:8/645: chown d2/d3/d5f/d98/da5/d4f/d58/cb4 593788 1 2024-09-17T01:01:59.042 INFO:tasks.workunit.client.0.smithi002.stdout:7/520: unlink d1/d14/d1d/d28/d8f/f9c 0 2024-09-17T01:01:59.042 INFO:tasks.workunit.client.1.smithi099.stdout:0/526: unlink da/d3b/c42 0 2024-09-17T01:01:59.044 INFO:tasks.workunit.client.1.smithi099.stdout:0/527: write f7 [7992075,74993] 0 2024-09-17T01:01:59.044 INFO:tasks.workunit.client.1.smithi099.stdout:1/614: dwrite d0/d8/f65 [0,4194304] 0 2024-09-17T01:01:59.045 INFO:tasks.workunit.client.1.smithi099.stdout:1/615: chown d0/d8/d49/d94/d4b/d59/db9/dc7 168 1 2024-09-17T01:01:59.045 INFO:tasks.workunit.client.1.smithi099.stdout:1/616: fsync d0/d2/fa6 0 2024-09-17T01:01:59.047 INFO:tasks.workunit.client.1.smithi099.stdout:9/552: dread da/d21/d2a/f54 [0,4194304] 0 2024-09-17T01:01:59.047 INFO:tasks.workunit.client.0.smithi002.stdout:6/561: getdents d2/d1d/d2d 0 2024-09-17T01:01:59.048 INFO:tasks.workunit.client.0.smithi002.stdout:8/646: rename d2/d30/d8b to d2/d1c/d28/dad/dcd/dd1/ddb 0 2024-09-17T01:01:59.049 INFO:tasks.workunit.client.0.smithi002.stdout:8/647: mknod d2/d1c/d28/dad/dcd/dd1/ddb/dcb/cdc 0 2024-09-17T01:01:59.049 INFO:tasks.workunit.client.0.smithi002.stdout:8/648: chown d2/d26/f61 3 1 2024-09-17T01:01:59.049 INFO:tasks.workunit.client.0.smithi002.stdout:8/649: stat d2/d3/d5f/d98/dab 0 2024-09-17T01:01:59.049 INFO:tasks.workunit.client.1.smithi099.stdout:6/572: write dc/d27/f7d [2596256,67337] 0 2024-09-17T01:01:59.050 INFO:tasks.workunit.client.0.smithi002.stdout:6/562: rename d2/d1d/d26/d49/d9f to d2/d1d/d27/d80/db0 0 2024-09-17T01:01:59.050 INFO:tasks.workunit.client.1.smithi099.stdout:1/617: mkdir d0/d2/dd8 0 2024-09-17T01:01:59.051 INFO:tasks.workunit.client.0.smithi002.stdout:8/650: mknod d2/d1c/dd4/cdd 0 2024-09-17T01:01:59.051 INFO:tasks.workunit.client.0.smithi002.stdout:8/651: readlink d2/d3/d5f/d98/da5/lbe 0 2024-09-17T01:01:59.051 INFO:tasks.workunit.client.0.smithi002.stdout:8/652: creat d2/d26/dbb/fde x:0 0 0 2024-09-17T01:01:59.052 INFO:tasks.workunit.client.0.smithi002.stdout:6/563: link d2/d1d/d2d/d73/c84 d2/d1d/d26/d49/d51/cb1 0 2024-09-17T01:01:59.053 INFO:tasks.workunit.client.1.smithi099.stdout:8/554: dread d0/d1f/d55/d95/f99 [0,4194304] 0 2024-09-17T01:01:59.054 INFO:tasks.workunit.client.1.smithi099.stdout:1/618: rmdir d0/d8/d49/d94/d4b/d59/db9 39 2024-09-17T01:01:59.054 INFO:tasks.workunit.client.0.smithi002.stdout:8/653: rmdir d2/d3/d5f/d98/dab 39 2024-09-17T01:01:59.056 INFO:tasks.workunit.client.1.smithi099.stdout:0/528: rename da/df/d1a/d23 to da/df/d1a/d49/dac 0 2024-09-17T01:01:59.056 INFO:tasks.workunit.client.1.smithi099.stdout:0/529: write da/df/f94 [682874,43959] 0 2024-09-17T01:01:59.056 INFO:tasks.workunit.client.1.smithi099.stdout:5/592: dwrite d2/d8/f29 [4194304,4194304] 0 2024-09-17T01:01:59.057 INFO:tasks.workunit.client.0.smithi002.stdout:6/564: creat d2/d1d/d2d/d5a/d71/fb2 x:0 0 0 2024-09-17T01:01:59.060 INFO:tasks.workunit.client.1.smithi099.stdout:1/619: mknod d0/dbc/cd9 0 2024-09-17T01:01:59.060 INFO:tasks.workunit.client.1.smithi099.stdout:1/620: read d0/f13 [2251988,125819] 0 2024-09-17T01:01:59.060 INFO:tasks.workunit.client.1.smithi099.stdout:1/621: write d0/d2/de/d70/f86 [445670,54695] 0 2024-09-17T01:01:59.060 INFO:tasks.workunit.client.1.smithi099.stdout:6/573: write dc/d5d/d66/f67 [1747156,44304] 0 2024-09-17T01:01:59.062 INFO:tasks.workunit.client.1.smithi099.stdout:9/553: rename da/d56/d84/f85 to da/d9a/fb5 0 2024-09-17T01:01:59.062 INFO:tasks.workunit.client.0.smithi002.stdout:2/560: sync 2024-09-17T01:01:59.062 INFO:tasks.workunit.client.0.smithi002.stdout:0/391: sync 2024-09-17T01:01:59.063 INFO:tasks.workunit.client.0.smithi002.stdout:2/561: write d1b/d37/f49 [420158,7773] 0 2024-09-17T01:01:59.063 INFO:tasks.workunit.client.0.smithi002.stdout:0/392: fsync dd/d19/f2c 0 2024-09-17T01:01:59.063 INFO:tasks.workunit.client.0.smithi002.stdout:0/393: write dd/d19/d1a/d29/d55/d61/f6c [776900,117643] 0 2024-09-17T01:01:59.065 INFO:tasks.workunit.client.1.smithi099.stdout:0/530: link da/l35 da/d1c/d1e/lad 0 2024-09-17T01:01:59.065 INFO:tasks.workunit.client.1.smithi099.stdout:0/531: dread - da/d12/d22/d66/f6d zero size 2024-09-17T01:01:59.065 INFO:tasks.workunit.client.1.smithi099.stdout:0/532: dread - da/d1c/d1e/f9d zero size 2024-09-17T01:01:59.065 INFO:tasks.workunit.client.1.smithi099.stdout:0/533: chown da/df/d1a/d63/d6a/da4 98529 1 2024-09-17T01:01:59.067 INFO:tasks.workunit.client.1.smithi099.stdout:1/622: read d0/d8/d49/f4c [3200434,63007] 0 2024-09-17T01:01:59.067 INFO:tasks.workunit.client.1.smithi099.stdout:1/623: creat d0/d8/d49/d94/fda x:0 0 0 2024-09-17T01:01:59.067 INFO:tasks.workunit.client.1.smithi099.stdout:8/555: getdents d0/d4/d64 0 2024-09-17T01:01:59.069 INFO:tasks.workunit.client.0.smithi002.stdout:8/654: dread d2/d26/f61 [0,4194304] 0 2024-09-17T01:01:59.069 INFO:tasks.workunit.client.1.smithi099.stdout:5/593: getdents d2/dc/d6c 0 2024-09-17T01:01:59.070 INFO:tasks.workunit.client.0.smithi002.stdout:8/655: unlink d2/d3/d5f/d98/da5/d71/d89/c9b 0 2024-09-17T01:01:59.071 INFO:tasks.workunit.client.0.smithi002.stdout:8/656: creat d2/d1c/dd4/fdf x:0 0 0 2024-09-17T01:01:59.071 INFO:tasks.workunit.client.1.smithi099.stdout:1/624: symlink d0/d2/dd8/ldb 0 2024-09-17T01:01:59.072 INFO:tasks.workunit.client.0.smithi002.stdout:0/394: dread dd/f14 [0,4194304] 0 2024-09-17T01:01:59.073 INFO:tasks.workunit.client.1.smithi099.stdout:5/594: creat d2/dc/d17/d3c/da8/fbb x:0 0 0 2024-09-17T01:01:59.075 INFO:tasks.workunit.client.1.smithi099.stdout:0/534: dread da/df/f28 [0,4194304] 0 2024-09-17T01:01:59.075 INFO:tasks.workunit.client.1.smithi099.stdout:0/535: write da/d12/d22/f9a [1920902,68884] 0 2024-09-17T01:01:59.077 INFO:tasks.workunit.client.1.smithi099.stdout:1/625: unlink d0/d2/de/d8b/da7/c80 0 2024-09-17T01:01:59.077 INFO:tasks.workunit.client.1.smithi099.stdout:2/481: sync 2024-09-17T01:01:59.077 INFO:tasks.workunit.client.1.smithi099.stdout:5/595: mknod d2/d8/cbc 0 2024-09-17T01:01:59.077 INFO:tasks.workunit.client.0.smithi002.stdout:6/565: dread d2/dc/d24/d53/d83/da9/d4c/f62 [0,4194304] 0 2024-09-17T01:01:59.077 INFO:tasks.workunit.client.0.smithi002.stdout:6/566: stat d2/d1d/d27/d30/l44 0 2024-09-17T01:01:59.082 INFO:tasks.workunit.client.1.smithi099.stdout:0/536: creat da/fae x:0 0 0 2024-09-17T01:01:59.082 INFO:tasks.workunit.client.1.smithi099.stdout:0/537: truncate da/df/d31/f34 921571 0 2024-09-17T01:01:59.083 INFO:tasks.workunit.client.0.smithi002.stdout:0/395: dread dd/d19/f3b [0,4194304] 0 2024-09-17T01:01:59.083 INFO:tasks.workunit.client.0.smithi002.stdout:0/396: chown dd/d19/d1a/d29/d55 18274 1 2024-09-17T01:01:59.083 INFO:tasks.workunit.client.0.smithi002.stdout:0/397: chown dd/d19/d1a/d29/c46 20798047 1 2024-09-17T01:01:59.083 INFO:tasks.workunit.client.0.smithi002.stdout:0/398: write dd/d19/d1c/d1f/d76/f7c [551457,114392] 0 2024-09-17T01:01:59.083 INFO:tasks.workunit.client.0.smithi002.stdout:0/399: stat dd/d44/f6e 0 2024-09-17T01:01:59.083 INFO:tasks.workunit.client.0.smithi002.stdout:0/400: stat dd/d19/d1a/d29/c63 0 2024-09-17T01:01:59.084 INFO:tasks.workunit.client.1.smithi099.stdout:9/554: write da/d18/d49/f63 [3907561,35959] 0 2024-09-17T01:01:59.084 INFO:tasks.workunit.client.1.smithi099.stdout:9/555: creat da/d18/d5e/fb6 x:0 0 0 2024-09-17T01:01:59.084 INFO:tasks.workunit.client.1.smithi099.stdout:8/556: dread d0/d1f/f20 [0,4194304] 0 2024-09-17T01:01:59.084 INFO:tasks.workunit.client.1.smithi099.stdout:1/626: write d0/d8/d38/d75/f9b [96599,50377] 0 2024-09-17T01:01:59.084 INFO:tasks.workunit.client.1.smithi099.stdout:2/482: creat d2/d9/d25/d26/d1b/d2c/d5d/f94 x:0 0 0 2024-09-17T01:01:59.084 INFO:tasks.workunit.client.1.smithi099.stdout:2/483: write d2/d9/d25/d26/d1b/f74 [254223,20345] 0 2024-09-17T01:01:59.085 INFO:tasks.workunit.client.1.smithi099.stdout:2/484: truncate d2/d9/d25/d26/f20 3040044 0 2024-09-17T01:01:59.085 INFO:tasks.workunit.client.0.smithi002.stdout:0/401: mkdir dd/d44/d84 0 2024-09-17T01:01:59.086 INFO:tasks.workunit.client.1.smithi099.stdout:5/596: creat d2/dc/d17/d3c/db3/fbd x:0 0 0 2024-09-17T01:01:59.086 INFO:tasks.workunit.client.1.smithi099.stdout:5/597: chown d2/l2c 14668778 1 2024-09-17T01:01:59.086 INFO:tasks.workunit.client.1.smithi099.stdout:5/598: write d2/dc/d17/d3c/da8/fbb [333219,109873] 0 2024-09-17T01:01:59.086 INFO:tasks.workunit.client.0.smithi002.stdout:8/657: write d2/d3/d5f/d98/da5/d4f/d58/f60 [4088273,96241] 0 2024-09-17T01:01:59.086 INFO:tasks.workunit.client.0.smithi002.stdout:7/521: dwrite d1/d14/d1d/d28/f79 [0,4194304] 0 2024-09-17T01:01:59.087 INFO:tasks.workunit.client.1.smithi099.stdout:0/538: rmdir da/d12/d22/d66/daa 0 2024-09-17T01:01:59.090 INFO:tasks.workunit.client.0.smithi002.stdout:8/658: getdents d2/d1c/d28/da0 0 2024-09-17T01:01:59.091 INFO:tasks.workunit.client.1.smithi099.stdout:9/556: rename da/d18/d49/f98 to da/d18/d49/fb7 0 2024-09-17T01:01:59.094 INFO:tasks.workunit.client.1.smithi099.stdout:8/557: mkdir d0/d1f/d90/db8 0 2024-09-17T01:01:59.094 INFO:tasks.workunit.client.1.smithi099.stdout:8/558: creat d0/d53/fb9 x:0 0 0 2024-09-17T01:01:59.096 INFO:tasks.workunit.client.0.smithi002.stdout:7/522: dread d1/f26 [0,4194304] 0 2024-09-17T01:01:59.096 INFO:tasks.workunit.client.1.smithi099.stdout:1/627: mkdir d0/d8/d38/d8a/dd0/ddc 0 2024-09-17T01:01:59.098 INFO:tasks.workunit.client.1.smithi099.stdout:2/485: mkdir d2/d9/d25/d26/d95 0 2024-09-17T01:01:59.098 INFO:tasks.workunit.client.0.smithi002.stdout:7/523: unlink d1/d14/d1d/d28/d6b/d9e/d54/f73 0 2024-09-17T01:01:59.098 INFO:tasks.workunit.client.1.smithi099.stdout:5/599: truncate d2/dc/d6c/fac 568959 0 2024-09-17T01:01:59.101 INFO:tasks.workunit.client.1.smithi099.stdout:8/559: creat d0/d4/fba x:0 0 0 2024-09-17T01:01:59.101 INFO:tasks.workunit.client.1.smithi099.stdout:8/560: readlink d0/d1f/lad 0 2024-09-17T01:01:59.102 INFO:tasks.workunit.client.1.smithi099.stdout:1/628: rmdir d0/d2/d5/dd3 0 2024-09-17T01:01:59.103 INFO:tasks.workunit.client.1.smithi099.stdout:2/486: link d2/d9/d25/d26/d1b/l3b d2/d9/d25/d26/d1b/d61/l96 0 2024-09-17T01:01:59.104 INFO:tasks.workunit.client.1.smithi099.stdout:5/600: link d2/dc/d17/d3c/d60/d90/da4/l78 d2/d8/lbe 0 2024-09-17T01:01:59.104 INFO:tasks.workunit.client.1.smithi099.stdout:5/601: creat d2/dc/d17/d3c/d60/fbf x:0 0 0 2024-09-17T01:01:59.105 INFO:tasks.workunit.client.1.smithi099.stdout:0/539: creat da/df/d1a/d49/d71/faf x:0 0 0 2024-09-17T01:01:59.105 INFO:tasks.workunit.client.1.smithi099.stdout:0/540: chown da/df/d1a/d63/d6a/l79 47242936 1 2024-09-17T01:01:59.106 INFO:tasks.workunit.client.1.smithi099.stdout:1/629: link d0/f40 d0/d2/d61/fdd 0 2024-09-17T01:01:59.106 INFO:tasks.workunit.client.1.smithi099.stdout:1/630: stat d0/d8/d49/d4e/ld5 0 2024-09-17T01:01:59.106 INFO:tasks.workunit.client.1.smithi099.stdout:2/487: mkdir d2/d9/d25/d97 0 2024-09-17T01:01:59.107 INFO:tasks.workunit.client.1.smithi099.stdout:5/602: rmdir d2/dc/d14 39 2024-09-17T01:01:59.109 INFO:tasks.workunit.client.0.smithi002.stdout:6/567: dwrite d2/d1d/d26/d49/d51/f96 [0,4194304] 0 2024-09-17T01:01:59.109 INFO:tasks.workunit.client.0.smithi002.stdout:6/568: creat d2/d1d/d27/d30/fb3 x:0 0 0 2024-09-17T01:01:59.109 INFO:tasks.workunit.client.0.smithi002.stdout:6/569: chown d2/d1d/d26/cae 27836424 1 2024-09-17T01:01:59.110 INFO:tasks.workunit.client.1.smithi099.stdout:1/631: symlink d0/d2/d61/dd6/lde 0 2024-09-17T01:01:59.110 INFO:tasks.workunit.client.1.smithi099.stdout:2/488: mkdir d2/d9/d25/d26/d1b/d61/d7d/d85/d98 0 2024-09-17T01:01:59.110 INFO:tasks.workunit.client.1.smithi099.stdout:2/489: chown d2/d7/f3a 429583 1 2024-09-17T01:01:59.110 INFO:tasks.workunit.client.1.smithi099.stdout:2/490: creat d2/d9/d17/d83/f99 x:0 0 0 2024-09-17T01:01:59.111 INFO:tasks.workunit.client.1.smithi099.stdout:0/541: rename da/d1c to da/df/d31/db0 0 2024-09-17T01:01:59.112 INFO:tasks.workunit.client.1.smithi099.stdout:5/603: dread d2/d26/d64/f68 [0,4194304] 0 2024-09-17T01:01:59.112 INFO:tasks.workunit.client.1.smithi099.stdout:5/604: chown d2/dc/d17/d3c/d72/f9f 335523837 1 2024-09-17T01:01:59.112 INFO:tasks.workunit.client.1.smithi099.stdout:5/605: readlink d2/dc/la0 0 2024-09-17T01:01:59.113 INFO:tasks.workunit.client.0.smithi002.stdout:6/570: symlink d2/d1d/d27/d30/lb4 0 2024-09-17T01:01:59.113 INFO:tasks.workunit.client.1.smithi099.stdout:1/632: mknod d0/d8/d49/d94/d4b/d59/dc3/cdf 0 2024-09-17T01:01:59.115 INFO:tasks.workunit.client.1.smithi099.stdout:0/542: getdents da/df/d1a/d49/d68 0 2024-09-17T01:01:59.116 INFO:tasks.workunit.client.1.smithi099.stdout:0/543: stat da/d3b/l88 0 2024-09-17T01:01:59.116 INFO:tasks.workunit.client.1.smithi099.stdout:0/544: chown da/d12/f62 983 1 2024-09-17T01:01:59.116 INFO:tasks.workunit.client.1.smithi099.stdout:8/561: write d0/d4/fb [2708802,11194] 0 2024-09-17T01:01:59.121 INFO:tasks.workunit.client.0.smithi002.stdout:6/571: dread d2/f4 [0,4194304] 0 2024-09-17T01:01:59.121 INFO:tasks.workunit.client.0.smithi002.stdout:6/572: rename d2/d1d/d2d/d35 to d2/d1d/d2d/d35/d8d/d43/d5c/db5 22 2024-09-17T01:01:59.121 INFO:tasks.workunit.client.0.smithi002.stdout:6/573: truncate d2/d1d/d26/d49/fa0 139607 0 2024-09-17T01:01:59.122 INFO:tasks.workunit.client.0.smithi002.stdout:6/574: truncate d2/d1d/d27/d30/f78 1915755 0 2024-09-17T01:01:59.123 INFO:tasks.workunit.client.0.smithi002.stdout:2/562: dwrite d1b/d1d/d79/fbe [0,4194304] 0 2024-09-17T01:01:59.123 INFO:tasks.workunit.client.1.smithi099.stdout:6/574: dwrite dc/d1a/f56 [0,4194304] 0 2024-09-17T01:01:59.125 INFO:tasks.workunit.client.0.smithi002.stdout:2/563: link d1b/d37/f49 d1b/d8b/fca 0 2024-09-17T01:01:59.126 INFO:tasks.workunit.client.1.smithi099.stdout:6/575: rename f7 to dc/d5d/d66/d7a/d87/db6/fb7 0 2024-09-17T01:01:59.126 INFO:tasks.workunit.client.0.smithi002.stdout:6/575: rmdir d2/d1d/d99 39 2024-09-17T01:01:59.126 INFO:tasks.workunit.client.0.smithi002.stdout:6/576: dread - d2/d1d/d27/d30/fb3 zero size 2024-09-17T01:01:59.129 INFO:tasks.workunit.client.1.smithi099.stdout:1/633: read d0/f36 [423144,85085] 0 2024-09-17T01:01:59.129 INFO:tasks.workunit.client.1.smithi099.stdout:1/634: chown d0/d2/d18/f28 57133 1 2024-09-17T01:01:59.130 INFO:tasks.workunit.client.0.smithi002.stdout:2/564: unlink d1b/d37/d48/d4e/dc5/cc7 0 2024-09-17T01:01:59.131 INFO:tasks.workunit.client.0.smithi002.stdout:6/577: creat d2/dc/fb6 x:0 0 0 2024-09-17T01:01:59.132 INFO:tasks.workunit.client.0.smithi002.stdout:6/578: creat d2/d1d/d27/d30/fb7 x:0 0 0 2024-09-17T01:01:59.134 INFO:tasks.workunit.client.0.smithi002.stdout:2/565: rename d1b/d37/d48/d52/fa2 to d1b/d37/d48/d4e/dc5/fcb 0 2024-09-17T01:01:59.136 INFO:tasks.workunit.client.0.smithi002.stdout:0/402: dwrite f1 [0,4194304] 0 2024-09-17T01:01:59.137 INFO:tasks.workunit.client.0.smithi002.stdout:6/579: symlink d2/dc/d24/d53/d83/lb8 0 2024-09-17T01:01:59.138 INFO:tasks.workunit.client.0.smithi002.stdout:7/524: dwrite d1/d14/fa5 [0,4194304] 0 2024-09-17T01:01:59.139 INFO:tasks.workunit.client.0.smithi002.stdout:2/566: symlink d1b/d3f/lcc 0 2024-09-17T01:01:59.140 INFO:tasks.workunit.client.0.smithi002.stdout:2/567: write d1b/d8b/fa8 [47199,104601] 0 2024-09-17T01:01:59.141 INFO:tasks.workunit.client.1.smithi099.stdout:2/491: dwrite d2/d9/d25/d26/f88 [0,4194304] 0 2024-09-17T01:01:59.141 INFO:tasks.workunit.client.1.smithi099.stdout:5/606: dwrite d2/fa2 [0,4194304] 0 2024-09-17T01:01:59.141 INFO:tasks.workunit.client.1.smithi099.stdout:5/607: chown d2/dc/d17/d6b/l8b 117481 1 2024-09-17T01:01:59.145 INFO:tasks.workunit.client.1.smithi099.stdout:2/492: rmdir d2/d9/d17/d58 39 2024-09-17T01:01:59.145 INFO:tasks.workunit.client.1.smithi099.stdout:2/493: dread - d2/d9/d17/d58/f8e zero size 2024-09-17T01:01:59.145 INFO:tasks.workunit.client.1.smithi099.stdout:2/494: dread - d2/d9/d17/f63 zero size 2024-09-17T01:01:59.145 INFO:tasks.workunit.client.1.smithi099.stdout:2/495: readlink d2/l81 0 2024-09-17T01:01:59.145 INFO:tasks.workunit.client.1.smithi099.stdout:2/496: fsync d2/d7/f3a 0 2024-09-17T01:01:59.146 INFO:tasks.workunit.client.0.smithi002.stdout:6/580: mkdir d2/d1d/d99/db9 0 2024-09-17T01:01:59.146 INFO:tasks.workunit.client.0.smithi002.stdout:0/403: write dd/d19/d1c/d1f/d22/f6b [1409108,54966] 0 2024-09-17T01:01:59.147 INFO:tasks.workunit.client.1.smithi099.stdout:5/608: creat d2/dc/d14/d36/fc0 x:0 0 0 2024-09-17T01:01:59.147 INFO:tasks.workunit.client.1.smithi099.stdout:5/609: fsync d2/fa2 0 2024-09-17T01:01:59.147 INFO:tasks.workunit.client.1.smithi099.stdout:5/610: creat d2/d8/fc1 x:0 0 0 2024-09-17T01:01:59.148 INFO:tasks.workunit.client.1.smithi099.stdout:2/497: mkdir d2/d9/d25/d26/d1b/d61/d7d/d85/d98/d9a 0 2024-09-17T01:01:59.149 INFO:tasks.workunit.client.1.smithi099.stdout:2/498: chown d2/d9/d25/d26/d1b/c44 64937441 1 2024-09-17T01:01:59.151 INFO:tasks.workunit.client.0.smithi002.stdout:7/525: mknod d1/d14/d1d/d28/d6b/d9e/d5e/ca6 0 2024-09-17T01:01:59.151 INFO:tasks.workunit.client.0.smithi002.stdout:7/526: truncate d1/d14/d1d/d28/d40/d58/f7e 191757 0 2024-09-17T01:01:59.151 INFO:tasks.workunit.client.1.smithi099.stdout:9/557: rmdir da/d18/d5e 39 2024-09-17T01:01:59.153 INFO:tasks.workunit.client.0.smithi002.stdout:2/568: creat d1b/d1d/dc8/fcd x:0 0 0 2024-09-17T01:01:59.153 INFO:tasks.workunit.client.0.smithi002.stdout:2/569: fdatasync d1b/f5f 0 2024-09-17T01:01:59.153 INFO:tasks.workunit.client.0.smithi002.stdout:2/570: fsync ff 0 2024-09-17T01:01:59.156 INFO:tasks.workunit.client.1.smithi099.stdout:9/558: mkdir da/d8e/db8 0 2024-09-17T01:01:59.156 INFO:tasks.workunit.client.1.smithi099.stdout:9/559: chown da/d14/f77 188222720 1 2024-09-17T01:01:59.156 INFO:tasks.workunit.client.0.smithi002.stdout:6/581: rename d2/d1d/d99/f9d to d2/d1d/d2d/d35/d79/fba 0 2024-09-17T01:01:59.156 INFO:tasks.workunit.client.0.smithi002.stdout:6/582: creat d2/d1d/d2d/d5a/d71/d7e/fbb x:0 0 0 2024-09-17T01:01:59.156 INFO:tasks.workunit.client.0.smithi002.stdout:6/583: creat d2/d1d/d2d/d35/d6d/fbc x:0 0 0 2024-09-17T01:01:59.157 INFO:tasks.workunit.client.0.smithi002.stdout:7/527: symlink d1/d14/d1d/d28/la7 0 2024-09-17T01:01:59.157 INFO:tasks.workunit.client.0.smithi002.stdout:7/528: stat d1/d14/d1d/d29/f2f 0 2024-09-17T01:01:59.158 INFO:tasks.workunit.client.0.smithi002.stdout:2/571: mknod d1b/d1d/dc8/cce 0 2024-09-17T01:01:59.159 INFO:tasks.workunit.client.0.smithi002.stdout:6/584: write d2/f4 [2311950,102546] 0 2024-09-17T01:01:59.159 INFO:tasks.workunit.client.0.smithi002.stdout:6/585: chown d2/d1d/f57 91844 1 2024-09-17T01:01:59.160 INFO:tasks.workunit.client.0.smithi002.stdout:7/529: mknod d1/d14/d1d/d29/ca8 0 2024-09-17T01:01:59.162 INFO:tasks.workunit.client.1.smithi099.stdout:2/499: dread f0 [0,4194304] 0 2024-09-17T01:01:59.164 INFO:tasks.workunit.client.0.smithi002.stdout:6/586: link d2/d1d/d2d/d5a/d71/d7e/f86 d2/dc/d34/d5f/fbd 0 2024-09-17T01:01:59.164 INFO:tasks.workunit.client.0.smithi002.stdout:6/587: chown d2/dc/d24/c17 15551416 1 2024-09-17T01:01:59.164 INFO:tasks.workunit.client.0.smithi002.stdout:6/588: write d2/d1d/d26/d49/d7d/d8c/faf [790715,15289] 0 2024-09-17T01:01:59.165 INFO:tasks.workunit.client.0.smithi002.stdout:2/572: symlink d1b/d1d/lcf 0 2024-09-17T01:01:59.165 INFO:tasks.workunit.client.0.smithi002.stdout:2/573: write d1b/d37/f49 [1427996,59877] 0 2024-09-17T01:01:59.165 INFO:tasks.workunit.client.0.smithi002.stdout:2/574: creat d1b/d74/d93/fd0 x:0 0 0 2024-09-17T01:01:59.165 INFO:tasks.workunit.client.1.smithi099.stdout:9/560: truncate da/d18/d5e/f67 70222 0 2024-09-17T01:01:59.166 INFO:tasks.workunit.client.1.smithi099.stdout:2/500: mkdir d2/d9/d25/d26/d1b/d2c/d9b 0 2024-09-17T01:01:59.167 INFO:tasks.workunit.client.1.smithi099.stdout:1/635: dwrite d0/d2/d61/fb0 [0,4194304] 0 2024-09-17T01:01:59.167 INFO:tasks.workunit.client.1.smithi099.stdout:1/636: truncate d0/d8/d49/d94/d4b/d59/db9/dc8/fcd 1532390 0 2024-09-17T01:01:59.171 INFO:tasks.workunit.client.1.smithi099.stdout:9/561: dread da/ff [0,4194304] 0 2024-09-17T01:01:59.172 INFO:tasks.workunit.client.1.smithi099.stdout:8/562: dwrite d0/d4/f49 [0,4194304] 0 2024-09-17T01:01:59.172 INFO:tasks.workunit.client.1.smithi099.stdout:6/576: dwrite dc/f18 [0,4194304] 0 2024-09-17T01:01:59.172 INFO:tasks.workunit.client.1.smithi099.stdout:6/577: creat dc/d1a/d49/fb8 x:0 0 0 2024-09-17T01:01:59.172 INFO:tasks.workunit.client.1.smithi099.stdout:6/578: stat dc/l43 0 2024-09-17T01:01:59.172 INFO:tasks.workunit.client.1.smithi099.stdout:2/501: truncate d2/d9/d25/d26/d1b/d2c/d3f/f54 2951063 0 2024-09-17T01:01:59.172 INFO:tasks.workunit.client.1.smithi099.stdout:0/545: dwrite da/df/d1a/d49/dac/f50 [0,4194304] 0 2024-09-17T01:01:59.174 INFO:tasks.workunit.client.0.smithi002.stdout:7/530: dwrite d1/d14/d1d/d28/d40/f7b [0,4194304] 0 2024-09-17T01:01:59.174 INFO:tasks.workunit.client.0.smithi002.stdout:0/404: dwrite dd/f57 [0,4194304] 0 2024-09-17T01:01:59.176 INFO:tasks.workunit.client.1.smithi099.stdout:1/637: rename d0/d2/d5 to d0/d8/d49/d94/de0 0 2024-09-17T01:01:59.176 INFO:tasks.workunit.client.1.smithi099.stdout:9/562: mkdir da/d56/d84/db9 0 2024-09-17T01:01:59.179 INFO:tasks.workunit.client.1.smithi099.stdout:8/563: mknod d0/d1f/cbb 0 2024-09-17T01:01:59.180 INFO:tasks.workunit.client.1.smithi099.stdout:8/564: dread d0/d1f/d31/f43 [0,4194304] 0 2024-09-17T01:01:59.182 INFO:tasks.workunit.client.1.smithi099.stdout:6/579: getdents dc/d5d/dae/d96/d60 0 2024-09-17T01:01:59.182 INFO:tasks.workunit.client.0.smithi002.stdout:6/589: write d2/dc/d34/d5f/fbd [3614787,128150] 0 2024-09-17T01:01:59.183 INFO:tasks.workunit.client.1.smithi099.stdout:5/611: rmdir d2/dc 39 2024-09-17T01:01:59.183 INFO:tasks.workunit.client.1.smithi099.stdout:5/612: readlink d2/dc/d17/d3c/d81/l85 0 2024-09-17T01:01:59.186 INFO:tasks.workunit.client.1.smithi099.stdout:2/502: creat d2/d9/d25/d26/d1b/d2c/f9c x:0 0 0 2024-09-17T01:01:59.187 INFO:tasks.workunit.client.0.smithi002.stdout:7/531: dread d1/d14/d1d/d28/d40/f5f [0,4194304] 0 2024-09-17T01:01:59.187 INFO:tasks.workunit.client.0.smithi002.stdout:7/532: chown d1/d14/d1d/d28/d6b/d9e/d54/c8e 0 1 2024-09-17T01:01:59.191 INFO:tasks.workunit.client.0.smithi002.stdout:6/590: truncate d2/d1d/d27/d30/f36 1528413 0 2024-09-17T01:01:59.192 INFO:tasks.workunit.client.1.smithi099.stdout:1/638: creat d0/d2/fe1 x:0 0 0 2024-09-17T01:01:59.192 INFO:tasks.workunit.client.0.smithi002.stdout:7/533: creat d1/d14/d1d/d21/d45/fa9 x:0 0 0 2024-09-17T01:01:59.192 INFO:tasks.workunit.client.0.smithi002.stdout:7/534: chown d1/d14/f3f 3 1 2024-09-17T01:01:59.193 INFO:tasks.workunit.client.0.smithi002.stdout:6/591: mknod d2/cbe 0 2024-09-17T01:01:59.193 INFO:tasks.workunit.client.1.smithi099.stdout:9/563: truncate da/d18/d49/f63 1180972 0 2024-09-17T01:01:59.194 INFO:tasks.workunit.client.0.smithi002.stdout:7/535: symlink d1/d14/d1d/d28/d6b/d9e/d54/laa 0 2024-09-17T01:01:59.194 INFO:tasks.workunit.client.0.smithi002.stdout:7/536: fdatasync d1/d14/f15 0 2024-09-17T01:01:59.196 INFO:tasks.workunit.client.0.smithi002.stdout:7/537: creat d1/d14/d1d/d28/d40/d58/fab x:0 0 0 2024-09-17T01:01:59.196 INFO:tasks.workunit.client.1.smithi099.stdout:6/580: rename dc/d5d/dae/d96/f99 to dc/d5d/d66/d7a/d87/fb9 0 2024-09-17T01:01:59.197 INFO:tasks.workunit.client.0.smithi002.stdout:9/486: sync 2024-09-17T01:01:59.197 INFO:tasks.workunit.client.0.smithi002.stdout:9/487: stat d5/dc/f68 0 2024-09-17T01:01:59.199 INFO:tasks.workunit.client.0.smithi002.stdout:2/575: dwrite d1b/d3f/d59/f63 [4194304,4194304] 0 2024-09-17T01:01:59.199 INFO:tasks.workunit.client.0.smithi002.stdout:7/538: unlink d1/d14/d1d/d28/d40/d58/l5a 0 2024-09-17T01:01:59.199 INFO:tasks.workunit.client.0.smithi002.stdout:7/539: stat d1/d14/d1d/d28/d6b/d9e/l37 0 2024-09-17T01:01:59.200 INFO:tasks.workunit.client.0.smithi002.stdout:0/405: dwrite dd/f40 [0,4194304] 0 2024-09-17T01:01:59.202 INFO:tasks.workunit.client.1.smithi099.stdout:1/639: mkdir d0/de2 0 2024-09-17T01:01:59.202 INFO:tasks.workunit.client.1.smithi099.stdout:9/564: mknod da/d21/d5b/cba 0 2024-09-17T01:01:59.203 INFO:tasks.workunit.client.0.smithi002.stdout:7/540: rename d1/d14/d1d/d29/d4b to d1/dac 0 2024-09-17T01:01:59.203 INFO:tasks.workunit.client.1.smithi099.stdout:2/503: write d2/d9/d25/d26/f88 [2180673,4304] 0 2024-09-17T01:01:59.204 INFO:tasks.workunit.client.0.smithi002.stdout:7/541: read d1/d14/d1d/d28/f6e [35946,36821] 0 2024-09-17T01:01:59.204 INFO:tasks.workunit.client.1.smithi099.stdout:8/565: mkdir d0/d4/dbc 0 2024-09-17T01:01:59.204 INFO:tasks.workunit.client.1.smithi099.stdout:8/566: truncate d0/d1f/fb4 215651 0 2024-09-17T01:01:59.204 INFO:tasks.workunit.client.1.smithi099.stdout:8/567: write d0/d4/f3c [582520,106543] 0 2024-09-17T01:01:59.204 INFO:tasks.workunit.client.1.smithi099.stdout:8/568: read d0/d4/d29/f2e [3819137,28039] 0 2024-09-17T01:01:59.206 INFO:tasks.workunit.client.1.smithi099.stdout:1/640: rename d0/d2/d61/c68 to d0/d8/d49/d94/d4b/d59/db9/dc8/ce3 0 2024-09-17T01:01:59.206 INFO:tasks.workunit.client.1.smithi099.stdout:1/641: fdatasync d0/d8/d49/f82 0 2024-09-17T01:01:59.206 INFO:tasks.workunit.client.1.smithi099.stdout:1/642: stat d0/d2/la5 0 2024-09-17T01:01:59.206 INFO:tasks.workunit.client.1.smithi099.stdout:9/565: truncate da/d50/f5c 4036967 0 2024-09-17T01:01:59.207 INFO:tasks.workunit.client.1.smithi099.stdout:9/566: readlink da/d14/l1e 0 2024-09-17T01:01:59.207 INFO:tasks.workunit.client.1.smithi099.stdout:9/567: write f6 [3017004,53857] 0 2024-09-17T01:01:59.207 INFO:tasks.workunit.client.1.smithi099.stdout:9/568: truncate da/d14/d6d/f87 1338750 0 2024-09-17T01:01:59.207 INFO:tasks.workunit.client.0.smithi002.stdout:0/406: read dd/d19/f1b [1088115,2443] 0 2024-09-17T01:01:59.208 INFO:tasks.workunit.client.1.smithi099.stdout:2/504: mknod d2/d9/d25/d26/d1b/d61/d7d/d85/d98/d9a/c9d 0 2024-09-17T01:01:59.208 INFO:tasks.workunit.client.0.smithi002.stdout:7/542: rmdir d1/d14/d1d/d28/d6b/d9e 39 2024-09-17T01:01:59.208 INFO:tasks.workunit.client.1.smithi099.stdout:1/643: unlink d0/d2/d61/fb0 0 2024-09-17T01:01:59.209 INFO:tasks.workunit.client.0.smithi002.stdout:9/488: dread d5/dc/d26/f7e [0,4194304] 0 2024-09-17T01:01:59.210 INFO:tasks.workunit.client.0.smithi002.stdout:7/543: unlink d1/d14/d1d/d28/d40/d58/f8c 0 2024-09-17T01:01:59.212 INFO:tasks.workunit.client.1.smithi099.stdout:0/546: dwrite da/d12/d2b/f37 [0,4194304] 0 2024-09-17T01:01:59.212 INFO:tasks.workunit.client.1.smithi099.stdout:6/581: dread dc/d27/d58/f8a [0,4194304] 0 2024-09-17T01:01:59.214 INFO:tasks.workunit.client.0.smithi002.stdout:7/544: rmdir d1/d14/d1d/d28/d2d 39 2024-09-17T01:01:59.215 INFO:tasks.workunit.client.1.smithi099.stdout:1/644: symlink d0/d8/d49/d94/d4b/d59/db9/dc8/le4 0 2024-09-17T01:01:59.215 INFO:tasks.workunit.client.1.smithi099.stdout:1/645: readlink d0/d8/d49/d94/l77 0 2024-09-17T01:01:59.217 INFO:tasks.workunit.client.1.smithi099.stdout:5/613: dwrite d2/d8/f77 [0,4194304] 0 2024-09-17T01:01:59.218 INFO:tasks.workunit.client.1.smithi099.stdout:5/614: write d2/dc/d17/d3c/d60/d90/da4/f3f [489190,53423] 0 2024-09-17T01:01:59.218 INFO:tasks.workunit.client.1.smithi099.stdout:5/615: chown d2/d8 1611 1 2024-09-17T01:01:59.218 INFO:tasks.workunit.client.1.smithi099.stdout:6/582: write dc/d5d/dae/d96/f47 [172615,62157] 0 2024-09-17T01:01:59.219 INFO:tasks.workunit.client.0.smithi002.stdout:5/495: sync 2024-09-17T01:01:59.219 INFO:tasks.workunit.client.0.smithi002.stdout:3/552: sync 2024-09-17T01:01:59.219 INFO:tasks.workunit.client.0.smithi002.stdout:4/639: sync 2024-09-17T01:01:59.219 INFO:tasks.workunit.client.0.smithi002.stdout:5/496: chown d2/f3a 106888804 1 2024-09-17T01:01:59.219 INFO:tasks.workunit.client.0.smithi002.stdout:1/529: sync 2024-09-17T01:01:59.223 INFO:tasks.workunit.client.1.smithi099.stdout:5/616: rmdir d2/dc/d17/d3c/d60/d90/da4/d9c 39 2024-09-17T01:01:59.224 INFO:tasks.workunit.client.0.smithi002.stdout:0/407: write dd/d3d/f3f [4836700,11499] 0 2024-09-17T01:01:59.224 INFO:tasks.workunit.client.0.smithi002.stdout:0/408: write dd/d19/d1a/d29/d55/f5b [645585,12055] 0 2024-09-17T01:01:59.224 INFO:tasks.workunit.client.0.smithi002.stdout:0/409: creat dd/d3d/f85 x:0 0 0 2024-09-17T01:01:59.224 INFO:tasks.workunit.client.0.smithi002.stdout:5/497: mkdir d2/d2d/d10/d14/d19/d39/d48/d9d 0 2024-09-17T01:01:59.225 INFO:tasks.workunit.client.1.smithi099.stdout:5/617: mkdir d2/dc/d17/d3c/d60/dad/dc2 0 2024-09-17T01:01:59.225 INFO:tasks.workunit.client.1.smithi099.stdout:5/618: getdents d2/dc/d14/d36/d9a/daa 0 2024-09-17T01:01:59.225 INFO:tasks.workunit.client.0.smithi002.stdout:0/410: write dd/f15 [4765134,128674] 0 2024-09-17T01:01:59.226 INFO:tasks.workunit.client.1.smithi099.stdout:5/619: mkdir d2/dc/d14/d89/db1/dc3 0 2024-09-17T01:01:59.227 INFO:tasks.workunit.client.0.smithi002.stdout:5/498: unlink d2/f6 0 2024-09-17T01:01:59.227 INFO:tasks.workunit.client.0.smithi002.stdout:5/499: chown d2/d2d/d10/d14/d19/d39/d43 31742227 1 2024-09-17T01:01:59.228 INFO:tasks.workunit.client.0.smithi002.stdout:5/500: symlink d2/d2d/d10/d23/l9e 0 2024-09-17T01:01:59.231 INFO:tasks.workunit.client.0.smithi002.stdout:7/545: write d1/d14/d1d/d28/d6b/f83 [3474562,60052] 0 2024-09-17T01:01:59.231 INFO:tasks.workunit.client.0.smithi002.stdout:1/530: dread d4/d11/d12/f7b [0,4194304] 0 2024-09-17T01:01:59.236 INFO:tasks.workunit.client.0.smithi002.stdout:1/531: symlink d4/d11/d12/d14/d17/d51/d88/lb7 0 2024-09-17T01:01:59.236 INFO:tasks.workunit.client.0.smithi002.stdout:1/532: truncate d4/d11/d12/d23/f99 783223 0 2024-09-17T01:01:59.236 INFO:tasks.workunit.client.0.smithi002.stdout:1/533: write d4/d11/d12/d30/d43/d67/f98 [1285065,45644] 0 2024-09-17T01:01:59.236 INFO:tasks.workunit.client.0.smithi002.stdout:1/534: chown d4/d11/d12/d14/d17/d20/f50 52167260 1 2024-09-17T01:01:59.236 INFO:tasks.workunit.client.0.smithi002.stdout:1/535: fsync d4/d11/d12/d14/d17/d56/f6f 0 2024-09-17T01:01:59.237 INFO:tasks.workunit.client.0.smithi002.stdout:1/536: symlink d4/d11/d1a/daa/lb8 0 2024-09-17T01:01:59.237 INFO:tasks.workunit.client.0.smithi002.stdout:0/411: write dd/d19/d1a/f4a [9119,23171] 0 2024-09-17T01:01:59.237 INFO:tasks.workunit.client.0.smithi002.stdout:1/537: chown d4/d11/d12/d14/d17/d3b/f42 85716 1 2024-09-17T01:01:59.237 INFO:tasks.workunit.client.0.smithi002.stdout:7/546: dread d1/d14/d1d/d28/f6e [0,4194304] 0 2024-09-17T01:01:59.238 INFO:tasks.workunit.client.0.smithi002.stdout:1/538: read d4/d11/d12/f4c [78547,82972] 0 2024-09-17T01:01:59.243 INFO:tasks.workunit.client.0.smithi002.stdout:7/547: dread d1/d14/d1d/d29/f2f [0,4194304] 0 2024-09-17T01:01:59.243 INFO:tasks.workunit.client.0.smithi002.stdout:1/539: read d4/d11/d12/f7b [1479822,15584] 0 2024-09-17T01:01:59.248 INFO:tasks.workunit.client.1.smithi099.stdout:2/505: dwrite d2/d9/d17/f69 [0,4194304] 0 2024-09-17T01:01:59.249 INFO:tasks.workunit.client.1.smithi099.stdout:0/547: dwrite da/d12/f5a [0,4194304] 0 2024-09-17T01:01:59.250 INFO:tasks.workunit.client.1.smithi099.stdout:0/548: symlink da/d12/lb1 0 2024-09-17T01:01:59.251 INFO:tasks.workunit.client.1.smithi099.stdout:0/549: mknod da/df/d1a/d56/d72/cb2 0 2024-09-17T01:01:59.263 INFO:tasks.workunit.client.1.smithi099.stdout:0/550: write da/d3b/f5b [1649647,22908] 0 2024-09-17T01:01:59.266 INFO:tasks.workunit.client.0.smithi002.stdout:4/640: dwrite d7/d19/d9f/f58 [0,4194304] 0 2024-09-17T01:01:59.270 INFO:tasks.workunit.client.0.smithi002.stdout:3/553: dwrite d0/d3/f3c [0,4194304] 0 2024-09-17T01:01:59.272 INFO:tasks.workunit.client.0.smithi002.stdout:0/412: fsync dd/f18 0 2024-09-17T01:01:59.272 INFO:tasks.workunit.client.0.smithi002.stdout:4/641: rmdir d7/d19 39 2024-09-17T01:01:59.272 INFO:tasks.workunit.client.0.smithi002.stdout:4/642: chown d7/d19/d9f/d9d 387176719 1 2024-09-17T01:01:59.272 INFO:tasks.workunit.client.0.smithi002.stdout:0/413: creat dd/d19/d1c/d1f/d76/f86 x:0 0 0 2024-09-17T01:01:59.273 INFO:tasks.workunit.client.1.smithi099.stdout:1/646: dread d0/d2/de/f15 [0,4194304] 0 2024-09-17T01:01:59.277 INFO:tasks.workunit.client.0.smithi002.stdout:8/659: sync 2024-09-17T01:01:59.278 INFO:tasks.workunit.client.1.smithi099.stdout:0/551: dread da/f1b [0,4194304] 0 2024-09-17T01:01:59.278 INFO:tasks.workunit.client.1.smithi099.stdout:0/552: truncate da/df/d31/db0/d1e/f9d 212988 0 2024-09-17T01:01:59.278 INFO:tasks.workunit.client.1.smithi099.stdout:0/553: chown da/d12/d22 28979 1 2024-09-17T01:01:59.278 INFO:tasks.workunit.client.1.smithi099.stdout:0/554: write da/df/f94 [378876,32125] 0 2024-09-17T01:01:59.279 INFO:tasks.workunit.client.1.smithi099.stdout:5/620: rename d2/dc/d17/d3c/d60 to d2/dc4 0 2024-09-17T01:01:59.280 INFO:tasks.workunit.client.1.smithi099.stdout:1/647: dread d0/d8/d38/d56/f63 [0,4194304] 0 2024-09-17T01:01:59.281 INFO:tasks.workunit.client.1.smithi099.stdout:0/555: mknod da/df/d1a/d63/d6a/cb3 0 2024-09-17T01:01:59.282 INFO:tasks.workunit.client.1.smithi099.stdout:5/621: mkdir d2/d45/dc5 0 2024-09-17T01:01:59.282 INFO:tasks.workunit.client.0.smithi002.stdout:4/643: symlink d7/d19/d2e/dc0/lc5 0 2024-09-17T01:01:59.284 INFO:tasks.workunit.client.0.smithi002.stdout:8/660: symlink d2/d3/d5f/d98/da5/d4f/d77/dd9/le0 0 2024-09-17T01:01:59.284 INFO:tasks.workunit.client.1.smithi099.stdout:1/648: creat d0/d2/de/d8b/da7/fe5 x:0 0 0 2024-09-17T01:01:59.284 INFO:tasks.workunit.client.0.smithi002.stdout:0/414: write dd/f40 [3234296,9233] 0 2024-09-17T01:01:59.284 INFO:tasks.workunit.client.0.smithi002.stdout:0/415: chown dd/d19/d1c/l62 9519 1 2024-09-17T01:01:59.285 INFO:tasks.workunit.client.0.smithi002.stdout:2/576: dwrite d1b/d37/d48/d52/f9a [0,4194304] 0 2024-09-17T01:01:59.285 INFO:tasks.workunit.client.0.smithi002.stdout:2/577: write d1b/d8a/d92/f96 [762417,6337] 0 2024-09-17T01:01:59.285 INFO:tasks.workunit.client.1.smithi099.stdout:0/556: mknod da/d59/d80/d8c/d97/cb4 0 2024-09-17T01:01:59.287 INFO:tasks.workunit.client.0.smithi002.stdout:8/661: link d2/d3/d5f/d98/da5/d4f/d58/fbc d2/d3/d5f/d98/da5/d71/d89/fe1 0 2024-09-17T01:01:59.287 INFO:tasks.workunit.client.0.smithi002.stdout:8/662: creat d2/d1c/fe2 x:0 0 0 2024-09-17T01:01:59.287 INFO:tasks.workunit.client.1.smithi099.stdout:2/506: rename d2/d9/d17/d58/l65 to d2/d9/d25/d26/d1b/l9e 0 2024-09-17T01:01:59.289 INFO:tasks.workunit.client.0.smithi002.stdout:0/416: mknod dd/d19/d1a/d29/d55/d61/c87 0 2024-09-17T01:01:59.290 INFO:tasks.workunit.client.0.smithi002.stdout:3/554: dwrite d0/d31/f94 [0,4194304] 0 2024-09-17T01:01:59.290 INFO:tasks.workunit.client.0.smithi002.stdout:2/578: getdents d1b/d3f/d59/d7f/dc9/dac 0 2024-09-17T01:01:59.290 INFO:tasks.workunit.client.0.smithi002.stdout:3/555: dread - d0/d31/d32/f98 zero size 2024-09-17T01:01:59.290 INFO:tasks.workunit.client.1.smithi099.stdout:5/622: write d2/dc4/d90/da4/f75 [219696,16640] 0 2024-09-17T01:01:59.291 INFO:tasks.workunit.client.1.smithi099.stdout:5/623: chown d2/d26/c2e 1534 1 2024-09-17T01:01:59.291 INFO:tasks.workunit.client.1.smithi099.stdout:5/624: chown d2/dc/d17/l61 9264980 1 2024-09-17T01:01:59.291 INFO:tasks.workunit.client.0.smithi002.stdout:0/417: symlink dd/d19/d1c/d1f/l88 0 2024-09-17T01:01:59.292 INFO:tasks.workunit.client.1.smithi099.stdout:5/625: mkdir d2/dc/d17/d3c/dc6 0 2024-09-17T01:01:59.300 INFO:tasks.workunit.client.1.smithi099.stdout:6/583: dwrite dc/fe [0,4194304] 0 2024-09-17T01:01:59.300 INFO:tasks.workunit.client.0.smithi002.stdout:7/548: dwrite d1/d14/d1d/d28/d6b/d9e/f84 [0,4194304] 0 2024-09-17T01:01:59.301 INFO:tasks.workunit.client.0.smithi002.stdout:7/549: read - d1/d14/d1d/d28/d8f/fa2 zero size 2024-09-17T01:01:59.301 INFO:tasks.workunit.client.0.smithi002.stdout:7/550: fdatasync d1/d14/d67/f75 0 2024-09-17T01:01:59.306 INFO:tasks.workunit.client.0.smithi002.stdout:1/540: dwrite d4/d11/d12/d30/d43/f4d [0,4194304] 0 2024-09-17T01:01:59.306 INFO:tasks.workunit.client.0.smithi002.stdout:7/551: dread d1/f26 [0,4194304] 0 2024-09-17T01:01:59.306 INFO:tasks.workunit.client.0.smithi002.stdout:5/501: dwrite d2/de/f34 [0,4194304] 0 2024-09-17T01:01:59.307 INFO:tasks.workunit.client.0.smithi002.stdout:5/502: chown d2/d2d/d10/d20/d24 284 1 2024-09-17T01:01:59.307 INFO:tasks.workunit.client.0.smithi002.stdout:5/503: readlink d2/d2d/d10/d20/l55 0 2024-09-17T01:01:59.315 INFO:tasks.workunit.client.0.smithi002.stdout:6/592: dwrite d2/d1d/d27/d30/f36 [0,4194304] 0 2024-09-17T01:01:59.315 INFO:tasks.workunit.client.0.smithi002.stdout:6/593: dread - d2/d1d/d2d/d35/d6d/fbc zero size 2024-09-17T01:01:59.315 INFO:tasks.workunit.client.0.smithi002.stdout:6/594: dread - d2/d1d/fa3 zero size 2024-09-17T01:01:59.318 INFO:tasks.workunit.client.0.smithi002.stdout:1/541: dread d4/d11/d12/d14/d17/d56/f8e [0,4194304] 0 2024-09-17T01:01:59.324 INFO:tasks.workunit.client.0.smithi002.stdout:7/552: dread d1/d14/d1d/d28/d2d/f35 [0,4194304] 0 2024-09-17T01:01:59.326 INFO:tasks.workunit.client.1.smithi099.stdout:0/557: dwrite f8 [0,4194304] 0 2024-09-17T01:01:59.327 INFO:tasks.workunit.client.0.smithi002.stdout:4/644: dwrite d7/de/d32/f40 [0,4194304] 0 2024-09-17T01:01:59.327 INFO:tasks.workunit.client.1.smithi099.stdout:1/649: dwrite d0/d8/d49/f82 [0,4194304] 0 2024-09-17T01:01:59.327 INFO:tasks.workunit.client.1.smithi099.stdout:1/650: chown d0/d2/d61/l8f 89590 1 2024-09-17T01:01:59.327 INFO:tasks.workunit.client.1.smithi099.stdout:1/651: truncate d0/f67 5072779 0 2024-09-17T01:01:59.328 INFO:tasks.workunit.client.1.smithi099.stdout:2/507: dwrite d2/d9/d25/d26/d1b/d61/f6a [0,4194304] 0 2024-09-17T01:01:59.330 INFO:tasks.workunit.client.1.smithi099.stdout:5/626: dwrite d2/dc/d14/f20 [0,4194304] 0 2024-09-17T01:01:59.334 INFO:tasks.workunit.client.1.smithi099.stdout:2/508: link d2/d9/d25/d26/d1b/d2c/d5d/f94 d2/d9/d17/d83/f9f 0 2024-09-17T01:01:59.334 INFO:tasks.workunit.client.1.smithi099.stdout:2/509: write d2/d9/d25/d26/d1b/d2c/f79 [1003537,61197] 0 2024-09-17T01:01:59.335 INFO:tasks.workunit.client.1.smithi099.stdout:1/652: dread d0/d8/d38/d75/fa9 [0,4194304] 0 2024-09-17T01:01:59.339 INFO:tasks.workunit.client.1.smithi099.stdout:5/627: getdents d2/dc/d14/d89 0 2024-09-17T01:01:59.339 INFO:tasks.workunit.client.1.smithi099.stdout:5/628: write d2/d26/d64/f68 [1059973,55203] 0 2024-09-17T01:01:59.340 INFO:tasks.workunit.client.1.smithi099.stdout:2/510: creat d2/d9/fa0 x:0 0 0 2024-09-17T01:01:59.341 INFO:tasks.workunit.client.1.smithi099.stdout:1/653: mkdir d0/d8/d49/d94/de0/de6 0 2024-09-17T01:01:59.342 INFO:tasks.workunit.client.1.smithi099.stdout:1/654: read d0/d8/f9c [76020,30459] 0 2024-09-17T01:01:59.342 INFO:tasks.workunit.client.1.smithi099.stdout:1/655: fdatasync d0/d8/f65 0 2024-09-17T01:01:59.342 INFO:tasks.workunit.client.1.smithi099.stdout:1/656: chown d0/d8/d38/d56/d93/lb4 31606376 1 2024-09-17T01:01:59.342 INFO:tasks.workunit.client.1.smithi099.stdout:0/558: rename da/d12/d22/d52 to da/d12/d2b/dab/db5 0 2024-09-17T01:01:59.343 INFO:tasks.workunit.client.1.smithi099.stdout:5/629: creat d2/dc/d17/d3c/da8/fc7 x:0 0 0 2024-09-17T01:01:59.343 INFO:tasks.workunit.client.1.smithi099.stdout:5/630: fdatasync d2/dc/d17/f52 0 2024-09-17T01:01:59.343 INFO:tasks.workunit.client.1.smithi099.stdout:3/602: sync 2024-09-17T01:01:59.344 INFO:tasks.workunit.client.1.smithi099.stdout:1/657: creat d0/d8/d49/d94/de0/fe7 x:0 0 0 2024-09-17T01:01:59.344 INFO:tasks.workunit.client.1.smithi099.stdout:1/658: fsync d0/d2/d61/f9f 0 2024-09-17T01:01:59.345 INFO:tasks.workunit.client.1.smithi099.stdout:1/659: write d0/d2/d18/f28 [1854144,11355] 0 2024-09-17T01:01:59.345 INFO:tasks.workunit.client.1.smithi099.stdout:1/660: read d0/d8/d49/f5e [482551,76612] 0 2024-09-17T01:01:59.346 INFO:tasks.workunit.client.1.smithi099.stdout:1/661: fsync d0/d2/fe1 0 2024-09-17T01:01:59.346 INFO:tasks.workunit.client.1.smithi099.stdout:2/511: rename f0 to d2/d9/d25/d97/fa1 0 2024-09-17T01:01:59.346 INFO:tasks.workunit.client.1.smithi099.stdout:7/518: sync 2024-09-17T01:01:59.347 INFO:tasks.workunit.client.1.smithi099.stdout:4/550: sync 2024-09-17T01:01:59.347 INFO:tasks.workunit.client.1.smithi099.stdout:0/559: getdents da/d59/d80 0 2024-09-17T01:01:59.349 INFO:tasks.workunit.client.1.smithi099.stdout:5/631: mkdir d2/dc/d14/d89/db1/dc3/dc8 0 2024-09-17T01:01:59.355 INFO:tasks.workunit.client.1.smithi099.stdout:0/560: mknod da/df/d4d/cb6 0 2024-09-17T01:01:59.355 INFO:tasks.workunit.client.1.smithi099.stdout:0/561: creat da/d12/d22/fb7 x:0 0 0 2024-09-17T01:01:59.356 INFO:tasks.workunit.client.0.smithi002.stdout:2/579: link d1b/d3f/c6c d1b/d3f/d59/cd1 0 2024-09-17T01:01:59.356 INFO:tasks.workunit.client.0.smithi002.stdout:2/580: write d1b/d1d/f1f [870575,78236] 0 2024-09-17T01:01:59.356 INFO:tasks.workunit.client.0.smithi002.stdout:0/418: truncate dd/d19/f4e 502320 0 2024-09-17T01:01:59.357 INFO:tasks.workunit.client.0.smithi002.stdout:0/419: chown dd/d19/d1a/d29/f52 59765 1 2024-09-17T01:01:59.357 INFO:tasks.workunit.client.1.smithi099.stdout:5/632: symlink d2/dc4/d90/da4/lc9 0 2024-09-17T01:01:59.361 INFO:tasks.workunit.client.1.smithi099.stdout:0/562: mknod da/d3b/cb8 0 2024-09-17T01:01:59.361 INFO:tasks.workunit.client.1.smithi099.stdout:5/633: mkdir d2/dc/d17/d3c/dca 0 2024-09-17T01:01:59.362 INFO:tasks.workunit.client.1.smithi099.stdout:1/662: rename d0/d2/d61 to d0/d2/de/d70/de8 0 2024-09-17T01:01:59.364 INFO:tasks.workunit.client.1.smithi099.stdout:0/563: mknod da/df/d1a/d49/dac/cb9 0 2024-09-17T01:01:59.365 INFO:tasks.workunit.client.1.smithi099.stdout:5/634: mknod d2/dc/d17/d3c/db3/ccb 0 2024-09-17T01:01:59.365 INFO:tasks.workunit.client.1.smithi099.stdout:5/635: fdatasync d2/dc4/d90/da4/f21 0 2024-09-17T01:01:59.366 INFO:tasks.workunit.client.0.smithi002.stdout:5/504: unlink d2/d2d/c5c 0 2024-09-17T01:01:59.367 INFO:tasks.workunit.client.1.smithi099.stdout:5/636: creat d2/dc/d6c/fcc x:0 0 0 2024-09-17T01:01:59.368 INFO:tasks.workunit.client.1.smithi099.stdout:5/637: symlink d2/dc/d17/d6b/lcd 0 2024-09-17T01:01:59.368 INFO:tasks.workunit.client.1.smithi099.stdout:5/638: creat d2/dc/d6c/fce x:0 0 0 2024-09-17T01:01:59.368 INFO:tasks.workunit.client.0.smithi002.stdout:6/595: unlink d2/f70 0 2024-09-17T01:01:59.371 INFO:tasks.workunit.client.0.smithi002.stdout:4/645: unlink d7/d19/d9f/d54/fc3 0 2024-09-17T01:01:59.374 INFO:tasks.workunit.client.0.smithi002.stdout:2/581: truncate d1b/d1d/f6e 4221025 0 2024-09-17T01:01:59.374 INFO:tasks.workunit.client.1.smithi099.stdout:1/663: dread d0/d2/de/d70/de8/fdd [0,4194304] 0 2024-09-17T01:01:59.374 INFO:tasks.workunit.client.1.smithi099.stdout:1/664: chown d0/d2/de/f27 94 1 2024-09-17T01:01:59.376 INFO:tasks.workunit.client.0.smithi002.stdout:5/505: unlink d2/d2d/d10/d14/d19/l4e 0 2024-09-17T01:01:59.376 INFO:tasks.workunit.client.0.smithi002.stdout:5/506: stat d2/d2d/d10/d14/d19/l9c 0 2024-09-17T01:01:59.378 INFO:tasks.workunit.client.0.smithi002.stdout:6/596: link d2/d1d/d2d/d35/l6b d2/dc/d24/d53/d83/da9/d4c/lbf 0 2024-09-17T01:01:59.380 INFO:tasks.workunit.client.1.smithi099.stdout:4/551: dwrite d7/dd/d21/f77 [0,4194304] 0 2024-09-17T01:01:59.380 INFO:tasks.workunit.client.1.smithi099.stdout:4/552: read d7/fb [1703572,114597] 0 2024-09-17T01:01:59.381 INFO:tasks.workunit.client.1.smithi099.stdout:4/553: fdatasync d7/dd/f79 0 2024-09-17T01:01:59.381 INFO:tasks.workunit.client.1.smithi099.stdout:4/554: readlink d7/dd/d21/l5a 0 2024-09-17T01:01:59.381 INFO:tasks.workunit.client.1.smithi099.stdout:7/519: dwrite d1/d2c/d7a/f7c [4194304,4194304] 0 2024-09-17T01:01:59.381 INFO:tasks.workunit.client.1.smithi099.stdout:4/555: write d7/dd/d21/d26/d3f/f8f [956722,70503] 0 2024-09-17T01:01:59.381 INFO:tasks.workunit.client.1.smithi099.stdout:4/556: fsync d7/dd/de/d10/f61 0 2024-09-17T01:01:59.381 INFO:tasks.workunit.client.1.smithi099.stdout:4/557: write d7/dd/d21/d7b/d74/f7c [366325,88248] 0 2024-09-17T01:01:59.381 INFO:tasks.workunit.client.1.smithi099.stdout:4/558: write d7/dd/f79 [387649,114519] 0 2024-09-17T01:01:59.381 INFO:tasks.workunit.client.1.smithi099.stdout:4/559: dread - d7/d35/f6e zero size 2024-09-17T01:01:59.381 INFO:tasks.workunit.client.0.smithi002.stdout:7/553: getdents d1/d14/d1d/d28/d40 0 2024-09-17T01:01:59.383 INFO:tasks.workunit.client.0.smithi002.stdout:4/646: mkdir d7/de/dc6 0 2024-09-17T01:01:59.390 INFO:tasks.workunit.client.0.smithi002.stdout:5/507: dread d2/d2d/d10/d14/f8c [0,4194304] 0 2024-09-17T01:01:59.390 INFO:tasks.workunit.client.0.smithi002.stdout:0/420: dwrite dd/d19/d1c/d1f/d76/f80 [0,4194304] 0 2024-09-17T01:01:59.390 INFO:tasks.workunit.client.0.smithi002.stdout:5/508: readlink d2/d2d/d10/d14/d19/d39/d43/l12 0 2024-09-17T01:01:59.390 INFO:tasks.workunit.client.0.smithi002.stdout:0/421: write dd/d19/d1a/d29/f72 [341972,122968] 0 2024-09-17T01:01:59.392 INFO:tasks.workunit.client.0.smithi002.stdout:4/647: rename d7/de/d32/d8a to d7/d19/d9f/d80/d62/d52/dc7 0 2024-09-17T01:01:59.394 INFO:tasks.workunit.client.0.smithi002.stdout:4/648: readlink d7/de/d32/l7f 0 2024-09-17T01:01:59.395 INFO:tasks.workunit.client.0.smithi002.stdout:4/649: write d7/d3f/da9/fbc [100825,67850] 0 2024-09-17T01:01:59.395 INFO:tasks.workunit.client.0.smithi002.stdout:0/422: rename dd/d19/d1c/d1f/d22/l28 to dd/d19/d1c/d78/l89 0 2024-09-17T01:01:59.395 INFO:tasks.workunit.client.0.smithi002.stdout:0/423: fsync dd/d19/d1c/d33/f7b 0 2024-09-17T01:01:59.396 INFO:tasks.workunit.client.0.smithi002.stdout:0/424: write dd/d19/d1a/d29/f72 [1466436,22501] 0 2024-09-17T01:01:59.397 INFO:tasks.workunit.client.0.smithi002.stdout:4/650: rmdir d7/d19/d2e/dab 0 2024-09-17T01:01:59.400 INFO:tasks.workunit.client.1.smithi099.stdout:3/603: dwrite d9/d15/d18/d1a/d23/f33 [0,4194304] 0 2024-09-17T01:01:59.400 INFO:tasks.workunit.client.1.smithi099.stdout:1/665: dread d0/d2/f25 [0,4194304] 0 2024-09-17T01:01:59.400 INFO:tasks.workunit.client.1.smithi099.stdout:1/666: write d0/d8/d49/d94/f6f [86294,16533] 0 2024-09-17T01:01:59.400 INFO:tasks.workunit.client.1.smithi099.stdout:3/604: creat d9/d15/d18/d1a/d23/d5c/d99/fba x:0 0 0 2024-09-17T01:01:59.401 INFO:tasks.workunit.client.0.smithi002.stdout:0/425: write dd/f15 [3276842,115742] 0 2024-09-17T01:01:59.401 INFO:tasks.workunit.client.0.smithi002.stdout:0/426: creat dd/d19/d1c/f8a x:0 0 0 2024-09-17T01:01:59.405 INFO:tasks.workunit.client.1.smithi099.stdout:1/667: symlink d0/d8/d49/d4e/le9 0 2024-09-17T01:01:59.405 INFO:tasks.workunit.client.1.smithi099.stdout:1/668: readlink d0/d8/d49/d94/l77 0 2024-09-17T01:01:59.406 INFO:tasks.workunit.client.1.smithi099.stdout:3/605: getdents d9/d15/d18/d1a/d23/d4c/d64 0 2024-09-17T01:01:59.406 INFO:tasks.workunit.client.1.smithi099.stdout:3/606: write d9/d15/d18/d1a/d23/d5c/d6e/f96 [864049,46200] 0 2024-09-17T01:01:59.407 INFO:tasks.workunit.client.0.smithi002.stdout:5/509: dread d2/d2d/d10/d3b/f5e [0,4194304] 0 2024-09-17T01:01:59.407 INFO:tasks.workunit.client.0.smithi002.stdout:5/510: dread - d2/d2d/d10/d14/f5d zero size 2024-09-17T01:01:59.408 INFO:tasks.workunit.client.0.smithi002.stdout:0/427: dread dd/d44/f6e [0,4194304] 0 2024-09-17T01:01:59.408 INFO:tasks.workunit.client.1.smithi099.stdout:1/669: creat d0/d2/de/d8b/da7/d98/fea x:0 0 0 2024-09-17T01:01:59.408 INFO:tasks.workunit.client.1.smithi099.stdout:1/670: readlink d0/d8/d49/l83 0 2024-09-17T01:01:59.409 INFO:tasks.workunit.client.0.smithi002.stdout:5/511: dread d2/f54 [0,4194304] 0 2024-09-17T01:01:59.410 INFO:tasks.workunit.client.1.smithi099.stdout:1/671: creat d0/d8/d49/d94/d4b/d59/db9/feb x:0 0 0 2024-09-17T01:01:59.417 INFO:tasks.workunit.client.0.smithi002.stdout:5/512: dread d2/d2d/d10/d14/d19/d39/f3c [0,4194304] 0 2024-09-17T01:01:59.422 INFO:tasks.workunit.client.1.smithi099.stdout:5/639: dwrite d2/dc/d17/d3c/fa9 [0,4194304] 0 2024-09-17T01:01:59.424 INFO:tasks.workunit.client.1.smithi099.stdout:5/640: mknod d2/dc4/d90/ccf 0 2024-09-17T01:01:59.427 INFO:tasks.workunit.client.1.smithi099.stdout:7/520: truncate d1/d2c/d7a/f7c 2676886 0 2024-09-17T01:01:59.427 INFO:tasks.workunit.client.1.smithi099.stdout:7/521: readlink d1/d2c/d7a/la1 0 2024-09-17T01:01:59.428 INFO:tasks.workunit.client.1.smithi099.stdout:0/564: dwrite da/fae [0,4194304] 0 2024-09-17T01:01:59.428 INFO:tasks.workunit.client.1.smithi099.stdout:7/522: symlink d1/d37/d78/la3 0 2024-09-17T01:01:59.431 INFO:tasks.workunit.client.1.smithi099.stdout:0/565: rename da/df/d1a/d63/d6a/d7c to da/d12/d2b/dab/dba 0 2024-09-17T01:01:59.431 INFO:tasks.workunit.client.1.smithi099.stdout:0/566: creat da/df/d1a/d49/d71/fbb x:0 0 0 2024-09-17T01:01:59.432 INFO:tasks.workunit.client.1.smithi099.stdout:7/523: creat d1/d36/fa4 x:0 0 0 2024-09-17T01:01:59.432 INFO:tasks.workunit.client.1.smithi099.stdout:7/524: getdents d1/d36/d8d 0 2024-09-17T01:01:59.434 INFO:tasks.workunit.client.1.smithi099.stdout:0/567: link da/df/d31/l44 da/df/d1a/d49/d68/d9f/lbc 0 2024-09-17T01:01:59.435 INFO:tasks.workunit.client.1.smithi099.stdout:7/525: truncate d1/f24 3774265 0 2024-09-17T01:01:59.436 INFO:tasks.workunit.client.1.smithi099.stdout:0/568: truncate da/d12/f5a 1475613 0 2024-09-17T01:01:59.444 INFO:tasks.workunit.client.0.smithi002.stdout:0/428: dread dd/d3d/f3f [0,4194304] 0 2024-09-17T01:01:59.445 INFO:tasks.workunit.client.0.smithi002.stdout:0/429: write dd/d19/d1c/d33/f7b [17061,1123] 0 2024-09-17T01:01:59.445 INFO:tasks.workunit.client.0.smithi002.stdout:0/430: write dd/d19/d1c/f79 [895833,11785] 0 2024-09-17T01:01:59.448 INFO:tasks.workunit.client.0.smithi002.stdout:0/431: symlink dd/d19/d1a/l8b 0 2024-09-17T01:01:59.449 INFO:tasks.workunit.client.0.smithi002.stdout:0/432: chown dd/d19/d1c/d1f 33744 1 2024-09-17T01:01:59.452 INFO:tasks.workunit.client.0.smithi002.stdout:5/513: dread d2/d2d/d10/d14/d19/d39/d25/d32/f40 [0,4194304] 0 2024-09-17T01:01:59.453 INFO:tasks.workunit.client.0.smithi002.stdout:5/514: creat d2/d2d/d10/d20/d24/f9f x:0 0 0 2024-09-17T01:01:59.453 INFO:tasks.workunit.client.0.smithi002.stdout:5/515: write d2/d2d/d10/d14/d19/d39/f52 [649585,43035] 0 2024-09-17T01:01:59.454 INFO:tasks.workunit.client.0.smithi002.stdout:5/516: creat d2/d2d/d10/d9b/fa0 x:0 0 0 2024-09-17T01:01:59.455 INFO:tasks.workunit.client.0.smithi002.stdout:5/517: link d2/d2d/d10/d14/d19/d39/d25/c7f d2/d2d/d10/d14/d19/d39/d25/d32/d33/ca1 0 2024-09-17T01:01:59.455 INFO:tasks.workunit.client.0.smithi002.stdout:5/518: truncate d2/d2d/d10/d20/d24/f9f 247998 0 2024-09-17T01:01:59.455 INFO:tasks.workunit.client.0.smithi002.stdout:5/519: truncate d2/d2d/d10/d14/d19/d39/f3c 9285601 0 2024-09-17T01:01:59.455 INFO:tasks.workunit.client.0.smithi002.stdout:5/520: dread - d2/d2d/d10/d14/d19/d39/d64/f91 zero size 2024-09-17T01:01:59.456 INFO:tasks.workunit.client.0.smithi002.stdout:5/521: unlink d2/d2d/d10/d20/d24/f9f 0 2024-09-17T01:01:59.456 INFO:tasks.workunit.client.0.smithi002.stdout:5/522: dread - d2/de/d1d/f83 zero size 2024-09-17T01:01:59.456 INFO:tasks.workunit.client.0.smithi002.stdout:5/523: creat d2/d2d/d10/d9b/fa2 x:0 0 0 2024-09-17T01:01:59.456 INFO:tasks.workunit.client.0.smithi002.stdout:5/524: getdents d2/de/d57/d80 0 2024-09-17T01:01:59.457 INFO:tasks.workunit.client.0.smithi002.stdout:5/525: chown d2/c5 0 1 2024-09-17T01:01:59.457 INFO:tasks.workunit.client.0.smithi002.stdout:5/526: creat d2/fa3 x:0 0 0 2024-09-17T01:01:59.458 INFO:tasks.workunit.client.0.smithi002.stdout:5/527: creat d2/de/fa4 x:0 0 0 2024-09-17T01:01:59.458 INFO:tasks.workunit.client.0.smithi002.stdout:5/528: write d2/d2d/d10/d9b/fa2 [195915,106456] 0 2024-09-17T01:01:59.463 INFO:tasks.workunit.client.0.smithi002.stdout:0/433: dread f1 [0,4194304] 0 2024-09-17T01:01:59.463 INFO:tasks.workunit.client.0.smithi002.stdout:0/434: fsync dd/d19/d1a/d29/f72 0 2024-09-17T01:01:59.463 INFO:tasks.workunit.client.0.smithi002.stdout:0/435: write dd/d19/d1a/d29/f52 [141355,65075] 0 2024-09-17T01:01:59.463 INFO:tasks.workunit.client.0.smithi002.stdout:0/436: rename dd/d19/d1c to dd/d19/d1c/d33/d67/d8c 22 2024-09-17T01:01:59.464 INFO:tasks.workunit.client.0.smithi002.stdout:0/437: unlink dd/d19/d1c/d1f/d39/l3c 0 2024-09-17T01:01:59.470 INFO:tasks.workunit.client.0.smithi002.stdout:6/597: dwrite d2/f18 [0,4194304] 0 2024-09-17T01:01:59.470 INFO:tasks.workunit.client.0.smithi002.stdout:7/554: dwrite d1/d14/d1d/d28/d8f/fa2 [0,4194304] 0 2024-09-17T01:01:59.471 INFO:tasks.workunit.client.0.smithi002.stdout:6/598: rmdir d2/d1d/d26/d49/d7d 39 2024-09-17T01:01:59.473 INFO:tasks.workunit.client.0.smithi002.stdout:7/555: link d1/d14/d1d/d28/f6e d1/d14/fad 0 2024-09-17T01:01:59.474 INFO:tasks.workunit.client.0.smithi002.stdout:4/651: dwrite d7/f14 [0,4194304] 0 2024-09-17T01:01:59.474 INFO:tasks.workunit.client.1.smithi099.stdout:1/672: dwrite d0/d8c/fc6 [0,4194304] 0 2024-09-17T01:01:59.474 INFO:tasks.workunit.client.0.smithi002.stdout:5/529: fsync d2/d2d/d10/d14/d19/d39/f52 0 2024-09-17T01:01:59.474 INFO:tasks.workunit.client.0.smithi002.stdout:6/599: rename d2/d1d/d2d/d35/d79/da8/f89 to d2/d1d/d2d/d35/d79/fc0 0 2024-09-17T01:01:59.474 INFO:tasks.workunit.client.0.smithi002.stdout:6/600: readlink d2/d1d/d27/d30/lb4 0 2024-09-17T01:01:59.476 INFO:tasks.workunit.client.1.smithi099.stdout:7/526: dwrite d1/d2c/f2d [0,4194304] 0 2024-09-17T01:01:59.476 INFO:tasks.workunit.client.1.smithi099.stdout:7/527: truncate d1/d2c/d5c/d12/f7f 4642996 0 2024-09-17T01:01:59.476 INFO:tasks.workunit.client.1.smithi099.stdout:7/528: fdatasync d1/d2c/d5c/d12/f7f 0 2024-09-17T01:01:59.476 INFO:tasks.workunit.client.1.smithi099.stdout:7/529: creat d1/d2c/d5c/d1c/d5a/d6f/fa5 x:0 0 0 2024-09-17T01:01:59.476 INFO:tasks.workunit.client.1.smithi099.stdout:3/607: dwrite d9/d15/d18/d1a/f1b [0,4194304] 0 2024-09-17T01:01:59.476 INFO:tasks.workunit.client.1.smithi099.stdout:5/641: dwrite d2/f32 [0,4194304] 0 2024-09-17T01:01:59.477 INFO:tasks.workunit.client.0.smithi002.stdout:5/530: mkdir d2/d2d/d10/d14/d19/da5 0 2024-09-17T01:01:59.478 INFO:tasks.workunit.client.1.smithi099.stdout:0/569: dwrite da/df/d1a/d49/f51 [0,4194304] 0 2024-09-17T01:01:59.478 INFO:tasks.workunit.client.1.smithi099.stdout:0/570: chown da/df/d1a/d63/d6a/f8a 14121595 1 2024-09-17T01:01:59.480 INFO:tasks.workunit.client.1.smithi099.stdout:1/673: creat d0/d8/d38/d56/d93/fec x:0 0 0 2024-09-17T01:01:59.483 INFO:tasks.workunit.client.0.smithi002.stdout:5/531: symlink d2/d99/la6 0 2024-09-17T01:01:59.490 INFO:tasks.workunit.client.1.smithi099.stdout:3/608: rename d9/d15/d7d/dad to d9/d15/d18/d1a/d23/d5c/d99/dbb 0 2024-09-17T01:01:59.490 INFO:tasks.workunit.client.1.smithi099.stdout:7/530: dread d1/d2c/f30 [0,4194304] 0 2024-09-17T01:01:59.496 INFO:tasks.workunit.client.1.smithi099.stdout:5/642: rename d2/dc/d14/d89/db1 to d2/dc4/d99/dd0 0 2024-09-17T01:01:59.499 INFO:tasks.workunit.client.1.smithi099.stdout:3/609: creat d9/d3b/db2/fbc x:0 0 0 2024-09-17T01:01:59.500 INFO:tasks.workunit.client.1.smithi099.stdout:3/610: write d9/d2b/f58 [664414,89019] 0 2024-09-17T01:01:59.500 INFO:tasks.workunit.client.1.smithi099.stdout:3/611: fsync d9/d15/f34 0 2024-09-17T01:01:59.500 INFO:tasks.workunit.client.1.smithi099.stdout:7/531: write d1/f24 [3026218,115653] 0 2024-09-17T01:01:59.500 INFO:tasks.workunit.client.1.smithi099.stdout:7/532: write d1/d2c/f66 [5140305,31855] 0 2024-09-17T01:01:59.501 INFO:tasks.workunit.client.1.smithi099.stdout:5/643: creat d2/dc/d17/d3c/fd1 x:0 0 0 2024-09-17T01:01:59.502 INFO:tasks.workunit.client.1.smithi099.stdout:5/644: write d2/dc/f74 [879998,3841] 0 2024-09-17T01:01:59.504 INFO:tasks.workunit.client.1.smithi099.stdout:5/645: creat d2/dc/d14/d36/fd2 x:0 0 0 2024-09-17T01:01:59.504 INFO:tasks.workunit.client.1.smithi099.stdout:5/646: write d2/f18 [5524509,6524] 0 2024-09-17T01:01:59.504 INFO:tasks.workunit.client.1.smithi099.stdout:5/647: creat d2/dc/d14/d36/fd3 x:0 0 0 2024-09-17T01:01:59.505 INFO:tasks.workunit.client.1.smithi099.stdout:5/648: symlink d2/dc/d14/d89/ld4 0 2024-09-17T01:01:59.506 INFO:tasks.workunit.client.1.smithi099.stdout:7/533: dread d1/d2c/f6b [0,4194304] 0 2024-09-17T01:01:59.506 INFO:tasks.workunit.client.1.smithi099.stdout:7/534: chown d1/d2c/d5c 67 1 2024-09-17T01:01:59.506 INFO:tasks.workunit.client.1.smithi099.stdout:7/535: fdatasync d1/d2c/d5c/f1d 0 2024-09-17T01:01:59.508 INFO:tasks.workunit.client.1.smithi099.stdout:7/536: link d1/d2c/d5c/d12/f74 d1/d2c/fa6 0 2024-09-17T01:01:59.509 INFO:tasks.workunit.client.1.smithi099.stdout:3/612: dread d9/d15/f50 [0,4194304] 0 2024-09-17T01:01:59.512 INFO:tasks.workunit.client.1.smithi099.stdout:3/613: link d9/d3b/d44/f7b d9/d15/d8f/d97/fbd 0 2024-09-17T01:01:59.521 INFO:tasks.workunit.client.1.smithi099.stdout:5/649: write d2/dc/d17/f5d [1805140,64916] 0 2024-09-17T01:01:59.522 INFO:tasks.workunit.client.1.smithi099.stdout:1/674: dwrite d0/d2/f24 [0,4194304] 0 2024-09-17T01:01:59.524 INFO:tasks.workunit.client.1.smithi099.stdout:1/675: creat d0/d2/fed x:0 0 0 2024-09-17T01:01:59.525 INFO:tasks.workunit.client.0.smithi002.stdout:7/556: dwrite d1/d14/d1d/d28/d6b/d9e/d54/f66 [0,4194304] 0 2024-09-17T01:01:59.525 INFO:tasks.workunit.client.1.smithi099.stdout:7/537: dread d1/d2c/d5c/d12/f74 [0,4194304] 0 2024-09-17T01:01:59.526 INFO:tasks.workunit.client.1.smithi099.stdout:0/571: dwrite da/df/d1a/d49/f4a [0,4194304] 0 2024-09-17T01:01:59.526 INFO:tasks.workunit.client.1.smithi099.stdout:1/676: dread d0/f64 [0,4194304] 0 2024-09-17T01:01:59.526 INFO:tasks.workunit.client.0.smithi002.stdout:4/652: dwrite d7/de/f2a [0,4194304] 0 2024-09-17T01:01:59.526 INFO:tasks.workunit.client.0.smithi002.stdout:4/653: chown d7/de/d32/c88 1 1 2024-09-17T01:01:59.527 INFO:tasks.workunit.client.1.smithi099.stdout:5/650: dread d2/dc/d6c/fac [0,4194304] 0 2024-09-17T01:01:59.527 INFO:tasks.workunit.client.0.smithi002.stdout:4/654: mkdir d7/d3f/da9/dc8 0 2024-09-17T01:01:59.536 INFO:tasks.workunit.client.1.smithi099.stdout:0/572: creat da/df/d1a/d56/fbd x:0 0 0 2024-09-17T01:01:59.548 INFO:tasks.workunit.client.0.smithi002.stdout:9/489: sync 2024-09-17T01:01:59.548 INFO:tasks.workunit.client.0.smithi002.stdout:9/490: write d5/dc/f84 [841697,33257] 0 2024-09-17T01:01:59.550 INFO:tasks.workunit.client.0.smithi002.stdout:9/491: creat d5/dc/d26/d5c/d6b/d75/d57/d7a/f8b x:0 0 0 2024-09-17T01:01:59.550 INFO:tasks.workunit.client.0.smithi002.stdout:9/492: stat d5/dc/d26/f2e 0 2024-09-17T01:01:59.550 INFO:tasks.workunit.client.0.smithi002.stdout:9/493: chown d5/f3e 1620743589 1 2024-09-17T01:01:59.551 INFO:tasks.workunit.client.1.smithi099.stdout:0/573: write da/df/d31/d8b/f81 [22387,22006] 0 2024-09-17T01:01:59.551 INFO:tasks.workunit.client.1.smithi099.stdout:0/574: fdatasync da/df/d1a/f5f 0 2024-09-17T01:01:59.552 INFO:tasks.workunit.client.1.smithi099.stdout:0/575: creat da/d59/d80/d8c/d97/fbe x:0 0 0 2024-09-17T01:01:59.553 INFO:tasks.workunit.client.1.smithi099.stdout:0/576: truncate da/d12/d22/fa9 54198 0 2024-09-17T01:01:59.553 INFO:tasks.workunit.client.1.smithi099.stdout:0/577: write da/d59/d80/d8c/d97/fbe [147547,90550] 0 2024-09-17T01:01:59.553 INFO:tasks.workunit.client.1.smithi099.stdout:0/578: dread - da/df/d1a/d49/d68/f98 zero size 2024-09-17T01:01:59.554 INFO:tasks.workunit.client.1.smithi099.stdout:0/579: mkdir da/df/d20/dbf 0 2024-09-17T01:01:59.554 INFO:tasks.workunit.client.1.smithi099.stdout:0/580: symlink da/df/d1a/d49/dac/d92/lc0 0 2024-09-17T01:01:59.556 INFO:tasks.workunit.client.1.smithi099.stdout:0/581: creat da/df/d20/dbf/fc1 x:0 0 0 2024-09-17T01:01:59.556 INFO:tasks.workunit.client.1.smithi099.stdout:0/582: truncate da/df/d1a/d56/d72/f96 4905442 0 2024-09-17T01:01:59.557 INFO:tasks.workunit.client.1.smithi099.stdout:0/583: fdatasync f8 0 2024-09-17T01:01:59.557 INFO:tasks.workunit.client.1.smithi099.stdout:0/584: creat da/df/d1a/d49/d71/fc2 x:0 0 0 2024-09-17T01:01:59.557 INFO:tasks.workunit.client.1.smithi099.stdout:0/585: dread da/df/d31/db0/d1e/f9d [0,4194304] 0 2024-09-17T01:01:59.559 INFO:tasks.workunit.client.1.smithi099.stdout:0/586: mknod da/d59/d80/cc3 0 2024-09-17T01:01:59.559 INFO:tasks.workunit.client.1.smithi099.stdout:0/587: creat da/d12/d22/fc4 x:0 0 0 2024-09-17T01:01:59.559 INFO:tasks.workunit.client.1.smithi099.stdout:0/588: creat da/df/d1a/d56/fc5 x:0 0 0 2024-09-17T01:01:59.559 INFO:tasks.workunit.client.1.smithi099.stdout:0/589: chown da/d59/d80/d8c/d97/fbe 444953525 1 2024-09-17T01:01:59.574 INFO:tasks.workunit.client.0.smithi002.stdout:7/557: dwrite d1/f8 [0,4194304] 0 2024-09-17T01:01:59.574 INFO:tasks.workunit.client.0.smithi002.stdout:7/558: truncate d1/d14/d1d/d21/d45/fa9 779757 0 2024-09-17T01:01:59.578 INFO:tasks.workunit.client.1.smithi099.stdout:7/538: dwrite d1/f35 [0,4194304] 0 2024-09-17T01:01:59.578 INFO:tasks.workunit.client.1.smithi099.stdout:1/677: dwrite d0/d2/de/d8b/da7/d98/fa8 [0,4194304] 0 2024-09-17T01:01:59.579 INFO:tasks.workunit.client.1.smithi099.stdout:5/651: dwrite d2/dc/f66 [0,4194304] 0 2024-09-17T01:01:59.579 INFO:tasks.workunit.client.1.smithi099.stdout:5/652: truncate d2/f1b 4797715 0 2024-09-17T01:01:59.579 INFO:tasks.workunit.client.1.smithi099.stdout:5/653: dread - d2/dc4/d99/dd0/db2/fb5 zero size 2024-09-17T01:01:59.581 INFO:tasks.workunit.client.1.smithi099.stdout:7/539: mknod d1/d36/d8d/ca7 0 2024-09-17T01:01:59.582 INFO:tasks.workunit.client.0.smithi002.stdout:4/655: dwrite d7/d19/d9f/d9d/fa2 [0,4194304] 0 2024-09-17T01:01:59.583 INFO:tasks.workunit.client.1.smithi099.stdout:7/540: mknod d1/d2c/d5c/d12/ca8 0 2024-09-17T01:01:59.584 INFO:tasks.workunit.client.1.smithi099.stdout:0/590: dwrite da/df/d1a/d63/d6a/f8a [0,4194304] 0 2024-09-17T01:01:59.584 INFO:tasks.workunit.client.1.smithi099.stdout:7/541: unlink d1/d2c/d47/l55 0 2024-09-17T01:01:59.585 INFO:tasks.workunit.client.1.smithi099.stdout:7/542: fsync d1/d2c/d5c/d12/f7f 0 2024-09-17T01:01:59.586 INFO:tasks.workunit.client.1.smithi099.stdout:0/591: link da/d3b/l88 da/df/d4d/d6f/lc6 0 2024-09-17T01:01:59.588 INFO:tasks.workunit.client.1.smithi099.stdout:7/543: creat d1/d2c/d7a/fa9 x:0 0 0 2024-09-17T01:01:59.589 INFO:tasks.workunit.client.0.smithi002.stdout:4/656: dread d7/de/f2a [4194304,4194304] 0 2024-09-17T01:01:59.590 INFO:tasks.workunit.client.1.smithi099.stdout:1/678: write d0/d8/d49/d94/f30 [3363321,82272] 0 2024-09-17T01:01:59.592 INFO:tasks.workunit.client.0.smithi002.stdout:4/657: unlink d7/d19/d2e/f3d 0 2024-09-17T01:01:59.592 INFO:tasks.workunit.client.0.smithi002.stdout:4/658: chown d7/d71/d8e/d95/fb0 13078 1 2024-09-17T01:01:59.592 INFO:tasks.workunit.client.0.smithi002.stdout:4/659: rmdir d7/de/d3a 39 2024-09-17T01:01:59.592 INFO:tasks.workunit.client.0.smithi002.stdout:4/660: fdatasync d7/de/fae 0 2024-09-17T01:01:59.593 INFO:tasks.workunit.client.1.smithi099.stdout:1/679: mkdir d0/d2/de/d70/dee 0 2024-09-17T01:01:59.593 INFO:tasks.workunit.client.0.smithi002.stdout:4/661: unlink d7/de/d32/d59/cc4 0 2024-09-17T01:01:59.594 INFO:tasks.workunit.client.1.smithi099.stdout:1/680: symlink d0/d2/de/d70/de8/dd6/lef 0 2024-09-17T01:01:59.595 INFO:tasks.workunit.client.1.smithi099.stdout:1/681: mknod d0/cf0 0 2024-09-17T01:01:59.595 INFO:tasks.workunit.client.1.smithi099.stdout:1/682: fdatasync d0/d8c/f99 0 2024-09-17T01:01:59.610 INFO:tasks.workunit.client.1.smithi099.stdout:5/654: dwrite d2/dc/d17/d3c/f8f [0,4194304] 0 2024-09-17T01:01:59.612 INFO:tasks.workunit.client.1.smithi099.stdout:5/655: creat d2/dc/d14/d89/fd5 x:0 0 0 2024-09-17T01:01:59.612 INFO:tasks.workunit.client.1.smithi099.stdout:5/656: write d2/dc/f39 [1445025,57737] 0 2024-09-17T01:01:59.613 INFO:tasks.workunit.client.1.smithi099.stdout:5/657: creat d2/dc4/d99/dd0/fd6 x:0 0 0 2024-09-17T01:01:59.649 INFO:tasks.workunit.client.0.smithi002.stdout:9/494: dwrite d5/dc/d26/d5c/d6b/d75/f62 [0,4194304] 0 2024-09-17T01:01:59.651 INFO:tasks.workunit.client.0.smithi002.stdout:9/495: symlink d5/dc/d26/d5c/d6b/d75/d57/d7a/l8c 0 2024-09-17T01:01:59.652 INFO:tasks.workunit.client.0.smithi002.stdout:4/662: dwrite d7/de/d3a/d99/fbf [0,4194304] 0 2024-09-17T01:01:59.656 INFO:tasks.workunit.client.0.smithi002.stdout:9/496: unlink d5/dc/d26/d5c/d6b/d75/f3c 0 2024-09-17T01:01:59.657 INFO:tasks.workunit.client.0.smithi002.stdout:4/663: truncate d7/f4f 3811643 0 2024-09-17T01:01:59.657 INFO:tasks.workunit.client.1.smithi099.stdout:0/592: dwrite da/df/d1a/d49/d68/f7f [0,4194304] 0 2024-09-17T01:01:59.657 INFO:tasks.workunit.client.1.smithi099.stdout:0/593: chown da/l3f 7 1 2024-09-17T01:01:59.657 INFO:tasks.workunit.client.1.smithi099.stdout:0/594: creat da/d12/d22/fc7 x:0 0 0 2024-09-17T01:01:59.657 INFO:tasks.workunit.client.1.smithi099.stdout:1/683: dwrite d0/d2/f25 [0,4194304] 0 2024-09-17T01:01:59.658 INFO:tasks.workunit.client.0.smithi002.stdout:9/497: truncate d5/dc/d26/f7e 3484177 0 2024-09-17T01:01:59.658 INFO:tasks.workunit.client.0.smithi002.stdout:9/498: dread - d5/dc/d26/d5c/d6b/d75/d57/f5d zero size 2024-09-17T01:01:59.660 INFO:tasks.workunit.client.1.smithi099.stdout:7/544: dwrite d1/d2c/d5c/d1c/fa2 [0,4194304] 0 2024-09-17T01:01:59.661 INFO:tasks.workunit.client.1.smithi099.stdout:7/545: write d1/d2c/f2d [4943037,30740] 0 2024-09-17T01:01:59.664 INFO:tasks.workunit.client.0.smithi002.stdout:9/499: rename d5/dc/d26/d46/d47/d7d to d5/dc/d26/d5c/d6b/d75/d57/d8d 0 2024-09-17T01:01:59.664 INFO:tasks.workunit.client.0.smithi002.stdout:9/500: truncate d5/dc/d26/d5c/d6b/f6e 788221 0 2024-09-17T01:01:59.664 INFO:tasks.workunit.client.0.smithi002.stdout:9/501: chown d5/dc 199 1 2024-09-17T01:01:59.666 INFO:tasks.workunit.client.0.smithi002.stdout:4/664: write d7/d19/d9f/d80/d62/f31 [1658557,99871] 0 2024-09-17T01:01:59.667 INFO:tasks.workunit.client.0.smithi002.stdout:4/665: mknod d7/d19/d9f/d80/d62/d52/dc7/cc9 0 2024-09-17T01:01:59.669 INFO:tasks.workunit.client.0.smithi002.stdout:4/666: mkdir d7/d3f/da9/dca 0 2024-09-17T01:01:59.670 INFO:tasks.workunit.client.0.smithi002.stdout:4/667: link d7/de/d3a/d99/fbf d7/d19/d9f/d80/fcb 0 2024-09-17T01:01:59.675 INFO:tasks.workunit.client.1.smithi099.stdout:1/684: write d0/d2/de/d8b/da7/d98/fa8 [433717,92130] 0 2024-09-17T01:01:59.676 INFO:tasks.workunit.client.1.smithi099.stdout:0/595: dwrite da/d12/d2b/dab/db5/f58 [0,4194304] 0 2024-09-17T01:01:59.676 INFO:tasks.workunit.client.1.smithi099.stdout:0/596: fsync da/df/d1a/d49/d71/faf 0 2024-09-17T01:01:59.676 INFO:tasks.workunit.client.0.smithi002.stdout:4/668: dread d7/d19/d9f/d80/d62/f6a [0,4194304] 0 2024-09-17T01:01:59.679 INFO:tasks.workunit.client.1.smithi099.stdout:7/546: write d1/f10 [2405538,25836] 0 2024-09-17T01:01:59.679 INFO:tasks.workunit.client.1.smithi099.stdout:7/547: readlink d1/d36/l5b 0 2024-09-17T01:01:59.679 INFO:tasks.workunit.client.1.smithi099.stdout:7/548: creat d1/d2c/d7a/faa x:0 0 0 2024-09-17T01:01:59.682 INFO:tasks.workunit.client.0.smithi002.stdout:9/502: dwrite d5/dc/d26/d5c/d6b/d75/d57/d7a/f8b [0,4194304] 0 2024-09-17T01:01:59.682 INFO:tasks.workunit.client.0.smithi002.stdout:9/503: fdatasync d5/f20 0 2024-09-17T01:01:59.683 INFO:tasks.workunit.client.1.smithi099.stdout:1/685: rename d0/d8c/lc9 to d0/d8/d38/d56/lf1 0 2024-09-17T01:01:59.683 INFO:tasks.workunit.client.1.smithi099.stdout:1/686: write d0/d2/de/f15 [2778542,44093] 0 2024-09-17T01:01:59.683 INFO:tasks.workunit.client.1.smithi099.stdout:1/687: creat d0/d8/d38/d56/ff2 x:0 0 0 2024-09-17T01:01:59.683 INFO:tasks.workunit.client.1.smithi099.stdout:1/688: readlink d0/d8/d49/d94/de0/l66 0 2024-09-17T01:01:59.683 INFO:tasks.workunit.client.1.smithi099.stdout:1/689: write d0/d8c/f9d [385001,52407] 0 2024-09-17T01:01:59.683 INFO:tasks.workunit.client.1.smithi099.stdout:1/690: creat d0/d2/de/d8b/ff3 x:0 0 0 2024-09-17T01:01:59.684 INFO:tasks.workunit.client.0.smithi002.stdout:4/669: mkdir d7/d19/d9f/d80/d62/d52/dc7/d77/d9b/dcc 0 2024-09-17T01:01:59.686 INFO:tasks.workunit.client.1.smithi099.stdout:7/549: mknod d1/d2c/d5c/d3f/cab 0 2024-09-17T01:01:59.691 INFO:tasks.workunit.client.0.smithi002.stdout:8/663: sync 2024-09-17T01:01:59.691 INFO:tasks.workunit.client.0.smithi002.stdout:3/556: sync 2024-09-17T01:01:59.693 INFO:tasks.workunit.client.0.smithi002.stdout:4/670: symlink d7/d19/d9f/d9d/da4/lcd 0 2024-09-17T01:01:59.694 INFO:tasks.workunit.client.0.smithi002.stdout:4/671: truncate d7/de/d32/f73 1400507 0 2024-09-17T01:01:59.695 INFO:tasks.workunit.client.0.smithi002.stdout:9/504: dread d5/f3e [0,4194304] 0 2024-09-17T01:01:59.698 INFO:tasks.workunit.client.0.smithi002.stdout:4/672: creat d7/de/d3a/dac/fce x:0 0 0 2024-09-17T01:01:59.698 INFO:tasks.workunit.client.0.smithi002.stdout:4/673: write d7/d19/d9f/d80/d62/f6f [2098590,61992] 0 2024-09-17T01:01:59.701 INFO:tasks.workunit.client.1.smithi099.stdout:8/569: sync 2024-09-17T01:01:59.704 INFO:tasks.workunit.client.1.smithi099.stdout:0/597: dwrite f7 [0,4194304] 0 2024-09-17T01:01:59.704 INFO:tasks.workunit.client.1.smithi099.stdout:0/598: write da/d3b/f5e [843414,89017] 0 2024-09-17T01:01:59.704 INFO:tasks.workunit.client.1.smithi099.stdout:0/599: stat da/d12/d22/f9a 0 2024-09-17T01:01:59.705 INFO:tasks.workunit.client.1.smithi099.stdout:0/600: stat da/df/d31/l44 0 2024-09-17T01:01:59.707 INFO:tasks.workunit.client.0.smithi002.stdout:3/557: read d0/d3/d33/f7d [808590,5234] 0 2024-09-17T01:01:59.707 INFO:tasks.workunit.client.0.smithi002.stdout:3/558: getdents d0/d31/d32/d90 0 2024-09-17T01:01:59.707 INFO:tasks.workunit.client.0.smithi002.stdout:3/559: chown d0/d3/d8d/f9c 1616 1 2024-09-17T01:01:59.707 INFO:tasks.workunit.client.0.smithi002.stdout:4/674: mkdir d7/d19/d2e/dc0/dcf 0 2024-09-17T01:01:59.710 INFO:tasks.workunit.client.0.smithi002.stdout:9/505: rename d5/c40 to d5/dc/d26/d5c/d6b/d75/d57/d7a/c8e 0 2024-09-17T01:01:59.711 INFO:tasks.workunit.client.0.smithi002.stdout:2/582: sync 2024-09-17T01:01:59.712 INFO:tasks.workunit.client.0.smithi002.stdout:9/506: link d5/fb d5/d8a/f8f 0 2024-09-17T01:01:59.713 INFO:tasks.workunit.client.0.smithi002.stdout:1/542: sync 2024-09-17T01:01:59.714 INFO:tasks.workunit.client.0.smithi002.stdout:1/543: creat d4/d11/d12/d14/d17/d20/fb9 x:0 0 0 2024-09-17T01:01:59.714 INFO:tasks.workunit.client.0.smithi002.stdout:1/544: chown d4/d11/d55/f92 1724 1 2024-09-17T01:01:59.714 INFO:tasks.workunit.client.0.smithi002.stdout:1/545: fdatasync d4/d11/d12/d14/d17/d20/fb9 0 2024-09-17T01:01:59.716 INFO:tasks.workunit.client.0.smithi002.stdout:9/507: rmdir d5/dc/d26/d63 39 2024-09-17T01:01:59.716 INFO:tasks.workunit.client.0.smithi002.stdout:9/508: stat d5/dc/d26/d5c/d6b/d75/f42 0 2024-09-17T01:01:59.720 INFO:tasks.workunit.client.0.smithi002.stdout:9/509: chown d5/l8 8863338 1 2024-09-17T01:01:59.720 INFO:tasks.workunit.client.0.smithi002.stdout:9/510: write d5/dc/d26/f81 [727046,113903] 0 2024-09-17T01:01:59.720 INFO:tasks.workunit.client.1.smithi099.stdout:1/691: dwrite d0/d8/fbe [0,4194304] 0 2024-09-17T01:01:59.720 INFO:tasks.workunit.client.1.smithi099.stdout:1/692: chown d0/de2 15022098 1 2024-09-17T01:01:59.720 INFO:tasks.workunit.client.1.smithi099.stdout:1/693: creat d0/d8/d49/d4e/ff4 x:0 0 0 2024-09-17T01:01:59.721 INFO:tasks.workunit.client.0.smithi002.stdout:8/664: dwrite d2/f12 [4194304,4194304] 0 2024-09-17T01:01:59.721 INFO:tasks.workunit.client.0.smithi002.stdout:8/665: stat d2/d3/d5f/f46 0 2024-09-17T01:01:59.722 INFO:tasks.workunit.client.0.smithi002.stdout:3/560: dread d0/d3/d37/f74 [0,4194304] 0 2024-09-17T01:01:59.722 INFO:tasks.workunit.client.0.smithi002.stdout:9/511: mknod d5/dc/d26/d63/c90 0 2024-09-17T01:01:59.723 INFO:tasks.workunit.client.1.smithi099.stdout:1/694: write d0/d8/d49/d94/f72 [122316,103281] 0 2024-09-17T01:01:59.724 INFO:tasks.workunit.client.0.smithi002.stdout:9/512: mknod d5/dc/d26/d46/d47/c91 0 2024-09-17T01:01:59.724 INFO:tasks.workunit.client.0.smithi002.stdout:9/513: write d5/dc/d26/d5c/d6b/d75/d57/f85 [985803,47837] 0 2024-09-17T01:01:59.727 INFO:tasks.workunit.client.0.smithi002.stdout:9/514: creat d5/dc/f92 x:0 0 0 2024-09-17T01:01:59.728 INFO:tasks.workunit.client.0.smithi002.stdout:1/546: dread d4/d11/d12/d30/d5e/f77 [0,4194304] 0 2024-09-17T01:01:59.728 INFO:tasks.workunit.client.0.smithi002.stdout:1/547: chown d4/d11/d12/f3d 295574998 1 2024-09-17T01:01:59.729 INFO:tasks.workunit.client.0.smithi002.stdout:1/548: symlink d4/d11/d12/d30/d43/d67/lba 0 2024-09-17T01:01:59.729 INFO:tasks.workunit.client.0.smithi002.stdout:1/549: readlink d4/d11/d1a/daa/lac 0 2024-09-17T01:01:59.731 INFO:tasks.workunit.client.0.smithi002.stdout:9/515: dread d5/dc/d26/d5c/d6b/d75/d57/f64 [0,4194304] 0 2024-09-17T01:01:59.731 INFO:tasks.workunit.client.0.smithi002.stdout:9/516: fdatasync d5/dc/d26/d5c/d6b/d75/d36/f67 0 2024-09-17T01:01:59.731 INFO:tasks.workunit.client.0.smithi002.stdout:1/550: mkdir d4/d11/d1a/daa/dbb 0 2024-09-17T01:01:59.731 INFO:tasks.workunit.client.0.smithi002.stdout:1/551: fdatasync d4/d11/d12/d30/d5e/f60 0 2024-09-17T01:01:59.733 INFO:tasks.workunit.client.0.smithi002.stdout:1/552: mkdir d4/d11/d55/dbc 0 2024-09-17T01:01:59.733 INFO:tasks.workunit.client.0.smithi002.stdout:1/553: dread - d4/d11/d12/d14/d17/d40/f6d zero size 2024-09-17T01:01:59.733 INFO:tasks.workunit.client.0.smithi002.stdout:1/554: readlink d4/d11/d12/d30/d5e/lab 0 2024-09-17T01:01:59.734 INFO:tasks.workunit.client.0.smithi002.stdout:1/555: stat d4/d11/d12/d14/l33 0 2024-09-17T01:01:59.734 INFO:tasks.workunit.client.1.smithi099.stdout:1/695: dread d0/d2/de/d8b/da7/f8e [4194304,4194304] 0 2024-09-17T01:01:59.735 INFO:tasks.workunit.client.0.smithi002.stdout:1/556: getdents d4/d11 0 2024-09-17T01:01:59.735 INFO:tasks.workunit.client.0.smithi002.stdout:1/557: fdatasync d4/d11/d12/f3d 0 2024-09-17T01:01:59.735 INFO:tasks.workunit.client.0.smithi002.stdout:1/558: readlink d4/d11/d12/d23/l58 0 2024-09-17T01:01:59.737 INFO:tasks.workunit.client.1.smithi099.stdout:8/570: dwrite d0/d4/f50 [0,4194304] 0 2024-09-17T01:01:59.737 INFO:tasks.workunit.client.1.smithi099.stdout:8/571: write d0/d4/d29/f57 [1452109,116675] 0 2024-09-17T01:01:59.737 INFO:tasks.workunit.client.1.smithi099.stdout:8/572: truncate d0/d41/f9b 1690416 0 2024-09-17T01:01:59.737 INFO:tasks.workunit.client.1.smithi099.stdout:8/573: chown d0/d53 2 1 2024-09-17T01:01:59.738 INFO:tasks.workunit.client.0.smithi002.stdout:3/561: dread d0/d3/d33/f7b [0,4194304] 0 2024-09-17T01:01:59.738 INFO:tasks.workunit.client.0.smithi002.stdout:3/562: write d0/d3/d37/dac/da1/fb6 [323132,47301] 0 2024-09-17T01:01:59.739 INFO:tasks.workunit.client.1.smithi099.stdout:8/574: creat d0/d4/d29/fbd x:0 0 0 2024-09-17T01:01:59.740 INFO:tasks.workunit.client.0.smithi002.stdout:3/563: symlink d0/d3/d8d/lc1 0 2024-09-17T01:01:59.740 INFO:tasks.workunit.client.0.smithi002.stdout:2/583: dwrite d1b/d37/d48/d78/f83 [0,4194304] 0 2024-09-17T01:01:59.740 INFO:tasks.workunit.client.1.smithi099.stdout:8/575: truncate d0/d1f/d31/f79 3537024 0 2024-09-17T01:01:59.743 INFO:tasks.workunit.client.1.smithi099.stdout:1/696: dread d0/d2/de/d70/de8/fdd [0,4194304] 0 2024-09-17T01:01:59.743 INFO:tasks.workunit.client.1.smithi099.stdout:1/697: truncate d0/d2/de/d8b/ff3 655086 0 2024-09-17T01:01:59.751 INFO:tasks.workunit.client.0.smithi002.stdout:8/666: dwrite d2/f12 [0,4194304] 0 2024-09-17T01:01:59.751 INFO:tasks.workunit.client.0.smithi002.stdout:8/667: read - d2/d3/d5f/d98/da5/d4f/f96 zero size 2024-09-17T01:01:59.755 INFO:tasks.workunit.client.0.smithi002.stdout:8/668: truncate d2/d1c/d28/f81 138379 0 2024-09-17T01:01:59.755 INFO:tasks.workunit.client.0.smithi002.stdout:8/669: getdents d2/d3/d5f/d98/da5/d4f/d77/d78 0 2024-09-17T01:01:59.755 INFO:tasks.workunit.client.0.smithi002.stdout:2/584: read d1b/d3f/d59/d7f/dc9/f61 [424623,54511] 0 2024-09-17T01:01:59.757 INFO:tasks.workunit.client.0.smithi002.stdout:8/670: link d2/d41/f90 d2/d41/fe3 0 2024-09-17T01:01:59.757 INFO:tasks.workunit.client.0.smithi002.stdout:8/671: chown d2/d1c/d28/c2a 259321931 1 2024-09-17T01:01:59.759 INFO:tasks.workunit.client.0.smithi002.stdout:9/517: dwrite d5/dc/d26/d46/f58 [0,4194304] 0 2024-09-17T01:01:59.759 INFO:tasks.workunit.client.0.smithi002.stdout:9/518: creat d5/dc/d26/d5c/d6b/d75/d57/d7a/f93 x:0 0 0 2024-09-17T01:01:59.759 INFO:tasks.workunit.client.0.smithi002.stdout:8/672: mknod d2/d3/d5f/d98/ce4 0 2024-09-17T01:01:59.759 INFO:tasks.workunit.client.0.smithi002.stdout:8/673: fdatasync d2/d1c/d28/dad/dcd/dd1/ddb/f8e 0 2024-09-17T01:01:59.760 INFO:tasks.workunit.client.0.smithi002.stdout:8/674: read d2/d3/d5f/d98/da5/d71/fbf [81280,102807] 0 2024-09-17T01:01:59.761 INFO:tasks.workunit.client.0.smithi002.stdout:9/519: creat d5/dc/d26/d63/f94 x:0 0 0 2024-09-17T01:01:59.763 INFO:tasks.workunit.client.0.smithi002.stdout:3/564: dwrite d0/d3/d37/f4d [0,4194304] 0 2024-09-17T01:01:59.763 INFO:tasks.workunit.client.0.smithi002.stdout:1/559: dwrite d4/fe [0,4194304] 0 2024-09-17T01:01:59.763 INFO:tasks.workunit.client.0.smithi002.stdout:1/560: chown d4/d11/d12/d23/d32/l75 890245 1 2024-09-17T01:01:59.764 INFO:tasks.workunit.client.0.smithi002.stdout:9/520: unlink d5/fb 0 2024-09-17T01:01:59.764 INFO:tasks.workunit.client.0.smithi002.stdout:6/601: sync 2024-09-17T01:01:59.765 INFO:tasks.workunit.client.0.smithi002.stdout:0/438: sync 2024-09-17T01:01:59.765 INFO:tasks.workunit.client.0.smithi002.stdout:0/439: chown dd/d19/d1a/d29/c83 3 1 2024-09-17T01:01:59.765 INFO:tasks.workunit.client.0.smithi002.stdout:0/440: write dd/d19/f2c [119022,46007] 0 2024-09-17T01:01:59.765 INFO:tasks.workunit.client.0.smithi002.stdout:0/441: creat dd/d3d/f8d x:0 0 0 2024-09-17T01:01:59.765 INFO:tasks.workunit.client.0.smithi002.stdout:8/675: getdents d2/d3/d5f/d98/da5/d4f/d58 0 2024-09-17T01:01:59.768 INFO:tasks.workunit.client.0.smithi002.stdout:1/561: creat d4/d11/d12/d14/d17/d51/fbd x:0 0 0 2024-09-17T01:01:59.771 INFO:tasks.workunit.client.0.smithi002.stdout:1/562: dread d4/d11/d12/d23/d32/f84 [0,4194304] 0 2024-09-17T01:01:59.771 INFO:tasks.workunit.client.0.smithi002.stdout:8/676: dread d2/d3/d5f/d98/da5/d4f/d77/d78/fa9 [0,4194304] 0 2024-09-17T01:01:59.771 INFO:tasks.workunit.client.0.smithi002.stdout:8/677: creat d2/d1c/d28/fe5 x:0 0 0 2024-09-17T01:01:59.771 INFO:tasks.workunit.client.0.smithi002.stdout:6/602: mkdir d2/d1d/d2d/d35/dc1 0 2024-09-17T01:01:59.774 INFO:tasks.workunit.client.0.smithi002.stdout:1/563: dread d4/d11/f82 [0,4194304] 0 2024-09-17T01:01:59.774 INFO:tasks.workunit.client.0.smithi002.stdout:1/564: creat d4/d11/d1a/d95/fbe x:0 0 0 2024-09-17T01:01:59.775 INFO:tasks.workunit.client.0.smithi002.stdout:0/442: rename dd/d19/d1a/d29/l48 to dd/d19/d1a/d29/d55/d56/l8e 0 2024-09-17T01:01:59.778 INFO:tasks.workunit.client.0.smithi002.stdout:8/678: mkdir d2/d3/de6 0 2024-09-17T01:01:59.778 INFO:tasks.workunit.client.0.smithi002.stdout:8/679: write d2/d3/d5f/d98/da5/d4f/d77/d78/fce [427328,53857] 0 2024-09-17T01:01:59.778 INFO:tasks.workunit.client.0.smithi002.stdout:8/680: fsync d2/d3/d5f/d98/da5/d4f/f94 0 2024-09-17T01:01:59.778 INFO:tasks.workunit.client.0.smithi002.stdout:8/681: stat d2/d3/f11 0 2024-09-17T01:01:59.778 INFO:tasks.workunit.client.0.smithi002.stdout:8/682: stat d2/d26/dbb/fd0 0 2024-09-17T01:01:59.778 INFO:tasks.workunit.client.0.smithi002.stdout:8/683: readlink d2/d3/d5f/d98/da5/d4f/l75 0 2024-09-17T01:01:59.779 INFO:tasks.workunit.client.0.smithi002.stdout:2/585: dwrite d1b/d37/d48/d4e/f70 [0,4194304] 0 2024-09-17T01:01:59.779 INFO:tasks.workunit.client.0.smithi002.stdout:2/586: creat d1b/d1d/d79/fd2 x:0 0 0 2024-09-17T01:01:59.780 INFO:tasks.workunit.client.0.smithi002.stdout:1/565: creat d4/d11/d12/d14/d17/d56/fbf x:0 0 0 2024-09-17T01:01:59.780 INFO:tasks.workunit.client.0.smithi002.stdout:1/566: write d4/d11/d12/d14/d17/d3b/f62 [93437,108537] 0 2024-09-17T01:01:59.780 INFO:tasks.workunit.client.0.smithi002.stdout:1/567: dread - d4/d11/d12/d30/fb1 zero size 2024-09-17T01:01:59.780 INFO:tasks.workunit.client.0.smithi002.stdout:3/565: dwrite d0/d3/fb5 [0,4194304] 0 2024-09-17T01:01:59.781 INFO:tasks.workunit.client.0.smithi002.stdout:6/603: rename d2/d1d/d2d/d35/d8d/l4d to d2/d1d/d27/lc2 0 2024-09-17T01:01:59.782 INFO:tasks.workunit.client.0.smithi002.stdout:0/443: rmdir dd/d19/d1a/d29/d55 39 2024-09-17T01:01:59.783 INFO:tasks.workunit.client.0.smithi002.stdout:0/444: creat dd/d3d/f8f x:0 0 0 2024-09-17T01:01:59.783 INFO:tasks.workunit.client.0.smithi002.stdout:9/521: getdents d5 0 2024-09-17T01:01:59.787 INFO:tasks.workunit.client.0.smithi002.stdout:2/587: write d1b/d37/d48/d52/f5d [3319164,103900] 0 2024-09-17T01:01:59.787 INFO:tasks.workunit.client.0.smithi002.stdout:3/566: creat d0/d31/d8b/fc2 x:0 0 0 2024-09-17T01:01:59.789 INFO:tasks.workunit.client.0.smithi002.stdout:8/684: rename d2/d9/dd/c52 to d2/d1c/d28/dad/dcd/dd1/ce7 0 2024-09-17T01:01:59.789 INFO:tasks.workunit.client.0.smithi002.stdout:8/685: chown d2/d3/d5f/d98/fb7 484091928 1 2024-09-17T01:01:59.789 INFO:tasks.workunit.client.0.smithi002.stdout:8/686: chown d2/d9/dd/cb2 36852 1 2024-09-17T01:01:59.789 INFO:tasks.workunit.client.0.smithi002.stdout:8/687: read d2/f1d [98928,130217] 0 2024-09-17T01:01:59.793 INFO:tasks.workunit.client.0.smithi002.stdout:6/604: rmdir d2/dc/d24/d53/d83/da9 39 2024-09-17T01:01:59.793 INFO:tasks.workunit.client.0.smithi002.stdout:6/605: chown d2/d1d/d2d/d73/c84 68157953 1 2024-09-17T01:01:59.794 INFO:tasks.workunit.client.0.smithi002.stdout:9/522: write d5/f14 [4151159,93563] 0 2024-09-17T01:01:59.796 INFO:tasks.workunit.client.0.smithi002.stdout:0/445: mknod dd/d19/d1c/d1f/d76/c90 0 2024-09-17T01:01:59.798 INFO:tasks.workunit.client.0.smithi002.stdout:1/568: dwrite d4/d11/d12/d23/f99 [0,4194304] 0 2024-09-17T01:01:59.806 INFO:tasks.workunit.client.0.smithi002.stdout:3/567: unlink d0/d3/d33/d99/lae 0 2024-09-17T01:01:59.806 INFO:tasks.workunit.client.0.smithi002.stdout:1/569: dread d4/d11/d12/d30/d5e/f77 [0,4194304] 0 2024-09-17T01:01:59.808 INFO:tasks.workunit.client.0.smithi002.stdout:2/588: rename d1b/f75 to d1b/d37/d48/d52/db5/fd3 0 2024-09-17T01:01:59.815 INFO:tasks.workunit.client.0.smithi002.stdout:2/589: mkdir d1b/d1d/dd4 0 2024-09-17T01:01:59.815 INFO:tasks.workunit.client.0.smithi002.stdout:2/590: fsync d1b/d37/f9c 0 2024-09-17T01:01:59.818 INFO:tasks.workunit.client.0.smithi002.stdout:2/591: dread d1b/d8a/d92/f96 [0,4194304] 0 2024-09-17T01:01:59.818 INFO:tasks.workunit.client.0.smithi002.stdout:2/592: truncate d1b/d3f/d59/d7f/dc9/f87 660905 0 2024-09-17T01:01:59.818 INFO:tasks.workunit.client.0.smithi002.stdout:8/688: dwrite d2/d26/f61 [0,4194304] 0 2024-09-17T01:01:59.818 INFO:tasks.workunit.client.0.smithi002.stdout:6/606: dwrite d2/d1d/f3d [4194304,4194304] 0 2024-09-17T01:01:59.819 INFO:tasks.workunit.client.0.smithi002.stdout:2/593: unlink d1b/d37/d48/d52/f6f 0 2024-09-17T01:01:59.821 INFO:tasks.workunit.client.0.smithi002.stdout:6/607: symlink d2/d1d/d27/d80/d93/lc3 0 2024-09-17T01:01:59.821 INFO:tasks.workunit.client.0.smithi002.stdout:6/608: chown d2/dc/lf 465376 1 2024-09-17T01:01:59.822 INFO:tasks.workunit.client.0.smithi002.stdout:2/594: mknod d1b/d8a/d92/cd5 0 2024-09-17T01:01:59.824 INFO:tasks.workunit.client.0.smithi002.stdout:0/446: dwrite dd/d19/d1c/d1f/d22/f51 [0,4194304] 0 2024-09-17T01:01:59.824 INFO:tasks.workunit.client.0.smithi002.stdout:3/568: dwrite d0/d3/d33/d40/f45 [0,4194304] 0 2024-09-17T01:01:59.824 INFO:tasks.workunit.client.0.smithi002.stdout:0/447: chown dd/d19/d1c/d33 19939179 1 2024-09-17T01:01:59.824 INFO:tasks.workunit.client.0.smithi002.stdout:6/609: creat d2/d1d/d2d/d35/d8d/dab/fc4 x:0 0 0 2024-09-17T01:01:59.827 INFO:tasks.workunit.client.0.smithi002.stdout:2/595: link d1b/f29 d1b/d37/d48/db1/dbb/fd6 0 2024-09-17T01:01:59.829 INFO:tasks.workunit.client.0.smithi002.stdout:2/596: dread d1b/d3f/d59/d7f/dc9/f87 [0,4194304] 0 2024-09-17T01:01:59.829 INFO:tasks.workunit.client.0.smithi002.stdout:2/597: write d1b/d8a/f8c [3762819,100805] 0 2024-09-17T01:01:59.829 INFO:tasks.workunit.client.0.smithi002.stdout:2/598: chown d1b/f2d 127 1 2024-09-17T01:01:59.829 INFO:tasks.workunit.client.0.smithi002.stdout:2/599: chown d1b/d8a/d92/fa7 1278 1 2024-09-17T01:01:59.829 INFO:tasks.workunit.client.0.smithi002.stdout:2/600: read fe [2324886,127926] 0 2024-09-17T01:01:59.829 INFO:tasks.workunit.client.0.smithi002.stdout:2/601: chown d1b/d1d/f6e 0 1 2024-09-17T01:01:59.831 INFO:tasks.workunit.client.1.smithi099.stdout:6/584: sync 2024-09-17T01:01:59.831 INFO:tasks.workunit.client.1.smithi099.stdout:6/585: creat dc/d1a/d49/fba x:0 0 0 2024-09-17T01:01:59.831 INFO:tasks.workunit.client.1.smithi099.stdout:9/569: sync 2024-09-17T01:01:59.832 INFO:tasks.workunit.client.0.smithi002.stdout:9/523: write d5/d8a/f8f [488801,15280] 0 2024-09-17T01:01:59.835 INFO:tasks.workunit.client.0.smithi002.stdout:8/689: dwrite d2/d3/f6e [0,4194304] 0 2024-09-17T01:01:59.835 INFO:tasks.workunit.client.1.smithi099.stdout:6/586: mkdir dc/d5d/d66/dbb 0 2024-09-17T01:01:59.836 INFO:tasks.workunit.client.0.smithi002.stdout:3/569: write d0/d3/d8d/fad [3984542,50138] 0 2024-09-17T01:01:59.840 INFO:tasks.workunit.client.0.smithi002.stdout:1/570: truncate d4/d11/d12/d23/f99 2990685 0 2024-09-17T01:01:59.840 INFO:tasks.workunit.client.0.smithi002.stdout:1/571: chown d4/d11/d12/d14/d17/d20/f50 1234203 1 2024-09-17T01:01:59.840 INFO:tasks.workunit.client.0.smithi002.stdout:1/572: write d4/d11/d12/d23/d32/d86/f8b [514037,110337] 0 2024-09-17T01:01:59.847 INFO:tasks.workunit.client.0.smithi002.stdout:8/690: write d2/f12 [1536724,94562] 0 2024-09-17T01:01:59.847 INFO:tasks.workunit.client.0.smithi002.stdout:8/691: readlink d2/d3/d5f/d98/da5/lc9 0 2024-09-17T01:01:59.847 INFO:tasks.workunit.client.0.smithi002.stdout:3/570: creat d0/d3/d33/d40/fc3 x:0 0 0 2024-09-17T01:01:59.847 INFO:tasks.workunit.client.0.smithi002.stdout:1/573: mkdir d4/d11/d12/d14/d17/d51/dc0 0 2024-09-17T01:01:59.849 INFO:tasks.workunit.client.0.smithi002.stdout:6/610: getdents d2 0 2024-09-17T01:01:59.852 INFO:tasks.workunit.client.1.smithi099.stdout:9/570: dwrite da/d50/f83 [0,4194304] 0 2024-09-17T01:01:59.852 INFO:tasks.workunit.client.1.smithi099.stdout:9/571: creat da/d56/d84/fbb x:0 0 0 2024-09-17T01:01:59.853 INFO:tasks.workunit.client.0.smithi002.stdout:8/692: link d2/d3/d5f/d98/da5/d4f/d77/db0/fda d2/d9/dd/fe8 0 2024-09-17T01:01:59.854 INFO:tasks.workunit.client.0.smithi002.stdout:3/571: symlink d0/d3/d33/d77/lc4 0 2024-09-17T01:01:59.854 INFO:tasks.workunit.client.0.smithi002.stdout:3/572: stat d0/d3/d17/d6a 0 2024-09-17T01:01:59.855 INFO:tasks.workunit.client.0.smithi002.stdout:3/573: truncate d0/d3/d33/f7b 3265950 0 2024-09-17T01:01:59.855 INFO:tasks.workunit.client.0.smithi002.stdout:3/574: write d0/d3/d8d/fad [3265033,69818] 0 2024-09-17T01:01:59.856 INFO:tasks.workunit.client.1.smithi099.stdout:9/572: unlink da/d14/c3c 0 2024-09-17T01:01:59.857 INFO:tasks.workunit.client.0.smithi002.stdout:6/611: getdents d2/d1d/d26/d49/d51 0 2024-09-17T01:01:59.857 INFO:tasks.workunit.client.0.smithi002.stdout:6/612: write d2/d1d/d26/d49/d51/f76 [2025162,101859] 0 2024-09-17T01:01:59.857 INFO:tasks.workunit.client.0.smithi002.stdout:6/613: chown d2/d1d/d2d/d35/d37/c3b 143726 1 2024-09-17T01:01:59.857 INFO:tasks.workunit.client.0.smithi002.stdout:6/614: dread - d2/d1d/d2d/d5a/d71/fb2 zero size 2024-09-17T01:01:59.858 INFO:tasks.workunit.client.0.smithi002.stdout:9/524: write d5/dc/f4e [117358,74356] 0 2024-09-17T01:01:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.860+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2064579364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b840fc520 msgr2=0x7f2b840fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.860+0000 7f2b8b5f6640 1 --2- 172.21.15.2:0/2064579364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b840fc520 0x7f2b840fc930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2b800048d0 tx=0x7f2b80009da0 comp rx=0 tx=0).stop 2024-09-17T01:01:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.860+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2064579364 shutdown_connections 2024-09-17T01:01:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.860+0000 7f2b8b5f6640 1 --2- 172.21.15.2:0/2064579364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b840fd7f0 0x7f2b840fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.860+0000 7f2b8b5f6640 1 --2- 172.21.15.2:0/2064579364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b840fc520 0x7f2b840fc930 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.860+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2064579364 >> 172.21.15.2:0/2064579364 conn(0x7f2b840f7ce0 msgr2=0x7f2b840fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:01:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.861+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2064579364 shutdown_connections 2024-09-17T01:01:59.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.861+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2064579364 wait complete. 2024-09-17T01:01:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.862+0000 7f2b8b5f6640 1 Processor -- start 2024-09-17T01:01:59.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.862+0000 7f2b8b5f6640 1 -- start start 2024-09-17T01:01:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.862+0000 7f2b8b5f6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b840fc520 0x7f2b841066f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.862+0000 7f2b8b5f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b840fd7f0 0x7f2b84106c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.862+0000 7f2b8b5f6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b841072c0 con 0x7f2b840fd7f0 2024-09-17T01:01:59.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.862+0000 7f2b8b5f6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b84107af0 con 0x7f2b840fc520 2024-09-17T01:01:59.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.863+0000 7f2b89392640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b840fc520 0x7f2b841066f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:59.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.863+0000 7f2b89392640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b840fc520 0x7f2b841066f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.2:51856/0 (socket says 172.21.15.2:51856) 2024-09-17T01:01:59.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.863+0000 7f2b89392640 1 -- 172.21.15.2:0/2826117955 learned_addr learned my addr 172.21.15.2:0/2826117955 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:01:59.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.869+0000 7f2b88b91640 1 --2- 172.21.15.2:0/2826117955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b840fd7f0 0x7f2b84106c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:59.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.869+0000 7f2b89392640 1 -- 172.21.15.2:0/2826117955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b840fd7f0 msgr2=0x7f2b84106c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:01:59.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.869+0000 7f2b89392640 1 --2- 172.21.15.2:0/2826117955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b840fd7f0 0x7f2b84106c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:01:59.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.869+0000 7f2b89392640 1 -- 172.21.15.2:0/2826117955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b80005040 con 0x7f2b840fc520 2024-09-17T01:01:59.868 INFO:tasks.workunit.client.0.smithi002.stdout:0/448: dwrite dd/f15 [0,4194304] 0 2024-09-17T01:01:59.868 INFO:tasks.workunit.client.0.smithi002.stdout:0/449: fsync dd/d19/f3a 0 2024-09-17T01:01:59.868 INFO:tasks.workunit.client.0.smithi002.stdout:2/602: dwrite d1b/d74/d93/fa4 [0,4194304] 0 2024-09-17T01:01:59.871 INFO:tasks.workunit.client.0.smithi002.stdout:0/450: symlink dd/d19/d1a/d29/l91 0 2024-09-17T01:01:59.872 INFO:tasks.workunit.client.0.smithi002.stdout:0/451: write dd/d19/d1a/f4a [1103704,77131] 0 2024-09-17T01:01:59.872 INFO:tasks.workunit.client.0.smithi002.stdout:0/452: read - dd/d3d/f8d zero size 2024-09-17T01:01:59.872 INFO:tasks.workunit.client.0.smithi002.stdout:0/453: chown dd/f18 1043 1 2024-09-17T01:01:59.872 INFO:tasks.workunit.client.1.smithi099.stdout:6/587: dwrite dc/f21 [0,4194304] 0 2024-09-17T01:01:59.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.872+0000 7f2b89392640 1 --2- 172.21.15.2:0/2826117955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b840fc520 0x7f2b841066f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b80003080 tx=0x7f2b80009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:59.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.876+0000 7f2b79ffb640 1 -- 172.21.15.2:0/2826117955 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b80038070 con 0x7f2b840fc520 2024-09-17T01:01:59.875 INFO:tasks.workunit.client.0.smithi002.stdout:2/603: dread d1b/d8a/d92/f96 [0,4194304] 0 2024-09-17T01:01:59.875 INFO:tasks.workunit.client.0.smithi002.stdout:2/604: chown d1b/d37/d48/d78 1502 1 2024-09-17T01:01:59.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.876+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2826117955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b84107d10 con 0x7f2b840fc520 2024-09-17T01:01:59.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.877+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2826117955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b841081d0 con 0x7f2b840fc520 2024-09-17T01:01:59.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.878+0000 7f2b79ffb640 1 -- 172.21.15.2:0/2826117955 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2b80009800 con 0x7f2b840fc520 2024-09-17T01:01:59.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.879+0000 7f2b79ffb640 1 -- 172.21.15.2:0/2826117955 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b80033660 con 0x7f2b840fc520 2024-09-17T01:01:59.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.879+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2826117955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b840fb980 con 0x7f2b840fc520 2024-09-17T01:01:59.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.881+0000 7f2b79ffb640 1 -- 172.21.15.2:0/2826117955 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f2b80030020 con 0x7f2b840fc520 2024-09-17T01:01:59.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.881+0000 7f2b79ffb640 1 --2- 172.21.15.2:0/2826117955 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2b7006eee0 0x7f2b70071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:01:59.880 INFO:tasks.workunit.client.0.smithi002.stdout:2/605: rename d1b/d1d/lcf to d1b/d37/d48/db1/ld7 0 2024-09-17T01:01:59.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.882+0000 7f2b79ffb640 1 -- 172.21.15.2:0/2826117955 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2b800ae2d0 con 0x7f2b840fc520 2024-09-17T01:01:59.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.882+0000 7f2b88b91640 1 --2- 172.21.15.2:0/2826117955 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2b7006eee0 0x7f2b70071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:01:59.881 INFO:tasks.workunit.client.0.smithi002.stdout:1/574: dwrite d4/d11/d1a/d95/fbe [0,4194304] 0 2024-09-17T01:01:59.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.883+0000 7f2b88b91640 1 --2- 172.21.15.2:0/2826117955 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2b7006eee0 0x7f2b70071390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2b74006fd0 tx=0x7f2b74008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:01:59.882 INFO:tasks.workunit.client.0.smithi002.stdout:2/606: creat d1b/d3f/d59/d7f/dc9/dac/fd8 x:0 0 0 2024-09-17T01:01:59.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:01:59.887+0000 7f2b79ffb640 1 -- 172.21.15.2:0/2826117955 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2b8007b400 con 0x7f2b840fc520 2024-09-17T01:01:59.888 INFO:tasks.workunit.client.1.smithi099.stdout:6/588: read dc/d1a/f56 [3286210,21563] 0 2024-09-17T01:01:59.888 INFO:tasks.workunit.client.0.smithi002.stdout:1/575: rename d4/d11/d12/d14/f2b to d4/d11/d12/d30/d5e/d8c/fc1 0 2024-09-17T01:01:59.889 INFO:tasks.workunit.client.1.smithi099.stdout:6/589: creat dc/d27/fbc x:0 0 0 2024-09-17T01:01:59.889 INFO:tasks.workunit.client.1.smithi099.stdout:6/590: stat dc/d5d/d66/dbb 0 2024-09-17T01:01:59.890 INFO:tasks.workunit.client.1.smithi099.stdout:6/591: link dc/d1a/c50 dc/d1a/d49/da8/db3/cbd 0 2024-09-17T01:01:59.890 INFO:tasks.workunit.client.0.smithi002.stdout:2/607: unlink d1b/d37/d48/d4e/l40 0 2024-09-17T01:01:59.890 INFO:tasks.workunit.client.0.smithi002.stdout:2/608: chown d1b/d8b/cc2 43255 1 2024-09-17T01:01:59.890 INFO:tasks.workunit.client.0.smithi002.stdout:2/609: write d1b/d37/f4d [3135271,62371] 0 2024-09-17T01:01:59.890 INFO:tasks.workunit.client.0.smithi002.stdout:2/610: creat d1b/d1d/d79/fd9 x:0 0 0 2024-09-17T01:01:59.891 INFO:tasks.workunit.client.1.smithi099.stdout:6/592: creat dc/d5d/dae/d96/fbe x:0 0 0 2024-09-17T01:01:59.891 INFO:tasks.workunit.client.0.smithi002.stdout:4/675: sync 2024-09-17T01:01:59.891 INFO:tasks.workunit.client.0.smithi002.stdout:7/559: sync 2024-09-17T01:01:59.891 INFO:tasks.workunit.client.0.smithi002.stdout:7/560: readlink d1/d14/d1d/l22 0 2024-09-17T01:01:59.892 INFO:tasks.workunit.client.0.smithi002.stdout:5/532: sync 2024-09-17T01:01:59.892 INFO:tasks.workunit.client.1.smithi099.stdout:6/593: link dc/d27/d7e/dad/lb4 dc/d5d/d66/d7a/d87/db6/lbf 0 2024-09-17T01:01:59.892 INFO:tasks.workunit.client.1.smithi099.stdout:6/594: write dc/d5d/dae/f6a [661468,68489] 0 2024-09-17T01:01:59.892 INFO:tasks.workunit.client.1.smithi099.stdout:6/595: rmdir dc/d5d/dae/d96/d60 39 2024-09-17T01:01:59.898 INFO:tasks.workunit.client.0.smithi002.stdout:2/611: truncate d1b/f26 5902782 0 2024-09-17T01:01:59.899 INFO:tasks.workunit.client.1.smithi099.stdout:9/573: dwrite da/f44 [0,4194304] 0 2024-09-17T01:01:59.900 INFO:tasks.workunit.client.1.smithi099.stdout:9/574: write da/d14/d40/f97 [5018437,27781] 0 2024-09-17T01:01:59.901 INFO:tasks.workunit.client.0.smithi002.stdout:7/561: mknod d1/d14/d1d/cae 0 2024-09-17T01:01:59.901 INFO:tasks.workunit.client.0.smithi002.stdout:7/562: chown d1/d14/d1d/d28/d8f 340 1 2024-09-17T01:01:59.901 INFO:tasks.workunit.client.0.smithi002.stdout:7/563: stat d1/d14/d67 0 2024-09-17T01:01:59.901 INFO:tasks.workunit.client.0.smithi002.stdout:7/564: chown d1/d14/d1d/d21/c71 59695212 1 2024-09-17T01:01:59.902 INFO:tasks.workunit.client.0.smithi002.stdout:8/693: dwrite d2/d3/d5f/d98/da5/f7b [0,4194304] 0 2024-09-17T01:01:59.902 INFO:tasks.workunit.client.0.smithi002.stdout:5/533: dread d2/d2d/d10/d3b/f5e [0,4194304] 0 2024-09-17T01:01:59.902 INFO:tasks.workunit.client.0.smithi002.stdout:2/612: mkdir d1b/d3f/d59/d7f/dc9/d72/dda 0 2024-09-17T01:01:59.902 INFO:tasks.workunit.client.0.smithi002.stdout:2/613: fsync d1b/d37/d48/d52/db5/fd3 0 2024-09-17T01:01:59.906 INFO:tasks.workunit.client.0.smithi002.stdout:7/565: symlink d1/d24/laf 0 2024-09-17T01:01:59.907 INFO:tasks.workunit.client.1.smithi099.stdout:9/575: unlink da/l20 0 2024-09-17T01:01:59.907 INFO:tasks.workunit.client.1.smithi099.stdout:9/576: chown da/lb 71046 1 2024-09-17T01:01:59.907 INFO:tasks.workunit.client.1.smithi099.stdout:9/577: readlink da/d21/l2f 0 2024-09-17T01:01:59.907 INFO:tasks.workunit.client.1.smithi099.stdout:9/578: chown da/d9a/d3a/f26 737719 1 2024-09-17T01:01:59.907 INFO:tasks.workunit.client.1.smithi099.stdout:9/579: creat da/d21/d5b/fbc x:0 0 0 2024-09-17T01:01:59.908 INFO:tasks.workunit.client.0.smithi002.stdout:9/525: dwrite d5/dc/f3d [0,4194304] 0 2024-09-17T01:01:59.909 INFO:tasks.workunit.client.1.smithi099.stdout:9/580: mknod da/d56/da5/cbd 0 2024-09-17T01:01:59.910 INFO:tasks.workunit.client.1.smithi099.stdout:9/581: rmdir da/d14/d40/d6f 39 2024-09-17T01:01:59.910 INFO:tasks.workunit.client.0.smithi002.stdout:2/614: dread d1b/d37/d48/d78/f8e [0,4194304] 0 2024-09-17T01:01:59.911 INFO:tasks.workunit.client.1.smithi099.stdout:9/582: mknod da/d9a/d3a/cbe 0 2024-09-17T01:01:59.911 INFO:tasks.workunit.client.0.smithi002.stdout:0/454: dwrite dd/d19/f4e [0,4194304] 0 2024-09-17T01:01:59.911 INFO:tasks.workunit.client.0.smithi002.stdout:3/575: dwrite d0/f16 [0,4194304] 0 2024-09-17T01:01:59.911 INFO:tasks.workunit.client.0.smithi002.stdout:3/576: truncate d0/d31/d8b/fc2 671950 0 2024-09-17T01:01:59.913 INFO:tasks.workunit.client.0.smithi002.stdout:4/676: rename d7/d19/d9f/d54 to d7/d71/d8e/dd0 0 2024-09-17T01:01:59.914 INFO:tasks.workunit.client.0.smithi002.stdout:4/677: truncate d7/d19/d9f/d80/d62/f6a 849673 0 2024-09-17T01:01:59.914 INFO:tasks.workunit.client.0.smithi002.stdout:7/566: creat d1/d14/d1d/d28/d6b/d9e/d5e/fb0 x:0 0 0 2024-09-17T01:01:59.916 INFO:tasks.workunit.client.0.smithi002.stdout:1/576: dwrite d4/ff [0,4194304] 0 2024-09-17T01:01:59.917 INFO:tasks.workunit.client.0.smithi002.stdout:1/577: write d4/d11/f71 [699603,37755] 0 2024-09-17T01:01:59.917 INFO:tasks.workunit.client.0.smithi002.stdout:1/578: chown d4/d11/d12/d30/d5e/f77 1 1 2024-09-17T01:01:59.918 INFO:tasks.workunit.client.0.smithi002.stdout:3/577: truncate d0/d31/d32/f42 1034102 0 2024-09-17T01:01:59.918 INFO:tasks.workunit.client.0.smithi002.stdout:5/534: dread d2/f4 [4194304,4194304] 0 2024-09-17T01:01:59.918 INFO:tasks.workunit.client.0.smithi002.stdout:5/535: creat d2/d2d/d10/d9b/fa7 x:0 0 0 2024-09-17T01:01:59.918 INFO:tasks.workunit.client.0.smithi002.stdout:9/526: rename d5/dc/d26/f81 to d5/dc/d26/d46/d47/d89/f95 0 2024-09-17T01:01:59.919 INFO:tasks.workunit.client.0.smithi002.stdout:1/579: dread d4/d11/d1a/f6c [0,4194304] 0 2024-09-17T01:01:59.919 INFO:tasks.workunit.client.0.smithi002.stdout:4/678: mknod d7/d19/d9f/d80/cd1 0 2024-09-17T01:01:59.919 INFO:tasks.workunit.client.0.smithi002.stdout:4/679: write d7/d71/d8e/d95/fb0 [361610,115584] 0 2024-09-17T01:01:59.922 INFO:tasks.workunit.client.0.smithi002.stdout:7/567: getdents d1/d14/d1d/d29 0 2024-09-17T01:01:59.922 INFO:tasks.workunit.client.0.smithi002.stdout:7/568: creat d1/d24/fb1 x:0 0 0 2024-09-17T01:01:59.926 INFO:tasks.workunit.client.1.smithi099.stdout:9/583: write da/d50/f83 [2159737,45283] 0 2024-09-17T01:01:59.926 INFO:tasks.workunit.client.1.smithi099.stdout:6/596: dwrite dc/d1a/f71 [0,4194304] 0 2024-09-17T01:01:59.926 INFO:tasks.workunit.client.1.smithi099.stdout:6/597: fdatasync dc/d2b/f2c 0 2024-09-17T01:01:59.926 INFO:tasks.workunit.client.1.smithi099.stdout:6/598: dread - dc/d2b/f76 zero size 2024-09-17T01:01:59.929 INFO:tasks.workunit.client.1.smithi099.stdout:9/584: mkdir da/d8e/dbf 0 2024-09-17T01:01:59.929 INFO:tasks.workunit.client.0.smithi002.stdout:7/569: write d1/d14/d1d/d28/d2d/f35 [2810694,59827] 0 2024-09-17T01:01:59.930 INFO:tasks.workunit.client.1.smithi099.stdout:6/599: symlink dc/d27/d7e/dad/lc0 0 2024-09-17T01:01:59.931 INFO:tasks.workunit.client.1.smithi099.stdout:6/600: unlink dc/ld 0 2024-09-17T01:01:59.932 INFO:tasks.workunit.client.0.smithi002.stdout:3/578: link d0/d3/d17/d9a/f66 d0/d3/d37/dac/da1/fc5 0 2024-09-17T01:01:59.932 INFO:tasks.workunit.client.1.smithi099.stdout:3/614: sync 2024-09-17T01:01:59.932 INFO:tasks.workunit.client.1.smithi099.stdout:6/601: creat dc/d1a/d49/da8/fc1 x:0 0 0 2024-09-17T01:01:59.932 INFO:tasks.workunit.client.1.smithi099.stdout:6/602: chown dc/d1a/f26 6423132 1 2024-09-17T01:01:59.934 INFO:tasks.workunit.client.1.smithi099.stdout:2/512: sync 2024-09-17T01:01:59.934 INFO:tasks.workunit.client.1.smithi099.stdout:4/560: sync 2024-09-17T01:01:59.934 INFO:tasks.workunit.client.1.smithi099.stdout:6/603: link dc/d1a/d82/lac dc/d1a/d49/d4c/lc2 0 2024-09-17T01:01:59.934 INFO:tasks.workunit.client.1.smithi099.stdout:6/604: chown dc/d27/d7e/f94 40655 1 2024-09-17T01:01:59.934 INFO:tasks.workunit.client.1.smithi099.stdout:5/658: sync 2024-09-17T01:01:59.935 INFO:tasks.workunit.client.1.smithi099.stdout:6/605: mkdir dc/d5d/d66/dc3 0 2024-09-17T01:01:59.936 INFO:tasks.workunit.client.1.smithi099.stdout:5/659: unlink d2/dc/d17/c73 0 2024-09-17T01:01:59.937 INFO:tasks.workunit.client.1.smithi099.stdout:6/606: symlink dc/d5d/d66/d7a/d87/lc4 0 2024-09-17T01:01:59.938 INFO:tasks.workunit.client.0.smithi002.stdout:9/527: mknod d5/dc/d26/c96 0 2024-09-17T01:01:59.939 INFO:tasks.workunit.client.1.smithi099.stdout:5/660: truncate d2/f32 2542062 0 2024-09-17T01:01:59.940 INFO:tasks.workunit.client.0.smithi002.stdout:1/580: mkdir d4/d11/d1a/daa/dc2 0 2024-09-17T01:01:59.940 INFO:tasks.workunit.client.1.smithi099.stdout:6/607: mknod dc/d27/d58/d74/cc5 0 2024-09-17T01:01:59.942 INFO:tasks.workunit.client.1.smithi099.stdout:5/661: creat d2/dc4/d99/dd0/dc3/dc8/fd7 x:0 0 0 2024-09-17T01:01:59.942 INFO:tasks.workunit.client.1.smithi099.stdout:6/608: symlink dc/d5d/dae/d96/lc6 0 2024-09-17T01:01:59.945 INFO:tasks.workunit.client.1.smithi099.stdout:6/609: truncate dc/d1a/d49/f45 1079171 0 2024-09-17T01:01:59.945 INFO:tasks.workunit.client.1.smithi099.stdout:6/610: chown dc/c57 532 1 2024-09-17T01:01:59.947 INFO:tasks.workunit.client.0.smithi002.stdout:4/680: getdents d7/d19/d9f/d80/d62/d52/dc7/d77/d9b 0 2024-09-17T01:01:59.949 INFO:tasks.workunit.client.0.smithi002.stdout:8/694: write d2/d1c/d28/f81 [747518,18984] 0 2024-09-17T01:01:59.952 INFO:tasks.workunit.client.0.smithi002.stdout:3/579: mkdir d0/d31/d32/d90/dc6 0 2024-09-17T01:01:59.953 INFO:tasks.workunit.client.0.smithi002.stdout:1/581: mknod d4/d11/d12/d14/cc3 0 2024-09-17T01:01:59.954 INFO:tasks.workunit.client.0.smithi002.stdout:4/681: symlink d7/de/dc6/ld2 0 2024-09-17T01:01:59.954 INFO:tasks.workunit.client.0.smithi002.stdout:4/682: chown d7/d19/d9f/d80/d62/d52/dc7/d77/d9b/f57 406605 1 2024-09-17T01:01:59.955 INFO:tasks.workunit.client.0.smithi002.stdout:8/695: rename d2/d3/d5f/d98/da5/d4f/d58/c6f to d2/d1c/d28/da0/ce9 0 2024-09-17T01:01:59.955 INFO:tasks.workunit.client.1.smithi099.stdout:5/662: dread d2/dc/f66 [0,4194304] 0 2024-09-17T01:01:59.955 INFO:tasks.workunit.client.1.smithi099.stdout:6/611: write dc/d1a/d49/d4c/f5f [2371519,3226] 0 2024-09-17T01:01:59.955 INFO:tasks.workunit.client.1.smithi099.stdout:6/612: readlink dc/d5d/l80 0 2024-09-17T01:01:59.957 INFO:tasks.workunit.client.0.smithi002.stdout:2/615: dwrite d1b/d3f/d59/d7f/dc9/f51 [0,4194304] 0 2024-09-17T01:01:59.957 INFO:tasks.workunit.client.0.smithi002.stdout:3/580: mknod d0/d31/d32/d92/cc7 0 2024-09-17T01:01:59.957 INFO:tasks.workunit.client.0.smithi002.stdout:4/683: link d7/d19/d9f/d80/d62/d52/dc7/d77/l83 d7/d71/d8e/d95/ld3 0 2024-09-17T01:01:59.958 INFO:tasks.workunit.client.1.smithi099.stdout:6/613: link dc/c24 dc/d5d/d66/d7a/cc7 0 2024-09-17T01:01:59.958 INFO:tasks.workunit.client.1.smithi099.stdout:5/663: rmdir d2/d26 39 2024-09-17T01:01:59.959 INFO:tasks.workunit.client.1.smithi099.stdout:6/614: mkdir dc/d5d/d66/dc8 0 2024-09-17T01:01:59.959 INFO:tasks.workunit.client.0.smithi002.stdout:8/696: mknod d2/d26/dbb/cea 0 2024-09-17T01:01:59.960 INFO:tasks.workunit.client.1.smithi099.stdout:6/615: unlink dc/d2b/f2c 0 2024-09-17T01:01:59.961 INFO:tasks.workunit.client.1.smithi099.stdout:6/616: mkdir dc/d5d/dc9 0 2024-09-17T01:01:59.961 INFO:tasks.workunit.client.1.smithi099.stdout:6/617: dread - dc/d27/fbc zero size 2024-09-17T01:01:59.963 INFO:tasks.workunit.client.1.smithi099.stdout:6/618: rename dc/d1a/l41 to dc/d5d/d66/dc8/lca 0 2024-09-17T01:01:59.964 INFO:tasks.workunit.client.1.smithi099.stdout:6/619: unlink dc/c2a 0 2024-09-17T01:01:59.964 INFO:tasks.workunit.client.1.smithi099.stdout:6/620: symlink dc/d1a/d49/da8/lcb 0 2024-09-17T01:01:59.965 INFO:tasks.workunit.client.1.smithi099.stdout:6/621: creat dc/d5d/dc9/fcc x:0 0 0 2024-09-17T01:01:59.965 INFO:tasks.workunit.client.1.smithi099.stdout:6/622: read - dc/d1a/f92 zero size 2024-09-17T01:01:59.966 INFO:tasks.workunit.client.1.smithi099.stdout:6/623: rmdir dc/d1a 39 2024-09-17T01:01:59.966 INFO:tasks.workunit.client.1.smithi099.stdout:6/624: stat dc/c70 0 2024-09-17T01:01:59.966 INFO:tasks.workunit.client.0.smithi002.stdout:2/616: symlink d1b/d37/d48/d52/db5/ldb 0 2024-09-17T01:01:59.966 INFO:tasks.workunit.client.0.smithi002.stdout:8/697: dread d2/d30/f32 [0,4194304] 0 2024-09-17T01:01:59.966 INFO:tasks.workunit.client.0.smithi002.stdout:8/698: fdatasync d2/d26/dbb/fde 0 2024-09-17T01:01:59.966 INFO:tasks.workunit.client.0.smithi002.stdout:8/699: read - d2/d3/d5f/fb3 zero size 2024-09-17T01:01:59.966 INFO:tasks.workunit.client.0.smithi002.stdout:2/617: write d1b/d3f/d59/d7f/dc9/f87 [1487674,89051] 0 2024-09-17T01:01:59.966 INFO:tasks.workunit.client.0.smithi002.stdout:2/618: truncate d1b/d8a/d92/fa7 1044040 0 2024-09-17T01:01:59.967 INFO:tasks.workunit.client.0.smithi002.stdout:2/619: write d1b/d1d/f6e [98888,88704] 0 2024-09-17T01:01:59.967 INFO:tasks.workunit.client.1.smithi099.stdout:6/625: mknod dc/d1a/d49/da8/db3/ccd 0 2024-09-17T01:01:59.967 INFO:tasks.workunit.client.1.smithi099.stdout:6/626: stat dc/d1a/f40 0 2024-09-17T01:01:59.967 INFO:tasks.workunit.client.1.smithi099.stdout:6/627: write dc/d5d/d66/f67 [935630,34891] 0 2024-09-17T01:01:59.968 INFO:tasks.workunit.client.1.smithi099.stdout:6/628: stat dc/d1a/c46 0 2024-09-17T01:01:59.968 INFO:tasks.workunit.client.1.smithi099.stdout:6/629: mknod dc/d5d/d66/d7a/d87/cce 0 2024-09-17T01:01:59.968 INFO:tasks.workunit.client.1.smithi099.stdout:6/630: creat dc/d5d/dae/d96/d60/fcf x:0 0 0 2024-09-17T01:01:59.969 INFO:tasks.workunit.client.0.smithi002.stdout:2/620: creat d1b/d37/d48/d52/db5/fdc x:0 0 0 2024-09-17T01:01:59.969 INFO:tasks.workunit.client.0.smithi002.stdout:2/621: creat d1b/d74/fdd x:0 0 0 2024-09-17T01:01:59.969 INFO:tasks.workunit.client.1.smithi099.stdout:6/631: mkdir dc/d5d/dae/dd0 0 2024-09-17T01:01:59.969 INFO:tasks.workunit.client.1.smithi099.stdout:6/632: creat dc/d27/d7e/fd1 x:0 0 0 2024-09-17T01:01:59.969 INFO:tasks.workunit.client.1.smithi099.stdout:6/633: write fa [3375718,60861] 0 2024-09-17T01:01:59.981 INFO:tasks.workunit.client.0.smithi002.stdout:4/684: dwrite d7/de/d3a/f5e [0,4194304] 0 2024-09-17T01:01:59.981 INFO:tasks.workunit.client.0.smithi002.stdout:4/685: fdatasync d7/d71/d8e/fba 0 2024-09-17T01:01:59.981 INFO:tasks.workunit.client.0.smithi002.stdout:2/622: read d1b/d37/d48/d78/f83 [1574211,64377] 0 2024-09-17T01:01:59.982 INFO:tasks.workunit.client.0.smithi002.stdout:2/623: mknod d1b/d3f/d59/cde 0 2024-09-17T01:01:59.983 INFO:tasks.workunit.client.0.smithi002.stdout:2/624: symlink d1b/d37/ldf 0 2024-09-17T01:01:59.983 INFO:tasks.workunit.client.0.smithi002.stdout:2/625: dread - d1b/d74/f9f zero size 2024-09-17T01:01:59.984 INFO:tasks.workunit.client.0.smithi002.stdout:9/528: dwrite d5/dc/d26/d46/f50 [4194304,4194304] 0 2024-09-17T01:01:59.985 INFO:tasks.workunit.client.0.smithi002.stdout:9/529: rename d5/dc/d26/d5c/d6b/d75/d57/f64 to d5/dc/d26/d5c/d6b/d75/d36/f97 0 2024-09-17T01:01:59.986 INFO:tasks.workunit.client.0.smithi002.stdout:9/530: mknod d5/dc/d26/d5c/d6b/d75/d57/c98 0 2024-09-17T01:01:59.988 INFO:tasks.workunit.client.0.smithi002.stdout:0/455: dwrite dd/f5a [0,4194304] 0 2024-09-17T01:01:59.989 INFO:tasks.workunit.client.0.smithi002.stdout:4/686: dread d7/d19/d2e/f70 [0,4194304] 0 2024-09-17T01:01:59.991 INFO:tasks.workunit.client.1.smithi099.stdout:2/513: dwrite d2/d9/d17/d83/d8d/f91 [0,4194304] 0 2024-09-17T01:01:59.991 INFO:tasks.workunit.client.1.smithi099.stdout:2/514: dread - d2/d9/d17/d83/f8a zero size 2024-09-17T01:01:59.991 INFO:tasks.workunit.client.1.smithi099.stdout:4/561: dwrite d7/dd/de/f62 [0,4194304] 0 2024-09-17T01:01:59.992 INFO:tasks.workunit.client.0.smithi002.stdout:0/456: rename dd/d3d/f50 to dd/d19/d1a/f92 0 2024-09-17T01:01:59.992 INFO:tasks.workunit.client.0.smithi002.stdout:0/457: chown dd/d3d/f8d 90 1 2024-09-17T01:01:59.993 INFO:tasks.workunit.client.1.smithi099.stdout:5/664: dwrite f0 [0,4194304] 0 2024-09-17T01:01:59.995 INFO:tasks.workunit.client.1.smithi099.stdout:9/585: dwrite da/d14/d40/f65 [0,4194304] 0 2024-09-17T01:01:59.996 INFO:tasks.workunit.client.1.smithi099.stdout:2/515: creat d2/d9/d25/d26/d1b/d2c/d9b/fa2 x:0 0 0 2024-09-17T01:01:59.997 INFO:tasks.workunit.client.0.smithi002.stdout:8/700: dwrite d2/d3/d5f/f8f [0,4194304] 0 2024-09-17T01:01:59.997 INFO:tasks.workunit.client.0.smithi002.stdout:8/701: chown d2/d3/d5f/c5b 0 1 2024-09-17T01:01:59.997 INFO:tasks.workunit.client.0.smithi002.stdout:8/702: dread - d2/d1c/d28/dad/dcd/dd1/ddb/dcb/fd7 zero size 2024-09-17T01:02:00.003 INFO:tasks.workunit.client.0.smithi002.stdout:3/581: fsync d0/d3/d37/dac/da1/fc5 0 2024-09-17T01:02:00.004 INFO:tasks.workunit.client.0.smithi002.stdout:7/570: fsync d1/d24/fb1 0 2024-09-17T01:02:00.007 INFO:tasks.workunit.client.0.smithi002.stdout:3/582: rename d0/d3/d8d/fad to d0/d31/d32/d90/fc8 0 2024-09-17T01:02:00.007 INFO:tasks.workunit.client.0.smithi002.stdout:3/583: chown d0/d3/da8 8993526 1 2024-09-17T01:02:00.007 INFO:tasks.workunit.client.0.smithi002.stdout:3/584: chown d0/d31/d32/fb9 0 1 2024-09-17T01:02:00.007 INFO:tasks.workunit.client.0.smithi002.stdout:3/585: write d0/d3/d17/f6d [893932,3783] 0 2024-09-17T01:02:00.007 INFO:tasks.workunit.client.1.smithi099.stdout:2/516: write d2/d9/d25/d97/fa1 [3938209,17989] 0 2024-09-17T01:02:00.010 INFO:tasks.workunit.client.0.smithi002.stdout:3/586: link d0/f97 d0/d3/d33/d40/fc9 0 2024-09-17T01:02:00.010 INFO:tasks.workunit.client.0.smithi002.stdout:4/687: dwrite d7/de/f28 [4194304,4194304] 0 2024-09-17T01:02:00.015 INFO:tasks.workunit.client.0.smithi002.stdout:7/571: dread d1/d14/d1d/d28/d6b/f83 [0,4194304] 0 2024-09-17T01:02:00.015 INFO:tasks.workunit.client.0.smithi002.stdout:7/572: chown d1/dac 1086476 1 2024-09-17T01:02:00.015 INFO:tasks.workunit.client.0.smithi002.stdout:7/573: dread - d1/d14/d1d/f88 zero size 2024-09-17T01:02:00.016 INFO:tasks.workunit.client.0.smithi002.stdout:7/574: unlink d1/d14/f6c 0 2024-09-17T01:02:00.021 INFO:tasks.workunit.client.0.smithi002.stdout:7/575: dread d1/f26 [0,4194304] 0 2024-09-17T01:02:00.022 INFO:tasks.workunit.client.0.smithi002.stdout:7/576: chown d1/d14/d1d/d28/d6b/f72 2900 1 2024-09-17T01:02:00.022 INFO:tasks.workunit.client.1.smithi099.stdout:5/665: creat d2/dc4/d99/fd8 x:0 0 0 2024-09-17T01:02:00.022 INFO:tasks.workunit.client.1.smithi099.stdout:2/517: dread d2/d9/f60 [0,4194304] 0 2024-09-17T01:02:00.023 INFO:tasks.workunit.client.1.smithi099.stdout:5/666: read - d2/dc/d14/d36/fd3 zero size 2024-09-17T01:02:00.023 INFO:tasks.workunit.client.1.smithi099.stdout:5/667: creat d2/dc/d17/d3c/fd9 x:0 0 0 2024-09-17T01:02:00.023 INFO:tasks.workunit.client.1.smithi099.stdout:5/668: readlink d2/dc4/d90/da4/l91 0 2024-09-17T01:02:00.023 INFO:tasks.workunit.client.0.smithi002.stdout:7/577: getdents d1/d14/d1d/d28 0 2024-09-17T01:02:00.027 INFO:tasks.workunit.client.1.smithi099.stdout:9/586: rename c1 to da/d8e/d96/cc0 0 2024-09-17T01:02:00.029 INFO:tasks.workunit.client.1.smithi099.stdout:5/669: link d2/dc/la0 d2/d26/lda 0 2024-09-17T01:02:00.030 INFO:tasks.workunit.client.0.smithi002.stdout:4/688: dread d7/de/f2a [0,4194304] 0 2024-09-17T01:02:00.030 INFO:tasks.workunit.client.0.smithi002.stdout:9/531: dwrite d5/f3e [4194304,4194304] 0 2024-09-17T01:02:00.034 INFO:tasks.workunit.client.0.smithi002.stdout:9/532: getdents d5/dc/d26/d63 0 2024-09-17T01:02:00.034 INFO:tasks.workunit.client.0.smithi002.stdout:0/458: dwrite dd/d19/d1a/f92 [0,4194304] 0 2024-09-17T01:02:00.034 INFO:tasks.workunit.client.0.smithi002.stdout:0/459: read - dd/d19/d1c/d33/d67/f7f zero size 2024-09-17T01:02:00.036 INFO:tasks.workunit.client.0.smithi002.stdout:7/578: dread d1/d14/d1d/d28/d40/f5f [0,4194304] 0 2024-09-17T01:02:00.036 INFO:tasks.workunit.client.0.smithi002.stdout:3/587: dwrite d0/f97 [0,4194304] 0 2024-09-17T01:02:00.039 INFO:tasks.workunit.client.0.smithi002.stdout:0/460: creat dd/d19/d1c/d78/f93 x:0 0 0 2024-09-17T01:02:00.040 INFO:tasks.workunit.client.0.smithi002.stdout:3/588: mknod d0/d3/d33/d99/cca 0 2024-09-17T01:02:00.041 INFO:tasks.workunit.client.0.smithi002.stdout:9/533: dread d5/dc/d26/d5c/d6b/d75/f3f [0,4194304] 0 2024-09-17T01:02:00.046 INFO:tasks.workunit.client.0.smithi002.stdout:4/689: dread d7/d19/d9f/d80/fcb [0,4194304] 0 2024-09-17T01:02:00.046 INFO:tasks.workunit.client.0.smithi002.stdout:8/703: dwrite d2/f6b [0,4194304] 0 2024-09-17T01:02:00.047 INFO:tasks.workunit.client.1.smithi099.stdout:9/587: dwrite da/d56/da5/fa6 [0,4194304] 0 2024-09-17T01:02:00.047 INFO:tasks.workunit.client.1.smithi099.stdout:9/588: write da/d9a/d3a/d4b/f66 [6443835,119523] 0 2024-09-17T01:02:00.047 INFO:tasks.workunit.client.1.smithi099.stdout:9/589: rename da/d8e to da/d8e/dc1 22 2024-09-17T01:02:00.047 INFO:tasks.workunit.client.1.smithi099.stdout:9/590: chown da/d14/d40/d6f/c81 1 1 2024-09-17T01:02:00.047 INFO:tasks.workunit.client.1.smithi099.stdout:9/591: chown da/l13 0 1 2024-09-17T01:02:00.051 INFO:tasks.workunit.client.1.smithi099.stdout:9/592: symlink da/d8e/d96/lc2 0 2024-09-17T01:02:00.051 INFO:tasks.workunit.client.1.smithi099.stdout:9/593: write da/d14/d40/f65 [4968605,36157] 0 2024-09-17T01:02:00.051 INFO:tasks.workunit.client.1.smithi099.stdout:9/594: fsync da/d21/d2a/f7f 0 2024-09-17T01:02:00.051 INFO:tasks.workunit.client.1.smithi099.stdout:2/518: dwrite d2/d9/fa0 [0,4194304] 0 2024-09-17T01:02:00.051 INFO:tasks.workunit.client.0.smithi002.stdout:0/461: mkdir dd/d3d/d94 0 2024-09-17T01:02:00.053 INFO:tasks.workunit.client.0.smithi002.stdout:3/589: truncate d0/d3/d33/d93/fb0 223472 0 2024-09-17T01:02:00.055 INFO:tasks.workunit.client.1.smithi099.stdout:1/698: sync 2024-09-17T01:02:00.055 INFO:tasks.workunit.client.1.smithi099.stdout:7/550: sync 2024-09-17T01:02:00.055 INFO:tasks.workunit.client.1.smithi099.stdout:0/601: sync 2024-09-17T01:02:00.055 INFO:tasks.workunit.client.1.smithi099.stdout:1/699: fdatasync d0/d8/d49/d94/f6f 0 2024-09-17T01:02:00.055 INFO:tasks.workunit.client.1.smithi099.stdout:1/700: dread - d0/d8/d49/d94/fd7 zero size 2024-09-17T01:02:00.055 INFO:tasks.workunit.client.1.smithi099.stdout:1/701: creat d0/d8c/ff5 x:0 0 0 2024-09-17T01:02:00.055 INFO:tasks.workunit.client.1.smithi099.stdout:1/702: stat d0/d2/de/d70/de8/dd6/lde 0 2024-09-17T01:02:00.055 INFO:tasks.workunit.client.1.smithi099.stdout:1/703: readlink d0/d8/d38/d56/d93/lb4 0 2024-09-17T01:02:00.055 INFO:tasks.workunit.client.1.smithi099.stdout:1/704: fsync d0/d2/f25 0 2024-09-17T01:02:00.056 INFO:tasks.workunit.client.0.smithi002.stdout:9/534: creat d5/dc/f99 x:0 0 0 2024-09-17T01:02:00.056 INFO:tasks.workunit.client.0.smithi002.stdout:9/535: creat d5/dc/d26/d63/d66/f9a x:0 0 0 2024-09-17T01:02:00.056 INFO:tasks.workunit.client.0.smithi002.stdout:9/536: dread - d5/dc/d26/d5c/d6b/d75/d57/f5d zero size 2024-09-17T01:02:00.056 INFO:tasks.workunit.client.0.smithi002.stdout:9/537: dread - d5/dc/d26/d63/f94 zero size 2024-09-17T01:02:00.056 INFO:tasks.workunit.client.1.smithi099.stdout:0/602: mknod da/d3b/cc8 0 2024-09-17T01:02:00.057 INFO:tasks.workunit.client.0.smithi002.stdout:4/690: mkdir d7/de/d3a/dac/dd4 0 2024-09-17T01:02:00.058 INFO:tasks.workunit.client.0.smithi002.stdout:3/590: write d0/d3/d33/f7b [1238643,128462] 0 2024-09-17T01:02:00.058 INFO:tasks.workunit.client.0.smithi002.stdout:8/704: symlink d2/d3/d5f/d98/leb 0 2024-09-17T01:02:00.059 INFO:tasks.workunit.client.0.smithi002.stdout:8/705: write d2/d3/d5f/d98/da5/d71/d89/fa8 [131776,119404] 0 2024-09-17T01:02:00.060 INFO:tasks.workunit.client.1.smithi099.stdout:1/705: rename d0/d2/fe1 to d0/d8c/ff6 0 2024-09-17T01:02:00.060 INFO:tasks.workunit.client.1.smithi099.stdout:1/706: readlink d0/d2/dd8/ldb 0 2024-09-17T01:02:00.060 INFO:tasks.workunit.client.1.smithi099.stdout:8/576: sync 2024-09-17T01:02:00.060 INFO:tasks.workunit.client.0.smithi002.stdout:0/462: creat dd/d19/d1a/d29/d55/f95 x:0 0 0 2024-09-17T01:02:00.064 INFO:tasks.workunit.client.1.smithi099.stdout:0/603: link da/d12/d2b/l30 da/df/d4d/lc9 0 2024-09-17T01:02:00.064 INFO:tasks.workunit.client.1.smithi099.stdout:0/604: fsync da/df/d1a/d49/fa0 0 2024-09-17T01:02:00.065 INFO:tasks.workunit.client.1.smithi099.stdout:8/577: mkdir d0/d4/d64/dbe 0 2024-09-17T01:02:00.066 INFO:tasks.workunit.client.1.smithi099.stdout:2/519: write d2/d9/d25/d26/d1b/d2c/f48 [3257977,63991] 0 2024-09-17T01:02:00.066 INFO:tasks.workunit.client.0.smithi002.stdout:9/538: rename d5/dc/d26/d46/f6f to d5/dc/d26/d5c/d6b/f9b 0 2024-09-17T01:02:00.066 INFO:tasks.workunit.client.0.smithi002.stdout:4/691: creat d7/d19/d9f/fd5 x:0 0 0 2024-09-17T01:02:00.066 INFO:tasks.workunit.client.0.smithi002.stdout:3/591: dread d0/d3/d33/f55 [0,4194304] 0 2024-09-17T01:02:00.066 INFO:tasks.workunit.client.0.smithi002.stdout:3/592: read - d0/d3/d33/d40/fc3 zero size 2024-09-17T01:02:00.067 INFO:tasks.workunit.client.0.smithi002.stdout:0/463: dread dd/d19/d1a/d29/f52 [0,4194304] 0 2024-09-17T01:02:00.067 INFO:tasks.workunit.client.0.smithi002.stdout:0/464: creat dd/d19/d1a/f96 x:0 0 0 2024-09-17T01:02:00.067 INFO:tasks.workunit.client.0.smithi002.stdout:0/465: write dd/d19/d1c/d33/d67/f66 [943279,5839] 0 2024-09-17T01:02:00.067 INFO:tasks.workunit.client.0.smithi002.stdout:0/466: chown dd/d19/d1a/d29/d55/d56 908 1 2024-09-17T01:02:00.068 INFO:tasks.workunit.client.1.smithi099.stdout:0/605: symlink da/df/d20/lca 0 2024-09-17T01:02:00.068 INFO:tasks.workunit.client.1.smithi099.stdout:0/606: write da/df/d1a/d56/fc5 [443333,51217] 0 2024-09-17T01:02:00.068 INFO:tasks.workunit.client.0.smithi002.stdout:3/593: mkdir d0/d31/d32/dcb 0 2024-09-17T01:02:00.068 INFO:tasks.workunit.client.0.smithi002.stdout:3/594: chown d0/d31/d32/c5e 1707988 1 2024-09-17T01:02:00.068 INFO:tasks.workunit.client.0.smithi002.stdout:3/595: stat d0/d3/d17/d35 0 2024-09-17T01:02:00.069 INFO:tasks.workunit.client.1.smithi099.stdout:7/551: dread d1/d2c/d47/d48/d60/f91 [0,4194304] 0 2024-09-17T01:02:00.069 INFO:tasks.workunit.client.1.smithi099.stdout:9/595: dread da/d21/d2a/f8c [0,4194304] 0 2024-09-17T01:02:00.069 INFO:tasks.workunit.client.1.smithi099.stdout:5/670: dwrite d2/dc/d14/f20 [0,4194304] 0 2024-09-17T01:02:00.069 INFO:tasks.workunit.client.1.smithi099.stdout:5/671: write d2/f5 [17367,47882] 0 2024-09-17T01:02:00.069 INFO:tasks.workunit.client.1.smithi099.stdout:5/672: stat d2/d8/f35 0 2024-09-17T01:02:00.070 INFO:tasks.workunit.client.1.smithi099.stdout:8/578: mknod d0/d1f/d90/cbf 0 2024-09-17T01:02:00.071 INFO:tasks.workunit.client.0.smithi002.stdout:0/467: creat dd/d19/f97 x:0 0 0 2024-09-17T01:02:00.071 INFO:tasks.workunit.client.0.smithi002.stdout:4/692: dread d7/d19/d9f/d80/fcb [0,4194304] 0 2024-09-17T01:02:00.071 INFO:tasks.workunit.client.0.smithi002.stdout:4/693: dread - d7/d71/d8e/fba zero size 2024-09-17T01:02:00.071 INFO:tasks.workunit.client.0.smithi002.stdout:8/706: write d2/d41/f7d [5405461,117623] 0 2024-09-17T01:02:00.071 INFO:tasks.workunit.client.0.smithi002.stdout:0/468: truncate dd/f36 794727 0 2024-09-17T01:02:00.071 INFO:tasks.workunit.client.0.smithi002.stdout:0/469: write dd/d19/d1a/f96 [169842,63407] 0 2024-09-17T01:02:00.072 INFO:tasks.workunit.client.0.smithi002.stdout:8/707: creat d2/d3/d5f/d98/da5/d4f/d58/fec x:0 0 0 2024-09-17T01:02:00.072 INFO:tasks.workunit.client.0.smithi002.stdout:3/596: dread d0/d3/d33/d4f/f53 [0,4194304] 0 2024-09-17T01:02:00.073 INFO:tasks.workunit.client.0.smithi002.stdout:3/597: chown d0/d3/f1a 442877676 1 2024-09-17T01:02:00.074 INFO:tasks.workunit.client.0.smithi002.stdout:0/470: symlink dd/d19/d1c/d1f/d76/l98 0 2024-09-17T01:02:00.074 INFO:tasks.workunit.client.1.smithi099.stdout:2/520: unlink d2/d9/d25/d26/f5b 0 2024-09-17T01:02:00.074 INFO:tasks.workunit.client.1.smithi099.stdout:2/521: readlink d2/d9/d25/l92 0 2024-09-17T01:02:00.076 INFO:tasks.workunit.client.1.smithi099.stdout:0/607: symlink da/d12/d22/lcb 0 2024-09-17T01:02:00.076 INFO:tasks.workunit.client.0.smithi002.stdout:8/708: truncate d2/d3/d5f/d98/da5/d71/fbf 786007 0 2024-09-17T01:02:00.076 INFO:tasks.workunit.client.0.smithi002.stdout:8/709: write d2/d3/d5f/d98/fb7 [74389,50065] 0 2024-09-17T01:02:00.076 INFO:tasks.workunit.client.0.smithi002.stdout:8/710: fdatasync d2/d26/f69 0 2024-09-17T01:02:00.076 INFO:tasks.workunit.client.0.smithi002.stdout:8/711: readlink d2/d3/d5f/d98/da5/d71/l9e 0 2024-09-17T01:02:00.076 INFO:tasks.workunit.client.0.smithi002.stdout:8/712: chown d2/d1c/d28/dad/dcd/dd1 0 1 2024-09-17T01:02:00.078 INFO:tasks.workunit.client.0.smithi002.stdout:0/471: symlink dd/d19/d1c/d33/d67/d68/l99 0 2024-09-17T01:02:00.078 INFO:tasks.workunit.client.0.smithi002.stdout:0/472: write dd/d19/f3a [3321857,107044] 0 2024-09-17T01:02:00.078 INFO:tasks.workunit.client.0.smithi002.stdout:0/473: chown dd/d19/d1a/f5f 870409 1 2024-09-17T01:02:00.079 INFO:tasks.workunit.client.1.smithi099.stdout:7/552: truncate d1/d2c/d5c/d12/f4b 4007644 0 2024-09-17T01:02:00.083 INFO:tasks.workunit.client.0.smithi002.stdout:9/539: write d5/f49 [788093,78931] 0 2024-09-17T01:02:00.083 INFO:tasks.workunit.client.0.smithi002.stdout:7/579: dwrite d1/d14/d1d/d28/d2d/f70 [0,4194304] 0 2024-09-17T01:02:00.084 INFO:tasks.workunit.client.0.smithi002.stdout:9/540: write d5/dc/f4b [32927,84311] 0 2024-09-17T01:02:00.085 INFO:tasks.workunit.client.1.smithi099.stdout:5/673: rename d2/dc4/d90/da4/f3f to d2/d26/fdb 0 2024-09-17T01:02:00.088 INFO:tasks.workunit.client.0.smithi002.stdout:7/580: mknod d1/cb2 0 2024-09-17T01:02:00.088 INFO:tasks.workunit.client.0.smithi002.stdout:7/581: truncate d1/d14/d1d/d29/f85 30809 0 2024-09-17T01:02:00.088 INFO:tasks.workunit.client.0.smithi002.stdout:7/582: write d1/d14/d1d/d28/d86/f97 [209822,124757] 0 2024-09-17T01:02:00.088 INFO:tasks.workunit.client.0.smithi002.stdout:7/583: creat d1/d14/d1d/d28/d6b/d9e/d5e/fb3 x:0 0 0 2024-09-17T01:02:00.088 INFO:tasks.workunit.client.0.smithi002.stdout:7/584: write d1/f20 [2487479,35639] 0 2024-09-17T01:02:00.088 INFO:tasks.workunit.client.0.smithi002.stdout:7/585: fsync d1/d14/fad 0 2024-09-17T01:02:00.089 INFO:tasks.workunit.client.1.smithi099.stdout:2/522: symlink d2/d9/d25/d26/d1b/d2c/d5d/la3 0 2024-09-17T01:02:00.089 INFO:tasks.workunit.client.1.smithi099.stdout:0/608: mkdir da/d59/d80/d8c/dcc 0 2024-09-17T01:02:00.089 INFO:tasks.workunit.client.1.smithi099.stdout:0/609: chown da/df/d1a/d49/d68 1 1 2024-09-17T01:02:00.089 INFO:tasks.workunit.client.0.smithi002.stdout:4/694: write d7/de/fa6 [3130063,42452] 0 2024-09-17T01:02:00.090 INFO:tasks.workunit.client.0.smithi002.stdout:4/695: fdatasync d7/d19/d9f/f58 0 2024-09-17T01:02:00.090 INFO:tasks.workunit.client.0.smithi002.stdout:9/541: mkdir d5/dc/d26/d9c 0 2024-09-17T01:02:00.090 INFO:tasks.workunit.client.1.smithi099.stdout:7/553: mkdir d1/d2c/d7a/dac 0 2024-09-17T01:02:00.090 INFO:tasks.workunit.client.1.smithi099.stdout:5/674: rmdir d2/dc4/d99/dd0/db2 39 2024-09-17T01:02:00.092 INFO:tasks.workunit.client.1.smithi099.stdout:2/523: rename d2/d9/c15 to d2/d9/d17/ca4 0 2024-09-17T01:02:00.093 INFO:tasks.workunit.client.1.smithi099.stdout:0/610: mkdir da/df/d1a/d49/d71/dcd 0 2024-09-17T01:02:00.093 INFO:tasks.workunit.client.1.smithi099.stdout:0/611: chown da/l35 77 1 2024-09-17T01:02:00.093 INFO:tasks.workunit.client.1.smithi099.stdout:0/612: fsync da/df/d31/db0/d1e/f38 0 2024-09-17T01:02:00.094 INFO:tasks.workunit.client.0.smithi002.stdout:3/598: write d0/d3/d17/f20 [6624042,109832] 0 2024-09-17T01:02:00.095 INFO:tasks.workunit.client.1.smithi099.stdout:7/554: mknod d1/d36/cad 0 2024-09-17T01:02:00.095 INFO:tasks.workunit.client.1.smithi099.stdout:7/555: stat d1/d37/c6e 0 2024-09-17T01:02:00.095 INFO:tasks.workunit.client.1.smithi099.stdout:2/524: mknod d2/d9/d25/d26/d1b/d61/d7d/d85/d98/ca5 0 2024-09-17T01:02:00.096 INFO:tasks.workunit.client.1.smithi099.stdout:2/525: fdatasync d2/d9/d25/d26/f50 0 2024-09-17T01:02:00.097 INFO:tasks.workunit.client.1.smithi099.stdout:7/556: creat d1/d2c/fae x:0 0 0 2024-09-17T01:02:00.097 INFO:tasks.workunit.client.0.smithi002.stdout:9/542: mkdir d5/d8a/d9d 0 2024-09-17T01:02:00.101 INFO:tasks.workunit.client.0.smithi002.stdout:8/713: dread d2/d3/d5f/d98/da5/d4f/d58/f60 [0,4194304] 0 2024-09-17T01:02:00.101 INFO:tasks.workunit.client.0.smithi002.stdout:8/714: read - d2/d3/d5f/d98/da5/d4f/d77/d78/f88 zero size 2024-09-17T01:02:00.102 INFO:tasks.workunit.client.1.smithi099.stdout:8/579: dwrite d0/d4/f50 [0,4194304] 0 2024-09-17T01:02:00.102 INFO:tasks.workunit.client.1.smithi099.stdout:1/707: dwrite d0/d2/f24 [4194304,4194304] 0 2024-09-17T01:02:00.102 INFO:tasks.workunit.client.1.smithi099.stdout:1/708: fdatasync d0/d2/f73 0 2024-09-17T01:02:00.102 INFO:tasks.workunit.client.0.smithi002.stdout:0/474: read dd/d19/d1a/f1d [1353718,62113] 0 2024-09-17T01:02:00.105 INFO:tasks.workunit.client.1.smithi099.stdout:2/526: dread d2/d9/d25/d97/fa1 [0,4194304] 0 2024-09-17T01:02:00.106 INFO:tasks.workunit.client.0.smithi002.stdout:0/475: truncate dd/d19/d1c/f79 169640 0 2024-09-17T01:02:00.116 INFO:tasks.workunit.client.0.smithi002.stdout:8/715: write d2/d3/d5f/fa6 [3330507,11415] 0 2024-09-17T01:02:00.118 INFO:tasks.workunit.client.1.smithi099.stdout:7/557: creat d1/d37/d4f/faf x:0 0 0 2024-09-17T01:02:00.118 INFO:tasks.workunit.client.1.smithi099.stdout:7/558: readlink d1/d2c/d5c/d3f/l68 0 2024-09-17T01:02:00.118 INFO:tasks.workunit.client.1.smithi099.stdout:7/559: write d1/d2c/d5c/d1c/d5a/d76/f90 [542018,98168] 0 2024-09-17T01:02:00.120 INFO:tasks.workunit.client.0.smithi002.stdout:0/476: link dd/l10 dd/d19/d1c/d1f/d22/l9a 0 2024-09-17T01:02:00.120 INFO:tasks.workunit.client.0.smithi002.stdout:0/477: stat dd/d3d/l54 0 2024-09-17T01:02:00.121 INFO:tasks.workunit.client.1.smithi099.stdout:8/580: link d0/d1f/d31/f7b d0/d1f/d31/d4c/d8c/fc0 0 2024-09-17T01:02:00.121 INFO:tasks.workunit.client.1.smithi099.stdout:8/581: creat d0/d4/d29/fc1 x:0 0 0 2024-09-17T01:02:00.122 INFO:tasks.workunit.client.0.smithi002.stdout:9/543: dwrite d5/dc/d26/d5c/d6b/d75/f42 [0,4194304] 0 2024-09-17T01:02:00.122 INFO:tasks.workunit.client.0.smithi002.stdout:9/544: write d5/dc/d26/f31 [1337800,15566] 0 2024-09-17T01:02:00.122 INFO:tasks.workunit.client.0.smithi002.stdout:9/545: fsync d5/dc/d26/d63/d66/f78 0 2024-09-17T01:02:00.122 INFO:tasks.workunit.client.0.smithi002.stdout:9/546: write d5/f19 [424275,82745] 0 2024-09-17T01:02:00.122 INFO:tasks.workunit.client.0.smithi002.stdout:9/547: readlink d5/l37 0 2024-09-17T01:02:00.122 INFO:tasks.workunit.client.0.smithi002.stdout:9/548: write d5/dc/d26/d5c/d6b/d75/f76 [451447,74789] 0 2024-09-17T01:02:00.123 INFO:tasks.workunit.client.1.smithi099.stdout:1/709: symlink d0/d2/de/d70/de8/lf7 0 2024-09-17T01:02:00.125 INFO:tasks.workunit.client.1.smithi099.stdout:2/527: link d2/d9/d25/f2e d2/d9/d25/d26/d95/fa6 0 2024-09-17T01:02:00.125 INFO:tasks.workunit.client.0.smithi002.stdout:0/478: creat dd/d44/d84/f9b x:0 0 0 2024-09-17T01:02:00.125 INFO:tasks.workunit.client.0.smithi002.stdout:0/479: readlink dd/d19/d1a/d29/l91 0 2024-09-17T01:02:00.125 INFO:tasks.workunit.client.0.smithi002.stdout:0/480: read dd/f13 [51891,95074] 0 2024-09-17T01:02:00.128 INFO:tasks.workunit.client.1.smithi099.stdout:2/528: write d2/d9/d25/d26/f50 [97547,27612] 0 2024-09-17T01:02:00.128 INFO:tasks.workunit.client.0.smithi002.stdout:8/716: link d2/d3/d5f/d98/da5/d71/fbf d2/d1c/d28/dad/dcd/fed 0 2024-09-17T01:02:00.128 INFO:tasks.workunit.client.0.smithi002.stdout:8/717: symlink d2/d1c/d3b/lee 0 2024-09-17T01:02:00.128 INFO:tasks.workunit.client.0.smithi002.stdout:8/718: fsync d2/d1c/d28/dad/dcd/dd1/ddb/fc7 0 2024-09-17T01:02:00.129 INFO:tasks.workunit.client.1.smithi099.stdout:8/582: creat d0/d4/d64/dbe/fc2 x:0 0 0 2024-09-17T01:02:00.130 INFO:tasks.workunit.client.1.smithi099.stdout:1/710: unlink d0/d2/de/d70/de8/f9f 0 2024-09-17T01:02:00.134 INFO:tasks.workunit.client.1.smithi099.stdout:2/529: unlink d2/d9/d25/d26/d1b/d2c/d3f/f54 0 2024-09-17T01:02:00.137 INFO:tasks.workunit.client.1.smithi099.stdout:1/711: mknod d0/d8/d49/d4e/cf8 0 2024-09-17T01:02:00.140 INFO:tasks.workunit.client.0.smithi002.stdout:9/549: dread d5/dc/d26/f2e [0,4194304] 0 2024-09-17T01:02:00.140 INFO:tasks.workunit.client.1.smithi099.stdout:8/583: rename d0/d41/d5a/db2 to d0/d4/dc3 0 2024-09-17T01:02:00.140 INFO:tasks.workunit.client.1.smithi099.stdout:8/584: stat d0/d1f/c16 0 2024-09-17T01:02:00.141 INFO:tasks.workunit.client.1.smithi099.stdout:2/530: getdents d2/d9/d17/d83/d8d 0 2024-09-17T01:02:00.141 INFO:tasks.workunit.client.0.smithi002.stdout:9/550: symlink d5/dc/d26/d46/d47/l9e 0 2024-09-17T01:02:00.144 INFO:tasks.workunit.client.1.smithi099.stdout:8/585: symlink d0/d41/d5a/lc4 0 2024-09-17T01:02:00.144 INFO:tasks.workunit.client.1.smithi099.stdout:8/586: chown d0/d4/d29/d4b/fa6 57413417 1 2024-09-17T01:02:00.144 INFO:tasks.workunit.client.1.smithi099.stdout:8/587: truncate d0/d1f/d31/d4c/f67 938451 0 2024-09-17T01:02:00.144 INFO:tasks.workunit.client.1.smithi099.stdout:8/588: readlink d0/d1f/d31/d4c/l72 0 2024-09-17T01:02:00.148 INFO:tasks.workunit.client.0.smithi002.stdout:9/551: dread d5/dc/d26/d46/f50 [0,4194304] 0 2024-09-17T01:02:00.151 INFO:tasks.workunit.client.0.smithi002.stdout:4/696: dread d7/de/fa6 [0,4194304] 0 2024-09-17T01:02:00.151 INFO:tasks.workunit.client.0.smithi002.stdout:4/697: readlink d7/d71/d8e/la3 0 2024-09-17T01:02:00.153 INFO:tasks.workunit.client.0.smithi002.stdout:4/698: link d7/d19/d2e/c35 d7/de/cd6 0 2024-09-17T01:02:00.153 INFO:tasks.workunit.client.1.smithi099.stdout:5/675: dwrite d2/dc4/d90/da4/f75 [0,4194304] 0 2024-09-17T01:02:00.153 INFO:tasks.workunit.client.1.smithi099.stdout:9/596: dwrite da/f64 [8388608,4194304] 0 2024-09-17T01:02:00.154 INFO:tasks.workunit.client.0.smithi002.stdout:7/586: dwrite d1/d14/d1d/d21/d45/f43 [0,4194304] 0 2024-09-17T01:02:00.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:01:59 smithi002 ceph-mon[27650]: pgmap v253: 65 pgs: 65 active+clean; 1.9 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 211 MiB/s rd, 259 MiB/s wr, 528 op/s 2024-09-17T01:02:00.155 INFO:tasks.workunit.client.0.smithi002.stdout:0/481: dwrite dd/d19/d1a/f70 [0,4194304] 0 2024-09-17T01:02:00.155 INFO:tasks.workunit.client.0.smithi002.stdout:0/482: readlink dd/d3d/l4b 0 2024-09-17T01:02:00.155 INFO:tasks.workunit.client.1.smithi099.stdout:7/560: dwrite d1/f4 [0,4194304] 0 2024-09-17T01:02:00.155 INFO:tasks.workunit.client.1.smithi099.stdout:5/676: mknod d2/dc/d17/d6b/cdc 0 2024-09-17T01:02:00.156 INFO:tasks.workunit.client.1.smithi099.stdout:5/677: truncate d2/f7 1582802 0 2024-09-17T01:02:00.156 INFO:tasks.workunit.client.1.smithi099.stdout:5/678: dread - d2/dc/d17/d3c/da8/fc7 zero size 2024-09-17T01:02:00.158 INFO:tasks.workunit.client.1.smithi099.stdout:9/597: rename da/d8e/d96/ca9 to da/d18/cc3 0 2024-09-17T01:02:00.158 INFO:tasks.workunit.client.1.smithi099.stdout:9/598: fdatasync da/d21/d5b/fbc 0 2024-09-17T01:02:00.159 INFO:tasks.workunit.client.0.smithi002.stdout:4/699: dread d7/d19/d2e/f70 [0,4194304] 0 2024-09-17T01:02:00.159 INFO:tasks.workunit.client.0.smithi002.stdout:4/700: truncate d7/d19/d2e/f39 801798 0 2024-09-17T01:02:00.160 INFO:tasks.workunit.client.0.smithi002.stdout:8/719: dread d2/d3/d5f/d98/da5/d4f/d77/d78/f87 [0,4194304] 0 2024-09-17T01:02:00.160 INFO:tasks.workunit.client.0.smithi002.stdout:8/720: fdatasync d2/d26/dbb/fde 0 2024-09-17T01:02:00.161 INFO:tasks.workunit.client.1.smithi099.stdout:9/599: dread da/d21/d2a/f7f [0,4194304] 0 2024-09-17T01:02:00.163 INFO:tasks.workunit.client.0.smithi002.stdout:7/587: rmdir d1/d14/d1d/d28/d2d 39 2024-09-17T01:02:00.163 INFO:tasks.workunit.client.0.smithi002.stdout:7/588: write d1/d24/fb1 [646279,106452] 0 2024-09-17T01:02:00.165 INFO:tasks.workunit.client.0.smithi002.stdout:0/483: truncate dd/d19/d1a/f2b 3711926 0 2024-09-17T01:02:00.165 INFO:tasks.workunit.client.0.smithi002.stdout:0/484: chown dd/d19/d1c/d1f/f77 246 1 2024-09-17T01:02:00.165 INFO:tasks.workunit.client.0.smithi002.stdout:0/485: read dd/f13 [1629948,124872] 0 2024-09-17T01:02:00.165 INFO:tasks.workunit.client.1.smithi099.stdout:7/561: getdents d1/d2c 0 2024-09-17T01:02:00.166 INFO:tasks.workunit.client.0.smithi002.stdout:4/701: mkdir d7/d19/d9f/d9d/da4/dd7 0 2024-09-17T01:02:00.166 INFO:tasks.workunit.client.0.smithi002.stdout:7/589: mknod d1/d14/d1d/d28/cb4 0 2024-09-17T01:02:00.166 INFO:tasks.workunit.client.0.smithi002.stdout:7/590: chown d1/d24/laf 260 1 2024-09-17T01:02:00.167 INFO:tasks.workunit.client.1.smithi099.stdout:9/600: rmdir da/d9a/d3a/d4b 39 2024-09-17T01:02:00.168 INFO:tasks.workunit.client.0.smithi002.stdout:0/486: symlink dd/d3d/d94/l9c 0 2024-09-17T01:02:00.169 INFO:tasks.workunit.client.0.smithi002.stdout:7/591: creat d1/d14/d1d/d29/d98/fb5 x:0 0 0 2024-09-17T01:02:00.169 INFO:tasks.workunit.client.0.smithi002.stdout:7/592: write d1/d14/d1d/d29/f85 [255170,32292] 0 2024-09-17T01:02:00.169 INFO:tasks.workunit.client.0.smithi002.stdout:7/593: readlink d1/l9 0 2024-09-17T01:02:00.169 INFO:tasks.workunit.client.1.smithi099.stdout:5/679: dread d2/f32 [0,4194304] 0 2024-09-17T01:02:00.173 INFO:tasks.workunit.client.1.smithi099.stdout:2/531: dwrite d2/d9/d25/d26/d1b/d2c/d5d/f64 [0,4194304] 0 2024-09-17T01:02:00.174 INFO:tasks.workunit.client.1.smithi099.stdout:2/532: creat d2/d9/d25/d26/d1b/d2c/fa7 x:0 0 0 2024-09-17T01:02:00.174 INFO:tasks.workunit.client.1.smithi099.stdout:2/533: chown d2/d9/d25/d26/d1b/d61/f6f 15029710 1 2024-09-17T01:02:00.182 INFO:tasks.workunit.client.1.smithi099.stdout:9/601: write da/d14/d6d/f8a [1304734,50063] 0 2024-09-17T01:02:00.185 INFO:tasks.workunit.client.0.smithi002.stdout:7/594: dread d1/d14/d1d/d28/d6b/d9e/f84 [0,4194304] 0 2024-09-17T01:02:00.190 INFO:tasks.workunit.client.1.smithi099.stdout:5/680: write d2/dc/f42 [2514174,15085] 0 2024-09-17T01:02:00.190 INFO:tasks.workunit.client.1.smithi099.stdout:2/534: dread d2/d9/d25/d26/d1b/f74 [0,4194304] 0 2024-09-17T01:02:00.190 INFO:tasks.workunit.client.1.smithi099.stdout:2/535: rename d2/d9/d17/d83/d8d/d8f to d2/d9/d17/d83/d8d/d8f/da8 22 2024-09-17T01:02:00.191 INFO:tasks.workunit.client.1.smithi099.stdout:2/536: creat d2/d9/d25/d26/d1b/d2c/d3f/fa9 x:0 0 0 2024-09-17T01:02:00.191 INFO:tasks.workunit.client.1.smithi099.stdout:2/537: fsync d2/f1c 0 2024-09-17T01:02:00.191 INFO:tasks.workunit.client.1.smithi099.stdout:2/538: write d2/d9/d17/d83/f99 [358032,91637] 0 2024-09-17T01:02:00.192 INFO:tasks.workunit.client.1.smithi099.stdout:2/539: chown d2/d9/d17 1367512753 1 2024-09-17T01:02:00.192 INFO:tasks.workunit.client.1.smithi099.stdout:2/540: chown d2/d9/d25/d68 109 1 2024-09-17T01:02:00.192 INFO:tasks.workunit.client.1.smithi099.stdout:2/541: creat d2/d9/d17/d58/faa x:0 0 0 2024-09-17T01:02:00.192 INFO:tasks.workunit.client.1.smithi099.stdout:2/542: fdatasync d2/d9/d17/d58/faa 0 2024-09-17T01:02:00.193 INFO:tasks.workunit.client.1.smithi099.stdout:8/589: dwrite d0/d1f/d90/fb7 [0,4194304] 0 2024-09-17T01:02:00.193 INFO:tasks.workunit.client.0.smithi002.stdout:8/721: dwrite d2/f56 [0,4194304] 0 2024-09-17T01:02:00.193 INFO:tasks.workunit.client.0.smithi002.stdout:8/722: chown d2/d3/d5f/d98/da5/d4f/d77/d78/f7a 140 1 2024-09-17T01:02:00.194 INFO:tasks.workunit.client.1.smithi099.stdout:7/562: dwrite d1/d2c/d5c/d12/f7f [4194304,4194304] 0 2024-09-17T01:02:00.195 INFO:tasks.workunit.client.1.smithi099.stdout:8/590: mknod d0/d41/cc5 0 2024-09-17T01:02:00.195 INFO:tasks.workunit.client.0.smithi002.stdout:4/702: dwrite d7/d19/d9f/d80/fb5 [0,4194304] 0 2024-09-17T01:02:00.196 INFO:tasks.workunit.client.1.smithi099.stdout:7/563: truncate d1/d2c/d5c/f4a 1129626 0 2024-09-17T01:02:00.200 INFO:tasks.workunit.client.1.smithi099.stdout:8/591: rmdir d0/d41/d5a 39 2024-09-17T01:02:00.201 INFO:tasks.workunit.client.0.smithi002.stdout:8/723: read d2/d3/f6e [1633443,30400] 0 2024-09-17T01:02:00.201 INFO:tasks.workunit.client.0.smithi002.stdout:8/724: chown d2/d3/l2d 8187764 1 2024-09-17T01:02:00.202 INFO:tasks.workunit.client.1.smithi099.stdout:8/592: link d0/d4/d64/l9e d0/lc6 0 2024-09-17T01:02:00.203 INFO:tasks.workunit.client.0.smithi002.stdout:8/725: mknod d2/d1c/d28/cef 0 2024-09-17T01:02:00.203 INFO:tasks.workunit.client.0.smithi002.stdout:8/726: chown d2/d3/f6e 128 1 2024-09-17T01:02:00.206 INFO:tasks.workunit.client.1.smithi099.stdout:2/543: dread d2/d9/f60 [0,4194304] 0 2024-09-17T01:02:00.207 INFO:tasks.workunit.client.1.smithi099.stdout:8/593: dread d0/d4/d29/d4b/f8f [0,4194304] 0 2024-09-17T01:02:00.207 INFO:tasks.workunit.client.1.smithi099.stdout:8/594: chown d0/d53/fab 604645 1 2024-09-17T01:02:00.208 INFO:tasks.workunit.client.1.smithi099.stdout:8/595: link d0/d4/d64/dbe/fc2 d0/d1f/d55/fc7 0 2024-09-17T01:02:00.209 INFO:tasks.workunit.client.1.smithi099.stdout:8/596: stat d0/d1f/d55/l69 0 2024-09-17T01:02:00.209 INFO:tasks.workunit.client.1.smithi099.stdout:7/564: dread d1/d2c/f40 [0,4194304] 0 2024-09-17T01:02:00.209 INFO:tasks.workunit.client.1.smithi099.stdout:7/565: dread - d1/d2c/d7a/faa zero size 2024-09-17T01:02:00.210 INFO:tasks.workunit.client.1.smithi099.stdout:7/566: creat d1/d2c/d5c/d3f/fb0 x:0 0 0 2024-09-17T01:02:00.210 INFO:tasks.workunit.client.1.smithi099.stdout:7/567: readlink d1/d2c/d5c/d1c/d72/l9c 0 2024-09-17T01:02:00.210 INFO:tasks.workunit.client.1.smithi099.stdout:8/597: creat d0/d1f/d31/fc8 x:0 0 0 2024-09-17T01:02:00.210 INFO:tasks.workunit.client.0.smithi002.stdout:8/727: dread d2/d3/d5f/d98/da5/d71/d89/fa8 [0,4194304] 0 2024-09-17T01:02:00.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.211+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2826117955 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b84105120 con 0x7f2b7006eee0 2024-09-17T01:02:00.211 INFO:tasks.workunit.client.0.smithi002.stdout:8/728: creat d2/d3/d5f/d98/dab/ff0 x:0 0 0 2024-09-17T01:02:00.211 INFO:tasks.workunit.client.0.smithi002.stdout:8/729: write d2/d3/d5f/d98/da5/d4f/d77/d78/fce [530036,3696] 0 2024-09-17T01:02:00.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.213+0000 7f2b79ffb640 1 -- 172.21.15.2:0/2826117955 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f2b84105120 con 0x7f2b7006eee0 2024-09-17T01:02:00.212 INFO:tasks.workunit.client.0.smithi002.stdout:8/730: link d2/d3/d5f/d47/l91 d2/d3/d5f/d47/d80/lf1 0 2024-09-17T01:02:00.213 INFO:tasks.workunit.client.0.smithi002.stdout:8/731: symlink d2/d9/lf2 0 2024-09-17T01:02:00.213 INFO:tasks.workunit.client.0.smithi002.stdout:8/732: symlink d2/d30/lf3 0 2024-09-17T01:02:00.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.216+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2826117955 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2b7006eee0 msgr2=0x7f2b70071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:00.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.216+0000 7f2b8b5f6640 1 --2- 172.21.15.2:0/2826117955 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2b7006eee0 0x7f2b70071390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2b74006fd0 tx=0x7f2b74008040 comp rx=0 tx=0).stop 2024-09-17T01:02:00.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.216+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2826117955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b840fc520 msgr2=0x7f2b841066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:00.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.216+0000 7f2b8b5f6640 1 --2- 172.21.15.2:0/2826117955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b840fc520 0x7f2b841066f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b80003080 tx=0x7f2b80009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.216+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2826117955 shutdown_connections 2024-09-17T01:02:00.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.216+0000 7f2b8b5f6640 1 --2- 172.21.15.2:0/2826117955 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f2b7006eee0 0x7f2b70071390 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.216+0000 7f2b8b5f6640 1 --2- 172.21.15.2:0/2826117955 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b840fd7f0 0x7f2b84106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.216+0000 7f2b8b5f6640 1 --2- 172.21.15.2:0/2826117955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b840fc520 0x7f2b841066f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.216+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2826117955 >> 172.21.15.2:0/2826117955 conn(0x7f2b840f7ce0 msgr2=0x7f2b840f9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:00.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.216+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2826117955 shutdown_connections 2024-09-17T01:02:00.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.216+0000 7f2b8b5f6640 1 -- 172.21.15.2:0/2826117955 wait complete. 2024-09-17T01:02:00.216 INFO:tasks.workunit.client.0.smithi002.stdout:8/733: symlink d2/d41/lf4 0 2024-09-17T01:02:00.216 INFO:tasks.workunit.client.0.smithi002.stdout:8/734: write d2/d3/d5f/d98/da5/d4f/d77/d78/fc5 [4950970,5573] 0 2024-09-17T01:02:00.216 INFO:tasks.workunit.client.0.smithi002.stdout:8/735: dread - d2/d26/f7c zero size 2024-09-17T01:02:00.216 INFO:tasks.workunit.client.0.smithi002.stdout:8/736: creat d2/d1c/ff5 x:0 0 0 2024-09-17T01:02:00.216 INFO:tasks.workunit.client.0.smithi002.stdout:8/737: stat d2/d9/dd/cb2 0 2024-09-17T01:02:00.222 INFO:tasks.workunit.client.1.smithi099.stdout:2/544: dread d2/d9/d25/d26/d1b/d2c/f48 [0,4194304] 0 2024-09-17T01:02:00.222 INFO:tasks.workunit.client.1.smithi099.stdout:2/545: stat d2/d9/d25/d26/d1b/f7c 0 2024-09-17T01:02:00.222 INFO:tasks.workunit.client.1.smithi099.stdout:2/546: readlink d2/l81 0 2024-09-17T01:02:00.222 INFO:tasks.workunit.client.1.smithi099.stdout:2/547: rename d2/d9/d17/d83/d8d to d2/d9/d17/d83/d8d/dab 22 2024-09-17T01:02:00.223 INFO:tasks.workunit.client.1.smithi099.stdout:9/602: dwrite da/d14/f29 [0,4194304] 0 2024-09-17T01:02:00.224 INFO:tasks.workunit.client.0.smithi002.stdout:0/487: dwrite dd/d19/f3b [0,4194304] 0 2024-09-17T01:02:00.224 INFO:tasks.workunit.client.0.smithi002.stdout:4/703: dwrite d7/d19/d9f/d9d/fa2 [0,4194304] 0 2024-09-17T01:02:00.225 INFO:tasks.workunit.client.1.smithi099.stdout:7/568: dread d1/d2c/d5c/d1c/d5a/d6f/f8e [0,4194304] 0 2024-09-17T01:02:00.225 INFO:tasks.workunit.client.1.smithi099.stdout:7/569: fdatasync d1/d2c/f66 0 2024-09-17T01:02:00.226 INFO:tasks.workunit.client.1.smithi099.stdout:9/603: getdents da 0 2024-09-17T01:02:00.226 INFO:tasks.workunit.client.1.smithi099.stdout:9/604: write da/d21/d5b/fb1 [5052314,97122] 0 2024-09-17T01:02:00.226 INFO:tasks.workunit.client.0.smithi002.stdout:0/488: write dd/d19/f24 [2205238,15360] 0 2024-09-17T01:02:00.226 INFO:tasks.workunit.client.0.smithi002.stdout:0/489: write dd/d19/d1c/d1f/f77 [199314,47753] 0 2024-09-17T01:02:00.228 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:02:00.232 INFO:tasks.workunit.client.0.smithi002.stdout:0/490: mkdir dd/d19/d1c/d33/d67/d68/d9d 0 2024-09-17T01:02:00.232 INFO:tasks.workunit.client.0.smithi002.stdout:0/491: chown dd/d19/d1a/d29/c63 13278549 1 2024-09-17T01:02:00.233 INFO:tasks.workunit.client.1.smithi099.stdout:9/605: rename da/d21/c55 to da/d14/d40/d6f/cc4 0 2024-09-17T01:02:00.233 INFO:tasks.workunit.client.0.smithi002.stdout:0/492: mknod dd/d19/d1a/d29/d55/d61/c9e 0 2024-09-17T01:02:00.234 INFO:tasks.workunit.client.0.smithi002.stdout:7/595: getdents d1/d14/d1d/d29/d98 0 2024-09-17T01:02:00.236 INFO:tasks.workunit.client.0.smithi002.stdout:7/596: symlink d1/d14/d1d/d28/d6b/d9e/d5e/lb6 0 2024-09-17T01:02:00.236 INFO:tasks.workunit.client.0.smithi002.stdout:7/597: chown d1/d14/d1d/d28/d6b/f83 361 1 2024-09-17T01:02:00.237 INFO:tasks.workunit.client.0.smithi002.stdout:0/493: mkdir dd/d19/d9f 0 2024-09-17T01:02:00.237 INFO:tasks.workunit.client.0.smithi002.stdout:0/494: write dd/d19/d1c/d1f/d76/f80 [4306215,104337] 0 2024-09-17T01:02:00.238 INFO:tasks.workunit.client.1.smithi099.stdout:7/570: write d1/d2c/f66 [2669943,6399] 0 2024-09-17T01:02:00.239 INFO:tasks.workunit.client.0.smithi002.stdout:7/598: symlink d1/d14/d1d/d28/lb7 0 2024-09-17T01:02:00.239 INFO:tasks.workunit.client.0.smithi002.stdout:7/599: chown d1/d14/d1d/d28/d40/d58/f62 59162644 1 2024-09-17T01:02:00.240 INFO:tasks.workunit.client.1.smithi099.stdout:7/571: rename d1/d37/l99 to d1/d2c/d47/lb1 0 2024-09-17T01:02:00.241 INFO:tasks.workunit.client.1.smithi099.stdout:7/572: mkdir d1/d37/d78/db2 0 2024-09-17T01:02:00.243 INFO:tasks.workunit.client.0.smithi002.stdout:8/738: dwrite d2/d1c/f43 [4194304,4194304] 0 2024-09-17T01:02:00.243 INFO:tasks.workunit.client.0.smithi002.stdout:4/704: dwrite d7/d71/d8e/dd0/f5f [4194304,4194304] 0 2024-09-17T01:02:00.243 INFO:tasks.workunit.client.0.smithi002.stdout:4/705: truncate d7/de/fae 258202 0 2024-09-17T01:02:00.243 INFO:tasks.workunit.client.1.smithi099.stdout:2/548: dwrite d2/d9/d25/d26/f32 [0,4194304] 0 2024-09-17T01:02:00.243 INFO:tasks.workunit.client.1.smithi099.stdout:7/573: mkdir d1/d2c/d5c/d1c/d5a/db3 0 2024-09-17T01:02:00.244 INFO:tasks.workunit.client.1.smithi099.stdout:7/574: write d1/d2c/d5c/f34 [4405376,115899] 0 2024-09-17T01:02:00.246 INFO:tasks.workunit.client.1.smithi099.stdout:7/575: truncate d1/d2c/d5c/d1c/f61 7828839 0 2024-09-17T01:02:00.246 INFO:tasks.workunit.client.1.smithi099.stdout:9/606: dread da/d50/f60 [0,4194304] 0 2024-09-17T01:02:00.247 INFO:tasks.workunit.client.1.smithi099.stdout:7/576: mkdir d1/d2c/d7a/dac/db4 0 2024-09-17T01:02:00.247 INFO:tasks.workunit.client.1.smithi099.stdout:7/577: readlink d1/d2c/d5c/d12/l44 0 2024-09-17T01:02:00.248 INFO:tasks.workunit.client.1.smithi099.stdout:7/578: creat d1/d37/d78/fb5 x:0 0 0 2024-09-17T01:02:00.249 INFO:tasks.workunit.client.1.smithi099.stdout:9/607: truncate f6 426235 0 2024-09-17T01:02:00.249 INFO:tasks.workunit.client.1.smithi099.stdout:9/608: write da/d18/d5e/f67 [1056324,56677] 0 2024-09-17T01:02:00.250 INFO:tasks.workunit.client.1.smithi099.stdout:7/579: dread d1/d2c/d5c/d3f/f92 [0,4194304] 0 2024-09-17T01:02:00.251 INFO:tasks.workunit.client.0.smithi002.stdout:4/706: creat d7/d19/d9f/d9d/da4/fd8 x:0 0 0 2024-09-17T01:02:00.251 INFO:tasks.workunit.client.0.smithi002.stdout:8/739: dread d2/d3/d5f/f8f [0,4194304] 0 2024-09-17T01:02:00.251 INFO:tasks.workunit.client.1.smithi099.stdout:9/609: mknod da/d14/d40/cc5 0 2024-09-17T01:02:00.251 INFO:tasks.workunit.client.0.smithi002.stdout:4/707: symlink d7/d3f/ld9 0 2024-09-17T01:02:00.252 INFO:tasks.workunit.client.0.smithi002.stdout:8/740: symlink d2/d3/d5f/d98/da5/d4f/d77/dd9/lf6 0 2024-09-17T01:02:00.253 INFO:tasks.workunit.client.0.smithi002.stdout:0/495: dwrite dd/d19/f3b [0,4194304] 0 2024-09-17T01:02:00.253 INFO:tasks.workunit.client.0.smithi002.stdout:0/496: creat dd/d19/d1c/fa0 x:0 0 0 2024-09-17T01:02:00.253 INFO:tasks.workunit.client.0.smithi002.stdout:0/497: truncate dd/d19/d1a/d29/d55/f5b 704596 0 2024-09-17T01:02:00.253 INFO:tasks.workunit.client.1.smithi099.stdout:7/580: rmdir d1/d8f 39 2024-09-17T01:02:00.254 INFO:tasks.workunit.client.0.smithi002.stdout:4/708: rename d7/d71/d8b to d7/de/dda 0 2024-09-17T01:02:00.254 INFO:tasks.workunit.client.1.smithi099.stdout:9/610: rmdir da/d9a 39 2024-09-17T01:02:00.256 INFO:tasks.workunit.client.1.smithi099.stdout:7/581: mkdir d1/d2c/d5c/d1c/d5a/d6f/db6 0 2024-09-17T01:02:00.256 INFO:tasks.workunit.client.1.smithi099.stdout:7/582: read - d1/d37/d4f/faf zero size 2024-09-17T01:02:00.256 INFO:tasks.workunit.client.1.smithi099.stdout:7/583: read - d1/d8f/f95 zero size 2024-09-17T01:02:00.256 INFO:tasks.workunit.client.1.smithi099.stdout:7/584: truncate d1/d2c/d5c/d12/f53 385930 0 2024-09-17T01:02:00.256 INFO:tasks.workunit.client.0.smithi002.stdout:0/498: rmdir dd/d19/d1a/d29 39 2024-09-17T01:02:00.257 INFO:tasks.workunit.client.1.smithi099.stdout:2/549: dread d2/d9/d25/d26/d1b/d2c/f36 [0,4194304] 0 2024-09-17T01:02:00.258 INFO:tasks.workunit.client.1.smithi099.stdout:9/611: rename da/d14/d6d/l73 to da/d18/lc6 0 2024-09-17T01:02:00.259 INFO:tasks.workunit.client.0.smithi002.stdout:4/709: link d7/d19/d9f/d80/c9e d7/d19/d4a/cdb 0 2024-09-17T01:02:00.259 INFO:tasks.workunit.client.0.smithi002.stdout:4/710: chown d7/d71/d8e/fba 4560954 1 2024-09-17T01:02:00.259 INFO:tasks.workunit.client.1.smithi099.stdout:2/550: symlink d2/d9/d25/d26/d1b/d61/d7d/lac 0 2024-09-17T01:02:00.261 INFO:tasks.workunit.client.0.smithi002.stdout:4/711: mknod d7/d19/d9f/cdc 0 2024-09-17T01:02:00.261 INFO:tasks.workunit.client.1.smithi099.stdout:9/612: truncate da/d14/f29 1745171 0 2024-09-17T01:02:00.261 INFO:tasks.workunit.client.1.smithi099.stdout:9/613: creat da/d50/fc7 x:0 0 0 2024-09-17T01:02:00.263 INFO:tasks.workunit.client.0.smithi002.stdout:4/712: mknod d7/de/d3a/dac/cdd 0 2024-09-17T01:02:00.264 INFO:tasks.workunit.client.0.smithi002.stdout:7/600: rmdir d1/d14/d1d 39 2024-09-17T01:02:00.264 INFO:tasks.workunit.client.1.smithi099.stdout:9/614: creat da/d8e/d96/fc8 x:0 0 0 2024-09-17T01:02:00.265 INFO:tasks.workunit.client.1.smithi099.stdout:9/615: chown da/d18/d5e/f9e 181 1 2024-09-17T01:02:00.265 INFO:tasks.workunit.client.1.smithi099.stdout:9/616: read - da/d8e/d96/fc8 zero size 2024-09-17T01:02:00.265 INFO:tasks.workunit.client.1.smithi099.stdout:9/617: creat da/d14/d62/fc9 x:0 0 0 2024-09-17T01:02:00.266 INFO:tasks.workunit.client.0.smithi002.stdout:4/713: rename d7/de/d3a/dac/dd4 to d7/d19/d9f/dc2/dde 0 2024-09-17T01:02:00.268 INFO:tasks.workunit.client.1.smithi099.stdout:9/618: symlink da/d14/lca 0 2024-09-17T01:02:00.268 INFO:tasks.workunit.client.1.smithi099.stdout:9/619: stat da/d14/lca 0 2024-09-17T01:02:00.268 INFO:tasks.workunit.client.1.smithi099.stdout:2/551: write d2/d9/d25/d26/f33 [358521,77178] 0 2024-09-17T01:02:00.268 INFO:tasks.workunit.client.1.smithi099.stdout:7/585: dread d1/d2c/fa6 [0,4194304] 0 2024-09-17T01:02:00.268 INFO:tasks.workunit.client.1.smithi099.stdout:7/586: fdatasync d1/d2c/d5c/d12/f2b 0 2024-09-17T01:02:00.269 INFO:tasks.workunit.client.0.smithi002.stdout:4/714: rename d7/d19/d9f/d80/d62/f6f to d7/d19/fdf 0 2024-09-17T01:02:00.269 INFO:tasks.workunit.client.0.smithi002.stdout:8/741: dwrite d2/d9/dd/f92 [0,4194304] 0 2024-09-17T01:02:00.269 INFO:tasks.workunit.client.1.smithi099.stdout:7/587: read d1/d2c/d47/f50 [4360179,22403] 0 2024-09-17T01:02:00.269 INFO:tasks.workunit.client.1.smithi099.stdout:9/620: creat da/d56/d84/db9/fcb x:0 0 0 2024-09-17T01:02:00.269 INFO:tasks.workunit.client.0.smithi002.stdout:7/601: rename d1/d14/d1d/d28/d6b/d9e/f90 to d1/d14/d1d/d29/d57/fb8 0 2024-09-17T01:02:00.270 INFO:tasks.workunit.client.0.smithi002.stdout:4/715: unlink d7/de/d32/d59/c93 0 2024-09-17T01:02:00.271 INFO:tasks.workunit.client.0.smithi002.stdout:8/742: mknod d2/d9/dd/cf7 0 2024-09-17T01:02:00.271 INFO:tasks.workunit.client.0.smithi002.stdout:8/743: creat d2/d1c/ff8 x:0 0 0 2024-09-17T01:02:00.272 INFO:tasks.workunit.client.0.smithi002.stdout:8/744: readlink d2/d1c/l76 0 2024-09-17T01:02:00.273 INFO:tasks.workunit.client.0.smithi002.stdout:7/602: rmdir d1/d14/d1d/d28/d6b 39 2024-09-17T01:02:00.273 INFO:tasks.workunit.client.1.smithi099.stdout:7/588: creat d1/fb7 x:0 0 0 2024-09-17T01:02:00.273 INFO:tasks.workunit.client.1.smithi099.stdout:7/589: creat d1/d37/d4f/fb8 x:0 0 0 2024-09-17T01:02:00.274 INFO:tasks.workunit.client.0.smithi002.stdout:6/615: sync 2024-09-17T01:02:00.276 INFO:tasks.workunit.client.1.smithi099.stdout:9/621: symlink da/d14/d62/dad/lcc 0 2024-09-17T01:02:00.279 INFO:tasks.workunit.client.0.smithi002.stdout:0/499: truncate dd/d19/f3b 1485092 0 2024-09-17T01:02:00.279 INFO:tasks.workunit.client.0.smithi002.stdout:0/500: write dd/d19/d1c/d33/d67/f7f [424358,20543] 0 2024-09-17T01:02:00.280 INFO:tasks.workunit.client.1.smithi099.stdout:7/590: unlink d1/d36/d8d/ca7 0 2024-09-17T01:02:00.282 INFO:tasks.workunit.client.1.smithi099.stdout:9/622: link da/d14/d40/f65 da/d14/d48/d69/d6c/fcd 0 2024-09-17T01:02:00.282 INFO:tasks.workunit.client.1.smithi099.stdout:9/623: creat da/d14/d48/d69/d6c/fce x:0 0 0 2024-09-17T01:02:00.283 INFO:tasks.workunit.client.0.smithi002.stdout:7/603: getdents d1/d14/d1d/d28/d40/d58 0 2024-09-17T01:02:00.284 INFO:tasks.workunit.client.1.smithi099.stdout:7/591: link d1/d36/f45 d1/d2c/d7a/dac/fb9 0 2024-09-17T01:02:00.285 INFO:tasks.workunit.client.0.smithi002.stdout:4/716: rename d7/d19/fdf to d7/d19/d9f/d80/d62/dbe/fe0 0 2024-09-17T01:02:00.285 INFO:tasks.workunit.client.0.smithi002.stdout:4/717: creat d7/d19/d9f/d9d/da4/fe1 x:0 0 0 2024-09-17T01:02:00.285 INFO:tasks.workunit.client.0.smithi002.stdout:4/718: fsync d7/f12 0 2024-09-17T01:02:00.285 INFO:tasks.workunit.client.0.smithi002.stdout:7/604: symlink d1/d14/d1d/d28/lb9 0 2024-09-17T01:02:00.286 INFO:tasks.workunit.client.1.smithi099.stdout:2/552: rename d2/d7 to d2/d9/d25/d26/d1b/dad 0 2024-09-17T01:02:00.286 INFO:tasks.workunit.client.0.smithi002.stdout:7/605: read d1/d14/d1d/d21/d45/fa9 [459686,23804] 0 2024-09-17T01:02:00.288 INFO:tasks.workunit.client.1.smithi099.stdout:7/592: rename d1/d2c/d5c/d12/l39 to d1/d2c/d5c/d1c/d5a/d6f/lba 0 2024-09-17T01:02:00.289 INFO:tasks.workunit.client.1.smithi099.stdout:2/553: mkdir d2/d9/d17/d83/dae 0 2024-09-17T01:02:00.290 INFO:tasks.workunit.client.0.smithi002.stdout:7/606: link d1/d14/d1d/d28/d6b/d9e/d5e/lb6 d1/d14/d1d/d28/d6b/lba 0 2024-09-17T01:02:00.291 INFO:tasks.workunit.client.1.smithi099.stdout:9/624: write da/d14/d48/d69/d6c/fcd [783973,76377] 0 2024-09-17T01:02:00.292 INFO:tasks.workunit.client.1.smithi099.stdout:9/625: dread - da/d14/d48/d69/d6c/fce zero size 2024-09-17T01:02:00.292 INFO:tasks.workunit.client.0.smithi002.stdout:0/501: rename dd/c31 to dd/d44/ca1 0 2024-09-17T01:02:00.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:01:59 smithi099 ceph-mon[34357]: pgmap v253: 65 pgs: 65 active+clean; 1.9 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 211 MiB/s rd, 259 MiB/s wr, 528 op/s 2024-09-17T01:02:00.293 INFO:tasks.workunit.client.1.smithi099.stdout:9/626: mknod da/d8e/dbf/ccf 0 2024-09-17T01:02:00.293 INFO:tasks.workunit.client.1.smithi099.stdout:9/627: dread - da/d56/d84/db9/fcb zero size 2024-09-17T01:02:00.293 INFO:tasks.workunit.client.1.smithi099.stdout:9/628: creat da/d14/d62/fd0 x:0 0 0 2024-09-17T01:02:00.294 INFO:tasks.workunit.client.0.smithi002.stdout:4/719: getdents d7/d71/d8e/d95 0 2024-09-17T01:02:00.294 INFO:tasks.workunit.client.0.smithi002.stdout:4/720: write d7/d3f/fb1 [1047322,59505] 0 2024-09-17T01:02:00.294 INFO:tasks.workunit.client.1.smithi099.stdout:2/554: dread d2/d9/d25/d26/f6b [0,4194304] 0 2024-09-17T01:02:00.294 INFO:tasks.workunit.client.1.smithi099.stdout:2/555: write d2/d9/f1f [4803520,4496] 0 2024-09-17T01:02:00.294 INFO:tasks.workunit.client.1.smithi099.stdout:2/556: write d2/d9/d25/d26/d1b/d61/f6f [1342716,40527] 0 2024-09-17T01:02:00.294 INFO:tasks.workunit.client.1.smithi099.stdout:9/629: getdents da/d8e 0 2024-09-17T01:02:00.294 INFO:tasks.workunit.client.0.smithi002.stdout:7/607: mkdir d1/d14/d1d/d29/d57/dbb 0 2024-09-17T01:02:00.295 INFO:tasks.workunit.client.1.smithi099.stdout:2/557: creat d2/d9/d25/d26/faf x:0 0 0 2024-09-17T01:02:00.295 INFO:tasks.workunit.client.1.smithi099.stdout:2/558: fsync d2/d9/d25/d26/d1b/d2c/d9b/fa2 0 2024-09-17T01:02:00.295 INFO:tasks.workunit.client.1.smithi099.stdout:9/630: rmdir da/d14/d48 39 2024-09-17T01:02:00.295 INFO:tasks.workunit.client.1.smithi099.stdout:9/631: read - da/d14/d48/d69/d6c/fce zero size 2024-09-17T01:02:00.296 INFO:tasks.workunit.client.0.smithi002.stdout:0/502: stat dd/c16 0 2024-09-17T01:02:00.296 INFO:tasks.workunit.client.0.smithi002.stdout:0/503: creat dd/d19/d1c/d1f/d76/fa2 x:0 0 0 2024-09-17T01:02:00.296 INFO:tasks.workunit.client.0.smithi002.stdout:0/504: chown dd/d19/f24 8601157 1 2024-09-17T01:02:00.296 INFO:tasks.workunit.client.0.smithi002.stdout:0/505: chown dd/d3d/l5d 1598 1 2024-09-17T01:02:00.296 INFO:tasks.workunit.client.0.smithi002.stdout:0/506: stat dd/d44/l69 0 2024-09-17T01:02:00.297 INFO:tasks.workunit.client.1.smithi099.stdout:2/559: symlink d2/d9/d17/d83/dae/lb0 0 2024-09-17T01:02:00.297 INFO:tasks.workunit.client.0.smithi002.stdout:4/721: mknod d7/d19/d9f/d9d/ce2 0 2024-09-17T01:02:00.299 INFO:tasks.workunit.client.0.smithi002.stdout:7/608: rename d1/d14/d1d/d28/d2d/c9b to d1/d14/d1d/d28/d8f/cbc 0 2024-09-17T01:02:00.299 INFO:tasks.workunit.client.0.smithi002.stdout:7/609: write d1/d14/d1d/d28/f4f [1300687,66611] 0 2024-09-17T01:02:00.299 INFO:tasks.workunit.client.1.smithi099.stdout:2/560: mkdir d2/d9/d25/d26/d1b/d2c/d9b/db1 0 2024-09-17T01:02:00.300 INFO:tasks.workunit.client.1.smithi099.stdout:7/593: write d1/d2c/d5c/d12/f32 [2755614,53186] 0 2024-09-17T01:02:00.300 INFO:tasks.workunit.client.1.smithi099.stdout:7/594: creat d1/d2c/d5c/fbb x:0 0 0 2024-09-17T01:02:00.300 INFO:tasks.workunit.client.1.smithi099.stdout:7/595: chown d1/d2c/d5c/d1c/d5a/d76/f90 29308499 1 2024-09-17T01:02:00.302 INFO:tasks.workunit.client.1.smithi099.stdout:2/561: link d2/d9/d25/d26/d1b/d2c/d3f/l56 d2/d9/d25/d68/lb2 0 2024-09-17T01:02:00.302 INFO:tasks.workunit.client.1.smithi099.stdout:2/562: read d2/d9/d25/d97/fa1 [713634,55611] 0 2024-09-17T01:02:00.302 INFO:tasks.workunit.client.1.smithi099.stdout:2/563: stat d2/d9/l7f 0 2024-09-17T01:02:00.303 INFO:tasks.workunit.client.0.smithi002.stdout:7/610: creat d1/d14/d1d/fbd x:0 0 0 2024-09-17T01:02:00.306 INFO:tasks.workunit.client.0.smithi002.stdout:5/536: sync 2024-09-17T01:02:00.306 INFO:tasks.workunit.client.0.smithi002.stdout:5/537: chown d2/d2d/d10/d20/d24/f77 856 1 2024-09-17T01:02:00.307 INFO:tasks.workunit.client.0.smithi002.stdout:5/538: dread - d2/de/fa4 zero size 2024-09-17T01:02:00.313 INFO:tasks.workunit.client.0.smithi002.stdout:0/507: read dd/f15 [41908,110311] 0 2024-09-17T01:02:00.313 INFO:tasks.workunit.client.0.smithi002.stdout:0/508: write dd/f32 [1800899,49262] 0 2024-09-17T01:02:00.314 INFO:tasks.workunit.client.0.smithi002.stdout:0/509: dread - dd/d19/f6f zero size 2024-09-17T01:02:00.316 INFO:tasks.workunit.client.0.smithi002.stdout:0/510: stat dd/d19/f34 0 2024-09-17T01:02:00.317 INFO:tasks.workunit.client.1.smithi099.stdout:7/596: dread d1/d2c/f2d [0,4194304] 0 2024-09-17T01:02:00.318 INFO:tasks.workunit.client.0.smithi002.stdout:0/511: link dd/d19/f1b dd/d44/d84/fa3 0 2024-09-17T01:02:00.318 INFO:tasks.workunit.client.0.smithi002.stdout:0/512: write dd/d44/d84/f9b [989154,35732] 0 2024-09-17T01:02:00.318 INFO:tasks.workunit.client.0.smithi002.stdout:0/513: dread - dd/d3d/f85 zero size 2024-09-17T01:02:00.319 INFO:tasks.workunit.client.1.smithi099.stdout:9/632: dwrite da/d18/d5e/fb6 [0,4194304] 0 2024-09-17T01:02:00.319 INFO:tasks.workunit.client.1.smithi099.stdout:9/633: write da/d21/d5b/fbc [578110,7363] 0 2024-09-17T01:02:00.320 INFO:tasks.workunit.client.0.smithi002.stdout:0/514: unlink dd/d19/d1c/d33/d67/d68/c7e 0 2024-09-17T01:02:00.320 INFO:tasks.workunit.client.1.smithi099.stdout:7/597: rename d1/d2c/d47/d48/l59 to d1/d2c/d5c/d3f/lbc 0 2024-09-17T01:02:00.322 INFO:tasks.workunit.client.1.smithi099.stdout:9/634: rename da/d14/d40/d6f/c81 to da/cd1 0 2024-09-17T01:02:00.322 INFO:tasks.workunit.client.1.smithi099.stdout:9/635: write da/d18/d5e/f9e [179125,49326] 0 2024-09-17T01:02:00.322 INFO:tasks.workunit.client.1.smithi099.stdout:9/636: chown da/d56/d84/db9/fcb 4055 1 2024-09-17T01:02:00.322 INFO:tasks.workunit.client.0.smithi002.stdout:0/515: mknod dd/d19/d1a/d29/d55/ca4 0 2024-09-17T01:02:00.323 INFO:tasks.workunit.client.1.smithi099.stdout:7/598: symlink d1/d2c/d5c/d3f/lbd 0 2024-09-17T01:02:00.323 INFO:tasks.workunit.client.0.smithi002.stdout:4/722: dwrite d7/d19/d9f/fd5 [0,4194304] 0 2024-09-17T01:02:00.323 INFO:tasks.workunit.client.0.smithi002.stdout:4/723: stat d7/d19/d9f/fb3 0 2024-09-17T01:02:00.324 INFO:tasks.workunit.client.1.smithi099.stdout:7/599: mknod d1/d2c/d47/d48/d60/cbe 0 2024-09-17T01:02:00.325 INFO:tasks.workunit.client.0.smithi002.stdout:0/516: creat dd/fa5 x:0 0 0 2024-09-17T01:02:00.325 INFO:tasks.workunit.client.1.smithi099.stdout:7/600: mkdir d1/d2c/d5c/d1c/d5a/d76/dbf 0 2024-09-17T01:02:00.329 INFO:tasks.workunit.client.0.smithi002.stdout:4/724: rmdir d7/d19/d9f/db2 39 2024-09-17T01:02:00.331 INFO:tasks.workunit.client.0.smithi002.stdout:0/517: symlink dd/d19/d1a/d29/d55/d56/la6 0 2024-09-17T01:02:00.331 INFO:tasks.workunit.client.0.smithi002.stdout:5/539: dwrite d2/d2d/d10/d9b/fa0 [0,4194304] 0 2024-09-17T01:02:00.331 INFO:tasks.workunit.client.0.smithi002.stdout:5/540: truncate d2/d2d/d10/d9b/fa2 510977 0 2024-09-17T01:02:00.332 INFO:tasks.workunit.client.1.smithi099.stdout:9/637: write da/d50/f86 [2543281,78503] 0 2024-09-17T01:02:00.332 INFO:tasks.workunit.client.0.smithi002.stdout:0/518: mknod dd/d19/d1c/d1f/d76/ca7 0 2024-09-17T01:02:00.332 INFO:tasks.workunit.client.1.smithi099.stdout:9/638: getdents da/d14/d48/d69 0 2024-09-17T01:02:00.333 INFO:tasks.workunit.client.1.smithi099.stdout:9/639: write da/d14/d48/d69/d6c/fcd [2050615,47035] 0 2024-09-17T01:02:00.333 INFO:tasks.workunit.client.1.smithi099.stdout:9/640: rmdir da/d8e/d96 39 2024-09-17T01:02:00.333 INFO:tasks.workunit.client.0.smithi002.stdout:0/519: link dd/d19/d1a/f4a dd/d19/d1c/d33/fa8 0 2024-09-17T01:02:00.336 INFO:tasks.workunit.client.0.smithi002.stdout:4/725: dread d7/de/d3a/f5e [0,4194304] 0 2024-09-17T01:02:00.337 INFO:tasks.workunit.client.0.smithi002.stdout:4/726: mknod d7/d3f/da9/dca/ce3 0 2024-09-17T01:02:00.342 INFO:tasks.workunit.client.1.smithi099.stdout:7/601: write d1/d2c/d5c/fe [1050500,31509] 0 2024-09-17T01:02:00.342 INFO:tasks.workunit.client.1.smithi099.stdout:7/602: chown d1/f10 16609335 1 2024-09-17T01:02:00.342 INFO:tasks.workunit.client.1.smithi099.stdout:9/641: truncate da/d14/d62/f6b 786997 0 2024-09-17T01:02:00.343 INFO:tasks.workunit.client.1.smithi099.stdout:2/564: dwrite d2/d9/d25/d26/d1b/f74 [0,4194304] 0 2024-09-17T01:02:00.343 INFO:tasks.workunit.client.1.smithi099.stdout:7/603: symlink d1/d36/lc0 0 2024-09-17T01:02:00.345 INFO:tasks.workunit.client.1.smithi099.stdout:9/642: truncate da/d21/f3b 162015 0 2024-09-17T01:02:00.345 INFO:tasks.workunit.client.1.smithi099.stdout:9/643: stat da/d18 0 2024-09-17T01:02:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.348+0000 7fcf148b3640 1 -- 172.21.15.2:0/173799429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf100fb430 msgr2=0x7fcf100fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.348+0000 7fcf148b3640 1 --2- 172.21.15.2:0/173799429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf100fb430 0x7fcf100fb840 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcf000048d0 tx=0x7fcf00009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.348+0000 7fcf148b3640 1 -- 172.21.15.2:0/173799429 shutdown_connections 2024-09-17T01:02:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.348+0000 7fcf148b3640 1 --2- 172.21.15.2:0/173799429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100fc700 0x7fcf100fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.348+0000 7fcf148b3640 1 --2- 172.21.15.2:0/173799429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf100fb430 0x7fcf100fb840 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.348+0000 7fcf148b3640 1 -- 172.21.15.2:0/173799429 >> 172.21.15.2:0/173799429 conn(0x7fcf100f6c10 msgr2=0x7fcf100f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.348+0000 7fcf148b3640 1 -- 172.21.15.2:0/173799429 shutdown_connections 2024-09-17T01:02:00.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.348+0000 7fcf148b3640 1 -- 172.21.15.2:0/173799429 wait complete. 2024-09-17T01:02:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.349+0000 7fcf148b3640 1 Processor -- start 2024-09-17T01:02:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.349+0000 7fcf148b3640 1 -- start start 2024-09-17T01:02:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.350+0000 7fcf148b3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100fb430 0x7fcf1010bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.350+0000 7fcf148b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf100fc700 0x7fcf1010c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.350+0000 7fcf148b3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1010cb10 con 0x7fcf100fc700 2024-09-17T01:02:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.350+0000 7fcf148b3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1010d330 con 0x7fcf100fb430 2024-09-17T01:02:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.350+0000 7fcf0dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf100fc700 0x7fcf1010c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.350+0000 7fcf0dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf100fc700 0x7fcf1010c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49748/0 (socket says 172.21.15.2:49748) 2024-09-17T01:02:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.350+0000 7fcf0dd9b640 1 -- 172.21.15.2:0/4227070943 learned_addr learned my addr 172.21.15.2:0/4227070943 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:02:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.350+0000 7fcf0dd9b640 1 -- 172.21.15.2:0/4227070943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100fb430 msgr2=0x7fcf1010bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.350+0000 7fcf0dd9b640 1 --2- 172.21.15.2:0/4227070943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100fb430 0x7fcf1010bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.350+0000 7fcf0dd9b640 1 -- 172.21.15.2:0/4227070943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf00005040 con 0x7fcf100fc700 2024-09-17T01:02:00.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.351+0000 7fcf0dd9b640 1 --2- 172.21.15.2:0/4227070943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf100fc700 0x7fcf1010c4c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcf0400eb70 tx=0x7fcf0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:00.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.351+0000 7fcefeffd640 1 -- 172.21.15.2:0/4227070943 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf04007c30 con 0x7fcf100fc700 2024-09-17T01:02:00.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.351+0000 7fcf148b3640 1 -- 172.21.15.2:0/4227070943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1010d560 con 0x7fcf100fc700 2024-09-17T01:02:00.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.351+0000 7fcefeffd640 1 -- 172.21.15.2:0/4227070943 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf0400f040 con 0x7fcf100fc700 2024-09-17T01:02:00.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.351+0000 7fcefeffd640 1 -- 172.21.15.2:0/4227070943 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf040094e0 con 0x7fcf100fc700 2024-09-17T01:02:00.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.351+0000 7fcf148b3640 1 -- 172.21.15.2:0/4227070943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1010da80 con 0x7fcf100fc700 2024-09-17T01:02:00.351 INFO:tasks.workunit.client.1.smithi099.stdout:2/565: symlink d2/d9/d25/d26/d1b/d61/d7d/d85/d98/lb3 0 2024-09-17T01:02:00.351 INFO:tasks.workunit.client.1.smithi099.stdout:2/566: chown d2/d9/d25/d26/d1b/d2c/d3f 833 1 2024-09-17T01:02:00.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.352+0000 7fcf148b3640 1 -- 172.21.15.2:0/4227070943 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf100fa890 con 0x7fcf100fc700 2024-09-17T01:02:00.352 INFO:tasks.workunit.client.1.smithi099.stdout:2/567: creat d2/d9/d17/d83/d8d/fb4 x:0 0 0 2024-09-17T01:02:00.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.354+0000 7fcefeffd640 1 -- 172.21.15.2:0/4227070943 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7fcf04009640 con 0x7fcf100fc700 2024-09-17T01:02:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.354+0000 7fcefeffd640 1 --2- 172.21.15.2:0/4227070943 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fcef806ed50 0x7fcef8071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.355+0000 7fcefeffd640 1 -- 172.21.15.2:0/4227070943 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcf0408dee0 con 0x7fcf100fc700 2024-09-17T01:02:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.355+0000 7fcf0e59c640 1 --2- 172.21.15.2:0/4227070943 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fcef806ed50 0x7fcef8071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:00.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.355+0000 7fcf0e59c640 1 --2- 172.21.15.2:0/4227070943 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fcef806ed50 0x7fcef8071200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcf0002a530 tx=0x7fcf00009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:00.354 INFO:tasks.workunit.client.0.smithi002.stdout:0/520: dwrite dd/d44/d84/f9b [0,4194304] 0 2024-09-17T01:02:00.354 INFO:tasks.workunit.client.1.smithi099.stdout:2/568: dread d2/d9/d25/d26/d1b/d2c/f79 [0,4194304] 0 2024-09-17T01:02:00.357 INFO:tasks.workunit.client.1.smithi099.stdout:2/569: mknod d2/d9/d25/d26/d1b/dad/cb5 0 2024-09-17T01:02:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.361+0000 7fcefeffd640 1 -- 172.21.15.2:0/4227070943 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcf0405b0f0 con 0x7fcf100fc700 2024-09-17T01:02:00.364 INFO:tasks.workunit.client.1.smithi099.stdout:9/644: dwrite da/d9a/f78 [0,4194304] 0 2024-09-17T01:02:00.368 INFO:tasks.workunit.client.1.smithi099.stdout:9/645: creat da/d18/d5e/fd2 x:0 0 0 2024-09-17T01:02:00.369 INFO:tasks.workunit.client.1.smithi099.stdout:3/615: sync 2024-09-17T01:02:00.369 INFO:tasks.workunit.client.1.smithi099.stdout:6/634: sync 2024-09-17T01:02:00.371 INFO:tasks.workunit.client.1.smithi099.stdout:3/616: creat d9/d3b/d44/fbe x:0 0 0 2024-09-17T01:02:00.373 INFO:tasks.workunit.client.1.smithi099.stdout:6/635: write dc/d2b/f76 [137596,103096] 0 2024-09-17T01:02:00.373 INFO:tasks.workunit.client.1.smithi099.stdout:6/636: readlink dc/d2b/l48 0 2024-09-17T01:02:00.374 INFO:tasks.workunit.client.1.smithi099.stdout:2/570: dwrite d2/d9/d25/d26/d1b/d2c/d9b/fa2 [0,4194304] 0 2024-09-17T01:02:00.381 INFO:tasks.workunit.client.1.smithi099.stdout:3/617: dread d9/d15/d18/f82 [0,4194304] 0 2024-09-17T01:02:00.383 INFO:tasks.workunit.client.1.smithi099.stdout:3/618: truncate d9/d15/d8f/fac 858726 0 2024-09-17T01:02:00.383 INFO:tasks.workunit.client.1.smithi099.stdout:3/619: chown d9/l6a 53 1 2024-09-17T01:02:00.383 INFO:tasks.workunit.client.1.smithi099.stdout:3/620: chown d9/d15/d18/d1a/fa8 794740013 1 2024-09-17T01:02:00.383 INFO:tasks.workunit.client.1.smithi099.stdout:3/621: write d9/f83 [1240649,70412] 0 2024-09-17T01:02:00.387 INFO:tasks.workunit.client.1.smithi099.stdout:3/622: rmdir d9/d15/d18/d1a/d23/d5c 39 2024-09-17T01:02:00.387 INFO:tasks.workunit.client.1.smithi099.stdout:2/571: read d2/d9/f1f [3732304,25055] 0 2024-09-17T01:02:00.392 INFO:tasks.workunit.client.1.smithi099.stdout:3/623: dread d9/d15/d18/f2a [0,4194304] 0 2024-09-17T01:02:00.393 INFO:tasks.workunit.client.1.smithi099.stdout:3/624: symlink d9/d2b/d52/lbf 0 2024-09-17T01:02:00.393 INFO:tasks.workunit.client.1.smithi099.stdout:3/625: creat d9/d15/fc0 x:0 0 0 2024-09-17T01:02:00.394 INFO:tasks.workunit.client.1.smithi099.stdout:3/626: stat d9/d15/d18/d1a/d23/d5c/d6e/d94 0 2024-09-17T01:02:00.394 INFO:tasks.workunit.client.1.smithi099.stdout:3/627: read - d9/d15/d18/f88 zero size 2024-09-17T01:02:00.394 INFO:tasks.workunit.client.1.smithi099.stdout:9/646: dwrite da/d50/f5c [4194304,4194304] 0 2024-09-17T01:02:00.394 INFO:tasks.workunit.client.1.smithi099.stdout:9/647: fsync da/d50/fc7 0 2024-09-17T01:02:00.394 INFO:tasks.workunit.client.1.smithi099.stdout:6/637: dwrite dc/d5d/dc9/fcc [0,4194304] 0 2024-09-17T01:02:00.395 INFO:tasks.workunit.client.1.smithi099.stdout:3/628: creat d9/d15/d18/d1a/d23/d5c/d99/fc1 x:0 0 0 2024-09-17T01:02:00.400 INFO:tasks.workunit.client.1.smithi099.stdout:6/638: creat dc/d5d/d66/dc3/fd2 x:0 0 0 2024-09-17T01:02:00.405 INFO:tasks.workunit.client.1.smithi099.stdout:9/648: write da/d9a/f78 [3929998,25935] 0 2024-09-17T01:02:00.411 INFO:tasks.workunit.client.1.smithi099.stdout:6/639: dread dc/f36 [0,4194304] 0 2024-09-17T01:02:00.414 INFO:tasks.workunit.client.1.smithi099.stdout:6/640: link dc/d27/d7e/dad/lc0 dc/d1a/d49/d4c/ld3 0 2024-09-17T01:02:00.414 INFO:tasks.workunit.client.1.smithi099.stdout:6/641: readlink dc/d27/d7e/l84 0 2024-09-17T01:02:00.415 INFO:tasks.workunit.client.1.smithi099.stdout:6/642: mkdir dc/d5d/d66/dc3/dd4 0 2024-09-17T01:02:00.426 INFO:tasks.workunit.client.1.smithi099.stdout:9/649: dwrite da/d14/d6d/f87 [0,4194304] 0 2024-09-17T01:02:00.426 INFO:tasks.workunit.client.1.smithi099.stdout:9/650: chown da/d21/d5b/l68 12 1 2024-09-17T01:02:00.426 INFO:tasks.workunit.client.1.smithi099.stdout:3/629: dwrite d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/f9e [0,4194304] 0 2024-09-17T01:02:00.428 INFO:tasks.workunit.client.1.smithi099.stdout:9/651: mkdir da/d14/d62/dd3 0 2024-09-17T01:02:00.428 INFO:tasks.workunit.client.1.smithi099.stdout:9/652: chown f6 198 1 2024-09-17T01:02:00.429 INFO:tasks.workunit.client.1.smithi099.stdout:9/653: read da/d18/d5e/f67 [485779,99129] 0 2024-09-17T01:02:00.429 INFO:tasks.workunit.client.1.smithi099.stdout:9/654: write da/d21/f3b [282506,79896] 0 2024-09-17T01:02:00.431 INFO:tasks.workunit.client.1.smithi099.stdout:9/655: creat da/fd4 x:0 0 0 2024-09-17T01:02:00.432 INFO:tasks.workunit.client.1.smithi099.stdout:9/656: symlink da/d56/ld5 0 2024-09-17T01:02:00.432 INFO:tasks.workunit.client.1.smithi099.stdout:9/657: chown da/d14/d48/d69/f79 10 1 2024-09-17T01:02:00.432 INFO:tasks.workunit.client.1.smithi099.stdout:9/658: chown da/d56/d84/db9/fcb 0 1 2024-09-17T01:02:00.434 INFO:tasks.workunit.client.1.smithi099.stdout:9/659: getdents da/d56/d84 0 2024-09-17T01:02:00.434 INFO:tasks.workunit.client.1.smithi099.stdout:9/660: chown da/d21/d5b/fbc 63733 1 2024-09-17T01:02:00.439 INFO:tasks.workunit.client.1.smithi099.stdout:3/630: write d9/d2b/f2d [6406798,90537] 0 2024-09-17T01:02:00.441 INFO:tasks.workunit.client.1.smithi099.stdout:6/643: dwrite dc/d1a/f56 [0,4194304] 0 2024-09-17T01:02:00.441 INFO:tasks.workunit.client.1.smithi099.stdout:6/644: write dc/d1a/d49/faf [1027439,121621] 0 2024-09-17T01:02:00.441 INFO:tasks.workunit.client.0.smithi002.stdout:4/727: creat d7/d19/fe4 x:0 0 0 2024-09-17T01:02:00.443 INFO:tasks.workunit.client.1.smithi099.stdout:6/645: creat dc/d2b/fd5 x:0 0 0 2024-09-17T01:02:00.444 INFO:tasks.workunit.client.1.smithi099.stdout:9/661: truncate da/d50/f5c 5639618 0 2024-09-17T01:02:00.444 INFO:tasks.workunit.client.1.smithi099.stdout:9/662: fdatasync da/d50/f83 0 2024-09-17T01:02:00.445 INFO:tasks.workunit.client.1.smithi099.stdout:6/646: link dc/d27/fbc dc/d1a/d49/da8/fd6 0 2024-09-17T01:02:00.446 INFO:tasks.workunit.client.0.smithi002.stdout:0/521: mkdir dd/d19/da9 0 2024-09-17T01:02:00.446 INFO:tasks.workunit.client.1.smithi099.stdout:9/663: getdents da/d14/d40/d6f 0 2024-09-17T01:02:00.449 INFO:tasks.workunit.client.0.smithi002.stdout:4/728: rmdir d7/de/d3a/d99 39 2024-09-17T01:02:00.451 INFO:tasks.workunit.client.0.smithi002.stdout:4/729: link d7/d19/d9c/caa d7/d3f/da9/ce5 0 2024-09-17T01:02:00.451 INFO:tasks.workunit.client.0.smithi002.stdout:4/730: stat d7/d19/fe4 0 2024-09-17T01:02:00.453 INFO:tasks.workunit.client.1.smithi099.stdout:3/631: dwrite d9/d3b/d44/f67 [4194304,4194304] 0 2024-09-17T01:02:00.453 INFO:tasks.workunit.client.1.smithi099.stdout:3/632: fdatasync d9/d15/d18/d1a/d23/d5c/fa1 0 2024-09-17T01:02:00.453 INFO:tasks.workunit.client.1.smithi099.stdout:3/633: readlink d9/d15/d18/l86 0 2024-09-17T01:02:00.454 INFO:tasks.workunit.client.0.smithi002.stdout:4/731: mkdir d7/de6 0 2024-09-17T01:02:00.466 INFO:tasks.workunit.client.0.smithi002.stdout:0/522: dwrite dd/d19/d1a/f92 [4194304,4194304] 0 2024-09-17T01:02:00.469 INFO:tasks.workunit.client.0.smithi002.stdout:0/523: link dd/d19/d1c/d33/d67/f66 dd/d19/d1c/faa 0 2024-09-17T01:02:00.472 INFO:tasks.workunit.client.0.smithi002.stdout:0/524: rename dd/d19/d1c/d1f/l49 to dd/d19/d1c/d33/d67/lab 0 2024-09-17T01:02:00.472 INFO:tasks.workunit.client.0.smithi002.stdout:0/525: read - dd/d3d/f8d zero size 2024-09-17T01:02:00.473 INFO:tasks.workunit.client.0.smithi002.stdout:0/526: stat dd/d19 0 2024-09-17T01:02:00.490 INFO:tasks.workunit.client.1.smithi099.stdout:3/634: dwrite d9/d15/f59 [0,4194304] 0 2024-09-17T01:02:00.490 INFO:tasks.workunit.client.1.smithi099.stdout:3/635: dread - d9/d2b/fb0 zero size 2024-09-17T01:02:00.497 INFO:tasks.workunit.client.0.smithi002.stdout:4/732: dwrite d7/d71/d8e/fba [0,4194304] 0 2024-09-17T01:02:00.497 INFO:tasks.workunit.client.0.smithi002.stdout:4/733: chown d7/d19/d9f/d80/d62/f31 859407 1 2024-09-17T01:02:00.498 INFO:tasks.workunit.client.1.smithi099.stdout:6/647: dwrite dc/d5d/dae/d96/f8e [0,4194304] 0 2024-09-17T01:02:00.498 INFO:tasks.workunit.client.1.smithi099.stdout:9/664: dwrite da/d21/d2a/f54 [0,4194304] 0 2024-09-17T01:02:00.498 INFO:tasks.workunit.client.0.smithi002.stdout:0/527: dwrite dd/d19/d1c/d1f/d76/fa2 [0,4194304] 0 2024-09-17T01:02:00.499 INFO:tasks.workunit.client.0.smithi002.stdout:4/734: creat d7/de/fe7 x:0 0 0 2024-09-17T01:02:00.503 INFO:tasks.workunit.client.0.smithi002.stdout:0/528: mknod dd/d19/d1c/d1f/d39/cac 0 2024-09-17T01:02:00.504 INFO:tasks.workunit.client.0.smithi002.stdout:4/735: symlink d7/d19/d2e/dc0/dcf/le8 0 2024-09-17T01:02:00.505 INFO:tasks.workunit.client.1.smithi099.stdout:6/648: rename dc/d5d/d66/d7a to dc/d27/dd7 0 2024-09-17T01:02:00.505 INFO:tasks.workunit.client.0.smithi002.stdout:4/736: truncate d7/de/d3a/f3c 3767038 0 2024-09-17T01:02:00.507 INFO:tasks.workunit.client.1.smithi099.stdout:9/665: rename da/d9a/d3a/d4b/f66 to da/d18/fd6 0 2024-09-17T01:02:00.507 INFO:tasks.workunit.client.1.smithi099.stdout:9/666: creat da/d21/d5b/fd7 x:0 0 0 2024-09-17T01:02:00.508 INFO:tasks.workunit.client.1.smithi099.stdout:3/636: dread d9/d2b/f2d [0,4194304] 0 2024-09-17T01:02:00.510 INFO:tasks.workunit.client.1.smithi099.stdout:9/667: rename da/d14/d62/f6b to da/d9a/fd8 0 2024-09-17T01:02:00.510 INFO:tasks.workunit.client.1.smithi099.stdout:9/668: fsync da/d18/d49/fb7 0 2024-09-17T01:02:00.510 INFO:tasks.workunit.client.1.smithi099.stdout:9/669: stat da/d14/d48/l4e 0 2024-09-17T01:02:00.510 INFO:tasks.workunit.client.0.smithi002.stdout:0/529: write dd/d19/d1c/d1f/f21 [3064862,46655] 0 2024-09-17T01:02:00.511 INFO:tasks.workunit.client.1.smithi099.stdout:3/637: read d9/d15/d18/d1a/d23/f4a [1203533,128269] 0 2024-09-17T01:02:00.512 INFO:tasks.workunit.client.0.smithi002.stdout:0/530: mkdir dd/d3d/d94/dad 0 2024-09-17T01:02:00.512 INFO:tasks.workunit.client.0.smithi002.stdout:0/531: chown dd/d19/d1c/d1f/d22/l9a 122316 1 2024-09-17T01:02:00.513 INFO:tasks.workunit.client.1.smithi099.stdout:6/649: rename dc/d1a/d82/la3 to dc/d27/d7e/ld8 0 2024-09-17T01:02:00.514 INFO:tasks.workunit.client.0.smithi002.stdout:7/611: sync 2024-09-17T01:02:00.514 INFO:tasks.workunit.client.0.smithi002.stdout:2/626: sync 2024-09-17T01:02:00.514 INFO:tasks.workunit.client.0.smithi002.stdout:2/627: chown d1b/d37/l7e 3 1 2024-09-17T01:02:00.514 INFO:tasks.workunit.client.0.smithi002.stdout:2/628: creat d1b/d3f/d59/d7f/dc9/dac/fe0 x:0 0 0 2024-09-17T01:02:00.514 INFO:tasks.workunit.client.0.smithi002.stdout:9/552: sync 2024-09-17T01:02:00.514 INFO:tasks.workunit.client.0.smithi002.stdout:8/745: sync 2024-09-17T01:02:00.514 INFO:tasks.workunit.client.0.smithi002.stdout:3/599: sync 2024-09-17T01:02:00.514 INFO:tasks.workunit.client.0.smithi002.stdout:6/616: sync 2024-09-17T01:02:00.514 INFO:tasks.workunit.client.0.smithi002.stdout:1/582: sync 2024-09-17T01:02:00.516 INFO:tasks.workunit.client.0.smithi002.stdout:2/629: mknod d1b/ce1 0 2024-09-17T01:02:00.516 INFO:tasks.workunit.client.0.smithi002.stdout:2/630: truncate d1b/d37/f60 457103 0 2024-09-17T01:02:00.516 INFO:tasks.workunit.client.1.smithi099.stdout:6/650: dread dc/d5d/dae/f5a [0,4194304] 0 2024-09-17T01:02:00.517 INFO:tasks.workunit.client.1.smithi099.stdout:6/651: creat dc/d27/dd7/d87/db6/fd9 x:0 0 0 2024-09-17T01:02:00.518 INFO:tasks.workunit.client.1.smithi099.stdout:6/652: truncate dc/d5d/d66/f67 3584751 0 2024-09-17T01:02:00.518 INFO:tasks.workunit.client.1.smithi099.stdout:6/653: stat dc/d1a/d49/da8/db3 0 2024-09-17T01:02:00.518 INFO:tasks.workunit.client.1.smithi099.stdout:3/638: read d9/d3b/d44/d57/f5a [1619657,9272] 0 2024-09-17T01:02:00.519 INFO:tasks.workunit.client.0.smithi002.stdout:4/737: write d7/d71/d8e/fba [2713650,40239] 0 2024-09-17T01:02:00.519 INFO:tasks.workunit.client.0.smithi002.stdout:3/600: symlink d0/d31/d8b/d9d/lcc 0 2024-09-17T01:02:00.519 INFO:tasks.workunit.client.1.smithi099.stdout:6/654: mknod dc/d27/d7e/cda 0 2024-09-17T01:02:00.519 INFO:tasks.workunit.client.1.smithi099.stdout:6/655: write dc/d1a/d49/da8/fc1 [838519,52742] 0 2024-09-17T01:02:00.521 INFO:tasks.workunit.client.1.smithi099.stdout:3/639: rename d9/d3b/d44/d57 to d9/d15/d18/dc2 0 2024-09-17T01:02:00.522 INFO:tasks.workunit.client.0.smithi002.stdout:6/617: creat d2/dc/d24/d53/d83/da9/d4c/fc5 x:0 0 0 2024-09-17T01:02:00.523 INFO:tasks.workunit.client.1.smithi099.stdout:6/656: rename dc/d1a/d49/faf to dc/d5d/dae/dd0/fdb 0 2024-09-17T01:02:00.524 INFO:tasks.workunit.client.0.smithi002.stdout:1/583: mkdir d4/d11/d12/d30/dc4 0 2024-09-17T01:02:00.524 INFO:tasks.workunit.client.0.smithi002.stdout:1/584: readlink d4/l21 0 2024-09-17T01:02:00.524 INFO:tasks.workunit.client.0.smithi002.stdout:1/585: write d4/d11/d12/d14/d17/f28 [248603,59926] 0 2024-09-17T01:02:00.524 INFO:tasks.workunit.client.0.smithi002.stdout:1/586: dread - d4/d11/d12/d14/d17/d56/fbf zero size 2024-09-17T01:02:00.524 INFO:tasks.workunit.client.0.smithi002.stdout:1/587: fsync d4/d11/d12/d30/d5e/f77 0 2024-09-17T01:02:00.524 INFO:tasks.workunit.client.0.smithi002.stdout:1/588: dread - d4/d11/d12/d14/d17/d40/f6d zero size 2024-09-17T01:02:00.524 INFO:tasks.workunit.client.0.smithi002.stdout:0/532: read dd/d44/d84/fa3 [717643,32899] 0 2024-09-17T01:02:00.525 INFO:tasks.workunit.client.0.smithi002.stdout:4/738: dread d7/d19/d9f/d80/f5a [0,4194304] 0 2024-09-17T01:02:00.525 INFO:tasks.workunit.client.0.smithi002.stdout:4/739: write d7/d19/d9f/d9d/fa2 [5021143,111148] 0 2024-09-17T01:02:00.526 INFO:tasks.workunit.client.0.smithi002.stdout:2/631: mkdir d1b/d74/d93/d94/de2 0 2024-09-17T01:02:00.526 INFO:tasks.workunit.client.0.smithi002.stdout:2/632: write d1b/d37/f62 [659213,105096] 0 2024-09-17T01:02:00.526 INFO:tasks.workunit.client.0.smithi002.stdout:2/633: write d1b/d37/d48/d52/f9a [207518,30971] 0 2024-09-17T01:02:00.526 INFO:tasks.workunit.client.0.smithi002.stdout:2/634: chown d1b/d37/d48/d52/c95 14990 1 2024-09-17T01:02:00.526 INFO:tasks.workunit.client.0.smithi002.stdout:8/746: getdents d2/d3/d5f/d98/da5/d71/d89 0 2024-09-17T01:02:00.526 INFO:tasks.workunit.client.0.smithi002.stdout:8/747: write d2/d3/d5f/d98/da5/f36 [4057171,109285] 0 2024-09-17T01:02:00.526 INFO:tasks.workunit.client.0.smithi002.stdout:8/748: readlink d2/d3/d5f/d47/d80/lb6 0 2024-09-17T01:02:00.528 INFO:tasks.workunit.client.0.smithi002.stdout:6/618: symlink d2/d1d/d2d/d35/d6d/lc6 0 2024-09-17T01:02:00.528 INFO:tasks.workunit.client.0.smithi002.stdout:6/619: chown d2/c3 54314768 1 2024-09-17T01:02:00.529 INFO:tasks.workunit.client.1.smithi099.stdout:0/613: sync 2024-09-17T01:02:00.529 INFO:tasks.workunit.client.1.smithi099.stdout:4/562: sync 2024-09-17T01:02:00.529 INFO:tasks.workunit.client.1.smithi099.stdout:0/614: fdatasync da/f27 0 2024-09-17T01:02:00.529 INFO:tasks.workunit.client.1.smithi099.stdout:0/615: chown da/df/d31/db0/d1e 14 1 2024-09-17T01:02:00.529 INFO:tasks.workunit.client.1.smithi099.stdout:3/640: rename d9/d3b/db2/fbc to d9/d15/d18/d1a/d23/fc3 0 2024-09-17T01:02:00.530 INFO:tasks.workunit.client.1.smithi099.stdout:6/657: mknod dc/cdc 0 2024-09-17T01:02:00.530 INFO:tasks.workunit.client.0.smithi002.stdout:0/533: creat dd/fae x:0 0 0 2024-09-17T01:02:00.530 INFO:tasks.workunit.client.0.smithi002.stdout:0/534: write dd/d19/f1b [313552,87056] 0 2024-09-17T01:02:00.532 INFO:tasks.workunit.client.1.smithi099.stdout:4/563: mknod d7/dd/de/d10/cba 0 2024-09-17T01:02:00.532 INFO:tasks.workunit.client.0.smithi002.stdout:2/635: symlink d1b/d3f/d59/d7f/dc9/d72/le3 0 2024-09-17T01:02:00.535 INFO:tasks.workunit.client.1.smithi099.stdout:0/616: truncate da/df/d1a/d49/dac/f40 2322815 0 2024-09-17T01:02:00.535 INFO:tasks.workunit.client.1.smithi099.stdout:3/641: mknod d9/d2b/d6b/dae/cc4 0 2024-09-17T01:02:00.536 INFO:tasks.workunit.client.0.smithi002.stdout:3/601: symlink d0/lcd 0 2024-09-17T01:02:00.536 INFO:tasks.workunit.client.0.smithi002.stdout:8/749: creat d2/d3/d5f/d98/da5/d71/d89/ff9 x:0 0 0 2024-09-17T01:02:00.536 INFO:tasks.workunit.client.0.smithi002.stdout:3/602: truncate d0/d31/d32/d92/fa4 583968 0 2024-09-17T01:02:00.537 INFO:tasks.workunit.client.0.smithi002.stdout:6/620: creat d2/dc/d34/d5f/fc7 x:0 0 0 2024-09-17T01:02:00.537 INFO:tasks.workunit.client.1.smithi099.stdout:0/617: getdents da/d59/d80/d8c/d97 0 2024-09-17T01:02:00.537 INFO:tasks.workunit.client.0.smithi002.stdout:4/740: rename d7/d19/d9f/d9d to d7/d19/d9c/de9 0 2024-09-17T01:02:00.538 INFO:tasks.workunit.client.0.smithi002.stdout:4/741: fdatasync d7/d19/d2e/fbd 0 2024-09-17T01:02:00.538 INFO:tasks.workunit.client.0.smithi002.stdout:4/742: write d7/de/f5c [4666031,48048] 0 2024-09-17T01:02:00.538 INFO:tasks.workunit.client.0.smithi002.stdout:4/743: truncate d7/d71/d8e/fba 4709857 0 2024-09-17T01:02:00.538 INFO:tasks.workunit.client.0.smithi002.stdout:4/744: getdents d7/d19/d9f/dc2/dde 0 2024-09-17T01:02:00.539 INFO:tasks.workunit.client.1.smithi099.stdout:3/642: mkdir d9/d3b/db2/daf/dc5 0 2024-09-17T01:02:00.540 INFO:tasks.workunit.client.1.smithi099.stdout:0/618: truncate da/df/d1a/d56/fc5 322332 0 2024-09-17T01:02:00.540 INFO:tasks.workunit.client.1.smithi099.stdout:0/619: read da/d12/f18 [2202996,65663] 0 2024-09-17T01:02:00.541 INFO:tasks.workunit.client.0.smithi002.stdout:0/535: unlink dd/d19/d1a/d29/d55/d61/c9e 0 2024-09-17T01:02:00.541 INFO:tasks.workunit.client.0.smithi002.stdout:0/536: fdatasync dd/f14 0 2024-09-17T01:02:00.542 INFO:tasks.workunit.client.1.smithi099.stdout:9/670: dwrite f6 [0,4194304] 0 2024-09-17T01:02:00.542 INFO:tasks.workunit.client.0.smithi002.stdout:8/750: creat d2/d3/de6/ffa x:0 0 0 2024-09-17T01:02:00.542 INFO:tasks.workunit.client.0.smithi002.stdout:4/745: write d7/d19/d9f/d80/d62/d52/dc7/d77/d9b/f57 [1355239,45567] 0 2024-09-17T01:02:00.543 INFO:tasks.workunit.client.1.smithi099.stdout:0/620: truncate da/df/d1a/d49/d68/f7f 2675408 0 2024-09-17T01:02:00.543 INFO:tasks.workunit.client.1.smithi099.stdout:0/621: chown da/d12/d2b/dab/db5/f58 15474628 1 2024-09-17T01:02:00.543 INFO:tasks.workunit.client.0.smithi002.stdout:0/537: symlink dd/d44/d84/laf 0 2024-09-17T01:02:00.543 INFO:tasks.workunit.client.0.smithi002.stdout:0/538: chown dd/d19/d1a/d29/l91 17135 1 2024-09-17T01:02:00.545 INFO:tasks.workunit.client.0.smithi002.stdout:4/746: truncate d7/f18 2487760 0 2024-09-17T01:02:00.550 INFO:tasks.workunit.client.0.smithi002.stdout:3/603: dread d0/d3/d37/dac/da1/fa2 [0,4194304] 0 2024-09-17T01:02:00.550 INFO:tasks.workunit.client.0.smithi002.stdout:0/539: creat dd/d19/d9f/fb0 x:0 0 0 2024-09-17T01:02:00.552 INFO:tasks.workunit.client.0.smithi002.stdout:1/589: dwrite d4/d11/d1a/f29 [0,4194304] 0 2024-09-17T01:02:00.552 INFO:tasks.workunit.client.0.smithi002.stdout:1/590: fsync d4/d11/f82 0 2024-09-17T01:02:00.555 INFO:tasks.workunit.client.0.smithi002.stdout:7/612: dwrite d1/d14/d1d/d28/d86/f97 [0,4194304] 0 2024-09-17T01:02:00.556 INFO:tasks.workunit.client.0.smithi002.stdout:1/591: mkdir d4/d11/d55/dbc/dc5 0 2024-09-17T01:02:00.556 INFO:tasks.workunit.client.0.smithi002.stdout:0/540: unlink dd/d19/f3a 0 2024-09-17T01:02:00.563 INFO:tasks.workunit.client.0.smithi002.stdout:6/621: dread d2/d1d/d2d/f2e [0,4194304] 0 2024-09-17T01:02:00.566 INFO:tasks.workunit.client.0.smithi002.stdout:1/592: rename d4/d11/d12/d30/d43/d67/c6a to d4/d22/d8d/cc6 0 2024-09-17T01:02:00.566 INFO:tasks.workunit.client.0.smithi002.stdout:0/541: link dd/d3d/l5d dd/d19/da9/lb1 0 2024-09-17T01:02:00.567 INFO:tasks.workunit.client.0.smithi002.stdout:0/542: symlink dd/d19/d1c/lb2 0 2024-09-17T01:02:00.568 INFO:tasks.workunit.client.0.smithi002.stdout:0/543: write dd/d44/d84/fa3 [788151,113175] 0 2024-09-17T01:02:00.570 INFO:tasks.workunit.client.0.smithi002.stdout:7/613: dread d1/f20 [0,4194304] 0 2024-09-17T01:02:00.572 INFO:tasks.workunit.client.0.smithi002.stdout:0/544: symlink dd/d44/d84/lb3 0 2024-09-17T01:02:00.572 INFO:tasks.workunit.client.0.smithi002.stdout:0/545: chown dd/d19/da9/lb1 1122783 1 2024-09-17T01:02:00.572 INFO:tasks.workunit.client.0.smithi002.stdout:0/546: fsync dd/d19/d1c/d1f/f77 0 2024-09-17T01:02:00.572 INFO:tasks.workunit.client.0.smithi002.stdout:7/614: rmdir d1/d24 39 2024-09-17T01:02:00.572 INFO:tasks.workunit.client.0.smithi002.stdout:7/615: chown d1/l9f 106779982 1 2024-09-17T01:02:00.574 INFO:tasks.workunit.client.0.smithi002.stdout:7/616: creat d1/d14/d1d/d28/d6b/d9e/d54/fbe x:0 0 0 2024-09-17T01:02:00.575 INFO:tasks.workunit.client.0.smithi002.stdout:1/593: write d4/d11/d12/d14/fa0 [2273845,106958] 0 2024-09-17T01:02:00.575 INFO:tasks.workunit.client.0.smithi002.stdout:1/594: write d4/d11/d12/d14/fa0 [1964639,55070] 0 2024-09-17T01:02:00.575 INFO:tasks.workunit.client.0.smithi002.stdout:1/595: creat d4/d11/d12/d14/d17/d51/fc7 x:0 0 0 2024-09-17T01:02:00.576 INFO:tasks.workunit.client.0.smithi002.stdout:7/617: creat d1/d14/d1d/d28/d6b/fbf x:0 0 0 2024-09-17T01:02:00.577 INFO:tasks.workunit.client.0.smithi002.stdout:0/547: dread dd/f32 [0,4194304] 0 2024-09-17T01:02:00.578 INFO:tasks.workunit.client.0.smithi002.stdout:1/596: rmdir d4/d11/d12/d23/dae 0 2024-09-17T01:02:00.578 INFO:tasks.workunit.client.0.smithi002.stdout:1/597: creat d4/d11/d12/d14/d17/d51/fc8 x:0 0 0 2024-09-17T01:02:00.579 INFO:tasks.workunit.client.0.smithi002.stdout:7/618: mkdir d1/d14/d67/dc0 0 2024-09-17T01:02:00.579 INFO:tasks.workunit.client.0.smithi002.stdout:0/548: unlink dd/d19/d1c/d33/d67/lab 0 2024-09-17T01:02:00.581 INFO:tasks.workunit.client.0.smithi002.stdout:0/549: read dd/d44/f6e [691393,87096] 0 2024-09-17T01:02:00.581 INFO:tasks.workunit.client.0.smithi002.stdout:1/598: link d4/d11/d55/d7a/fa5 d4/d11/d55/dbc/dc5/fc9 0 2024-09-17T01:02:00.581 INFO:tasks.workunit.client.0.smithi002.stdout:1/599: truncate d4/d11/d55/f92 954521 0 2024-09-17T01:02:00.582 INFO:tasks.workunit.client.0.smithi002.stdout:7/619: symlink d1/d14/d1d/d29/lc1 0 2024-09-17T01:02:00.583 INFO:tasks.workunit.client.1.smithi099.stdout:6/658: dwrite dc/d1a/f92 [0,4194304] 0 2024-09-17T01:02:00.583 INFO:tasks.workunit.client.1.smithi099.stdout:6/659: creat dc/d5d/dae/d96/d60/fdd x:0 0 0 2024-09-17T01:02:00.583 INFO:tasks.workunit.client.0.smithi002.stdout:7/620: truncate d1/d14/d1d/d28/d6b/d9e/f69 2988572 0 2024-09-17T01:02:00.584 INFO:tasks.workunit.client.1.smithi099.stdout:4/564: dwrite d7/dd/de/f4f [0,4194304] 0 2024-09-17T01:02:00.584 INFO:tasks.workunit.client.1.smithi099.stdout:3/643: dwrite d9/d15/d18/d1a/d23/d5c/d99/fc1 [0,4194304] 0 2024-09-17T01:02:00.586 INFO:tasks.workunit.client.0.smithi002.stdout:7/621: rmdir d1/d14/d1d/d29/d98 39 2024-09-17T01:02:00.586 INFO:tasks.workunit.client.0.smithi002.stdout:7/622: readlink d1/d14/d1d/d28/d6b/d9e/d50/l7f 0 2024-09-17T01:02:00.586 INFO:tasks.workunit.client.0.smithi002.stdout:8/751: dwrite d2/d26/f5c [0,4194304] 0 2024-09-17T01:02:00.586 INFO:tasks.workunit.client.0.smithi002.stdout:8/752: write d2/d3/d5f/d98/da5/d71/fbf [860392,84918] 0 2024-09-17T01:02:00.587 INFO:tasks.workunit.client.0.smithi002.stdout:7/623: creat d1/d14/d1d/d28/d40/fc2 x:0 0 0 2024-09-17T01:02:00.589 INFO:tasks.workunit.client.0.smithi002.stdout:8/753: unlink d2/d9/f34 0 2024-09-17T01:02:00.589 INFO:tasks.workunit.client.0.smithi002.stdout:8/754: write d2/d26/f69 [4769579,117057] 0 2024-09-17T01:02:00.591 INFO:tasks.workunit.client.0.smithi002.stdout:7/624: unlink d1/d14/d1d/d28/c42 0 2024-09-17T01:02:00.593 INFO:tasks.workunit.client.0.smithi002.stdout:8/755: symlink d2/d1c/d28/dad/dcd/lfb 0 2024-09-17T01:02:00.594 INFO:tasks.workunit.client.1.smithi099.stdout:9/671: dwrite da/d14/d40/f65 [4194304,4194304] 0 2024-09-17T01:02:00.594 INFO:tasks.workunit.client.0.smithi002.stdout:7/625: link d1/d14/d1d/d28/d6b/d9e/d5e/lb6 d1/d14/d1d/d28/d6b/d9e/lc3 0 2024-09-17T01:02:00.595 INFO:tasks.workunit.client.1.smithi099.stdout:0/622: dread da/df/d1a/d56/fc5 [0,4194304] 0 2024-09-17T01:02:00.595 INFO:tasks.workunit.client.1.smithi099.stdout:0/623: write da/d12/fa6 [4865658,61174] 0 2024-09-17T01:02:00.595 INFO:tasks.workunit.client.0.smithi002.stdout:1/600: dread d4/d11/d55/f65 [0,4194304] 0 2024-09-17T01:02:00.595 INFO:tasks.workunit.client.0.smithi002.stdout:1/601: stat d4/d11/d1a/daa/dbb 0 2024-09-17T01:02:00.595 INFO:tasks.workunit.client.0.smithi002.stdout:1/602: read - d4/d11/d12/d14/d17/d20/f50 zero size 2024-09-17T01:02:00.595 INFO:tasks.workunit.client.0.smithi002.stdout:4/747: dwrite d7/de/fe7 [0,4194304] 0 2024-09-17T01:02:00.596 INFO:tasks.workunit.client.0.smithi002.stdout:4/748: fsync d7/d71/d8e/fb8 0 2024-09-17T01:02:00.596 INFO:tasks.workunit.client.0.smithi002.stdout:4/749: chown d7/d19/d9f/fb3 11 1 2024-09-17T01:02:00.597 INFO:tasks.workunit.client.0.smithi002.stdout:8/756: rename d2/d1c/d28/dad/dcd/dd1/ddb/dcb/cdc to d2/d3/d5f/d98/da5/d4f/d77/cfc 0 2024-09-17T01:02:00.597 INFO:tasks.workunit.client.0.smithi002.stdout:8/757: read - d2/d3/d5f/d98/da5/d4f/d58/fec zero size 2024-09-17T01:02:00.597 INFO:tasks.workunit.client.1.smithi099.stdout:9/672: rename da/fe to da/d8e/fd9 0 2024-09-17T01:02:00.597 INFO:tasks.workunit.client.1.smithi099.stdout:9/673: chown da/d14/d48 1219 1 2024-09-17T01:02:00.597 INFO:tasks.workunit.client.0.smithi002.stdout:7/626: symlink d1/d14/d1d/d28/d6b/d9e/d54/lc4 0 2024-09-17T01:02:00.599 INFO:tasks.workunit.client.1.smithi099.stdout:4/565: dread d7/dd/de/ff [0,4194304] 0 2024-09-17T01:02:00.599 INFO:tasks.workunit.client.1.smithi099.stdout:0/624: creat da/df/d1a/fce x:0 0 0 2024-09-17T01:02:00.600 INFO:tasks.workunit.client.0.smithi002.stdout:4/750: symlink d7/d71/d8e/dd0/d89/lea 0 2024-09-17T01:02:00.600 INFO:tasks.workunit.client.0.smithi002.stdout:7/627: symlink d1/d24/lc5 0 2024-09-17T01:02:00.601 INFO:tasks.workunit.client.1.smithi099.stdout:9/674: unlink da/c17 0 2024-09-17T01:02:00.602 INFO:tasks.workunit.client.0.smithi002.stdout:6/622: dwrite d2/d1d/d27/d30/fb7 [0,4194304] 0 2024-09-17T01:02:00.603 INFO:tasks.workunit.client.0.smithi002.stdout:7/628: rename d1/d14/d1d/d28/la7 to d1/d14/d1d/d28/d40/lc6 0 2024-09-17T01:02:00.604 INFO:tasks.workunit.client.1.smithi099.stdout:4/566: creat d7/dd/d21/d26/d3f/d5b/da4/fbb x:0 0 0 2024-09-17T01:02:00.606 INFO:tasks.workunit.client.1.smithi099.stdout:0/625: rename da/d12/d22/f9a to da/df/d20/fcf 0 2024-09-17T01:02:00.607 INFO:tasks.workunit.client.0.smithi002.stdout:8/758: dread d2/f12 [0,4194304] 0 2024-09-17T01:02:00.609 INFO:tasks.workunit.client.0.smithi002.stdout:4/751: write d7/d19/d2e/f39 [303360,42676] 0 2024-09-17T01:02:00.609 INFO:tasks.workunit.client.0.smithi002.stdout:8/759: stat d2/d1c/d28/dad/dcd/dd1/ce7 0 2024-09-17T01:02:00.610 INFO:tasks.workunit.client.0.smithi002.stdout:8/760: readlink d2/d3/d5f/d98/da5/lc9 0 2024-09-17T01:02:00.610 INFO:tasks.workunit.client.0.smithi002.stdout:8/761: chown d2/d1c/d28/dad/dcd/dd1 128 1 2024-09-17T01:02:00.610 INFO:tasks.workunit.client.1.smithi099.stdout:4/567: mkdir d7/dbc 0 2024-09-17T01:02:00.610 INFO:tasks.workunit.client.1.smithi099.stdout:4/568: readlink d7/dd/d21/l5a 0 2024-09-17T01:02:00.610 INFO:tasks.workunit.client.1.smithi099.stdout:0/626: rmdir da/d12/d2b/dab/dba 39 2024-09-17T01:02:00.611 INFO:tasks.workunit.client.0.smithi002.stdout:7/629: getdents d1/d14 0 2024-09-17T01:02:00.612 INFO:tasks.workunit.client.1.smithi099.stdout:4/569: link d7/dd/de/d17/f25 d7/dd/d21/fbd 0 2024-09-17T01:02:00.613 INFO:tasks.workunit.client.0.smithi002.stdout:6/623: write d2/d1d/d26/d49/d51/f96 [547916,125615] 0 2024-09-17T01:02:00.613 INFO:tasks.workunit.client.0.smithi002.stdout:6/624: fdatasync d2/d1d/fa3 0 2024-09-17T01:02:00.613 INFO:tasks.workunit.client.0.smithi002.stdout:6/625: write d2/d1d/d2d/d35/d6d/f7c [1860110,55700] 0 2024-09-17T01:02:00.613 INFO:tasks.workunit.client.0.smithi002.stdout:6/626: fsync d2/dc/d34/f8f 0 2024-09-17T01:02:00.614 INFO:tasks.workunit.client.1.smithi099.stdout:0/627: mkdir da/df/d1a/d56/d72/dd0 0 2024-09-17T01:02:00.614 INFO:tasks.workunit.client.1.smithi099.stdout:0/628: creat da/d59/d80/d8c/d97/fd1 x:0 0 0 2024-09-17T01:02:00.614 INFO:tasks.workunit.client.1.smithi099.stdout:0/629: creat da/df/d1a/d63/d6a/fd2 x:0 0 0 2024-09-17T01:02:00.614 INFO:tasks.workunit.client.1.smithi099.stdout:0/630: readlink da/df/d1a/d70/l99 0 2024-09-17T01:02:00.615 INFO:tasks.workunit.client.1.smithi099.stdout:0/631: rmdir da/df/d31/db0/d1e 39 2024-09-17T01:02:00.615 INFO:tasks.workunit.client.0.smithi002.stdout:7/630: link d1/d14/d1d/d21/d45/l4d d1/d14/d1d/d28/d6b/d9e/d5e/lc7 0 2024-09-17T01:02:00.616 INFO:tasks.workunit.client.0.smithi002.stdout:7/631: write d1/d14/f3f [904983,48209] 0 2024-09-17T01:02:00.616 INFO:tasks.workunit.client.1.smithi099.stdout:0/632: mknod da/df/d1a/cd3 0 2024-09-17T01:02:00.616 INFO:tasks.workunit.client.1.smithi099.stdout:6/660: dwrite dc/d27/fbc [0,4194304] 0 2024-09-17T01:02:00.619 INFO:tasks.workunit.client.1.smithi099.stdout:6/661: mkdir dc/d27/dd7/dde 0 2024-09-17T01:02:00.620 INFO:tasks.workunit.client.0.smithi002.stdout:7/632: creat d1/d24/fc8 x:0 0 0 2024-09-17T01:02:00.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.623+0000 7fcf148b3640 1 -- 172.21.15.2:0/4227070943 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf1010df90 con 0x7fcef806ed50 2024-09-17T01:02:00.622 INFO:tasks.workunit.client.1.smithi099.stdout:6/662: rename dc/d1a/d82 to dc/d27/dd7/dde/ddf 0 2024-09-17T01:02:00.622 INFO:tasks.workunit.client.1.smithi099.stdout:6/663: fdatasync dc/d27/d58/f6e 0 2024-09-17T01:02:00.622 INFO:tasks.workunit.client.1.smithi099.stdout:6/664: fdatasync dc/d1a/d49/da8/fd6 0 2024-09-17T01:02:00.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.624+0000 7fcefeffd640 1 -- 172.21.15.2:0/4227070943 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fcf1010df90 con 0x7fcef806ed50 2024-09-17T01:02:00.623 INFO:tasks.workunit.client.1.smithi099.stdout:6/665: unlink dc/d27/d58/d74/c93 0 2024-09-17T01:02:00.624 INFO:tasks.workunit.client.1.smithi099.stdout:6/666: mknod dc/d27/dd7/dde/ddf/ce0 0 2024-09-17T01:02:00.624 INFO:tasks.workunit.client.1.smithi099.stdout:6/667: truncate dc/d1a/d49/fb8 219993 0 2024-09-17T01:02:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.626+0000 7fcf148b3640 1 -- 172.21.15.2:0/4227070943 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fcef806ed50 msgr2=0x7fcef8071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.626+0000 7fcf148b3640 1 --2- 172.21.15.2:0/4227070943 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fcef806ed50 0x7fcef8071200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcf0002a530 tx=0x7fcf00009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.626+0000 7fcf148b3640 1 -- 172.21.15.2:0/4227070943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf100fc700 msgr2=0x7fcf1010c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.626+0000 7fcf148b3640 1 --2- 172.21.15.2:0/4227070943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf100fc700 0x7fcf1010c4c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcf0400eb70 tx=0x7fcf0400b040 comp rx=0 tx=0).stop 2024-09-17T01:02:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.626+0000 7fcf148b3640 1 -- 172.21.15.2:0/4227070943 shutdown_connections 2024-09-17T01:02:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.626+0000 7fcf148b3640 1 --2- 172.21.15.2:0/4227070943 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7fcef806ed50 0x7fcef8071200 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.626+0000 7fcf148b3640 1 --2- 172.21.15.2:0/4227070943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf100fc700 0x7fcf1010c4c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.626+0000 7fcf148b3640 1 --2- 172.21.15.2:0/4227070943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100fb430 0x7fcf1010bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.626+0000 7fcf148b3640 1 -- 172.21.15.2:0/4227070943 >> 172.21.15.2:0/4227070943 conn(0x7fcf100f6c10 msgr2=0x7fcf100f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.626+0000 7fcf148b3640 1 -- 172.21.15.2:0/4227070943 shutdown_connections 2024-09-17T01:02:00.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.627+0000 7fcf148b3640 1 -- 172.21.15.2:0/4227070943 wait complete. 2024-09-17T01:02:00.626 INFO:tasks.workunit.client.0.smithi002.stdout:0/550: rename dd/d44/d84 to dd/d44/db4 0 2024-09-17T01:02:00.626 INFO:tasks.workunit.client.0.smithi002.stdout:0/551: link dd/d19/d1a/d29/d55/d61/c87 dd/d19/d1c/d33/d67/d68/cb5 0 2024-09-17T01:02:00.626 INFO:tasks.workunit.client.0.smithi002.stdout:0/552: chown dd/d19/d1a/d29/d55/d56/l64 1065056 1 2024-09-17T01:02:00.627 INFO:tasks.workunit.client.1.smithi099.stdout:6/668: mkdir dc/d27/dd7/d87/db6/de1 0 2024-09-17T01:02:00.627 INFO:tasks.workunit.client.1.smithi099.stdout:6/669: write dc/d5d/dae/d96/fbe [256472,60808] 0 2024-09-17T01:02:00.627 INFO:tasks.workunit.client.0.smithi002.stdout:0/553: mknod dd/d19/d1c/d78/cb6 0 2024-09-17T01:02:00.630 INFO:tasks.workunit.client.1.smithi099.stdout:4/570: write d7/dd/d21/f77 [3515668,9702] 0 2024-09-17T01:02:00.633 INFO:tasks.workunit.client.1.smithi099.stdout:4/571: creat d7/dd/d21/fbe x:0 0 0 2024-09-17T01:02:00.635 INFO:tasks.workunit.client.1.smithi099.stdout:4/572: creat d7/d35/d98/fbf x:0 0 0 2024-09-17T01:02:00.635 INFO:tasks.workunit.client.1.smithi099.stdout:4/573: chown d7/dd/d21/d26/d3f/d5b/da4/fbb 18706258 1 2024-09-17T01:02:00.637 INFO:tasks.workunit.client.1.smithi099.stdout:3/644: dwrite d9/d15/d18/f82 [0,4194304] 0 2024-09-17T01:02:00.638 INFO:tasks.workunit.client.0.smithi002.stdout:1/603: dwrite d4/d11/d12/f38 [4194304,4194304] 0 2024-09-17T01:02:00.638 INFO:tasks.workunit.client.0.smithi002.stdout:7/633: write d1/d14/d1d/d28/d6b/d9e/d54/f66 [2780382,77086] 0 2024-09-17T01:02:00.638 INFO:tasks.workunit.client.0.smithi002.stdout:1/604: mknod d4/d11/d12/d14/d17/d20/cca 0 2024-09-17T01:02:00.639 INFO:tasks.workunit.client.0.smithi002.stdout:7/634: mknod d1/d14/d1d/d21/d45/cc9 0 2024-09-17T01:02:00.640 INFO:tasks.workunit.client.1.smithi099.stdout:3/645: rename l7 to d9/d15/lc6 0 2024-09-17T01:02:00.640 INFO:tasks.workunit.client.0.smithi002.stdout:8/762: dwrite d2/d3/d5f/d98/da5/d4f/d77/d78/f88 [0,4194304] 0 2024-09-17T01:02:00.640 INFO:tasks.workunit.client.0.smithi002.stdout:1/605: rmdir d4/d11/d55/dbc 39 2024-09-17T01:02:00.642 INFO:tasks.workunit.client.0.smithi002.stdout:7/635: link f0 d1/d14/d1d/d28/d40/d58/fca 0 2024-09-17T01:02:00.642 INFO:tasks.workunit.client.0.smithi002.stdout:7/636: write d1/d14/d1d/d28/d40/d58/fca [2829232,103036] 0 2024-09-17T01:02:00.642 INFO:tasks.workunit.client.0.smithi002.stdout:7/637: fdatasync d1/d14/d1d/d28/f6e 0 2024-09-17T01:02:00.642 INFO:tasks.workunit.client.0.smithi002.stdout:7/638: write d1/d14/d1d/d29/d57/fb8 [324616,37532] 0 2024-09-17T01:02:00.643 INFO:tasks.workunit.client.0.smithi002.stdout:7/639: creat d1/d14/d1d/d28/d6b/d9e/d54/fcb x:0 0 0 2024-09-17T01:02:00.643 INFO:tasks.workunit.client.1.smithi099.stdout:4/574: dread d7/dd/d21/d26/f6c [0,4194304] 0 2024-09-17T01:02:00.643 INFO:tasks.workunit.client.1.smithi099.stdout:4/575: stat d7/dd 0 2024-09-17T01:02:00.643 INFO:tasks.workunit.client.1.smithi099.stdout:4/576: write d7/dd/de/f4f [5212127,57602] 0 2024-09-17T01:02:00.645 INFO:tasks.workunit.client.0.smithi002.stdout:8/763: mkdir d2/d3/dfd 0 2024-09-17T01:02:00.646 INFO:tasks.workunit.client.0.smithi002.stdout:8/764: chown d2/d1c/d28/f55 0 1 2024-09-17T01:02:00.647 INFO:tasks.workunit.client.1.smithi099.stdout:9/675: dwrite da/d14/d6d/f87 [0,4194304] 0 2024-09-17T01:02:00.649 INFO:tasks.workunit.client.0.smithi002.stdout:6/627: dwrite d2/d1d/d2d/d35/d37/f41 [0,4194304] 0 2024-09-17T01:02:00.651 INFO:tasks.workunit.client.1.smithi099.stdout:6/670: dwrite dc/d5d/dae/f6a [0,4194304] 0 2024-09-17T01:02:00.651 INFO:tasks.workunit.client.1.smithi099.stdout:6/671: creat dc/d27/fe2 x:0 0 0 2024-09-17T01:02:00.651 INFO:tasks.workunit.client.1.smithi099.stdout:6/672: write dc/d27/dd7/d87/fb9 [1579406,95014] 0 2024-09-17T01:02:00.651 INFO:tasks.workunit.client.1.smithi099.stdout:6/673: stat dc/d1a/d49/fba 0 2024-09-17T01:02:00.655 INFO:tasks.workunit.client.0.smithi002.stdout:8/765: dread d2/d3/d5f/d98/da5/d4f/d58/f60 [0,4194304] 0 2024-09-17T01:02:00.656 INFO:tasks.workunit.client.0.smithi002.stdout:7/640: link d1/d14/d1d/d28/d40/f5f d1/d14/d1d/d28/d6b/d9e/d5e/fcc 0 2024-09-17T01:02:00.656 INFO:tasks.workunit.client.0.smithi002.stdout:7/641: chown d1/d14/d1d/l32 791881820 1 2024-09-17T01:02:00.658 INFO:tasks.workunit.client.0.smithi002.stdout:8/766: getdents d2/d1c/dd4 0 2024-09-17T01:02:00.659 INFO:tasks.workunit.client.1.smithi099.stdout:9/676: link da/d9a/d3a/c45 da/d21/cda 0 2024-09-17T01:02:00.660 INFO:tasks.workunit.client.0.smithi002.stdout:6/628: dread d2/d1d/d27/d30/f36 [0,4194304] 0 2024-09-17T01:02:00.660 INFO:tasks.workunit.client.0.smithi002.stdout:6/629: write d2/d1d/d2d/d35/d79/fba [697213,85333] 0 2024-09-17T01:02:00.661 INFO:tasks.workunit.client.0.smithi002.stdout:6/630: creat d2/dc/d24/d53/d9e/fc8 x:0 0 0 2024-09-17T01:02:00.662 INFO:tasks.workunit.client.0.smithi002.stdout:4/752: truncate d7/de/f5c 2981108 0 2024-09-17T01:02:00.663 INFO:tasks.workunit.client.0.smithi002.stdout:6/631: truncate d2/d1d/d2d/f2e 2069109 0 2024-09-17T01:02:00.664 INFO:tasks.workunit.client.0.smithi002.stdout:6/632: chown d2/d1d/d27/c82 25657 1 2024-09-17T01:02:00.664 INFO:tasks.workunit.client.0.smithi002.stdout:6/633: truncate d2/d1d/f25 4518773 0 2024-09-17T01:02:00.664 INFO:tasks.workunit.client.0.smithi002.stdout:6/634: fsync d2/d1d/d26/d49/d7d/d8c/faf 0 2024-09-17T01:02:00.664 INFO:tasks.workunit.client.0.smithi002.stdout:6/635: fsync d2/d1d/d27/d30/f78 0 2024-09-17T01:02:00.664 INFO:tasks.workunit.client.0.smithi002.stdout:6/636: write d2/d1d/d26/d49/d7d/d8c/faf [1523159,33257] 0 2024-09-17T01:02:00.666 INFO:tasks.workunit.client.1.smithi099.stdout:9/677: unlink da/d14/d48/d69/d6c/fce 0 2024-09-17T01:02:00.668 INFO:tasks.workunit.client.1.smithi099.stdout:6/674: truncate dc/d1a/f1e 3110328 0 2024-09-17T01:02:00.671 INFO:tasks.workunit.client.1.smithi099.stdout:9/678: mknod da/d56/d84/cdb 0 2024-09-17T01:02:00.671 INFO:tasks.workunit.client.0.smithi002.stdout:8/767: fdatasync d2/d26/f69 0 2024-09-17T01:02:00.671 INFO:tasks.workunit.client.0.smithi002.stdout:8/768: chown d2/d3/dfd 271 1 2024-09-17T01:02:00.674 INFO:tasks.workunit.client.0.smithi002.stdout:0/554: rename dd/d44 to dd/d19/d1c/db7 0 2024-09-17T01:02:00.676 INFO:tasks.workunit.client.0.smithi002.stdout:1/606: rename d4/d11/d12/d23/f85 to d4/d11/d12/fcb 0 2024-09-17T01:02:00.681 INFO:tasks.workunit.client.1.smithi099.stdout:8/598: sync 2024-09-17T01:02:00.681 INFO:tasks.workunit.client.1.smithi099.stdout:1/712: sync 2024-09-17T01:02:00.681 INFO:tasks.workunit.client.1.smithi099.stdout:5/681: sync 2024-09-17T01:02:00.681 INFO:tasks.workunit.client.1.smithi099.stdout:7/604: sync 2024-09-17T01:02:00.681 INFO:tasks.workunit.client.1.smithi099.stdout:2/572: sync 2024-09-17T01:02:00.681 INFO:tasks.workunit.client.1.smithi099.stdout:2/573: creat d2/d9/d25/d26/d1b/d2c/d3f/fb6 x:0 0 0 2024-09-17T01:02:00.682 INFO:tasks.workunit.client.0.smithi002.stdout:0/555: creat dd/d19/d1a/d29/fb8 x:0 0 0 2024-09-17T01:02:00.682 INFO:tasks.workunit.client.0.smithi002.stdout:1/607: symlink d4/d11/d12/d14/d17/d51/dc0/lcc 0 2024-09-17T01:02:00.682 INFO:tasks.workunit.client.0.smithi002.stdout:8/769: rename d2/d30/f7f to d2/d1c/d28/dad/ffe 0 2024-09-17T01:02:00.682 INFO:tasks.workunit.client.0.smithi002.stdout:8/770: fsync d2/d3/d5f/d98/da5/d71/fa2 0 2024-09-17T01:02:00.682 INFO:tasks.workunit.client.0.smithi002.stdout:1/608: dread d4/d11/d55/f92 [0,4194304] 0 2024-09-17T01:02:00.683 INFO:tasks.workunit.client.1.smithi099.stdout:3/646: dwrite d9/d15/d18/dc2/f5a [0,4194304] 0 2024-09-17T01:02:00.683 INFO:tasks.workunit.client.1.smithi099.stdout:3/647: chown d9/ca6 2687 1 2024-09-17T01:02:00.683 INFO:tasks.workunit.client.1.smithi099.stdout:4/577: dwrite d7/dd/d21/fb2 [0,4194304] 0 2024-09-17T01:02:00.683 INFO:tasks.workunit.client.1.smithi099.stdout:4/578: fsync d7/dd/d21/d7b/d74/f75 0 2024-09-17T01:02:00.683 INFO:tasks.workunit.client.0.smithi002.stdout:0/556: mkdir dd/d19/d1c/d33/d67/db9 0 2024-09-17T01:02:00.684 INFO:tasks.workunit.client.1.smithi099.stdout:8/599: rename d0/d4/c1b to d0/d1f/d31/d4c/d8c/cc9 0 2024-09-17T01:02:00.684 INFO:tasks.workunit.client.1.smithi099.stdout:6/675: dread dc/d1a/d49/fb8 [0,4194304] 0 2024-09-17T01:02:00.685 INFO:tasks.workunit.client.0.smithi002.stdout:1/609: creat d4/d11/d1a/daa/dc2/fcd x:0 0 0 2024-09-17T01:02:00.685 INFO:tasks.workunit.client.0.smithi002.stdout:1/610: write d4/d11/d12/d14/d17/d56/fbf [501790,71849] 0 2024-09-17T01:02:00.685 INFO:tasks.workunit.client.1.smithi099.stdout:2/574: symlink d2/d9/d25/d26/d1b/d2c/d9b/db1/lb7 0 2024-09-17T01:02:00.686 INFO:tasks.workunit.client.0.smithi002.stdout:1/611: symlink d4/d22/d8d/lce 0 2024-09-17T01:02:00.688 INFO:tasks.workunit.client.1.smithi099.stdout:3/648: creat d9/d15/d18/fc7 x:0 0 0 2024-09-17T01:02:00.688 INFO:tasks.workunit.client.1.smithi099.stdout:8/600: mknod d0/d4/d29/d9c/cca 0 2024-09-17T01:02:00.688 INFO:tasks.workunit.client.1.smithi099.stdout:8/601: fsync d0/d4/d29/fc1 0 2024-09-17T01:02:00.689 INFO:tasks.workunit.client.0.smithi002.stdout:1/612: creat d4/d11/d12/d23/d32/d86/fcf x:0 0 0 2024-09-17T01:02:00.689 INFO:tasks.workunit.client.0.smithi002.stdout:1/613: dread - d4/d11/d55/d7a/f9f zero size 2024-09-17T01:02:00.691 INFO:tasks.workunit.client.1.smithi099.stdout:6/676: mknod dc/d27/d7e/dad/ce3 0 2024-09-17T01:02:00.691 INFO:tasks.workunit.client.1.smithi099.stdout:1/713: dread d0/d2/de/d70/f86 [0,4194304] 0 2024-09-17T01:02:00.691 INFO:tasks.workunit.client.1.smithi099.stdout:1/714: truncate d0/d8c/ff6 371235 0 2024-09-17T01:02:00.692 INFO:tasks.workunit.client.1.smithi099.stdout:3/649: creat d9/d15/d38/fc8 x:0 0 0 2024-09-17T01:02:00.692 INFO:tasks.workunit.client.1.smithi099.stdout:3/650: chown d9/d15/d18/d1a/c60 7 1 2024-09-17T01:02:00.696 INFO:tasks.workunit.client.1.smithi099.stdout:1/715: creat d0/d8/dbf/ff9 x:0 0 0 2024-09-17T01:02:00.708 INFO:tasks.workunit.client.1.smithi099.stdout:7/605: write d1/d2c/d5c/d12/f2b [309353,120539] 0 2024-09-17T01:02:00.709 INFO:tasks.workunit.client.1.smithi099.stdout:4/579: dread d7/dd/de/d17/f52 [0,4194304] 0 2024-09-17T01:02:00.709 INFO:tasks.workunit.client.1.smithi099.stdout:4/580: rename d7/dd/de to d7/dd/de/d10/d6b/d82/d8a/d9a/dc0 22 2024-09-17T01:02:00.712 INFO:tasks.workunit.client.1.smithi099.stdout:4/581: rename d7/dd/d21/fbe to d7/d35/d80/fc1 0 2024-09-17T01:02:00.715 INFO:tasks.workunit.client.1.smithi099.stdout:4/582: rename d7/dd/d21/d26/d3f/d5b/da4/fbb to d7/dd/de/d17/d72/fc2 0 2024-09-17T01:02:00.717 INFO:tasks.workunit.client.1.smithi099.stdout:4/583: rename d7/dd/d21/d26/c33 to d7/dd/de/d10/d6b/d82/d8a/d9a/da6/cc3 0 2024-09-17T01:02:00.718 INFO:tasks.workunit.client.1.smithi099.stdout:4/584: creat d7/dd/de/d10/fc4 x:0 0 0 2024-09-17T01:02:00.718 INFO:tasks.workunit.client.1.smithi099.stdout:4/585: fdatasync d7/d35/d98/fbf 0 2024-09-17T01:02:00.718 INFO:tasks.workunit.client.1.smithi099.stdout:4/586: stat d7/dd/d21/d7b/d74 0 2024-09-17T01:02:00.718 INFO:tasks.workunit.client.1.smithi099.stdout:4/587: write f6 [1662408,79975] 0 2024-09-17T01:02:00.718 INFO:tasks.workunit.client.1.smithi099.stdout:4/588: stat d7 0 2024-09-17T01:02:00.719 INFO:tasks.workunit.client.1.smithi099.stdout:4/589: symlink d7/dd/d21/d26/d3f/d5b/da4/lc5 0 2024-09-17T01:02:00.720 INFO:tasks.workunit.client.1.smithi099.stdout:4/590: write d7/dd/d21/d7b/d74/f7c [66550,75192] 0 2024-09-17T01:02:00.721 INFO:tasks.workunit.client.1.smithi099.stdout:4/591: rename d7/dd/de/d17/l99 to d7/dd/de/d17/d72/lc6 0 2024-09-17T01:02:00.731 INFO:tasks.workunit.client.1.smithi099.stdout:1/716: dread d0/d2/f24 [0,4194304] 0 2024-09-17T01:02:00.732 INFO:tasks.workunit.client.1.smithi099.stdout:1/717: dread - d0/d8/d49/d94/fda zero size 2024-09-17T01:02:00.734 INFO:tasks.workunit.client.1.smithi099.stdout:1/718: rename d0/d8/d38/fce to d0/d8/d38/d8a/dd0/ddc/ffa 0 2024-09-17T01:02:00.735 INFO:tasks.workunit.client.1.smithi099.stdout:1/719: chown d0/d8c/d9e 145 1 2024-09-17T01:02:00.735 INFO:tasks.workunit.client.1.smithi099.stdout:1/720: fsync d0/d8/d49/d94/de0/fe7 0 2024-09-17T01:02:00.736 INFO:tasks.workunit.client.1.smithi099.stdout:1/721: creat d0/d8/d38/d75/ffb x:0 0 0 2024-09-17T01:02:00.736 INFO:tasks.workunit.client.1.smithi099.stdout:1/722: chown d0/d8/dbf/ff9 65 1 2024-09-17T01:02:00.737 INFO:tasks.workunit.client.1.smithi099.stdout:1/723: mkdir d0/d8/d38/d8a/dd0/ddc/dfc 0 2024-09-17T01:02:00.737 INFO:tasks.workunit.client.1.smithi099.stdout:1/724: write d0/d8/d49/d94/de0/f4d [915076,9630] 0 2024-09-17T01:02:00.739 INFO:tasks.workunit.client.1.smithi099.stdout:3/651: dread d9/d15/d18/d1a/d23/f2c [0,4194304] 0 2024-09-17T01:02:00.741 INFO:tasks.workunit.client.1.smithi099.stdout:3/652: creat d9/d15/d18/d1a/d23/d5c/d6e/d7e/fc9 x:0 0 0 2024-09-17T01:02:00.743 INFO:tasks.workunit.client.1.smithi099.stdout:3/653: mkdir d9/d2b/d52/db5/dca 0 2024-09-17T01:02:00.743 INFO:tasks.workunit.client.1.smithi099.stdout:3/654: write d9/d15/d18/d1a/d23/d4c/f90 [1403959,30436] 0 2024-09-17T01:02:00.745 INFO:tasks.workunit.client.1.smithi099.stdout:3/655: rename d9/d15/d18/d1a/d23/d5c/d6e/d94 to d9/d15/d18/d1a/d23/d5c/d99/dbb/dcb 0 2024-09-17T01:02:00.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.761+0000 7f4c0f218640 1 -- 172.21.15.2:0/2147749196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c080ff6e0 msgr2=0x7f4c08101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:00.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.761+0000 7f4c0f218640 1 --2- 172.21.15.2:0/2147749196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c080ff6e0 0x7f4c08101ac0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80048d0 tx=0x7f4bf8009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.759 INFO:tasks.workunit.client.0.smithi002.stdout:8/771: dwrite d2/d1c/fe2 [0,4194304] 0 2024-09-17T01:02:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.761+0000 7f4c0f218640 1 -- 172.21.15.2:0/2147749196 shutdown_connections 2024-09-17T01:02:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.761+0000 7f4c0f218640 1 --2- 172.21.15.2:0/2147749196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c080ff6e0 0x7f4c08101ac0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.761+0000 7f4c0f218640 1 --2- 172.21.15.2:0/2147749196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c08065be0 0x7f4c080ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.761+0000 7f4c0f218640 1 -- 172.21.15.2:0/2147749196 >> 172.21.15.2:0/2147749196 conn(0x7f4c080f6c10 msgr2=0x7f4c080f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.761+0000 7f4c0f218640 1 -- 172.21.15.2:0/2147749196 shutdown_connections 2024-09-17T01:02:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.761+0000 7f4c0f218640 1 -- 172.21.15.2:0/2147749196 wait complete. 2024-09-17T01:02:00.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.762+0000 7f4c0f218640 1 Processor -- start 2024-09-17T01:02:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.762+0000 7f4c0f218640 1 -- start start 2024-09-17T01:02:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.762+0000 7f4c0f218640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c08065be0 0x7f4c0810d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.762+0000 7f4c0f218640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c080ff6e0 0x7f4c0810d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.762+0000 7f4c0f218640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0810dc50 con 0x7f4c080ff6e0 2024-09-17T01:02:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.762+0000 7f4c0f218640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0810e420 con 0x7f4c08065be0 2024-09-17T01:02:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.763+0000 7f4bfffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c080ff6e0 0x7f4c0810d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.763+0000 7f4bfffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c080ff6e0 0x7f4c0810d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49776/0 (socket says 172.21.15.2:49776) 2024-09-17T01:02:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.763+0000 7f4bfffff640 1 -- 172.21.15.2:0/1560131680 learned_addr learned my addr 172.21.15.2:0/1560131680 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:02:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.763+0000 7f4c0cfb4640 1 --2- 172.21.15.2:0/1560131680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c08065be0 0x7f4c0810d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:00.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.763+0000 7f4bfffff640 1 -- 172.21.15.2:0/1560131680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c08065be0 msgr2=0x7f4c0810d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:00.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.763+0000 7f4bfffff640 1 --2- 172.21.15.2:0/1560131680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c08065be0 0x7f4c0810d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:00.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.763+0000 7f4bfffff640 1 -- 172.21.15.2:0/1560131680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf8005040 con 0x7f4c080ff6e0 2024-09-17T01:02:00.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.763+0000 7f4bfffff640 1 --2- 172.21.15.2:0/1560131680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c080ff6e0 0x7f4c0810d600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009ac0 tx=0x7f4bf8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:00.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.763+0000 7f4bfd7fa640 1 -- 172.21.15.2:0/1560131680 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf8038070 con 0x7f4c080ff6e0 2024-09-17T01:02:00.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.763+0000 7f4bfd7fa640 1 -- 172.21.15.2:0/1560131680 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4bf8032d30 con 0x7f4c080ff6e0 2024-09-17T01:02:00.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.763+0000 7f4bfd7fa640 1 -- 172.21.15.2:0/1560131680 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bf803db50 con 0x7f4c080ff6e0 2024-09-17T01:02:00.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.764+0000 7f4c0f218640 1 -- 172.21.15.2:0/1560131680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0810e650 con 0x7f4c080ff6e0 2024-09-17T01:02:00.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.764+0000 7f4c0f218640 1 -- 172.21.15.2:0/1560131680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0810eb10 con 0x7f4c080ff6e0 2024-09-17T01:02:00.765 INFO:tasks.workunit.client.0.smithi002.stdout:8/772: getdents d2/d3/d5f/d98/da5/d4f/d58 0 2024-09-17T01:02:00.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.765+0000 7f4c0f218640 1 -- 172.21.15.2:0/1560131680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c080fa890 con 0x7f4c080ff6e0 2024-09-17T01:02:00.766 INFO:tasks.workunit.client.0.smithi002.stdout:8/773: dread - d2/d3/d5f/d98/da5/d71/d89/fe1 zero size 2024-09-17T01:02:00.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.765+0000 7f4bfd7fa640 1 -- 172.21.15.2:0/1560131680 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f4bf8030020 con 0x7f4c080ff6e0 2024-09-17T01:02:00.767 INFO:tasks.workunit.client.0.smithi002.stdout:8/774: mknod d2/d3/d5f/d98/da5/cff 0 2024-09-17T01:02:00.767 INFO:tasks.workunit.client.1.smithi099.stdout:5/682: dwrite d2/d26/f83 [0,4194304] 0 2024-09-17T01:02:00.767 INFO:tasks.workunit.client.1.smithi099.stdout:5/683: creat d2/d26/fdd x:0 0 0 2024-09-17T01:02:00.767 INFO:tasks.workunit.client.1.smithi099.stdout:5/684: mkdir d2/dc/d17/d3c/db3/dde 0 2024-09-17T01:02:00.768 INFO:tasks.workunit.client.1.smithi099.stdout:5/685: creat d2/dc/d17/d3c/db3/fdf x:0 0 0 2024-09-17T01:02:00.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.766+0000 7f4bfd7fa640 1 --2- 172.21.15.2:0/1560131680 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f4bf006ed60 0x7f4bf0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:00.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.766+0000 7f4bfd7fa640 1 -- 172.21.15.2:0/1560131680 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4bf80aec00 con 0x7f4c080ff6e0 2024-09-17T01:02:00.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.766+0000 7f4c0cfb4640 1 --2- 172.21.15.2:0/1560131680 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f4bf006ed60 0x7f4bf0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:00.768 INFO:tasks.workunit.client.0.smithi002.stdout:8/775: symlink d2/d3/de6/l100 0 2024-09-17T01:02:00.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.767+0000 7f4c0cfb4640 1 --2- 172.21.15.2:0/1560131680 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f4bf006ed60 0x7f4bf0071210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009fd0 tx=0x7f4c0400b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:00.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:00.770+0000 7f4bfd7fa640 1 -- 172.21.15.2:0/1560131680 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4bf80b4020 con 0x7f4c080ff6e0 2024-09-17T01:02:00.769 INFO:tasks.workunit.client.1.smithi099.stdout:9/679: dwrite da/d18/fd6 [8388608,4194304] 0 2024-09-17T01:02:00.770 INFO:tasks.workunit.client.0.smithi002.stdout:7/642: dwrite d1/d14/d1d/d28/d40/d58/fca [0,4194304] 0 2024-09-17T01:02:00.770 INFO:tasks.workunit.client.0.smithi002.stdout:4/753: dwrite d7/de/f27 [0,4194304] 0 2024-09-17T01:02:00.770 INFO:tasks.workunit.client.0.smithi002.stdout:7/643: write d1/f20 [2610043,18960] 0 2024-09-17T01:02:00.774 INFO:tasks.workunit.client.0.smithi002.stdout:4/754: rename d7/d19/d9f/d80/d62/l43 to d7/d19/d9c/de9/leb 0 2024-09-17T01:02:00.776 INFO:tasks.workunit.client.0.smithi002.stdout:7/644: rename d1/d14/d1d/d21 to d1/d14/d67/dc0/dcd 0 2024-09-17T01:02:00.776 INFO:tasks.workunit.client.0.smithi002.stdout:7/645: fdatasync d1/d14/f3f 0 2024-09-17T01:02:00.777 INFO:tasks.workunit.client.0.smithi002.stdout:4/755: rmdir d7/d19/d9f/d80/d62/dbe 39 2024-09-17T01:02:00.778 INFO:tasks.workunit.client.0.smithi002.stdout:4/756: mknod d7/d71/d8e/cec 0 2024-09-17T01:02:00.778 INFO:tasks.workunit.client.1.smithi099.stdout:8/602: dwrite d0/d1f/d55/faf [0,4194304] 0 2024-09-17T01:02:00.778 INFO:tasks.workunit.client.1.smithi099.stdout:4/592: dwrite d7/dd/f9d [0,4194304] 0 2024-09-17T01:02:00.779 INFO:tasks.workunit.client.0.smithi002.stdout:4/757: mknod d7/de6/ced 0 2024-09-17T01:02:00.779 INFO:tasks.workunit.client.0.smithi002.stdout:4/758: chown d7/d19/d9f/d80/fcb 75960 1 2024-09-17T01:02:00.779 INFO:tasks.workunit.client.1.smithi099.stdout:1/725: dwrite d0/d2/de/d70/de8/fab [0,4194304] 0 2024-09-17T01:02:00.779 INFO:tasks.workunit.client.1.smithi099.stdout:1/726: readlink d0/d2/de/d31/l76 0 2024-09-17T01:02:00.780 INFO:tasks.workunit.client.1.smithi099.stdout:1/727: fsync d0/d2/ff 0 2024-09-17T01:02:00.780 INFO:tasks.workunit.client.0.smithi002.stdout:7/646: write d1/d14/d1d/d29/f2f [1286230,113692] 0 2024-09-17T01:02:00.780 INFO:tasks.workunit.client.0.smithi002.stdout:1/614: dwrite d4/fa [4194304,4194304] 0 2024-09-17T01:02:00.782 INFO:tasks.workunit.client.1.smithi099.stdout:3/656: dwrite d9/d15/f34 [4194304,4194304] 0 2024-09-17T01:02:00.782 INFO:tasks.workunit.client.1.smithi099.stdout:3/657: creat d9/d15/d18/d1a/d23/d5c/d99/fcc x:0 0 0 2024-09-17T01:02:00.782 INFO:tasks.workunit.client.1.smithi099.stdout:3/658: chown d9/d15/f34 770873 1 2024-09-17T01:02:00.782 INFO:tasks.workunit.client.1.smithi099.stdout:7/606: dwrite d1/d2c/f6b [0,4194304] 0 2024-09-17T01:02:00.782 INFO:tasks.workunit.client.1.smithi099.stdout:7/607: write d1/f35 [2024297,14640] 0 2024-09-17T01:02:00.783 INFO:tasks.workunit.client.0.smithi002.stdout:0/557: dwrite dd/d19/d1a/f4a [0,4194304] 0 2024-09-17T01:02:00.783 INFO:tasks.workunit.client.0.smithi002.stdout:7/647: creat d1/d14/d67/dc0/dcd/d45/fce x:0 0 0 2024-09-17T01:02:00.783 INFO:tasks.workunit.client.0.smithi002.stdout:1/615: creat d4/d11/d12/d30/d5e/fd0 x:0 0 0 2024-09-17T01:02:00.783 INFO:tasks.workunit.client.0.smithi002.stdout:1/616: dread - d4/d11/d12/d14/d17/d51/fbd zero size 2024-09-17T01:02:00.783 INFO:tasks.workunit.client.1.smithi099.stdout:6/677: dwrite dc/d2b/fa6 [0,4194304] 0 2024-09-17T01:02:00.783 INFO:tasks.workunit.client.1.smithi099.stdout:9/680: write da/d21/d2a/f54 [6310503,91327] 0 2024-09-17T01:02:00.787 INFO:tasks.workunit.client.1.smithi099.stdout:5/686: dwrite d2/d8/fc1 [0,4194304] 0 2024-09-17T01:02:00.789 INFO:tasks.workunit.client.0.smithi002.stdout:7/648: unlink d1/d14/f8a 0 2024-09-17T01:02:00.791 INFO:tasks.workunit.client.0.smithi002.stdout:1/617: symlink d4/d22/d8d/ld1 0 2024-09-17T01:02:00.792 INFO:tasks.workunit.client.0.smithi002.stdout:0/558: getdents dd/d19 0 2024-09-17T01:02:00.792 INFO:tasks.workunit.client.1.smithi099.stdout:1/728: unlink d0/d8/l22 0 2024-09-17T01:02:00.793 INFO:tasks.workunit.client.1.smithi099.stdout:8/603: dread d0/d1f/d90/fb7 [0,4194304] 0 2024-09-17T01:02:00.793 INFO:tasks.workunit.client.0.smithi002.stdout:7/649: mkdir d1/d14/d1d/d29/d98/dcf 0 2024-09-17T01:02:00.793 INFO:tasks.workunit.client.1.smithi099.stdout:7/608: rename d1/d2c/d5c/d3f/fb0 to d1/d8f/fc1 0 2024-09-17T01:02:00.794 INFO:tasks.workunit.client.0.smithi002.stdout:8/776: getdents d2/d30 0 2024-09-17T01:02:00.794 INFO:tasks.workunit.client.0.smithi002.stdout:8/777: chown d2/d26/f57 1309841 1 2024-09-17T01:02:00.796 INFO:tasks.workunit.client.1.smithi099.stdout:9/681: truncate da/d14/d48/d69/d6c/fcd 1924811 0 2024-09-17T01:02:00.796 INFO:tasks.workunit.client.1.smithi099.stdout:9/682: truncate da/d14/d40/f97 5697880 0 2024-09-17T01:02:00.796 INFO:tasks.workunit.client.1.smithi099.stdout:9/683: fdatasync da/d18/d5e/f9e 0 2024-09-17T01:02:00.796 INFO:tasks.workunit.client.1.smithi099.stdout:9/684: fsync da/d18/fd6 0 2024-09-17T01:02:00.796 INFO:tasks.workunit.client.1.smithi099.stdout:9/685: write da/d9b/fa1 [1286163,120336] 0 2024-09-17T01:02:00.799 INFO:tasks.workunit.client.1.smithi099.stdout:7/609: mkdir d1/d2c/d5c/d12/dc2 0 2024-09-17T01:02:00.799 INFO:tasks.workunit.client.1.smithi099.stdout:1/729: rename d0/d2/de/d70/dee to d0/de2/dfd 0 2024-09-17T01:02:00.800 INFO:tasks.workunit.client.0.smithi002.stdout:0/559: mkdir dd/d19/d1c/dba 0 2024-09-17T01:02:00.800 INFO:tasks.workunit.client.0.smithi002.stdout:0/560: chown dd/d19/d1c/d33 31417 1 2024-09-17T01:02:00.800 INFO:tasks.workunit.client.0.smithi002.stdout:0/561: chown dd/d19/d1c/d1f/d76/ca7 168 1 2024-09-17T01:02:00.800 INFO:tasks.workunit.client.0.smithi002.stdout:0/562: chown dd/d19/d1c/d1f/d76/f86 17 1 2024-09-17T01:02:00.802 INFO:tasks.workunit.client.1.smithi099.stdout:9/686: mkdir da/d14/d62/dad/ddc 0 2024-09-17T01:02:00.802 INFO:tasks.workunit.client.1.smithi099.stdout:7/610: mkdir d1/d2c/d5c/d1c/d72/dc3 0 2024-09-17T01:02:00.804 INFO:tasks.workunit.client.1.smithi099.stdout:9/687: truncate da/d50/f60 3442777 0 2024-09-17T01:02:00.804 INFO:tasks.workunit.client.1.smithi099.stdout:9/688: fsync da/d50/f83 0 2024-09-17T01:02:00.804 INFO:tasks.workunit.client.1.smithi099.stdout:9/689: chown da/l28 7 1 2024-09-17T01:02:00.806 INFO:tasks.workunit.client.1.smithi099.stdout:7/611: creat d1/d2c/d47/d48/fc4 x:0 0 0 2024-09-17T01:02:00.806 INFO:tasks.workunit.client.1.smithi099.stdout:7/612: chown d1/d2c/d5c/d1c/d5a/d6f/l87 257788 1 2024-09-17T01:02:00.809 INFO:tasks.workunit.client.0.smithi002.stdout:8/778: symlink d2/d3/d5f/d98/dab/l101 0 2024-09-17T01:02:00.809 INFO:tasks.workunit.client.0.smithi002.stdout:8/779: readlink d2/d3/d5f/d98/da5/d4f/d77/dd9/lf6 0 2024-09-17T01:02:00.809 INFO:tasks.workunit.client.1.smithi099.stdout:7/613: creat d1/d2c/d7a/dac/fc5 x:0 0 0 2024-09-17T01:02:00.809 INFO:tasks.workunit.client.1.smithi099.stdout:7/614: fdatasync d1/d2c/d47/d48/f69 0 2024-09-17T01:02:00.811 INFO:tasks.workunit.client.0.smithi002.stdout:1/618: rmdir d4/d11/d12/d30/d5e/d8c 39 2024-09-17T01:02:00.811 INFO:tasks.workunit.client.1.smithi099.stdout:7/615: link d1/d2c/d5c/d1c/c42 d1/d2c/d5c/d1c/d5a/d76/cc6 0 2024-09-17T01:02:00.813 INFO:tasks.workunit.client.0.smithi002.stdout:8/780: mkdir d2/d3/d5f/d47/d102 0 2024-09-17T01:02:00.813 INFO:tasks.workunit.client.0.smithi002.stdout:8/781: creat d2/d9/dd/f103 x:0 0 0 2024-09-17T01:02:00.813 INFO:tasks.workunit.client.0.smithi002.stdout:8/782: fsync d2/d9/f38 0 2024-09-17T01:02:00.816 INFO:tasks.workunit.client.0.smithi002.stdout:1/619: link d4/d11/d12/l7d d4/d11/d1a/ld2 0 2024-09-17T01:02:00.817 INFO:tasks.workunit.client.1.smithi099.stdout:6/678: write dc/d1a/f40 [1942294,125196] 0 2024-09-17T01:02:00.819 INFO:tasks.workunit.client.0.smithi002.stdout:8/783: creat d2/d3/d5f/d98/da5/d4f/d58/f104 x:0 0 0 2024-09-17T01:02:00.819 INFO:tasks.workunit.client.1.smithi099.stdout:7/616: write d1/f19 [1119154,112293] 0 2024-09-17T01:02:00.822 INFO:tasks.workunit.client.0.smithi002.stdout:8/784: write d2/d3/f72 [186818,72610] 0 2024-09-17T01:02:00.825 INFO:tasks.workunit.client.0.smithi002.stdout:8/785: unlink d2/d9/dd/cf7 0 2024-09-17T01:02:00.825 INFO:tasks.workunit.client.1.smithi099.stdout:1/730: dread d0/d8/d49/f4c [0,4194304] 0 2024-09-17T01:02:00.825 INFO:tasks.workunit.client.1.smithi099.stdout:1/731: chown d0/d2/f3b 3132416 1 2024-09-17T01:02:00.826 INFO:tasks.workunit.client.1.smithi099.stdout:3/659: dwrite d9/d3b/d44/fbe [0,4194304] 0 2024-09-17T01:02:00.826 INFO:tasks.workunit.client.1.smithi099.stdout:3/660: dread - d9/d15/d18/d1a/d23/d5c/fa1 zero size 2024-09-17T01:02:00.827 INFO:tasks.workunit.client.1.smithi099.stdout:1/732: mknod d0/d8/d49/d94/de0/dba/cfe 0 2024-09-17T01:02:00.827 INFO:tasks.workunit.client.1.smithi099.stdout:1/733: write d0/d8/d49/d94/de0/f4d [1617258,1355] 0 2024-09-17T01:02:00.827 INFO:tasks.workunit.client.1.smithi099.stdout:1/734: chown d0/d2/de/c2e 108796 1 2024-09-17T01:02:00.827 INFO:tasks.workunit.client.1.smithi099.stdout:1/735: stat d0/d8/d38/d75/cac 0 2024-09-17T01:02:00.827 INFO:tasks.workunit.client.1.smithi099.stdout:1/736: fsync d0/d2/f25 0 2024-09-17T01:02:00.827 INFO:tasks.workunit.client.1.smithi099.stdout:1/737: readlink d0/d2/la5 0 2024-09-17T01:02:00.827 INFO:tasks.workunit.client.1.smithi099.stdout:1/738: truncate d0/d8/d38/d56/d93/fec 417762 0 2024-09-17T01:02:00.828 INFO:tasks.workunit.client.0.smithi002.stdout:5/541: sync 2024-09-17T01:02:00.828 INFO:tasks.workunit.client.0.smithi002.stdout:8/786: symlink d2/d9/l105 0 2024-09-17T01:02:00.830 INFO:tasks.workunit.client.0.smithi002.stdout:4/759: dwrite d7/d19/d2e/fbd [0,4194304] 0 2024-09-17T01:02:00.831 INFO:tasks.workunit.client.1.smithi099.stdout:1/739: stat d0/d8c/d9e/lae 0 2024-09-17T01:02:00.831 INFO:tasks.workunit.client.1.smithi099.stdout:1/740: stat d0/d8/c47 0 2024-09-17T01:02:00.832 INFO:tasks.workunit.client.0.smithi002.stdout:5/542: mknod d2/d2d/d10/d14/d19/d39/d25/d32/ca8 0 2024-09-17T01:02:00.836 INFO:tasks.workunit.client.0.smithi002.stdout:8/787: mkdir d2/d3/d5f/d47/d106 0 2024-09-17T01:02:00.838 INFO:tasks.workunit.client.0.smithi002.stdout:1/620: dwrite d4/fe [0,4194304] 0 2024-09-17T01:02:00.838 INFO:tasks.workunit.client.0.smithi002.stdout:1/621: stat d4/d11/d12/fa7 0 2024-09-17T01:02:00.844 INFO:tasks.workunit.client.0.smithi002.stdout:5/543: symlink d2/d2d/d10/d14/d19/d39/d51/la9 0 2024-09-17T01:02:00.844 INFO:tasks.workunit.client.0.smithi002.stdout:5/544: chown d2/d2d/d10/d14/c45 15141479 1 2024-09-17T01:02:00.844 INFO:tasks.workunit.client.0.smithi002.stdout:5/545: read d2/d2d/d10/d14/d19/d39/f52 [410418,11044] 0 2024-09-17T01:02:00.847 INFO:tasks.workunit.client.0.smithi002.stdout:1/622: symlink d4/d22/d8d/da9/ld3 0 2024-09-17T01:02:00.849 INFO:tasks.workunit.client.0.smithi002.stdout:5/546: symlink d2/d2d/d10/d20/d24/laa 0 2024-09-17T01:02:00.850 INFO:tasks.workunit.client.1.smithi099.stdout:5/687: dwrite d2/dc4/d90/da4/f6d [4194304,4194304] 0 2024-09-17T01:02:00.850 INFO:tasks.workunit.client.0.smithi002.stdout:5/547: symlink d2/d2d/d10/d9b/lab 0 2024-09-17T01:02:00.852 INFO:tasks.workunit.client.0.smithi002.stdout:5/548: symlink d2/d2d/d10/d95/lac 0 2024-09-17T01:02:00.852 INFO:tasks.workunit.client.0.smithi002.stdout:5/549: write d2/fa3 [203406,15951] 0 2024-09-17T01:02:00.852 INFO:tasks.workunit.client.0.smithi002.stdout:5/550: read d2/d2d/d10/d9b/fa2 [333771,19282] 0 2024-09-17T01:02:00.866 INFO:tasks.workunit.client.1.smithi099.stdout:5/688: read d2/d26/f4e [2814070,31302] 0 2024-09-17T01:02:00.867 INFO:tasks.workunit.client.1.smithi099.stdout:5/689: link d2/dc4/d90/da4/f4b d2/dc/d17/d3c/fe0 0 2024-09-17T01:02:00.868 INFO:tasks.workunit.client.0.smithi002.stdout:1/623: read d4/fb0 [1508926,65692] 0 2024-09-17T01:02:00.879 INFO:tasks.workunit.client.1.smithi099.stdout:4/593: dwrite d7/dd/de/d17/f91 [0,4194304] 0 2024-09-17T01:02:00.880 INFO:tasks.workunit.client.0.smithi002.stdout:5/551: write d2/d2d/d10/d14/f8c [7658,56744] 0 2024-09-17T01:02:00.881 INFO:tasks.workunit.client.0.smithi002.stdout:0/563: dwrite dd/d19/d1a/d29/f52 [0,4194304] 0 2024-09-17T01:02:00.881 INFO:tasks.workunit.client.0.smithi002.stdout:5/552: truncate d2/f54 1081172 0 2024-09-17T01:02:00.881 INFO:tasks.workunit.client.1.smithi099.stdout:4/594: mknod d7/dd/de/d10/d6b/d82/d8a/cc7 0 2024-09-17T01:02:00.885 INFO:tasks.workunit.client.1.smithi099.stdout:4/595: symlink d7/d35/d80/lc8 0 2024-09-17T01:02:00.885 INFO:tasks.workunit.client.1.smithi099.stdout:4/596: rename d7/dd/d21/d26/d3f to d7/dd/d21/d26/d3f/d5b/dc9 22 2024-09-17T01:02:00.885 INFO:tasks.workunit.client.0.smithi002.stdout:0/564: mknod dd/d19/d1c/d1f/d39/cbb 0 2024-09-17T01:02:00.885 INFO:tasks.workunit.client.0.smithi002.stdout:5/553: mknod d2/d2d/d10/d95/cad 0 2024-09-17T01:02:00.885 INFO:tasks.workunit.client.0.smithi002.stdout:0/565: mkdir dd/d19/d1a/dbc 0 2024-09-17T01:02:00.890 INFO:tasks.workunit.client.0.smithi002.stdout:5/554: read d2/de/f34 [4029251,89791] 0 2024-09-17T01:02:00.891 INFO:tasks.workunit.client.1.smithi099.stdout:8/604: dwrite d0/d53/fab [0,4194304] 0 2024-09-17T01:02:00.891 INFO:tasks.workunit.client.1.smithi099.stdout:9/690: dwrite da/d50/f5c [0,4194304] 0 2024-09-17T01:02:00.891 INFO:tasks.workunit.client.1.smithi099.stdout:8/605: stat d0/d1f/d90 0 2024-09-17T01:02:00.891 INFO:tasks.workunit.client.1.smithi099.stdout:9/691: fdatasync da/d9a/fd8 0 2024-09-17T01:02:00.891 INFO:tasks.workunit.client.1.smithi099.stdout:9/692: stat da/d14/d40/l46 0 2024-09-17T01:02:00.896 INFO:tasks.workunit.client.1.smithi099.stdout:8/606: unlink d0/d1f/c16 0 2024-09-17T01:02:00.896 INFO:tasks.workunit.client.1.smithi099.stdout:8/607: chown d0/d4/l9 42198140 1 2024-09-17T01:02:00.897 INFO:tasks.workunit.client.0.smithi002.stdout:7/650: dwrite d1/d14/d67/dc0/dcd/f61 [0,4194304] 0 2024-09-17T01:02:00.897 INFO:tasks.workunit.client.1.smithi099.stdout:9/693: mknod da/d14/d62/dad/cdd 0 2024-09-17T01:02:00.899 INFO:tasks.workunit.client.1.smithi099.stdout:8/608: link d0/d1f/d31/f7b d0/fcb 0 2024-09-17T01:02:00.901 INFO:tasks.workunit.client.0.smithi002.stdout:0/566: dread dd/d19/d1a/f70 [0,4194304] 0 2024-09-17T01:02:00.901 INFO:tasks.workunit.client.0.smithi002.stdout:0/567: dread - dd/d3d/f85 zero size 2024-09-17T01:02:00.901 INFO:tasks.workunit.client.0.smithi002.stdout:0/568: truncate dd/d19/d1c/d78/f93 980069 0 2024-09-17T01:02:00.901 INFO:tasks.workunit.client.0.smithi002.stdout:5/555: dread d2/d2d/d10/d23/d6e/f6b [0,4194304] 0 2024-09-17T01:02:00.901 INFO:tasks.workunit.client.1.smithi099.stdout:9/694: creat da/d8e/fde x:0 0 0 2024-09-17T01:02:00.902 INFO:tasks.workunit.client.1.smithi099.stdout:9/695: chown da/d56/da5 13468 1 2024-09-17T01:02:00.902 INFO:tasks.workunit.client.0.smithi002.stdout:7/651: symlink d1/d14/d1d/d28/d6b/ld0 0 2024-09-17T01:02:00.903 INFO:tasks.workunit.client.0.smithi002.stdout:0/569: symlink dd/d19/d1c/d33/d67/db9/lbd 0 2024-09-17T01:02:00.903 INFO:tasks.workunit.client.0.smithi002.stdout:5/556: dread d2/d2d/d10/d14/d19/d39/f52 [0,4194304] 0 2024-09-17T01:02:00.904 INFO:tasks.workunit.client.0.smithi002.stdout:4/760: dwrite d7/d19/d9c/de9/fa2 [0,4194304] 0 2024-09-17T01:02:00.904 INFO:tasks.workunit.client.1.smithi099.stdout:1/741: dwrite d0/d8c/fc6 [0,4194304] 0 2024-09-17T01:02:00.904 INFO:tasks.workunit.client.1.smithi099.stdout:8/609: mknod d0/d1f/d31/d4c/d8c/ccc 0 2024-09-17T01:02:00.904 INFO:tasks.workunit.client.1.smithi099.stdout:4/597: fsync f6 0 2024-09-17T01:02:00.904 INFO:tasks.workunit.client.1.smithi099.stdout:8/610: chown d0/f18 1020 1 2024-09-17T01:02:00.904 INFO:tasks.workunit.client.1.smithi099.stdout:6/679: dwrite dc/d5d/dae/f6a [4194304,4194304] 0 2024-09-17T01:02:00.904 INFO:tasks.workunit.client.1.smithi099.stdout:6/680: fsync dc/d27/d58/f78 0 2024-09-17T01:02:00.905 INFO:tasks.workunit.client.1.smithi099.stdout:6/681: write dc/d27/d58/f78 [4657153,76433] 0 2024-09-17T01:02:00.906 INFO:tasks.workunit.client.1.smithi099.stdout:5/690: dwrite d2/dc/d17/f52 [0,4194304] 0 2024-09-17T01:02:00.906 INFO:tasks.workunit.client.1.smithi099.stdout:3/661: dwrite d9/d2b/fb0 [0,4194304] 0 2024-09-17T01:02:00.906 INFO:tasks.workunit.client.1.smithi099.stdout:7/617: dwrite d1/d2c/d7a/faa [0,4194304] 0 2024-09-17T01:02:00.906 INFO:tasks.workunit.client.1.smithi099.stdout:9/696: creat da/d14/d62/dad/ddc/fdf x:0 0 0 2024-09-17T01:02:00.907 INFO:tasks.workunit.client.0.smithi002.stdout:7/652: creat d1/d14/d67/dc0/dcd/d45/fd1 x:0 0 0 2024-09-17T01:02:00.907 INFO:tasks.workunit.client.0.smithi002.stdout:7/653: readlink d1/d14/d1d/d28/d6b/d9e/d5e/lc7 0 2024-09-17T01:02:00.907 INFO:tasks.workunit.client.0.smithi002.stdout:7/654: chown d1/d14/d1d/d28/d6b/d9e/d54/laa 3654361 1 2024-09-17T01:02:00.907 INFO:tasks.workunit.client.0.smithi002.stdout:1/624: dwrite d4/d11/f82 [0,4194304] 0 2024-09-17T01:02:00.907 INFO:tasks.workunit.client.0.smithi002.stdout:1/625: read d4/d11/d12/d14/d17/d3b/f62 [2722907,50739] 0 2024-09-17T01:02:00.907 INFO:tasks.workunit.client.0.smithi002.stdout:1/626: write d4/d11/f71 [781535,130934] 0 2024-09-17T01:02:00.907 INFO:tasks.workunit.client.0.smithi002.stdout:1/627: fdatasync d4/d11/d12/d14/d17/d3b/f42 0 2024-09-17T01:02:00.907 INFO:tasks.workunit.client.0.smithi002.stdout:1/628: creat d4/d11/d12/d30/d43/d67/fd4 x:0 0 0 2024-09-17T01:02:00.907 INFO:tasks.workunit.client.0.smithi002.stdout:1/629: fdatasync d4/d11/d12/d14/d17/d3b/f42 0 2024-09-17T01:02:00.907 INFO:tasks.workunit.client.0.smithi002.stdout:1/630: stat d4/d11/d12/d14/d17/d20/fb9 0 2024-09-17T01:02:00.907 INFO:tasks.workunit.client.0.smithi002.stdout:0/570: mkdir dd/d19/d1c/d33/d67/d68/d9d/dbe 0 2024-09-17T01:02:00.908 INFO:tasks.workunit.client.0.smithi002.stdout:0/571: fdatasync dd/f5a 0 2024-09-17T01:02:00.908 INFO:tasks.workunit.client.0.smithi002.stdout:5/557: mkdir d2/d2d/d10/d14/d19/d39/dae 0 2024-09-17T01:02:00.910 INFO:tasks.workunit.client.1.smithi099.stdout:8/611: mkdir d0/d41/d5a/dcd 0 2024-09-17T01:02:00.912 INFO:tasks.workunit.client.0.smithi002.stdout:4/761: mknod d7/d19/d9f/d80/d62/d52/dc7/d77/cee 0 2024-09-17T01:02:00.912 INFO:tasks.workunit.client.1.smithi099.stdout:4/598: symlink d7/dbc/lca 0 2024-09-17T01:02:00.914 INFO:tasks.workunit.client.0.smithi002.stdout:7/655: mknod d1/d14/d1d/d28/d40/d58/cd2 0 2024-09-17T01:02:00.916 INFO:tasks.workunit.client.0.smithi002.stdout:4/762: read d7/de/d32/f73 [950740,90079] 0 2024-09-17T01:02:00.920 INFO:tasks.workunit.client.1.smithi099.stdout:3/662: write d9/d3b/d44/f48 [653040,44825] 0 2024-09-17T01:02:00.920 INFO:tasks.workunit.client.1.smithi099.stdout:3/663: chown d9/d15/d18/d1a/d23/d5c/fa1 15783 1 2024-09-17T01:02:00.920 INFO:tasks.workunit.client.1.smithi099.stdout:3/664: stat d9/d15/d18/d1a/fa8 0 2024-09-17T01:02:00.920 INFO:tasks.workunit.client.1.smithi099.stdout:3/665: write d9/d15/d18/d1a/d23/f4a [407350,1006] 0 2024-09-17T01:02:00.920 INFO:tasks.workunit.client.1.smithi099.stdout:3/666: chown d9/d3b/db2/c8e 98211 1 2024-09-17T01:02:00.920 INFO:tasks.workunit.client.1.smithi099.stdout:1/742: write d0/d8c/f99 [3883787,42968] 0 2024-09-17T01:02:00.921 INFO:tasks.workunit.client.1.smithi099.stdout:9/697: write da/d9b/fa0 [2518365,90565] 0 2024-09-17T01:02:00.921 INFO:tasks.workunit.client.1.smithi099.stdout:9/698: chown da/d14/d6d/c94 40 1 2024-09-17T01:02:00.921 INFO:tasks.workunit.client.1.smithi099.stdout:7/618: dread d1/d2c/d7a/faa [0,4194304] 0 2024-09-17T01:02:00.921 INFO:tasks.workunit.client.1.smithi099.stdout:7/619: readlink d1/d2c/d5c/l63 0 2024-09-17T01:02:00.921 INFO:tasks.workunit.client.1.smithi099.stdout:5/691: link d2/dc/d17/d3c/fe0 d2/dc/d97/fe1 0 2024-09-17T01:02:00.923 INFO:tasks.workunit.client.1.smithi099.stdout:9/699: dread da/d21/d2a/f8c [0,4194304] 0 2024-09-17T01:02:00.924 INFO:tasks.workunit.client.1.smithi099.stdout:8/612: symlink d0/d4/d64/dbe/lce 0 2024-09-17T01:02:00.925 INFO:tasks.workunit.client.0.smithi002.stdout:1/631: unlink d4/d11/d12/d14/d17/f27 0 2024-09-17T01:02:00.925 INFO:tasks.workunit.client.1.smithi099.stdout:4/599: getdents d7/dd/de/d10/d6b 0 2024-09-17T01:02:00.926 INFO:tasks.workunit.client.0.smithi002.stdout:5/558: symlink d2/d2d/d10/d23/laf 0 2024-09-17T01:02:00.927 INFO:tasks.workunit.client.1.smithi099.stdout:3/667: symlink d9/d15/d18/d1a/d23/d5c/d99/dbb/lcd 0 2024-09-17T01:02:00.928 INFO:tasks.workunit.client.0.smithi002.stdout:7/656: symlink d1/d14/d1d/d28/d6b/d9e/ld3 0 2024-09-17T01:02:00.929 INFO:tasks.workunit.client.1.smithi099.stdout:5/692: mkdir d2/d26/d64/de2 0 2024-09-17T01:02:00.930 INFO:tasks.workunit.client.0.smithi002.stdout:1/632: creat d4/d22/d8d/fd5 x:0 0 0 2024-09-17T01:02:00.930 INFO:tasks.workunit.client.0.smithi002.stdout:1/633: truncate d4/d11/d12/f4c 1220902 0 2024-09-17T01:02:00.931 INFO:tasks.workunit.client.1.smithi099.stdout:9/700: unlink da/d18/l37 0 2024-09-17T01:02:00.931 INFO:tasks.workunit.client.1.smithi099.stdout:9/701: truncate da/d18/d5e/fb6 4213120 0 2024-09-17T01:02:00.932 INFO:tasks.workunit.client.1.smithi099.stdout:9/702: read da/d21/d5b/fbc [319879,83550] 0 2024-09-17T01:02:00.933 INFO:tasks.workunit.client.1.smithi099.stdout:4/600: mkdir d7/dd/d21/d7b/d4b/dcb 0 2024-09-17T01:02:00.933 INFO:tasks.workunit.client.1.smithi099.stdout:4/601: truncate d7/dd/d21/d26/f60 4537306 0 2024-09-17T01:02:00.934 INFO:tasks.workunit.client.0.smithi002.stdout:5/559: rename d2/d2d/d10/d14/d19/d39/d25/d32 to d2/d2d/d10/d14/d19/da5/db0 0 2024-09-17T01:02:00.934 INFO:tasks.workunit.client.1.smithi099.stdout:3/668: creat d9/d15/d18/d1a/d23/d5c/d6e/fce x:0 0 0 2024-09-17T01:02:00.936 INFO:tasks.workunit.client.0.smithi002.stdout:7/657: rename d1/d14/d1d/d28/d6b/d9e/d5e/c7d to d1/d14/d1d/d29/d98/dcf/cd4 0 2024-09-17T01:02:00.936 INFO:tasks.workunit.client.0.smithi002.stdout:7/658: fdatasync d1/d14/d67/dc0/dcd/d45/fd1 0 2024-09-17T01:02:00.936 INFO:tasks.workunit.client.0.smithi002.stdout:7/659: fdatasync d1/d14/d1d/d28/f6e 0 2024-09-17T01:02:00.938 INFO:tasks.workunit.client.1.smithi099.stdout:1/743: rename d0/d8c/d9e/fb8 to d0/d2/fff 0 2024-09-17T01:02:00.939 INFO:tasks.workunit.client.1.smithi099.stdout:7/620: getdents d1/d2c/d5c/d3f 0 2024-09-17T01:02:00.939 INFO:tasks.workunit.client.1.smithi099.stdout:7/621: fsync d1/d2c/d5c/d3f/f92 0 2024-09-17T01:02:00.940 INFO:tasks.workunit.client.0.smithi002.stdout:1/634: rename d4/d11/d12/d23/f99 to d4/d11/d12/d14/d17/d51/dc0/fd6 0 2024-09-17T01:02:00.940 INFO:tasks.workunit.client.1.smithi099.stdout:8/613: getdents d0/d1f/d31/d4c 0 2024-09-17T01:02:00.941 INFO:tasks.workunit.client.0.smithi002.stdout:4/763: dwrite d7/de/f28 [4194304,4194304] 0 2024-09-17T01:02:00.941 INFO:tasks.workunit.client.1.smithi099.stdout:6/682: dwrite dc/d27/d7e/f94 [0,4194304] 0 2024-09-17T01:02:00.941 INFO:tasks.workunit.client.0.smithi002.stdout:0/572: dwrite dd/d19/d1a/f96 [0,4194304] 0 2024-09-17T01:02:00.942 INFO:tasks.workunit.client.0.smithi002.stdout:7/660: link d1/d14/d1d/d28/d40/d58/cd2 d1/d14/d1d/d28/d2d/cd5 0 2024-09-17T01:02:00.943 INFO:tasks.workunit.client.0.smithi002.stdout:1/635: mkdir d4/d11/d12/d30/d43/dd7 0 2024-09-17T01:02:00.945 INFO:tasks.workunit.client.1.smithi099.stdout:9/703: creat da/d14/d40/fe0 x:0 0 0 2024-09-17T01:02:00.945 INFO:tasks.workunit.client.0.smithi002.stdout:4/764: rename d7/d71/d8e/la3 to d7/de/dc6/lef 0 2024-09-17T01:02:00.946 INFO:tasks.workunit.client.1.smithi099.stdout:3/669: creat d9/d2b/d52/db5/fcf x:0 0 0 2024-09-17T01:02:00.947 INFO:tasks.workunit.client.1.smithi099.stdout:4/602: write d7/fc [5028528,30294] 0 2024-09-17T01:02:00.948 INFO:tasks.workunit.client.1.smithi099.stdout:7/622: stat d1/d2c/d5c/d1c/d5a/d6f/lba 0 2024-09-17T01:02:00.950 INFO:tasks.workunit.client.0.smithi002.stdout:0/573: dread dd/f13 [0,4194304] 0 2024-09-17T01:02:00.950 INFO:tasks.workunit.client.0.smithi002.stdout:7/661: truncate d1/f5 631733 0 2024-09-17T01:02:00.950 INFO:tasks.workunit.client.0.smithi002.stdout:7/662: creat d1/d14/d1d/d28/d40/fd6 x:0 0 0 2024-09-17T01:02:00.950 INFO:tasks.workunit.client.0.smithi002.stdout:7/663: fsync d1/d14/f3f 0 2024-09-17T01:02:00.950 INFO:tasks.workunit.client.0.smithi002.stdout:7/664: chown d1/d14/d1d/d29/d57/c77 3 1 2024-09-17T01:02:00.951 INFO:tasks.workunit.client.1.smithi099.stdout:8/614: mkdir d0/d4/d64/dcf 0 2024-09-17T01:02:00.951 INFO:tasks.workunit.client.1.smithi099.stdout:8/615: truncate d0/d41/d5a/fa3 39340 0 2024-09-17T01:02:00.952 INFO:tasks.workunit.client.0.smithi002.stdout:1/636: truncate d4/d11/d1a/f29 1549717 0 2024-09-17T01:02:00.953 INFO:tasks.workunit.client.0.smithi002.stdout:3/604: sync 2024-09-17T01:02:00.953 INFO:tasks.workunit.client.0.smithi002.stdout:9/553: sync 2024-09-17T01:02:00.953 INFO:tasks.workunit.client.0.smithi002.stdout:3/605: chown d0/d31/d32/l10 10506 1 2024-09-17T01:02:00.953 INFO:tasks.workunit.client.0.smithi002.stdout:4/765: dread d7/de/f5c [0,4194304] 0 2024-09-17T01:02:00.955 INFO:tasks.workunit.client.0.smithi002.stdout:2/636: sync 2024-09-17T01:02:00.955 INFO:tasks.workunit.client.0.smithi002.stdout:7/665: creat d1/fd7 x:0 0 0 2024-09-17T01:02:00.956 INFO:tasks.workunit.client.0.smithi002.stdout:6/637: sync 2024-09-17T01:02:00.956 INFO:tasks.workunit.client.1.smithi099.stdout:9/704: rename da/d9a/d3a/d4b/caa to da/d56/ce1 0 2024-09-17T01:02:00.957 INFO:tasks.workunit.client.1.smithi099.stdout:1/744: getdents d0/d8/d49/d94/de0 0 2024-09-17T01:02:00.958 INFO:tasks.workunit.client.0.smithi002.stdout:0/574: dread dd/d19/d1c/d1f/f21 [0,4194304] 0 2024-09-17T01:02:00.958 INFO:tasks.workunit.client.0.smithi002.stdout:1/637: link d4/d22/d8d/da9/ld3 d4/d22/d8d/ld8 0 2024-09-17T01:02:00.958 INFO:tasks.workunit.client.0.smithi002.stdout:1/638: dread - d4/d11/d12/d14/d17/d40/f6d zero size 2024-09-17T01:02:00.959 INFO:tasks.workunit.client.1.smithi099.stdout:4/603: link f1 d7/dd/d21/d7b/fcc 0 2024-09-17T01:02:00.960 INFO:tasks.workunit.client.1.smithi099.stdout:8/616: creat d0/d1f/d31/d4c/d8c/fd0 x:0 0 0 2024-09-17T01:02:00.961 INFO:tasks.workunit.client.0.smithi002.stdout:3/606: rename d0/d31/f43 to d0/d31/fce 0 2024-09-17T01:02:00.961 INFO:tasks.workunit.client.0.smithi002.stdout:4/766: dread d7/d19/d9f/d80/d62/d52/dc7/d77/d9b/f57 [4194304,4194304] 0 2024-09-17T01:02:00.962 INFO:tasks.workunit.client.1.smithi099.stdout:9/705: getdents da/d21 0 2024-09-17T01:02:00.962 INFO:tasks.workunit.client.1.smithi099.stdout:9/706: write da/d14/d62/fd0 [864756,9414] 0 2024-09-17T01:02:00.962 INFO:tasks.workunit.client.1.smithi099.stdout:9/707: write da/d21/d2a/f7f [813740,102925] 0 2024-09-17T01:02:00.962 INFO:tasks.workunit.client.1.smithi099.stdout:9/708: stat da/d9a/c34 0 2024-09-17T01:02:00.963 INFO:tasks.workunit.client.1.smithi099.stdout:9/709: chown da/d50/fc7 2761 1 2024-09-17T01:02:00.963 INFO:tasks.workunit.client.1.smithi099.stdout:8/617: dread d0/d1f/d31/f43 [0,4194304] 0 2024-09-17T01:02:00.964 INFO:tasks.workunit.client.1.smithi099.stdout:4/604: rename d7/d35/d80 to d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd 0 2024-09-17T01:02:00.965 INFO:tasks.workunit.client.0.smithi002.stdout:5/560: dwrite d2/f4d [0,4194304] 0 2024-09-17T01:02:00.965 INFO:tasks.workunit.client.0.smithi002.stdout:5/561: truncate d2/d2d/d10/d14/d19/da5/db0/f40 4785879 0 2024-09-17T01:02:00.966 INFO:tasks.workunit.client.0.smithi002.stdout:0/575: unlink dd/d19/d1c/d1f/d76/ca7 0 2024-09-17T01:02:00.966 INFO:tasks.workunit.client.0.smithi002.stdout:0/576: read - dd/d19/d9f/fb0 zero size 2024-09-17T01:02:00.967 INFO:tasks.workunit.client.1.smithi099.stdout:8/618: creat d0/d4/dc3/fd1 x:0 0 0 2024-09-17T01:02:00.967 INFO:tasks.workunit.client.0.smithi002.stdout:3/607: mknod d0/d31/d8b/ccf 0 2024-09-17T01:02:00.967 INFO:tasks.workunit.client.0.smithi002.stdout:3/608: stat d0/d3/d17/d87 0 2024-09-17T01:02:00.968 INFO:tasks.workunit.client.0.smithi002.stdout:4/767: mknod d7/de/d32/cf0 0 2024-09-17T01:02:00.968 INFO:tasks.workunit.client.1.smithi099.stdout:6/683: dwrite dc/d1a/d49/d4c/f5f [4194304,4194304] 0 2024-09-17T01:02:00.969 INFO:tasks.workunit.client.1.smithi099.stdout:4/605: mknod d7/dd/de/d17/d72/cce 0 2024-09-17T01:02:00.972 INFO:tasks.workunit.client.0.smithi002.stdout:4/768: dread d7/de/f5c [0,4194304] 0 2024-09-17T01:02:00.972 INFO:tasks.workunit.client.0.smithi002.stdout:5/562: link d2/d2d/d10/d14/d19/d39/f35 d2/d2d/d10/d23/d6e/d60/fb1 0 2024-09-17T01:02:00.972 INFO:tasks.workunit.client.0.smithi002.stdout:5/563: dread - d2/de/d1d/f83 zero size 2024-09-17T01:02:00.973 INFO:tasks.workunit.client.1.smithi099.stdout:4/606: link d7/dd/d21/d7b/l2a d7/dd/d21/d7b/d4b/dcb/lcf 0 2024-09-17T01:02:00.973 INFO:tasks.workunit.client.1.smithi099.stdout:4/607: read d7/dd/d21/d7b/d74/f7c [102470,50506] 0 2024-09-17T01:02:00.974 INFO:tasks.workunit.client.0.smithi002.stdout:0/577: symlink dd/d19/d1c/d33/d67/d68/d9d/lbf 0 2024-09-17T01:02:00.976 INFO:tasks.workunit.client.0.smithi002.stdout:6/638: rename d2/dc/d34/d5f to d2/d1d/d2d/d35/d8d/d43/d5c/dc9 0 2024-09-17T01:02:00.978 INFO:tasks.workunit.client.0.smithi002.stdout:3/609: rmdir d0/d3/d33/d99 39 2024-09-17T01:02:00.978 INFO:tasks.workunit.client.0.smithi002.stdout:3/610: getdents d0/d31/d32/dcb 0 2024-09-17T01:02:00.978 INFO:tasks.workunit.client.1.smithi099.stdout:4/608: mknod d7/dd/de/d10/d6b/d82/d8a/d9a/da6/cd0 0 2024-09-17T01:02:00.978 INFO:tasks.workunit.client.1.smithi099.stdout:4/609: creat d7/d35/d98/fd1 x:0 0 0 2024-09-17T01:02:00.980 INFO:tasks.workunit.client.0.smithi002.stdout:6/639: symlink d2/d1d/d2d/d35/dc1/lca 0 2024-09-17T01:02:00.980 INFO:tasks.workunit.client.0.smithi002.stdout:6/640: truncate d2/d1d/d26/f2b 1727390 0 2024-09-17T01:02:00.980 INFO:tasks.workunit.client.0.smithi002.stdout:6/641: write d2/d1d/d2d/d35/d79/fc0 [256473,37748] 0 2024-09-17T01:02:00.981 INFO:tasks.workunit.client.1.smithi099.stdout:4/610: mknod d7/d35/d98/cd2 0 2024-09-17T01:02:00.981 INFO:tasks.workunit.client.1.smithi099.stdout:4/611: chown d7/dd/d21/d26/d3f/f94 20 1 2024-09-17T01:02:00.983 INFO:tasks.workunit.client.0.smithi002.stdout:6/642: rename d2/d1d/d2d/d35/d8d/d43/d5c/c68 to d2/d1d/d2d/ccb 0 2024-09-17T01:02:00.986 INFO:tasks.workunit.client.1.smithi099.stdout:8/619: dread d0/f18 [0,4194304] 0 2024-09-17T01:02:00.986 INFO:tasks.workunit.client.0.smithi002.stdout:6/643: symlink d2/d1d/d27/d80/d93/lcc 0 2024-09-17T01:02:00.986 INFO:tasks.workunit.client.0.smithi002.stdout:6/644: dread - d2/d1d/d2d/d35/d79/da8/f69 zero size 2024-09-17T01:02:00.987 INFO:tasks.workunit.client.1.smithi099.stdout:6/684: dread dc/d1a/f1e [0,4194304] 0 2024-09-17T01:02:00.988 INFO:tasks.workunit.client.1.smithi099.stdout:6/685: symlink dc/d2b/le4 0 2024-09-17T01:02:00.995 INFO:tasks.workunit.client.1.smithi099.stdout:6/686: dread dc/d5d/dae/dd0/fdb [0,4194304] 0 2024-09-17T01:02:00.996 INFO:tasks.workunit.client.0.smithi002.stdout:0/578: write dd/d19/d1a/f96 [1380528,21751] 0 2024-09-17T01:02:00.997 INFO:tasks.workunit.client.1.smithi099.stdout:6/687: creat dc/d1a/d49/da8/db3/fe5 x:0 0 0 2024-09-17T01:02:00.997 INFO:tasks.workunit.client.0.smithi002.stdout:7/666: getdents d1/d14/d1d/d29/d98/dcf 0 2024-09-17T01:02:00.997 INFO:tasks.workunit.client.0.smithi002.stdout:7/667: readlink d1/d14/d1d/d28/d6b/d9e/l4c 0 2024-09-17T01:02:00.997 INFO:tasks.workunit.client.0.smithi002.stdout:7/668: chown d1/d14/d1d/l2c 448287323 1 2024-09-17T01:02:00.997 INFO:tasks.workunit.client.0.smithi002.stdout:7/669: dread - d1/d14/d67/dc0/dcd/d45/fd1 zero size 2024-09-17T01:02:00.997 INFO:tasks.workunit.client.0.smithi002.stdout:7/670: chown d1/d14/d1d/d28/lb9 5 1 2024-09-17T01:02:00.999 INFO:tasks.workunit.client.0.smithi002.stdout:0/579: symlink dd/d19/d1c/db7/lc0 0 2024-09-17T01:02:01.001 INFO:tasks.workunit.client.0.smithi002.stdout:7/671: rmdir d1/d14/d67/dc0 39 2024-09-17T01:02:01.001 INFO:tasks.workunit.client.0.smithi002.stdout:9/554: dwrite d5/d8a/f8f [0,4194304] 0 2024-09-17T01:02:01.004 INFO:tasks.workunit.client.0.smithi002.stdout:0/580: rename dd/d19/d1a/d29/f52 to dd/d19/d1a/d29/d55/d56/fc1 0 2024-09-17T01:02:01.005 INFO:tasks.workunit.client.0.smithi002.stdout:0/581: chown dd/c16 26 1 2024-09-17T01:02:01.007 INFO:tasks.workunit.client.1.smithi099.stdout:8/620: dread d0/d4/f3c [0,4194304] 0 2024-09-17T01:02:01.007 INFO:tasks.workunit.client.1.smithi099.stdout:8/621: chown d0/d53/f83 174 1 2024-09-17T01:02:01.009 INFO:tasks.workunit.client.1.smithi099.stdout:8/622: dread d0/d4/f3c [0,4194304] 0 2024-09-17T01:02:01.010 INFO:tasks.workunit.client.0.smithi002.stdout:7/672: symlink d1/d14/d1d/d28/d40/ld8 0 2024-09-17T01:02:01.012 INFO:tasks.workunit.client.0.smithi002.stdout:7/673: creat d1/d14/d1d/d28/d86/fd9 x:0 0 0 2024-09-17T01:02:01.014 INFO:tasks.workunit.client.0.smithi002.stdout:7/674: creat d1/d14/d67/dc0/fda x:0 0 0 2024-09-17T01:02:01.029 INFO:tasks.workunit.client.1.smithi099.stdout:6/688: dread dc/d1a/d49/d4c/f6d [8388608,4194304] 0 2024-09-17T01:02:01.030 INFO:tasks.workunit.client.1.smithi099.stdout:6/689: creat dc/fe6 x:0 0 0 2024-09-17T01:02:01.031 INFO:tasks.workunit.client.1.smithi099.stdout:6/690: write dc/d1a/d49/da8/fc1 [415287,3585] 0 2024-09-17T01:02:01.031 INFO:tasks.workunit.client.1.smithi099.stdout:6/691: write dc/d27/dd7/d87/fb5 [314844,102079] 0 2024-09-17T01:02:01.032 INFO:tasks.workunit.client.1.smithi099.stdout:6/692: read dc/d27/dd7/d87/fb9 [637418,26699] 0 2024-09-17T01:02:01.032 INFO:tasks.workunit.client.1.smithi099.stdout:6/693: write dc/d1a/d49/d4c/f9d [617685,109430] 0 2024-09-17T01:02:01.033 INFO:tasks.workunit.client.1.smithi099.stdout:6/694: creat dc/d1a/fe7 x:0 0 0 2024-09-17T01:02:01.034 INFO:tasks.workunit.client.1.smithi099.stdout:6/695: symlink dc/d2b/le8 0 2024-09-17T01:02:01.035 INFO:tasks.workunit.client.1.smithi099.stdout:6/696: mkdir dc/d27/dd7/dde/ddf/de9 0 2024-09-17T01:02:01.035 INFO:tasks.workunit.client.1.smithi099.stdout:6/697: readlink dc/d1a/d49/d4c/l61 0 2024-09-17T01:02:01.036 INFO:tasks.workunit.client.1.smithi099.stdout:6/698: symlink dc/d5d/dae/d96/lea 0 2024-09-17T01:02:01.036 INFO:tasks.workunit.client.1.smithi099.stdout:6/699: stat dc/d27/d58/f6e 0 2024-09-17T01:02:01.036 INFO:tasks.workunit.client.1.smithi099.stdout:6/700: symlink dc/d5d/d66/dc3/leb 0 2024-09-17T01:02:01.037 INFO:tasks.workunit.client.1.smithi099.stdout:8/623: read d0/d4/d29/d4b/f5c [426944,77036] 0 2024-09-17T01:02:01.037 INFO:tasks.workunit.client.1.smithi099.stdout:6/701: fsync dc/d27/d7e/fd1 0 2024-09-17T01:02:01.037 INFO:tasks.workunit.client.1.smithi099.stdout:6/702: chown dc/d27 50943 1 2024-09-17T01:02:01.037 INFO:tasks.workunit.client.1.smithi099.stdout:8/624: read d0/d4/d29/f78 [166849,83093] 0 2024-09-17T01:02:01.037 INFO:tasks.workunit.client.1.smithi099.stdout:6/703: symlink dc/d5d/lec 0 2024-09-17T01:02:01.038 INFO:tasks.workunit.client.1.smithi099.stdout:6/704: stat dc/l16 0 2024-09-17T01:02:01.039 INFO:tasks.workunit.client.1.smithi099.stdout:8/625: creat d0/d1f/db5/fd2 x:0 0 0 2024-09-17T01:02:01.039 INFO:tasks.workunit.client.1.smithi099.stdout:8/626: chown d0/d4/fb 380358262 1 2024-09-17T01:02:01.039 INFO:tasks.workunit.client.1.smithi099.stdout:6/705: creat dc/fed x:0 0 0 2024-09-17T01:02:01.040 INFO:tasks.workunit.client.1.smithi099.stdout:8/627: dread d0/d1f/d31/d4c/f7d [0,4194304] 0 2024-09-17T01:02:01.040 INFO:tasks.workunit.client.1.smithi099.stdout:6/706: symlink dc/d27/dd7/dde/lee 0 2024-09-17T01:02:01.041 INFO:tasks.workunit.client.1.smithi099.stdout:6/707: dread dc/d1a/d49/fb8 [0,4194304] 0 2024-09-17T01:02:01.042 INFO:tasks.workunit.client.1.smithi099.stdout:8/628: symlink d0/d4/d29/d4b/ld3 0 2024-09-17T01:02:01.042 INFO:tasks.workunit.client.1.smithi099.stdout:8/629: fsync d0/d1f/f81 0 2024-09-17T01:02:01.042 INFO:tasks.workunit.client.1.smithi099.stdout:8/630: dread - d0/d41/d5a/fa0 zero size 2024-09-17T01:02:01.043 INFO:tasks.workunit.client.1.smithi099.stdout:6/708: creat dc/d27/dd7/dde/ddf/fef x:0 0 0 2024-09-17T01:02:01.045 INFO:tasks.workunit.client.1.smithi099.stdout:6/709: truncate dc/f3e 3456538 0 2024-09-17T01:02:01.047 INFO:tasks.workunit.client.1.smithi099.stdout:6/710: symlink dc/d27/d7e/lf0 0 2024-09-17T01:02:01.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.053+0000 7f4c0f218640 1 -- 172.21.15.2:0/1560131680 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c0810eeb0 con 0x7f4bf006ed60 2024-09-17T01:02:01.052 INFO:tasks.workunit.client.1.smithi099.stdout:8/631: write d0/d1f/d31/f38 [3851549,71562] 0 2024-09-17T01:02:01.053 INFO:tasks.workunit.client.1.smithi099.stdout:8/632: dread d0/d41/d5a/fa3 [0,4194304] 0 2024-09-17T01:02:01.053 INFO:tasks.workunit.client.1.smithi099.stdout:8/633: fsync d0/d1f/f12 0 2024-09-17T01:02:01.054 INFO:tasks.workunit.client.1.smithi099.stdout:8/634: rename d0/d1f/d90/f98 to d0/d41/d5a/fd4 0 2024-09-17T01:02:01.055 INFO:tasks.workunit.client.0.smithi002.stdout:2/637: dwrite d1b/d74/d93/d94/fb9 [0,4194304] 0 2024-09-17T01:02:01.055 INFO:tasks.workunit.client.0.smithi002.stdout:2/638: write d1b/d74/d93/d94/fb9 [4667372,130669] 0 2024-09-17T01:02:01.055 INFO:tasks.workunit.client.0.smithi002.stdout:2/639: chown d1b/d1d/d79/l6b 187 1 2024-09-17T01:02:01.055 INFO:tasks.workunit.client.1.smithi099.stdout:9/710: dwrite da/d14/d40/fe0 [0,4194304] 0 2024-09-17T01:02:01.055 INFO:tasks.workunit.client.1.smithi099.stdout:9/711: readlink da/d50/l59 0 2024-09-17T01:02:01.055 INFO:tasks.workunit.client.1.smithi099.stdout:9/712: readlink da/l28 0 2024-09-17T01:02:01.057 INFO:tasks.workunit.client.1.smithi099.stdout:1/745: dwrite d0/d8/d49/d94/d4b/d59/db9/feb [0,4194304] 0 2024-09-17T01:02:01.057 INFO:tasks.workunit.client.1.smithi099.stdout:1/746: write d0/d8/d49/d94/f6f [134691,23731] 0 2024-09-17T01:02:01.057 INFO:tasks.workunit.client.1.smithi099.stdout:1/747: chown d0/d8/d49/d4e/ff4 0 1 2024-09-17T01:02:01.057 INFO:tasks.workunit.client.0.smithi002.stdout:2/640: rename d1b/f2d to d1b/d37/d48/d78/fe4 0 2024-09-17T01:02:01.058 INFO:tasks.workunit.client.0.smithi002.stdout:3/611: dwrite d0/d3/d17/f6f [0,4194304] 0 2024-09-17T01:02:01.058 INFO:tasks.workunit.client.0.smithi002.stdout:3/612: chown d0/d31/d32/l7a 25197 1 2024-09-17T01:02:01.058 INFO:tasks.workunit.client.0.smithi002.stdout:1/639: dwrite d4/d11/d12/d30/fb6 [0,4194304] 0 2024-09-17T01:02:01.059 INFO:tasks.workunit.client.1.smithi099.stdout:9/713: creat da/d8e/dbf/fe2 x:0 0 0 2024-09-17T01:02:01.059 INFO:tasks.workunit.client.1.smithi099.stdout:4/612: dwrite d7/dd/de/f4e [0,4194304] 0 2024-09-17T01:02:01.059 INFO:tasks.workunit.client.1.smithi099.stdout:4/613: chown d7/c8d 457432977 1 2024-09-17T01:02:01.061 INFO:tasks.workunit.client.1.smithi099.stdout:9/714: rename da/d14/d6d/c94 to da/d56/ce3 0 2024-09-17T01:02:01.062 INFO:tasks.workunit.client.0.smithi002.stdout:3/613: symlink d0/d3/d33/d40/ld0 0 2024-09-17T01:02:01.065 INFO:tasks.workunit.client.1.smithi099.stdout:1/748: getdents d0/d8/d38 0 2024-09-17T01:02:01.065 INFO:tasks.workunit.client.1.smithi099.stdout:9/715: symlink da/d21/d2a/le4 0 2024-09-17T01:02:01.065 INFO:tasks.workunit.client.1.smithi099.stdout:9/716: read - da/d56/d84/fbb zero size 2024-09-17T01:02:01.067 INFO:tasks.workunit.client.0.smithi002.stdout:9/555: dwrite d5/dc/d26/d5c/f7b [0,4194304] 0 2024-09-17T01:02:01.067 INFO:tasks.workunit.client.0.smithi002.stdout:9/556: chown d5/l6 155600 1 2024-09-17T01:02:01.068 INFO:tasks.workunit.client.0.smithi002.stdout:0/582: dwrite f1 [0,4194304] 0 2024-09-17T01:02:01.068 INFO:tasks.workunit.client.0.smithi002.stdout:4/769: dwrite d7/d3f/fb1 [0,4194304] 0 2024-09-17T01:02:01.068 INFO:tasks.workunit.client.0.smithi002.stdout:4/770: chown d7/d19/f1c 51696094 1 2024-09-17T01:02:01.068 INFO:tasks.workunit.client.0.smithi002.stdout:0/583: fdatasync dd/d19/d1a/d29/d55/f95 0 2024-09-17T01:02:01.068 INFO:tasks.workunit.client.0.smithi002.stdout:5/564: dwrite d2/de/f1f [0,4194304] 0 2024-09-17T01:02:01.068 INFO:tasks.workunit.client.0.smithi002.stdout:5/565: write d2/d2d/d10/f66 [1427060,66296] 0 2024-09-17T01:02:01.068 INFO:tasks.workunit.client.0.smithi002.stdout:7/675: dwrite d1/fd7 [0,4194304] 0 2024-09-17T01:02:01.069 INFO:tasks.workunit.client.0.smithi002.stdout:6/645: dwrite d2/d1d/f57 [4194304,4194304] 0 2024-09-17T01:02:01.070 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:02:01.070 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (6m) 2m ago 7m 26.6M - 0.25.0 c8568f914cd2 225a4094fd9c 2024-09-17T01:02:01.070 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (8m) 2m ago 8m 6903k - 17.2.7-1635-g4a704134 f22ead590bad 53b003b1ad6f 2024-09-17T01:02:01.070 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (7m) 2m ago 7m 6891k - 17.2.7-1635-g4a704134 f22ead590bad 6ec40439e9b5 2024-09-17T01:02:01.070 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (6m) 2m ago 7m 83.7M - 9.4.7 954c08fa6188 68fde0ccaa6c 2024-09-17T01:02:01.071 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (2m) 2m ago 2m 15.1M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:02:01.071 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (2m) 2m ago 2m 11.9M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:02:01.071 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (2m) 2m ago 2m 15.2M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:02:01.071 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (2m) 2m ago 2m 17.3M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:02:01.071 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:9283,8765,8443 running (9m) 2m ago 9m 449M - 17.2.7-1635-g4a704134 f22ead590bad 6f10e41396cd 2024-09-17T01:02:01.071 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283 running (7m) 2m ago 7m 400M - 17.2.7-1635-g4a704134 f22ead590bad d88571dad10b 2024-09-17T01:02:01.071 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (9m) 2m ago 9m 43.0M 2048M 17.2.7-1635-g4a704134 f22ead590bad 08b932b41bfa 2024-09-17T01:02:01.071 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (7m) 2m ago 7m 33.4M 2048M 17.2.7-1635-g4a704134 f22ead590bad 1c9583d52c94 2024-09-17T01:02:01.071 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (8m) 2m ago 8m 16.4M - 1.5.0 0da6a335fe13 175a7378d3e6 2024-09-17T01:02:01.071 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (7m) 2m ago 7m 17.1M - 1.5.0 0da6a335fe13 7c4fe7150f28 2024-09-17T01:02:01.071 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (6m) 2m ago 6m 47.4M 4289M 17.2.7-1635-g4a704134 f22ead590bad 720f74f40752 2024-09-17T01:02:01.071 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (5m) 2m ago 5m 46.5M 4289M 17.2.7-1635-g4a704134 f22ead590bad 629defddb38c 2024-09-17T01:02:01.071 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (5m) 2m ago 5m 46.4M 4289M 17.2.7-1635-g4a704134 f22ead590bad 5dff1cf9fc56 2024-09-17T01:02:01.071 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (4m) 2m ago 4m 43.7M 5312M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:02:01.072 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (4m) 2m ago 4m 44.8M 5312M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:02:01.072 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (4m) 2m ago 4m 44.9M 5312M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:02:01.072 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (6m) 2m ago 7m 53.8M - 2.43.0 a07b618ecd1d 4c4de4cca2fc 2024-09-17T01:02:01.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.071+0000 7f4bfd7fa640 1 -- 172.21.15.2:0/1560131680 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f4c0810eeb0 con 0x7f4bf006ed60 2024-09-17T01:02:01.072 INFO:tasks.workunit.client.0.smithi002.stdout:9/557: mkdir d5/dc/d26/d5c/d6b/d75/d57/d9f 0 2024-09-17T01:02:01.072 INFO:tasks.workunit.client.0.smithi002.stdout:9/558: chown d5/dc/d26/d5c/d6b/d75/d57/d8d/l82 0 1 2024-09-17T01:02:01.073 INFO:tasks.workunit.client.1.smithi099.stdout:1/749: write d0/d8/d49/d94/de0/f4d [652955,77339] 0 2024-09-17T01:02:01.073 INFO:tasks.workunit.client.1.smithi099.stdout:1/750: fdatasync d0/d2/f73 0 2024-09-17T01:02:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.074+0000 7f4c0f218640 1 -- 172.21.15.2:0/1560131680 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f4bf006ed60 msgr2=0x7f4bf0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.074+0000 7f4c0f218640 1 --2- 172.21.15.2:0/1560131680 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f4bf006ed60 0x7f4bf0071210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009fd0 tx=0x7f4c0400b040 comp rx=0 tx=0).stop 2024-09-17T01:02:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.074+0000 7f4c0f218640 1 -- 172.21.15.2:0/1560131680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c080ff6e0 msgr2=0x7f4c0810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.074+0000 7f4c0f218640 1 --2- 172.21.15.2:0/1560131680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c080ff6e0 0x7f4c0810d600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009ac0 tx=0x7f4bf8009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.074+0000 7f4c0f218640 1 -- 172.21.15.2:0/1560131680 shutdown_connections 2024-09-17T01:02:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.075+0000 7f4c0f218640 1 --2- 172.21.15.2:0/1560131680 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f4bf006ed60 0x7f4bf0071210 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.075+0000 7f4c0f218640 1 --2- 172.21.15.2:0/1560131680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c080ff6e0 0x7f4c0810d600 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.075+0000 7f4c0f218640 1 --2- 172.21.15.2:0/1560131680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c08065be0 0x7f4c0810d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.075+0000 7f4c0f218640 1 -- 172.21.15.2:0/1560131680 >> 172.21.15.2:0/1560131680 conn(0x7f4c080f6c10 msgr2=0x7f4c080f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.075+0000 7f4c0f218640 1 -- 172.21.15.2:0/1560131680 shutdown_connections 2024-09-17T01:02:01.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.075+0000 7f4c0f218640 1 -- 172.21.15.2:0/1560131680 wait complete. 2024-09-17T01:02:01.075 INFO:tasks.workunit.client.0.smithi002.stdout:4/771: unlink d7/d71/d8e/dd0/f5f 0 2024-09-17T01:02:01.077 INFO:tasks.workunit.client.1.smithi099.stdout:6/711: dwrite dc/d1a/d49/fba [0,4194304] 0 2024-09-17T01:02:01.077 INFO:tasks.workunit.client.0.smithi002.stdout:5/566: creat d2/d2d/d10/d20/fb2 x:0 0 0 2024-09-17T01:02:01.079 INFO:tasks.workunit.client.0.smithi002.stdout:7/676: link d1/d14/d1d/d28/d86/c95 d1/d14/d1d/d29/cdb 0 2024-09-17T01:02:01.079 INFO:tasks.workunit.client.0.smithi002.stdout:7/677: readlink d1/d14/d1d/d28/d40/lc6 0 2024-09-17T01:02:01.079 INFO:tasks.workunit.client.0.smithi002.stdout:7/678: stat d1/d14/d1d/d28/l9a 0 2024-09-17T01:02:01.081 INFO:tasks.workunit.client.0.smithi002.stdout:6/646: mkdir d2/dc/dcd 0 2024-09-17T01:02:01.081 INFO:tasks.workunit.client.0.smithi002.stdout:6/647: write d2/d1d/d27/d30/fb3 [342369,65914] 0 2024-09-17T01:02:01.085 INFO:tasks.workunit.client.1.smithi099.stdout:8/635: rmdir d0/d4/d29 39 2024-09-17T01:02:01.089 INFO:tasks.workunit.client.1.smithi099.stdout:8/636: getdents d0 0 2024-09-17T01:02:01.089 INFO:tasks.workunit.client.0.smithi002.stdout:1/640: dread d4/d11/d1a/fb4 [0,4194304] 0 2024-09-17T01:02:01.091 INFO:tasks.workunit.client.1.smithi099.stdout:6/712: write dc/d27/dd7/d87/db6/fb7 [6774660,120096] 0 2024-09-17T01:02:01.092 INFO:tasks.workunit.client.1.smithi099.stdout:8/637: getdents d0/d41 0 2024-09-17T01:02:01.096 INFO:tasks.workunit.client.1.smithi099.stdout:0/633: sync 2024-09-17T01:02:01.096 INFO:tasks.workunit.client.1.smithi099.stdout:0/634: chown da/d12/d2b/dab/db5/fa2 7 1 2024-09-17T01:02:01.096 INFO:tasks.workunit.client.1.smithi099.stdout:0/635: chown da/d3b/cb8 4154245 1 2024-09-17T01:02:01.097 INFO:tasks.workunit.client.1.smithi099.stdout:0/636: fsync da/df/d31/db0/f3d 0 2024-09-17T01:02:01.097 INFO:tasks.workunit.client.1.smithi099.stdout:0/637: fsync da/df/d1a/d49/d71/fbb 0 2024-09-17T01:02:01.097 INFO:tasks.workunit.client.1.smithi099.stdout:2/575: sync 2024-09-17T01:02:01.097 INFO:tasks.workunit.client.1.smithi099.stdout:6/713: dread dc/d5d/dae/dd0/fdb [0,4194304] 0 2024-09-17T01:02:01.099 INFO:tasks.workunit.client.1.smithi099.stdout:0/638: write da/d59/f75 [264203,58927] 0 2024-09-17T01:02:01.099 INFO:tasks.workunit.client.1.smithi099.stdout:0/639: write da/d12/d2b/fa8 [318574,4432] 0 2024-09-17T01:02:01.099 INFO:tasks.workunit.client.1.smithi099.stdout:6/714: rename dc/d1a/d49/c55 to dc/d27/d58/d74/cf1 0 2024-09-17T01:02:01.100 INFO:tasks.workunit.client.1.smithi099.stdout:6/715: truncate dc/d5d/f69 3192418 0 2024-09-17T01:02:01.102 INFO:tasks.workunit.client.0.smithi002.stdout:9/559: unlink d5/dc/d26/d63/d66/f9a 0 2024-09-17T01:02:01.102 INFO:tasks.workunit.client.0.smithi002.stdout:9/560: stat d5/dc/d26/d5c/d6b/d75/f56 0 2024-09-17T01:02:01.103 INFO:tasks.workunit.client.1.smithi099.stdout:6/716: link dc/d27/d58/f8a dc/d27/dd7/dde/ff2 0 2024-09-17T01:02:01.104 INFO:tasks.workunit.client.1.smithi099.stdout:2/576: dread d2/d9/d25/d26/f29 [0,4194304] 0 2024-09-17T01:02:01.105 INFO:tasks.workunit.client.0.smithi002.stdout:4/772: unlink d7/d19/d9f/fd5 0 2024-09-17T01:02:01.106 INFO:tasks.workunit.client.0.smithi002.stdout:4/773: creat d7/de/d3a/dac/ff1 x:0 0 0 2024-09-17T01:02:01.106 INFO:tasks.workunit.client.1.smithi099.stdout:0/640: dread da/d12/f5a [0,4194304] 0 2024-09-17T01:02:01.106 INFO:tasks.workunit.client.1.smithi099.stdout:0/641: readlink da/df/d31/db0/d1e/la3 0 2024-09-17T01:02:01.106 INFO:tasks.workunit.client.1.smithi099.stdout:0/642: stat da/df/f4f 0 2024-09-17T01:02:01.106 INFO:tasks.workunit.client.0.smithi002.stdout:7/679: creat d1/d14/d67/dc0/dcd/fdc x:0 0 0 2024-09-17T01:02:01.107 INFO:tasks.workunit.client.0.smithi002.stdout:2/641: dwrite d1b/d1d/d79/fd9 [0,4194304] 0 2024-09-17T01:02:01.107 INFO:tasks.workunit.client.0.smithi002.stdout:2/642: creat d1b/d3f/d59/d7f/dc9/dac/fe5 x:0 0 0 2024-09-17T01:02:01.107 INFO:tasks.workunit.client.0.smithi002.stdout:1/641: mknod d4/d11/d55/d7a/cd9 0 2024-09-17T01:02:01.108 INFO:tasks.workunit.client.1.smithi099.stdout:0/643: dread da/df/d1a/d56/fc5 [0,4194304] 0 2024-09-17T01:02:01.108 INFO:tasks.workunit.client.1.smithi099.stdout:2/577: mkdir d2/d9/d25/d26/d1b/d2c/d3f/db8 0 2024-09-17T01:02:01.108 INFO:tasks.workunit.client.1.smithi099.stdout:2/578: stat d2/d9/d17/d83/d8d/d8f 0 2024-09-17T01:02:01.109 INFO:tasks.workunit.client.1.smithi099.stdout:4/614: dwrite d7/dd/de/d17/f97 [0,4194304] 0 2024-09-17T01:02:01.109 INFO:tasks.workunit.client.1.smithi099.stdout:4/615: readlink d7/dd/d21/d7b/l66 0 2024-09-17T01:02:01.109 INFO:tasks.workunit.client.1.smithi099.stdout:4/616: truncate d7/d35/d98/fbf 538782 0 2024-09-17T01:02:01.109 INFO:tasks.workunit.client.1.smithi099.stdout:0/644: dread da/d12/d22/fa9 [0,4194304] 0 2024-09-17T01:02:01.109 INFO:tasks.workunit.client.1.smithi099.stdout:4/617: creat d7/dd/de/d10/d6b/d82/d8a/d9a/da6/fd3 x:0 0 0 2024-09-17T01:02:01.110 INFO:tasks.workunit.client.0.smithi002.stdout:9/561: mknod d5/dc/d26/d63/d66/ca0 0 2024-09-17T01:02:01.111 INFO:tasks.workunit.client.1.smithi099.stdout:2/579: rename d2/d9/d25/d26/d1b/dad/fe to d2/d9/d25/d26/d1b/d2c/d3f/fb9 0 2024-09-17T01:02:01.111 INFO:tasks.workunit.client.1.smithi099.stdout:2/580: write d2/d9/d25/d26/d1b/d2c/f79 [1301550,28933] 0 2024-09-17T01:02:01.111 INFO:tasks.workunit.client.0.smithi002.stdout:4/774: creat d7/d19/d9f/d80/d62/dbe/ff2 x:0 0 0 2024-09-17T01:02:01.114 INFO:tasks.workunit.client.0.smithi002.stdout:2/643: unlink d1b/d1d/d79/fbe 0 2024-09-17T01:02:01.114 INFO:tasks.workunit.client.1.smithi099.stdout:4/618: read d7/dd/d21/d26/d3f/d5b/da4/f53 [162494,18572] 0 2024-09-17T01:02:01.115 INFO:tasks.workunit.client.1.smithi099.stdout:2/581: rename d2/d9/d17/d83/d8d/f91 to d2/d9/d25/d26/d1b/d2c/d5d/fba 0 2024-09-17T01:02:01.117 INFO:tasks.workunit.client.1.smithi099.stdout:2/582: rename d2/d9/l4d to d2/d9/d17/lbb 0 2024-09-17T01:02:01.117 INFO:tasks.workunit.client.1.smithi099.stdout:2/583: chown d2/d9/d25/d26/d1b/d2c/d3f/db8 988338817 1 2024-09-17T01:02:01.118 INFO:tasks.workunit.client.0.smithi002.stdout:2/644: rename d1b/d8b to d1b/d37/d48/d52/de6 0 2024-09-17T01:02:01.119 INFO:tasks.workunit.client.0.smithi002.stdout:1/642: rename d4/d11/d1a/daa/lac to d4/d22/d8d/lda 0 2024-09-17T01:02:01.120 INFO:tasks.workunit.client.0.smithi002.stdout:2/645: getdents d1b/d1d 0 2024-09-17T01:02:01.120 INFO:tasks.workunit.client.0.smithi002.stdout:2/646: write d1b/d37/d48/d4e/f76 [434616,129455] 0 2024-09-17T01:02:01.120 INFO:tasks.workunit.client.0.smithi002.stdout:2/647: creat d1b/d74/d93/fe7 x:0 0 0 2024-09-17T01:02:01.120 INFO:tasks.workunit.client.0.smithi002.stdout:9/562: write d5/dc/d26/d46/f58 [3822553,99926] 0 2024-09-17T01:02:01.121 INFO:tasks.workunit.client.1.smithi099.stdout:2/584: rename d2/d9/d25/d26/d1b/d2c/d9b/db1/lb7 to d2/d9/d17/d83/lbc 0 2024-09-17T01:02:01.121 INFO:tasks.workunit.client.1.smithi099.stdout:2/585: chown d2/d9/d25/d26/f32 7454 1 2024-09-17T01:02:01.121 INFO:tasks.workunit.client.1.smithi099.stdout:0/645: dread da/fae [0,4194304] 0 2024-09-17T01:02:01.122 INFO:tasks.workunit.client.0.smithi002.stdout:9/563: mkdir d5/dc/d26/d46/d47/da1 0 2024-09-17T01:02:01.123 INFO:tasks.workunit.client.1.smithi099.stdout:0/646: truncate da/df/d1a/d63/d6a/f8a 3960207 0 2024-09-17T01:02:01.125 INFO:tasks.workunit.client.1.smithi099.stdout:0/647: truncate da/d3b/f5b 2630957 0 2024-09-17T01:02:01.125 INFO:tasks.workunit.client.1.smithi099.stdout:0/648: dread - da/df/d1a/d49/d71/fc2 zero size 2024-09-17T01:02:01.126 INFO:tasks.workunit.client.0.smithi002.stdout:9/564: mkdir d5/dc/d26/d5c/d6b/d75/d57/d7a/da2 0 2024-09-17T01:02:01.136 INFO:tasks.workunit.client.1.smithi099.stdout:2/586: dread d2/d9/d17/f51 [0,4194304] 0 2024-09-17T01:02:01.137 INFO:tasks.workunit.client.1.smithi099.stdout:2/587: rename d2/d9/f60 to d2/d9/d25/d26/d1b/d2c/d9b/db1/fbd 0 2024-09-17T01:02:01.138 INFO:tasks.workunit.client.1.smithi099.stdout:2/588: unlink d2/d9/d25/d68/c8b 0 2024-09-17T01:02:01.148 INFO:tasks.workunit.client.0.smithi002.stdout:1/643: dread d4/d11/d12/f3d [0,4194304] 0 2024-09-17T01:02:01.148 INFO:tasks.workunit.client.0.smithi002.stdout:1/644: fdatasync d4/d11/d12/d23/f64 0 2024-09-17T01:02:01.149 INFO:tasks.workunit.client.1.smithi099.stdout:0/649: dread da/df/d1a/d56/f65 [0,4194304] 0 2024-09-17T01:02:01.149 INFO:tasks.workunit.client.1.smithi099.stdout:9/717: dwrite da/d50/f60 [0,4194304] 0 2024-09-17T01:02:01.149 INFO:tasks.workunit.client.0.smithi002.stdout:1/645: mkdir d4/d11/d12/d14/d17/ddb 0 2024-09-17T01:02:01.151 INFO:tasks.workunit.client.1.smithi099.stdout:0/650: mkdir da/df/d1a/d56/d72/dd4 0 2024-09-17T01:02:01.151 INFO:tasks.workunit.client.1.smithi099.stdout:0/651: fsync da/d59/d80/d8c/d97/fbe 0 2024-09-17T01:02:01.152 INFO:tasks.workunit.client.1.smithi099.stdout:9/718: symlink da/d56/d84/le5 0 2024-09-17T01:02:01.153 INFO:tasks.workunit.client.0.smithi002.stdout:3/614: dwrite d0/d31/d32/f98 [0,4194304] 0 2024-09-17T01:02:01.153 INFO:tasks.workunit.client.0.smithi002.stdout:3/615: dread - d0/d3/d8d/fa0 zero size 2024-09-17T01:02:01.153 INFO:tasks.workunit.client.1.smithi099.stdout:0/652: creat da/df/d31/fd5 x:0 0 0 2024-09-17T01:02:01.154 INFO:tasks.workunit.client.1.smithi099.stdout:0/653: getdents da/df/d1a/d49/d71/dcd 0 2024-09-17T01:02:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:00 smithi002 ceph-mon[27650]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:00 smithi002 ceph-mon[27650]: pgmap v254: 65 pgs: 65 active+clean; 2.4 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 290 MiB/s rd, 355 MiB/s wr, 625 op/s 2024-09-17T01:02:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:00 smithi002 ceph-mon[27650]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:01.156 INFO:tasks.workunit.client.1.smithi099.stdout:9/719: mkdir da/d14/d62/dad/ddc/de6 0 2024-09-17T01:02:01.156 INFO:tasks.workunit.client.1.smithi099.stdout:0/654: mknod da/d59/d80/d8c/cd6 0 2024-09-17T01:02:01.163 INFO:tasks.workunit.client.1.smithi099.stdout:8/638: dwrite d0/d4/d64/dbe/fc2 [0,4194304] 0 2024-09-17T01:02:01.163 INFO:tasks.workunit.client.1.smithi099.stdout:8/639: write d0/d1f/d31/d4c/f5d [2683222,88051] 0 2024-09-17T01:02:01.167 INFO:tasks.workunit.client.1.smithi099.stdout:8/640: creat d0/d4/d29/d4b/db3/fd5 x:0 0 0 2024-09-17T01:02:01.170 INFO:tasks.workunit.client.0.smithi002.stdout:3/616: dread d0/d3/d37/f7e [0,4194304] 0 2024-09-17T01:02:01.172 INFO:tasks.workunit.client.0.smithi002.stdout:3/617: unlink d0/fd 0 2024-09-17T01:02:01.173 INFO:tasks.workunit.client.0.smithi002.stdout:3/618: truncate d0/d3/f19 4225427 0 2024-09-17T01:02:01.174 INFO:tasks.workunit.client.1.smithi099.stdout:1/751: dwrite d0/f40 [0,4194304] 0 2024-09-17T01:02:01.174 INFO:tasks.workunit.client.1.smithi099.stdout:1/752: chown d0/l44 3004 1 2024-09-17T01:02:01.175 INFO:tasks.workunit.client.0.smithi002.stdout:3/619: symlink d0/d3/d33/d4a/ld1 0 2024-09-17T01:02:01.175 INFO:tasks.workunit.client.0.smithi002.stdout:5/567: dwrite d2/d2d/d10/d20/f3e [0,4194304] 0 2024-09-17T01:02:01.175 INFO:tasks.workunit.client.0.smithi002.stdout:0/584: dwrite dd/f5a [0,4194304] 0 2024-09-17T01:02:01.175 INFO:tasks.workunit.client.0.smithi002.stdout:0/585: write dd/d19/d1a/d29/fb8 [210050,19918] 0 2024-09-17T01:02:01.178 INFO:tasks.workunit.client.0.smithi002.stdout:5/568: symlink d2/de/d1d/lb3 0 2024-09-17T01:02:01.178 INFO:tasks.workunit.client.0.smithi002.stdout:5/569: read - d2/d2d/d10/d23/d6e/d60/f8e zero size 2024-09-17T01:02:01.178 INFO:tasks.workunit.client.0.smithi002.stdout:5/570: chown d2/f54 65935112 1 2024-09-17T01:02:01.179 INFO:tasks.workunit.client.0.smithi002.stdout:0/586: creat dd/d19/d1c/dba/fc2 x:0 0 0 2024-09-17T01:02:01.181 INFO:tasks.workunit.client.0.smithi002.stdout:0/587: mkdir dd/d19/d1c/d1f/d22/dc3 0 2024-09-17T01:02:01.184 INFO:tasks.workunit.client.0.smithi002.stdout:0/588: unlink dd/d19/d1a/d29/fb8 0 2024-09-17T01:02:01.184 INFO:tasks.workunit.client.1.smithi099.stdout:6/717: dwrite dc/d5d/dae/fa2 [0,4194304] 0 2024-09-17T01:02:01.185 INFO:tasks.workunit.client.0.smithi002.stdout:4/775: dwrite d7/d19/d2e/f46 [4194304,4194304] 0 2024-09-17T01:02:01.185 INFO:tasks.workunit.client.0.smithi002.stdout:4/776: write d7/de/d3a/f97 [1779021,51243] 0 2024-09-17T01:02:01.185 INFO:tasks.workunit.client.0.smithi002.stdout:3/620: write d0/d3/d17/d6a/f6c [458195,58003] 0 2024-09-17T01:02:01.186 INFO:tasks.workunit.client.0.smithi002.stdout:0/589: mkdir dd/d19/d1c/d1f/dc4 0 2024-09-17T01:02:01.186 INFO:tasks.workunit.client.0.smithi002.stdout:2/648: dwrite d1b/d37/d48/d4e/f90 [0,4194304] 0 2024-09-17T01:02:01.186 INFO:tasks.workunit.client.0.smithi002.stdout:2/649: chown d1b/d1d/d79/fbf 181458693 1 2024-09-17T01:02:01.188 INFO:tasks.workunit.client.0.smithi002.stdout:5/571: dread d2/d2d/f13 [0,4194304] 0 2024-09-17T01:02:01.188 INFO:tasks.workunit.client.0.smithi002.stdout:5/572: chown d2/de/fa4 1789514 1 2024-09-17T01:02:01.188 INFO:tasks.workunit.client.0.smithi002.stdout:5/573: chown d2/c8b 109 1 2024-09-17T01:02:01.188 INFO:tasks.workunit.client.0.smithi002.stdout:4/777: symlink d7/d19/d9f/d80/d62/d52/dc7/d77/d9b/lf3 0 2024-09-17T01:02:01.191 INFO:tasks.workunit.client.0.smithi002.stdout:0/590: rename dd/d3d/d94/l9c to dd/d19/d1c/dba/lc5 0 2024-09-17T01:02:01.194 INFO:tasks.workunit.client.0.smithi002.stdout:2/650: mkdir d1b/d3f/d59/d7f/dc9/dac/dbd/de8 0 2024-09-17T01:02:01.194 INFO:tasks.workunit.client.0.smithi002.stdout:2/651: read d1b/d3f/d59/d7f/dc9/f61 [2573322,54613] 0 2024-09-17T01:02:01.195 INFO:tasks.workunit.client.0.smithi002.stdout:5/574: truncate d2/d2d/d10/d3b/f5e 2920992 0 2024-09-17T01:02:01.196 INFO:tasks.workunit.client.0.smithi002.stdout:0/591: symlink dd/d19/d1c/dba/lc6 0 2024-09-17T01:02:01.198 INFO:tasks.workunit.client.0.smithi002.stdout:2/652: mkdir d1b/d1d/dd4/de9 0 2024-09-17T01:02:01.198 INFO:tasks.workunit.client.0.smithi002.stdout:8/788: sync 2024-09-17T01:02:01.201 INFO:tasks.workunit.client.0.smithi002.stdout:2/653: mkdir d1b/d3f/dea 0 2024-09-17T01:02:01.204 INFO:tasks.workunit.client.0.smithi002.stdout:8/789: creat d2/d9/f107 x:0 0 0 2024-09-17T01:02:01.205 INFO:tasks.workunit.client.1.smithi099.stdout:4/619: dwrite d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/fc1 [0,4194304] 0 2024-09-17T01:02:01.205 INFO:tasks.workunit.client.1.smithi099.stdout:4/620: creat d7/dd/d21/fd4 x:0 0 0 2024-09-17T01:02:01.205 INFO:tasks.workunit.client.1.smithi099.stdout:4/621: truncate d7/dd/d21/d7b/d74/f7c 1473234 0 2024-09-17T01:02:01.205 INFO:tasks.workunit.client.1.smithi099.stdout:4/622: write f6 [2955515,105830] 0 2024-09-17T01:02:01.206 INFO:tasks.workunit.client.1.smithi099.stdout:4/623: creat d7/dd/d21/d26/d3f/fd5 x:0 0 0 2024-09-17T01:02:01.206 INFO:tasks.workunit.client.0.smithi002.stdout:8/790: dread - d2/d1c/d28/fe5 zero size 2024-09-17T01:02:01.206 INFO:tasks.workunit.client.0.smithi002.stdout:8/791: write d2/d3/d5f/d98/da5/d4f/d77/f8a [52247,69908] 0 2024-09-17T01:02:01.206 INFO:tasks.workunit.client.0.smithi002.stdout:3/621: read d0/f21 [382819,86802] 0 2024-09-17T01:02:01.207 INFO:tasks.workunit.client.0.smithi002.stdout:2/654: symlink d1b/d74/d93/d94/de2/leb 0 2024-09-17T01:02:01.209 INFO:tasks.workunit.client.0.smithi002.stdout:3/622: rmdir d0/d3/d17/d87/d96 0 2024-09-17T01:02:01.212 INFO:tasks.workunit.client.1.smithi099.stdout:4/624: link d7/d35/d98/cd2 d7/d35/d98/cd6 0 2024-09-17T01:02:01.212 INFO:tasks.workunit.client.1.smithi099.stdout:4/625: write d7/dd/de/d17/f52 [4212434,36614] 0 2024-09-17T01:02:01.216 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:00 smithi099 ceph-mon[34357]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:01.216 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:00 smithi099 ceph-mon[34357]: pgmap v254: 65 pgs: 65 active+clean; 2.4 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 290 MiB/s rd, 355 MiB/s wr, 625 op/s 2024-09-17T01:02:01.216 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:00 smithi099 ceph-mon[34357]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.219+0000 7f16a01c4640 1 -- 172.21.15.2:0/462274403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f169806dbf0 msgr2=0x7f169806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.219+0000 7f16a01c4640 1 --2- 172.21.15.2:0/462274403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f169806dbf0 0x7f169806e000 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f16940048d0 tx=0x7f1694009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.220+0000 7f16a01c4640 1 -- 172.21.15.2:0/462274403 shutdown_connections 2024-09-17T01:02:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.220+0000 7f16a01c4640 1 --2- 172.21.15.2:0/462274403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f169806e540 0x7f169810a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.220+0000 7f16a01c4640 1 --2- 172.21.15.2:0/462274403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f169806dbf0 0x7f169806e000 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.220+0000 7f16a01c4640 1 -- 172.21.15.2:0/462274403 >> 172.21.15.2:0/462274403 conn(0x7f1698069560 msgr2=0x7f169806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.220+0000 7f16a01c4640 1 -- 172.21.15.2:0/462274403 shutdown_connections 2024-09-17T01:02:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.220+0000 7f16a01c4640 1 -- 172.21.15.2:0/462274403 wait complete. 2024-09-17T01:02:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.220+0000 7f16a01c4640 1 Processor -- start 2024-09-17T01:02:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.220+0000 7f16a01c4640 1 -- start start 2024-09-17T01:02:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.221+0000 7f16a01c4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f169806dbf0 0x7f16981158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.221+0000 7f16a01c4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f169806e540 0x7f1698115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:01.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.221+0000 7f16a01c4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1698116440 con 0x7f169806e540 2024-09-17T01:02:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.221+0000 7f16a01c4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1698116c10 con 0x7f169806dbf0 2024-09-17T01:02:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.221+0000 7f169d75f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f169806e540 0x7f1698115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.221+0000 7f169d75f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f169806e540 0x7f1698115df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49802/0 (socket says 172.21.15.2:49802) 2024-09-17T01:02:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.221+0000 7f169d75f640 1 -- 172.21.15.2:0/1524973224 learned_addr learned my addr 172.21.15.2:0/1524973224 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:02:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.221+0000 7f169d75f640 1 -- 172.21.15.2:0/1524973224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f169806dbf0 msgr2=0x7f16981158b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T01:02:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.221+0000 7f169d75f640 1 --2- 172.21.15.2:0/1524973224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f169806dbf0 0x7f16981158b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.221+0000 7f169d75f640 1 -- 172.21.15.2:0/1524973224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694005040 con 0x7f169806e540 2024-09-17T01:02:01.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.221+0000 7f169d75f640 1 --2- 172.21.15.2:0/1524973224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f169806e540 0x7f1698115df0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c810 tx=0x7f168c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:01.222 INFO:tasks.workunit.client.0.smithi002.stdout:1/646: dwrite d4/d11/d1a/f29 [0,4194304] 0 2024-09-17T01:02:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.222+0000 7f168a7fc640 1 -- 172.21.15.2:0/1524973224 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f168c00a820 con 0x7f169806e540 2024-09-17T01:02:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.222+0000 7f168a7fc640 1 -- 172.21.15.2:0/1524973224 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f168c00ae20 con 0x7f169806e540 2024-09-17T01:02:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.222+0000 7f16a01c4640 1 -- 172.21.15.2:0/1524973224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1698116ea0 con 0x7f169806e540 2024-09-17T01:02:01.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.223+0000 7f168a7fc640 1 -- 172.21.15.2:0/1524973224 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f168c0115c0 con 0x7f169806e540 2024-09-17T01:02:01.224 INFO:tasks.workunit.client.1.smithi099.stdout:0/655: dwrite da/df/d1a/d56/d72/f93 [0,4194304] 0 2024-09-17T01:02:01.224 INFO:tasks.workunit.client.1.smithi099.stdout:0/656: readlink da/df/d1a/d63/d6a/l79 0 2024-09-17T01:02:01.224 INFO:tasks.workunit.client.1.smithi099.stdout:0/657: write da/df/d1a/d56/f74 [3805162,48547] 0 2024-09-17T01:02:01.224 INFO:tasks.workunit.client.1.smithi099.stdout:0/658: write da/d12/d22/fc7 [1031733,84474] 0 2024-09-17T01:02:01.224 INFO:tasks.workunit.client.1.smithi099.stdout:0/659: write da/d12/d22/fb7 [23462,63749] 0 2024-09-17T01:02:01.224 INFO:tasks.workunit.client.1.smithi099.stdout:4/626: rmdir d7/dd/de/d10/d6b/d82/d8a/d9b 0 2024-09-17T01:02:01.224 INFO:tasks.workunit.client.1.smithi099.stdout:4/627: chown d7/dd/d21/c22 47 1 2024-09-17T01:02:01.224 INFO:tasks.workunit.client.1.smithi099.stdout:4/628: dread - d7/d35/f6e zero size 2024-09-17T01:02:01.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.223+0000 7f16a01c4640 1 -- 172.21.15.2:0/1524973224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1698117440 con 0x7f169806e540 2024-09-17T01:02:01.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.224+0000 7f16a01c4640 1 -- 172.21.15.2:0/1524973224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169806d1b0 con 0x7f169806e540 2024-09-17T01:02:01.226 INFO:tasks.workunit.client.1.smithi099.stdout:4/629: symlink d7/dd/d21/d7b/d4b/dcb/ld7 0 2024-09-17T01:02:01.226 INFO:tasks.workunit.client.1.smithi099.stdout:4/630: chown d7 1140 1 2024-09-17T01:02:01.226 INFO:tasks.workunit.client.0.smithi002.stdout:9/565: dwrite d5/dc/d26/f2d [0,4194304] 0 2024-09-17T01:02:01.226 INFO:tasks.workunit.client.0.smithi002.stdout:9/566: stat d5/dc/d26/d5c/d6b/d75 0 2024-09-17T01:02:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.225+0000 7f168a7fc640 1 -- 172.21.15.2:0/1524973224 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f168c00a980 con 0x7f169806e540 2024-09-17T01:02:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.226+0000 7f168a7fc640 1 --2- 172.21.15.2:0/1524973224 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f168406eb40 0x7f1684070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.227+0000 7f168a7fc640 1 -- 172.21.15.2:0/1524973224 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f168c05aa00 con 0x7f169806e540 2024-09-17T01:02:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.227+0000 7f169df60640 1 --2- 172.21.15.2:0/1524973224 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f168406eb40 0x7f1684070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:01.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.227+0000 7f169df60640 1 --2- 172.21.15.2:0/1524973224 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f168406eb40 0x7f1684070ff0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f169402a530 tx=0x7f1694009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:01.228 INFO:tasks.workunit.client.1.smithi099.stdout:4/631: rmdir d7/dd/d21/d7b/d4b/dcb 39 2024-09-17T01:02:01.228 INFO:tasks.workunit.client.0.smithi002.stdout:9/567: rmdir d5/dc/d26/d5c/d6b/d75/d36 39 2024-09-17T01:02:01.229 INFO:tasks.workunit.client.0.smithi002.stdout:9/568: truncate d5/f19 1658874 0 2024-09-17T01:02:01.230 INFO:tasks.workunit.client.0.smithi002.stdout:9/569: write d5/dc/f92 [52885,28980] 0 2024-09-17T01:02:01.230 INFO:tasks.workunit.client.0.smithi002.stdout:9/570: truncate d5/dc/d26/d63/f94 305696 0 2024-09-17T01:02:01.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.232+0000 7f168a7fc640 1 -- 172.21.15.2:0/1524973224 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f168c093060 con 0x7f169806e540 2024-09-17T01:02:01.231 INFO:tasks.workunit.client.0.smithi002.stdout:9/571: rename d5/dc/f92 to d5/d8a/d9d/fa3 0 2024-09-17T01:02:01.231 INFO:tasks.workunit.client.0.smithi002.stdout:9/572: creat d5/dc/d26/d63/d66/fa4 x:0 0 0 2024-09-17T01:02:01.233 INFO:tasks.workunit.client.0.smithi002.stdout:9/573: chown d5/dc/f68 16152 1 2024-09-17T01:02:01.234 INFO:tasks.workunit.client.0.smithi002.stdout:9/574: symlink d5/dc/d26/d5c/d6b/d75/d57/d7a/la5 0 2024-09-17T01:02:01.234 INFO:tasks.workunit.client.0.smithi002.stdout:9/575: write d5/dc/d26/d63/d66/f88 [588037,29526] 0 2024-09-17T01:02:01.235 INFO:tasks.workunit.client.0.smithi002.stdout:9/576: link d5/dc/d26/d5c/d6b/d75/d57/d7a/l8c d5/dc/d26/d46/d47/d89/la6 0 2024-09-17T01:02:01.237 INFO:tasks.workunit.client.0.smithi002.stdout:9/577: dread d5/dc/d26/d5c/d6b/f6e [0,4194304] 0 2024-09-17T01:02:01.238 INFO:tasks.workunit.client.0.smithi002.stdout:9/578: mkdir d5/d8a/d9d/da7 0 2024-09-17T01:02:01.240 INFO:tasks.workunit.client.0.smithi002.stdout:9/579: creat d5/dc/d26/d46/d47/d89/fa8 x:0 0 0 2024-09-17T01:02:01.243 INFO:tasks.workunit.client.1.smithi099.stdout:4/632: dread f2 [0,4194304] 0 2024-09-17T01:02:01.243 INFO:tasks.workunit.client.1.smithi099.stdout:4/633: chown d7/dd/de/d17/d72/cce 569 1 2024-09-17T01:02:01.252 INFO:tasks.workunit.client.1.smithi099.stdout:4/634: dread d7/dd/d21/d26/f56 [0,4194304] 0 2024-09-17T01:02:01.252 INFO:tasks.workunit.client.1.smithi099.stdout:4/635: readlink d7/dd/d21/d26/d3f/d5b/l2b 0 2024-09-17T01:02:01.253 INFO:tasks.workunit.client.1.smithi099.stdout:8/641: dwrite d0/d41/d5a/fd4 [0,4194304] 0 2024-09-17T01:02:01.253 INFO:tasks.workunit.client.1.smithi099.stdout:6/718: dwrite dc/d1a/d49/f62 [0,4194304] 0 2024-09-17T01:02:01.254 INFO:tasks.workunit.client.1.smithi099.stdout:9/720: dwrite da/d14/d40/f65 [0,4194304] 0 2024-09-17T01:02:01.255 INFO:tasks.workunit.client.1.smithi099.stdout:9/721: creat da/d18/d5e/fe7 x:0 0 0 2024-09-17T01:02:01.255 INFO:tasks.workunit.client.1.smithi099.stdout:9/722: write da/d18/d49/fb7 [738083,6219] 0 2024-09-17T01:02:01.257 INFO:tasks.workunit.client.1.smithi099.stdout:6/719: truncate dc/d27/d7e/f94 2921946 0 2024-09-17T01:02:01.259 INFO:tasks.workunit.client.1.smithi099.stdout:9/723: mkdir da/d56/d84/db9/de8 0 2024-09-17T01:02:01.267 INFO:tasks.workunit.client.0.smithi002.stdout:0/592: truncate dd/f5a 2842367 0 2024-09-17T01:02:01.268 INFO:tasks.workunit.client.0.smithi002.stdout:4/778: dwrite d7/d19/d9c/de9/fa2 [0,4194304] 0 2024-09-17T01:02:01.268 INFO:tasks.workunit.client.0.smithi002.stdout:4/779: chown d7/f18 13 1 2024-09-17T01:02:01.268 INFO:tasks.workunit.client.0.smithi002.stdout:4/780: write d7/d19/f1c [2894105,45441] 0 2024-09-17T01:02:01.270 INFO:tasks.workunit.client.1.smithi099.stdout:9/724: creat da/d56/d84/db9/de8/fe9 x:0 0 0 2024-09-17T01:02:01.270 INFO:tasks.workunit.client.1.smithi099.stdout:9/725: dread - da/fd4 zero size 2024-09-17T01:02:01.270 INFO:tasks.workunit.client.1.smithi099.stdout:9/726: write da/d14/d48/d69/d6c/fa2 [367611,88174] 0 2024-09-17T01:02:01.271 INFO:tasks.workunit.client.0.smithi002.stdout:4/781: mkdir d7/d19/d9f/d80/d62/dbe/df4 0 2024-09-17T01:02:01.271 INFO:tasks.workunit.client.0.smithi002.stdout:4/782: chown d7/de/f27 34741255 1 2024-09-17T01:02:01.271 INFO:tasks.workunit.client.0.smithi002.stdout:4/783: chown d7/l1b 81318 1 2024-09-17T01:02:01.271 INFO:tasks.workunit.client.0.smithi002.stdout:8/792: dwrite d2/d3/d5f/fb3 [0,4194304] 0 2024-09-17T01:02:01.271 INFO:tasks.workunit.client.0.smithi002.stdout:3/623: dwrite d0/d3/d17/f6d [0,4194304] 0 2024-09-17T01:02:01.271 INFO:tasks.workunit.client.0.smithi002.stdout:3/624: chown d0/d3/f1a 54 1 2024-09-17T01:02:01.271 INFO:tasks.workunit.client.0.smithi002.stdout:3/625: write d0/d3/d37/f51 [580666,66812] 0 2024-09-17T01:02:01.272 INFO:tasks.workunit.client.0.smithi002.stdout:3/626: write d0/d3/d37/dac/da1/fa2 [1094499,6451] 0 2024-09-17T01:02:01.272 INFO:tasks.workunit.client.0.smithi002.stdout:3/627: truncate d0/f16 4348725 0 2024-09-17T01:02:01.272 INFO:tasks.workunit.client.0.smithi002.stdout:2/655: dwrite d1b/d74/d93/fa1 [0,4194304] 0 2024-09-17T01:02:01.272 INFO:tasks.workunit.client.0.smithi002.stdout:9/580: dwrite d5/dc/d26/f7e [0,4194304] 0 2024-09-17T01:02:01.273 INFO:tasks.workunit.client.0.smithi002.stdout:5/575: dwrite d2/de/f4a [0,4194304] 0 2024-09-17T01:02:01.274 INFO:tasks.workunit.client.1.smithi099.stdout:8/642: dread d0/d4/d64/f8d [0,4194304] 0 2024-09-17T01:02:01.274 INFO:tasks.workunit.client.1.smithi099.stdout:8/643: fsync d0/d4/d29/d4b/f96 0 2024-09-17T01:02:01.274 INFO:tasks.workunit.client.1.smithi099.stdout:6/720: dread dc/d1a/d49/d4c/f5f [4194304,4194304] 0 2024-09-17T01:02:01.275 INFO:tasks.workunit.client.1.smithi099.stdout:0/660: dwrite da/df/d1a/d49/f51 [0,4194304] 0 2024-09-17T01:02:01.275 INFO:tasks.workunit.client.1.smithi099.stdout:0/661: chown da/df/d1a/d56/fc5 88365 1 2024-09-17T01:02:01.275 INFO:tasks.workunit.client.1.smithi099.stdout:0/662: readlink da/df/d4d/lc9 0 2024-09-17T01:02:01.275 INFO:tasks.workunit.client.1.smithi099.stdout:1/753: dwrite d0/d2/d18/f34 [0,4194304] 0 2024-09-17T01:02:01.275 INFO:tasks.workunit.client.0.smithi002.stdout:4/784: getdents d7/d3f/da9/dca 0 2024-09-17T01:02:01.278 INFO:tasks.workunit.client.1.smithi099.stdout:1/754: creat d0/de2/f100 x:0 0 0 2024-09-17T01:02:01.280 INFO:tasks.workunit.client.1.smithi099.stdout:6/721: symlink dc/lf3 0 2024-09-17T01:02:01.280 INFO:tasks.workunit.client.1.smithi099.stdout:6/722: truncate dc/d5d/d66/dc3/fd2 300859 0 2024-09-17T01:02:01.281 INFO:tasks.workunit.client.1.smithi099.stdout:1/755: truncate d0/d8/d49/f82 1095806 0 2024-09-17T01:02:01.282 INFO:tasks.workunit.client.1.smithi099.stdout:1/756: fdatasync d0/d8/d38/d75/f9b 0 2024-09-17T01:02:01.282 INFO:tasks.workunit.client.0.smithi002.stdout:2/656: mkdir d1b/d8a/d92/dae/dec 0 2024-09-17T01:02:01.283 INFO:tasks.workunit.client.1.smithi099.stdout:6/723: mknod dc/d27/d58/cf4 0 2024-09-17T01:02:01.284 INFO:tasks.workunit.client.0.smithi002.stdout:9/581: symlink d5/dc/d26/d5c/d6b/d75/d57/la9 0 2024-09-17T01:02:01.287 INFO:tasks.workunit.client.1.smithi099.stdout:1/757: rmdir d0/d8c/d9e 39 2024-09-17T01:02:01.288 INFO:tasks.workunit.client.1.smithi099.stdout:1/758: fsync d0/d2/de/d70/de8/fdd 0 2024-09-17T01:02:01.292 INFO:tasks.workunit.client.1.smithi099.stdout:0/663: read da/df/d1a/d63/d6a/f6e [1567486,90980] 0 2024-09-17T01:02:01.292 INFO:tasks.workunit.client.1.smithi099.stdout:0/664: dread - da/f82 zero size 2024-09-17T01:02:01.293 INFO:tasks.workunit.client.0.smithi002.stdout:8/793: read d2/d26/f40 [3762815,76994] 0 2024-09-17T01:02:01.293 INFO:tasks.workunit.client.0.smithi002.stdout:8/794: readlink d2/d3/d5f/d98/lc2 0 2024-09-17T01:02:01.293 INFO:tasks.workunit.client.0.smithi002.stdout:8/795: chown d2/d1c/d28/cef 495 1 2024-09-17T01:02:01.294 INFO:tasks.workunit.client.1.smithi099.stdout:6/724: rename dc/l43 to dc/d5d/dc9/lf5 0 2024-09-17T01:02:01.294 INFO:tasks.workunit.client.1.smithi099.stdout:6/725: rename dc/d5d to dc/d5d/d66/dc8/df6 22 2024-09-17T01:02:01.294 INFO:tasks.workunit.client.1.smithi099.stdout:6/726: fdatasync dc/fe6 0 2024-09-17T01:02:01.294 INFO:tasks.workunit.client.0.smithi002.stdout:5/576: creat d2/d2d/d10/d14/d19/d39/d97/fb4 x:0 0 0 2024-09-17T01:02:01.295 INFO:tasks.workunit.client.1.smithi099.stdout:1/759: mknod d0/d8c/c101 0 2024-09-17T01:02:01.296 INFO:tasks.workunit.client.1.smithi099.stdout:1/760: write d0/d2/de/d8b/da7/d98/fea [946751,63107] 0 2024-09-17T01:02:01.296 INFO:tasks.workunit.client.0.smithi002.stdout:2/657: symlink d1b/d1d/led 0 2024-09-17T01:02:01.296 INFO:tasks.workunit.client.0.smithi002.stdout:2/658: truncate d1b/d37/d48/d52/db5/fdc 585447 0 2024-09-17T01:02:01.297 INFO:tasks.workunit.client.1.smithi099.stdout:0/665: getdents da/df/d31/db0/d1e 0 2024-09-17T01:02:01.298 INFO:tasks.workunit.client.0.smithi002.stdout:9/582: creat d5/dc/d26/d5c/d6b/d75/d57/d8d/faa x:0 0 0 2024-09-17T01:02:01.299 INFO:tasks.workunit.client.1.smithi099.stdout:6/727: rename dc/d1a/f40 to dc/d27/d7e/ff7 0 2024-09-17T01:02:01.300 INFO:tasks.workunit.client.1.smithi099.stdout:6/728: creat dc/d27/ff8 x:0 0 0 2024-09-17T01:02:01.300 INFO:tasks.workunit.client.0.smithi002.stdout:9/583: mkdir d5/dc/d26/d46/d47/da1/dab 0 2024-09-17T01:02:01.301 INFO:tasks.workunit.client.1.smithi099.stdout:0/666: mkdir da/df/d1a/d49/d68/d9f/dd7 0 2024-09-17T01:02:01.301 INFO:tasks.workunit.client.0.smithi002.stdout:8/796: rmdir d2/d1c/d28 39 2024-09-17T01:02:01.302 INFO:tasks.workunit.client.0.smithi002.stdout:8/797: chown d2/d26/f40 132 1 2024-09-17T01:02:01.302 INFO:tasks.workunit.client.0.smithi002.stdout:5/577: getdents d2/d2d/d10/d3b 0 2024-09-17T01:02:01.302 INFO:tasks.workunit.client.0.smithi002.stdout:5/578: truncate d2/d2d/d10/d14/d19/d39/d51/f79 5091530 0 2024-09-17T01:02:01.304 INFO:tasks.workunit.client.0.smithi002.stdout:9/584: unlink d5/dc/d26/l74 0 2024-09-17T01:02:01.305 INFO:tasks.workunit.client.0.smithi002.stdout:8/798: truncate d2/d3/d5f/d47/f62 2005471 0 2024-09-17T01:02:01.305 INFO:tasks.workunit.client.0.smithi002.stdout:8/799: fdatasync d2/d3/d5f/d98/da5/d4f/fd8 0 2024-09-17T01:02:01.305 INFO:tasks.workunit.client.1.smithi099.stdout:4/636: dwrite d7/dd/d21/d7b/d4b/fa9 [0,4194304] 0 2024-09-17T01:02:01.306 INFO:tasks.workunit.client.1.smithi099.stdout:4/637: write d7/dd/de/d17/d72/fc2 [659564,3932] 0 2024-09-17T01:02:01.306 INFO:tasks.workunit.client.1.smithi099.stdout:4/638: creat d7/dd/d21/fd8 x:0 0 0 2024-09-17T01:02:01.306 INFO:tasks.workunit.client.1.smithi099.stdout:0/667: rmdir da/df/d1a/d63/d6a/da4 0 2024-09-17T01:02:01.306 INFO:tasks.workunit.client.0.smithi002.stdout:8/800: mknod d2/d3/d5f/d47/d80/c108 0 2024-09-17T01:02:01.307 INFO:tasks.workunit.client.1.smithi099.stdout:6/729: mkdir dc/df9 0 2024-09-17T01:02:01.307 INFO:tasks.workunit.client.1.smithi099.stdout:6/730: creat dc/d27/d58/ffa x:0 0 0 2024-09-17T01:02:01.307 INFO:tasks.workunit.client.1.smithi099.stdout:6/731: dread - dc/d5d/dae/d96/d60/fcf zero size 2024-09-17T01:02:01.308 INFO:tasks.workunit.client.0.smithi002.stdout:3/628: read d0/d3/fb5 [3404433,129164] 0 2024-09-17T01:02:01.308 INFO:tasks.workunit.client.0.smithi002.stdout:3/629: chown d0/d3/d33/f7b 318 1 2024-09-17T01:02:01.310 INFO:tasks.workunit.client.0.smithi002.stdout:3/630: creat d0/d3/d33/d99/fd2 x:0 0 0 2024-09-17T01:02:01.310 INFO:tasks.workunit.client.0.smithi002.stdout:3/631: dread - d0/d31/d32/f81 zero size 2024-09-17T01:02:01.311 INFO:tasks.workunit.client.0.smithi002.stdout:3/632: write d0/d31/d8b/fc2 [583315,76567] 0 2024-09-17T01:02:01.312 INFO:tasks.workunit.client.1.smithi099.stdout:4/639: symlink d7/dd/ld9 0 2024-09-17T01:02:01.314 INFO:tasks.workunit.client.1.smithi099.stdout:0/668: unlink da/d12/d22/d53/c67 0 2024-09-17T01:02:01.314 INFO:tasks.workunit.client.1.smithi099.stdout:0/669: stat da/df/d31/d8b/f81 0 2024-09-17T01:02:01.316 INFO:tasks.workunit.client.1.smithi099.stdout:6/732: creat dc/d27/dd7/ffb x:0 0 0 2024-09-17T01:02:01.319 INFO:tasks.workunit.client.1.smithi099.stdout:4/640: stat d7/l46 0 2024-09-17T01:02:01.320 INFO:tasks.workunit.client.1.smithi099.stdout:0/670: rename da/f1b to da/df/d1a/d49/d71/fd8 0 2024-09-17T01:02:01.321 INFO:tasks.workunit.client.1.smithi099.stdout:0/671: write da/df/d1a/d49/d71/faf [516822,43209] 0 2024-09-17T01:02:01.321 INFO:tasks.workunit.client.1.smithi099.stdout:6/733: stat dc/d2b/c98 0 2024-09-17T01:02:01.322 INFO:tasks.workunit.client.1.smithi099.stdout:4/641: symlink d7/dd/d21/d26/d3f/d5b/lda 0 2024-09-17T01:02:01.324 INFO:tasks.workunit.client.1.smithi099.stdout:6/734: symlink dc/d5d/d66/dc3/dd4/lfc 0 2024-09-17T01:02:01.325 INFO:tasks.workunit.client.1.smithi099.stdout:4/642: mkdir d7/dd/d21/d26/ddb 0 2024-09-17T01:02:01.325 INFO:tasks.workunit.client.1.smithi099.stdout:4/643: chown d7/dd/de/ff 1620181 1 2024-09-17T01:02:01.325 INFO:tasks.workunit.client.1.smithi099.stdout:6/735: mkdir dc/d5d/dae/d96/dfd 0 2024-09-17T01:02:01.333 INFO:tasks.workunit.client.0.smithi002.stdout:0/593: dwrite dd/d19/d1a/f4a [0,4194304] 0 2024-09-17T01:02:01.334 INFO:tasks.workunit.client.0.smithi002.stdout:0/594: truncate dd/fae 984572 0 2024-09-17T01:02:01.334 INFO:tasks.workunit.client.0.smithi002.stdout:0/595: fsync dd/d19/f6f 0 2024-09-17T01:02:01.334 INFO:tasks.workunit.client.0.smithi002.stdout:0/596: readlink dd/d19/d1a/d29/d55/d56/l73 0 2024-09-17T01:02:01.334 INFO:tasks.workunit.client.0.smithi002.stdout:0/597: write dd/d19/d1c/d1f/d22/f51 [4766640,40723] 0 2024-09-17T01:02:01.335 INFO:tasks.workunit.client.0.smithi002.stdout:4/785: dwrite d7/d19/fe4 [0,4194304] 0 2024-09-17T01:02:01.336 INFO:tasks.workunit.client.0.smithi002.stdout:0/598: rename dd/d19/d1c/dba/lc5 to dd/d19/d1c/d1f/d22/lc7 0 2024-09-17T01:02:01.337 INFO:tasks.workunit.client.0.smithi002.stdout:8/801: dread d2/d3/d5f/d98/da5/d4f/f94 [0,4194304] 0 2024-09-17T01:02:01.337 INFO:tasks.workunit.client.0.smithi002.stdout:8/802: fsync d2/d30/fae 0 2024-09-17T01:02:01.337 INFO:tasks.workunit.client.0.smithi002.stdout:8/803: creat d2/d3/d5f/d98/da5/d4f/d77/db0/f109 x:0 0 0 2024-09-17T01:02:01.337 INFO:tasks.workunit.client.0.smithi002.stdout:8/804: write d2/d3/d5f/d98/da5/d4f/d77/d78/fa9 [2347785,116811] 0 2024-09-17T01:02:01.337 INFO:tasks.workunit.client.0.smithi002.stdout:8/805: readlink d2/d26/dbb/ld5 0 2024-09-17T01:02:01.337 INFO:tasks.workunit.client.0.smithi002.stdout:8/806: stat d2/d3/de6 0 2024-09-17T01:02:01.338 INFO:tasks.workunit.client.0.smithi002.stdout:4/786: rmdir d7/d19/d9f/d80/d62/d52/dc7/d77/d9b 39 2024-09-17T01:02:01.338 INFO:tasks.workunit.client.0.smithi002.stdout:4/787: dread - d7/de/d3a/dac/fce zero size 2024-09-17T01:02:01.339 INFO:tasks.workunit.client.0.smithi002.stdout:4/788: dread d7/de/fae [0,4194304] 0 2024-09-17T01:02:01.340 INFO:tasks.workunit.client.0.smithi002.stdout:8/807: symlink d2/l10a 0 2024-09-17T01:02:01.351 INFO:tasks.workunit.client.0.smithi002.stdout:9/585: dwrite d5/dc/d26/d5c/d6b/f9b [0,4194304] 0 2024-09-17T01:02:01.352 INFO:tasks.workunit.client.0.smithi002.stdout:9/586: write d5/f14 [2526659,6820] 0 2024-09-17T01:02:01.353 INFO:tasks.workunit.client.1.smithi099.stdout:9/727: dwrite da/d21/d5b/fb1 [0,4194304] 0 2024-09-17T01:02:01.354 INFO:tasks.workunit.client.1.smithi099.stdout:9/728: readlink da/d56/d84/l88 0 2024-09-17T01:02:01.354 INFO:tasks.workunit.client.0.smithi002.stdout:9/587: rename d5/dc/d26/d5c/d6b/d75/d57/d7a/c8e to d5/dc/d26/d63/d66/cac 0 2024-09-17T01:02:01.354 INFO:tasks.workunit.client.1.smithi099.stdout:1/761: dwrite d0/de2/f100 [0,4194304] 0 2024-09-17T01:02:01.355 INFO:tasks.workunit.client.0.smithi002.stdout:4/789: read d7/d19/d2e/fbd [2083371,64023] 0 2024-09-17T01:02:01.355 INFO:tasks.workunit.client.0.smithi002.stdout:9/588: creat d5/dc/d26/d46/d47/da1/fad x:0 0 0 2024-09-17T01:02:01.355 INFO:tasks.workunit.client.0.smithi002.stdout:9/589: fdatasync d5/dc/d26/d5c/d6b/d75/f62 0 2024-09-17T01:02:01.357 INFO:tasks.workunit.client.0.smithi002.stdout:9/590: rename d5/dc/d26/d5c/d6b/d75/f76 to d5/dc/d26/d63/d66/fae 0 2024-09-17T01:02:01.357 INFO:tasks.workunit.client.0.smithi002.stdout:9/591: creat d5/dc/d26/d46/faf x:0 0 0 2024-09-17T01:02:01.361 INFO:tasks.workunit.client.0.smithi002.stdout:3/633: write d0/f62 [715063,5630] 0 2024-09-17T01:02:01.362 INFO:tasks.workunit.client.0.smithi002.stdout:3/634: getdents d0/d3/d37/dac 0 2024-09-17T01:02:01.362 INFO:tasks.workunit.client.0.smithi002.stdout:3/635: symlink d0/d31/d32/dcb/ld3 0 2024-09-17T01:02:01.364 INFO:tasks.workunit.client.0.smithi002.stdout:3/636: mkdir d0/d3/d17/d87/d9e/dd4 0 2024-09-17T01:02:01.365 INFO:tasks.workunit.client.0.smithi002.stdout:3/637: rmdir d0/d3/d8d/db3 0 2024-09-17T01:02:01.365 INFO:tasks.workunit.client.0.smithi002.stdout:3/638: creat d0/d31/d32/fd5 x:0 0 0 2024-09-17T01:02:01.365 INFO:tasks.workunit.client.0.smithi002.stdout:3/639: stat d0/d3/fb2 0 2024-09-17T01:02:01.367 INFO:tasks.workunit.client.0.smithi002.stdout:9/592: dread d5/f44 [0,4194304] 0 2024-09-17T01:02:01.367 INFO:tasks.workunit.client.0.smithi002.stdout:3/640: mknod d0/d3/d17/d9a/daa/cd6 0 2024-09-17T01:02:01.367 INFO:tasks.workunit.client.1.smithi099.stdout:1/762: write d0/f67 [2917169,51389] 0 2024-09-17T01:02:01.368 INFO:tasks.workunit.client.0.smithi002.stdout:5/579: dwrite d2/d2d/d10/d14/f8c [0,4194304] 0 2024-09-17T01:02:01.370 INFO:tasks.workunit.client.0.smithi002.stdout:9/593: mknod d5/dc/cb0 0 2024-09-17T01:02:01.372 INFO:tasks.workunit.client.0.smithi002.stdout:0/599: dwrite dd/d19/d1c/fa0 [0,4194304] 0 2024-09-17T01:02:01.372 INFO:tasks.workunit.client.0.smithi002.stdout:2/659: dwrite d1b/d37/d48/fba [0,4194304] 0 2024-09-17T01:02:01.372 INFO:tasks.workunit.client.1.smithi099.stdout:4/644: dwrite d7/dd/d21/d26/d3f/d5b/f2c [0,4194304] 0 2024-09-17T01:02:01.372 INFO:tasks.workunit.client.1.smithi099.stdout:4/645: fdatasync d7/dd/d21/d26/f51 0 2024-09-17T01:02:01.375 INFO:tasks.workunit.client.0.smithi002.stdout:9/594: chown d5/dc/l39 22869963 1 2024-09-17T01:02:01.375 INFO:tasks.workunit.client.0.smithi002.stdout:8/808: dwrite d2/d3/d5f/d98/da5/d4f/d77/f8a [0,4194304] 0 2024-09-17T01:02:01.375 INFO:tasks.workunit.client.0.smithi002.stdout:2/660: write d1b/d37/f4d [4483588,121431] 0 2024-09-17T01:02:01.375 INFO:tasks.workunit.client.0.smithi002.stdout:2/661: read - d1b/d37/f80 zero size 2024-09-17T01:02:01.377 INFO:tasks.workunit.client.0.smithi002.stdout:4/790: dwrite d7/d19/d9c/de9/da4/fd8 [0,4194304] 0 2024-09-17T01:02:01.382 INFO:tasks.workunit.client.0.smithi002.stdout:9/595: dread d5/dc/d26/d5c/d6b/d75/d57/d7a/f8b [0,4194304] 0 2024-09-17T01:02:01.389 INFO:tasks.workunit.client.0.smithi002.stdout:5/580: rmdir d2/d2d 39 2024-09-17T01:02:01.389 INFO:tasks.workunit.client.0.smithi002.stdout:0/600: dwrite dd/d19/f4e [0,4194304] 0 2024-09-17T01:02:01.393 INFO:tasks.workunit.client.0.smithi002.stdout:2/662: link d1b/d37/f42 d1b/d37/d48/db1/dbb/fee 0 2024-09-17T01:02:01.397 INFO:tasks.workunit.client.0.smithi002.stdout:4/791: mkdir d7/d19/d9f/d80/d62/dbe/df5 0 2024-09-17T01:02:01.397 INFO:tasks.workunit.client.0.smithi002.stdout:4/792: chown d7/de/dda 1910663 1 2024-09-17T01:02:01.401 INFO:tasks.workunit.client.0.smithi002.stdout:9/596: creat d5/dc/d26/d5c/d6b/d75/fb1 x:0 0 0 2024-09-17T01:02:01.403 INFO:tasks.workunit.client.0.smithi002.stdout:5/581: link d2/de/f1f d2/d2d/d10/d14/d19/da5/fb5 0 2024-09-17T01:02:01.403 INFO:tasks.workunit.client.0.smithi002.stdout:5/582: dread - d2/d2d/d10/d20/fb2 zero size 2024-09-17T01:02:01.403 INFO:tasks.workunit.client.0.smithi002.stdout:5/583: chown d2/d2d/d10/d14/f88 25315351 1 2024-09-17T01:02:01.403 INFO:tasks.workunit.client.0.smithi002.stdout:5/584: dread - d2/d2d/d10/d23/f76 zero size 2024-09-17T01:02:01.405 INFO:tasks.workunit.client.0.smithi002.stdout:0/601: creat dd/d19/d1c/db7/db4/fc8 x:0 0 0 2024-09-17T01:02:01.407 INFO:tasks.workunit.client.0.smithi002.stdout:4/793: link d7/d19/d9f/d80/d62/d52/dc7/c76 d7/d3f/da9/dca/cf6 0 2024-09-17T01:02:01.408 INFO:tasks.workunit.client.0.smithi002.stdout:9/597: creat d5/d8a/d9d/da7/fb2 x:0 0 0 2024-09-17T01:02:01.409 INFO:tasks.workunit.client.0.smithi002.stdout:5/585: creat d2/d2d/d10/d14/d19/d39/d64/fb6 x:0 0 0 2024-09-17T01:02:01.410 INFO:tasks.workunit.client.0.smithi002.stdout:5/586: chown d2/d2d/d10/d23/d6e/d60/fb1 1112566 1 2024-09-17T01:02:01.410 INFO:tasks.workunit.client.0.smithi002.stdout:5/587: chown d2/d2d/d10/d14/d19/da5/db0/d33 9 1 2024-09-17T01:02:01.410 INFO:tasks.workunit.client.0.smithi002.stdout:0/602: creat dd/d19/d1c/d33/d67/d68/fc9 x:0 0 0 2024-09-17T01:02:01.411 INFO:tasks.workunit.client.0.smithi002.stdout:0/603: write dd/d19/d1c/d33/d67/f7f [544752,104586] 0 2024-09-17T01:02:01.411 INFO:tasks.workunit.client.0.smithi002.stdout:0/604: fsync dd/d19/f3b 0 2024-09-17T01:02:01.411 INFO:tasks.workunit.client.0.smithi002.stdout:0/605: stat dd/d19/d1c/f79 0 2024-09-17T01:02:01.411 INFO:tasks.workunit.client.0.smithi002.stdout:4/794: truncate d7/d19/f1c 1781606 0 2024-09-17T01:02:01.411 INFO:tasks.workunit.client.1.smithi099.stdout:9/729: rename da/d14/lca to da/d14/d62/dad/ddc/lea 0 2024-09-17T01:02:01.412 INFO:tasks.workunit.client.0.smithi002.stdout:5/588: rename d2/d2d/d10/d14/c45 to d2/d99/cb7 0 2024-09-17T01:02:01.412 INFO:tasks.workunit.client.0.smithi002.stdout:0/606: mknod dd/d19/cca 0 2024-09-17T01:02:01.413 INFO:tasks.workunit.client.0.smithi002.stdout:5/589: rename d2/d2d/d10/f66 to d2/d2d/d10/d14/d19/d39/d64/fb8 0 2024-09-17T01:02:01.415 INFO:tasks.workunit.client.0.smithi002.stdout:5/590: rename d2/d2d/d10/d14/d19/d39/d64/f70 to d2/fb9 0 2024-09-17T01:02:01.415 INFO:tasks.workunit.client.0.smithi002.stdout:5/591: chown d2/de/d1d/l3d 1817649385 1 2024-09-17T01:02:01.415 INFO:tasks.workunit.client.0.smithi002.stdout:5/592: chown d2/de/c87 19 1 2024-09-17T01:02:01.416 INFO:tasks.workunit.client.0.smithi002.stdout:5/593: rename d2/d2d/d10/d14/d7d to d2/d2d/d10/d14/d19/d39/d48/d9d/dba 0 2024-09-17T01:02:01.416 INFO:tasks.workunit.client.1.smithi099.stdout:1/763: unlink d0/d2/de/f27 0 2024-09-17T01:02:01.417 INFO:tasks.workunit.client.1.smithi099.stdout:1/764: stat d0/d8/d49/d4e/ff4 0 2024-09-17T01:02:01.417 INFO:tasks.workunit.client.0.smithi002.stdout:5/594: creat d2/de/d57/d80/fbb x:0 0 0 2024-09-17T01:02:01.417 INFO:tasks.workunit.client.0.smithi002.stdout:5/595: readlink d2/d2d/d10/d20/l55 0 2024-09-17T01:02:01.417 INFO:tasks.workunit.client.0.smithi002.stdout:5/596: write d2/d2d/d10/d14/f5d [869993,47281] 0 2024-09-17T01:02:01.419 INFO:tasks.workunit.client.1.smithi099.stdout:9/730: mkdir da/d21/deb 0 2024-09-17T01:02:01.421 INFO:tasks.workunit.client.1.smithi099.stdout:4/646: rename d7/dd/d21/d7b/cb9 to d7/dd/d21/d26/d3f/d5b/cdc 0 2024-09-17T01:02:01.421 INFO:tasks.workunit.client.1.smithi099.stdout:4/647: readlink d7/dd/d21/d7b/l66 0 2024-09-17T01:02:01.421 INFO:tasks.workunit.client.1.smithi099.stdout:4/648: write d7/dd/d21/d7b/fcc [3365699,90446] 0 2024-09-17T01:02:01.424 INFO:tasks.workunit.client.0.smithi002.stdout:9/598: write d5/f20 [2279548,45088] 0 2024-09-17T01:02:01.424 INFO:tasks.workunit.client.0.smithi002.stdout:9/599: creat d5/dc/d26/d46/d47/da1/fb3 x:0 0 0 2024-09-17T01:02:01.425 INFO:tasks.workunit.client.1.smithi099.stdout:1/765: rmdir d0/dbc 39 2024-09-17T01:02:01.426 INFO:tasks.workunit.client.1.smithi099.stdout:4/649: symlink d7/ldd 0 2024-09-17T01:02:01.428 INFO:tasks.workunit.client.1.smithi099.stdout:4/650: mkdir d7/dd/d21/d26/d3f/d5b/da4/dde 0 2024-09-17T01:02:01.429 INFO:tasks.workunit.client.1.smithi099.stdout:4/651: fdatasync d7/dd/de/d10/d6b/f8b 0 2024-09-17T01:02:01.429 INFO:tasks.workunit.client.1.smithi099.stdout:4/652: symlink d7/dd/de/d10/ldf 0 2024-09-17T01:02:01.430 INFO:tasks.workunit.client.1.smithi099.stdout:4/653: mkdir d7/dd/de/d10/d6b/d82/d8a/de0 0 2024-09-17T01:02:01.436 INFO:tasks.workunit.client.0.smithi002.stdout:0/607: read f1 [431696,77095] 0 2024-09-17T01:02:01.436 INFO:tasks.workunit.client.0.smithi002.stdout:0/608: creat dd/d19/d1a/d29/d55/fcb x:0 0 0 2024-09-17T01:02:01.438 INFO:tasks.workunit.client.0.smithi002.stdout:0/609: creat dd/fcc x:0 0 0 2024-09-17T01:02:01.443 INFO:tasks.workunit.client.0.smithi002.stdout:2/663: dwrite d1b/d37/d48/d52/db5/fd3 [0,4194304] 0 2024-09-17T01:02:01.443 INFO:tasks.workunit.client.0.smithi002.stdout:2/664: write d1b/d1d/f6e [3560557,38657] 0 2024-09-17T01:02:01.444 INFO:tasks.workunit.client.0.smithi002.stdout:8/809: dwrite d2/d3/d5f/d98/da5/d4f/d77/f8a [4194304,4194304] 0 2024-09-17T01:02:01.444 INFO:tasks.workunit.client.0.smithi002.stdout:8/810: readlink d2/d3/d5f/d47/d80/lf1 0 2024-09-17T01:02:01.444 INFO:tasks.workunit.client.0.smithi002.stdout:8/811: write d2/d3/d5f/d98/da5/d4f/fd8 [411362,78131] 0 2024-09-17T01:02:01.445 INFO:tasks.workunit.client.0.smithi002.stdout:2/665: mkdir d1b/d3f/d59/d7f/dc9/dac/dbd/dc3/def 0 2024-09-17T01:02:01.445 INFO:tasks.workunit.client.0.smithi002.stdout:2/666: truncate d1b/d1d/f4f 392635 0 2024-09-17T01:02:01.449 INFO:tasks.workunit.client.0.smithi002.stdout:6/648: sync 2024-09-17T01:02:01.449 INFO:tasks.workunit.client.1.smithi099.stdout:6/736: dwrite dc/d1a/f86 [0,4194304] 0 2024-09-17T01:02:01.450 INFO:tasks.workunit.client.1.smithi099.stdout:9/731: dwrite da/d56/d84/db9/fcb [0,4194304] 0 2024-09-17T01:02:01.450 INFO:tasks.workunit.client.1.smithi099.stdout:6/737: mknod dc/d1a/d49/d4c/cfe 0 2024-09-17T01:02:01.451 INFO:tasks.workunit.client.0.smithi002.stdout:6/649: link d2/d1d/d2d/d35/c4a d2/d1d/d2d/d5a/d71/cce 0 2024-09-17T01:02:01.451 INFO:tasks.workunit.client.0.smithi002.stdout:6/650: creat d2/d1d/d2d/d5a/d71/d7e/fcf x:0 0 0 2024-09-17T01:02:01.451 INFO:tasks.workunit.client.1.smithi099.stdout:1/766: dwrite d0/fc [4194304,4194304] 0 2024-09-17T01:02:01.451 INFO:tasks.workunit.client.1.smithi099.stdout:1/767: write d0/d2/f25 [4702144,80641] 0 2024-09-17T01:02:01.454 INFO:tasks.workunit.client.1.smithi099.stdout:9/732: mknod da/d14/d40/cec 0 2024-09-17T01:02:01.454 INFO:tasks.workunit.client.1.smithi099.stdout:9/733: read da/d21/d5b/fbc [206032,17382] 0 2024-09-17T01:02:01.455 INFO:tasks.workunit.client.0.smithi002.stdout:6/651: creat d2/d1d/d2d/d35/dc1/fd0 x:0 0 0 2024-09-17T01:02:01.455 INFO:tasks.workunit.client.1.smithi099.stdout:6/738: creat dc/df9/fff x:0 0 0 2024-09-17T01:02:01.458 INFO:tasks.workunit.client.1.smithi099.stdout:1/768: truncate d0/d2/de/d8b/f9a 3350977 0 2024-09-17T01:02:01.458 INFO:tasks.workunit.client.0.smithi002.stdout:6/652: creat d2/d1d/d2d/d35/d8d/d43/fd1 x:0 0 0 2024-09-17T01:02:01.459 INFO:tasks.workunit.client.1.smithi099.stdout:6/739: stat dc/c1d 0 2024-09-17T01:02:01.459 INFO:tasks.workunit.client.1.smithi099.stdout:6/740: read - dc/d27/dd7/ffb zero size 2024-09-17T01:02:01.460 INFO:tasks.workunit.client.0.smithi002.stdout:5/597: rmdir d2/d2d/d10/d14/d19/d39/d64 39 2024-09-17T01:02:01.461 INFO:tasks.workunit.client.0.smithi002.stdout:6/653: getdents d2/d1d/d26/d49 0 2024-09-17T01:02:01.461 INFO:tasks.workunit.client.0.smithi002.stdout:6/654: chown d2/d1d/d26/f2b 10 1 2024-09-17T01:02:01.461 INFO:tasks.workunit.client.0.smithi002.stdout:6/655: write d2/d1d/d2d/d5a/d71/d7e/fcf [987310,22928] 0 2024-09-17T01:02:01.461 INFO:tasks.workunit.client.0.smithi002.stdout:6/656: write d2/d1d/d26/f7a [738251,2637] 0 2024-09-17T01:02:01.462 INFO:tasks.workunit.client.0.smithi002.stdout:6/657: truncate d2/dc/d24/d53/d83/da9/d4c/fc5 226530 0 2024-09-17T01:02:01.462 INFO:tasks.workunit.client.1.smithi099.stdout:1/769: symlink d0/d8/d49/l102 0 2024-09-17T01:02:01.463 INFO:tasks.workunit.client.0.smithi002.stdout:2/667: dread f19 [4194304,4194304] 0 2024-09-17T01:02:01.463 INFO:tasks.workunit.client.0.smithi002.stdout:2/668: fdatasync d1b/d37/d48/d52/f5e 0 2024-09-17T01:02:01.463 INFO:tasks.workunit.client.0.smithi002.stdout:4/795: dread d7/d19/d9f/d80/d62/f31 [0,4194304] 0 2024-09-17T01:02:01.464 INFO:tasks.workunit.client.1.smithi099.stdout:6/741: mknod dc/d5d/dae/dd0/c100 0 2024-09-17T01:02:01.464 INFO:tasks.workunit.client.1.smithi099.stdout:6/742: fdatasync dc/d1a/d49/d4c/f6d 0 2024-09-17T01:02:01.465 INFO:tasks.workunit.client.0.smithi002.stdout:4/796: creat d7/de6/ff7 x:0 0 0 2024-09-17T01:02:01.466 INFO:tasks.workunit.client.0.smithi002.stdout:4/797: write d7/de/d3a/f5e [5315245,20506] 0 2024-09-17T01:02:01.466 INFO:tasks.workunit.client.1.smithi099.stdout:6/743: mkdir dc/d5d/dae/d96/dfd/d101 0 2024-09-17T01:02:01.469 INFO:tasks.workunit.client.1.smithi099.stdout:1/770: getdents d0/d8/d38/d56 0 2024-09-17T01:02:01.473 INFO:tasks.workunit.client.1.smithi099.stdout:6/744: rename dc/d1a/l91 to dc/d27/d58/d74/l102 0 2024-09-17T01:02:01.475 INFO:tasks.workunit.client.1.smithi099.stdout:6/745: truncate dc/d27/d7e/ff7 1334427 0 2024-09-17T01:02:01.475 INFO:tasks.workunit.client.1.smithi099.stdout:6/746: fsync dc/f36 0 2024-09-17T01:02:01.479 INFO:tasks.workunit.client.1.smithi099.stdout:6/747: unlink dc/f36 0 2024-09-17T01:02:01.481 INFO:tasks.workunit.client.0.smithi002.stdout:5/598: write d2/d2d/f13 [6706600,36987] 0 2024-09-17T01:02:01.481 INFO:tasks.workunit.client.0.smithi002.stdout:5/599: readlink d2/de/d1d/lb3 0 2024-09-17T01:02:01.482 INFO:tasks.workunit.client.0.smithi002.stdout:5/600: symlink d2/d2d/d10/d95/lbc 0 2024-09-17T01:02:01.483 INFO:tasks.workunit.client.0.smithi002.stdout:5/601: mknod d2/de/d57/d80/cbd 0 2024-09-17T01:02:01.484 INFO:tasks.workunit.client.0.smithi002.stdout:5/602: rmdir d2/d2d/d10/d14/d19/d39/d3f 39 2024-09-17T01:02:01.486 INFO:tasks.workunit.client.1.smithi099.stdout:6/748: write dc/d1a/d49/d4c/f5f [4492121,83172] 0 2024-09-17T01:02:01.488 INFO:tasks.workunit.client.0.smithi002.stdout:5/603: mknod d2/d2d/d10/d14/d59/cbe 0 2024-09-17T01:02:01.497 INFO:tasks.workunit.client.0.smithi002.stdout:5/604: dread d2/d2d/d10/d14/d19/d39/d48/d9d/dba/f8d [0,4194304] 0 2024-09-17T01:02:01.497 INFO:tasks.workunit.client.0.smithi002.stdout:5/605: creat d2/d2d/d10/d14/d19/d39/d48/d9d/dba/fbf x:0 0 0 2024-09-17T01:02:01.500 INFO:tasks.workunit.client.0.smithi002.stdout:2/669: dwrite f13 [0,4194304] 0 2024-09-17T01:02:01.503 INFO:tasks.workunit.client.0.smithi002.stdout:2/670: creat d1b/d37/d48/ff0 x:0 0 0 2024-09-17T01:02:01.503 INFO:tasks.workunit.client.0.smithi002.stdout:5/606: dread d2/d2d/d10/d14/d19/d39/d43/f2a [0,4194304] 0 2024-09-17T01:02:01.504 INFO:tasks.workunit.client.1.smithi099.stdout:1/771: dwrite d0/d2/f73 [0,4194304] 0 2024-09-17T01:02:01.504 INFO:tasks.workunit.client.1.smithi099.stdout:1/772: chown d0/d8/d38/d56/d93 1527 1 2024-09-17T01:02:01.505 INFO:tasks.workunit.client.0.smithi002.stdout:4/798: dwrite d7/d71/d8e/d95/fb0 [0,4194304] 0 2024-09-17T01:02:01.505 INFO:tasks.workunit.client.0.smithi002.stdout:4/799: write d7/f12 [2717386,3202] 0 2024-09-17T01:02:01.506 INFO:tasks.workunit.client.1.smithi099.stdout:6/749: dwrite dc/d2b/fd5 [0,4194304] 0 2024-09-17T01:02:01.506 INFO:tasks.workunit.client.1.smithi099.stdout:6/750: write dc/d27/d7e/f89 [4460634,86477] 0 2024-09-17T01:02:01.506 INFO:tasks.workunit.client.1.smithi099.stdout:6/751: dread - dc/d27/f81 zero size 2024-09-17T01:02:01.506 INFO:tasks.workunit.client.1.smithi099.stdout:6/752: chown dc/d27/fe2 0 1 2024-09-17T01:02:01.507 INFO:tasks.workunit.client.1.smithi099.stdout:1/773: mknod d0/d8/d49/c103 0 2024-09-17T01:02:01.507 INFO:tasks.workunit.client.1.smithi099.stdout:1/774: dread - d0/d8/d49/d4e/ff4 zero size 2024-09-17T01:02:01.507 INFO:tasks.workunit.client.1.smithi099.stdout:1/775: chown d0/d8/f65 13 1 2024-09-17T01:02:01.510 INFO:tasks.workunit.client.1.smithi099.stdout:1/776: rename d0/d8c/d9e to d0/de2/dfd/d104 0 2024-09-17T01:02:01.512 INFO:tasks.workunit.client.0.smithi002.stdout:2/671: read d1b/d3f/d59/d7f/dc9/dac/fbc [2947372,27619] 0 2024-09-17T01:02:01.513 INFO:tasks.workunit.client.0.smithi002.stdout:2/672: symlink d1b/d8a/d92/dae/dec/lf1 0 2024-09-17T01:02:01.516 INFO:tasks.workunit.client.0.smithi002.stdout:2/673: getdents d1b/d37/d48/d4e 0 2024-09-17T01:02:01.516 INFO:tasks.workunit.client.0.smithi002.stdout:2/674: fsync d1b/d37/f62 0 2024-09-17T01:02:01.516 INFO:tasks.workunit.client.0.smithi002.stdout:2/675: truncate d1b/d1d/d79/fbf 5716 0 2024-09-17T01:02:01.516 INFO:tasks.workunit.client.1.smithi099.stdout:1/777: mknod d0/d2/c105 0 2024-09-17T01:02:01.516 INFO:tasks.workunit.client.1.smithi099.stdout:6/753: dread dc/d27/d7e/f94 [0,4194304] 0 2024-09-17T01:02:01.518 INFO:tasks.workunit.client.0.smithi002.stdout:2/676: creat d1b/d37/d48/d52/de6/ff2 x:0 0 0 2024-09-17T01:02:01.518 INFO:tasks.workunit.client.1.smithi099.stdout:1/778: link d0/fc d0/dbc/f106 0 2024-09-17T01:02:01.518 INFO:tasks.workunit.client.1.smithi099.stdout:1/779: chown d0/d2/de/d70/cb1 3329700 1 2024-09-17T01:02:01.519 INFO:tasks.workunit.client.0.smithi002.stdout:4/800: read d7/de/f28 [1516413,56846] 0 2024-09-17T01:02:01.520 INFO:tasks.workunit.client.1.smithi099.stdout:6/754: rmdir dc/d27/dd7/dde/ddf 39 2024-09-17T01:02:01.521 INFO:tasks.workunit.client.0.smithi002.stdout:5/607: dwrite d2/d2d/d10/d20/d24/f2e [0,4194304] 0 2024-09-17T01:02:01.523 INFO:tasks.workunit.client.0.smithi002.stdout:5/608: creat d2/d2d/d10/d14/d19/da5/db0/fc0 x:0 0 0 2024-09-17T01:02:01.525 INFO:tasks.workunit.client.0.smithi002.stdout:5/609: creat d2/d2d/d10/d23/d6e/fc1 x:0 0 0 2024-09-17T01:02:01.526 INFO:tasks.workunit.client.0.smithi002.stdout:5/610: symlink d2/de/d1d/lc2 0 2024-09-17T01:02:01.527 INFO:tasks.workunit.client.0.smithi002.stdout:5/611: mknod d2/d99/cc3 0 2024-09-17T01:02:01.530 INFO:tasks.workunit.client.0.smithi002.stdout:5/612: dread d2/d2d/d10/f71 [0,4194304] 0 2024-09-17T01:02:01.531 INFO:tasks.workunit.client.1.smithi099.stdout:6/755: write dc/d5d/dae/f6a [6860428,42670] 0 2024-09-17T01:02:01.531 INFO:tasks.workunit.client.1.smithi099.stdout:6/756: write dc/fe [4323323,15173] 0 2024-09-17T01:02:01.532 INFO:tasks.workunit.client.0.smithi002.stdout:5/613: read d2/d2d/d10/f58 [684141,76930] 0 2024-09-17T01:02:01.533 INFO:tasks.workunit.client.0.smithi002.stdout:5/614: mkdir d2/d2d/d10/d14/d19/d39/dc4 0 2024-09-17T01:02:01.533 INFO:tasks.workunit.client.0.smithi002.stdout:5/615: chown d2/d2d/d10/d14/d19/da5/db0/fc0 2722 1 2024-09-17T01:02:01.534 INFO:tasks.workunit.client.0.smithi002.stdout:5/616: chown d2/d2d/d10/d14/d19/d39/f3c 87 1 2024-09-17T01:02:01.534 INFO:tasks.workunit.client.1.smithi099.stdout:6/757: rename dc/f18 to dc/d5d/d66/dbb/f103 0 2024-09-17T01:02:01.535 INFO:tasks.workunit.client.0.smithi002.stdout:5/617: mknod d2/d2d/d10/d14/d19/d39/d51/cc5 0 2024-09-17T01:02:01.536 INFO:tasks.workunit.client.0.smithi002.stdout:5/618: dread - d2/d2d/d10/d14/f88 zero size 2024-09-17T01:02:01.536 INFO:tasks.workunit.client.0.smithi002.stdout:2/677: write d1b/d3f/d59/f63 [3707043,64687] 0 2024-09-17T01:02:01.536 INFO:tasks.workunit.client.0.smithi002.stdout:2/678: truncate d1b/d37/d48/d52/db5/fdc 1444775 0 2024-09-17T01:02:01.537 INFO:tasks.workunit.client.0.smithi002.stdout:2/679: mkdir d1b/d8a/d92/dae/df3 0 2024-09-17T01:02:01.546 INFO:tasks.workunit.client.1.smithi099.stdout:1/780: dwrite d0/d8/d38/d56/f63 [0,4194304] 0 2024-09-17T01:02:01.549 INFO:tasks.workunit.client.0.smithi002.stdout:2/680: dread d1b/d37/f4d [0,4194304] 0 2024-09-17T01:02:01.549 INFO:tasks.workunit.client.0.smithi002.stdout:2/681: chown d1b/d1d/f6e 5473 1 2024-09-17T01:02:01.550 INFO:tasks.workunit.client.1.smithi099.stdout:1/781: symlink d0/db6/l107 0 2024-09-17T01:02:01.551 INFO:tasks.workunit.client.0.smithi002.stdout:2/682: link d1b/d1d/f33 d1b/d8a/ff4 0 2024-09-17T01:02:01.551 INFO:tasks.workunit.client.0.smithi002.stdout:2/683: read d1b/d37/f4d [3986842,28051] 0 2024-09-17T01:02:01.552 INFO:tasks.workunit.client.1.smithi099.stdout:1/782: mknod d0/db6/c108 0 2024-09-17T01:02:01.552 INFO:tasks.workunit.client.1.smithi099.stdout:1/783: stat d0/d8/d38/d8a/dd0/ddc/dfc 0 2024-09-17T01:02:01.552 INFO:tasks.workunit.client.1.smithi099.stdout:1/784: mkdir d0/d2/dd8/d109 0 2024-09-17T01:02:01.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/619: dwrite d2/fb9 [0,4194304] 0 2024-09-17T01:02:01.553 INFO:tasks.workunit.client.0.smithi002.stdout:2/684: rename d1b/d37/f42 to d1b/d1d/dd4/ff5 0 2024-09-17T01:02:01.554 INFO:tasks.workunit.client.0.smithi002.stdout:4/801: dwrite d7/d19/fe4 [4194304,4194304] 0 2024-09-17T01:02:01.555 INFO:tasks.workunit.client.0.smithi002.stdout:5/620: rmdir d2/d2d 39 2024-09-17T01:02:01.557 INFO:tasks.workunit.client.1.smithi099.stdout:1/785: symlink d0/d8/d49/d94/d4b/d59/db9/l10a 0 2024-09-17T01:02:01.557 INFO:tasks.workunit.client.0.smithi002.stdout:4/802: mkdir d7/d19/d9c/de9/df8 0 2024-09-17T01:02:01.558 INFO:tasks.workunit.client.1.smithi099.stdout:1/786: dread d0/d8/d38/d56/d93/fec [0,4194304] 0 2024-09-17T01:02:01.561 INFO:tasks.workunit.client.0.smithi002.stdout:5/621: dread d2/d2d/d10/d14/d19/d39/d48/d9d/dba/f8d [0,4194304] 0 2024-09-17T01:02:01.561 INFO:tasks.workunit.client.0.smithi002.stdout:5/622: chown d2/fb9 1 1 2024-09-17T01:02:01.563 INFO:tasks.workunit.client.1.smithi099.stdout:6/758: dwrite dc/d1a/d49/da8/fd6 [0,4194304] 0 2024-09-17T01:02:01.563 INFO:tasks.workunit.client.1.smithi099.stdout:1/787: dread d0/d8/d49/d94/f72 [0,4194304] 0 2024-09-17T01:02:01.563 INFO:tasks.workunit.client.1.smithi099.stdout:1/788: stat d0/d8/d38/d56/ff2 0 2024-09-17T01:02:01.565 INFO:tasks.workunit.client.1.smithi099.stdout:6/759: rename dc/d1a/l35 to dc/d5d/dae/d96/dfd/d101/l104 0 2024-09-17T01:02:01.565 INFO:tasks.workunit.client.1.smithi099.stdout:6/760: creat dc/d27/dd7/dde/ddf/de9/f105 x:0 0 0 2024-09-17T01:02:01.567 INFO:tasks.workunit.client.1.smithi099.stdout:1/789: rename d0/d2/de/d31/c39 to d0/d8/d49/d94/de0/de6/c10b 0 2024-09-17T01:02:01.568 INFO:tasks.workunit.client.1.smithi099.stdout:6/761: mkdir dc/d5d/dae/d96/d60/d106 0 2024-09-17T01:02:01.569 INFO:tasks.workunit.client.1.smithi099.stdout:1/790: mkdir d0/de2/dfd/d10c 0 2024-09-17T01:02:01.571 INFO:tasks.workunit.client.1.smithi099.stdout:1/791: unlink d0/f7b 0 2024-09-17T01:02:01.578 INFO:tasks.workunit.client.0.smithi002.stdout:2/685: dwrite d1b/d3f/d59/d7f/dc9/dac/fd8 [0,4194304] 0 2024-09-17T01:02:01.580 INFO:tasks.workunit.client.0.smithi002.stdout:2/686: mknod d1b/d37/d48/d4e/cf6 0 2024-09-17T01:02:01.581 INFO:tasks.workunit.client.1.smithi099.stdout:1/792: write d0/d8/d49/d4e/f6d [2617726,119850] 0 2024-09-17T01:02:01.582 INFO:tasks.workunit.client.0.smithi002.stdout:2/687: creat d1b/d37/d48/d4e/dc5/ff7 x:0 0 0 2024-09-17T01:02:01.582 INFO:tasks.workunit.client.0.smithi002.stdout:2/688: stat d1b/d37/d48/d52/f5e 0 2024-09-17T01:02:01.582 INFO:tasks.workunit.client.0.smithi002.stdout:2/689: chown d1b/d3f/c4a 12136604 1 2024-09-17T01:02:01.582 INFO:tasks.workunit.client.0.smithi002.stdout:2/690: fdatasync ff 0 2024-09-17T01:02:01.583 INFO:tasks.workunit.client.0.smithi002.stdout:2/691: creat d1b/d3f/d59/d7f/dc9/dac/ff8 x:0 0 0 2024-09-17T01:02:01.583 INFO:tasks.workunit.client.1.smithi099.stdout:1/793: dread d0/d8/d38/d56/d93/fec [0,4194304] 0 2024-09-17T01:02:01.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.586+0000 7f16a01c4640 1 -- 172.21.15.2:0/1524973224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1698117740 con 0x7f169806e540 2024-09-17T01:02:01.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.587+0000 7f168a7fc640 1 -- 172.21.15.2:0/1524973224 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f168c05acc0 con 0x7f169806e540 2024-09-17T01:02:01.585 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:02:01.585 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:02:01.585 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T01:02:01.585 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:02:01.585 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:02:01.585 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T01:02:01.585 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:02:01.585 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:02:01.586 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T01:02:01.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:02:01.586 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:02:01.586 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:02:01.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:02:01.586 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:02:01.586 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 14 2024-09-17T01:02:01.586 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:02:01.586 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:02:01.588 INFO:tasks.workunit.client.0.smithi002.stdout:4/803: dwrite d7/d3f/da9/fbc [0,4194304] 0 2024-09-17T01:02:01.588 INFO:tasks.workunit.client.0.smithi002.stdout:4/804: write d7/de/d3a/d99/fbf [4271128,64236] 0 2024-09-17T01:02:01.588 INFO:tasks.workunit.client.0.smithi002.stdout:4/805: truncate d7/de6/ff7 712930 0 2024-09-17T01:02:01.588 INFO:tasks.workunit.client.0.smithi002.stdout:4/806: write d7/d19/d2e/f33 [5229024,29557] 0 2024-09-17T01:02:01.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.590+0000 7f16a01c4640 1 -- 172.21.15.2:0/1524973224 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f168406eb40 msgr2=0x7f1684070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:01.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.590+0000 7f16a01c4640 1 --2- 172.21.15.2:0/1524973224 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f168406eb40 0x7f1684070ff0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f169402a530 tx=0x7f1694009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.590+0000 7f16a01c4640 1 -- 172.21.15.2:0/1524973224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f169806e540 msgr2=0x7f1698115df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:01.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.590+0000 7f16a01c4640 1 --2- 172.21.15.2:0/1524973224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f169806e540 0x7f1698115df0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c810 tx=0x7f168c0043c0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.591+0000 7f16a01c4640 1 -- 172.21.15.2:0/1524973224 shutdown_connections 2024-09-17T01:02:01.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.591+0000 7f16a01c4640 1 --2- 172.21.15.2:0/1524973224 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f168406eb40 0x7f1684070ff0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.591+0000 7f16a01c4640 1 --2- 172.21.15.2:0/1524973224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f169806e540 0x7f1698115df0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.591+0000 7f16a01c4640 1 --2- 172.21.15.2:0/1524973224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f169806dbf0 0x7f16981158b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.591+0000 7f16a01c4640 1 -- 172.21.15.2:0/1524973224 >> 172.21.15.2:0/1524973224 conn(0x7f1698069560 msgr2=0x7f1698108ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:01.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.591+0000 7f16a01c4640 1 -- 172.21.15.2:0/1524973224 shutdown_connections 2024-09-17T01:02:01.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.591+0000 7f16a01c4640 1 -- 172.21.15.2:0/1524973224 wait complete. 2024-09-17T01:02:01.592 INFO:tasks.workunit.client.0.smithi002.stdout:4/807: mknod d7/d71/cf9 0 2024-09-17T01:02:01.593 INFO:tasks.workunit.client.0.smithi002.stdout:4/808: truncate d7/de/d3a/f3c 2498255 0 2024-09-17T01:02:01.593 INFO:tasks.workunit.client.0.smithi002.stdout:4/809: write d7/d19/d9f/d80/d62/d52/dc7/d77/d9b/f57 [2964393,46169] 0 2024-09-17T01:02:01.593 INFO:tasks.workunit.client.1.smithi099.stdout:5/693: sync 2024-09-17T01:02:01.593 INFO:tasks.workunit.client.1.smithi099.stdout:3/670: sync 2024-09-17T01:02:01.595 INFO:tasks.workunit.client.1.smithi099.stdout:3/671: mknod d9/d15/d18/d1a/d23/d4c/cd0 0 2024-09-17T01:02:01.596 INFO:tasks.workunit.client.1.smithi099.stdout:5/694: symlink d2/dc4/le3 0 2024-09-17T01:02:01.596 INFO:tasks.workunit.client.0.smithi002.stdout:2/692: read d1b/d37/f91 [2398148,99644] 0 2024-09-17T01:02:01.596 INFO:tasks.workunit.client.0.smithi002.stdout:2/693: chown fe 1653 1 2024-09-17T01:02:01.596 INFO:tasks.workunit.client.0.smithi002.stdout:5/623: dwrite d2/d2d/d10/d20/f7e [0,4194304] 0 2024-09-17T01:02:01.597 INFO:tasks.workunit.client.1.smithi099.stdout:3/672: symlink d9/d3b/d44/ld1 0 2024-09-17T01:02:01.597 INFO:tasks.workunit.client.1.smithi099.stdout:3/673: truncate d9/d3b/db2/fa4 5163643 0 2024-09-17T01:02:01.598 INFO:tasks.workunit.client.1.smithi099.stdout:3/674: rename d9/d15/f59 to d9/d15/d18/d1a/d23/fd2 0 2024-09-17T01:02:01.598 INFO:tasks.workunit.client.1.smithi099.stdout:3/675: write d9/d15/d18/d1a/d23/d5c/d6e/f96 [1663789,26346] 0 2024-09-17T01:02:01.598 INFO:tasks.workunit.client.1.smithi099.stdout:3/676: chown d9/d15/d18/d1a/d23/d5c/fa1 61491486 1 2024-09-17T01:02:01.599 INFO:tasks.workunit.client.1.smithi099.stdout:3/677: getdents d9/d3b/db2 0 2024-09-17T01:02:01.600 INFO:tasks.workunit.client.1.smithi099.stdout:3/678: creat d9/fd3 x:0 0 0 2024-09-17T01:02:01.602 INFO:tasks.workunit.client.1.smithi099.stdout:3/679: rename d9/d15/d18/d1a/d23/d5c/d99/fc1 to d9/d15/d18/d1a/d23/d5c/d6e/d7e/fd4 0 2024-09-17T01:02:01.602 INFO:tasks.workunit.client.1.smithi099.stdout:3/680: readlink d9/d3b/d44/ld1 0 2024-09-17T01:02:01.603 INFO:tasks.workunit.client.0.smithi002.stdout:4/810: write d7/d19/d9f/d80/fcb [2772808,33011] 0 2024-09-17T01:02:01.603 INFO:tasks.workunit.client.1.smithi099.stdout:6/762: dwrite dc/fe [4194304,4194304] 0 2024-09-17T01:02:01.603 INFO:tasks.workunit.client.1.smithi099.stdout:6/763: chown dc/df9 638 1 2024-09-17T01:02:01.604 INFO:tasks.workunit.client.1.smithi099.stdout:3/681: symlink d9/d15/d18/d1a/d23/d4c/ld5 0 2024-09-17T01:02:01.604 INFO:tasks.workunit.client.0.smithi002.stdout:5/624: rename d2/d2d/d10/d20/f3e to d2/d2d/d10/d23/d6a/fc6 0 2024-09-17T01:02:01.605 INFO:tasks.workunit.client.1.smithi099.stdout:6/764: symlink dc/d1a/l107 0 2024-09-17T01:02:01.605 INFO:tasks.workunit.client.1.smithi099.stdout:1/794: dwrite d0/d8/dbf/ff9 [0,4194304] 0 2024-09-17T01:02:01.605 INFO:tasks.workunit.client.1.smithi099.stdout:3/682: dread d9/d15/d8f/f9f [0,4194304] 0 2024-09-17T01:02:01.605 INFO:tasks.workunit.client.1.smithi099.stdout:3/683: fsync d9/f7a 0 2024-09-17T01:02:01.606 INFO:tasks.workunit.client.0.smithi002.stdout:5/625: unlink d2/d2d/d10/d14/d19/d39/d97/fb4 0 2024-09-17T01:02:01.607 INFO:tasks.workunit.client.1.smithi099.stdout:6/765: getdents dc/d27/dd7/d87/db6 0 2024-09-17T01:02:01.607 INFO:tasks.workunit.client.1.smithi099.stdout:6/766: stat dc/df9/fff 0 2024-09-17T01:02:01.607 INFO:tasks.workunit.client.1.smithi099.stdout:6/767: chown dc/d27/dd7/d87/db6/fb7 546 1 2024-09-17T01:02:01.607 INFO:tasks.workunit.client.0.smithi002.stdout:5/626: symlink d2/lc7 0 2024-09-17T01:02:01.608 INFO:tasks.workunit.client.1.smithi099.stdout:6/768: mkdir dc/d27/dd7/dde/ddf/d108 0 2024-09-17T01:02:01.610 INFO:tasks.workunit.client.1.smithi099.stdout:5/695: dread d2/dc4/d90/da4/f54 [0,4194304] 0 2024-09-17T01:02:01.611 INFO:tasks.workunit.client.1.smithi099.stdout:3/684: fsync d9/d15/d18/d1a/d23/d5c/d6e/f96 0 2024-09-17T01:02:01.612 INFO:tasks.workunit.client.1.smithi099.stdout:5/696: mkdir d2/de4 0 2024-09-17T01:02:01.612 INFO:tasks.workunit.client.1.smithi099.stdout:5/697: truncate d2/dc/d17/d3c/db3/fdf 9392 0 2024-09-17T01:02:01.615 INFO:tasks.workunit.client.0.smithi002.stdout:7/680: sync 2024-09-17T01:02:01.615 INFO:tasks.workunit.client.0.smithi002.stdout:1/647: sync 2024-09-17T01:02:01.616 INFO:tasks.workunit.client.0.smithi002.stdout:7/681: mkdir d1/d14/d1d/d28/d40/ddd 0 2024-09-17T01:02:01.618 INFO:tasks.workunit.client.0.smithi002.stdout:7/682: mknod d1/d24/cde 0 2024-09-17T01:02:01.621 INFO:tasks.workunit.client.1.smithi099.stdout:3/685: getdents d9/d15/d18/d1a/d23/d4c 0 2024-09-17T01:02:01.621 INFO:tasks.workunit.client.1.smithi099.stdout:3/686: chown d9/d15/d18/d1a/d23/d5c/d99/dbb/cb6 0 1 2024-09-17T01:02:01.622 INFO:tasks.workunit.client.0.smithi002.stdout:4/811: dwrite d7/d71/d8e/dd0/f81 [0,4194304] 0 2024-09-17T01:02:01.622 INFO:tasks.workunit.client.0.smithi002.stdout:4/812: chown d7/d19/d9c/de9/da4/dd7 23503 1 2024-09-17T01:02:01.622 INFO:tasks.workunit.client.1.smithi099.stdout:1/795: dread d0/d8/d49/d94/d4b/d59/f87 [0,4194304] 0 2024-09-17T01:02:01.624 INFO:tasks.workunit.client.1.smithi099.stdout:1/796: getdents d0/d8/d38/d75 0 2024-09-17T01:02:01.625 INFO:tasks.workunit.client.0.smithi002.stdout:4/813: mkdir d7/d19/d4a/dfa 0 2024-09-17T01:02:01.625 INFO:tasks.workunit.client.0.smithi002.stdout:5/627: write d2/fb9 [764403,77963] 0 2024-09-17T01:02:01.626 INFO:tasks.workunit.client.1.smithi099.stdout:1/797: getdents d0/d8/d49/d94/de0/dba 0 2024-09-17T01:02:01.626 INFO:tasks.workunit.client.1.smithi099.stdout:1/798: dread - d0/d2/fed zero size 2024-09-17T01:02:01.626 INFO:tasks.workunit.client.1.smithi099.stdout:1/799: fdatasync d0/d8/d38/d75/f9b 0 2024-09-17T01:02:01.626 INFO:tasks.workunit.client.1.smithi099.stdout:1/800: read d0/d8/d38/d75/f9b [343523,123728] 0 2024-09-17T01:02:01.626 INFO:tasks.workunit.client.0.smithi002.stdout:2/694: dwrite d1b/d3f/d59/d7f/dc9/fa6 [0,4194304] 0 2024-09-17T01:02:01.626 INFO:tasks.workunit.client.0.smithi002.stdout:4/814: getdents d7/d71/d8e/dd0/d89 0 2024-09-17T01:02:01.629 INFO:tasks.workunit.client.0.smithi002.stdout:1/648: dread d4/d11/d1a/f29 [0,4194304] 0 2024-09-17T01:02:01.631 INFO:tasks.workunit.client.1.smithi099.stdout:1/801: dread d0/d2/de/f15 [0,4194304] 0 2024-09-17T01:02:01.632 INFO:tasks.workunit.client.0.smithi002.stdout:7/683: write d1/d14/d1d/d28/d8f/fa2 [1607392,90212] 0 2024-09-17T01:02:01.632 INFO:tasks.workunit.client.0.smithi002.stdout:4/815: dread d7/d19/d9f/d80/d62/f6a [0,4194304] 0 2024-09-17T01:02:01.632 INFO:tasks.workunit.client.0.smithi002.stdout:7/684: creat d1/d14/d1d/d28/d6b/fdf x:0 0 0 2024-09-17T01:02:01.632 INFO:tasks.workunit.client.0.smithi002.stdout:7/685: write d1/d14/d67/dc0/dcd/f76 [527989,55133] 0 2024-09-17T01:02:01.632 INFO:tasks.workunit.client.0.smithi002.stdout:1/649: symlink d4/d11/d1a/daa/ldc 0 2024-09-17T01:02:01.638 INFO:tasks.workunit.client.0.smithi002.stdout:1/650: read d4/d11/d12/d14/d17/d3b/f42 [514574,123942] 0 2024-09-17T01:02:01.638 INFO:tasks.workunit.client.0.smithi002.stdout:1/651: chown d4/d11/d12/d30/d43/f4d 30388674 1 2024-09-17T01:02:01.638 INFO:tasks.workunit.client.0.smithi002.stdout:4/816: link d7/de/f79 d7/d19/d4a/dfa/ffb 0 2024-09-17T01:02:01.638 INFO:tasks.workunit.client.0.smithi002.stdout:4/817: creat d7/d3f/ffc x:0 0 0 2024-09-17T01:02:01.643 INFO:tasks.workunit.client.0.smithi002.stdout:1/652: mknod d4/d11/d12/d14/d17/cdd 0 2024-09-17T01:02:01.643 INFO:tasks.workunit.client.0.smithi002.stdout:2/695: dread d1b/d37/d48/d4e/f90 [0,4194304] 0 2024-09-17T01:02:01.647 INFO:tasks.workunit.client.1.smithi099.stdout:3/687: dwrite d9/d3b/d44/f67 [4194304,4194304] 0 2024-09-17T01:02:01.649 INFO:tasks.workunit.client.0.smithi002.stdout:4/818: rename d7/d19/d9c/de9/ce2 to d7/d19/d9f/d80/d62/cfd 0 2024-09-17T01:02:01.650 INFO:tasks.workunit.client.0.smithi002.stdout:4/819: readlink d7/d19/d9f/d80/d62/d52/dc7/d77/d9b/l7d 0 2024-09-17T01:02:01.654 INFO:tasks.workunit.client.0.smithi002.stdout:1/653: rename d4/d11/d55/d7a/f9a to d4/d11/d55/dbc/fde 0 2024-09-17T01:02:01.654 INFO:tasks.workunit.client.0.smithi002.stdout:1/654: dread - d4/d11/d1a/daa/dc2/fcd zero size 2024-09-17T01:02:01.654 INFO:tasks.workunit.client.0.smithi002.stdout:1/655: chown d4/d11/d55/c57 558 1 2024-09-17T01:02:01.654 INFO:tasks.workunit.client.0.smithi002.stdout:1/656: dread - d4/d11/d12/d14/d17/d40/f6d zero size 2024-09-17T01:02:01.654 INFO:tasks.workunit.client.0.smithi002.stdout:1/657: chown d4/d22/c5a 8201544 1 2024-09-17T01:02:01.655 INFO:tasks.workunit.client.0.smithi002.stdout:4/820: mknod d7/d71/cfe 0 2024-09-17T01:02:01.656 INFO:tasks.workunit.client.0.smithi002.stdout:2/696: getdents d1b/d8a/d92/dae 0 2024-09-17T01:02:01.656 INFO:tasks.workunit.client.1.smithi099.stdout:3/688: dread d9/d3b/f62 [4194304,4194304] 0 2024-09-17T01:02:01.657 INFO:tasks.workunit.client.0.smithi002.stdout:1/658: readlink d4/l5 0 2024-09-17T01:02:01.657 INFO:tasks.workunit.client.1.smithi099.stdout:3/689: symlink d9/ld6 0 2024-09-17T01:02:01.658 INFO:tasks.workunit.client.1.smithi099.stdout:3/690: mknod d9/d15/d18/d1a/cd7 0 2024-09-17T01:02:01.658 INFO:tasks.workunit.client.1.smithi099.stdout:3/691: rmdir d9/d3b/db2 39 2024-09-17T01:02:01.659 INFO:tasks.workunit.client.0.smithi002.stdout:4/821: link d7/de/d3a/lb9 d7/d19/d9f/d80/d62/d52/lff 0 2024-09-17T01:02:01.659 INFO:tasks.workunit.client.0.smithi002.stdout:4/822: chown d7/de/d32/f73 467649561 1 2024-09-17T01:02:01.659 INFO:tasks.workunit.client.0.smithi002.stdout:4/823: stat d7/d19/d2e/l85 0 2024-09-17T01:02:01.660 INFO:tasks.workunit.client.1.smithi099.stdout:3/692: mkdir d9/d15/d18/d1a/d23/d5c/d99/dd8 0 2024-09-17T01:02:01.661 INFO:tasks.workunit.client.0.smithi002.stdout:1/659: symlink d4/d11/d12/d30/d43/dd7/ldf 0 2024-09-17T01:02:01.661 INFO:tasks.workunit.client.1.smithi099.stdout:5/698: dwrite d2/dc/d14/f20 [0,4194304] 0 2024-09-17T01:02:01.661 INFO:tasks.workunit.client.1.smithi099.stdout:3/693: mknod d9/d15/d18/d1a/d23/cd9 0 2024-09-17T01:02:01.662 INFO:tasks.workunit.client.1.smithi099.stdout:1/802: dwrite d0/d8/d38/d8a/dd0/ddc/ffa [0,4194304] 0 2024-09-17T01:02:01.662 INFO:tasks.workunit.client.1.smithi099.stdout:1/803: creat d0/d8/dbf/f10d x:0 0 0 2024-09-17T01:02:01.663 INFO:tasks.workunit.client.1.smithi099.stdout:5/699: creat d2/dc4/dad/fe5 x:0 0 0 2024-09-17T01:02:01.664 INFO:tasks.workunit.client.0.smithi002.stdout:5/628: dwrite d2/de/f4f [0,4194304] 0 2024-09-17T01:02:01.665 INFO:tasks.workunit.client.0.smithi002.stdout:7/686: dwrite d1/d14/d67/dc0/dcd/fdc [0,4194304] 0 2024-09-17T01:02:01.665 INFO:tasks.workunit.client.0.smithi002.stdout:7/687: write d1/d14/d1d/d28/d86/fd9 [682622,94569] 0 2024-09-17T01:02:01.670 INFO:tasks.workunit.client.1.smithi099.stdout:1/804: creat d0/d2/de/d31/f10e x:0 0 0 2024-09-17T01:02:01.671 INFO:tasks.workunit.client.1.smithi099.stdout:1/805: read - d0/d2/de/d8b/da7/fe5 zero size 2024-09-17T01:02:01.671 INFO:tasks.workunit.client.1.smithi099.stdout:5/700: mknod d2/dc4/d90/da4/ce6 0 2024-09-17T01:02:01.671 INFO:tasks.workunit.client.1.smithi099.stdout:5/701: write d2/dc/f93 [147352,8575] 0 2024-09-17T01:02:01.673 INFO:tasks.workunit.client.1.smithi099.stdout:3/694: rename d9/d2b/d52 to d9/d15/d18/d1a/d23/d5c/d99/dda 0 2024-09-17T01:02:01.673 INFO:tasks.workunit.client.1.smithi099.stdout:3/695: chown d9/d15/d18/d1a/d23/d5c/d99/dda/db5/dca 2158 1 2024-09-17T01:02:01.673 INFO:tasks.workunit.client.0.smithi002.stdout:7/688: mkdir d1/d14/d1d/d28/d8f/de0 0 2024-09-17T01:02:01.673 INFO:tasks.workunit.client.0.smithi002.stdout:7/689: write d1/d14/d67/dc0/dcd/f63 [1116477,101566] 0 2024-09-17T01:02:01.675 INFO:tasks.workunit.client.1.smithi099.stdout:5/702: mkdir d2/dc4/d90/de7 0 2024-09-17T01:02:01.678 INFO:tasks.workunit.client.1.smithi099.stdout:3/696: rename d9/d15/d18/d1a/d23/d5c/d6e/fa9 to d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/fdb 0 2024-09-17T01:02:01.679 INFO:tasks.workunit.client.0.smithi002.stdout:2/697: dwrite d1b/d8a/f8c [0,4194304] 0 2024-09-17T01:02:01.679 INFO:tasks.workunit.client.0.smithi002.stdout:2/698: creat d1b/d1d/dc8/ff9 x:0 0 0 2024-09-17T01:02:01.681 INFO:tasks.workunit.client.1.smithi099.stdout:3/697: rmdir d9/d3b/db2/daf/dc5 0 2024-09-17T01:02:01.681 INFO:tasks.workunit.client.0.smithi002.stdout:2/699: mkdir d1b/d3f/d59/dfa 0 2024-09-17T01:02:01.681 INFO:tasks.workunit.client.0.smithi002.stdout:2/700: stat d1b/d3f/d59/cb8 0 2024-09-17T01:02:01.682 INFO:tasks.workunit.client.1.smithi099.stdout:3/698: write d9/d15/d18/d1a/d23/f68 [795070,8368] 0 2024-09-17T01:02:01.683 INFO:tasks.workunit.client.0.smithi002.stdout:2/701: mknod d1b/d3f/cfb 0 2024-09-17T01:02:01.685 INFO:tasks.workunit.client.0.smithi002.stdout:2/702: creat d1b/d3f/d59/d7f/dc9/dac/dbd/ffc x:0 0 0 2024-09-17T01:02:01.688 INFO:tasks.workunit.client.0.smithi002.stdout:2/703: mknod d1b/d3f/d59/d7f/dc9/d72/dda/cfd 0 2024-09-17T01:02:01.690 INFO:tasks.workunit.client.0.smithi002.stdout:2/704: getdents d1b/d37/d48 0 2024-09-17T01:02:01.690 INFO:tasks.workunit.client.0.smithi002.stdout:2/705: fdatasync d1b/d1d/d79/fd9 0 2024-09-17T01:02:01.690 INFO:tasks.workunit.client.0.smithi002.stdout:2/706: write d1b/d37/d48/d4e/f90 [5221281,5685] 0 2024-09-17T01:02:01.692 INFO:tasks.workunit.client.0.smithi002.stdout:2/707: creat d1b/d3f/d59/d7f/ffe x:0 0 0 2024-09-17T01:02:01.693 INFO:tasks.workunit.client.0.smithi002.stdout:2/708: truncate d1b/d37/d48/d52/f5d 3531603 0 2024-09-17T01:02:01.694 INFO:tasks.workunit.client.0.smithi002.stdout:2/709: creat d1b/d1d/dd4/fff x:0 0 0 2024-09-17T01:02:01.694 INFO:tasks.workunit.client.0.smithi002.stdout:2/710: write d1b/d1d/f6e [229528,2148] 0 2024-09-17T01:02:01.694 INFO:tasks.workunit.client.1.smithi099.stdout:3/699: write d9/d3b/d44/f67 [3672931,110092] 0 2024-09-17T01:02:01.695 INFO:tasks.workunit.client.1.smithi099.stdout:3/700: fdatasync d9/d15/fb8 0 2024-09-17T01:02:01.695 INFO:tasks.workunit.client.1.smithi099.stdout:1/806: dwrite d0/d8/d49/f4c [0,4194304] 0 2024-09-17T01:02:01.695 INFO:tasks.workunit.client.0.smithi002.stdout:2/711: read d1b/d37/d48/d52/de6/f8d [607101,1429] 0 2024-09-17T01:02:01.695 INFO:tasks.workunit.client.1.smithi099.stdout:1/807: symlink d0/d8/d49/d94/l10f 0 2024-09-17T01:02:01.697 INFO:tasks.workunit.client.1.smithi099.stdout:3/701: read d9/d15/d8f/fac [697305,96298] 0 2024-09-17T01:02:01.697 INFO:tasks.workunit.client.1.smithi099.stdout:1/808: creat d0/d8/d38/d8a/dd0/ddc/dfc/f110 x:0 0 0 2024-09-17T01:02:01.698 INFO:tasks.workunit.client.1.smithi099.stdout:3/702: chown d9/d15/d18/d1a/d23/f43 11893 1 2024-09-17T01:02:01.698 INFO:tasks.workunit.client.1.smithi099.stdout:1/809: truncate d0/d8/fbe 772689 0 2024-09-17T01:02:01.698 INFO:tasks.workunit.client.1.smithi099.stdout:1/810: chown d0/d2/de/d8b/f9a 3503506 1 2024-09-17T01:02:01.699 INFO:tasks.workunit.client.1.smithi099.stdout:1/811: truncate d0/d8c/ff6 145074 0 2024-09-17T01:02:01.700 INFO:tasks.workunit.client.0.smithi002.stdout:7/690: read d1/d14/d1d/d28/d40/d58/f62 [2562258,70647] 0 2024-09-17T01:02:01.701 INFO:tasks.workunit.client.0.smithi002.stdout:7/691: symlink d1/d14/d67/le1 0 2024-09-17T01:02:01.702 INFO:tasks.workunit.client.0.smithi002.stdout:7/692: write d1/d14/d67/dc0/fda [894868,86013] 0 2024-09-17T01:02:01.702 INFO:tasks.workunit.client.0.smithi002.stdout:7/693: chown d1/d14/d1d/d28/d40/lc6 6730013 1 2024-09-17T01:02:01.702 INFO:tasks.workunit.client.0.smithi002.stdout:7/694: fdatasync d1/d14/d1d/d28/d6b/d9e/d54/fbe 0 2024-09-17T01:02:01.703 INFO:tasks.workunit.client.0.smithi002.stdout:7/695: link d1/d14/d1d/d28/d6b/d9e/d5e/fcc d1/d14/d1d/fe2 0 2024-09-17T01:02:01.707 INFO:tasks.workunit.client.0.smithi002.stdout:7/696: dread d1/d14/d1d/d29/f2f [0,4194304] 0 2024-09-17T01:02:01.708 INFO:tasks.workunit.client.0.smithi002.stdout:7/697: truncate d1/d14/d1d/d28/d86/f97 3176097 0 2024-09-17T01:02:01.708 INFO:tasks.workunit.client.1.smithi099.stdout:3/703: dread d9/d2b/fb0 [0,4194304] 0 2024-09-17T01:02:01.709 INFO:tasks.workunit.client.0.smithi002.stdout:7/698: link d1/c78 d1/d14/d1d/d28/d8f/de0/ce3 0 2024-09-17T01:02:01.709 INFO:tasks.workunit.client.0.smithi002.stdout:7/699: chown d1/d14/d1d/d28/d2d/c96 18207 1 2024-09-17T01:02:01.709 INFO:tasks.workunit.client.0.smithi002.stdout:7/700: readlink d1/d14/d1d/d28/d6b/d9e/d54/lc4 0 2024-09-17T01:02:01.709 INFO:tasks.workunit.client.0.smithi002.stdout:7/701: fsync d1/fd7 0 2024-09-17T01:02:01.710 INFO:tasks.workunit.client.1.smithi099.stdout:3/704: symlink d9/d15/d18/d1a/d23/d5c/d99/dd8/ldc 0 2024-09-17T01:02:01.712 INFO:tasks.workunit.client.1.smithi099.stdout:5/703: dwrite d2/dc/d14/d89/fd5 [0,4194304] 0 2024-09-17T01:02:01.712 INFO:tasks.workunit.client.0.smithi002.stdout:4/824: dwrite d7/d19/f21 [4194304,4194304] 0 2024-09-17T01:02:01.712 INFO:tasks.workunit.client.0.smithi002.stdout:1/660: dwrite d4/d11/f15 [0,4194304] 0 2024-09-17T01:02:01.712 INFO:tasks.workunit.client.0.smithi002.stdout:1/661: fsync d4/d11/d12/d14/d17/d40/f6d 0 2024-09-17T01:02:01.714 INFO:tasks.workunit.client.1.smithi099.stdout:5/704: mknod d2/dc/ce8 0 2024-09-17T01:02:01.714 INFO:tasks.workunit.client.1.smithi099.stdout:5/705: write d2/d45/fa7 [698639,82326] 0 2024-09-17T01:02:01.714 INFO:tasks.workunit.client.1.smithi099.stdout:5/706: read - d2/dc4/d99/dd0/fd6 zero size 2024-09-17T01:02:01.715 INFO:tasks.workunit.client.1.smithi099.stdout:5/707: mknod d2/dc/d17/d3c/dca/ce9 0 2024-09-17T01:02:01.715 INFO:tasks.workunit.client.0.smithi002.stdout:5/629: dwrite d2/d2d/d10/d14/d19/da5/db0/d33/f7c [4194304,4194304] 0 2024-09-17T01:02:01.715 INFO:tasks.workunit.client.0.smithi002.stdout:5/630: write d2/d2d/d10/d23/d6e/d60/f8e [84454,25713] 0 2024-09-17T01:02:01.716 INFO:tasks.workunit.client.0.smithi002.stdout:1/662: rename d4/d11/d1a/f6c to d4/d11/d1c/fe0 0 2024-09-17T01:02:01.716 INFO:tasks.workunit.client.0.smithi002.stdout:4/825: dread d7/de/d3a/f5e [4194304,4194304] 0 2024-09-17T01:02:01.719 INFO:tasks.workunit.client.0.smithi002.stdout:5/631: mknod d2/d2d/d10/d14/d19/d39/dae/cc8 0 2024-09-17T01:02:01.719 INFO:tasks.workunit.client.0.smithi002.stdout:7/702: write d1/d14/d67/dc0/dcd/fdc [813141,34929] 0 2024-09-17T01:02:01.720 INFO:tasks.workunit.client.0.smithi002.stdout:1/663: symlink d4/d11/d12/d14/d17/d51/dc0/le1 0 2024-09-17T01:02:01.723 INFO:tasks.workunit.client.1.smithi099.stdout:1/812: dwrite d0/d8/f9c [0,4194304] 0 2024-09-17T01:02:01.725 INFO:tasks.workunit.client.0.smithi002.stdout:5/632: dread d2/d2d/d10/f58 [0,4194304] 0 2024-09-17T01:02:01.726 INFO:tasks.workunit.client.1.smithi099.stdout:3/705: dread d9/d15/d18/d1a/d23/f33 [0,4194304] 0 2024-09-17T01:02:01.726 INFO:tasks.workunit.client.0.smithi002.stdout:7/703: getdents d1/dac 0 2024-09-17T01:02:01.727 INFO:tasks.workunit.client.0.smithi002.stdout:2/712: dwrite d1b/f39 [0,4194304] 0 2024-09-17T01:02:01.730 INFO:tasks.workunit.client.0.smithi002.stdout:1/664: dread d4/d11/f5c [0,4194304] 0 2024-09-17T01:02:01.730 INFO:tasks.workunit.client.1.smithi099.stdout:3/706: unlink d9/d2b/f56 0 2024-09-17T01:02:01.731 INFO:tasks.workunit.client.0.smithi002.stdout:1/665: write d4/d11/d55/f65 [3636511,38778] 0 2024-09-17T01:02:01.732 INFO:tasks.workunit.client.0.smithi002.stdout:5/633: link d2/d2d/d10/f8a d2/d2d/d10/d14/d19/d39/dae/fc9 0 2024-09-17T01:02:01.732 INFO:tasks.workunit.client.0.smithi002.stdout:5/634: readlink d2/d2d/d10/d14/d19/l9c 0 2024-09-17T01:02:01.733 INFO:tasks.workunit.client.1.smithi099.stdout:5/708: dwrite d2/dc4/d90/da4/f54 [4194304,4194304] 0 2024-09-17T01:02:01.734 INFO:tasks.workunit.client.0.smithi002.stdout:7/704: truncate d1/d14/d1d/d28/d6b/d9e/f53 4101888 0 2024-09-17T01:02:01.734 INFO:tasks.workunit.client.0.smithi002.stdout:7/705: truncate d1/d14/d67/f9d 80254 0 2024-09-17T01:02:01.735 INFO:tasks.workunit.client.1.smithi099.stdout:3/707: dread d9/d15/d18/d1a/d23/f68 [0,4194304] 0 2024-09-17T01:02:01.735 INFO:tasks.workunit.client.1.smithi099.stdout:5/709: unlink d2/dc4/d90/da4/d9c/lab 0 2024-09-17T01:02:01.736 INFO:tasks.workunit.client.0.smithi002.stdout:4/826: dread d7/d3f/fb1 [0,4194304] 0 2024-09-17T01:02:01.736 INFO:tasks.workunit.client.0.smithi002.stdout:5/635: symlink d2/d2d/d10/d14/d19/lca 0 2024-09-17T01:02:01.736 INFO:tasks.workunit.client.0.smithi002.stdout:5/636: chown d2/d2d/d10/d95/d96 102826 1 2024-09-17T01:02:01.736 INFO:tasks.workunit.client.1.smithi099.stdout:3/708: mknod d9/d3b/db2/cdd 0 2024-09-17T01:02:01.737 INFO:tasks.workunit.client.1.smithi099.stdout:3/709: write d9/d15/d18/f20 [1169520,122803] 0 2024-09-17T01:02:01.737 INFO:tasks.workunit.client.1.smithi099.stdout:5/710: symlink d2/dc/d14/d36/lea 0 2024-09-17T01:02:01.737 INFO:tasks.workunit.client.1.smithi099.stdout:5/711: fsync d2/f5 0 2024-09-17T01:02:01.738 INFO:tasks.workunit.client.1.smithi099.stdout:5/712: chown d2/d26/f27 0 1 2024-09-17T01:02:01.738 INFO:tasks.workunit.client.1.smithi099.stdout:5/713: fsync d2/dc/d17/f70 0 2024-09-17T01:02:01.738 INFO:tasks.workunit.client.1.smithi099.stdout:5/714: chown d2/d8/cbc 6 1 2024-09-17T01:02:01.738 INFO:tasks.workunit.client.1.smithi099.stdout:5/715: chown d2/dc4/d99/dd0/dc3/dc8 1886 1 2024-09-17T01:02:01.738 INFO:tasks.workunit.client.1.smithi099.stdout:5/716: dread - d2/dc/d14/d36/fd3 zero size 2024-09-17T01:02:01.738 INFO:tasks.workunit.client.1.smithi099.stdout:5/717: dread - d2/dc/d17/d3c/da8/fc7 zero size 2024-09-17T01:02:01.739 INFO:tasks.workunit.client.0.smithi002.stdout:4/827: rename d7/d19/d9f/d80/c72 to d7/d19/d4a/dfa/c100 0 2024-09-17T01:02:01.741 INFO:tasks.workunit.client.0.smithi002.stdout:5/637: mkdir d2/d2d/d10/d9b/dcb 0 2024-09-17T01:02:01.741 INFO:tasks.workunit.client.1.smithi099.stdout:3/710: rename d9/d15/d18/d1a/d23/d5c/d99/dda/f6f to d9/d15/d18/d1a/d23/d5c/d6e/d7e/fde 0 2024-09-17T01:02:01.741 INFO:tasks.workunit.client.1.smithi099.stdout:3/711: fdatasync d9/d2b/fb0 0 2024-09-17T01:02:01.741 INFO:tasks.workunit.client.1.smithi099.stdout:5/718: symlink d2/dc/d6c/leb 0 2024-09-17T01:02:01.741 INFO:tasks.workunit.client.1.smithi099.stdout:5/719: chown d2/dc/d6c/c88 7814 1 2024-09-17T01:02:01.742 INFO:tasks.workunit.client.0.smithi002.stdout:5/638: symlink d2/d2d/lcc 0 2024-09-17T01:02:01.743 INFO:tasks.workunit.client.0.smithi002.stdout:4/828: write d7/d19/d9f/d80/d62/dbe/fe0 [892085,111297] 0 2024-09-17T01:02:01.744 INFO:tasks.workunit.client.0.smithi002.stdout:5/639: mkdir d2/d2d/d10/d14/d19/da5/db0/dcd 0 2024-09-17T01:02:01.744 INFO:tasks.workunit.client.0.smithi002.stdout:5/640: chown d2/d2d/d10/d20/d24/f77 142369107 1 2024-09-17T01:02:01.744 INFO:tasks.workunit.client.0.smithi002.stdout:5/641: readlink d2/de/d1d/lc2 0 2024-09-17T01:02:01.744 INFO:tasks.workunit.client.0.smithi002.stdout:5/642: chown d2/d2d/d10/d14/d59/f8f 353556 1 2024-09-17T01:02:01.746 INFO:tasks.workunit.client.1.smithi099.stdout:3/712: symlink d9/d15/d18/ldf 0 2024-09-17T01:02:01.746 INFO:tasks.workunit.client.1.smithi099.stdout:1/813: dwrite d0/d2/de/d8b/da7/d98/fea [0,4194304] 0 2024-09-17T01:02:01.746 INFO:tasks.workunit.client.1.smithi099.stdout:1/814: chown d0/d8/f7e 1055736 1 2024-09-17T01:02:01.746 INFO:tasks.workunit.client.1.smithi099.stdout:1/815: readlink d0/d2/de/d70/de8/l8f 0 2024-09-17T01:02:01.746 INFO:tasks.workunit.client.1.smithi099.stdout:1/816: chown d0/d8/d38/d8a/dd0 559253 1 2024-09-17T01:02:01.748 INFO:tasks.workunit.client.0.smithi002.stdout:4/829: rmdir d7/d19/d9f/d80/d62/d52 39 2024-09-17T01:02:01.748 INFO:tasks.workunit.client.1.smithi099.stdout:5/720: mkdir d2/dc/d97/dec 0 2024-09-17T01:02:01.748 INFO:tasks.workunit.client.1.smithi099.stdout:5/721: fdatasync d2/dc/d17/d3c/fd1 0 2024-09-17T01:02:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.751+0000 7f22517d8640 1 -- 172.21.15.2:0/3972967620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0ff680 msgr2=0x7f224c101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.751+0000 7f22517d8640 1 --2- 172.21.15.2:0/3972967620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0ff680 0x7f224c101a60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f22400048d0 tx=0x7f2240009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.752+0000 7f22517d8640 1 -- 172.21.15.2:0/3972967620 shutdown_connections 2024-09-17T01:02:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.752+0000 7f22517d8640 1 --2- 172.21.15.2:0/3972967620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0ff680 0x7f224c101a60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.752+0000 7f22517d8640 1 --2- 172.21.15.2:0/3972967620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c065c40 0x7f224c0ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.752+0000 7f22517d8640 1 -- 172.21.15.2:0/3972967620 >> 172.21.15.2:0/3972967620 conn(0x7f224c0f6c10 msgr2=0x7f224c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:01.751 INFO:tasks.workunit.client.1.smithi099.stdout:5/722: rename d2/dc/f39 to d2/dc/d97/dec/fed 0 2024-09-17T01:02:01.751 INFO:tasks.workunit.client.1.smithi099.stdout:5/723: chown d2/dc4/d99/dd0/dc3/dc8 10 1 2024-09-17T01:02:01.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.752+0000 7f22517d8640 1 -- 172.21.15.2:0/3972967620 shutdown_connections 2024-09-17T01:02:01.751 INFO:tasks.workunit.client.0.smithi002.stdout:5/643: mkdir d2/d2d/d10/d14/dce 0 2024-09-17T01:02:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.752+0000 7f22517d8640 1 -- 172.21.15.2:0/3972967620 wait complete. 2024-09-17T01:02:01.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.753+0000 7f22517d8640 1 Processor -- start 2024-09-17T01:02:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.754+0000 7f22517d8640 1 -- start start 2024-09-17T01:02:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.755+0000 7f22517d8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c065c40 0x7f224c10afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:01.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.755+0000 7f22517d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0ff680 0x7f224c10b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.755+0000 7f22517d8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c10bb90 con 0x7f224c0ff680 2024-09-17T01:02:01.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.755+0000 7f22517d8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c10c2b0 con 0x7f224c065c40 2024-09-17T01:02:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.756+0000 7f224a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0ff680 0x7f224c10b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.756+0000 7f224a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0ff680 0x7f224c10b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49824/0 (socket says 172.21.15.2:49824) 2024-09-17T01:02:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.756+0000 7f224a7fc640 1 -- 172.21.15.2:0/2952706910 learned_addr learned my addr 172.21.15.2:0/2952706910 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:02:01.755 INFO:tasks.workunit.client.0.smithi002.stdout:4/830: creat d7/d19/d2e/dc0/f101 x:0 0 0 2024-09-17T01:02:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.756+0000 7f224a7fc640 1 -- 172.21.15.2:0/2952706910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c065c40 msgr2=0x7f224c10afc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T01:02:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.756+0000 7f224a7fc640 1 --2- 172.21.15.2:0/2952706910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c065c40 0x7f224c10afc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.756+0000 7f224a7fc640 1 -- 172.21.15.2:0/2952706910 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2240005040 con 0x7f224c0ff680 2024-09-17T01:02:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.756+0000 7f224a7fc640 1 --2- 172.21.15.2:0/2952706910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0ff680 0x7f224c10b500 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f22400048a0 tx=0x7f2240009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.757+0000 7f22337fe640 1 -- 172.21.15.2:0/2952706910 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2240038070 con 0x7f224c0ff680 2024-09-17T01:02:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.757+0000 7f22337fe640 1 -- 172.21.15.2:0/2952706910 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f22400097b0 con 0x7f224c0ff680 2024-09-17T01:02:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.757+0000 7f22337fe640 1 -- 172.21.15.2:0/2952706910 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f224003d660 con 0x7f224c0ff680 2024-09-17T01:02:01.757 INFO:tasks.workunit.client.0.smithi002.stdout:5/644: symlink d2/d2d/d10/d14/d19/lcf 0 2024-09-17T01:02:01.757 INFO:tasks.workunit.client.0.smithi002.stdout:5/645: fdatasync d2/f4d 0 2024-09-17T01:02:01.757 INFO:tasks.workunit.client.0.smithi002.stdout:4/831: rmdir d7/d19/d4a/dfa 39 2024-09-17T01:02:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.759+0000 7f22517d8640 1 -- 172.21.15.2:0/2952706910 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224c10c4d0 con 0x7f224c0ff680 2024-09-17T01:02:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.759+0000 7f22517d8640 1 -- 172.21.15.2:0/2952706910 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c10c900 con 0x7f224c0ff680 2024-09-17T01:02:01.759 INFO:tasks.workunit.client.0.smithi002.stdout:2/713: dwrite f13 [0,4194304] 0 2024-09-17T01:02:01.759 INFO:tasks.workunit.client.0.smithi002.stdout:1/666: dwrite d4/d11/d12/d14/d17/d51/fc7 [0,4194304] 0 2024-09-17T01:02:01.760 INFO:tasks.workunit.client.0.smithi002.stdout:5/646: mknod d2/d2d/d10/d14/d19/da5/db0/d33/cd0 0 2024-09-17T01:02:01.760 INFO:tasks.workunit.client.0.smithi002.stdout:4/832: mkdir d7/d19/d9f/d80/d62/dbe/df5/d102 0 2024-09-17T01:02:01.760 INFO:tasks.workunit.client.0.smithi002.stdout:4/833: write d7/d19/d2e/f70 [1198757,59474] 0 2024-09-17T01:02:01.761 INFO:tasks.workunit.client.0.smithi002.stdout:5/647: read d2/d2d/d10/d9b/fa2 [22202,93679] 0 2024-09-17T01:02:01.764 INFO:tasks.workunit.client.0.smithi002.stdout:5/648: write d2/d2d/d10/d14/d19/d39/d64/fb6 [556763,49902] 0 2024-09-17T01:02:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.761+0000 7f22517d8640 1 -- 172.21.15.2:0/2952706910 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224c0fa890 con 0x7f224c0ff680 2024-09-17T01:02:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.764+0000 7f22337fe640 1 -- 172.21.15.2:0/2952706910 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 90865+0+0 (secure 0 0 0) 0x7f2240030020 con 0x7f224c0ff680 2024-09-17T01:02:01.766 INFO:tasks.workunit.client.1.smithi099.stdout:7/623: sync 2024-09-17T01:02:01.766 INFO:tasks.workunit.client.1.smithi099.stdout:8/644: sync 2024-09-17T01:02:01.766 INFO:tasks.workunit.client.1.smithi099.stdout:7/624: creat d1/d2c/d47/d48/fc7 x:0 0 0 2024-09-17T01:02:01.766 INFO:tasks.workunit.client.1.smithi099.stdout:8/645: write d0/d1f/d31/d4c/f76 [898919,86149] 0 2024-09-17T01:02:01.766 INFO:tasks.workunit.client.1.smithi099.stdout:8/646: symlink d0/d1f/ld6 0 2024-09-17T01:02:01.766 INFO:tasks.workunit.client.0.smithi002.stdout:2/714: rename d1b/d74/fdd to d1b/d3f/dea/f100 0 2024-09-17T01:02:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.765+0000 7f22337fe640 1 --2- 172.21.15.2:0/2952706910 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f223406eda0 0x7f2234071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.765+0000 7f22337fe640 1 -- 172.21.15.2:0/2952706910 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f22400ae6d0 con 0x7f224c0ff680 2024-09-17T01:02:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.766+0000 7f224affd640 1 --2- 172.21.15.2:0/2952706910 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f223406eda0 0x7f2234071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:01.767 INFO:tasks.workunit.client.0.smithi002.stdout:1/667: dread d4/d11/d12/d14/d17/d56/fbf [0,4194304] 0 2024-09-17T01:02:01.767 INFO:tasks.workunit.client.0.smithi002.stdout:1/668: truncate d4/d11/d12/d14/d17/d51/fc8 341898 0 2024-09-17T01:02:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.767+0000 7f224affd640 1 --2- 172.21.15.2:0/2952706910 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f223406eda0 0x7f2234071250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f224c10ad70 tx=0x7f223c006ca0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:01.768 INFO:tasks.workunit.client.0.smithi002.stdout:4/834: dread d7/d19/d9f/d80/f5a [0,4194304] 0 2024-09-17T01:02:01.768 INFO:tasks.workunit.client.1.smithi099.stdout:3/713: dwrite d9/d2b/fb0 [0,4194304] 0 2024-09-17T01:02:01.768 INFO:tasks.workunit.client.1.smithi099.stdout:8/647: mknod d0/cd7 0 2024-09-17T01:02:01.769 INFO:tasks.workunit.client.0.smithi002.stdout:5/649: write d2/d2d/d10/d14/d19/d39/d43/f2a [2873011,21801] 0 2024-09-17T01:02:01.771 INFO:tasks.workunit.client.0.smithi002.stdout:2/715: link d1b/d3f/d59/d7f/dc9/dac/fe5 d1b/d1d/dd4/f101 0 2024-09-17T01:02:01.771 INFO:tasks.workunit.client.0.smithi002.stdout:2/716: stat d1b/d37/fa5 0 2024-09-17T01:02:01.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:01.773+0000 7f22337fe640 1 -- 172.21.15.2:0/2952706910 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f224007b820 con 0x7f224c0ff680 2024-09-17T01:02:01.772 INFO:tasks.workunit.client.1.smithi099.stdout:3/714: rename d9/d15/d18/d1a/fa8 to d9/d15/d38/fe0 0 2024-09-17T01:02:01.772 INFO:tasks.workunit.client.1.smithi099.stdout:3/715: write d9/d15/d18/d1a/d23/d5c/d99/fcc [186778,55613] 0 2024-09-17T01:02:01.772 INFO:tasks.workunit.client.1.smithi099.stdout:8/648: truncate d0/d1f/d31/f7b 835606 0 2024-09-17T01:02:01.772 INFO:tasks.workunit.client.0.smithi002.stdout:2/717: read d1b/d37/f62 [308150,12080] 0 2024-09-17T01:02:01.773 INFO:tasks.workunit.client.0.smithi002.stdout:1/669: symlink d4/d11/d12/d14/d17/d51/d88/da3/le2 0 2024-09-17T01:02:01.773 INFO:tasks.workunit.client.1.smithi099.stdout:3/716: creat d9/d3b/db2/daf/fe1 x:0 0 0 2024-09-17T01:02:01.773 INFO:tasks.workunit.client.1.smithi099.stdout:8/649: mkdir d0/d4/d29/d4b/db3/dd8 0 2024-09-17T01:02:01.773 INFO:tasks.workunit.client.0.smithi002.stdout:4/835: mkdir d7/d19/d2e/d103 0 2024-09-17T01:02:01.774 INFO:tasks.workunit.client.1.smithi099.stdout:3/717: creat d9/d3b/fe2 x:0 0 0 2024-09-17T01:02:01.774 INFO:tasks.workunit.client.1.smithi099.stdout:3/718: chown d9/c11 62379 1 2024-09-17T01:02:01.775 INFO:tasks.workunit.client.1.smithi099.stdout:8/650: mknod d0/d1f/d31/d4c/cd9 0 2024-09-17T01:02:01.775 INFO:tasks.workunit.client.0.smithi002.stdout:2/718: symlink d1b/d3f/d59/d7f/dc9/dac/dbd/de8/l102 0 2024-09-17T01:02:01.776 INFO:tasks.workunit.client.1.smithi099.stdout:8/651: creat d0/d41/d5a/dcd/fda x:0 0 0 2024-09-17T01:02:01.777 INFO:tasks.workunit.client.1.smithi099.stdout:8/652: mknod d0/d1f/db5/cdb 0 2024-09-17T01:02:01.780 INFO:tasks.workunit.client.0.smithi002.stdout:5/650: write d2/d2d/d10/d3b/f5e [2000434,17115] 0 2024-09-17T01:02:01.785 INFO:tasks.workunit.client.1.smithi099.stdout:1/817: dwrite d0/d8c/f99 [0,4194304] 0 2024-09-17T01:02:01.788 INFO:tasks.workunit.client.1.smithi099.stdout:1/818: creat d0/d2/dd8/f111 x:0 0 0 2024-09-17T01:02:01.790 INFO:tasks.workunit.client.1.smithi099.stdout:1/819: mkdir d0/d8/d38/d8a/d112 0 2024-09-17T01:02:01.791 INFO:tasks.workunit.client.1.smithi099.stdout:3/719: read d9/d15/d18/d1a/d23/d5c/d99/dda/f75 [2812187,123270] 0 2024-09-17T01:02:01.792 INFO:tasks.workunit.client.1.smithi099.stdout:3/720: stat d9/d15/d38/l84 0 2024-09-17T01:02:01.793 INFO:tasks.workunit.client.1.smithi099.stdout:3/721: mkdir d9/d15/d8f/de3 0 2024-09-17T01:02:01.793 INFO:tasks.workunit.client.1.smithi099.stdout:3/722: write d9/d15/d18/d1a/d23/d5c/d6e/d7e/fde [1797915,70458] 0 2024-09-17T01:02:01.793 INFO:tasks.workunit.client.1.smithi099.stdout:3/723: chown d9/f30 0 1 2024-09-17T01:02:01.794 INFO:tasks.workunit.client.1.smithi099.stdout:3/724: mkdir d9/d15/d18/d1a/d23/d4c/de4 0 2024-09-17T01:02:01.794 INFO:tasks.workunit.client.1.smithi099.stdout:3/725: dread - d9/d15/d18/d1a/d23/d5c/fa1 zero size 2024-09-17T01:02:01.795 INFO:tasks.workunit.client.0.smithi002.stdout:1/670: write d4/d22/f39 [4074879,127531] 0 2024-09-17T01:02:01.795 INFO:tasks.workunit.client.0.smithi002.stdout:1/671: write d4/d11/d12/fcb [988322,128454] 0 2024-09-17T01:02:01.795 INFO:tasks.workunit.client.0.smithi002.stdout:1/672: chown d4/d22/d8d/da9 1192869 1 2024-09-17T01:02:01.796 INFO:tasks.workunit.client.0.smithi002.stdout:1/673: chown d4/d11/d55/dbc/dc5 16934 1 2024-09-17T01:02:01.796 INFO:tasks.workunit.client.0.smithi002.stdout:1/674: readlink d4/d11/l68 0 2024-09-17T01:02:01.796 INFO:tasks.workunit.client.1.smithi099.stdout:3/726: mkdir d9/d15/d18/de5 0 2024-09-17T01:02:01.796 INFO:tasks.workunit.client.1.smithi099.stdout:3/727: write d9/d3b/db2/fa4 [5202770,54050] 0 2024-09-17T01:02:01.796 INFO:tasks.workunit.client.1.smithi099.stdout:3/728: chown d9/d15/d18/d1a/d23/fc3 11952 1 2024-09-17T01:02:01.797 INFO:tasks.workunit.client.1.smithi099.stdout:3/729: rmdir d9/d15/d18/d1a/d23/d5c/d99/dd8 39 2024-09-17T01:02:01.798 INFO:tasks.workunit.client.1.smithi099.stdout:3/730: mkdir d9/d2b/de6 0 2024-09-17T01:02:01.798 INFO:tasks.workunit.client.1.smithi099.stdout:3/731: write d9/d15/d18/d1a/d23/d5c/d99/fcc [488117,111027] 0 2024-09-17T01:02:01.799 INFO:tasks.workunit.client.1.smithi099.stdout:3/732: write d9/f8c [836037,107835] 0 2024-09-17T01:02:01.801 INFO:tasks.workunit.client.1.smithi099.stdout:3/733: mkdir d9/d2b/d6b/de7 0 2024-09-17T01:02:01.801 INFO:tasks.workunit.client.1.smithi099.stdout:3/734: fdatasync d9/f83 0 2024-09-17T01:02:01.802 INFO:tasks.workunit.client.0.smithi002.stdout:3/641: sync 2024-09-17T01:02:01.802 INFO:tasks.workunit.client.0.smithi002.stdout:9/600: sync 2024-09-17T01:02:01.802 INFO:tasks.workunit.client.0.smithi002.stdout:9/601: write d5/dc/d26/d5c/d6b/d75/fb1 [14608,64540] 0 2024-09-17T01:02:01.802 INFO:tasks.workunit.client.1.smithi099.stdout:3/735: creat d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/fe8 x:0 0 0 2024-09-17T01:02:01.803 INFO:tasks.workunit.client.0.smithi002.stdout:9/602: rmdir d5/dc/d26/d63/d66 39 2024-09-17T01:02:01.804 INFO:tasks.workunit.client.0.smithi002.stdout:3/642: dread d0/f61 [0,4194304] 0 2024-09-17T01:02:01.804 INFO:tasks.workunit.client.0.smithi002.stdout:9/603: getdents d5/d8a 0 2024-09-17T01:02:01.805 INFO:tasks.workunit.client.0.smithi002.stdout:3/643: mkdir d0/d31/d32/dcb/dd7 0 2024-09-17T01:02:01.806 INFO:tasks.workunit.client.0.smithi002.stdout:9/604: stat d5/dc/d26/d5c/d6b/d75/d36/c43 0 2024-09-17T01:02:01.806 INFO:tasks.workunit.client.0.smithi002.stdout:9/605: truncate d5/dc/d26/d46/faf 989159 0 2024-09-17T01:02:01.806 INFO:tasks.workunit.client.0.smithi002.stdout:9/606: dread - d5/dc/d26/d5c/d6b/d75/d57/f5d zero size 2024-09-17T01:02:01.807 INFO:tasks.workunit.client.0.smithi002.stdout:9/607: rmdir d5/dc/d26/d5c/d6b/d75/d36 39 2024-09-17T01:02:01.807 INFO:tasks.workunit.client.0.smithi002.stdout:9/608: fsync d5/f10 0 2024-09-17T01:02:01.807 INFO:tasks.workunit.client.0.smithi002.stdout:9/609: chown d5/l8 733605 1 2024-09-17T01:02:01.808 INFO:tasks.workunit.client.0.smithi002.stdout:3/644: rmdir d0/d3/d33/d99 39 2024-09-17T01:02:01.808 INFO:tasks.workunit.client.0.smithi002.stdout:3/645: readlink d0/d3/d37/lbc 0 2024-09-17T01:02:01.808 INFO:tasks.workunit.client.0.smithi002.stdout:3/646: chown d0/d3/d17/f29 5064 1 2024-09-17T01:02:01.808 INFO:tasks.workunit.client.0.smithi002.stdout:3/647: write d0/d3/d8d/f9c [889597,42015] 0 2024-09-17T01:02:01.811 INFO:tasks.workunit.client.1.smithi099.stdout:7/625: dwrite d1/f10 [0,4194304] 0 2024-09-17T01:02:01.812 INFO:tasks.workunit.client.0.smithi002.stdout:9/610: getdents d5/dc/d26/d5c/d6b/d75 0 2024-09-17T01:02:01.814 INFO:tasks.workunit.client.0.smithi002.stdout:9/611: mkdir d5/dc/d26/d46/db4 0 2024-09-17T01:02:01.814 INFO:tasks.workunit.client.0.smithi002.stdout:9/612: creat d5/dc/d26/d5c/d6b/d75/d57/d7a/fb5 x:0 0 0 2024-09-17T01:02:01.814 INFO:tasks.workunit.client.0.smithi002.stdout:9/613: creat d5/dc/d26/d46/fb6 x:0 0 0 2024-09-17T01:02:01.815 INFO:tasks.workunit.client.1.smithi099.stdout:7/626: getdents d1/d2c/d5c/d1c/d5a/d6f 0 2024-09-17T01:02:01.815 INFO:tasks.workunit.client.1.smithi099.stdout:7/627: chown d1/d2c/d5c/c3c 8 1 2024-09-17T01:02:01.816 INFO:tasks.workunit.client.0.smithi002.stdout:2/719: dwrite d1b/d1d/f7c [0,4194304] 0 2024-09-17T01:02:01.816 INFO:tasks.workunit.client.0.smithi002.stdout:2/720: write d1b/d37/d48/d52/f5e [1219768,19539] 0 2024-09-17T01:02:01.816 INFO:tasks.workunit.client.0.smithi002.stdout:4/836: dwrite d7/d71/d8e/fb8 [0,4194304] 0 2024-09-17T01:02:01.816 INFO:tasks.workunit.client.0.smithi002.stdout:4/837: chown d7/de/d32 1577234 1 2024-09-17T01:02:01.816 INFO:tasks.workunit.client.0.smithi002.stdout:4/838: write d7/de/fa6 [1960871,22417] 0 2024-09-17T01:02:01.816 INFO:tasks.workunit.client.1.smithi099.stdout:1/820: dwrite d0/d8/d49/d4e/ff4 [0,4194304] 0 2024-09-17T01:02:01.817 INFO:tasks.workunit.client.1.smithi099.stdout:1/821: fdatasync d0/d2/d18/f34 0 2024-09-17T01:02:01.817 INFO:tasks.workunit.client.1.smithi099.stdout:7/628: getdents d1/d2c/d5c/d12 0 2024-09-17T01:02:01.817 INFO:tasks.workunit.client.1.smithi099.stdout:7/629: creat d1/d37/d4f/fc8 x:0 0 0 2024-09-17T01:02:01.818 INFO:tasks.workunit.client.1.smithi099.stdout:8/653: getdents d0 0 2024-09-17T01:02:01.818 INFO:tasks.workunit.client.1.smithi099.stdout:8/654: creat d0/d1f/d90/fdc x:0 0 0 2024-09-17T01:02:01.818 INFO:tasks.workunit.client.1.smithi099.stdout:8/655: stat d0/d4/d29/d9c 0 2024-09-17T01:02:01.819 INFO:tasks.workunit.client.1.smithi099.stdout:8/656: dread d0/d1f/f81 [0,4194304] 0 2024-09-17T01:02:01.819 INFO:tasks.workunit.client.0.smithi002.stdout:9/614: rename d5/f44 to d5/dc/d26/d63/fb7 0 2024-09-17T01:02:01.823 INFO:tasks.workunit.client.1.smithi099.stdout:7/630: creat d1/d2c/fc9 x:0 0 0 2024-09-17T01:02:01.825 INFO:tasks.workunit.client.1.smithi099.stdout:8/657: unlink d0/d4/d29/c7f 0 2024-09-17T01:02:01.827 INFO:tasks.workunit.client.0.smithi002.stdout:4/839: creat d7/d3f/da9/dca/f104 x:0 0 0 2024-09-17T01:02:01.827 INFO:tasks.workunit.client.0.smithi002.stdout:4/840: chown d7/de/fe7 17717858 1 2024-09-17T01:02:01.827 INFO:tasks.workunit.client.1.smithi099.stdout:7/631: unlink d1/d2c/d5c/d1c/f61 0 2024-09-17T01:02:01.828 INFO:tasks.workunit.client.1.smithi099.stdout:1/822: dread d0/d2/de/d70/de8/fab [0,4194304] 0 2024-09-17T01:02:01.828 INFO:tasks.workunit.client.1.smithi099.stdout:7/632: rmdir d1/d2c/d5c/d3f 39 2024-09-17T01:02:01.829 INFO:tasks.workunit.client.1.smithi099.stdout:8/658: dread d0/d1f/d31/d4c/f7d [0,4194304] 0 2024-09-17T01:02:01.830 INFO:tasks.workunit.client.1.smithi099.stdout:1/823: creat d0/d2/dd8/d109/f113 x:0 0 0 2024-09-17T01:02:01.831 INFO:tasks.workunit.client.1.smithi099.stdout:8/659: mknod d0/d41/d5a/dcd/cdd 0 2024-09-17T01:02:01.833 INFO:tasks.workunit.client.1.smithi099.stdout:1/824: mkdir d0/d2/de/d70/de8/dd6/d114 0 2024-09-17T01:02:01.833 INFO:tasks.workunit.client.1.smithi099.stdout:1/825: dread - d0/d2/d18/f6b zero size 2024-09-17T01:02:01.834 INFO:tasks.workunit.client.1.smithi099.stdout:1/826: creat d0/d2/de/d31/f115 x:0 0 0 2024-09-17T01:02:01.834 INFO:tasks.workunit.client.1.smithi099.stdout:1/827: chown d0/d8/d49/ccc 0 1 2024-09-17T01:02:01.834 INFO:tasks.workunit.client.1.smithi099.stdout:8/660: rmdir d0/d1f/d55/d95 39 2024-09-17T01:02:01.835 INFO:tasks.workunit.client.1.smithi099.stdout:8/661: dread d0/d4/d29/f58 [0,4194304] 0 2024-09-17T01:02:01.835 INFO:tasks.workunit.client.1.smithi099.stdout:8/662: write d0/d4/d29/f8e [953070,47050] 0 2024-09-17T01:02:01.835 INFO:tasks.workunit.client.1.smithi099.stdout:8/663: dread - d0/d4/dc3/fd1 zero size 2024-09-17T01:02:01.836 INFO:tasks.workunit.client.0.smithi002.stdout:2/721: rmdir d1b/d37/d48/d52/de6 39 2024-09-17T01:02:01.836 INFO:tasks.workunit.client.1.smithi099.stdout:1/828: mknod d0/d2/de/d8b/da7/c116 0 2024-09-17T01:02:01.836 INFO:tasks.workunit.client.0.smithi002.stdout:2/722: creat d1b/d37/d48/db1/dbb/f103 x:0 0 0 2024-09-17T01:02:01.839 INFO:tasks.workunit.client.1.smithi099.stdout:1/829: truncate d0/f13 402297 0 2024-09-17T01:02:01.842 INFO:tasks.workunit.client.1.smithi099.stdout:1/830: mknod d0/d8/d38/d8a/c117 0 2024-09-17T01:02:01.845 INFO:tasks.workunit.client.1.smithi099.stdout:1/831: symlink d0/d8/d38/d56/d93/l118 0 2024-09-17T01:02:01.845 INFO:tasks.workunit.client.1.smithi099.stdout:1/832: fsync d0/d2/de/d70/de8/fdd 0 2024-09-17T01:02:01.845 INFO:tasks.workunit.client.1.smithi099.stdout:1/833: fsync d0/d2/de/f15 0 2024-09-17T01:02:01.850 INFO:tasks.workunit.client.1.smithi099.stdout:8/664: rename d0/d4 to d0/d1f/d90/db8/dde 0 2024-09-17T01:02:01.850 INFO:tasks.workunit.client.1.smithi099.stdout:8/665: readlink d0/d1f/l6a 0 2024-09-17T01:02:01.851 INFO:tasks.workunit.client.1.smithi099.stdout:8/666: mknod d0/cdf 0 2024-09-17T01:02:01.852 INFO:tasks.workunit.client.1.smithi099.stdout:8/667: mkdir d0/d53/de0 0 2024-09-17T01:02:01.853 INFO:tasks.workunit.client.1.smithi099.stdout:8/668: mknod d0/d1f/d90/db8/dde/d64/dbe/ce1 0 2024-09-17T01:02:01.854 INFO:tasks.workunit.client.1.smithi099.stdout:8/669: mkdir d0/d1f/d55/d95/de2 0 2024-09-17T01:02:01.858 INFO:tasks.workunit.client.0.smithi002.stdout:2/723: dwrite d1b/d37/d48/d52/de6/ff2 [0,4194304] 0 2024-09-17T01:02:01.859 INFO:tasks.workunit.client.0.smithi002.stdout:2/724: symlink d1b/d37/d48/d4e/l104 0 2024-09-17T01:02:01.860 INFO:tasks.workunit.client.1.smithi099.stdout:8/670: rmdir d0/d1f/d90/db8/dde 39 2024-09-17T01:02:01.876 INFO:tasks.workunit.client.1.smithi099.stdout:8/671: dwrite d0/d1f/d31/d4c/f7d [0,4194304] 0 2024-09-17T01:02:01.878 INFO:tasks.workunit.client.1.smithi099.stdout:8/672: symlink d0/d41/d5a/dcd/le3 0 2024-09-17T01:02:01.901 INFO:tasks.workunit.client.1.smithi099.stdout:3/736: dwrite d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/fe8 [0,4194304] 0 2024-09-17T01:02:01.908 INFO:tasks.workunit.client.0.smithi002.stdout:3/648: dwrite d0/f1f [0,4194304] 0 2024-09-17T01:02:01.908 INFO:tasks.workunit.client.1.smithi099.stdout:7/633: dwrite d1/f11 [4194304,4194304] 0 2024-09-17T01:02:01.909 INFO:tasks.workunit.client.0.smithi002.stdout:3/649: rename d0/d31/d32/d90 to d0/d3/d37/dac/da1/dd8 0 2024-09-17T01:02:01.912 INFO:tasks.workunit.client.0.smithi002.stdout:3/650: mkdir d0/d3/d17/d84/dd9 0 2024-09-17T01:02:01.913 INFO:tasks.workunit.client.1.smithi099.stdout:1/834: dread d0/d2/f25 [0,4194304] 0 2024-09-17T01:02:01.913 INFO:tasks.workunit.client.1.smithi099.stdout:1/835: write d0/d8/d49/d94/de0/fe7 [575834,118654] 0 2024-09-17T01:02:01.914 INFO:tasks.workunit.client.0.smithi002.stdout:9/615: dwrite d5/dc/d26/d46/f50 [0,4194304] 0 2024-09-17T01:02:01.914 INFO:tasks.workunit.client.0.smithi002.stdout:9/616: fsync d5/dc/d26/d5c/d6b/d75/d57/d7a/f8b 0 2024-09-17T01:02:01.914 INFO:tasks.workunit.client.0.smithi002.stdout:2/725: dwrite d1b/d1d/dd4/fff [0,4194304] 0 2024-09-17T01:02:01.915 INFO:tasks.workunit.client.1.smithi099.stdout:8/673: dwrite d0/fcb [0,4194304] 0 2024-09-17T01:02:01.915 INFO:tasks.workunit.client.1.smithi099.stdout:8/674: chown d0/d1f/l7a 512633 1 2024-09-17T01:02:01.915 INFO:tasks.workunit.client.1.smithi099.stdout:8/675: write d0/d1f/d90/db8/dde/d29/d4b/f4e [1053203,29743] 0 2024-09-17T01:02:01.916 INFO:tasks.workunit.client.0.smithi002.stdout:9/617: creat d5/dc/d26/d5c/d6b/d75/d36/fb8 x:0 0 0 2024-09-17T01:02:01.918 INFO:tasks.workunit.client.1.smithi099.stdout:8/676: mknod d0/d1f/d31/d4c/ce4 0 2024-09-17T01:02:01.918 INFO:tasks.workunit.client.1.smithi099.stdout:8/677: creat d0/d1f/d31/fe5 x:0 0 0 2024-09-17T01:02:01.919 INFO:tasks.workunit.client.0.smithi002.stdout:9/618: unlink d5/dc/d26/d5c/d6b/d75/c73 0 2024-09-17T01:02:01.921 INFO:tasks.workunit.client.1.smithi099.stdout:8/678: mknod d0/d1f/d90/db8/dde/d64/dcf/ce6 0 2024-09-17T01:02:01.921 INFO:tasks.workunit.client.1.smithi099.stdout:8/679: truncate d0/d41/f9b 5058966 0 2024-09-17T01:02:01.921 INFO:tasks.workunit.client.1.smithi099.stdout:8/680: creat d0/d1f/d31/d4c/d8c/fe7 x:0 0 0 2024-09-17T01:02:01.921 INFO:tasks.workunit.client.1.smithi099.stdout:3/737: dread d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/f9e [0,4194304] 0 2024-09-17T01:02:01.922 INFO:tasks.workunit.client.0.smithi002.stdout:9/619: getdents d5/dc/d26 0 2024-09-17T01:02:01.923 INFO:tasks.workunit.client.0.smithi002.stdout:9/620: mknod d5/dc/d26/d5c/d6b/d75/d57/d7a/da2/cb9 0 2024-09-17T01:02:01.923 INFO:tasks.workunit.client.1.smithi099.stdout:7/634: dwrite d1/ff [4194304,4194304] 0 2024-09-17T01:02:01.924 INFO:tasks.workunit.client.1.smithi099.stdout:3/738: rmdir d9/d2b/de6 0 2024-09-17T01:02:01.924 INFO:tasks.workunit.client.1.smithi099.stdout:8/681: dread d0/d1f/d90/db8/dde/f3c [0,4194304] 0 2024-09-17T01:02:01.924 INFO:tasks.workunit.client.1.smithi099.stdout:1/836: write d0/d8/d49/f4c [318461,79467] 0 2024-09-17T01:02:01.925 INFO:tasks.workunit.client.1.smithi099.stdout:1/837: fsync d0/d8/d38/d56/f57 0 2024-09-17T01:02:01.925 INFO:tasks.workunit.client.0.smithi002.stdout:9/621: mkdir d5/dc/d26/d5c/d6b/d75/d57/dba 0 2024-09-17T01:02:01.925 INFO:tasks.workunit.client.0.smithi002.stdout:9/622: rename d5/dc/d26/d5c/d6b/d75/d57/la9 to d5/dc/d26/d46/lbb 0 2024-09-17T01:02:01.927 INFO:tasks.workunit.client.0.smithi002.stdout:9/623: truncate d5/dc/d26/d63/d66/f78 3292237 0 2024-09-17T01:02:01.927 INFO:tasks.workunit.client.1.smithi099.stdout:7/635: creat d1/d2c/d47/fca x:0 0 0 2024-09-17T01:02:01.927 INFO:tasks.workunit.client.1.smithi099.stdout:3/739: rmdir d9/d15/d18/d1a 39 2024-09-17T01:02:01.927 INFO:tasks.workunit.client.0.smithi002.stdout:3/651: write d0/d31/d32/f42 [1155409,115621] 0 2024-09-17T01:02:01.928 INFO:tasks.workunit.client.0.smithi002.stdout:3/652: creat d0/d31/d32/d92/fda x:0 0 0 2024-09-17T01:02:01.929 INFO:tasks.workunit.client.1.smithi099.stdout:8/682: unlink d0/d1f/d90/db8/dde/c2d 0 2024-09-17T01:02:01.930 INFO:tasks.workunit.client.1.smithi099.stdout:7/636: rmdir d1/d2c/d5c/d1c/d72/dc3 0 2024-09-17T01:02:01.931 INFO:tasks.workunit.client.1.smithi099.stdout:8/683: symlink d0/d1f/d90/db8/dde/dbc/le8 0 2024-09-17T01:02:01.932 INFO:tasks.workunit.client.1.smithi099.stdout:7/637: mknod d1/d37/d78/db2/ccb 0 2024-09-17T01:02:01.933 INFO:tasks.workunit.client.1.smithi099.stdout:1/838: read d0/d8/d49/d94/d4b/d59/db9/feb [2744623,73884] 0 2024-09-17T01:02:01.933 INFO:tasks.workunit.client.1.smithi099.stdout:1/839: chown d0/cf0 8225 1 2024-09-17T01:02:01.933 INFO:tasks.workunit.client.1.smithi099.stdout:1/840: creat d0/d8/d38/d56/d93/f119 x:0 0 0 2024-09-17T01:02:01.934 INFO:tasks.workunit.client.0.smithi002.stdout:3/653: dread d0/d3/fb5 [0,4194304] 0 2024-09-17T01:02:01.936 INFO:tasks.workunit.client.0.smithi002.stdout:3/654: unlink d0/d3/d37/f4d 0 2024-09-17T01:02:01.936 INFO:tasks.workunit.client.0.smithi002.stdout:3/655: write d0/d3/d17/d9a/fc0 [1007565,81868] 0 2024-09-17T01:02:01.936 INFO:tasks.workunit.client.0.smithi002.stdout:3/656: fdatasync d0/d3/d37/f74 0 2024-09-17T01:02:01.936 INFO:tasks.workunit.client.0.smithi002.stdout:3/657: write d0/d31/d32/fb9 [866635,112869] 0 2024-09-17T01:02:01.937 INFO:tasks.workunit.client.0.smithi002.stdout:3/658: unlink d0/d3/d17/d9a/l6b 0 2024-09-17T01:02:01.940 INFO:tasks.workunit.client.0.smithi002.stdout:3/659: getdents d0/d3/d33/d40 0 2024-09-17T01:02:01.940 INFO:tasks.workunit.client.0.smithi002.stdout:3/660: write d0/d3/d37/f47 [937076,25581] 0 2024-09-17T01:02:01.944 INFO:tasks.workunit.client.1.smithi099.stdout:7/638: write d1/d37/f56 [3458150,31424] 0 2024-09-17T01:02:01.987 INFO:tasks.workunit.client.0.smithi002.stdout:0/610: sync 2024-09-17T01:02:02.000 INFO:tasks.workunit.client.1.smithi099.stdout:2/589: sync 2024-09-17T01:02:02.002 INFO:tasks.workunit.client.1.smithi099.stdout:8/684: truncate d0/d1f/f20 5681289 0 2024-09-17T01:02:02.002 INFO:tasks.workunit.client.1.smithi099.stdout:8/685: write d0/d1f/d90/db8/dde/d29/d4b/f96 [1038942,96316] 0 2024-09-17T01:02:02.002 INFO:tasks.workunit.client.1.smithi099.stdout:8/686: write d0/d1f/d31/fe5 [731332,100822] 0 2024-09-17T01:02:02.003 INFO:tasks.workunit.client.1.smithi099.stdout:8/687: truncate d0/f74 793229 0 2024-09-17T01:02:02.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:02.005+0000 7f22517d8640 1 -- 172.21.15.2:0/2952706910 --> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f224c10cf80 con 0x7f223406eda0 2024-09-17T01:02:02.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:02.007+0000 7f22337fe640 1 -- 172.21.15.2:0/2952706910 <== mgr.14204 v2:172.21.15.2:6800/1697208540 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f224c10cf80 con 0x7f223406eda0 2024-09-17T01:02:02.005 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:02:02.005 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:02:02.005 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:02:02.005 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-17T01:02:02.005 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2024-09-17T01:02:02.005 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "0/2 daemons upgraded", 2024-09-17T01:02:02.005 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mgr daemons", 2024-09-17T01:02:02.005 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:02:02.005 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:02:02.006 INFO:tasks.workunit.client.1.smithi099.stdout:1/841: unlink d0/d8/d49/lb2 0 2024-09-17T01:02:02.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:02.009+0000 7f22517d8640 1 -- 172.21.15.2:0/2952706910 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f223406eda0 msgr2=0x7f2234071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:02.009+0000 7f22517d8640 1 --2- 172.21.15.2:0/2952706910 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f223406eda0 0x7f2234071250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f224c10ad70 tx=0x7f223c006ca0 comp rx=0 tx=0).stop 2024-09-17T01:02:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:02.009+0000 7f22517d8640 1 -- 172.21.15.2:0/2952706910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0ff680 msgr2=0x7f224c10b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:02.009+0000 7f22517d8640 1 --2- 172.21.15.2:0/2952706910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0ff680 0x7f224c10b500 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f22400048a0 tx=0x7f2240009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:02.009+0000 7f22517d8640 1 -- 172.21.15.2:0/2952706910 shutdown_connections 2024-09-17T01:02:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:02.009+0000 7f22517d8640 1 --2- 172.21.15.2:0/2952706910 >> [v2:172.21.15.2:6800/1697208540,v1:172.21.15.2:6801/1697208540] conn(0x7f223406eda0 0x7f2234071250 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:02.009+0000 7f22517d8640 1 --2- 172.21.15.2:0/2952706910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f224c0ff680 0x7f224c10b500 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:02.009+0000 7f22517d8640 1 --2- 172.21.15.2:0/2952706910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c065c40 0x7f224c10afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:02.009+0000 7f22517d8640 1 -- 172.21.15.2:0/2952706910 >> 172.21.15.2:0/2952706910 conn(0x7f224c0f6c10 msgr2=0x7f224c0f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:02.009+0000 7f22517d8640 1 -- 172.21.15.2:0/2952706910 shutdown_connections 2024-09-17T01:02:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:02.009+0000 7f22517d8640 1 -- 172.21.15.2:0/2952706910 wait complete. 2024-09-17T01:02:02.009 INFO:tasks.workunit.client.1.smithi099.stdout:2/590: symlink d2/d9/d25/d26/d1b/d2c/d5d/lbe 0 2024-09-17T01:02:02.009 INFO:tasks.workunit.client.1.smithi099.stdout:2/591: write d2/d9/d25/d97/fa1 [1628352,6732] 0 2024-09-17T01:02:02.009 INFO:tasks.workunit.client.1.smithi099.stdout:8/688: mkdir d0/d1f/d90/db8/dde/d29/d4b/db3/de9 0 2024-09-17T01:02:02.011 INFO:tasks.workunit.client.1.smithi099.stdout:8/689: creat d0/d1f/d55/fea x:0 0 0 2024-09-17T01:02:02.012 INFO:tasks.workunit.client.1.smithi099.stdout:2/592: getdents d2/d9/d25/d26/d1b/d2c 0 2024-09-17T01:02:02.012 INFO:tasks.workunit.client.1.smithi099.stdout:2/593: fdatasync d2/d9/d25/d26/d1b/d2c/f9c 0 2024-09-17T01:02:02.013 INFO:tasks.workunit.client.1.smithi099.stdout:8/690: creat d0/feb x:0 0 0 2024-09-17T01:02:02.013 INFO:tasks.workunit.client.1.smithi099.stdout:8/691: creat d0/d1f/d90/fec x:0 0 0 2024-09-17T01:02:02.013 INFO:tasks.workunit.client.1.smithi099.stdout:8/692: write d0/d1f/fb4 [1179423,13671] 0 2024-09-17T01:02:02.013 INFO:tasks.workunit.client.1.smithi099.stdout:8/693: chown d0/d1f/d90/la7 479413 1 2024-09-17T01:02:02.014 INFO:tasks.workunit.client.1.smithi099.stdout:2/594: unlink d2/l73 0 2024-09-17T01:02:02.014 INFO:tasks.workunit.client.1.smithi099.stdout:2/595: creat d2/d9/d25/d26/d1b/d2c/d5d/fbf x:0 0 0 2024-09-17T01:02:02.017 INFO:tasks.workunit.client.1.smithi099.stdout:2/596: symlink d2/d9/d17/d58/lc0 0 2024-09-17T01:02:02.017 INFO:tasks.workunit.client.1.smithi099.stdout:2/597: write d2/d9/d17/d58/f71 [597460,76364] 0 2024-09-17T01:02:02.017 INFO:tasks.workunit.client.1.smithi099.stdout:2/598: readlink d2/d9/d17/d58/lc0 0 2024-09-17T01:02:02.017 INFO:tasks.workunit.client.1.smithi099.stdout:1/842: read d0/de2/f100 [3563364,76568] 0 2024-09-17T01:02:02.018 INFO:tasks.workunit.client.1.smithi099.stdout:2/599: symlink d2/d9/d25/d26/d1b/d61/d7d/d85/d98/d9a/lc1 0 2024-09-17T01:02:02.019 INFO:tasks.workunit.client.1.smithi099.stdout:1/843: creat d0/d8/d49/d94/de0/dba/f11a x:0 0 0 2024-09-17T01:02:02.019 INFO:tasks.workunit.client.1.smithi099.stdout:1/844: getdents d0/d8/d38/d56 0 2024-09-17T01:02:02.020 INFO:tasks.workunit.client.1.smithi099.stdout:2/600: mknod d2/d9/d25/d26/d1b/d61/d7d/d85/d98/d9a/cc2 0 2024-09-17T01:02:02.020 INFO:tasks.workunit.client.1.smithi099.stdout:1/845: getdents d0/db6 0 2024-09-17T01:02:02.021 INFO:tasks.workunit.client.1.smithi099.stdout:1/846: mkdir d0/d8/d38/d8a/d112/d11b 0 2024-09-17T01:02:02.022 INFO:tasks.workunit.client.1.smithi099.stdout:1/847: symlink d0/d8/dbf/l11c 0 2024-09-17T01:02:02.036 INFO:tasks.workunit.client.1.smithi099.stdout:1/848: dread d0/d8/d38/d8a/dd0/ddc/ffa [0,4194304] 0 2024-09-17T01:02:02.040 INFO:tasks.workunit.client.0.smithi002.stdout:9/624: dwrite d5/dc/f4e [0,4194304] 0 2024-09-17T01:02:02.049 INFO:tasks.workunit.client.0.smithi002.stdout:3/661: dwrite d0/d3/d33/d40/f52 [0,4194304] 0 2024-09-17T01:02:02.056 INFO:tasks.workunit.client.1.smithi099.stdout:8/694: dwrite d0/d1f/d31/d4c/f70 [0,4194304] 0 2024-09-17T01:02:02.057 INFO:tasks.workunit.client.0.smithi002.stdout:9/625: dwrite d5/dc/d26/d5c/d6b/d75/f42 [0,4194304] 0 2024-09-17T01:02:02.057 INFO:tasks.workunit.client.0.smithi002.stdout:9/626: chown d5/dc/d26/d5c/d6b/d75/d36 146653989 1 2024-09-17T01:02:02.057 INFO:tasks.workunit.client.1.smithi099.stdout:7/639: dwrite d1/d2c/d5c/d12/f53 [0,4194304] 0 2024-09-17T01:02:02.057 INFO:tasks.workunit.client.1.smithi099.stdout:7/640: readlink d1/d2c/d47/lb1 0 2024-09-17T01:02:02.059 INFO:tasks.workunit.client.1.smithi099.stdout:1/849: dwrite d0/d2/de/d8b/f7f [0,4194304] 0 2024-09-17T01:02:02.061 INFO:tasks.workunit.client.0.smithi002.stdout:3/662: write d0/f16 [1894237,109672] 0 2024-09-17T01:02:02.064 INFO:tasks.workunit.client.1.smithi099.stdout:7/641: mknod d1/d2c/d5c/d1c/d5a/d6f/db6/ccc 0 2024-09-17T01:02:02.064 INFO:tasks.workunit.client.1.smithi099.stdout:7/642: write d1/d2c/d47/d48/f69 [239836,19589] 0 2024-09-17T01:02:02.070 INFO:tasks.workunit.client.1.smithi099.stdout:7/643: stat d1/d2c/d47/lb1 0 2024-09-17T01:02:02.071 INFO:tasks.workunit.client.1.smithi099.stdout:8/695: dread d0/d1f/d90/db8/dde/d29/d4b/fa6 [0,4194304] 0 2024-09-17T01:02:02.071 INFO:tasks.workunit.client.1.smithi099.stdout:2/601: dwrite d2/d9/d25/d26/d1b/d2c/f48 [0,4194304] 0 2024-09-17T01:02:02.073 INFO:tasks.workunit.client.1.smithi099.stdout:7/644: mkdir d1/d2c/d5c/d1c/d5a/db3/dcd 0 2024-09-17T01:02:02.073 INFO:tasks.workunit.client.1.smithi099.stdout:7/645: chown d1/d37/d4f/fb8 12009 1 2024-09-17T01:02:02.073 INFO:tasks.workunit.client.1.smithi099.stdout:7/646: read - d1/d37/d78/fb5 zero size 2024-09-17T01:02:02.075 INFO:tasks.workunit.client.1.smithi099.stdout:7/647: rename d1/d2c/d47/d48/c49 to d1/d2c/d5c/d12/cce 0 2024-09-17T01:02:02.077 INFO:tasks.workunit.client.1.smithi099.stdout:7/648: rename d1/d2c/d5c/d1c/fa2 to d1/d2c/d47/d48/d60/fcf 0 2024-09-17T01:02:02.080 INFO:tasks.workunit.client.1.smithi099.stdout:1/850: dwrite d0/d2/d18/f96 [0,4194304] 0 2024-09-17T01:02:02.083 INFO:tasks.workunit.client.1.smithi099.stdout:1/851: symlink d0/d2/de/d8b/da7/d98/l11d 0 2024-09-17T01:02:02.084 INFO:tasks.workunit.client.1.smithi099.stdout:1/852: dread d0/d8/d38/d56/d93/fec [0,4194304] 0 2024-09-17T01:02:02.087 INFO:tasks.workunit.client.1.smithi099.stdout:8/696: write d0/d1f/d90/db8/dde/d29/f5f [1677810,120932] 0 2024-09-17T01:02:02.089 INFO:tasks.workunit.client.1.smithi099.stdout:8/697: mknod d0/d1f/d55/d95/de2/ced 0 2024-09-17T01:02:02.090 INFO:tasks.workunit.client.1.smithi099.stdout:8/698: stat d0/d1f/d90/db8/dde/d29/d4b/f8f 0 2024-09-17T01:02:02.090 INFO:tasks.workunit.client.1.smithi099.stdout:8/699: write d0/d1f/d90/fdc [332584,8179] 0 2024-09-17T01:02:02.090 INFO:tasks.workunit.client.1.smithi099.stdout:8/700: mknod d0/d41/d5a/dcd/cee 0 2024-09-17T01:02:02.095 INFO:tasks.workunit.client.1.smithi099.stdout:2/602: dwrite d2/d9/d25/d26/d1b/d2c/d3f/f45 [4194304,4194304] 0 2024-09-17T01:02:02.097 INFO:tasks.workunit.client.1.smithi099.stdout:2/603: rename d2/d9/d25/d26/d1b/d2c/d5d/fbf to d2/d9/d25/d26/d1b/dad/fc3 0 2024-09-17T01:02:02.098 INFO:tasks.workunit.client.1.smithi099.stdout:8/701: dread d0/d1f/d31/d4c/d8c/fc0 [0,4194304] 0 2024-09-17T01:02:02.099 INFO:tasks.workunit.client.1.smithi099.stdout:8/702: dread - d0/d1f/d90/fec zero size 2024-09-17T01:02:02.110 INFO:tasks.workunit.client.1.smithi099.stdout:8/703: write d0/d1f/d90/db8/dde/f49 [163189,106568] 0 2024-09-17T01:02:02.110 INFO:tasks.workunit.client.1.smithi099.stdout:8/704: dread - d0/d1f/d31/fc8 zero size 2024-09-17T01:02:02.110 INFO:tasks.workunit.client.1.smithi099.stdout:8/705: truncate d0/d41/d5a/fa0 860314 0 2024-09-17T01:02:02.111 INFO:tasks.workunit.client.1.smithi099.stdout:8/706: chown d0/d1f/d90/db8/dde 0 1 2024-09-17T01:02:02.111 INFO:tasks.workunit.client.1.smithi099.stdout:8/707: fsync d0/f18 0 2024-09-17T01:02:02.116 INFO:tasks.workunit.client.1.smithi099.stdout:2/604: dwrite d2/f1c [0,4194304] 0 2024-09-17T01:02:02.117 INFO:tasks.workunit.client.1.smithi099.stdout:2/605: link d2/l81 d2/d9/d17/d83/dae/lc4 0 2024-09-17T01:02:02.117 INFO:tasks.workunit.client.1.smithi099.stdout:2/606: fsync d2/d9/d25/d26/d1b/d2c/d5d/f94 0 2024-09-17T01:02:02.117 INFO:tasks.workunit.client.1.smithi099.stdout:2/607: chown d2/d9/d25/d26/d1b/d2c/d3f/fb6 494 1 2024-09-17T01:02:02.117 INFO:tasks.workunit.client.1.smithi099.stdout:2/608: rename d2/l81 to d2/d9/d25/d26/d1b/d2c/d9b/lc5 0 2024-09-17T01:02:02.117 INFO:tasks.workunit.client.1.smithi099.stdout:2/609: mknod d2/d9/d17/d83/d8d/cc6 0 2024-09-17T01:02:02.124 INFO:tasks.workunit.client.1.smithi099.stdout:2/610: dread d2/d9/d25/d26/d1b/d61/f6a [0,4194304] 0 2024-09-17T01:02:02.125 INFO:tasks.workunit.client.1.smithi099.stdout:2/611: truncate d2/d9/d25/d26/d95/fa6 3402749 0 2024-09-17T01:02:02.126 INFO:tasks.workunit.client.1.smithi099.stdout:2/612: creat d2/fc7 x:0 0 0 2024-09-17T01:02:02.126 INFO:tasks.workunit.client.1.smithi099.stdout:2/613: dread - d2/d9/d25/d26/faf zero size 2024-09-17T01:02:02.127 INFO:tasks.workunit.client.1.smithi099.stdout:2/614: truncate d2/d9/d25/d26/f32 131196 0 2024-09-17T01:02:02.129 INFO:tasks.workunit.client.1.smithi099.stdout:2/615: dread d2/d9/d25/f75 [0,4194304] 0 2024-09-17T01:02:02.130 INFO:tasks.workunit.client.1.smithi099.stdout:2/616: write d2/d9/d25/f75 [58946,98454] 0 2024-09-17T01:02:02.131 INFO:tasks.workunit.client.1.smithi099.stdout:2/617: write d2/d9/d17/d58/faa [103343,5895] 0 2024-09-17T01:02:02.132 INFO:tasks.workunit.client.1.smithi099.stdout:4/654: sync 2024-09-17T01:02:02.132 INFO:tasks.workunit.client.1.smithi099.stdout:9/734: sync 2024-09-17T01:02:02.132 INFO:tasks.workunit.client.1.smithi099.stdout:0/672: sync 2024-09-17T01:02:02.132 INFO:tasks.workunit.client.1.smithi099.stdout:9/735: creat da/d18/d5e/fed x:0 0 0 2024-09-17T01:02:02.133 INFO:tasks.workunit.client.1.smithi099.stdout:2/618: dread d2/d9/d25/d26/d1b/dad/f3a [0,4194304] 0 2024-09-17T01:02:02.134 INFO:tasks.workunit.client.1.smithi099.stdout:0/673: mkdir da/df/d1a/d63/d6a/dd9 0 2024-09-17T01:02:02.134 INFO:tasks.workunit.client.1.smithi099.stdout:0/674: fsync da/df/d1a/d56/f74 0 2024-09-17T01:02:02.134 INFO:tasks.workunit.client.1.smithi099.stdout:0/675: write da/d12/d22/fc4 [266343,72703] 0 2024-09-17T01:02:02.137 INFO:tasks.workunit.client.1.smithi099.stdout:9/736: mknod da/d21/cee 0 2024-09-17T01:02:02.146 INFO:tasks.workunit.client.1.smithi099.stdout:4/655: dread d7/dd/d21/fb2 [0,4194304] 0 2024-09-17T01:02:02.148 INFO:tasks.workunit.client.1.smithi099.stdout:0/676: write da/df/d1a/d49/dac/f50 [281765,63111] 0 2024-09-17T01:02:02.151 INFO:tasks.workunit.client.1.smithi099.stdout:4/656: creat d7/dd/d92/fe1 x:0 0 0 2024-09-17T01:02:02.151 INFO:tasks.workunit.client.1.smithi099.stdout:4/657: chown d7/dd/de/d17/caf 70 1 2024-09-17T01:02:02.151 INFO:tasks.workunit.client.1.smithi099.stdout:9/737: dread da/d21/d2a/f54 [0,4194304] 0 2024-09-17T01:02:02.152 INFO:tasks.workunit.client.1.smithi099.stdout:8/708: dread d0/f74 [0,4194304] 0 2024-09-17T01:02:02.154 INFO:tasks.workunit.client.1.smithi099.stdout:8/709: symlink d0/d1f/lef 0 2024-09-17T01:02:02.154 INFO:tasks.workunit.client.1.smithi099.stdout:8/710: chown d0/d1f/d31/d4c/f67 17 1 2024-09-17T01:02:02.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/711: write d0/d1f/d90/db8/dde/d29/f58 [671244,60078] 0 2024-09-17T01:02:02.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/712: write d0/d1f/d31/fc8 [583593,128096] 0 2024-09-17T01:02:02.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/713: stat d0/d41/d5a/fd4 0 2024-09-17T01:02:02.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:01 smithi002 ceph-mon[27650]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:02.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:01 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/1524973224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:02:02.155 INFO:tasks.workunit.client.1.smithi099.stdout:8/714: fsync d0/d1f/d90/db8/dde/dc3/fd1 0 2024-09-17T01:02:02.161 INFO:tasks.workunit.client.1.smithi099.stdout:4/658: write d7/dd/d21/f38 [1370971,37291] 0 2024-09-17T01:02:02.162 INFO:tasks.workunit.client.1.smithi099.stdout:4/659: write d7/dd/d21/f41 [123465,69574] 0 2024-09-17T01:02:02.162 INFO:tasks.workunit.client.1.smithi099.stdout:4/660: write d7/dd/de/fb8 [502267,43472] 0 2024-09-17T01:02:02.163 INFO:tasks.workunit.client.1.smithi099.stdout:4/661: mkdir d7/dd/d21/d7b/de2 0 2024-09-17T01:02:02.165 INFO:tasks.workunit.client.1.smithi099.stdout:4/662: symlink d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/le3 0 2024-09-17T01:02:02.166 INFO:tasks.workunit.client.1.smithi099.stdout:1/853: dwrite d0/d8/d49/d94/f6f [0,4194304] 0 2024-09-17T01:02:02.166 INFO:tasks.workunit.client.1.smithi099.stdout:1/854: read - d0/d8/d49/d94/fda zero size 2024-09-17T01:02:02.168 INFO:tasks.workunit.client.1.smithi099.stdout:4/663: symlink d7/dd/d21/d26/d3f/d5b/le4 0 2024-09-17T01:02:02.168 INFO:tasks.workunit.client.1.smithi099.stdout:4/664: fdatasync d7/dd/d21/d26/f51 0 2024-09-17T01:02:02.169 INFO:tasks.workunit.client.1.smithi099.stdout:0/677: dwrite da/d59/f75 [0,4194304] 0 2024-09-17T01:02:02.173 INFO:tasks.workunit.client.1.smithi099.stdout:0/678: mknod da/d12/d22/d66/cda 0 2024-09-17T01:02:02.173 INFO:tasks.workunit.client.1.smithi099.stdout:0/679: read - da/d12/d22/d66/f6d zero size 2024-09-17T01:02:02.174 INFO:tasks.workunit.client.1.smithi099.stdout:0/680: symlink da/d12/d2b/dab/dba/ldb 0 2024-09-17T01:02:02.176 INFO:tasks.workunit.client.1.smithi099.stdout:0/681: mknod da/df/d4d/cdc 0 2024-09-17T01:02:02.179 INFO:tasks.workunit.client.1.smithi099.stdout:4/665: getdents d7/dd/d92 0 2024-09-17T01:02:02.180 INFO:tasks.workunit.client.1.smithi099.stdout:1/855: read d0/d8/d38/d56/f63 [1742383,57428] 0 2024-09-17T01:02:02.182 INFO:tasks.workunit.client.1.smithi099.stdout:8/715: getdents d0/d1f 0 2024-09-17T01:02:02.182 INFO:tasks.workunit.client.1.smithi099.stdout:8/716: chown d0/lc6 21325 1 2024-09-17T01:02:02.183 INFO:tasks.workunit.client.1.smithi099.stdout:8/717: unlink d0/d1f/f81 0 2024-09-17T01:02:02.184 INFO:tasks.workunit.client.1.smithi099.stdout:8/718: read - d0/d1f/d31/d4c/d8c/fe7 zero size 2024-09-17T01:02:02.186 INFO:tasks.workunit.client.1.smithi099.stdout:8/719: rename d0/d41/l52 to d0/d41/lf0 0 2024-09-17T01:02:02.187 INFO:tasks.workunit.client.1.smithi099.stdout:0/682: write da/d12/d22/f7e [2121181,63991] 0 2024-09-17T01:02:02.187 INFO:tasks.workunit.client.1.smithi099.stdout:0/683: fdatasync da/df/d1a/f5f 0 2024-09-17T01:02:02.189 INFO:tasks.workunit.client.1.smithi099.stdout:8/720: fsync d0/d1f/d55/fea 0 2024-09-17T01:02:02.196 INFO:tasks.workunit.client.0.smithi002.stdout:9/627: rename d5/dc/d26/d5c/d6b/d75/d57/d9f to d5/dc/dbc 0 2024-09-17T01:02:02.196 INFO:tasks.workunit.client.0.smithi002.stdout:9/628: write d5/dc/f99 [408238,104657] 0 2024-09-17T01:02:02.197 INFO:tasks.workunit.client.1.smithi099.stdout:8/721: read - d0/d1f/d90/db8/dde/dc3/fd1 zero size 2024-09-17T01:02:02.197 INFO:tasks.workunit.client.0.smithi002.stdout:9/629: creat d5/dc/d26/fbd x:0 0 0 2024-09-17T01:02:02.198 INFO:tasks.workunit.client.1.smithi099.stdout:4/666: dwrite d7/dd/d21/d26/d3f/d5b/f2d [0,4194304] 0 2024-09-17T01:02:02.198 INFO:tasks.workunit.client.1.smithi099.stdout:0/684: dread da/df/d1a/d63/d6a/f8a [0,4194304] 0 2024-09-17T01:02:02.199 INFO:tasks.workunit.client.0.smithi002.stdout:9/630: rename d5/dc/f4e to d5/dc/d26/d5c/d6b/d75/d57/fbe 0 2024-09-17T01:02:02.199 INFO:tasks.workunit.client.0.smithi002.stdout:9/631: link d5/l8 d5/d8a/d9d/lbf 0 2024-09-17T01:02:02.203 INFO:tasks.workunit.client.1.smithi099.stdout:0/685: unlink da/df/d1a/d49/d71/fc2 0 2024-09-17T01:02:02.207 INFO:tasks.workunit.client.0.smithi002.stdout:9/632: dread d5/dc/f3d [0,4194304] 0 2024-09-17T01:02:02.208 INFO:tasks.workunit.client.1.smithi099.stdout:8/722: write d0/f7c [3555806,90282] 0 2024-09-17T01:02:02.208 INFO:tasks.workunit.client.1.smithi099.stdout:8/723: fdatasync d0/d1f/d55/fc7 0 2024-09-17T01:02:02.209 INFO:tasks.workunit.client.0.smithi002.stdout:9/633: readlink d5/dc/l35 0 2024-09-17T01:02:02.209 INFO:tasks.workunit.client.0.smithi002.stdout:9/634: creat d5/dc/d26/d46/d47/d89/fc0 x:0 0 0 2024-09-17T01:02:02.210 INFO:tasks.workunit.client.0.smithi002.stdout:9/635: rmdir d5/d8a/d9d 39 2024-09-17T01:02:02.210 INFO:tasks.workunit.client.1.smithi099.stdout:8/724: creat d0/d1f/d90/db8/dde/d29/d9c/ff1 x:0 0 0 2024-09-17T01:02:02.211 INFO:tasks.workunit.client.1.smithi099.stdout:8/725: stat d0/c22 0 2024-09-17T01:02:02.211 INFO:tasks.workunit.client.1.smithi099.stdout:0/686: write da/d12/d2b/dab/db5/f58 [37818,93734] 0 2024-09-17T01:02:02.212 INFO:tasks.workunit.client.0.smithi002.stdout:9/636: unlink d5/dc/d26/d63/d66/fa4 0 2024-09-17T01:02:02.216 INFO:tasks.workunit.client.0.smithi002.stdout:6/658: sync 2024-09-17T01:02:02.216 INFO:tasks.workunit.client.0.smithi002.stdout:7/706: sync 2024-09-17T01:02:02.216 INFO:tasks.workunit.client.0.smithi002.stdout:8/812: sync 2024-09-17T01:02:02.216 INFO:tasks.workunit.client.0.smithi002.stdout:6/659: readlink d2/l1e 0 2024-09-17T01:02:02.216 INFO:tasks.workunit.client.0.smithi002.stdout:6/660: write d2/f4 [2919521,6562] 0 2024-09-17T01:02:02.216 INFO:tasks.workunit.client.0.smithi002.stdout:6/661: chown d2/d1d/d27 39 1 2024-09-17T01:02:02.216 INFO:tasks.workunit.client.1.smithi099.stdout:4/667: dwrite d7/dd/d21/f77 [4194304,4194304] 0 2024-09-17T01:02:02.217 INFO:tasks.workunit.client.1.smithi099.stdout:4/668: chown d7/dd/de/d10/d6b/d82/d8a/d9a/ca2 0 1 2024-09-17T01:02:02.217 INFO:tasks.workunit.client.0.smithi002.stdout:7/707: mknod d1/dac/ce4 0 2024-09-17T01:02:02.217 INFO:tasks.workunit.client.0.smithi002.stdout:7/708: write d1/d14/d1d/d28/d2d/f70 [4297465,27410] 0 2024-09-17T01:02:02.217 INFO:tasks.workunit.client.0.smithi002.stdout:6/662: dread d2/d1d/d27/d30/f77 [0,4194304] 0 2024-09-17T01:02:02.218 INFO:tasks.workunit.client.0.smithi002.stdout:8/813: mknod d2/d9/c10b 0 2024-09-17T01:02:02.218 INFO:tasks.workunit.client.0.smithi002.stdout:8/814: dread - d2/d3/d5f/d98/da5/d71/fa2 zero size 2024-09-17T01:02:02.218 INFO:tasks.workunit.client.0.smithi002.stdout:6/663: read d2/d1d/d2d/d35/d6d/fa1 [245978,72125] 0 2024-09-17T01:02:02.221 INFO:tasks.workunit.client.1.smithi099.stdout:8/726: dread d0/d1f/d90/db8/dde/d64/f93 [0,4194304] 0 2024-09-17T01:02:02.221 INFO:tasks.workunit.client.1.smithi099.stdout:8/727: fdatasync d0/d1f/d55/f7e 0 2024-09-17T01:02:02.221 INFO:tasks.workunit.client.1.smithi099.stdout:8/728: stat d0/d1f/d90/fb7 0 2024-09-17T01:02:02.221 INFO:tasks.workunit.client.1.smithi099.stdout:8/729: truncate d0/d1f/d90/db8/dde/d29/f58 1263084 0 2024-09-17T01:02:02.222 INFO:tasks.workunit.client.0.smithi002.stdout:8/815: link d2/d3/d5f/d98/da5/d4f/d58/dbd/cc6 d2/d3/d5f/d98/da5/d71/d89/c10c 0 2024-09-17T01:02:02.222 INFO:tasks.workunit.client.0.smithi002.stdout:8/816: dread - d2/d3/d5f/d98/da5/d4f/d77/db0/f109 zero size 2024-09-17T01:02:02.222 INFO:tasks.workunit.client.0.smithi002.stdout:8/817: write d2/d3/d5f/d98/da5/d4f/d58/fec [63698,19715] 0 2024-09-17T01:02:02.223 INFO:tasks.workunit.client.0.smithi002.stdout:6/664: getdents d2/d1d/d26/d49/d7d/d8c 0 2024-09-17T01:02:02.225 INFO:tasks.workunit.client.0.smithi002.stdout:8/818: creat d2/d3/d5f/d98/da5/d4f/d77/f10d x:0 0 0 2024-09-17T01:02:02.226 INFO:tasks.workunit.client.0.smithi002.stdout:5/651: sync 2024-09-17T01:02:02.228 INFO:tasks.workunit.client.0.smithi002.stdout:9/637: read d5/f10 [5282433,54251] 0 2024-09-17T01:02:02.228 INFO:tasks.workunit.client.0.smithi002.stdout:9/638: readlink d5/dc/d26/l28 0 2024-09-17T01:02:02.229 INFO:tasks.workunit.client.0.smithi002.stdout:8/819: unlink d2/d3/d5f/f8f 0 2024-09-17T01:02:02.229 INFO:tasks.workunit.client.0.smithi002.stdout:8/820: creat d2/d3/de6/f10e x:0 0 0 2024-09-17T01:02:02.229 INFO:tasks.workunit.client.0.smithi002.stdout:8/821: stat d2/d1c/fe2 0 2024-09-17T01:02:02.233 INFO:tasks.workunit.client.0.smithi002.stdout:5/652: creat d2/d2d/d10/d23/d6e/fd1 x:0 0 0 2024-09-17T01:02:02.233 INFO:tasks.workunit.client.0.smithi002.stdout:5/653: getdents d2/d2d/d10/d14/dce 0 2024-09-17T01:02:02.239 INFO:tasks.workunit.client.0.smithi002.stdout:5/654: creat d2/d2d/d10/d14/d19/da5/fd2 x:0 0 0 2024-09-17T01:02:02.243 INFO:tasks.workunit.client.1.smithi099.stdout:4/669: dwrite d7/dd/d21/fd4 [0,4194304] 0 2024-09-17T01:02:02.244 INFO:tasks.workunit.client.1.smithi099.stdout:4/670: symlink d7/le5 0 2024-09-17T01:02:02.247 INFO:tasks.workunit.client.0.smithi002.stdout:5/655: dread d2/de/f4f [0,4194304] 0 2024-09-17T01:02:02.247 INFO:tasks.workunit.client.0.smithi002.stdout:5/656: fsync d2/d2d/d10/d14/d19/d39/d64/fb8 0 2024-09-17T01:02:02.252 INFO:tasks.workunit.client.1.smithi099.stdout:8/730: dwrite d0/d1f/d90/db8/dde/d29/d4b/f5c [0,4194304] 0 2024-09-17T01:02:02.253 INFO:tasks.workunit.client.0.smithi002.stdout:6/665: dwrite d2/d1d/d26/f2a [0,4194304] 0 2024-09-17T01:02:02.253 INFO:tasks.workunit.client.0.smithi002.stdout:7/709: dwrite d1/d14/d1d/d29/f2f [0,4194304] 0 2024-09-17T01:02:02.254 INFO:tasks.workunit.client.1.smithi099.stdout:8/731: mkdir d0/d1f/d90/db8/dde/d29/d4b/df2 0 2024-09-17T01:02:02.254 INFO:tasks.workunit.client.1.smithi099.stdout:8/732: chown d0/d1f/d31/f7b 326080947 1 2024-09-17T01:02:02.255 INFO:tasks.workunit.client.0.smithi002.stdout:7/710: readlink d1/l3a 0 2024-09-17T01:02:02.255 INFO:tasks.workunit.client.0.smithi002.stdout:9/639: dwrite d5/dc/d26/d5c/d6b/d75/d57/d7a/fb5 [0,4194304] 0 2024-09-17T01:02:02.255 INFO:tasks.workunit.client.0.smithi002.stdout:9/640: readlink d5/l37 0 2024-09-17T01:02:02.255 INFO:tasks.workunit.client.0.smithi002.stdout:9/641: stat d5/dc/d26/d46/f50 0 2024-09-17T01:02:02.256 INFO:tasks.workunit.client.1.smithi099.stdout:8/733: read d0/d1f/d90/db8/dde/f3a [4350154,51705] 0 2024-09-17T01:02:02.258 INFO:tasks.workunit.client.1.smithi099.stdout:8/734: link d0/d1f/d90/fec d0/ff3 0 2024-09-17T01:02:02.258 INFO:tasks.workunit.client.1.smithi099.stdout:8/735: read d0/d1f/d90/db8/dde/d29/f57 [1190011,12781] 0 2024-09-17T01:02:02.261 INFO:tasks.workunit.client.0.smithi002.stdout:8/822: rename d2/d3 to d2/d1c/d28/dad/dcd/dd1/ddb/d10f 0 2024-09-17T01:02:02.264 INFO:tasks.workunit.client.0.smithi002.stdout:9/642: truncate d5/f29 3123888 0 2024-09-17T01:02:02.265 INFO:tasks.workunit.client.0.smithi002.stdout:7/711: dread d1/d24/f56 [0,4194304] 0 2024-09-17T01:02:02.265 INFO:tasks.workunit.client.0.smithi002.stdout:8/823: getdents d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f 0 2024-09-17T01:02:02.267 INFO:tasks.workunit.client.1.smithi099.stdout:8/736: write d0/d41/f9d [3302257,32947] 0 2024-09-17T01:02:02.267 INFO:tasks.workunit.client.1.smithi099.stdout:8/737: write d0/d41/d5a/dcd/fda [654859,41617] 0 2024-09-17T01:02:02.267 INFO:tasks.workunit.client.0.smithi002.stdout:7/712: mkdir d1/d14/d1d/d28/d40/d58/de5 0 2024-09-17T01:02:02.268 INFO:tasks.workunit.client.0.smithi002.stdout:8/824: getdents d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f 0 2024-09-17T01:02:02.269 INFO:tasks.workunit.client.0.smithi002.stdout:8/825: fsync d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/f7b 0 2024-09-17T01:02:02.271 INFO:tasks.workunit.client.0.smithi002.stdout:9/643: rename d5/dc/f69 to d5/dc/d26/d46/db4/fc1 0 2024-09-17T01:02:02.271 INFO:tasks.workunit.client.0.smithi002.stdout:9/644: chown d5/dc/d26/d5c/d6b/f9b 0 1 2024-09-17T01:02:02.272 INFO:tasks.workunit.client.0.smithi002.stdout:5/657: dwrite d2/de/f34 [0,4194304] 0 2024-09-17T01:02:02.273 INFO:tasks.workunit.client.0.smithi002.stdout:7/713: rename d1/d14/d67/dc0/dcd/d45/cc9 to d1/ce6 0 2024-09-17T01:02:02.273 INFO:tasks.workunit.client.0.smithi002.stdout:7/714: read - d1/d14/d1d/d28/d6b/fdf zero size 2024-09-17T01:02:02.275 INFO:tasks.workunit.client.0.smithi002.stdout:6/666: dread d2/d1d/d27/d30/fb7 [0,4194304] 0 2024-09-17T01:02:02.276 INFO:tasks.workunit.client.0.smithi002.stdout:1/675: sync 2024-09-17T01:02:02.277 INFO:tasks.workunit.client.0.smithi002.stdout:9/645: truncate d5/dc/d26/d5c/d6b/d75/d57/d7a/f8b 483381 0 2024-09-17T01:02:02.279 INFO:tasks.workunit.client.0.smithi002.stdout:8/826: mknod d2/d9/c110 0 2024-09-17T01:02:02.279 INFO:tasks.workunit.client.1.smithi099.stdout:8/738: dread d0/f7c [0,4194304] 0 2024-09-17T01:02:02.279 INFO:tasks.workunit.client.1.smithi099.stdout:6/769: sync 2024-09-17T01:02:02.279 INFO:tasks.workunit.client.1.smithi099.stdout:5/724: sync 2024-09-17T01:02:02.280 INFO:tasks.workunit.client.1.smithi099.stdout:8/739: creat d0/d1f/d90/db8/dde/d29/ff4 x:0 0 0 2024-09-17T01:02:02.282 INFO:tasks.workunit.client.0.smithi002.stdout:5/658: mkdir d2/d2d/d10/d9b/dd3 0 2024-09-17T01:02:02.282 INFO:tasks.workunit.client.1.smithi099.stdout:6/770: creat dc/d27/dd7/dde/ddf/d108/f109 x:0 0 0 2024-09-17T01:02:02.284 INFO:tasks.workunit.client.1.smithi099.stdout:8/740: link d0/d1f/d31/c84 d0/d1f/db5/cf5 0 2024-09-17T01:02:02.284 INFO:tasks.workunit.client.0.smithi002.stdout:6/667: rename d2/dc/c8e to d2/dc/d24/d53/d83/da9/d4c/cd2 0 2024-09-17T01:02:02.284 INFO:tasks.workunit.client.1.smithi099.stdout:6/771: mknod dc/c10a 0 2024-09-17T01:02:02.285 INFO:tasks.workunit.client.0.smithi002.stdout:8/827: mknod d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d58/dbd/c111 0 2024-09-17T01:02:02.286 INFO:tasks.workunit.client.1.smithi099.stdout:8/741: dread d0/fcb [4194304,4194304] 0 2024-09-17T01:02:02.286 INFO:tasks.workunit.client.1.smithi099.stdout:8/742: fdatasync d0/d1f/d90/db8/dde/d29/d4b/db3/fd5 0 2024-09-17T01:02:02.287 INFO:tasks.workunit.client.0.smithi002.stdout:5/659: creat d2/d2d/d10/d9b/dd3/fd4 x:0 0 0 2024-09-17T01:02:02.287 INFO:tasks.workunit.client.0.smithi002.stdout:5/660: dread - d2/d2d/d10/d14/d19/d39/d48/d9d/dba/f81 zero size 2024-09-17T01:02:02.287 INFO:tasks.workunit.client.0.smithi002.stdout:5/661: fdatasync d2/d2d/d10/d14/d19/da5/db0/f74 0 2024-09-17T01:02:02.290 INFO:tasks.workunit.client.0.smithi002.stdout:6/668: link d2/dc/d24/d53/d9e/fc8 d2/d1d/d27/d30/fd3 0 2024-09-17T01:02:02.292 INFO:tasks.workunit.client.0.smithi002.stdout:8/828: unlink d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/f46 0 2024-09-17T01:02:02.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:01 smithi099 ceph-mon[34357]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:02.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:01 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/1524973224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:02:02.295 INFO:tasks.workunit.client.1.smithi099.stdout:6/772: dread dc/fe [0,4194304] 0 2024-09-17T01:02:02.296 INFO:tasks.workunit.client.0.smithi002.stdout:6/669: rename d2/d1d/d2d/d35/d8d/d43/fd1 to d2/d1d/d27/d87/d94/fd4 0 2024-09-17T01:02:02.297 INFO:tasks.workunit.client.0.smithi002.stdout:0/611: sync 2024-09-17T01:02:02.297 INFO:tasks.workunit.client.0.smithi002.stdout:4/841: sync 2024-09-17T01:02:02.297 INFO:tasks.workunit.client.0.smithi002.stdout:2/726: sync 2024-09-17T01:02:02.297 INFO:tasks.workunit.client.0.smithi002.stdout:3/663: sync 2024-09-17T01:02:02.298 INFO:tasks.workunit.client.0.smithi002.stdout:0/612: write dd/d19/d1c/d1f/d76/f86 [505922,76929] 0 2024-09-17T01:02:02.298 INFO:tasks.workunit.client.0.smithi002.stdout:0/613: chown dd/f13 2 1 2024-09-17T01:02:02.298 INFO:tasks.workunit.client.0.smithi002.stdout:0/614: chown dd/d19/d1c/d33/fa8 55087467 1 2024-09-17T01:02:02.298 INFO:tasks.workunit.client.0.smithi002.stdout:3/664: write d0/d3/d37/dac/da1/fa2 [1417643,58502] 0 2024-09-17T01:02:02.298 INFO:tasks.workunit.client.0.smithi002.stdout:8/829: mknod d2/d1c/d28/da0/c112 0 2024-09-17T01:02:02.302 INFO:tasks.workunit.client.1.smithi099.stdout:8/743: read d0/d1f/d90/db8/dde/f50 [3101817,84723] 0 2024-09-17T01:02:02.302 INFO:tasks.workunit.client.1.smithi099.stdout:8/744: truncate d0/d1f/d90/fac 599594 0 2024-09-17T01:02:02.302 INFO:tasks.workunit.client.0.smithi002.stdout:4/842: symlink d7/d71/d8e/l105 0 2024-09-17T01:02:02.302 INFO:tasks.workunit.client.0.smithi002.stdout:4/843: fdatasync d7/d19/d9f/f58 0 2024-09-17T01:02:02.303 INFO:tasks.workunit.client.1.smithi099.stdout:8/745: mknod d0/d53/de0/cf6 0 2024-09-17T01:02:02.303 INFO:tasks.workunit.client.0.smithi002.stdout:8/830: mknod d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/dab/c113 0 2024-09-17T01:02:02.304 INFO:tasks.workunit.client.0.smithi002.stdout:4/844: link d7/d19/d2e/c35 d7/de/d3a/dac/c106 0 2024-09-17T01:02:02.305 INFO:tasks.workunit.client.0.smithi002.stdout:8/831: link d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d47/cc1 d2/d1c/d28/dad/dcd/dd1/ddb/d10f/dfd/c114 0 2024-09-17T01:02:02.305 INFO:tasks.workunit.client.1.smithi099.stdout:8/746: getdents d0/d1f/d31 0 2024-09-17T01:02:02.306 INFO:tasks.workunit.client.0.smithi002.stdout:4/845: truncate d7/de/d32/f73 316264 0 2024-09-17T01:02:02.307 INFO:tasks.workunit.client.0.smithi002.stdout:8/832: getdents d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d71 0 2024-09-17T01:02:02.307 INFO:tasks.workunit.client.1.smithi099.stdout:8/747: link d0/d41/d5a/c80 d0/d53/de0/cf7 0 2024-09-17T01:02:02.307 INFO:tasks.workunit.client.1.smithi099.stdout:8/748: fsync d0/d1f/d90/db8/dde/d29/fc1 0 2024-09-17T01:02:02.308 INFO:tasks.workunit.client.0.smithi002.stdout:4/846: truncate d7/d19/d9f/d80/fcb 602323 0 2024-09-17T01:02:02.309 INFO:tasks.workunit.client.0.smithi002.stdout:4/847: truncate d7/f12 3624594 0 2024-09-17T01:02:02.309 INFO:tasks.workunit.client.1.smithi099.stdout:6/773: write dc/d1a/f92 [3351815,6200] 0 2024-09-17T01:02:02.310 INFO:tasks.workunit.client.1.smithi099.stdout:6/774: fdatasync dc/d1a/d49/f5b 0 2024-09-17T01:02:02.310 INFO:tasks.workunit.client.1.smithi099.stdout:6/775: getdents dc/d27/dd7/d87/db6/de1 0 2024-09-17T01:02:02.310 INFO:tasks.workunit.client.1.smithi099.stdout:6/776: chown dc/d5d/dae/d96/d60/fdd 54 1 2024-09-17T01:02:02.310 INFO:tasks.workunit.client.0.smithi002.stdout:8/833: getdents d2/d9 0 2024-09-17T01:02:02.310 INFO:tasks.workunit.client.0.smithi002.stdout:8/834: write d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d71/d89/fe1 [200263,82817] 0 2024-09-17T01:02:02.311 INFO:tasks.workunit.client.1.smithi099.stdout:6/777: link dc/d5d/d66/c8f dc/d5d/dae/d96/d60/c10b 0 2024-09-17T01:02:02.311 INFO:tasks.workunit.client.1.smithi099.stdout:6/778: fdatasync dc/d27/f81 0 2024-09-17T01:02:02.312 INFO:tasks.workunit.client.0.smithi002.stdout:0/615: write dd/d19/d1c/db7/db4/f9b [2808078,57671] 0 2024-09-17T01:02:02.313 INFO:tasks.workunit.client.0.smithi002.stdout:0/616: truncate dd/d19/d1a/f92 2667670 0 2024-09-17T01:02:02.314 INFO:tasks.workunit.client.0.smithi002.stdout:0/617: creat dd/d19/da9/fcd x:0 0 0 2024-09-17T01:02:02.314 INFO:tasks.workunit.client.1.smithi099.stdout:8/749: dread d0/d1f/d31/fe5 [0,4194304] 0 2024-09-17T01:02:02.316 INFO:tasks.workunit.client.1.smithi099.stdout:8/750: mkdir d0/d1f/d90/db8/dde/d29/df8 0 2024-09-17T01:02:02.317 INFO:tasks.workunit.client.1.smithi099.stdout:8/751: mkdir d0/d1f/d31/d4c/d8c/df9 0 2024-09-17T01:02:02.317 INFO:tasks.workunit.client.1.smithi099.stdout:8/752: write d0/d1f/d55/fea [217206,36376] 0 2024-09-17T01:02:02.317 INFO:tasks.workunit.client.1.smithi099.stdout:8/753: dread - d0/d41/f9a zero size 2024-09-17T01:02:02.318 INFO:tasks.workunit.client.0.smithi002.stdout:4/848: read d7/de/d32/f40 [468488,89107] 0 2024-09-17T01:02:02.318 INFO:tasks.workunit.client.1.smithi099.stdout:8/754: creat d0/d1f/d90/db8/dde/dbc/ffa x:0 0 0 2024-09-17T01:02:02.318 INFO:tasks.workunit.client.1.smithi099.stdout:8/755: truncate d0/d1f/d90/db8/dde/f6c 1580659 0 2024-09-17T01:02:02.319 INFO:tasks.workunit.client.0.smithi002.stdout:4/849: mkdir d7/d19/d9f/dc2/d107 0 2024-09-17T01:02:02.319 INFO:tasks.workunit.client.0.smithi002.stdout:4/850: read d7/de/fa6 [4007670,13383] 0 2024-09-17T01:02:02.327 INFO:tasks.workunit.client.0.smithi002.stdout:1/676: dwrite d4/d11/d12/d30/d43/d67/fd4 [0,4194304] 0 2024-09-17T01:02:02.327 INFO:tasks.workunit.client.0.smithi002.stdout:9/646: dwrite d5/dc/d26/d63/d66/f78 [0,4194304] 0 2024-09-17T01:02:02.327 INFO:tasks.workunit.client.0.smithi002.stdout:9/647: fdatasync d5/f19 0 2024-09-17T01:02:02.327 INFO:tasks.workunit.client.0.smithi002.stdout:9/648: creat d5/d8a/d9d/da7/fc2 x:0 0 0 2024-09-17T01:02:02.328 INFO:tasks.workunit.client.0.smithi002.stdout:4/851: dread d7/d3f/fb1 [0,4194304] 0 2024-09-17T01:02:02.329 INFO:tasks.workunit.client.0.smithi002.stdout:1/677: mkdir d4/d11/d12/d23/d32/de3 0 2024-09-17T01:02:02.330 INFO:tasks.workunit.client.0.smithi002.stdout:9/649: truncate d5/dc/d26/d5c/d6b/d75/f62 890226 0 2024-09-17T01:02:02.330 INFO:tasks.workunit.client.0.smithi002.stdout:1/678: mkdir d4/d11/d1a/daa/de4 0 2024-09-17T01:02:02.331 INFO:tasks.workunit.client.0.smithi002.stdout:9/650: symlink d5/dc/d26/d63/lc3 0 2024-09-17T01:02:02.337 INFO:tasks.workunit.client.0.smithi002.stdout:5/662: dwrite d2/f4d [0,4194304] 0 2024-09-17T01:02:02.337 INFO:tasks.workunit.client.0.smithi002.stdout:5/663: fdatasync d2/fb9 0 2024-09-17T01:02:02.337 INFO:tasks.workunit.client.0.smithi002.stdout:5/664: fsync d2/f3a 0 2024-09-17T01:02:02.337 INFO:tasks.workunit.client.0.smithi002.stdout:5/665: dread - d2/d2d/d10/d14/d19/da5/db0/fc0 zero size 2024-09-17T01:02:02.337 INFO:tasks.workunit.client.0.smithi002.stdout:1/679: dread d4/d11/d12/d30/d5e/f77 [0,4194304] 0 2024-09-17T01:02:02.337 INFO:tasks.workunit.client.0.smithi002.stdout:3/665: dwrite d0/d31/da7/fba [0,4194304] 0 2024-09-17T01:02:02.338 INFO:tasks.workunit.client.1.smithi099.stdout:5/725: dwrite d2/d8/fc1 [0,4194304] 0 2024-09-17T01:02:02.338 INFO:tasks.workunit.client.1.smithi099.stdout:8/756: dwrite d0/d1f/d90/db8/dde/d29/d4b/f5c [0,4194304] 0 2024-09-17T01:02:02.338 INFO:tasks.workunit.client.0.smithi002.stdout:1/680: read d4/d11/d12/d14/d17/d56/fbf [134146,2276] 0 2024-09-17T01:02:02.338 INFO:tasks.workunit.client.0.smithi002.stdout:1/681: write d4/d11/d12/d14/d17/d3b/f42 [1041301,94389] 0 2024-09-17T01:02:02.340 INFO:tasks.workunit.client.1.smithi099.stdout:5/726: getdents d2/dc4/d90/da4 0 2024-09-17T01:02:02.344 INFO:tasks.workunit.client.0.smithi002.stdout:6/670: rename d2/d1d/d2d/d35/d8d/d43 to d2/d1d/d27/d80/d93/dd5 0 2024-09-17T01:02:02.347 INFO:tasks.workunit.client.0.smithi002.stdout:3/666: link d0/d3/f1a d0/d31/d32/db8/fdb 0 2024-09-17T01:02:02.347 INFO:tasks.workunit.client.0.smithi002.stdout:3/667: truncate d0/d31/d32/f42 1307816 0 2024-09-17T01:02:02.350 INFO:tasks.workunit.client.0.smithi002.stdout:2/727: rename d1b/d74/d93/fe7 to d1b/d1d/f105 0 2024-09-17T01:02:02.350 INFO:tasks.workunit.client.0.smithi002.stdout:2/728: readlink d1b/d8a/dab/lb6 0 2024-09-17T01:02:02.352 INFO:tasks.workunit.client.0.smithi002.stdout:6/671: mkdir d2/d1d/d2d/d35/d6d/dd6 0 2024-09-17T01:02:02.353 INFO:tasks.workunit.client.1.smithi099.stdout:5/727: dread d2/dc/d14/d89/fd5 [0,4194304] 0 2024-09-17T01:02:02.353 INFO:tasks.workunit.client.1.smithi099.stdout:5/728: fdatasync d2/dc/d97/dec/fed 0 2024-09-17T01:02:02.353 INFO:tasks.workunit.client.1.smithi099.stdout:5/729: chown d2/d8/c55 111248348 1 2024-09-17T01:02:02.353 INFO:tasks.workunit.client.1.smithi099.stdout:5/730: chown d2/dc4/d99/dd0/fd6 24488 1 2024-09-17T01:02:02.354 INFO:tasks.workunit.client.1.smithi099.stdout:5/731: link d2/l2c d2/dc4/d99/dd0/lee 0 2024-09-17T01:02:02.356 INFO:tasks.workunit.client.0.smithi002.stdout:8/835: rename d2/d1c/ff5 to d2/d1c/d28/dad/dcd/dd1/f115 0 2024-09-17T01:02:02.358 INFO:tasks.workunit.client.0.smithi002.stdout:2/729: mknod d1b/d3f/d59/d7f/c106 0 2024-09-17T01:02:02.358 INFO:tasks.workunit.client.0.smithi002.stdout:2/730: write d1b/d74/d93/fd0 [518874,47829] 0 2024-09-17T01:02:02.361 INFO:tasks.workunit.client.0.smithi002.stdout:8/836: creat d2/d1c/d28/dad/f116 x:0 0 0 2024-09-17T01:02:02.361 INFO:tasks.workunit.client.0.smithi002.stdout:8/837: truncate d2/d30/fae 635862 0 2024-09-17T01:02:02.361 INFO:tasks.workunit.client.0.smithi002.stdout:8/838: fdatasync d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d58/f60 0 2024-09-17T01:02:02.362 INFO:tasks.workunit.client.0.smithi002.stdout:8/839: fsync d2/d26/f40 0 2024-09-17T01:02:02.362 INFO:tasks.workunit.client.0.smithi002.stdout:8/840: chown d2/d1c/dd4/cdd 13505 1 2024-09-17T01:02:02.362 INFO:tasks.workunit.client.0.smithi002.stdout:2/731: symlink d1b/d3f/d59/d7f/dc9/d72/l107 0 2024-09-17T01:02:02.363 INFO:tasks.workunit.client.0.smithi002.stdout:6/672: getdents d2/d1d/d2d/d35 0 2024-09-17T01:02:02.364 INFO:tasks.workunit.client.1.smithi099.stdout:5/732: dread d2/dc4/d90/da4/f75 [0,4194304] 0 2024-09-17T01:02:02.364 INFO:tasks.workunit.client.1.smithi099.stdout:5/733: read d2/f1b [3022364,33884] 0 2024-09-17T01:02:02.365 INFO:tasks.workunit.client.0.smithi002.stdout:8/841: mknod d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/c117 0 2024-09-17T01:02:02.365 INFO:tasks.workunit.client.0.smithi002.stdout:8/842: chown d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/f96 41415900 1 2024-09-17T01:02:02.366 INFO:tasks.workunit.client.1.smithi099.stdout:5/734: symlink d2/dc4/dad/lef 0 2024-09-17T01:02:02.366 INFO:tasks.workunit.client.1.smithi099.stdout:5/735: symlink d2/dc4/d90/de7/lf0 0 2024-09-17T01:02:02.366 INFO:tasks.workunit.client.0.smithi002.stdout:2/732: creat d1b/d3f/d59/d7f/dc9/dac/dbd/de8/f108 x:0 0 0 2024-09-17T01:02:02.366 INFO:tasks.workunit.client.0.smithi002.stdout:8/843: symlink d2/d9/l118 0 2024-09-17T01:02:02.366 INFO:tasks.workunit.client.0.smithi002.stdout:8/844: fsync d2/d1c/d28/dad/dcd/dd1/ddb/d10f/f72 0 2024-09-17T01:02:02.366 INFO:tasks.workunit.client.0.smithi002.stdout:2/733: creat d1b/d8a/d92/dae/df3/f109 x:0 0 0 2024-09-17T01:02:02.370 INFO:tasks.workunit.client.0.smithi002.stdout:6/673: write d2/dc/f21 [673994,49163] 0 2024-09-17T01:02:02.375 INFO:tasks.workunit.client.1.smithi099.stdout:5/736: dread d2/dc/f42 [0,4194304] 0 2024-09-17T01:02:02.375 INFO:tasks.workunit.client.1.smithi099.stdout:5/737: chown d2/dc4/d90/da4/l78 0 1 2024-09-17T01:02:02.379 INFO:tasks.workunit.client.1.smithi099.stdout:8/757: dwrite d0/d1f/d55/f7e [0,4194304] 0 2024-09-17T01:02:02.379 INFO:tasks.workunit.client.0.smithi002.stdout:9/651: dwrite d5/dc/d26/d5c/d6b/f6e [0,4194304] 0 2024-09-17T01:02:02.385 INFO:tasks.workunit.client.0.smithi002.stdout:5/666: dwrite d2/d2d/d10/f71 [0,4194304] 0 2024-09-17T01:02:02.386 INFO:tasks.workunit.client.1.smithi099.stdout:8/758: creat d0/d1f/d55/d95/de2/ffb x:0 0 0 2024-09-17T01:02:02.386 INFO:tasks.workunit.client.1.smithi099.stdout:8/759: creat d0/d1f/d90/ffc x:0 0 0 2024-09-17T01:02:02.386 INFO:tasks.workunit.client.1.smithi099.stdout:8/760: fsync d0/d1f/d55/f7e 0 2024-09-17T01:02:02.387 INFO:tasks.workunit.client.0.smithi002.stdout:8/845: dread d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/f94 [0,4194304] 0 2024-09-17T01:02:02.389 INFO:tasks.workunit.client.0.smithi002.stdout:8/846: getdents d2/d1c/d28/dad/dcd/dd1/ddb/d10f/dfd 0 2024-09-17T01:02:02.389 INFO:tasks.workunit.client.0.smithi002.stdout:8/847: stat d2/d1c/fc8 0 2024-09-17T01:02:02.390 INFO:tasks.workunit.client.0.smithi002.stdout:2/734: read d1b/d3f/d59/d7f/dc9/f51 [2907858,11441] 0 2024-09-17T01:02:02.390 INFO:tasks.workunit.client.0.smithi002.stdout:2/735: write d1b/d37/d48/ff0 [993822,19902] 0 2024-09-17T01:02:02.390 INFO:tasks.workunit.client.0.smithi002.stdout:2/736: write d1b/d1d/d79/fbf [83953,52337] 0 2024-09-17T01:02:02.390 INFO:tasks.workunit.client.0.smithi002.stdout:2/737: readlink d1b/d3f/d59/d7f/dc9/d72/l107 0 2024-09-17T01:02:02.391 INFO:tasks.workunit.client.0.smithi002.stdout:2/738: dread - d1b/d8a/d92/dae/df3/f109 zero size 2024-09-17T01:02:02.394 INFO:tasks.workunit.client.0.smithi002.stdout:6/674: dwrite d2/d1d/d27/d30/f36 [0,4194304] 0 2024-09-17T01:02:02.396 INFO:tasks.workunit.client.0.smithi002.stdout:6/675: creat d2/dc/d24/fd7 x:0 0 0 2024-09-17T01:02:02.398 INFO:tasks.workunit.client.0.smithi002.stdout:6/676: unlink d2/d1d/d26/f67 0 2024-09-17T01:02:02.398 INFO:tasks.workunit.client.0.smithi002.stdout:2/739: dread d1b/d37/d48/d4e/f90 [0,4194304] 0 2024-09-17T01:02:02.399 INFO:tasks.workunit.client.0.smithi002.stdout:2/740: mknod d1b/d37/c10a 0 2024-09-17T01:02:02.399 INFO:tasks.workunit.client.0.smithi002.stdout:2/741: rename d1b/d8a/d92 to d1b/d8a/d92/dae/dec/d10b 22 2024-09-17T01:02:02.402 INFO:tasks.workunit.client.0.smithi002.stdout:5/667: write d2/d2d/d10/d14/d19/da5/db0/d33/f7c [8200481,82982] 0 2024-09-17T01:02:02.402 INFO:tasks.workunit.client.0.smithi002.stdout:5/668: fsync d2/f4d 0 2024-09-17T01:02:02.408 INFO:tasks.workunit.client.0.smithi002.stdout:5/669: rename d2/d2d/d10/d14/d19/d39/d97 to d2/d2d/d10/d9b/dcb/dd5 0 2024-09-17T01:02:02.409 INFO:tasks.workunit.client.0.smithi002.stdout:5/670: creat d2/d2d/d10/d14/d19/d39/fd6 x:0 0 0 2024-09-17T01:02:02.410 INFO:tasks.workunit.client.0.smithi002.stdout:5/671: creat d2/d2d/d10/d14/d19/da5/db0/d33/fd7 x:0 0 0 2024-09-17T01:02:02.411 INFO:tasks.workunit.client.0.smithi002.stdout:5/672: creat d2/d2d/d10/d14/d19/d39/d25/fd8 x:0 0 0 2024-09-17T01:02:02.417 INFO:tasks.workunit.client.0.smithi002.stdout:5/673: dread d2/d2d/d10/d14/d19/d39/d43/f2a [0,4194304] 0 2024-09-17T01:02:02.419 INFO:tasks.workunit.client.0.smithi002.stdout:5/674: rename d2/c84 to d2/d2d/cd9 0 2024-09-17T01:02:02.419 INFO:tasks.workunit.client.0.smithi002.stdout:5/675: write d2/d2d/d10/d23/d6e/d60/f8e [212782,83192] 0 2024-09-17T01:02:02.420 INFO:tasks.workunit.client.0.smithi002.stdout:5/676: link d2/d2d/d10/d14/d19/da5/fb5 d2/d2d/d10/d14/fda 0 2024-09-17T01:02:02.420 INFO:tasks.workunit.client.0.smithi002.stdout:5/677: mknod d2/d2d/d10/d9b/cdb 0 2024-09-17T01:02:02.421 INFO:tasks.workunit.client.0.smithi002.stdout:5/678: truncate d2/d2d/d10/d3b/f5e 1281463 0 2024-09-17T01:02:02.422 INFO:tasks.workunit.client.0.smithi002.stdout:5/679: creat d2/d2d/d10/d95/fdc x:0 0 0 2024-09-17T01:02:02.423 INFO:tasks.workunit.client.1.smithi099.stdout:5/738: dwrite d2/dc/f74 [0,4194304] 0 2024-09-17T01:02:02.423 INFO:tasks.workunit.client.0.smithi002.stdout:5/680: truncate d2/d2d/d10/d14/d19/d39/d43/f16 3770668 0 2024-09-17T01:02:02.424 INFO:tasks.workunit.client.0.smithi002.stdout:5/681: link d2/d2d/d10/d14/d19/da5/db0/f74 d2/d2d/d10/d9b/fdd 0 2024-09-17T01:02:02.424 INFO:tasks.workunit.client.0.smithi002.stdout:5/682: stat d2/d2d/d10/d14/d59/cbe 0 2024-09-17T01:02:02.425 INFO:tasks.workunit.client.1.smithi099.stdout:8/761: dwrite d0/d41/d5a/fd4 [0,4194304] 0 2024-09-17T01:02:02.425 INFO:tasks.workunit.client.1.smithi099.stdout:5/739: symlink d2/dc/d17/d3c/d72/lf1 0 2024-09-17T01:02:02.425 INFO:tasks.workunit.client.0.smithi002.stdout:9/652: dwrite d5/dc/d26/d5c/d6b/d75/d57/d7a/f93 [0,4194304] 0 2024-09-17T01:02:02.426 INFO:tasks.workunit.client.0.smithi002.stdout:8/848: dwrite d2/d1c/fe2 [0,4194304] 0 2024-09-17T01:02:02.426 INFO:tasks.workunit.client.0.smithi002.stdout:8/849: write d2/d1c/d28/dad/dcd/dd1/f115 [946625,21462] 0 2024-09-17T01:02:02.427 INFO:tasks.workunit.client.0.smithi002.stdout:6/677: dwrite d2/dc/d24/fd7 [0,4194304] 0 2024-09-17T01:02:02.427 INFO:tasks.workunit.client.0.smithi002.stdout:6/678: stat d2/d1d/d2d/d35/d37/f8b 0 2024-09-17T01:02:02.428 INFO:tasks.workunit.client.1.smithi099.stdout:3/740: sync 2024-09-17T01:02:02.428 INFO:tasks.workunit.client.0.smithi002.stdout:5/683: fsync d2/d2d/d10/d20/f7e 0 2024-09-17T01:02:02.428 INFO:tasks.workunit.client.0.smithi002.stdout:8/850: mknod d2/d9/c119 0 2024-09-17T01:02:02.429 INFO:tasks.workunit.client.1.smithi099.stdout:5/740: creat d2/dc/d17/d3c/db3/dde/ff2 x:0 0 0 2024-09-17T01:02:02.429 INFO:tasks.workunit.client.1.smithi099.stdout:5/741: write d2/dc/d17/d3c/db3/fbd [513560,91400] 0 2024-09-17T01:02:02.430 INFO:tasks.workunit.client.1.smithi099.stdout:5/742: mkdir d2/dc/d14/d36/da6/df3 0 2024-09-17T01:02:02.430 INFO:tasks.workunit.client.1.smithi099.stdout:5/743: fsync d2/d26/fdb 0 2024-09-17T01:02:02.431 INFO:tasks.workunit.client.0.smithi002.stdout:6/679: creat d2/d1d/d2d/d35/d79/da8/fd8 x:0 0 0 2024-09-17T01:02:02.432 INFO:tasks.workunit.client.0.smithi002.stdout:6/680: write d2/d1d/d26/d49/fa0 [972988,115238] 0 2024-09-17T01:02:02.432 INFO:tasks.workunit.client.0.smithi002.stdout:8/851: unlink d2/d1c/d28/c79 0 2024-09-17T01:02:02.433 INFO:tasks.workunit.client.1.smithi099.stdout:5/744: rename d2/d26/f27 to d2/dc4/d99/ff4 0 2024-09-17T01:02:02.433 INFO:tasks.workunit.client.1.smithi099.stdout:5/745: read d2/f5 [64419,123034] 0 2024-09-17T01:02:02.433 INFO:tasks.workunit.client.1.smithi099.stdout:3/741: dread d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/f9e [0,4194304] 0 2024-09-17T01:02:02.433 INFO:tasks.workunit.client.0.smithi002.stdout:8/852: mknod d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/c11a 0 2024-09-17T01:02:02.434 INFO:tasks.workunit.client.1.smithi099.stdout:5/746: symlink d2/d26/d64/lf5 0 2024-09-17T01:02:02.435 INFO:tasks.workunit.client.0.smithi002.stdout:8/853: symlink d2/d1c/d28/dad/dcd/dd1/ddb/d10f/l11b 0 2024-09-17T01:02:02.436 INFO:tasks.workunit.client.1.smithi099.stdout:3/742: link d9/d15/f50 d9/d15/d38/fe9 0 2024-09-17T01:02:02.436 INFO:tasks.workunit.client.1.smithi099.stdout:3/743: readlink d9/d3b/d44/ld1 0 2024-09-17T01:02:02.436 INFO:tasks.workunit.client.1.smithi099.stdout:5/747: mknod d2/dc/d17/d6b/cf6 0 2024-09-17T01:02:02.436 INFO:tasks.workunit.client.1.smithi099.stdout:5/748: chown d2/dc/d17/d3c/d81/la3 2465711 1 2024-09-17T01:02:02.436 INFO:tasks.workunit.client.1.smithi099.stdout:5/749: dread - d2/dc4/fbf zero size 2024-09-17T01:02:02.436 INFO:tasks.workunit.client.1.smithi099.stdout:5/750: stat d2/dc/d17/d6b/lcd 0 2024-09-17T01:02:02.437 INFO:tasks.workunit.client.1.smithi099.stdout:5/751: getdents d2/d45 0 2024-09-17T01:02:02.437 INFO:tasks.workunit.client.0.smithi002.stdout:8/854: rmdir d2/d26/dbb 39 2024-09-17T01:02:02.438 INFO:tasks.workunit.client.0.smithi002.stdout:8/855: getdents d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d77/dd9 0 2024-09-17T01:02:02.438 INFO:tasks.workunit.client.1.smithi099.stdout:5/752: unlink d2/dc4/d90/da4/d8e/c98 0 2024-09-17T01:02:02.439 INFO:tasks.workunit.client.1.smithi099.stdout:5/753: creat d2/dc4/d99/dd0/ff7 x:0 0 0 2024-09-17T01:02:02.439 INFO:tasks.workunit.client.1.smithi099.stdout:5/754: chown d2/dc4/d90/da4/l76 134932570 1 2024-09-17T01:02:02.439 INFO:tasks.workunit.client.0.smithi002.stdout:8/856: mkdir d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d47/d80/d11c 0 2024-09-17T01:02:02.447 INFO:tasks.workunit.client.1.smithi099.stdout:8/762: dwrite d0/d1f/f62 [0,4194304] 0 2024-09-17T01:02:02.448 INFO:tasks.workunit.client.1.smithi099.stdout:8/763: readlink d0/d41/d5a/dcd/le3 0 2024-09-17T01:02:02.448 INFO:tasks.workunit.client.0.smithi002.stdout:6/681: write d2/d1d/f57 [2183232,87460] 0 2024-09-17T01:02:02.449 INFO:tasks.workunit.client.1.smithi099.stdout:8/764: creat d0/d1f/d90/db8/dde/dc3/ffd x:0 0 0 2024-09-17T01:02:02.449 INFO:tasks.workunit.client.1.smithi099.stdout:8/765: getdents d0/d1f/d31/d4c/d8c/df9 0 2024-09-17T01:02:02.449 INFO:tasks.workunit.client.1.smithi099.stdout:8/766: write d0/d1f/d90/db8/dde/d29/fc1 [360616,35706] 0 2024-09-17T01:02:02.449 INFO:tasks.workunit.client.1.smithi099.stdout:8/767: fdatasync d0/feb 0 2024-09-17T01:02:02.452 INFO:tasks.workunit.client.0.smithi002.stdout:6/682: unlink d2/d1d/d2d/d5a/d71/fb2 0 2024-09-17T01:02:02.459 INFO:tasks.workunit.client.0.smithi002.stdout:8/857: dwrite d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d58/fb8 [0,4194304] 0 2024-09-17T01:02:02.459 INFO:tasks.workunit.client.0.smithi002.stdout:8/858: readlink d2/l2f 0 2024-09-17T01:02:02.461 INFO:tasks.workunit.client.1.smithi099.stdout:8/768: read d0/d1f/f4d [993732,6876] 0 2024-09-17T01:02:02.461 INFO:tasks.workunit.client.0.smithi002.stdout:6/683: dread d2/d1d/d27/d30/f36 [0,4194304] 0 2024-09-17T01:02:02.461 INFO:tasks.workunit.client.0.smithi002.stdout:6/684: write d2/dc/d24/d53/d9e/fc8 [935463,28446] 0 2024-09-17T01:02:02.461 INFO:tasks.workunit.client.0.smithi002.stdout:6/685: chown d2/d1d/d26/d49/d7d/d8c 0 1 2024-09-17T01:02:02.462 INFO:tasks.workunit.client.0.smithi002.stdout:6/686: creat d2/d1d/d2d/d5a/d71/d7e/fd9 x:0 0 0 2024-09-17T01:02:02.462 INFO:tasks.workunit.client.0.smithi002.stdout:8/859: mknod d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d47/d80/c11d 0 2024-09-17T01:02:02.462 INFO:tasks.workunit.client.1.smithi099.stdout:3/744: dwrite d9/d15/d18/d1a/d23/d5c/d99/dda/f75 [0,4194304] 0 2024-09-17T01:02:02.462 INFO:tasks.workunit.client.1.smithi099.stdout:3/745: chown d9/d3b/d44/c53 1152454 1 2024-09-17T01:02:02.464 INFO:tasks.workunit.client.1.smithi099.stdout:5/755: dwrite d2/dc4/d90/da4/f75 [0,4194304] 0 2024-09-17T01:02:02.464 INFO:tasks.workunit.client.1.smithi099.stdout:3/746: getdents d9/d15/d18/d1a/d23/d5c/d99 0 2024-09-17T01:02:02.466 INFO:tasks.workunit.client.1.smithi099.stdout:5/756: mkdir d2/d26/d64/df8 0 2024-09-17T01:02:02.467 INFO:tasks.workunit.client.1.smithi099.stdout:5/757: creat d2/d45/ff9 x:0 0 0 2024-09-17T01:02:02.468 INFO:tasks.workunit.client.0.smithi002.stdout:8/860: dread d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d71/fbf [0,4194304] 0 2024-09-17T01:02:02.468 INFO:tasks.workunit.client.0.smithi002.stdout:8/861: fsync d2/d1c/d28/da0/fc0 0 2024-09-17T01:02:02.469 INFO:tasks.workunit.client.0.smithi002.stdout:8/862: creat d2/d26/dbb/f11e x:0 0 0 2024-09-17T01:02:02.469 INFO:tasks.workunit.client.0.smithi002.stdout:8/863: chown d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f 67909 1 2024-09-17T01:02:02.469 INFO:tasks.workunit.client.0.smithi002.stdout:8/864: dread - d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/f96 zero size 2024-09-17T01:02:02.469 INFO:tasks.workunit.client.0.smithi002.stdout:8/865: chown d2/d30 6722 1 2024-09-17T01:02:02.469 INFO:tasks.workunit.client.1.smithi099.stdout:3/747: truncate d9/d15/d18/d1a/d23/f17 9812415 0 2024-09-17T01:02:02.470 INFO:tasks.workunit.client.0.smithi002.stdout:6/687: dread d2/d1d/d26/d49/d51/f96 [0,4194304] 0 2024-09-17T01:02:02.470 INFO:tasks.workunit.client.0.smithi002.stdout:8/866: mknod d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d47/c11f 0 2024-09-17T01:02:02.473 INFO:tasks.workunit.client.0.smithi002.stdout:6/688: rename d2/d1d/d2d/d35/d6d/l97 to d2/lda 0 2024-09-17T01:02:02.473 INFO:tasks.workunit.client.0.smithi002.stdout:8/867: rmdir d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5 39 2024-09-17T01:02:02.482 INFO:tasks.workunit.client.1.smithi099.stdout:8/769: dwrite d0/d1f/f68 [0,4194304] 0 2024-09-17T01:02:02.482 INFO:tasks.workunit.client.1.smithi099.stdout:8/770: write d0/d53/f83 [1346762,43896] 0 2024-09-17T01:02:02.485 INFO:tasks.workunit.client.1.smithi099.stdout:8/771: mknod d0/d1f/d90/db8/dde/d29/d4b/cfe 0 2024-09-17T01:02:02.486 INFO:tasks.workunit.client.1.smithi099.stdout:8/772: getdents d0/d1f/d90/db8 0 2024-09-17T01:02:02.515 INFO:tasks.workunit.client.0.smithi002.stdout:8/868: dwrite d2/d41/fe3 [0,4194304] 0 2024-09-17T01:02:02.515 INFO:tasks.workunit.client.0.smithi002.stdout:8/869: write d2/d26/f7c [551858,20482] 0 2024-09-17T01:02:02.515 INFO:tasks.workunit.client.0.smithi002.stdout:8/870: truncate d2/d1c/fc8 1014776 0 2024-09-17T01:02:02.515 INFO:tasks.workunit.client.0.smithi002.stdout:8/871: chown d2/d1c/d3b/la3 84099555 1 2024-09-17T01:02:02.516 INFO:tasks.workunit.client.1.smithi099.stdout:5/758: dwrite d2/dc4/d99/fd8 [0,4194304] 0 2024-09-17T01:02:02.517 INFO:tasks.workunit.client.1.smithi099.stdout:8/773: dwrite d0/d1f/d55/d95/de2/ffb [0,4194304] 0 2024-09-17T01:02:02.517 INFO:tasks.workunit.client.0.smithi002.stdout:6/689: dwrite d2/dc/f21 [0,4194304] 0 2024-09-17T01:02:02.517 INFO:tasks.workunit.client.0.smithi002.stdout:6/690: creat d2/dc/fdb x:0 0 0 2024-09-17T01:02:02.517 INFO:tasks.workunit.client.0.smithi002.stdout:8/872: unlink d2/d1c/d28/dad/dcd/dd1/ddb/d10f/f11 0 2024-09-17T01:02:02.518 INFO:tasks.workunit.client.1.smithi099.stdout:5/759: creat d2/d26/d64/df8/ffa x:0 0 0 2024-09-17T01:02:02.518 INFO:tasks.workunit.client.1.smithi099.stdout:5/760: dread - d2/dc/d6c/fcc zero size 2024-09-17T01:02:02.518 INFO:tasks.workunit.client.1.smithi099.stdout:5/761: stat d2/d45/dc5 0 2024-09-17T01:02:02.519 INFO:tasks.workunit.client.0.smithi002.stdout:8/873: rmdir d2/d1c/d28/dad/dcd/dd1 39 2024-09-17T01:02:02.519 INFO:tasks.workunit.client.0.smithi002.stdout:8/874: write d2/d1c/d28/fe5 [655887,43814] 0 2024-09-17T01:02:02.520 INFO:tasks.workunit.client.1.smithi099.stdout:5/762: mkdir d2/dc/d17/d3c/dc6/dfb 0 2024-09-17T01:02:02.521 INFO:tasks.workunit.client.0.smithi002.stdout:6/691: rmdir d2/d1d/d2d/d35/d79 39 2024-09-17T01:02:02.521 INFO:tasks.workunit.client.1.smithi099.stdout:8/774: mkdir d0/d1f/d90/db8/dde/d29/d4b/dff 0 2024-09-17T01:02:02.523 INFO:tasks.workunit.client.1.smithi099.stdout:8/775: unlink d0/d41/cc5 0 2024-09-17T01:02:02.523 INFO:tasks.workunit.client.1.smithi099.stdout:8/776: creat d0/d1f/d90/db8/dde/d29/d9c/f100 x:0 0 0 2024-09-17T01:02:02.524 INFO:tasks.workunit.client.0.smithi002.stdout:6/692: creat d2/d1d/d2d/d35/d6d/dd6/fdc x:0 0 0 2024-09-17T01:02:02.527 INFO:tasks.workunit.client.0.smithi002.stdout:8/875: rmdir d2/d9/dd 39 2024-09-17T01:02:02.528 INFO:tasks.workunit.client.0.smithi002.stdout:6/693: rename d2/d1d/d26/d49/d7d/f7b to d2/d1d/d27/d30/fdd 0 2024-09-17T01:02:02.528 INFO:tasks.workunit.client.0.smithi002.stdout:6/694: chown d2/dc/d24/d53/d83/da9/d4c/f62 48875 1 2024-09-17T01:02:02.529 INFO:tasks.workunit.client.0.smithi002.stdout:6/695: write d2/d1d/d2d/d35/d79/da8/fd8 [983201,100126] 0 2024-09-17T01:02:02.531 INFO:tasks.workunit.client.0.smithi002.stdout:8/876: rename d2/d1c/l76 to d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d77/d78/l120 0 2024-09-17T01:02:02.531 INFO:tasks.workunit.client.0.smithi002.stdout:8/877: chown d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d47/d80/lf1 106951297 1 2024-09-17T01:02:02.531 INFO:tasks.workunit.client.0.smithi002.stdout:8/878: dread - d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d71/d89/ff9 zero size 2024-09-17T01:02:02.532 INFO:tasks.workunit.client.0.smithi002.stdout:8/879: getdents d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d71 0 2024-09-17T01:02:02.536 INFO:tasks.workunit.client.1.smithi099.stdout:8/777: write d0/d41/f9b [74399,43426] 0 2024-09-17T01:02:02.536 INFO:tasks.workunit.client.1.smithi099.stdout:5/763: dwrite d2/dc/d17/f5d [0,4194304] 0 2024-09-17T01:02:02.538 INFO:tasks.workunit.client.1.smithi099.stdout:5/764: mkdir d2/dc4/d99/dd0/dc3/dfc 0 2024-09-17T01:02:02.538 INFO:tasks.workunit.client.1.smithi099.stdout:5/765: fdatasync d2/d8/fc1 0 2024-09-17T01:02:02.538 INFO:tasks.workunit.client.1.smithi099.stdout:8/778: dread d0/d1f/d31/d4c/f67 [0,4194304] 0 2024-09-17T01:02:02.538 INFO:tasks.workunit.client.1.smithi099.stdout:5/766: write d2/dc/d17/d3c/d72/f79 [52279,108870] 0 2024-09-17T01:02:02.538 INFO:tasks.workunit.client.1.smithi099.stdout:5/767: fsync d2/d26/d64/df8/ffa 0 2024-09-17T01:02:02.541 INFO:tasks.workunit.client.1.smithi099.stdout:5/768: read d2/dc/d6c/fac [152387,108455] 0 2024-09-17T01:02:02.544 INFO:tasks.workunit.client.1.smithi099.stdout:5/769: rename d2/dc4/d99/dd0/lee to d2/dc4/d99/dd0/dc3/lfd 0 2024-09-17T01:02:02.544 INFO:tasks.workunit.client.1.smithi099.stdout:5/770: write d2/d8/fba [315363,118586] 0 2024-09-17T01:02:02.546 INFO:tasks.workunit.client.1.smithi099.stdout:5/771: rmdir d2/dc/d17/d3c/db3 39 2024-09-17T01:02:02.548 INFO:tasks.workunit.client.1.smithi099.stdout:5/772: symlink d2/dc/d14/lfe 0 2024-09-17T01:02:02.548 INFO:tasks.workunit.client.1.smithi099.stdout:5/773: write d2/d26/f2a [1482767,100055] 0 2024-09-17T01:02:02.548 INFO:tasks.workunit.client.1.smithi099.stdout:5/774: chown d2/dc/d14/d36 89466756 1 2024-09-17T01:02:02.548 INFO:tasks.workunit.client.1.smithi099.stdout:5/775: write d2/dc/d17/d3c/d81/f84 [768308,25408] 0 2024-09-17T01:02:02.549 INFO:tasks.workunit.client.1.smithi099.stdout:5/776: link d2/dc/d17/d3c/db3/fdf d2/dc/d6c/fff 0 2024-09-17T01:02:02.550 INFO:tasks.workunit.client.1.smithi099.stdout:5/777: dread d2/dc4/d90/da4/f21 [0,4194304] 0 2024-09-17T01:02:02.551 INFO:tasks.workunit.client.1.smithi099.stdout:5/778: unlink d2/dc/d17/f59 0 2024-09-17T01:02:02.553 INFO:tasks.workunit.client.1.smithi099.stdout:8/779: truncate d0/fcb 2822969 0 2024-09-17T01:02:02.553 INFO:tasks.workunit.client.1.smithi099.stdout:8/780: chown d0/d41/d5a/f94 1848 1 2024-09-17T01:02:02.558 INFO:tasks.workunit.client.0.smithi002.stdout:8/880: dwrite d2/d30/fae [0,4194304] 0 2024-09-17T01:02:02.558 INFO:tasks.workunit.client.0.smithi002.stdout:6/696: dwrite d2/d1d/d2d/d35/d79/fc0 [0,4194304] 0 2024-09-17T01:02:02.558 INFO:tasks.workunit.client.0.smithi002.stdout:6/697: chown d2/d1d/d2d/d35/dc1/fd0 884 1 2024-09-17T01:02:02.562 INFO:tasks.workunit.client.0.smithi002.stdout:6/698: mknod d2/cde 0 2024-09-17T01:02:02.564 INFO:tasks.workunit.client.0.smithi002.stdout:6/699: getdents d2/d1d 0 2024-09-17T01:02:02.564 INFO:tasks.workunit.client.0.smithi002.stdout:6/700: creat d2/d1d/d27/d30/fdf x:0 0 0 2024-09-17T01:02:02.567 INFO:tasks.workunit.client.0.smithi002.stdout:6/701: symlink d2/dc/d24/d53/d83/da9/le0 0 2024-09-17T01:02:02.576 INFO:tasks.workunit.client.1.smithi099.stdout:5/779: dwrite d2/f63 [0,4194304] 0 2024-09-17T01:02:02.576 INFO:tasks.workunit.client.1.smithi099.stdout:5/780: fdatasync d2/dc/d14/f16 0 2024-09-17T01:02:02.577 INFO:tasks.workunit.client.1.smithi099.stdout:8/781: dwrite d0/d1f/d55/fc7 [0,4194304] 0 2024-09-17T01:02:02.583 INFO:tasks.workunit.client.1.smithi099.stdout:5/781: rmdir d2/dc/d14/d36 39 2024-09-17T01:02:02.586 INFO:tasks.workunit.client.0.smithi002.stdout:6/702: dwrite d2/dc/d24/d53/d9e/fc8 [0,4194304] 0 2024-09-17T01:02:02.586 INFO:tasks.workunit.client.0.smithi002.stdout:6/703: chown d2/d1d/d2d/d5a/d71/d7e/fd9 2 1 2024-09-17T01:02:02.587 INFO:tasks.workunit.client.1.smithi099.stdout:8/782: write d0/d1f/d90/fb7 [635891,38452] 0 2024-09-17T01:02:02.587 INFO:tasks.workunit.client.1.smithi099.stdout:8/783: write d0/d1f/d31/f43 [295973,102945] 0 2024-09-17T01:02:02.589 INFO:tasks.workunit.client.1.smithi099.stdout:8/784: read d0/d1f/d31/fc8 [155951,31507] 0 2024-09-17T01:02:02.589 INFO:tasks.workunit.client.1.smithi099.stdout:8/785: write d0/d1f/d31/d4c/f5d [4424267,120098] 0 2024-09-17T01:02:02.589 INFO:tasks.workunit.client.0.smithi002.stdout:6/704: mknod d2/d1d/d27/d30/ce1 0 2024-09-17T01:02:02.590 INFO:tasks.workunit.client.1.smithi099.stdout:8/786: mknod d0/d1f/d31/d4c/d8c/df9/c101 0 2024-09-17T01:02:02.590 INFO:tasks.workunit.client.0.smithi002.stdout:6/705: mknod d2/dc/d34/ce2 0 2024-09-17T01:02:02.591 INFO:tasks.workunit.client.0.smithi002.stdout:6/706: creat d2/d1d/d26/d49/d7d/fe3 x:0 0 0 2024-09-17T01:02:02.591 INFO:tasks.workunit.client.0.smithi002.stdout:6/707: chown d2/d1d/d27/d80/d93/dd5/d5c 1743 1 2024-09-17T01:02:02.591 INFO:tasks.workunit.client.0.smithi002.stdout:6/708: read - d2/d1d/d2d/d5a/d71/d7e/fbb zero size 2024-09-17T01:02:02.592 INFO:tasks.workunit.client.1.smithi099.stdout:8/787: symlink d0/d1f/d90/db8/dde/d29/l102 0 2024-09-17T01:02:02.594 INFO:tasks.workunit.client.1.smithi099.stdout:8/788: unlink d0/d1f/d31/d4c/d8c/fe7 0 2024-09-17T01:02:02.594 INFO:tasks.workunit.client.1.smithi099.stdout:8/789: chown d0/d41/f91 3 1 2024-09-17T01:02:02.594 INFO:tasks.workunit.client.0.smithi002.stdout:6/709: dread d2/d1d/d26/f7a [0,4194304] 0 2024-09-17T01:02:02.595 INFO:tasks.workunit.client.0.smithi002.stdout:6/710: unlink d2/lda 0 2024-09-17T01:02:02.601 INFO:tasks.workunit.client.1.smithi099.stdout:0/687: sync 2024-09-17T01:02:02.601 INFO:tasks.workunit.client.1.smithi099.stdout:2/619: sync 2024-09-17T01:02:02.601 INFO:tasks.workunit.client.1.smithi099.stdout:1/856: sync 2024-09-17T01:02:02.601 INFO:tasks.workunit.client.1.smithi099.stdout:0/688: write da/d12/f18 [86581,39101] 0 2024-09-17T01:02:02.601 INFO:tasks.workunit.client.1.smithi099.stdout:0/689: fsync da/f5d 0 2024-09-17T01:02:02.601 INFO:tasks.workunit.client.1.smithi099.stdout:6/779: sync 2024-09-17T01:02:02.601 INFO:tasks.workunit.client.1.smithi099.stdout:6/780: fsync fa 0 2024-09-17T01:02:02.601 INFO:tasks.workunit.client.1.smithi099.stdout:7/649: sync 2024-09-17T01:02:02.601 INFO:tasks.workunit.client.1.smithi099.stdout:7/650: truncate d1/d2c/d5c/d1c/d5a/d6f/fa5 831806 0 2024-09-17T01:02:02.601 INFO:tasks.workunit.client.1.smithi099.stdout:9/738: sync 2024-09-17T01:02:02.601 INFO:tasks.workunit.client.1.smithi099.stdout:4/671: sync 2024-09-17T01:02:02.601 INFO:tasks.workunit.client.1.smithi099.stdout:4/672: write d7/d35/d98/fd1 [478023,112106] 0 2024-09-17T01:02:02.602 INFO:tasks.workunit.client.1.smithi099.stdout:3/748: sync 2024-09-17T01:02:02.602 INFO:tasks.workunit.client.1.smithi099.stdout:3/749: truncate d9/d15/fc0 635216 0 2024-09-17T01:02:02.603 INFO:tasks.workunit.client.1.smithi099.stdout:1/857: truncate d0/d8/d49/d94/d4b/d59/db9/feb 4057577 0 2024-09-17T01:02:02.603 INFO:tasks.workunit.client.1.smithi099.stdout:1/858: readlink d0/d8/d38/d56/d93/l118 0 2024-09-17T01:02:02.605 INFO:tasks.workunit.client.1.smithi099.stdout:3/750: write d9/f7a [601935,104064] 0 2024-09-17T01:02:02.605 INFO:tasks.workunit.client.1.smithi099.stdout:8/790: dread d0/d53/f83 [0,4194304] 0 2024-09-17T01:02:02.606 INFO:tasks.workunit.client.1.smithi099.stdout:8/791: fdatasync d0/d41/d5a/fa0 0 2024-09-17T01:02:02.609 INFO:tasks.workunit.client.1.smithi099.stdout:0/690: symlink da/df/d31/db0/ldd 0 2024-09-17T01:02:02.609 INFO:tasks.workunit.client.1.smithi099.stdout:9/739: mkdir da/d18/db3/def 0 2024-09-17T01:02:02.610 INFO:tasks.workunit.client.1.smithi099.stdout:4/673: symlink d7/dd/d21/d7b/d4b/le6 0 2024-09-17T01:02:02.623 INFO:tasks.workunit.client.1.smithi099.stdout:0/691: rmdir da/df/d1a/d49/d71 39 2024-09-17T01:02:02.623 INFO:tasks.workunit.client.1.smithi099.stdout:0/692: dread - da/df/d31/fd5 zero size 2024-09-17T01:02:02.623 INFO:tasks.workunit.client.1.smithi099.stdout:0/693: chown da/df/c46 13570759 1 2024-09-17T01:02:02.629 INFO:tasks.workunit.client.1.smithi099.stdout:4/674: dread d7/dd/d21/d26/d3f/d5b/f37 [0,4194304] 0 2024-09-17T01:02:02.629 INFO:tasks.workunit.client.1.smithi099.stdout:4/675: readlink d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/le3 0 2024-09-17T01:02:02.632 INFO:tasks.workunit.client.1.smithi099.stdout:4/676: creat d7/dd/de/d10/d85/fe7 x:0 0 0 2024-09-17T01:02:02.632 INFO:tasks.workunit.client.1.smithi099.stdout:4/677: readlink d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/lc8 0 2024-09-17T01:02:02.633 INFO:tasks.workunit.client.1.smithi099.stdout:9/740: dread da/d18/d5e/fb6 [0,4194304] 0 2024-09-17T01:02:02.633 INFO:tasks.workunit.client.1.smithi099.stdout:7/651: rename d1/d2c/d5c/f9 to d1/d37/d78/fd0 0 2024-09-17T01:02:02.643 INFO:tasks.workunit.client.1.smithi099.stdout:4/678: dread d7/dd/d21/d26/d3f/d5b/f2d [0,4194304] 0 2024-09-17T01:02:02.644 INFO:tasks.workunit.client.1.smithi099.stdout:4/679: write d7/dd/de/d10/d6b/f95 [771888,41652] 0 2024-09-17T01:02:02.644 INFO:tasks.workunit.client.1.smithi099.stdout:4/680: write d7/dd/de/d10/d85/fe7 [76992,9798] 0 2024-09-17T01:02:02.644 INFO:tasks.workunit.client.0.smithi002.stdout:0/618: sync 2024-09-17T01:02:02.645 INFO:tasks.workunit.client.1.smithi099.stdout:4/681: getdents d7/dd/de/d10/d6b/d82/d8a/d9a/da6 0 2024-09-17T01:02:02.645 INFO:tasks.workunit.client.1.smithi099.stdout:4/682: truncate f2 8699580 0 2024-09-17T01:02:02.650 INFO:tasks.workunit.client.1.smithi099.stdout:4/683: dread d7/dd/f79 [0,4194304] 0 2024-09-17T01:02:02.650 INFO:tasks.workunit.client.1.smithi099.stdout:4/684: creat d7/dd/d21/fe8 x:0 0 0 2024-09-17T01:02:02.651 INFO:tasks.workunit.client.1.smithi099.stdout:4/685: truncate d7/fc 1965951 0 2024-09-17T01:02:02.651 INFO:tasks.workunit.client.1.smithi099.stdout:4/686: creat d7/dd/d21/d26/d3f/d5b/da4/fe9 x:0 0 0 2024-09-17T01:02:02.652 INFO:tasks.workunit.client.1.smithi099.stdout:4/687: fsync d7/dd/d21/d26/d3f/f8f 0 2024-09-17T01:02:02.652 INFO:tasks.workunit.client.1.smithi099.stdout:4/688: chown d7/dd/d21/d26/d3f/d5b 219962 1 2024-09-17T01:02:02.653 INFO:tasks.workunit.client.1.smithi099.stdout:4/689: rmdir d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd 39 2024-09-17T01:02:02.653 INFO:tasks.workunit.client.1.smithi099.stdout:4/690: symlink d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/lea 0 2024-09-17T01:02:02.654 INFO:tasks.workunit.client.1.smithi099.stdout:4/691: truncate d7/dd/f9d 3194272 0 2024-09-17T01:02:02.655 INFO:tasks.workunit.client.1.smithi099.stdout:4/692: symlink d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/leb 0 2024-09-17T01:02:02.655 INFO:tasks.workunit.client.1.smithi099.stdout:4/693: write d7/dd/d21/d7b/d74/f75 [558382,48106] 0 2024-09-17T01:02:02.655 INFO:tasks.workunit.client.1.smithi099.stdout:4/694: creat d7/dd/de/d17/fec x:0 0 0 2024-09-17T01:02:02.655 INFO:tasks.workunit.client.1.smithi099.stdout:4/695: creat d7/d35/d98/fed x:0 0 0 2024-09-17T01:02:02.655 INFO:tasks.workunit.client.0.smithi002.stdout:0/619: mknod dd/d19/d1c/d33/d67/db9/cce 0 2024-09-17T01:02:02.656 INFO:tasks.workunit.client.1.smithi099.stdout:4/696: read d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/f88 [40974,58564] 0 2024-09-17T01:02:02.656 INFO:tasks.workunit.client.0.smithi002.stdout:6/711: dwrite d2/d1d/d2d/d35/d79/fba [0,4194304] 0 2024-09-17T01:02:02.657 INFO:tasks.workunit.client.0.smithi002.stdout:0/620: creat dd/d19/d1c/d33/d67/db9/fcf x:0 0 0 2024-09-17T01:02:02.658 INFO:tasks.workunit.client.1.smithi099.stdout:4/697: creat d7/dd/d21/d7b/d4b/fee x:0 0 0 2024-09-17T01:02:02.660 INFO:tasks.workunit.client.1.smithi099.stdout:4/698: link d7/dbc/lca d7/dd/d21/d26/d3f/lef 0 2024-09-17T01:02:02.661 INFO:tasks.workunit.client.0.smithi002.stdout:0/621: link dd/d19/d1a/d29/c83 dd/d3d/cd0 0 2024-09-17T01:02:02.661 INFO:tasks.workunit.client.0.smithi002.stdout:0/622: fsync dd/d19/d1c/d78/f93 0 2024-09-17T01:02:02.661 INFO:tasks.workunit.client.1.smithi099.stdout:4/699: unlink d7/dd/de/d17/c5d 0 2024-09-17T01:02:02.663 INFO:tasks.workunit.client.1.smithi099.stdout:3/751: dwrite d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/f9e [0,4194304] 0 2024-09-17T01:02:02.663 INFO:tasks.workunit.client.1.smithi099.stdout:3/752: chown d9/d15/d18/l26 114 1 2024-09-17T01:02:02.664 INFO:tasks.workunit.client.1.smithi099.stdout:6/781: dwrite dc/d5d/f69 [0,4194304] 0 2024-09-17T01:02:02.664 INFO:tasks.workunit.client.1.smithi099.stdout:3/753: mknod d9/d15/d18/d1a/d23/d4c/cea 0 2024-09-17T01:02:02.665 INFO:tasks.workunit.client.1.smithi099.stdout:0/694: dwrite da/d12/f5a [0,4194304] 0 2024-09-17T01:02:02.665 INFO:tasks.workunit.client.1.smithi099.stdout:4/700: dread d7/dd/d21/f41 [0,4194304] 0 2024-09-17T01:02:02.665 INFO:tasks.workunit.client.1.smithi099.stdout:4/701: creat d7/dd/d21/d26/d3f/d5b/da4/ff0 x:0 0 0 2024-09-17T01:02:02.666 INFO:tasks.workunit.client.1.smithi099.stdout:3/754: rename d9/d15/d18/d1a/d23/cd9 to d9/d3b/ceb 0 2024-09-17T01:02:02.667 INFO:tasks.workunit.client.1.smithi099.stdout:8/792: dwrite d0/d1f/db5/fd2 [0,4194304] 0 2024-09-17T01:02:02.667 INFO:tasks.workunit.client.1.smithi099.stdout:5/782: dwrite d2/dc4/d99/dd0/db2/fb5 [0,4194304] 0 2024-09-17T01:02:02.668 INFO:tasks.workunit.client.1.smithi099.stdout:2/620: dwrite d2/d9/d25/d26/d1b/f74 [0,4194304] 0 2024-09-17T01:02:02.668 INFO:tasks.workunit.client.1.smithi099.stdout:2/621: stat d2/d9/d17/c89 0 2024-09-17T01:02:02.668 INFO:tasks.workunit.client.1.smithi099.stdout:1/859: dwrite d0/d8c/f99 [0,4194304] 0 2024-09-17T01:02:02.668 INFO:tasks.workunit.client.1.smithi099.stdout:1/860: creat d0/d2/d18/f11e x:0 0 0 2024-09-17T01:02:02.670 INFO:tasks.workunit.client.1.smithi099.stdout:3/755: truncate d9/d15/d18/d1a/d23/d5c/d99/fcc 469784 0 2024-09-17T01:02:02.673 INFO:tasks.workunit.client.1.smithi099.stdout:9/741: dwrite da/d9a/d3a/f26 [0,4194304] 0 2024-09-17T01:02:02.675 INFO:tasks.workunit.client.1.smithi099.stdout:8/793: mknod d0/d41/d5a/dcd/c103 0 2024-09-17T01:02:02.677 INFO:tasks.workunit.client.1.smithi099.stdout:8/794: dread d0/d1f/d31/d4c/f67 [0,4194304] 0 2024-09-17T01:02:02.680 INFO:tasks.workunit.client.1.smithi099.stdout:4/702: dread d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/fc1 [0,4194304] 0 2024-09-17T01:02:02.681 INFO:tasks.workunit.client.1.smithi099.stdout:4/703: chown d7/d35/d98/cd2 3809 1 2024-09-17T01:02:02.681 INFO:tasks.workunit.client.1.smithi099.stdout:5/783: creat d2/dc/d17/d3c/dca/f100 x:0 0 0 2024-09-17T01:02:02.681 INFO:tasks.workunit.client.1.smithi099.stdout:5/784: chown d2/dc/d17/d3c/da8/fc7 10 1 2024-09-17T01:02:02.683 INFO:tasks.workunit.client.1.smithi099.stdout:2/622: rmdir d2/d9/d25/d26/d1b/d61/d7d/d85 39 2024-09-17T01:02:02.685 INFO:tasks.workunit.client.1.smithi099.stdout:0/695: getdents da/df/d1a 0 2024-09-17T01:02:02.685 INFO:tasks.workunit.client.1.smithi099.stdout:5/785: dread d2/dc/d14/d89/fd5 [0,4194304] 0 2024-09-17T01:02:02.685 INFO:tasks.workunit.client.0.smithi002.stdout:0/623: dwrite dd/d19/d1c/f8a [0,4194304] 0 2024-09-17T01:02:02.686 INFO:tasks.workunit.client.1.smithi099.stdout:5/786: stat d2/dc/d17/l1c 0 2024-09-17T01:02:02.686 INFO:tasks.workunit.client.1.smithi099.stdout:7/652: rmdir d1/d2c/d5c 39 2024-09-17T01:02:02.686 INFO:tasks.workunit.client.1.smithi099.stdout:7/653: creat d1/d2c/d47/fd1 x:0 0 0 2024-09-17T01:02:02.686 INFO:tasks.workunit.client.1.smithi099.stdout:7/654: chown d1/d8f/f95 79483678 1 2024-09-17T01:02:02.687 INFO:tasks.workunit.client.0.smithi002.stdout:6/712: dwrite d2/d1d/d27/d30/f36 [0,4194304] 0 2024-09-17T01:02:02.687 INFO:tasks.workunit.client.0.smithi002.stdout:0/624: read dd/d19/f34 [134804,95871] 0 2024-09-17T01:02:02.688 INFO:tasks.workunit.client.1.smithi099.stdout:3/756: rmdir d9/d15/d18/dc2 39 2024-09-17T01:02:02.688 INFO:tasks.workunit.client.1.smithi099.stdout:3/757: stat d9/d15/l71 0 2024-09-17T01:02:02.689 INFO:tasks.workunit.client.0.smithi002.stdout:6/713: mknod d2/d1d/d2d/d35/d8d/dab/ce4 0 2024-09-17T01:02:02.689 INFO:tasks.workunit.client.0.smithi002.stdout:6/714: stat d2/d1d/d27/d80/d93/dd5/l45 0 2024-09-17T01:02:02.689 INFO:tasks.workunit.client.0.smithi002.stdout:6/715: fsync d2/d1d/d27/d80/d93/dd5/d5c/dc9/fc7 0 2024-09-17T01:02:02.689 INFO:tasks.workunit.client.0.smithi002.stdout:0/625: mkdir dd/d3d/d94/dd1 0 2024-09-17T01:02:02.689 INFO:tasks.workunit.client.0.smithi002.stdout:6/716: mknod d2/d1d/d27/d80/db0/ce5 0 2024-09-17T01:02:02.691 INFO:tasks.workunit.client.1.smithi099.stdout:2/623: dread d2/d9/d25/f7b [0,4194304] 0 2024-09-17T01:02:02.691 INFO:tasks.workunit.client.1.smithi099.stdout:9/742: link da/d8e/d96/lc2 da/d8e/db8/lf0 0 2024-09-17T01:02:02.691 INFO:tasks.workunit.client.0.smithi002.stdout:0/626: link dd/d19/d1c/d33/d67/f74 dd/d19/d1c/d33/d67/db9/fd2 0 2024-09-17T01:02:02.691 INFO:tasks.workunit.client.0.smithi002.stdout:0/627: write dd/d19/d9f/fb0 [483472,88529] 0 2024-09-17T01:02:02.692 INFO:tasks.workunit.client.1.smithi099.stdout:8/795: mknod d0/d1f/d55/d95/c104 0 2024-09-17T01:02:02.693 INFO:tasks.workunit.client.0.smithi002.stdout:0/628: creat dd/d19/d1a/dbc/fd3 x:0 0 0 2024-09-17T01:02:02.694 INFO:tasks.workunit.client.1.smithi099.stdout:4/704: rename d7/dd/d21/d7b/d4b/f1d to d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/d83/ff1 0 2024-09-17T01:02:02.694 INFO:tasks.workunit.client.1.smithi099.stdout:4/705: write d7/d35/f78 [5122032,63937] 0 2024-09-17T01:02:02.695 INFO:tasks.workunit.client.1.smithi099.stdout:4/706: write d7/dd/d21/f41 [23816,113991] 0 2024-09-17T01:02:02.695 INFO:tasks.workunit.client.1.smithi099.stdout:6/782: dwrite dc/d27/dd7/dde/ff2 [0,4194304] 0 2024-09-17T01:02:02.695 INFO:tasks.workunit.client.1.smithi099.stdout:1/861: dwrite d0/d2/de/d8b/da7/d98/fea [4194304,4194304] 0 2024-09-17T01:02:02.696 INFO:tasks.workunit.client.0.smithi002.stdout:6/717: dread d2/d1d/d2d/d35/d6d/fa1 [0,4194304] 0 2024-09-17T01:02:02.696 INFO:tasks.workunit.client.0.smithi002.stdout:6/718: dread - d2/d1d/d27/d30/fdd zero size 2024-09-17T01:02:02.696 INFO:tasks.workunit.client.0.smithi002.stdout:6/719: chown d2/d1d/d26/d49/d51 94 1 2024-09-17T01:02:02.697 INFO:tasks.workunit.client.0.smithi002.stdout:6/720: mkdir d2/d1d/d2d/d35/d79/de6 0 2024-09-17T01:02:02.697 INFO:tasks.workunit.client.0.smithi002.stdout:6/721: chown d2/d1d/d27/d30/d98 50494505 1 2024-09-17T01:02:02.697 INFO:tasks.workunit.client.0.smithi002.stdout:6/722: write d2/d1d/d26/d49/d51/f76 [2422523,73331] 0 2024-09-17T01:02:02.698 INFO:tasks.workunit.client.1.smithi099.stdout:5/787: read d2/f63 [1728921,20864] 0 2024-09-17T01:02:02.698 INFO:tasks.workunit.client.1.smithi099.stdout:7/655: creat d1/d2c/d5c/d1c/d5a/db3/dcd/fd2 x:0 0 0 2024-09-17T01:02:02.700 INFO:tasks.workunit.client.0.smithi002.stdout:6/723: symlink d2/d1d/d26/d49/d7d/le7 0 2024-09-17T01:02:02.700 INFO:tasks.workunit.client.1.smithi099.stdout:3/758: creat d9/d3b/db2/fec x:0 0 0 2024-09-17T01:02:02.700 INFO:tasks.workunit.client.1.smithi099.stdout:3/759: dread - d9/d15/d18/d1a/d23/d5c/d99/dda/db5/fcf zero size 2024-09-17T01:02:02.700 INFO:tasks.workunit.client.1.smithi099.stdout:3/760: fsync d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/f9e 0 2024-09-17T01:02:02.702 INFO:tasks.workunit.client.1.smithi099.stdout:9/743: symlink da/d14/d40/lf1 0 2024-09-17T01:02:02.704 INFO:tasks.workunit.client.1.smithi099.stdout:8/796: mknod d0/d41/c105 0 2024-09-17T01:02:02.705 INFO:tasks.workunit.client.0.smithi002.stdout:0/629: dread dd/d19/f1b [0,4194304] 0 2024-09-17T01:02:02.707 INFO:tasks.workunit.client.0.smithi002.stdout:0/630: symlink dd/d3d/d94/ld4 0 2024-09-17T01:02:02.708 INFO:tasks.workunit.client.0.smithi002.stdout:0/631: creat dd/d19/d1c/d1f/d76/fd5 x:0 0 0 2024-09-17T01:02:02.711 INFO:tasks.workunit.client.1.smithi099.stdout:4/707: symlink d7/dd/de/d10/d6b/d82/d8a/lf2 0 2024-09-17T01:02:02.713 INFO:tasks.workunit.client.0.smithi002.stdout:0/632: dread dd/d19/d1c/db7/db4/f9b [0,4194304] 0 2024-09-17T01:02:02.713 INFO:tasks.workunit.client.0.smithi002.stdout:0/633: write dd/f32 [2660638,80567] 0 2024-09-17T01:02:02.715 INFO:tasks.workunit.client.0.smithi002.stdout:0/634: rmdir dd/d19/d1c/d33/d67/d68/d9d 39 2024-09-17T01:02:02.717 INFO:tasks.workunit.client.1.smithi099.stdout:1/862: link d0/d8c/c101 d0/d2/de/d8b/da7/d98/c11f 0 2024-09-17T01:02:02.717 INFO:tasks.workunit.client.0.smithi002.stdout:0/635: creat dd/d3d/d94/dd1/fd6 x:0 0 0 2024-09-17T01:02:02.718 INFO:tasks.workunit.client.1.smithi099.stdout:0/696: dwrite da/d12/f5a [0,4194304] 0 2024-09-17T01:02:02.718 INFO:tasks.workunit.client.1.smithi099.stdout:0/697: chown da/d12/d2b/dab/db5/fa2 151 1 2024-09-17T01:02:02.718 INFO:tasks.workunit.client.0.smithi002.stdout:6/724: dread f1 [4194304,4194304] 0 2024-09-17T01:02:02.719 INFO:tasks.workunit.client.0.smithi002.stdout:6/725: fdatasync f1 0 2024-09-17T01:02:02.719 INFO:tasks.workunit.client.0.smithi002.stdout:0/636: rmdir dd/d3d/d94/dad 0 2024-09-17T01:02:02.719 INFO:tasks.workunit.client.1.smithi099.stdout:2/624: dwrite d2/d9/d25/d26/d1b/d2c/f77 [0,4194304] 0 2024-09-17T01:02:02.720 INFO:tasks.workunit.client.0.smithi002.stdout:6/726: mknod d2/d1d/d2d/ce8 0 2024-09-17T01:02:02.721 INFO:tasks.workunit.client.0.smithi002.stdout:0/637: unlink dd/d19/d1c/d33/l42 0 2024-09-17T01:02:02.721 INFO:tasks.workunit.client.0.smithi002.stdout:0/638: fdatasync dd/d19/d1c/d1f/d22/f51 0 2024-09-17T01:02:02.721 INFO:tasks.workunit.client.0.smithi002.stdout:0/639: write dd/d19/d1c/db7/f6e [986340,55459] 0 2024-09-17T01:02:02.722 INFO:tasks.workunit.client.1.smithi099.stdout:3/761: write d9/d15/d8f/d97/fbd [4173580,95827] 0 2024-09-17T01:02:02.722 INFO:tasks.workunit.client.1.smithi099.stdout:3/762: fsync d9/d15/d18/d1a/d23/d5c/d99/fcc 0 2024-09-17T01:02:02.723 INFO:tasks.workunit.client.1.smithi099.stdout:4/708: dread d7/dd/fb0 [0,4194304] 0 2024-09-17T01:02:02.724 INFO:tasks.workunit.client.0.smithi002.stdout:6/727: write d2/d1d/d2d/d5a/d71/d7e/f85 [31539,120280] 0 2024-09-17T01:02:02.726 INFO:tasks.workunit.client.1.smithi099.stdout:1/863: mkdir d0/d8/d38/d8a/d120 0 2024-09-17T01:02:02.727 INFO:tasks.workunit.client.0.smithi002.stdout:6/728: rename d2/d1d/l75 to d2/d1d/d2d/d35/d79/da8/le9 0 2024-09-17T01:02:02.728 INFO:tasks.workunit.client.0.smithi002.stdout:6/729: write d2/dc/fb6 [330650,90018] 0 2024-09-17T01:02:02.736 INFO:tasks.workunit.client.1.smithi099.stdout:4/709: dread d7/dd/d21/f38 [0,4194304] 0 2024-09-17T01:02:02.739 INFO:tasks.workunit.client.1.smithi099.stdout:2/625: unlink d2/d9/d25/d26/d1b/d2c/l55 0 2024-09-17T01:02:02.739 INFO:tasks.workunit.client.1.smithi099.stdout:2/626: fdatasync d2/d9/d17/d58/faa 0 2024-09-17T01:02:02.741 INFO:tasks.workunit.client.1.smithi099.stdout:6/783: rename dc/d27/d58 to dc/d5d/d66/dbb/d10c 0 2024-09-17T01:02:02.742 INFO:tasks.workunit.client.1.smithi099.stdout:9/744: dwrite da/d18/f7e [0,4194304] 0 2024-09-17T01:02:02.744 INFO:tasks.workunit.client.1.smithi099.stdout:3/763: mkdir d9/d15/d18/d1a/d23/d5c/d99/dd8/ded 0 2024-09-17T01:02:02.744 INFO:tasks.workunit.client.1.smithi099.stdout:3/764: write d9/d15/d18/fc7 [637343,67653] 0 2024-09-17T01:02:02.744 INFO:tasks.workunit.client.1.smithi099.stdout:3/765: write d9/d15/d18/d1a/d23/d5c/d6e/d7e/fc9 [169636,48430] 0 2024-09-17T01:02:02.744 INFO:tasks.workunit.client.1.smithi099.stdout:3/766: write d9/d15/f50 [3993199,109803] 0 2024-09-17T01:02:02.745 INFO:tasks.workunit.client.1.smithi099.stdout:1/864: truncate d0/d8/d49/d94/d4b/d59/db9/feb 3160825 0 2024-09-17T01:02:02.745 INFO:tasks.workunit.client.1.smithi099.stdout:7/656: rmdir d1/d37/d78 39 2024-09-17T01:02:02.745 INFO:tasks.workunit.client.1.smithi099.stdout:7/657: chown d1/d37/d4f/fc8 453 1 2024-09-17T01:02:02.746 INFO:tasks.workunit.client.1.smithi099.stdout:2/627: mkdir d2/d9/d25/d26/d1b/d2c/d5d/dc8 0 2024-09-17T01:02:02.746 INFO:tasks.workunit.client.1.smithi099.stdout:2/628: truncate d2/d9/d25/d26/d1b/d2c/f52 1910 0 2024-09-17T01:02:02.748 INFO:tasks.workunit.client.1.smithi099.stdout:5/788: rename d2/dc4/d90/da4/l48 to d2/dc4/d99/dd0/db2/l101 0 2024-09-17T01:02:02.748 INFO:tasks.workunit.client.1.smithi099.stdout:5/789: stat d2/dc4/d90/da4/f21 0 2024-09-17T01:02:02.748 INFO:tasks.workunit.client.1.smithi099.stdout:5/790: fdatasync d2/d8/f29 0 2024-09-17T01:02:02.752 INFO:tasks.workunit.client.1.smithi099.stdout:7/658: creat d1/d2c/d5c/d1c/d72/fd3 x:0 0 0 2024-09-17T01:02:02.755 INFO:tasks.workunit.client.1.smithi099.stdout:3/767: dread d9/d15/d18/d1a/f1b [8388608,4194304] 0 2024-09-17T01:02:02.756 INFO:tasks.workunit.client.1.smithi099.stdout:0/698: dwrite da/d12/d2b/f37 [8388608,4194304] 0 2024-09-17T01:02:02.756 INFO:tasks.workunit.client.1.smithi099.stdout:0/699: stat da/df/f28 0 2024-09-17T01:02:02.756 INFO:tasks.workunit.client.1.smithi099.stdout:4/710: rename d7/dd/de/d17/d72/faa to d7/dd/d21/d26/d3f/d5b/da4/dde/ff3 0 2024-09-17T01:02:02.757 INFO:tasks.workunit.client.1.smithi099.stdout:5/791: mknod d2/dc4/d90/da4/d9c/c102 0 2024-09-17T01:02:02.758 INFO:tasks.workunit.client.1.smithi099.stdout:9/745: rmdir da/d21/d5b 39 2024-09-17T01:02:02.759 INFO:tasks.workunit.client.1.smithi099.stdout:1/865: rmdir d0/d2/de/d31 39 2024-09-17T01:02:02.759 INFO:tasks.workunit.client.1.smithi099.stdout:1/866: creat d0/d8/d49/d94/de0/dba/f121 x:0 0 0 2024-09-17T01:02:02.760 INFO:tasks.workunit.client.0.smithi002.stdout:3/668: sync 2024-09-17T01:02:02.760 INFO:tasks.workunit.client.0.smithi002.stdout:4/852: sync 2024-09-17T01:02:02.761 INFO:tasks.workunit.client.0.smithi002.stdout:1/682: sync 2024-09-17T01:02:02.761 INFO:tasks.workunit.client.0.smithi002.stdout:7/715: sync 2024-09-17T01:02:02.761 INFO:tasks.workunit.client.0.smithi002.stdout:7/716: fdatasync d1/d14/d1d/d28/d40/fc2 0 2024-09-17T01:02:02.761 INFO:tasks.workunit.client.0.smithi002.stdout:4/853: truncate d7/d71/d8e/fba 2718602 0 2024-09-17T01:02:02.762 INFO:tasks.workunit.client.0.smithi002.stdout:1/683: mknod d4/d11/d55/ce5 0 2024-09-17T01:02:02.762 INFO:tasks.workunit.client.0.smithi002.stdout:1/684: fdatasync d4/d11/d12/d14/d17/d51/fc7 0 2024-09-17T01:02:02.763 INFO:tasks.workunit.client.1.smithi099.stdout:7/659: link d1/d2c/l31 d1/d2c/d5c/d1c/d5a/d76/ld4 0 2024-09-17T01:02:02.763 INFO:tasks.workunit.client.1.smithi099.stdout:7/660: write d1/d2c/d5c/d1c/d72/fd3 [389115,51469] 0 2024-09-17T01:02:02.765 INFO:tasks.workunit.client.1.smithi099.stdout:2/629: rmdir d2/d9/d25/d26/d1b/d2c/d9b 39 2024-09-17T01:02:02.765 INFO:tasks.workunit.client.1.smithi099.stdout:2/630: truncate d2/d9/d25/d26/d1b/d2c/d3f/fa9 790860 0 2024-09-17T01:02:02.765 INFO:tasks.workunit.client.1.smithi099.stdout:2/631: truncate d2/d9/d17/f93 19819 0 2024-09-17T01:02:02.765 INFO:tasks.workunit.client.1.smithi099.stdout:2/632: dread - d2/d9/d17/f63 zero size 2024-09-17T01:02:02.765 INFO:tasks.workunit.client.0.smithi002.stdout:0/640: dwrite dd/d19/d1a/f70 [0,4194304] 0 2024-09-17T01:02:02.765 INFO:tasks.workunit.client.0.smithi002.stdout:7/717: creat d1/d14/d1d/d28/d40/d58/fe7 x:0 0 0 2024-09-17T01:02:02.765 INFO:tasks.workunit.client.0.smithi002.stdout:7/718: dread - d1/d14/d1d/d29/d98/fb5 zero size 2024-09-17T01:02:02.765 INFO:tasks.workunit.client.0.smithi002.stdout:7/719: fdatasync d1/d14/d1d/d28/d40/f5f 0 2024-09-17T01:02:02.765 INFO:tasks.workunit.client.0.smithi002.stdout:7/720: write d1/d14/d1d/d28/d40/d58/fe7 [1041595,72845] 0 2024-09-17T01:02:02.765 INFO:tasks.workunit.client.0.smithi002.stdout:7/721: fsync d1/d14/d1d/d28/d6b/fbf 0 2024-09-17T01:02:02.765 INFO:tasks.workunit.client.0.smithi002.stdout:7/722: chown d1/d14/d67 13700 1 2024-09-17T01:02:02.765 INFO:tasks.workunit.client.0.smithi002.stdout:4/854: mkdir d7/d19/d2e/d103/d108 0 2024-09-17T01:02:02.766 INFO:tasks.workunit.client.0.smithi002.stdout:1/685: creat d4/d11/d1a/daa/fe6 x:0 0 0 2024-09-17T01:02:02.767 INFO:tasks.workunit.client.0.smithi002.stdout:1/686: creat d4/d11/d1a/daa/fe7 x:0 0 0 2024-09-17T01:02:02.767 INFO:tasks.workunit.client.1.smithi099.stdout:6/784: dwrite dc/d5d/dae/dd0/fdb [0,4194304] 0 2024-09-17T01:02:02.769 INFO:tasks.workunit.client.1.smithi099.stdout:3/768: dread d9/d2b/f2d [0,4194304] 0 2024-09-17T01:02:02.769 INFO:tasks.workunit.client.1.smithi099.stdout:3/769: chown d9/d15/l61 0 1 2024-09-17T01:02:02.769 INFO:tasks.workunit.client.1.smithi099.stdout:5/792: rename d2/d26/l96 to d2/dc4/d99/dd0/dc3/dfc/l103 0 2024-09-17T01:02:02.769 INFO:tasks.workunit.client.1.smithi099.stdout:5/793: stat d2/dc4/dad/dc2 0 2024-09-17T01:02:02.769 INFO:tasks.workunit.client.1.smithi099.stdout:5/794: write d2/dc/d14/d36/fc0 [736666,116027] 0 2024-09-17T01:02:02.769 INFO:tasks.workunit.client.1.smithi099.stdout:5/795: chown d2/dc/d6c/l8d 2707 1 2024-09-17T01:02:02.769 INFO:tasks.workunit.client.1.smithi099.stdout:5/796: write d2/dc4/d99/dd0/ff7 [709053,75166] 0 2024-09-17T01:02:02.769 INFO:tasks.workunit.client.1.smithi099.stdout:5/797: write d2/dc/d6c/fcc [18800,119105] 0 2024-09-17T01:02:02.769 INFO:tasks.workunit.client.0.smithi002.stdout:0/641: rename dd/d19/d1a/d29/l5c to dd/d19/d1a/d29/d55/d61/ld7 0 2024-09-17T01:02:02.770 INFO:tasks.workunit.client.0.smithi002.stdout:0/642: write dd/d19/da9/fcd [15528,58080] 0 2024-09-17T01:02:02.771 INFO:tasks.workunit.client.0.smithi002.stdout:4/855: truncate d7/d19/d2e/fbd 2278645 0 2024-09-17T01:02:02.772 INFO:tasks.workunit.client.0.smithi002.stdout:6/730: dwrite d2/d1d/d26/d49/fa0 [0,4194304] 0 2024-09-17T01:02:02.772 INFO:tasks.workunit.client.0.smithi002.stdout:1/687: mkdir d4/d22/d8d/de8 0 2024-09-17T01:02:02.772 INFO:tasks.workunit.client.1.smithi099.stdout:1/867: creat d0/de2/dfd/d104/f122 x:0 0 0 2024-09-17T01:02:02.776 INFO:tasks.workunit.client.1.smithi099.stdout:9/746: dread da/d56/d84/f9c [0,4194304] 0 2024-09-17T01:02:02.776 INFO:tasks.workunit.client.1.smithi099.stdout:9/747: write da/d56/d84/fbb [351277,25724] 0 2024-09-17T01:02:02.776 INFO:tasks.workunit.client.1.smithi099.stdout:7/661: creat d1/d2c/d5c/d1c/d5a/db3/fd5 x:0 0 0 2024-09-17T01:02:02.776 INFO:tasks.workunit.client.1.smithi099.stdout:7/662: stat d1/d37/c6e 0 2024-09-17T01:02:02.776 INFO:tasks.workunit.client.1.smithi099.stdout:7/663: read - d1/d2c/d5c/d12/f29 zero size 2024-09-17T01:02:02.776 INFO:tasks.workunit.client.1.smithi099.stdout:7/664: chown d1/d36 805980 1 2024-09-17T01:02:02.777 INFO:tasks.workunit.client.1.smithi099.stdout:7/665: chown d1/d2c/d47/c6d 13829617 1 2024-09-17T01:02:02.777 INFO:tasks.workunit.client.0.smithi002.stdout:4/856: rename d7/d19/d9f/d80/d62/d52 to d7/de/d3a/d109 0 2024-09-17T01:02:02.782 INFO:tasks.workunit.client.0.smithi002.stdout:6/731: symlink d2/d1d/d26/d49/d7d/d8c/lea 0 2024-09-17T01:02:02.786 INFO:tasks.workunit.client.1.smithi099.stdout:2/633: mknod d2/d9/d17/cc9 0 2024-09-17T01:02:02.787 INFO:tasks.workunit.client.1.smithi099.stdout:4/711: rmdir d7/d35/d98 39 2024-09-17T01:02:02.787 INFO:tasks.workunit.client.1.smithi099.stdout:4/712: write d7/dd/d21/d7b/fb1 [989638,117936] 0 2024-09-17T01:02:02.787 INFO:tasks.workunit.client.1.smithi099.stdout:4/713: write d7/dd/d21/d7b/d74/f7c [2327715,91225] 0 2024-09-17T01:02:02.788 INFO:tasks.workunit.client.1.smithi099.stdout:4/714: chown d7/dd/de/fb8 414 1 2024-09-17T01:02:02.788 INFO:tasks.workunit.client.1.smithi099.stdout:3/770: creat d9/d15/d18/d1a/d23/d5c/d99/dda/db5/dca/fee x:0 0 0 2024-09-17T01:02:02.790 INFO:tasks.workunit.client.0.smithi002.stdout:0/643: rmdir dd 39 2024-09-17T01:02:02.792 INFO:tasks.workunit.client.0.smithi002.stdout:4/857: unlink d7/de/d32/f73 0 2024-09-17T01:02:02.793 INFO:tasks.workunit.client.1.smithi099.stdout:5/798: link d2/dc4/d99/dd0/dc3/dc8/fd7 d2/dc/d14/d89/f104 0 2024-09-17T01:02:02.794 INFO:tasks.workunit.client.0.smithi002.stdout:4/858: link d7/l1b d7/d19/d9f/d80/l10a 0 2024-09-17T01:02:02.795 INFO:tasks.workunit.client.1.smithi099.stdout:1/868: symlink d0/d8/d49/d94/de0/dba/l123 0 2024-09-17T01:02:02.795 INFO:tasks.workunit.client.1.smithi099.stdout:1/869: creat d0/d2/dd8/f124 x:0 0 0 2024-09-17T01:02:02.795 INFO:tasks.workunit.client.1.smithi099.stdout:1/870: write d0/d8/d49/d94/d4b/d59/db9/dc8/fcd [2496776,34862] 0 2024-09-17T01:02:02.796 INFO:tasks.workunit.client.0.smithi002.stdout:1/688: write d4/d11/d12/d14/d17/d51/dc0/fd6 [1275272,50073] 0 2024-09-17T01:02:02.796 INFO:tasks.workunit.client.1.smithi099.stdout:4/715: dread d7/dd/d21/d26/d3f/d5b/f37 [0,4194304] 0 2024-09-17T01:02:02.797 INFO:tasks.workunit.client.1.smithi099.stdout:9/748: rename da/ff to da/d14/d40/ff2 0 2024-09-17T01:02:02.797 INFO:tasks.workunit.client.0.smithi002.stdout:1/689: mkdir d4/d11/d12/d14/d17/d20/de9 0 2024-09-17T01:02:02.798 INFO:tasks.workunit.client.0.smithi002.stdout:1/690: truncate d4/d11/d12/d14/d17/d3b/f42 1027772 0 2024-09-17T01:02:02.799 INFO:tasks.workunit.client.0.smithi002.stdout:1/691: symlink d4/d11/d12/d14/d17/d51/d88/da3/lea 0 2024-09-17T01:02:02.799 INFO:tasks.workunit.client.1.smithi099.stdout:3/771: mknod d9/d3b/cef 0 2024-09-17T01:02:02.799 INFO:tasks.workunit.client.1.smithi099.stdout:3/772: chown d9/d15/c16 41218 1 2024-09-17T01:02:02.799 INFO:tasks.workunit.client.0.smithi002.stdout:1/692: fdatasync d4/d11/d12/d30/d43/d67/f98 0 2024-09-17T01:02:02.800 INFO:tasks.workunit.client.1.smithi099.stdout:5/799: truncate d2/dc/f42 4181990 0 2024-09-17T01:02:02.800 INFO:tasks.workunit.client.0.smithi002.stdout:1/693: mkdir d4/d11/d12/d14/d17/d40/deb 0 2024-09-17T01:02:02.802 INFO:tasks.workunit.client.1.smithi099.stdout:2/634: read d2/d9/d17/f78 [960617,34389] 0 2024-09-17T01:02:02.808 INFO:tasks.workunit.client.0.smithi002.stdout:1/694: read d4/d11/d12/d14/d17/d40/f69 [4141059,57725] 0 2024-09-17T01:02:02.821 INFO:tasks.workunit.client.1.smithi099.stdout:6/785: dwrite dc/d1a/d49/fba [0,4194304] 0 2024-09-17T01:02:02.821 INFO:tasks.workunit.client.1.smithi099.stdout:6/786: write dc/d27/d7e/fd1 [194186,107577] 0 2024-09-17T01:02:02.822 INFO:tasks.workunit.client.0.smithi002.stdout:4/859: dread d7/d19/fe4 [0,4194304] 0 2024-09-17T01:02:02.822 INFO:tasks.workunit.client.0.smithi002.stdout:1/695: dread d4/d22/f39 [0,4194304] 0 2024-09-17T01:02:02.822 INFO:tasks.workunit.client.0.smithi002.stdout:4/860: symlink d7/de/d3a/d109/l10b 0 2024-09-17T01:02:02.824 INFO:tasks.workunit.client.0.smithi002.stdout:1/696: symlink d4/d11/d12/d14/d17/lec 0 2024-09-17T01:02:02.824 INFO:tasks.workunit.client.0.smithi002.stdout:1/697: stat d4/d11/d1c/f66 0 2024-09-17T01:02:02.824 INFO:tasks.workunit.client.1.smithi099.stdout:1/871: mknod d0/d2/de/d31/c125 0 2024-09-17T01:02:02.824 INFO:tasks.workunit.client.1.smithi099.stdout:1/872: chown d0/d2/d18/f6b 7098418 1 2024-09-17T01:02:02.827 INFO:tasks.workunit.client.1.smithi099.stdout:0/700: dwrite da/df/d1a/d56/fbd [0,4194304] 0 2024-09-17T01:02:02.827 INFO:tasks.workunit.client.0.smithi002.stdout:3/669: dwrite d0/d31/d32/d92/fda [0,4194304] 0 2024-09-17T01:02:02.828 INFO:tasks.workunit.client.1.smithi099.stdout:9/749: rmdir da/d9a/d3a/d4b 39 2024-09-17T01:02:02.829 INFO:tasks.workunit.client.1.smithi099.stdout:4/716: creat d7/dd/d21/d7b/de2/ff4 x:0 0 0 2024-09-17T01:02:02.829 INFO:tasks.workunit.client.1.smithi099.stdout:4/717: write d7/dd/d21/fd8 [796361,31684] 0 2024-09-17T01:02:02.830 INFO:tasks.workunit.client.1.smithi099.stdout:2/635: mkdir d2/d9/d17/d83/dca 0 2024-09-17T01:02:02.830 INFO:tasks.workunit.client.0.smithi002.stdout:7/723: dwrite d1/d14/d1d/d28/d40/fd6 [0,4194304] 0 2024-09-17T01:02:02.832 INFO:tasks.workunit.client.0.smithi002.stdout:6/732: dwrite d2/f13 [0,4194304] 0 2024-09-17T01:02:02.832 INFO:tasks.workunit.client.0.smithi002.stdout:7/724: mkdir d1/d14/d1d/d28/d6b/d9e/d54/de8 0 2024-09-17T01:02:02.832 INFO:tasks.workunit.client.1.smithi099.stdout:7/666: dwrite d1/d36/f62 [4194304,4194304] 0 2024-09-17T01:02:02.833 INFO:tasks.workunit.client.1.smithi099.stdout:6/787: dread dc/d5d/dae/d96/f8e [0,4194304] 0 2024-09-17T01:02:02.833 INFO:tasks.workunit.client.0.smithi002.stdout:1/698: dread d4/ff [0,4194304] 0 2024-09-17T01:02:02.834 INFO:tasks.workunit.client.0.smithi002.stdout:0/644: dwrite dd/d19/f6f [0,4194304] 0 2024-09-17T01:02:02.839 INFO:tasks.workunit.client.0.smithi002.stdout:0/645: rmdir dd/d19/d1c/d33/d67 39 2024-09-17T01:02:02.839 INFO:tasks.workunit.client.0.smithi002.stdout:0/646: write dd/d3d/f85 [690010,66951] 0 2024-09-17T01:02:02.840 INFO:tasks.workunit.client.0.smithi002.stdout:6/733: getdents d2/d1d/d2d/d35/d6d/dd6 0 2024-09-17T01:02:02.840 INFO:tasks.workunit.client.0.smithi002.stdout:7/725: dread d1/d14/d1d/fe2 [0,4194304] 0 2024-09-17T01:02:02.843 INFO:tasks.workunit.client.0.smithi002.stdout:7/726: mknod d1/d14/d1d/d28/d6b/ce9 0 2024-09-17T01:02:02.843 INFO:tasks.workunit.client.0.smithi002.stdout:8/881: sync 2024-09-17T01:02:02.843 INFO:tasks.workunit.client.0.smithi002.stdout:5/684: sync 2024-09-17T01:02:02.844 INFO:tasks.workunit.client.0.smithi002.stdout:1/699: dread d4/d11/f15 [0,4194304] 0 2024-09-17T01:02:02.844 INFO:tasks.workunit.client.0.smithi002.stdout:2/742: sync 2024-09-17T01:02:02.844 INFO:tasks.workunit.client.0.smithi002.stdout:2/743: readlink d1b/d1d/led 0 2024-09-17T01:02:02.844 INFO:tasks.workunit.client.0.smithi002.stdout:9/653: sync 2024-09-17T01:02:02.844 INFO:tasks.workunit.client.1.smithi099.stdout:0/701: dread da/df/d31/db0/d1e/f24 [0,4194304] 0 2024-09-17T01:02:02.847 INFO:tasks.workunit.client.0.smithi002.stdout:8/882: rename d2/d9/dd/cb2 to d2/d1c/c121 0 2024-09-17T01:02:02.850 INFO:tasks.workunit.client.0.smithi002.stdout:5/685: symlink d2/de/d57/d80/lde 0 2024-09-17T01:02:02.850 INFO:tasks.workunit.client.0.smithi002.stdout:3/670: dwrite d0/d31/d32/fb9 [0,4194304] 0 2024-09-17T01:02:02.850 INFO:tasks.workunit.client.0.smithi002.stdout:3/671: dread - d0/d3/d17/d9a/daa/f8f zero size 2024-09-17T01:02:02.854 INFO:tasks.workunit.client.0.smithi002.stdout:9/654: chown d5/dc/f32 241671982 1 2024-09-17T01:02:02.855 INFO:tasks.workunit.client.0.smithi002.stdout:9/655: fdatasync d5/dc/d26/d5c/d6b/d75/d57/d7a/f93 0 2024-09-17T01:02:02.855 INFO:tasks.workunit.client.0.smithi002.stdout:5/686: mknod d2/d2d/d10/d14/d19/d39/dae/cdf 0 2024-09-17T01:02:02.856 INFO:tasks.workunit.client.0.smithi002.stdout:5/687: write d2/d2d/d10/d14/d19/d39/d64/fb6 [536078,130052] 0 2024-09-17T01:02:02.857 INFO:tasks.workunit.client.1.smithi099.stdout:1/873: dread d0/de2/f100 [0,4194304] 0 2024-09-17T01:02:02.858 INFO:tasks.workunit.client.0.smithi002.stdout:3/672: rename d0/cbf to d0/d3/d37/dac/da1/dd8/dc6/cdc 0 2024-09-17T01:02:02.858 INFO:tasks.workunit.client.0.smithi002.stdout:3/673: stat d0/d3/d17/l64 0 2024-09-17T01:02:02.859 INFO:tasks.workunit.client.0.smithi002.stdout:1/700: getdents d4/d11/d12/d14/d17/d40 0 2024-09-17T01:02:02.860 INFO:tasks.workunit.client.1.smithi099.stdout:9/750: dread da/d21/d2a/f8c [0,4194304] 0 2024-09-17T01:02:02.860 INFO:tasks.workunit.client.0.smithi002.stdout:9/656: creat d5/dc/d26/d63/d66/fc4 x:0 0 0 2024-09-17T01:02:02.861 INFO:tasks.workunit.client.0.smithi002.stdout:1/701: rmdir d4/d11/d12/d14/d17/d51/d88 39 2024-09-17T01:02:02.862 INFO:tasks.workunit.client.0.smithi002.stdout:9/657: symlink d5/dc/d26/d5c/d6b/d75/d57/d8d/lc5 0 2024-09-17T01:02:02.864 INFO:tasks.workunit.client.0.smithi002.stdout:9/658: symlink d5/dc/d26/d46/d47/lc6 0 2024-09-17T01:02:02.864 INFO:tasks.workunit.client.0.smithi002.stdout:9/659: chown d5/dc/d26/d5c/d6b/d75/f62 175877 1 2024-09-17T01:02:02.864 INFO:tasks.workunit.client.0.smithi002.stdout:9/660: chown d5/dc/f3d 76 1 2024-09-17T01:02:02.864 INFO:tasks.workunit.client.0.smithi002.stdout:9/661: dread - d5/d8a/d9d/da7/fb2 zero size 2024-09-17T01:02:02.865 INFO:tasks.workunit.client.0.smithi002.stdout:9/662: getdents d5/dc/d26/d5c/d6b/d75/d57/d7a/da2 0 2024-09-17T01:02:02.881 INFO:tasks.workunit.client.0.smithi002.stdout:6/734: dwrite d2/d1d/d27/d30/fdd [0,4194304] 0 2024-09-17T01:02:02.881 INFO:tasks.workunit.client.0.smithi002.stdout:6/735: readlink d2/d1d/d2d/d35/d79/da8/le9 0 2024-09-17T01:02:02.881 INFO:tasks.workunit.client.0.smithi002.stdout:6/736: write d2/d1d/fa3 [579819,95304] 0 2024-09-17T01:02:02.882 INFO:tasks.workunit.client.0.smithi002.stdout:6/737: write d2/d1d/d2d/d35/d79/faa [1003669,9124] 0 2024-09-17T01:02:02.883 INFO:tasks.workunit.client.0.smithi002.stdout:6/738: symlink d2/dc/dcd/leb 0 2024-09-17T01:02:02.883 INFO:tasks.workunit.client.0.smithi002.stdout:6/739: creat d2/dc/d24/fec x:0 0 0 2024-09-17T01:02:02.883 INFO:tasks.workunit.client.0.smithi002.stdout:6/740: readlink d2/dc/lf 0 2024-09-17T01:02:02.887 INFO:tasks.workunit.client.0.smithi002.stdout:2/744: dread d1b/d74/f99 [0,4194304] 0 2024-09-17T01:02:02.888 INFO:tasks.workunit.client.0.smithi002.stdout:2/745: getdents d1b/d37 0 2024-09-17T01:02:02.901 INFO:tasks.workunit.client.0.smithi002.stdout:7/727: dwrite d1/d14/d67/dc0/dcd/f63 [0,4194304] 0 2024-09-17T01:02:02.901 INFO:tasks.workunit.client.0.smithi002.stdout:7/728: chown d1/d24/f31 8185 1 2024-09-17T01:02:02.902 INFO:tasks.workunit.client.0.smithi002.stdout:7/729: write d1/d24/f46 [1877397,37193] 0 2024-09-17T01:02:02.902 INFO:tasks.workunit.client.0.smithi002.stdout:7/730: creat d1/d14/d67/dc0/dcd/d45/fea x:0 0 0 2024-09-17T01:02:02.911 INFO:tasks.workunit.client.0.smithi002.stdout:8/883: dwrite d2/d1c/d28/da0/fc0 [0,4194304] 0 2024-09-17T01:02:02.911 INFO:tasks.workunit.client.0.smithi002.stdout:8/884: chown d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d47/l91 82528 1 2024-09-17T01:02:02.914 INFO:tasks.workunit.client.0.smithi002.stdout:8/885: creat d2/d1c/d28/f122 x:0 0 0 2024-09-17T01:02:02.914 INFO:tasks.workunit.client.0.smithi002.stdout:8/886: stat d2/d1c/d28/dad/dcd/dd1/ddb/d10f/de6/f10e 0 2024-09-17T01:02:02.918 INFO:tasks.workunit.client.1.smithi099.stdout:4/718: truncate d7/dd/d21/fbd 2460764 0 2024-09-17T01:02:02.923 INFO:tasks.workunit.client.0.smithi002.stdout:8/887: dread d2/d1c/d28/f55 [0,4194304] 0 2024-09-17T01:02:02.925 INFO:tasks.workunit.client.0.smithi002.stdout:8/888: creat d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/f123 x:0 0 0 2024-09-17T01:02:02.925 INFO:tasks.workunit.client.1.smithi099.stdout:7/667: stat d1/d36/c84 0 2024-09-17T01:02:02.927 INFO:tasks.workunit.client.0.smithi002.stdout:8/889: dread d2/d9/dd/fb1 [0,4194304] 0 2024-09-17T01:02:02.928 INFO:tasks.workunit.client.0.smithi002.stdout:8/890: rename d2/f56 to d2/d1c/d28/da0/f124 0 2024-09-17T01:02:02.931 INFO:tasks.workunit.client.1.smithi099.stdout:6/788: rename dc/d27/dd7/d87/db6/lbf to dc/d27/dd7/dde/ddf/l10d 0 2024-09-17T01:02:02.931 INFO:tasks.workunit.client.1.smithi099.stdout:6/789: chown dc/d2b/fa6 29337 1 2024-09-17T01:02:02.938 INFO:tasks.workunit.client.0.smithi002.stdout:0/647: dwrite dd/d3d/d94/dd1/fd6 [0,4194304] 0 2024-09-17T01:02:02.938 INFO:tasks.workunit.client.0.smithi002.stdout:0/648: chown dd/f32 0 1 2024-09-17T01:02:02.939 INFO:tasks.workunit.client.1.smithi099.stdout:0/702: dwrite da/f27 [0,4194304] 0 2024-09-17T01:02:02.939 INFO:tasks.workunit.client.1.smithi099.stdout:0/703: write da/df/d1a/d49/f4a [4533417,63852] 0 2024-09-17T01:02:02.949 INFO:tasks.workunit.client.0.smithi002.stdout:1/702: dwrite d4/d11/f15 [0,4194304] 0 2024-09-17T01:02:02.949 INFO:tasks.workunit.client.0.smithi002.stdout:1/703: read d4/d11/f71 [889437,54761] 0 2024-09-17T01:02:02.949 INFO:tasks.workunit.client.0.smithi002.stdout:6/741: dwrite d2/dc/d24/d53/d9e/fc8 [4194304,4194304] 0 2024-09-17T01:02:02.950 INFO:tasks.workunit.client.1.smithi099.stdout:5/800: unlink d2/dc/d17/d3c/fe0 0 2024-09-17T01:02:02.951 INFO:tasks.workunit.client.1.smithi099.stdout:1/874: symlink d0/d8/d38/d56/l126 0 2024-09-17T01:02:02.951 INFO:tasks.workunit.client.0.smithi002.stdout:2/746: dwrite d1b/d37/d48/d4e/dc5/ff7 [0,4194304] 0 2024-09-17T01:02:02.953 INFO:tasks.workunit.client.0.smithi002.stdout:5/688: dwrite d2/d2d/d10/d14/d19/d39/dae/fc9 [0,4194304] 0 2024-09-17T01:02:02.954 INFO:tasks.workunit.client.1.smithi099.stdout:6/790: dread dc/d1a/f86 [0,4194304] 0 2024-09-17T01:02:02.954 INFO:tasks.workunit.client.0.smithi002.stdout:6/742: creat d2/d1d/d27/d30/d98/fed x:0 0 0 2024-09-17T01:02:02.956 INFO:tasks.workunit.client.0.smithi002.stdout:2/747: creat d1b/d1d/dd4/de9/f10c x:0 0 0 2024-09-17T01:02:02.957 INFO:tasks.workunit.client.1.smithi099.stdout:7/668: mkdir d1/d36/d8d/dd6 0 2024-09-17T01:02:02.957 INFO:tasks.workunit.client.1.smithi099.stdout:7/669: readlink d1/d2c/d5c/d1c/l2e 0 2024-09-17T01:02:02.958 INFO:tasks.workunit.client.0.smithi002.stdout:7/731: dwrite d1/d14/d1d/d28/d40/fd6 [0,4194304] 0 2024-09-17T01:02:02.959 INFO:tasks.workunit.client.0.smithi002.stdout:6/743: truncate d2/d1d/d26/d49/d51/f96 1766366 0 2024-09-17T01:02:02.960 INFO:tasks.workunit.client.0.smithi002.stdout:2/748: mkdir d1b/d8a/d92/dae/d10d 0 2024-09-17T01:02:02.961 INFO:tasks.workunit.client.1.smithi099.stdout:4/719: dwrite d7/dd/d21/d26/d3f/d5b/da4/fb7 [4194304,4194304] 0 2024-09-17T01:02:02.961 INFO:tasks.workunit.client.0.smithi002.stdout:8/891: dwrite d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d77/db0/fda [0,4194304] 0 2024-09-17T01:02:02.961 INFO:tasks.workunit.client.0.smithi002.stdout:0/649: dread dd/f5a [0,4194304] 0 2024-09-17T01:02:02.962 INFO:tasks.workunit.client.1.smithi099.stdout:5/801: mknod d2/dc4/d99/dd0/c105 0 2024-09-17T01:02:02.962 INFO:tasks.workunit.client.1.smithi099.stdout:5/802: read - d2/dc4/d99/dd0/dc3/dc8/fd7 zero size 2024-09-17T01:02:02.963 INFO:tasks.workunit.client.0.smithi002.stdout:7/732: rename d1/d14/d1d/d28/d40/d58/c87 to d1/d24/ceb 0 2024-09-17T01:02:02.963 INFO:tasks.workunit.client.0.smithi002.stdout:7/733: readlink d1/d14/d1d/l2c 0 2024-09-17T01:02:02.963 INFO:tasks.workunit.client.0.smithi002.stdout:7/734: fsync d1/d14/d1d/d28/d40/d58/f7e 0 2024-09-17T01:02:02.963 INFO:tasks.workunit.client.0.smithi002.stdout:6/744: link d2/d1d/d26/f2b d2/d1d/d99/fee 0 2024-09-17T01:02:02.964 INFO:tasks.workunit.client.1.smithi099.stdout:6/791: mknod dc/d5d/d66/dbb/d10c/d74/c10e 0 2024-09-17T01:02:02.966 INFO:tasks.workunit.client.1.smithi099.stdout:4/720: dread d7/dd/d21/d7b/f42 [0,4194304] 0 2024-09-17T01:02:02.967 INFO:tasks.workunit.client.0.smithi002.stdout:2/749: rename d1b/d37/d48/d52/f5d to d1b/d3f/d59/d7f/dc9/dac/f10e 0 2024-09-17T01:02:02.967 INFO:tasks.workunit.client.0.smithi002.stdout:2/750: fsync d1b/d37/d48/d52/db5/fd3 0 2024-09-17T01:02:02.967 INFO:tasks.workunit.client.0.smithi002.stdout:2/751: write d1b/d37/d48/db1/dbb/f103 [884062,1170] 0 2024-09-17T01:02:02.968 INFO:tasks.workunit.client.0.smithi002.stdout:7/735: getdents d1/d14/d1d/d29/d98 0 2024-09-17T01:02:02.968 INFO:tasks.workunit.client.0.smithi002.stdout:7/736: chown d1/l12 465371 1 2024-09-17T01:02:02.970 INFO:tasks.workunit.client.1.smithi099.stdout:5/803: creat d2/dc/d17/d3c/dc6/dfb/f106 x:0 0 0 2024-09-17T01:02:02.970 INFO:tasks.workunit.client.0.smithi002.stdout:6/745: creat d2/d1d/d2d/d5a/fef x:0 0 0 2024-09-17T01:02:02.972 INFO:tasks.workunit.client.0.smithi002.stdout:8/892: rename d2/d1c/d28/dad/dcd/dd1/f115 to d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/f125 0 2024-09-17T01:02:02.973 INFO:tasks.workunit.client.1.smithi099.stdout:7/670: dread d1/ff [4194304,4194304] 0 2024-09-17T01:02:02.974 INFO:tasks.workunit.client.1.smithi099.stdout:4/721: mknod d7/dd/de/d10/d85/cf5 0 2024-09-17T01:02:02.975 INFO:tasks.workunit.client.0.smithi002.stdout:0/650: rename dd/d19/d1c/d1f/d22/c27 to dd/d19/d1a/d29/d55/cd8 0 2024-09-17T01:02:02.975 INFO:tasks.workunit.client.0.smithi002.stdout:0/651: chown dd/d19/d1a/f70 61971 1 2024-09-17T01:02:02.975 INFO:tasks.workunit.client.0.smithi002.stdout:8/893: rmdir d2/d1c/d28/dad/dcd/dd1/ddb/dcb 39 2024-09-17T01:02:02.975 INFO:tasks.workunit.client.0.smithi002.stdout:8/894: truncate d2/d9/f97 823738 0 2024-09-17T01:02:02.975 INFO:tasks.workunit.client.0.smithi002.stdout:0/652: creat dd/d19/d1c/d33/fd9 x:0 0 0 2024-09-17T01:02:02.976 INFO:tasks.workunit.client.1.smithi099.stdout:6/792: truncate dc/f34 5616614 0 2024-09-17T01:02:02.976 INFO:tasks.workunit.client.0.smithi002.stdout:8/895: unlink d2/d9/c85 0 2024-09-17T01:02:02.976 INFO:tasks.workunit.client.0.smithi002.stdout:8/896: readlink d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/ld2 0 2024-09-17T01:02:02.977 INFO:tasks.workunit.client.0.smithi002.stdout:0/653: mknod dd/d19/d1c/cda 0 2024-09-17T01:02:02.977 INFO:tasks.workunit.client.0.smithi002.stdout:8/897: creat d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/f126 x:0 0 0 2024-09-17T01:02:02.978 INFO:tasks.workunit.client.0.smithi002.stdout:0/654: mkdir dd/d19/d1c/d33/ddb 0 2024-09-17T01:02:02.979 INFO:tasks.workunit.client.0.smithi002.stdout:8/898: symlink d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d58/l127 0 2024-09-17T01:02:02.980 INFO:tasks.workunit.client.0.smithi002.stdout:8/899: write d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d77/d78/fa9 [1167932,79798] 0 2024-09-17T01:02:02.980 INFO:tasks.workunit.client.0.smithi002.stdout:8/900: read - d2/d1c/d28/f122 zero size 2024-09-17T01:02:02.980 INFO:tasks.workunit.client.0.smithi002.stdout:8/901: readlink d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d77/dd9/le0 0 2024-09-17T01:02:02.981 INFO:tasks.workunit.client.0.smithi002.stdout:8/902: getdents d2/d1c/d28/dad 0 2024-09-17T01:02:02.982 INFO:tasks.workunit.client.0.smithi002.stdout:8/903: chown d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d77/d78/fce 7134110 1 2024-09-17T01:02:02.982 INFO:tasks.workunit.client.0.smithi002.stdout:8/904: readlink d2/d1c/d28/dad/dcd/dd1/ddb/d10f/l39 0 2024-09-17T01:02:02.982 INFO:tasks.workunit.client.0.smithi002.stdout:8/905: getdents d2/d1c/d28/da0 0 2024-09-17T01:02:02.982 INFO:tasks.workunit.client.0.smithi002.stdout:8/906: mknod d2/d9/dd/c128 0 2024-09-17T01:02:02.984 INFO:tasks.workunit.client.1.smithi099.stdout:4/722: link d7/dd/l44 d7/dd/d21/d7b/d74/lf6 0 2024-09-17T01:02:02.985 INFO:tasks.workunit.client.0.smithi002.stdout:1/704: dwrite d4/d11/fa8 [0,4194304] 0 2024-09-17T01:02:02.985 INFO:tasks.workunit.client.0.smithi002.stdout:1/705: stat d4/d11/d12/d23/d32/f84 0 2024-09-17T01:02:02.986 INFO:tasks.workunit.client.1.smithi099.stdout:6/793: link dc/d27/d7e/fd1 dc/d5d/dae/d96/dfd/d101/f10f 0 2024-09-17T01:02:02.986 INFO:tasks.workunit.client.1.smithi099.stdout:5/804: write d2/d8/f35 [926959,114694] 0 2024-09-17T01:02:02.987 INFO:tasks.workunit.client.0.smithi002.stdout:1/706: read d4/fb0 [1629771,127130] 0 2024-09-17T01:02:02.987 INFO:tasks.workunit.client.0.smithi002.stdout:1/707: write d4/ff [4818241,106750] 0 2024-09-17T01:02:02.988 INFO:tasks.workunit.client.1.smithi099.stdout:0/704: dwrite da/f27 [0,4194304] 0 2024-09-17T01:02:02.988 INFO:tasks.workunit.client.1.smithi099.stdout:0/705: write da/df/f28 [349945,46779] 0 2024-09-17T01:02:02.989 INFO:tasks.workunit.client.1.smithi099.stdout:0/706: chown da/d12/d2b/dab 0 1 2024-09-17T01:02:02.989 INFO:tasks.workunit.client.0.smithi002.stdout:1/708: creat d4/d11/d12/d14/d17/fed x:0 0 0 2024-09-17T01:02:02.992 INFO:tasks.workunit.client.1.smithi099.stdout:4/723: rename d7/dd/fb0 to d7/dd/d21/d26/d3f/d5b/ff7 0 2024-09-17T01:02:02.992 INFO:tasks.workunit.client.1.smithi099.stdout:4/724: stat d7/dd/d21/d26/d3f/d5b/c96 0 2024-09-17T01:02:02.994 INFO:tasks.workunit.client.1.smithi099.stdout:1/875: dwrite d0/d2/de/d70/de8/fab [4194304,4194304] 0 2024-09-17T01:02:02.996 INFO:tasks.workunit.client.1.smithi099.stdout:5/805: mkdir d2/d26/d64/de2/d107 0 2024-09-17T01:02:02.998 INFO:tasks.workunit.client.1.smithi099.stdout:0/707: link da/df/d1a/d49/fa0 da/df/d1a/d49/d68/d9f/dd7/fde 0 2024-09-17T01:02:02.999 INFO:tasks.workunit.client.0.smithi002.stdout:5/689: dread d2/d2d/d10/d23/d6e/f6b [0,4194304] 0 2024-09-17T01:02:03.000 INFO:tasks.workunit.client.1.smithi099.stdout:6/794: getdents dc/d27/dd7 0 2024-09-17T01:02:03.000 INFO:tasks.workunit.client.1.smithi099.stdout:0/708: dread da/d12/d2b/fa8 [0,4194304] 0 2024-09-17T01:02:03.000 INFO:tasks.workunit.client.1.smithi099.stdout:0/709: write da/df/d1a/d49/d71/fbb [855634,16719] 0 2024-09-17T01:02:03.005 INFO:tasks.workunit.client.1.smithi099.stdout:1/876: dread d0/d8/d49/f4c [0,4194304] 0 2024-09-17T01:02:03.016 INFO:tasks.workunit.client.0.smithi002.stdout:0/655: write dd/d19/d1a/f4a [2578075,38673] 0 2024-09-17T01:02:03.017 INFO:tasks.workunit.client.0.smithi002.stdout:2/752: dwrite d1b/d3f/d59/d7f/dc9/dac/fe0 [0,4194304] 0 2024-09-17T01:02:03.018 INFO:tasks.workunit.client.1.smithi099.stdout:6/795: mkdir dc/d1a/d49/da8/d110 0 2024-09-17T01:02:03.019 INFO:tasks.workunit.client.0.smithi002.stdout:2/753: symlink d1b/d37/d48/d4e/l10f 0 2024-09-17T01:02:03.019 INFO:tasks.workunit.client.1.smithi099.stdout:1/877: mknod d0/de2/dfd/d104/c127 0 2024-09-17T01:02:03.019 INFO:tasks.workunit.client.1.smithi099.stdout:1/878: write d0/dbc/f106 [1015631,93771] 0 2024-09-17T01:02:03.020 INFO:tasks.workunit.client.0.smithi002.stdout:2/754: rename d1b/f39 to d1b/d74/d93/d94/f110 0 2024-09-17T01:02:03.021 INFO:tasks.workunit.client.1.smithi099.stdout:6/796: creat dc/f111 x:0 0 0 2024-09-17T01:02:03.022 INFO:tasks.workunit.client.0.smithi002.stdout:2/755: write d1b/d37/f49 [814787,42318] 0 2024-09-17T01:02:03.022 INFO:tasks.workunit.client.1.smithi099.stdout:1/879: symlink d0/d8/d38/d8a/l128 0 2024-09-17T01:02:03.023 INFO:tasks.workunit.client.1.smithi099.stdout:6/797: mknod dc/d27/dd7/d87/db6/de1/c112 0 2024-09-17T01:02:03.024 INFO:tasks.workunit.client.1.smithi099.stdout:1/880: truncate d0/d2/f25 2830289 0 2024-09-17T01:02:03.025 INFO:tasks.workunit.client.0.smithi002.stdout:8/907: write d2/d41/f54 [7419706,36789] 0 2024-09-17T01:02:03.025 INFO:tasks.workunit.client.1.smithi099.stdout:1/881: creat d0/d2/d18/f129 x:0 0 0 2024-09-17T01:02:03.028 INFO:tasks.workunit.client.1.smithi099.stdout:2/636: symlink d2/d9/d25/d26/d1b/d2c/lcb 0 2024-09-17T01:02:03.029 INFO:tasks.workunit.client.1.smithi099.stdout:2/637: fsync d2/d9/d25/d26/f32 0 2024-09-17T01:02:03.030 INFO:tasks.workunit.client.1.smithi099.stdout:7/671: rmdir d1/d36 39 2024-09-17T01:02:03.031 INFO:tasks.workunit.client.0.smithi002.stdout:6/746: dwrite d2/d1d/d2d/d35/d6d/fa1 [0,4194304] 0 2024-09-17T01:02:03.032 INFO:tasks.workunit.client.0.smithi002.stdout:2/756: dread f19 [4194304,4194304] 0 2024-09-17T01:02:03.032 INFO:tasks.workunit.client.1.smithi099.stdout:2/638: symlink d2/d9/d25/d26/d1b/d61/d7d/d85/lcc 0 2024-09-17T01:02:03.036 INFO:tasks.workunit.client.1.smithi099.stdout:7/672: truncate d1/d2c/d7a/f7c 2288682 0 2024-09-17T01:02:03.038 INFO:tasks.workunit.client.1.smithi099.stdout:7/673: mknod d1/d8f/cd7 0 2024-09-17T01:02:03.038 INFO:tasks.workunit.client.1.smithi099.stdout:7/674: read d1/d2c/d5c/d12/f16 [12510,49833] 0 2024-09-17T01:02:03.038 INFO:tasks.workunit.client.1.smithi099.stdout:2/639: symlink d2/d9/d25/d26/d1b/lcd 0 2024-09-17T01:02:03.039 INFO:tasks.workunit.client.0.smithi002.stdout:0/656: dread dd/d19/d1a/f70 [0,4194304] 0 2024-09-17T01:02:03.039 INFO:tasks.workunit.client.0.smithi002.stdout:8/908: dread d2/d30/f32 [0,4194304] 0 2024-09-17T01:02:03.039 INFO:tasks.workunit.client.0.smithi002.stdout:8/909: chown d2/f37 0 1 2024-09-17T01:02:03.041 INFO:tasks.workunit.client.1.smithi099.stdout:7/675: link d1/d2c/fae d1/d2c/d5c/d1c/d5a/db3/dcd/fd8 0 2024-09-17T01:02:03.041 INFO:tasks.workunit.client.1.smithi099.stdout:7/676: chown d1/d2c/f6b 0 1 2024-09-17T01:02:03.041 INFO:tasks.workunit.client.1.smithi099.stdout:7/677: fdatasync d1/d2c/d47/d48/fc4 0 2024-09-17T01:02:03.041 INFO:tasks.workunit.client.1.smithi099.stdout:7/678: truncate d1/d2c/d5c/d1c/d72/fd3 816657 0 2024-09-17T01:02:03.041 INFO:tasks.workunit.client.1.smithi099.stdout:7/679: readlink d1/d2c/l31 0 2024-09-17T01:02:03.041 INFO:tasks.workunit.client.0.smithi002.stdout:8/910: truncate d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d71/d89/fa8 1023357 0 2024-09-17T01:02:03.042 INFO:tasks.workunit.client.1.smithi099.stdout:2/640: dread d2/d9/d25/d26/d1b/dad/f3a [0,4194304] 0 2024-09-17T01:02:03.042 INFO:tasks.workunit.client.1.smithi099.stdout:2/641: chown d2/d9/d25/d26/d1b/d2c/d3f/db8 8589 1 2024-09-17T01:02:03.042 INFO:tasks.workunit.client.0.smithi002.stdout:0/657: dread dd/d3d/f85 [0,4194304] 0 2024-09-17T01:02:03.042 INFO:tasks.workunit.client.0.smithi002.stdout:0/658: read - dd/d19/d1c/d33/fd9 zero size 2024-09-17T01:02:03.042 INFO:tasks.workunit.client.0.smithi002.stdout:8/911: creat d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d71/d89/f129 x:0 0 0 2024-09-17T01:02:03.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:02 smithi099 ceph-mon[34357]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:03.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:02 smithi099 ceph-mon[34357]: pgmap v255: 65 pgs: 65 active+clean; 2.7 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 313 MiB/s rd, 383 MiB/s wr, 528 op/s 2024-09-17T01:02:03.043 INFO:tasks.workunit.client.0.smithi002.stdout:0/659: creat dd/d19/d1c/d1f/d39/fdc x:0 0 0 2024-09-17T01:02:03.044 INFO:tasks.workunit.client.0.smithi002.stdout:8/912: truncate d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d77/d78/fc5 810345 0 2024-09-17T01:02:03.046 INFO:tasks.workunit.client.0.smithi002.stdout:0/660: unlink dd/d19/d1c/d78/l89 0 2024-09-17T01:02:03.046 INFO:tasks.workunit.client.0.smithi002.stdout:0/661: chown dd/d19/d1a/c81 871823 1 2024-09-17T01:02:03.047 INFO:tasks.workunit.client.0.smithi002.stdout:8/913: mknod d2/d1c/d28/dad/dcd/dd1/ddb/c12a 0 2024-09-17T01:02:03.047 INFO:tasks.workunit.client.0.smithi002.stdout:8/914: chown d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d58/dbd/cc6 7038136 1 2024-09-17T01:02:03.047 INFO:tasks.workunit.client.0.smithi002.stdout:8/915: truncate d2/d1c/d28/dad/dcd/dd1/ddb/d10f/f72 1202876 0 2024-09-17T01:02:03.047 INFO:tasks.workunit.client.0.smithi002.stdout:0/662: mkdir dd/d19/d1c/d1f/d76/ddd 0 2024-09-17T01:02:03.047 INFO:tasks.workunit.client.0.smithi002.stdout:7/737: dwrite d1/d14/d1d/d29/d57/fb8 [0,4194304] 0 2024-09-17T01:02:03.049 INFO:tasks.workunit.client.0.smithi002.stdout:8/916: unlink d2/d26/dbb/f11e 0 2024-09-17T01:02:03.049 INFO:tasks.workunit.client.0.smithi002.stdout:8/917: truncate d2/d9/dd/f103 409239 0 2024-09-17T01:02:03.050 INFO:tasks.workunit.client.0.smithi002.stdout:0/663: dread dd/f36 [0,4194304] 0 2024-09-17T01:02:03.052 INFO:tasks.workunit.client.0.smithi002.stdout:7/738: truncate d1/f26 11599 0 2024-09-17T01:02:03.052 INFO:tasks.workunit.client.0.smithi002.stdout:7/739: chown d1/d14/d1d/d28/d6b/d9e/f69 455 1 2024-09-17T01:02:03.052 INFO:tasks.workunit.client.0.smithi002.stdout:7/740: dread - d1/d14/d1d/d28/d6b/d9e/d54/fbe zero size 2024-09-17T01:02:03.053 INFO:tasks.workunit.client.0.smithi002.stdout:7/741: readlink d1/l19 0 2024-09-17T01:02:03.053 INFO:tasks.workunit.client.1.smithi099.stdout:7/680: write d1/d2c/d5c/d12/f74 [3305010,87339] 0 2024-09-17T01:02:03.056 INFO:tasks.workunit.client.1.smithi099.stdout:2/642: dread d2/d9/d25/d26/d1b/dad/f40 [4194304,4194304] 0 2024-09-17T01:02:03.057 INFO:tasks.workunit.client.1.smithi099.stdout:2/643: symlink d2/d9/d25/d26/d1b/d61/d7d/d85/d98/lce 0 2024-09-17T01:02:03.061 INFO:tasks.workunit.client.1.smithi099.stdout:2/644: rename d2/d9/d25/d26/d1b/d2c/d5d/f64 to d2/d9/d25/d26/d1b/d2c/d3f/db8/fcf 0 2024-09-17T01:02:03.061 INFO:tasks.workunit.client.1.smithi099.stdout:2/645: creat d2/d9/d25/d26/d1b/d2c/d5d/fd0 x:0 0 0 2024-09-17T01:02:03.061 INFO:tasks.workunit.client.0.smithi002.stdout:2/757: write d1b/d37/d48/d4e/f54 [3177288,59645] 0 2024-09-17T01:02:03.061 INFO:tasks.workunit.client.1.smithi099.stdout:7/681: dread d1/d2c/d5c/f13 [4194304,4194304] 0 2024-09-17T01:02:03.062 INFO:tasks.workunit.client.0.smithi002.stdout:1/709: dwrite d4/d11/d12/d14/d17/d51/fc7 [0,4194304] 0 2024-09-17T01:02:03.062 INFO:tasks.workunit.client.1.smithi099.stdout:0/710: dwrite da/df/d31/f4c [0,4194304] 0 2024-09-17T01:02:03.062 INFO:tasks.workunit.client.1.smithi099.stdout:0/711: chown da/df/d1a/d49/f4a 74205295 1 2024-09-17T01:02:03.062 INFO:tasks.workunit.client.1.smithi099.stdout:1/882: dwrite d0/d8/d38/d56/ff2 [0,4194304] 0 2024-09-17T01:02:03.063 INFO:tasks.workunit.client.1.smithi099.stdout:5/806: dwrite d2/d26/fdd [0,4194304] 0 2024-09-17T01:02:03.063 INFO:tasks.workunit.client.1.smithi099.stdout:5/807: write d2/f5 [1070767,117042] 0 2024-09-17T01:02:03.063 INFO:tasks.workunit.client.1.smithi099.stdout:5/808: creat d2/dc4/d99/dd0/f108 x:0 0 0 2024-09-17T01:02:03.063 INFO:tasks.workunit.client.0.smithi002.stdout:2/758: creat d1b/d37/f111 x:0 0 0 2024-09-17T01:02:03.063 INFO:tasks.workunit.client.0.smithi002.stdout:5/690: dwrite d2/d2d/d10/d20/d24/f7a [0,4194304] 0 2024-09-17T01:02:03.064 INFO:tasks.workunit.client.1.smithi099.stdout:6/798: dwrite dc/d2b/fa6 [0,4194304] 0 2024-09-17T01:02:03.064 INFO:tasks.workunit.client.1.smithi099.stdout:4/725: rmdir d7/dd/d21/d7b/d74 39 2024-09-17T01:02:03.064 INFO:tasks.workunit.client.1.smithi099.stdout:4/726: write f1 [2175307,122644] 0 2024-09-17T01:02:03.065 INFO:tasks.workunit.client.0.smithi002.stdout:7/742: dwrite d1/d14/fa5 [4194304,4194304] 0 2024-09-17T01:02:03.065 INFO:tasks.workunit.client.0.smithi002.stdout:7/743: readlink d1/d14/d67/dc0/dcd/d45/l4d 0 2024-09-17T01:02:03.066 INFO:tasks.workunit.client.1.smithi099.stdout:2/646: truncate d2/d9/d25/d26/d1b/d2c/f52 684034 0 2024-09-17T01:02:03.068 INFO:tasks.workunit.client.1.smithi099.stdout:7/682: creat d1/d2c/d5c/d12/fd9 x:0 0 0 2024-09-17T01:02:03.068 INFO:tasks.workunit.client.0.smithi002.stdout:1/710: mkdir d4/d11/d1a/daa/dee 0 2024-09-17T01:02:03.068 INFO:tasks.workunit.client.0.smithi002.stdout:1/711: stat d4/d11/d12/d14/d17/d20/c78 0 2024-09-17T01:02:03.069 INFO:tasks.workunit.client.0.smithi002.stdout:1/712: fdatasync d4/d11/d1a/d95/fbe 0 2024-09-17T01:02:03.070 INFO:tasks.workunit.client.1.smithi099.stdout:0/712: creat da/df/d1a/d56/d72/fdf x:0 0 0 2024-09-17T01:02:03.070 INFO:tasks.workunit.client.1.smithi099.stdout:0/713: write da/d12/f18 [2878391,10813] 0 2024-09-17T01:02:03.071 INFO:tasks.workunit.client.1.smithi099.stdout:0/714: chown da/df/d1a/d63/d6a/f8a 3144 1 2024-09-17T01:02:03.071 INFO:tasks.workunit.client.0.smithi002.stdout:2/759: mkdir d1b/d37/d48/d78/d112 0 2024-09-17T01:02:03.073 INFO:tasks.workunit.client.0.smithi002.stdout:1/713: dread d4/d11/d12/f4c [0,4194304] 0 2024-09-17T01:02:03.073 INFO:tasks.workunit.client.0.smithi002.stdout:1/714: chown d4/d11/d55/dbc/dc5/fc9 3665499 1 2024-09-17T01:02:03.073 INFO:tasks.workunit.client.0.smithi002.stdout:1/715: creat d4/d11/d55/d7a/fef x:0 0 0 2024-09-17T01:02:03.074 INFO:tasks.workunit.client.0.smithi002.stdout:1/716: getdents d4/d11/d12/d14/d17/d20/de9 0 2024-09-17T01:02:03.074 INFO:tasks.workunit.client.0.smithi002.stdout:1/717: chown d4/d11/d1a/d95/f9b 72553 1 2024-09-17T01:02:03.077 INFO:tasks.workunit.client.0.smithi002.stdout:5/691: symlink d2/le0 0 2024-09-17T01:02:03.077 INFO:tasks.workunit.client.0.smithi002.stdout:5/692: creat d2/d2d/d10/d14/d19/d39/fe1 x:0 0 0 2024-09-17T01:02:03.077 INFO:tasks.workunit.client.0.smithi002.stdout:5/693: truncate d2/d2d/d10/d14/d59/f8f 687720 0 2024-09-17T01:02:03.077 INFO:tasks.workunit.client.0.smithi002.stdout:5/694: dread - d2/de/fa4 zero size 2024-09-17T01:02:03.078 INFO:tasks.workunit.client.1.smithi099.stdout:1/883: mknod d0/d8/d38/d8a/dd0/c12a 0 2024-09-17T01:02:03.078 INFO:tasks.workunit.client.1.smithi099.stdout:1/884: read d0/d8/f7e [312016,98168] 0 2024-09-17T01:02:03.080 INFO:tasks.workunit.client.0.smithi002.stdout:8/918: dwrite d2/d41/fe3 [0,4194304] 0 2024-09-17T01:02:03.080 INFO:tasks.workunit.client.0.smithi002.stdout:8/919: dread - d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d58/f104 zero size 2024-09-17T01:02:03.081 INFO:tasks.workunit.client.0.smithi002.stdout:8/920: write d2/d1c/d28/f122 [117616,31565] 0 2024-09-17T01:02:03.081 INFO:tasks.workunit.client.0.smithi002.stdout:1/718: link d4/d11/d12/d14/d17/d51/fc8 d4/d11/d12/d30/d43/d67/ff0 0 2024-09-17T01:02:03.083 INFO:tasks.workunit.client.1.smithi099.stdout:5/809: rename d2/dc/l11 to d2/dc/d14/l109 0 2024-09-17T01:02:03.083 INFO:tasks.workunit.client.1.smithi099.stdout:5/810: write d2/dc/d14/d36/f67 [1207348,95941] 0 2024-09-17T01:02:03.083 INFO:tasks.workunit.client.1.smithi099.stdout:2/647: dread d2/d9/d25/d26/d1b/d2c/f77 [0,4194304] 0 2024-09-17T01:02:03.083 INFO:tasks.workunit.client.0.smithi002.stdout:1/719: truncate d4/d11/d12/d14/d17/d40/f69 3083057 0 2024-09-17T01:02:03.084 INFO:tasks.workunit.client.0.smithi002.stdout:4/861: sync 2024-09-17T01:02:03.084 INFO:tasks.workunit.client.0.smithi002.stdout:4/862: readlink d7/de/d3a/d109/dc7/d77/d9b/l7b 0 2024-09-17T01:02:03.084 INFO:tasks.workunit.client.1.smithi099.stdout:4/727: creat d7/dd/de/d10/d6b/ff8 x:0 0 0 2024-09-17T01:02:03.085 INFO:tasks.workunit.client.0.smithi002.stdout:1/720: mkdir d4/d11/d12/d30/d5e/df1 0 2024-09-17T01:02:03.085 INFO:tasks.workunit.client.0.smithi002.stdout:1/721: dread - d4/d22/d8d/fd5 zero size 2024-09-17T01:02:03.086 INFO:tasks.workunit.client.0.smithi002.stdout:4/863: rename d7/d19/d9c/de9/fa2 to d7/d19/d9f/dc2/dde/f10c 0 2024-09-17T01:02:03.086 INFO:tasks.workunit.client.0.smithi002.stdout:4/864: readlink d7/de/d3a/d109/l69 0 2024-09-17T01:02:03.086 INFO:tasks.workunit.client.0.smithi002.stdout:4/865: chown d7/d19/d2e/f39 4919242 1 2024-09-17T01:02:03.087 INFO:tasks.workunit.client.1.smithi099.stdout:0/715: truncate da/df/d1a/d56/f74 2903788 0 2024-09-17T01:02:03.087 INFO:tasks.workunit.client.1.smithi099.stdout:0/716: chown da/df/d1a/d63/d6a/l79 3830183 1 2024-09-17T01:02:03.088 INFO:tasks.workunit.client.0.smithi002.stdout:1/722: symlink d4/d22/lf2 0 2024-09-17T01:02:03.088 INFO:tasks.workunit.client.0.smithi002.stdout:1/723: chown d4/d11/d1a/ld2 11216094 1 2024-09-17T01:02:03.088 INFO:tasks.workunit.client.0.smithi002.stdout:1/724: truncate d4/d11/d12/d30/d5e/f60 5222997 0 2024-09-17T01:02:03.088 INFO:tasks.workunit.client.0.smithi002.stdout:4/866: getdents d7/de/d3a/d109 0 2024-09-17T01:02:03.088 INFO:tasks.workunit.client.0.smithi002.stdout:8/921: dread d2/f6b [0,4194304] 0 2024-09-17T01:02:03.088 INFO:tasks.workunit.client.0.smithi002.stdout:4/867: truncate d7/f14 4301090 0 2024-09-17T01:02:03.088 INFO:tasks.workunit.client.0.smithi002.stdout:1/725: truncate d4/fe 4388517 0 2024-09-17T01:02:03.089 INFO:tasks.workunit.client.0.smithi002.stdout:4/868: mkdir d7/d19/d9f/d10d 0 2024-09-17T01:02:03.089 INFO:tasks.workunit.client.1.smithi099.stdout:1/885: creat d0/de2/dfd/f12b x:0 0 0 2024-09-17T01:02:03.089 INFO:tasks.workunit.client.0.smithi002.stdout:1/726: symlink d4/d11/d12/d23/d32/de3/lf3 0 2024-09-17T01:02:03.090 INFO:tasks.workunit.client.1.smithi099.stdout:5/811: creat d2/dc4/f10a x:0 0 0 2024-09-17T01:02:03.090 INFO:tasks.workunit.client.1.smithi099.stdout:5/812: write d2/dc/d17/d3c/f46 [4267118,68659] 0 2024-09-17T01:02:03.091 INFO:tasks.workunit.client.0.smithi002.stdout:4/869: creat d7/d19/d9c/de9/df8/f10e x:0 0 0 2024-09-17T01:02:03.091 INFO:tasks.workunit.client.0.smithi002.stdout:4/870: stat d7/d3f/fa0 0 2024-09-17T01:02:03.091 INFO:tasks.workunit.client.1.smithi099.stdout:5/813: read d2/d26/d64/f68 [91129,14474] 0 2024-09-17T01:02:03.091 INFO:tasks.workunit.client.0.smithi002.stdout:5/695: write d2/d2d/d10/d20/d24/f31 [6570024,38434] 0 2024-09-17T01:02:03.092 INFO:tasks.workunit.client.0.smithi002.stdout:5/696: write d2/f54 [830890,113898] 0 2024-09-17T01:02:03.092 INFO:tasks.workunit.client.0.smithi002.stdout:5/697: fdatasync d2/d2d/d10/d14/d19/d39/f35 0 2024-09-17T01:02:03.092 INFO:tasks.workunit.client.0.smithi002.stdout:5/698: readlink d2/d2d/d10/d95/lac 0 2024-09-17T01:02:03.093 INFO:tasks.workunit.client.1.smithi099.stdout:4/728: rename d7/dd/de/d10/ldf to d7/dd/de/lf9 0 2024-09-17T01:02:03.093 INFO:tasks.workunit.client.1.smithi099.stdout:4/729: chown d7/fc 498579 1 2024-09-17T01:02:03.093 INFO:tasks.workunit.client.0.smithi002.stdout:4/871: rename d7/d19/d4a to d7/de/d32/d59/d10f 0 2024-09-17T01:02:03.094 INFO:tasks.workunit.client.1.smithi099.stdout:4/730: read d7/d35/d98/fbf [91683,68701] 0 2024-09-17T01:02:03.094 INFO:tasks.workunit.client.0.smithi002.stdout:4/872: getdents d7/de/d3a/dac 0 2024-09-17T01:02:03.095 INFO:tasks.workunit.client.0.smithi002.stdout:4/873: fdatasync d7/d19/d9c/de9/da4/fe1 0 2024-09-17T01:02:03.095 INFO:tasks.workunit.client.1.smithi099.stdout:0/717: mkdir da/df/d1a/d49/d68/d9f/dd7/de0 0 2024-09-17T01:02:03.095 INFO:tasks.workunit.client.1.smithi099.stdout:0/718: chown da/df/d20/f83 134131659 1 2024-09-17T01:02:03.095 INFO:tasks.workunit.client.1.smithi099.stdout:0/719: truncate da/df/d1a/d56/d72/fdf 374146 0 2024-09-17T01:02:03.098 INFO:tasks.workunit.client.1.smithi099.stdout:2/648: read d2/d9/d25/d26/d1b/d2c/d5d/fba [218319,107383] 0 2024-09-17T01:02:03.098 INFO:tasks.workunit.client.1.smithi099.stdout:2/649: chown d2/d9/d25/d26/f6b 39437571 1 2024-09-17T01:02:03.098 INFO:tasks.workunit.client.1.smithi099.stdout:2/650: write d2/d9/d25/d26/d1b/d2c/d3f/fb6 [530656,21379] 0 2024-09-17T01:02:03.101 INFO:tasks.workunit.client.1.smithi099.stdout:5/814: rename d2/l2b to d2/dc/d17/d3c/db3/dde/l10b 0 2024-09-17T01:02:03.102 INFO:tasks.workunit.client.0.smithi002.stdout:3/674: sync 2024-09-17T01:02:03.104 INFO:tasks.workunit.client.1.smithi099.stdout:0/720: truncate da/df/d31/d8b/f81 4174148 0 2024-09-17T01:02:03.104 INFO:tasks.workunit.client.1.smithi099.stdout:1/886: link d0/d8/d49/d94/d4b/d59/c90 d0/c12c 0 2024-09-17T01:02:03.104 INFO:tasks.workunit.client.1.smithi099.stdout:4/731: dread d7/dd/d21/fb2 [0,4194304] 0 2024-09-17T01:02:03.104 INFO:tasks.workunit.client.1.smithi099.stdout:1/887: creat d0/d2/dd8/d109/f12d x:0 0 0 2024-09-17T01:02:03.105 INFO:tasks.workunit.client.0.smithi002.stdout:9/663: sync 2024-09-17T01:02:03.105 INFO:tasks.workunit.client.0.smithi002.stdout:9/664: creat d5/dc/d26/d46/d47/da1/fc7 x:0 0 0 2024-09-17T01:02:03.106 INFO:tasks.workunit.client.1.smithi099.stdout:0/721: mkdir da/df/d1a/d63/de1 0 2024-09-17T01:02:03.107 INFO:tasks.workunit.client.0.smithi002.stdout:9/665: getdents d5 0 2024-09-17T01:02:03.107 INFO:tasks.workunit.client.0.smithi002.stdout:9/666: readlink d5/dc/d26/l28 0 2024-09-17T01:02:03.107 INFO:tasks.workunit.client.0.smithi002.stdout:9/667: truncate d5/dc/d26/d5c/d6b/d75/f62 1222044 0 2024-09-17T01:02:03.107 INFO:tasks.workunit.client.0.smithi002.stdout:9/668: write d5/f10 [7180216,26013] 0 2024-09-17T01:02:03.110 INFO:tasks.workunit.client.1.smithi099.stdout:1/888: rename d0/d2/c78 to d0/d8/d38/d8a/dd0/ddc/dfc/c12e 0 2024-09-17T01:02:03.110 INFO:tasks.workunit.client.1.smithi099.stdout:1/889: fsync d0/d8/dbf/ff9 0 2024-09-17T01:02:03.110 INFO:tasks.workunit.client.0.smithi002.stdout:8/922: read d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/f7b [3883500,46582] 0 2024-09-17T01:02:03.110 INFO:tasks.workunit.client.0.smithi002.stdout:8/923: truncate d2/d1c/d28/dad/dcd/dd1/ddb/d10f/f1b 1818872 0 2024-09-17T01:02:03.111 INFO:tasks.workunit.client.0.smithi002.stdout:8/924: fsync d2/d30/f32 0 2024-09-17T01:02:03.111 INFO:tasks.workunit.client.1.smithi099.stdout:0/722: creat da/d12/d22/d53/fe2 x:0 0 0 2024-09-17T01:02:03.111 INFO:tasks.workunit.client.1.smithi099.stdout:0/723: chown da/d12/d2b/dab/db5/fa2 13 1 2024-09-17T01:02:03.112 INFO:tasks.workunit.client.1.smithi099.stdout:0/724: chown da/f27 9 1 2024-09-17T01:02:03.112 INFO:tasks.workunit.client.1.smithi099.stdout:1/890: truncate d0/d8c/f99 1693910 0 2024-09-17T01:02:03.113 INFO:tasks.workunit.client.0.smithi002.stdout:8/925: creat d2/d1c/dd4/f12b x:0 0 0 2024-09-17T01:02:03.113 INFO:tasks.workunit.client.0.smithi002.stdout:7/744: dwrite d1/d14/d1d/d28/d6b/d9e/d54/fcb [0,4194304] 0 2024-09-17T01:02:03.113 INFO:tasks.workunit.client.1.smithi099.stdout:7/683: dwrite d1/f35 [4194304,4194304] 0 2024-09-17T01:02:03.115 INFO:tasks.workunit.client.1.smithi099.stdout:1/891: mkdir d0/d2/de/d12f 0 2024-09-17T01:02:03.115 INFO:tasks.workunit.client.1.smithi099.stdout:1/892: fsync d0/d8/d38/d56/d93/f119 0 2024-09-17T01:02:03.115 INFO:tasks.workunit.client.1.smithi099.stdout:1/893: write d0/de2/dfd/d104/f122 [686638,25915] 0 2024-09-17T01:02:03.115 INFO:tasks.workunit.client.1.smithi099.stdout:0/725: creat da/df/d1a/d49/d68/d9f/fe3 x:0 0 0 2024-09-17T01:02:03.115 INFO:tasks.workunit.client.1.smithi099.stdout:0/726: write da/df/d1a/d63/d6a/f6e [1388899,101432] 0 2024-09-17T01:02:03.115 INFO:tasks.workunit.client.1.smithi099.stdout:0/727: chown da/df/d1a/d49/dac 2 1 2024-09-17T01:02:03.115 INFO:tasks.workunit.client.0.smithi002.stdout:5/699: dread d2/d2d/d10/d14/fda [0,4194304] 0 2024-09-17T01:02:03.116 INFO:tasks.workunit.client.0.smithi002.stdout:5/700: chown d2/d2d/d10/d14/d19/da5/db0 728742 1 2024-09-17T01:02:03.116 INFO:tasks.workunit.client.0.smithi002.stdout:5/701: read - d2/d2d/d10/d14/d19/da5/db0/f74 zero size 2024-09-17T01:02:03.118 INFO:tasks.workunit.client.1.smithi099.stdout:0/728: mkdir da/df/d1a/d49/dac/d92/de4 0 2024-09-17T01:02:03.121 INFO:tasks.workunit.client.1.smithi099.stdout:6/799: dwrite dc/d5d/dae/f6a [4194304,4194304] 0 2024-09-17T01:02:03.121 INFO:tasks.workunit.client.0.smithi002.stdout:5/702: rename d2/d2d/d10/d14/d19/d39/d64/f91 to d2/d2d/d10/d95/fe2 0 2024-09-17T01:02:03.121 INFO:tasks.workunit.client.0.smithi002.stdout:5/703: write d2/d2d/d10/d20/fb2 [941009,76744] 0 2024-09-17T01:02:03.121 INFO:tasks.workunit.client.0.smithi002.stdout:5/704: dread - d2/d2d/d10/d14/d19/d39/d25/fd8 zero size 2024-09-17T01:02:03.121 INFO:tasks.workunit.client.0.smithi002.stdout:1/727: dwrite d4/d11/d12/d14/d17/d56/fbf [0,4194304] 0 2024-09-17T01:02:03.122 INFO:tasks.workunit.client.1.smithi099.stdout:4/732: write d7/dd/de/f62 [2410783,111367] 0 2024-09-17T01:02:03.123 INFO:tasks.workunit.client.1.smithi099.stdout:6/800: mkdir dc/d5d/d113 0 2024-09-17T01:02:03.125 INFO:tasks.workunit.client.0.smithi002.stdout:1/728: symlink d4/d11/d12/d30/d5e/lf4 0 2024-09-17T01:02:03.126 INFO:tasks.workunit.client.1.smithi099.stdout:4/733: truncate d7/dd/d21/d7b/d4b/f39 608755 0 2024-09-17T01:02:03.129 INFO:tasks.workunit.client.1.smithi099.stdout:9/751: sync 2024-09-17T01:02:03.129 INFO:tasks.workunit.client.1.smithi099.stdout:9/752: chown da/d8e/d96/lc2 3966558 1 2024-09-17T01:02:03.129 INFO:tasks.workunit.client.1.smithi099.stdout:6/801: write dc/d1a/d49/d4c/f6d [3355194,11584] 0 2024-09-17T01:02:03.130 INFO:tasks.workunit.client.1.smithi099.stdout:6/802: fdatasync dc/d1a/fe7 0 2024-09-17T01:02:03.131 INFO:tasks.workunit.client.1.smithi099.stdout:7/684: dread d1/d2c/f66 [0,4194304] 0 2024-09-17T01:02:03.134 INFO:tasks.workunit.client.0.smithi002.stdout:1/729: read d4/d11/f5c [1292758,37801] 0 2024-09-17T01:02:03.136 INFO:tasks.workunit.client.1.smithi099.stdout:3/773: sync 2024-09-17T01:02:03.136 INFO:tasks.workunit.client.1.smithi099.stdout:3/774: chown d9/d3b/lb7 98568421 1 2024-09-17T01:02:03.136 INFO:tasks.workunit.client.1.smithi099.stdout:5/815: dwrite d2/dc4/f10a [0,4194304] 0 2024-09-17T01:02:03.136 INFO:tasks.workunit.client.1.smithi099.stdout:8/797: sync 2024-09-17T01:02:03.136 INFO:tasks.workunit.client.1.smithi099.stdout:9/753: dread da/d21/d5b/fb1 [0,4194304] 0 2024-09-17T01:02:03.137 INFO:tasks.workunit.client.1.smithi099.stdout:9/754: chown da/d9a/fb5 147 1 2024-09-17T01:02:03.138 INFO:tasks.workunit.client.1.smithi099.stdout:4/734: rmdir d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/d83 39 2024-09-17T01:02:03.138 INFO:tasks.workunit.client.1.smithi099.stdout:4/735: read d7/dd/d21/f41 [459744,110291] 0 2024-09-17T01:02:03.139 INFO:tasks.workunit.client.0.smithi002.stdout:9/669: dwrite d5/dc/d26/d5c/d6b/f9b [0,4194304] 0 2024-09-17T01:02:03.141 INFO:tasks.workunit.client.0.smithi002.stdout:9/670: creat d5/d8a/fc8 x:0 0 0 2024-09-17T01:02:03.142 INFO:tasks.workunit.client.1.smithi099.stdout:6/803: read dc/d1a/d49/d4c/f5f [2723225,62363] 0 2024-09-17T01:02:03.142 INFO:tasks.workunit.client.1.smithi099.stdout:7/685: write d1/d2c/f6b [54725,101478] 0 2024-09-17T01:02:03.142 INFO:tasks.workunit.client.0.smithi002.stdout:8/926: read d2/d1c/d28/da0/fc0 [3412619,81374] 0 2024-09-17T01:02:03.144 INFO:tasks.workunit.client.0.smithi002.stdout:9/671: mknod d5/dc/d26/d46/d47/da1/cc9 0 2024-09-17T01:02:03.146 INFO:tasks.workunit.client.0.smithi002.stdout:8/927: unlink d2/d41/f90 0 2024-09-17T01:02:03.147 INFO:tasks.workunit.client.1.smithi099.stdout:1/894: truncate d0/d8/d38/d56/ff2 706061 0 2024-09-17T01:02:03.149 INFO:tasks.workunit.client.1.smithi099.stdout:8/798: dread d0/d41/d5a/fd4 [0,4194304] 0 2024-09-17T01:02:03.151 INFO:tasks.workunit.client.1.smithi099.stdout:3/775: dread d9/d3b/f69 [0,4194304] 0 2024-09-17T01:02:03.151 INFO:tasks.workunit.client.1.smithi099.stdout:3/776: readlink d9/d3b/d44/ld1 0 2024-09-17T01:02:03.152 INFO:tasks.workunit.client.1.smithi099.stdout:5/816: link d2/dc4/d99/dd0/dc3/lfd d2/dc/d97/dec/l10c 0 2024-09-17T01:02:03.154 INFO:tasks.workunit.client.0.smithi002.stdout:4/874: rmdir d7/d19 39 2024-09-17T01:02:03.155 INFO:tasks.workunit.client.0.smithi002.stdout:4/875: truncate d7/d19/d2e/f39 260665 0 2024-09-17T01:02:03.158 INFO:tasks.workunit.client.0.smithi002.stdout:4/876: rename d7/de/f27 to d7/d19/d2e/d103/d108/f110 0 2024-09-17T01:02:03.159 INFO:tasks.workunit.client.1.smithi099.stdout:1/895: mknod d0/d8/d49/d94/de0/c130 0 2024-09-17T01:02:03.159 INFO:tasks.workunit.client.0.smithi002.stdout:4/877: mkdir d7/de6/d111 0 2024-09-17T01:02:03.159 INFO:tasks.workunit.client.0.smithi002.stdout:4/878: chown d7/d71/d8e/cec 11603 1 2024-09-17T01:02:03.159 INFO:tasks.workunit.client.0.smithi002.stdout:4/879: fdatasync d7/d19/d9f/d80/d62/dbe/ff2 0 2024-09-17T01:02:03.162 INFO:tasks.workunit.client.0.smithi002.stdout:9/672: dread d5/dc/d26/d5c/f7b [0,4194304] 0 2024-09-17T01:02:03.163 INFO:tasks.workunit.client.1.smithi099.stdout:5/817: creat d2/d26/d64/de2/f10d x:0 0 0 2024-09-17T01:02:03.163 INFO:tasks.workunit.client.1.smithi099.stdout:6/804: read dc/d5d/dc9/fcc [2383737,88255] 0 2024-09-17T01:02:03.165 INFO:tasks.workunit.client.0.smithi002.stdout:9/673: link d5/dc/d26/d5c/d6b/d75/c5f d5/dc/cca 0 2024-09-17T01:02:03.165 INFO:tasks.workunit.client.1.smithi099.stdout:5/818: dread d2/dc/d17/d3c/d72/f79 [0,4194304] 0 2024-09-17T01:02:03.169 INFO:tasks.workunit.client.0.smithi002.stdout:4/880: read d7/d19/d9f/d80/fb5 [1049004,29970] 0 2024-09-17T01:02:03.169 INFO:tasks.workunit.client.0.smithi002.stdout:4/881: write d7/de/d3a/dac/fce [78428,129795] 0 2024-09-17T01:02:03.170 INFO:tasks.workunit.client.1.smithi099.stdout:8/799: rename d0/d1f/d31/d4c/f70 to d0/d1f/d90/db8/dde/d29/d4b/f106 0 2024-09-17T01:02:03.170 INFO:tasks.workunit.client.1.smithi099.stdout:8/800: chown d0/d1f/d90/db8/dde 3 1 2024-09-17T01:02:03.171 INFO:tasks.workunit.client.1.smithi099.stdout:4/736: rmdir d7/dd/de 39 2024-09-17T01:02:03.172 INFO:tasks.workunit.client.1.smithi099.stdout:4/737: fdatasync d7/dd/d21/d26/d3f/d5b/ff7 0 2024-09-17T01:02:03.177 INFO:tasks.workunit.client.1.smithi099.stdout:5/819: truncate d2/dc/d14/f4f 3266197 0 2024-09-17T01:02:03.177 INFO:tasks.workunit.client.1.smithi099.stdout:5/820: truncate d2/dc/d14/d89/f104 338981 0 2024-09-17T01:02:03.177 INFO:tasks.workunit.client.1.smithi099.stdout:5/821: readlink d2/d45/l87 0 2024-09-17T01:02:03.178 INFO:tasks.workunit.client.1.smithi099.stdout:6/805: chown dc/d1a/f79 1037 1 2024-09-17T01:02:03.178 INFO:tasks.workunit.client.1.smithi099.stdout:4/738: symlink d7/d35/d98/lfa 0 2024-09-17T01:02:03.188 INFO:tasks.workunit.client.1.smithi099.stdout:0/729: dwrite da/df/d1a/d56/fbd [4194304,4194304] 0 2024-09-17T01:02:03.188 INFO:tasks.workunit.client.1.smithi099.stdout:0/730: fsync f7 0 2024-09-17T01:02:03.188 INFO:tasks.workunit.client.1.smithi099.stdout:0/731: write da/df/d1a/d56/f74 [1043056,48894] 0 2024-09-17T01:02:03.188 INFO:tasks.workunit.client.1.smithi099.stdout:0/732: readlink da/df/d31/db0/d1e/lad 0 2024-09-17T01:02:03.200 INFO:tasks.workunit.client.1.smithi099.stdout:6/806: dread fa [0,4194304] 0 2024-09-17T01:02:03.200 INFO:tasks.workunit.client.1.smithi099.stdout:6/807: truncate dc/d1a/fe7 1012994 0 2024-09-17T01:02:03.202 INFO:tasks.workunit.client.0.smithi002.stdout:7/745: dwrite d1/d14/d1d/d28/d40/fd6 [0,4194304] 0 2024-09-17T01:02:03.203 INFO:tasks.workunit.client.0.smithi002.stdout:7/746: link d1/d14/d1d/d29/d98/dcf/cd4 d1/d14/d1d/d28/d6b/d9e/cec 0 2024-09-17T01:02:03.204 INFO:tasks.workunit.client.0.smithi002.stdout:7/747: dread d1/f26 [0,4194304] 0 2024-09-17T01:02:03.205 INFO:tasks.workunit.client.0.smithi002.stdout:7/748: creat d1/d14/d1d/d28/d6b/d9e/d5e/fed x:0 0 0 2024-09-17T01:02:03.205 INFO:tasks.workunit.client.0.smithi002.stdout:7/749: stat d1/d14/d1d/d29/d57/fb8 0 2024-09-17T01:02:03.205 INFO:tasks.workunit.client.0.smithi002.stdout:7/750: dread - d1/d14/d1d/d29/d98/fb5 zero size 2024-09-17T01:02:03.214 INFO:tasks.workunit.client.0.smithi002.stdout:3/675: dwrite d0/d3/d33/d4a/f78 [0,4194304] 0 2024-09-17T01:02:03.214 INFO:tasks.workunit.client.0.smithi002.stdout:3/676: readlink d0/d31/d32/dcb/ld3 0 2024-09-17T01:02:03.214 INFO:tasks.workunit.client.0.smithi002.stdout:1/730: dwrite d4/d11/d12/d30/d43/d67/fd4 [4194304,4194304] 0 2024-09-17T01:02:03.214 INFO:tasks.workunit.client.1.smithi099.stdout:7/686: dwrite d1/d2c/d7a/dac/fc5 [0,4194304] 0 2024-09-17T01:02:03.218 INFO:tasks.workunit.client.0.smithi002.stdout:1/731: read d4/d11/d1c/f66 [238132,90485] 0 2024-09-17T01:02:03.218 INFO:tasks.workunit.client.0.smithi002.stdout:5/705: truncate d2/f54 890203 0 2024-09-17T01:02:03.218 INFO:tasks.workunit.client.0.smithi002.stdout:5/706: readlink d2/d2d/d10/d14/d19/d39/d3f/l90 0 2024-09-17T01:02:03.220 INFO:tasks.workunit.client.0.smithi002.stdout:5/707: creat d2/d2d/d10/d3b/fe3 x:0 0 0 2024-09-17T01:02:03.221 INFO:tasks.workunit.client.0.smithi002.stdout:5/708: creat d2/d2d/d10/d20/fe4 x:0 0 0 2024-09-17T01:02:03.223 INFO:tasks.workunit.client.0.smithi002.stdout:5/709: truncate d2/d2d/d10/d20/f7e 4296484 0 2024-09-17T01:02:03.223 INFO:tasks.workunit.client.0.smithi002.stdout:5/710: dread - d2/d2d/d10/d14/d19/da5/db0/f74 zero size 2024-09-17T01:02:03.223 INFO:tasks.workunit.client.0.smithi002.stdout:3/677: dread d0/d3/d33/d4f/f53 [0,4194304] 0 2024-09-17T01:02:03.224 INFO:tasks.workunit.client.0.smithi002.stdout:5/711: mkdir d2/d2d/d10/d14/d19/d39/de5 0 2024-09-17T01:02:03.226 INFO:tasks.workunit.client.1.smithi099.stdout:9/755: dwrite f6 [0,4194304] 0 2024-09-17T01:02:03.226 INFO:tasks.workunit.client.1.smithi099.stdout:9/756: write da/d56/d84/db9/de8/fe9 [381464,88668] 0 2024-09-17T01:02:03.226 INFO:tasks.workunit.client.1.smithi099.stdout:9/757: chown da/d18/d5e 61 1 2024-09-17T01:02:03.227 INFO:tasks.workunit.client.0.smithi002.stdout:5/712: rename d2/d2d/d10/d20/d24/f2e to d2/d2d/d10/d14/d19/d39/d25/fe6 0 2024-09-17T01:02:03.227 INFO:tasks.workunit.client.0.smithi002.stdout:1/732: dread d4/d11/d12/d30/d43/d67/fd4 [0,4194304] 0 2024-09-17T01:02:03.236 INFO:tasks.workunit.client.1.smithi099.stdout:1/896: dwrite d0/d2/d18/f28 [0,4194304] 0 2024-09-17T01:02:03.237 INFO:tasks.workunit.client.1.smithi099.stdout:1/897: stat d0/d8/d49/d94/l10f 0 2024-09-17T01:02:03.238 INFO:tasks.workunit.client.0.smithi002.stdout:1/733: rmdir d4/d11/d12/d14/d17/d56 39 2024-09-17T01:02:03.238 INFO:tasks.workunit.client.0.smithi002.stdout:1/734: chown d4/d11/d12/d14/d17/d51/d88/da3/lea 63 1 2024-09-17T01:02:03.238 INFO:tasks.workunit.client.0.smithi002.stdout:8/928: dwrite d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/fd8 [0,4194304] 0 2024-09-17T01:02:03.240 INFO:tasks.workunit.client.0.smithi002.stdout:1/735: rename d4/d11/d12/d14/lad to d4/d11/d55/d7a/lf5 0 2024-09-17T01:02:03.242 INFO:tasks.workunit.client.0.smithi002.stdout:1/736: symlink d4/d22/d8d/de8/lf6 0 2024-09-17T01:02:03.242 INFO:tasks.workunit.client.0.smithi002.stdout:1/737: creat d4/d11/d1a/d95/ff7 x:0 0 0 2024-09-17T01:02:03.244 INFO:tasks.workunit.client.0.smithi002.stdout:1/738: rename d4/d11/d12/f3d to d4/d11/d1a/daa/dbb/ff8 0 2024-09-17T01:02:03.244 INFO:tasks.workunit.client.0.smithi002.stdout:1/739: readlink d4/d22/l9c 0 2024-09-17T01:02:03.244 INFO:tasks.workunit.client.0.smithi002.stdout:1/740: read d4/d11/d12/d14/d17/d3b/f62 [1960342,23419] 0 2024-09-17T01:02:03.245 INFO:tasks.workunit.client.1.smithi099.stdout:3/777: dwrite d9/d3b/fe2 [0,4194304] 0 2024-09-17T01:02:03.246 INFO:tasks.workunit.client.1.smithi099.stdout:3/778: fdatasync d9/d2b/fb0 0 2024-09-17T01:02:03.246 INFO:tasks.workunit.client.0.smithi002.stdout:1/741: rename d4/d11/d12/d30/d43/dd7 to d4/d11/d12/d14/d17/ddb/df9 0 2024-09-17T01:02:03.248 INFO:tasks.workunit.client.0.smithi002.stdout:4/882: dwrite d7/f12 [0,4194304] 0 2024-09-17T01:02:03.249 INFO:tasks.workunit.client.0.smithi002.stdout:5/713: dwrite d2/d2d/d10/d14/d19/d39/fd6 [0,4194304] 0 2024-09-17T01:02:03.249 INFO:tasks.workunit.client.0.smithi002.stdout:5/714: chown d2/f3a 0 1 2024-09-17T01:02:03.249 INFO:tasks.workunit.client.1.smithi099.stdout:2/651: dwrite d2/d9/d25/d26/d95/fa6 [0,4194304] 0 2024-09-17T01:02:03.249 INFO:tasks.workunit.client.1.smithi099.stdout:7/687: dwrite d1/d2c/d5c/f1d [0,4194304] 0 2024-09-17T01:02:03.250 INFO:tasks.workunit.client.0.smithi002.stdout:7/751: dwrite d1/d14/d1d/d28/f6e [0,4194304] 0 2024-09-17T01:02:03.250 INFO:tasks.workunit.client.0.smithi002.stdout:7/752: dread - d1/d14/d1d/d28/d6b/fdf zero size 2024-09-17T01:02:03.250 INFO:tasks.workunit.client.0.smithi002.stdout:8/929: dread d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d77/db0/fda [0,4194304] 0 2024-09-17T01:02:03.253 INFO:tasks.workunit.client.0.smithi002.stdout:7/753: mknod d1/d14/d1d/d29/d57/cee 0 2024-09-17T01:02:03.254 INFO:tasks.workunit.client.0.smithi002.stdout:8/930: stat d2/d1c/c86 0 2024-09-17T01:02:03.254 INFO:tasks.workunit.client.0.smithi002.stdout:1/742: dread d4/d11/d12/d14/f1b [0,4194304] 0 2024-09-17T01:02:03.254 INFO:tasks.workunit.client.0.smithi002.stdout:1/743: dread - d4/d11/d12/d14/d17/d20/fb9 zero size 2024-09-17T01:02:03.256 INFO:tasks.workunit.client.0.smithi002.stdout:7/754: creat d1/d14/d1d/d28/d6b/d9e/d54/de8/fef x:0 0 0 2024-09-17T01:02:03.257 INFO:tasks.workunit.client.0.smithi002.stdout:4/883: dread d7/d71/d8e/dd0/f81 [0,4194304] 0 2024-09-17T01:02:03.259 INFO:tasks.workunit.client.0.smithi002.stdout:1/744: symlink d4/d11/d12/d14/d17/ddb/lfa 0 2024-09-17T01:02:03.259 INFO:tasks.workunit.client.0.smithi002.stdout:5/715: dread d2/d2d/d10/d14/d19/d39/d43/f2a [0,4194304] 0 2024-09-17T01:02:03.262 INFO:tasks.workunit.client.0.smithi002.stdout:8/931: rmdir d2/d1c/d28/dad/dcd/dd1/ddb/d10f 39 2024-09-17T01:02:03.262 INFO:tasks.workunit.client.1.smithi099.stdout:7/688: dread d1/f10 [0,4194304] 0 2024-09-17T01:02:03.264 INFO:tasks.workunit.client.0.smithi002.stdout:4/884: getdents d7/d71 0 2024-09-17T01:02:03.269 INFO:tasks.workunit.client.0.smithi002.stdout:8/932: rename d2/f9a to d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d77/dd9/f12c 0 2024-09-17T01:02:03.270 INFO:tasks.workunit.client.0.smithi002.stdout:4/885: mkdir d7/d3f/da9/dca/d112 0 2024-09-17T01:02:03.271 INFO:tasks.workunit.client.0.smithi002.stdout:1/745: getdents d4/d11/d1a/daa/dc2 0 2024-09-17T01:02:03.272 INFO:tasks.workunit.client.0.smithi002.stdout:8/933: symlink d2/d1c/d3b/l12d 0 2024-09-17T01:02:03.273 INFO:tasks.workunit.client.0.smithi002.stdout:8/934: write d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/f7b [4793057,56579] 0 2024-09-17T01:02:03.273 INFO:tasks.workunit.client.1.smithi099.stdout:7/689: dread d1/d37/f51 [0,4194304] 0 2024-09-17T01:02:03.273 INFO:tasks.workunit.client.1.smithi099.stdout:7/690: chown d1/d36/l5b 1 1 2024-09-17T01:02:03.273 INFO:tasks.workunit.client.1.smithi099.stdout:7/691: fsync d1/d2c/d5c/d1c/d5a/d76/f90 0 2024-09-17T01:02:03.275 INFO:tasks.workunit.client.0.smithi002.stdout:7/755: dwrite d1/d14/d1d/d28/d40/d58/fab [0,4194304] 0 2024-09-17T01:02:03.279 INFO:tasks.workunit.client.0.smithi002.stdout:7/756: truncate d1/d14/d1d/d28/d6b/d9e/d54/fcb 3496160 0 2024-09-17T01:02:03.285 INFO:tasks.workunit.client.1.smithi099.stdout:5/822: mknod d2/dc/d14/d36/d9a/daa/c10e 0 2024-09-17T01:02:03.287 INFO:tasks.workunit.client.1.smithi099.stdout:4/739: symlink d7/dd/d21/d7b/de2/lfb 0 2024-09-17T01:02:03.287 INFO:tasks.workunit.client.0.smithi002.stdout:1/746: dwrite d4/d11/d1c/fe0 [0,4194304] 0 2024-09-17T01:02:03.292 INFO:tasks.workunit.client.1.smithi099.stdout:0/733: mkdir da/df/d1a/d49/d71/dcd/de5 0 2024-09-17T01:02:03.296 INFO:tasks.workunit.client.0.smithi002.stdout:1/747: dread d4/d11/d12/d30/d43/f4d [0,4194304] 0 2024-09-17T01:02:03.296 INFO:tasks.workunit.client.1.smithi099.stdout:9/758: creat da/d14/d48/d69/ff3 x:0 0 0 2024-09-17T01:02:03.297 INFO:tasks.workunit.client.1.smithi099.stdout:5/823: dread d2/dc/d14/f20 [0,4194304] 0 2024-09-17T01:02:03.298 INFO:tasks.workunit.client.0.smithi002.stdout:1/748: rename d4/d11/d12/d23/l58 to d4/d11/d12/d14/d17/d20/lfb 0 2024-09-17T01:02:03.301 INFO:tasks.workunit.client.1.smithi099.stdout:1/898: unlink d0/d8/d49/d94/d4b/faf 0 2024-09-17T01:02:03.303 INFO:tasks.workunit.client.0.smithi002.stdout:1/749: dread d4/d11/f5c [0,4194304] 0 2024-09-17T01:02:03.303 INFO:tasks.workunit.client.0.smithi002.stdout:1/750: truncate d4/d11/d55/d7a/fef 57409 0 2024-09-17T01:02:03.313 INFO:tasks.workunit.client.0.smithi002.stdout:7/757: dwrite d1/d14/d67/dc0/dcd/f63 [0,4194304] 0 2024-09-17T01:02:03.315 INFO:tasks.workunit.client.1.smithi099.stdout:3/779: symlink d9/d15/d7d/lf0 0 2024-09-17T01:02:03.316 INFO:tasks.workunit.client.1.smithi099.stdout:2/652: symlink d2/d9/d17/ld1 0 2024-09-17T01:02:03.316 INFO:tasks.workunit.client.1.smithi099.stdout:7/692: mknod d1/d2c/d5c/d12/cda 0 2024-09-17T01:02:03.317 INFO:tasks.workunit.client.1.smithi099.stdout:4/740: symlink d7/dbc/lfc 0 2024-09-17T01:02:03.317 INFO:tasks.workunit.client.1.smithi099.stdout:4/741: write d7/dd/d21/f38 [1288081,87063] 0 2024-09-17T01:02:03.317 INFO:tasks.workunit.client.0.smithi002.stdout:8/935: dwrite d2/d41/fe3 [0,4194304] 0 2024-09-17T01:02:03.318 INFO:tasks.workunit.client.1.smithi099.stdout:0/734: symlink da/d12/d22/d66/le6 0 2024-09-17T01:02:03.318 INFO:tasks.workunit.client.0.smithi002.stdout:8/936: mknod d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d71/d89/c12e 0 2024-09-17T01:02:03.319 INFO:tasks.workunit.client.1.smithi099.stdout:9/759: rename da/d9a/d3a/cbe to da/d14/cf4 0 2024-09-17T01:02:03.319 INFO:tasks.workunit.client.1.smithi099.stdout:9/760: creat da/d18/d5e/ff5 x:0 0 0 2024-09-17T01:02:03.320 INFO:tasks.workunit.client.0.smithi002.stdout:8/937: mknod d2/d1c/d28/dad/dcd/dd1/ddb/dcb/c12f 0 2024-09-17T01:02:03.320 INFO:tasks.workunit.client.0.smithi002.stdout:7/758: dread d1/d14/d67/f75 [0,4194304] 0 2024-09-17T01:02:03.320 INFO:tasks.workunit.client.0.smithi002.stdout:7/759: truncate d1/d14/d1d/d28/d2d/fa4 312599 0 2024-09-17T01:02:03.320 INFO:tasks.workunit.client.1.smithi099.stdout:5/824: mkdir d2/dc4/dad/d10f 0 2024-09-17T01:02:03.321 INFO:tasks.workunit.client.1.smithi099.stdout:1/899: creat d0/d8c/f131 x:0 0 0 2024-09-17T01:02:03.321 INFO:tasks.workunit.client.0.smithi002.stdout:8/938: unlink d2/f37 0 2024-09-17T01:02:03.323 INFO:tasks.workunit.client.0.smithi002.stdout:7/760: rename d1/d14/d1d/d28/d40/ld8 to d1/d14/d67/dc0/dcd/lf0 0 2024-09-17T01:02:03.324 INFO:tasks.workunit.client.1.smithi099.stdout:3/780: truncate d9/d15/d7d/f8a 724460 0 2024-09-17T01:02:03.324 INFO:tasks.workunit.client.0.smithi002.stdout:1/751: dwrite d4/d11/d12/d14/d17/d3b/f42 [0,4194304] 0 2024-09-17T01:02:03.325 INFO:tasks.workunit.client.0.smithi002.stdout:8/939: rename d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/f126 to d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d77/d78/f130 0 2024-09-17T01:02:03.325 INFO:tasks.workunit.client.1.smithi099.stdout:4/742: creat d7/ffd x:0 0 0 2024-09-17T01:02:03.326 INFO:tasks.workunit.client.0.smithi002.stdout:7/761: mknod d1/d14/d67/cf1 0 2024-09-17T01:02:03.329 INFO:tasks.workunit.client.0.smithi002.stdout:8/940: truncate d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/f7b 4743511 0 2024-09-17T01:02:03.330 INFO:tasks.workunit.client.0.smithi002.stdout:7/762: creat d1/d14/d1d/d28/d8f/ff2 x:0 0 0 2024-09-17T01:02:03.331 INFO:tasks.workunit.client.1.smithi099.stdout:7/693: write d1/d2c/f30 [3871963,119875] 0 2024-09-17T01:02:03.331 INFO:tasks.workunit.client.1.smithi099.stdout:2/653: read d2/d9/d25/d26/d95/fa6 [3556259,46042] 0 2024-09-17T01:02:03.331 INFO:tasks.workunit.client.0.smithi002.stdout:7/763: creat d1/d14/d1d/d28/d8f/de0/ff3 x:0 0 0 2024-09-17T01:02:03.331 INFO:tasks.workunit.client.0.smithi002.stdout:7/764: chown d1/d14/d1d/d28/d6b/d9e/d54/laa 5 1 2024-09-17T01:02:03.333 INFO:tasks.workunit.client.1.smithi099.stdout:2/654: dread d2/d9/d25/d26/f32 [0,4194304] 0 2024-09-17T01:02:03.333 INFO:tasks.workunit.client.1.smithi099.stdout:1/900: symlink d0/d8/dbf/l132 0 2024-09-17T01:02:03.336 INFO:tasks.workunit.client.1.smithi099.stdout:0/735: dread da/f27 [0,4194304] 0 2024-09-17T01:02:03.336 INFO:tasks.workunit.client.1.smithi099.stdout:0/736: creat da/df/d20/fe7 x:0 0 0 2024-09-17T01:02:03.336 INFO:tasks.workunit.client.1.smithi099.stdout:0/737: creat da/d12/fe8 x:0 0 0 2024-09-17T01:02:03.336 INFO:tasks.workunit.client.1.smithi099.stdout:0/738: stat da/df/d1a/d49/d68/d9f/lbc 0 2024-09-17T01:02:03.336 INFO:tasks.workunit.client.1.smithi099.stdout:0/739: read f9 [2238892,58932] 0 2024-09-17T01:02:03.336 INFO:tasks.workunit.client.1.smithi099.stdout:0/740: fdatasync da/df/d1a/d49/d68/d9f/fe3 0 2024-09-17T01:02:03.336 INFO:tasks.workunit.client.1.smithi099.stdout:0/741: write da/df/f4f [2206537,128563] 0 2024-09-17T01:02:03.338 INFO:tasks.workunit.client.1.smithi099.stdout:9/761: dread da/d50/f83 [0,4194304] 0 2024-09-17T01:02:03.340 INFO:tasks.workunit.client.1.smithi099.stdout:4/743: dread d7/dd/de/d17/f52 [0,4194304] 0 2024-09-17T01:02:03.353 INFO:tasks.workunit.client.1.smithi099.stdout:3/781: link d9/d15/d18/d1a/f4d d9/d15/d18/d1a/d23/d4c/d64/ff1 0 2024-09-17T01:02:03.355 INFO:tasks.workunit.client.1.smithi099.stdout:7/694: rename d1/d8f/f95 to d1/d2c/d5c/d1c/d72/fdb 0 2024-09-17T01:02:03.356 INFO:tasks.workunit.client.1.smithi099.stdout:5/825: rmdir d2/dc4/d99/dd0 39 2024-09-17T01:02:03.357 INFO:tasks.workunit.client.0.smithi002.stdout:7/765: dwrite d1/d24/f31 [0,4194304] 0 2024-09-17T01:02:03.357 INFO:tasks.workunit.client.0.smithi002.stdout:1/752: dwrite d4/d11/d12/d14/d17/d56/f8e [4194304,4194304] 0 2024-09-17T01:02:03.357 INFO:tasks.workunit.client.0.smithi002.stdout:7/766: write d1/d14/d1d/d28/d8f/de0/ff3 [127504,64479] 0 2024-09-17T01:02:03.357 INFO:tasks.workunit.client.0.smithi002.stdout:1/753: creat d4/d11/d12/d14/d17/d51/ffc x:0 0 0 2024-09-17T01:02:03.358 INFO:tasks.workunit.client.0.smithi002.stdout:7/767: write d1/d24/fc8 [104434,65905] 0 2024-09-17T01:02:03.358 INFO:tasks.workunit.client.0.smithi002.stdout:7/768: stat d1/d14/d1d/d29/d57/c51 0 2024-09-17T01:02:03.358 INFO:tasks.workunit.client.1.smithi099.stdout:2/655: mknod d2/d9/d25/d26/d1b/d61/d7d/cd2 0 2024-09-17T01:02:03.359 INFO:tasks.workunit.client.1.smithi099.stdout:1/901: mknod d0/de2/dfd/c133 0 2024-09-17T01:02:03.360 INFO:tasks.workunit.client.0.smithi002.stdout:7/769: mknod d1/d14/d1d/d28/d6b/d9e/d5e/cf4 0 2024-09-17T01:02:03.361 INFO:tasks.workunit.client.0.smithi002.stdout:1/754: getdents d4/d11/d12/d30/d43/d67 0 2024-09-17T01:02:03.363 INFO:tasks.workunit.client.1.smithi099.stdout:0/742: symlink da/df/d1a/d56/d72/dd4/le9 0 2024-09-17T01:02:03.364 INFO:tasks.workunit.client.0.smithi002.stdout:7/770: dread d1/f5 [0,4194304] 0 2024-09-17T01:02:03.364 INFO:tasks.workunit.client.0.smithi002.stdout:6/747: sync 2024-09-17T01:02:03.364 INFO:tasks.workunit.client.0.smithi002.stdout:0/664: sync 2024-09-17T01:02:03.365 INFO:tasks.workunit.client.1.smithi099.stdout:9/762: creat da/d21/deb/ff6 x:0 0 0 2024-09-17T01:02:03.366 INFO:tasks.workunit.client.1.smithi099.stdout:4/744: symlink d7/dd/d92/lfe 0 2024-09-17T01:02:03.366 INFO:tasks.workunit.client.1.smithi099.stdout:4/745: chown d7/dd/de/f14 417756 1 2024-09-17T01:02:03.367 INFO:tasks.workunit.client.0.smithi002.stdout:6/748: rename d2/d1d/d26/d49/d7d/fe3 to d2/d1d/d2d/d35/d37/ff0 0 2024-09-17T01:02:03.369 INFO:tasks.workunit.client.1.smithi099.stdout:7/695: rmdir d1/d36 39 2024-09-17T01:02:03.369 INFO:tasks.workunit.client.1.smithi099.stdout:7/696: chown d1/d37/d78/la3 0 1 2024-09-17T01:02:03.369 INFO:tasks.workunit.client.0.smithi002.stdout:6/749: creat d2/ff1 x:0 0 0 2024-09-17T01:02:03.372 INFO:tasks.workunit.client.1.smithi099.stdout:5/826: creat d2/dc/d17/d3c/db3/dde/f110 x:0 0 0 2024-09-17T01:02:03.372 INFO:tasks.workunit.client.1.smithi099.stdout:2/656: link d2/d9/d17/f21 d2/d9/d17/d83/dca/fd3 0 2024-09-17T01:02:03.373 INFO:tasks.workunit.client.0.smithi002.stdout:7/771: dread d1/d24/fb1 [0,4194304] 0 2024-09-17T01:02:03.375 INFO:tasks.workunit.client.1.smithi099.stdout:9/763: dread da/d14/d40/d6f/f71 [0,4194304] 0 2024-09-17T01:02:03.378 INFO:tasks.workunit.client.1.smithi099.stdout:1/902: mkdir d0/d8/d38/d8a/dd0/ddc/d134 0 2024-09-17T01:02:03.379 INFO:tasks.workunit.client.1.smithi099.stdout:4/746: mkdir d7/dd/d21/d26/d3f/dff 0 2024-09-17T01:02:03.380 INFO:tasks.workunit.client.1.smithi099.stdout:4/747: dread - d7/dd/d21/d7b/d4b/f27 zero size 2024-09-17T01:02:03.382 INFO:tasks.workunit.client.1.smithi099.stdout:9/764: dread da/d50/f83 [0,4194304] 0 2024-09-17T01:02:03.382 INFO:tasks.workunit.client.1.smithi099.stdout:9/765: write da/d14/d62/fc9 [57354,9814] 0 2024-09-17T01:02:03.382 INFO:tasks.workunit.client.1.smithi099.stdout:7/697: mknod d1/d2c/cdc 0 2024-09-17T01:02:03.385 INFO:tasks.workunit.client.1.smithi099.stdout:5/827: creat d2/dc/d14/d36/d9a/daa/f111 x:0 0 0 2024-09-17T01:02:03.386 INFO:tasks.workunit.client.1.smithi099.stdout:2/657: getdents d2/d9/d25/d26/d1b/dad 0 2024-09-17T01:02:03.387 INFO:tasks.workunit.client.1.smithi099.stdout:1/903: mkdir d0/d8/d38/d75/d135 0 2024-09-17T01:02:03.387 INFO:tasks.workunit.client.1.smithi099.stdout:1/904: truncate d0/d8/d49/d94/f72 1324542 0 2024-09-17T01:02:03.387 INFO:tasks.workunit.client.1.smithi099.stdout:1/905: chown d0/d8/d38/d8a/d120 154598855 1 2024-09-17T01:02:03.387 INFO:tasks.workunit.client.0.smithi002.stdout:1/755: dwrite d4/d11/d12/d14/d17/d51/fbd [0,4194304] 0 2024-09-17T01:02:03.388 INFO:tasks.workunit.client.0.smithi002.stdout:1/756: write d4/d11/d55/dbc/fde [1835330,735] 0 2024-09-17T01:02:03.388 INFO:tasks.workunit.client.0.smithi002.stdout:1/757: chown d4/d11/d55/fb2 2802 1 2024-09-17T01:02:03.388 INFO:tasks.workunit.client.0.smithi002.stdout:1/758: getdents d4/d11/d12/d30/d43/d67 0 2024-09-17T01:02:03.388 INFO:tasks.workunit.client.1.smithi099.stdout:4/748: link d7/dd/d21/d26/l3b d7/dd/d92/l100 0 2024-09-17T01:02:03.388 INFO:tasks.workunit.client.1.smithi099.stdout:4/749: truncate d7/dd/d21/d26/d3f/fd5 835607 0 2024-09-17T01:02:03.388 INFO:tasks.workunit.client.1.smithi099.stdout:4/750: readlink d7/dd/de/d10/d6b/la1 0 2024-09-17T01:02:03.389 INFO:tasks.workunit.client.1.smithi099.stdout:5/828: mkdir d2/de4/d112 0 2024-09-17T01:02:03.390 INFO:tasks.workunit.client.1.smithi099.stdout:1/906: mknod d0/d8/d49/d94/c136 0 2024-09-17T01:02:03.390 INFO:tasks.workunit.client.0.smithi002.stdout:1/759: dread d4/d11/f71 [0,4194304] 0 2024-09-17T01:02:03.391 INFO:tasks.workunit.client.0.smithi002.stdout:1/760: truncate d4/d11/d12/d23/f89 1942704 0 2024-09-17T01:02:03.391 INFO:tasks.workunit.client.0.smithi002.stdout:1/761: write d4/d11/d12/d14/d17/d56/f6f [1514358,85766] 0 2024-09-17T01:02:03.391 INFO:tasks.workunit.client.1.smithi099.stdout:4/751: creat d7/dd/de/d10/d6b/d82/d8a/f101 x:0 0 0 2024-09-17T01:02:03.392 INFO:tasks.workunit.client.0.smithi002.stdout:1/762: mknod d4/d11/d12/d14/d17/d51/dc0/cfd 0 2024-09-17T01:02:03.392 INFO:tasks.workunit.client.1.smithi099.stdout:5/829: creat d2/dc/d17/d3c/d72/f113 x:0 0 0 2024-09-17T01:02:03.393 INFO:tasks.workunit.client.1.smithi099.stdout:1/907: truncate d0/d8/d49/d94/de0/f4d 1044885 0 2024-09-17T01:02:03.393 INFO:tasks.workunit.client.0.smithi002.stdout:1/763: mknod d4/d11/d55/dbc/cfe 0 2024-09-17T01:02:03.394 INFO:tasks.workunit.client.1.smithi099.stdout:4/752: getdents d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd 0 2024-09-17T01:02:03.394 INFO:tasks.workunit.client.1.smithi099.stdout:4/753: chown d7/dd/d21/d26/d3f/l4c 182729923 1 2024-09-17T01:02:03.395 INFO:tasks.workunit.client.0.smithi002.stdout:1/764: mkdir d4/d11/d55/dbc/dff 0 2024-09-17T01:02:03.396 INFO:tasks.workunit.client.1.smithi099.stdout:1/908: creat d0/d8/d49/d94/d4b/d59/dc3/f137 x:0 0 0 2024-09-17T01:02:03.396 INFO:tasks.workunit.client.1.smithi099.stdout:1/909: creat d0/d2/de/d8b/da7/d98/f138 x:0 0 0 2024-09-17T01:02:03.398 INFO:tasks.workunit.client.1.smithi099.stdout:2/658: write d2/d9/d25/d26/d1b/d61/f6a [1437933,99883] 0 2024-09-17T01:02:03.398 INFO:tasks.workunit.client.1.smithi099.stdout:1/910: symlink d0/d8/d49/d94/d4b/d59/db9/dc8/l139 0 2024-09-17T01:02:03.399 INFO:tasks.workunit.client.1.smithi099.stdout:2/659: getdents d2/d9/d25/d26/d1b/d61 0 2024-09-17T01:02:03.400 INFO:tasks.workunit.client.1.smithi099.stdout:1/911: symlink d0/d8/dbf/l13a 0 2024-09-17T01:02:03.401 INFO:tasks.workunit.client.1.smithi099.stdout:1/912: symlink d0/d8c/l13b 0 2024-09-17T01:02:03.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:02 smithi002 ceph-mon[27650]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:03.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:02 smithi002 ceph-mon[27650]: pgmap v255: 65 pgs: 65 active+clean; 2.7 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 313 MiB/s rd, 383 MiB/s wr, 528 op/s 2024-09-17T01:02:03.405 INFO:tasks.workunit.client.1.smithi099.stdout:1/913: dread d0/d8/d49/f82 [0,4194304] 0 2024-09-17T01:02:03.405 INFO:tasks.workunit.client.1.smithi099.stdout:1/914: creat d0/d8/d49/d94/de0/dba/f13c x:0 0 0 2024-09-17T01:02:03.405 INFO:tasks.workunit.client.1.smithi099.stdout:1/915: write d0/d8c/faa [1826246,112665] 0 2024-09-17T01:02:03.405 INFO:tasks.workunit.client.1.smithi099.stdout:1/916: chown d0/d8/d38/d75/c92 3439 1 2024-09-17T01:02:03.406 INFO:tasks.workunit.client.1.smithi099.stdout:0/743: dwrite da/d59/d80/d8c/d97/fbe [0,4194304] 0 2024-09-17T01:02:03.408 INFO:tasks.workunit.client.0.smithi002.stdout:1/765: dread d4/d11/d55/f65 [0,4194304] 0 2024-09-17T01:02:03.410 INFO:tasks.workunit.client.1.smithi099.stdout:1/917: rename d0/d2/de/d70/de8/fdd to d0/d8c/f13d 0 2024-09-17T01:02:03.410 INFO:tasks.workunit.client.1.smithi099.stdout:2/660: write d2/d9/d25/d26/d1b/d2c/d3f/db8/fcf [2223739,95544] 0 2024-09-17T01:02:03.410 INFO:tasks.workunit.client.1.smithi099.stdout:2/661: fdatasync d2/d9/d25/d26/d1b/d2c/f52 0 2024-09-17T01:02:03.410 INFO:tasks.workunit.client.1.smithi099.stdout:2/662: read - d2/fc7 zero size 2024-09-17T01:02:03.411 INFO:tasks.workunit.client.1.smithi099.stdout:2/663: read d2/d9/d25/f2e [3018446,88999] 0 2024-09-17T01:02:03.415 INFO:tasks.workunit.client.1.smithi099.stdout:0/744: rename da/df/d1a/d63/de1 to da/df/d31/dea 0 2024-09-17T01:02:03.416 INFO:tasks.workunit.client.1.smithi099.stdout:1/918: mknod d0/d8/d38/d8a/dd0/ddc/dfc/c13e 0 2024-09-17T01:02:03.416 INFO:tasks.workunit.client.0.smithi002.stdout:6/750: dwrite d2/d1d/d27/d30/fb7 [0,4194304] 0 2024-09-17T01:02:03.417 INFO:tasks.workunit.client.1.smithi099.stdout:2/664: mkdir d2/d9/d17/d83/d8d/dd4 0 2024-09-17T01:02:03.419 INFO:tasks.workunit.client.0.smithi002.stdout:6/751: truncate d2/d1d/d99/fee 1633232 0 2024-09-17T01:02:03.419 INFO:tasks.workunit.client.0.smithi002.stdout:6/752: stat d2/d1d/d27/d30/fdd 0 2024-09-17T01:02:03.419 INFO:tasks.workunit.client.0.smithi002.stdout:6/753: write d2/d1d/d27/d80/d93/dd5/d5c/dc9/fc7 [992158,76807] 0 2024-09-17T01:02:03.419 INFO:tasks.workunit.client.0.smithi002.stdout:6/754: chown d2/d1d/d27/d80/d93/dd5/d5c/dc9/fbd 913 1 2024-09-17T01:02:03.419 INFO:tasks.workunit.client.0.smithi002.stdout:6/755: truncate d2/d1d/d27/d30/fa2 928110 0 2024-09-17T01:02:03.420 INFO:tasks.workunit.client.0.smithi002.stdout:6/756: rmdir d2/d1d/d2d/d35/d8d/dab 39 2024-09-17T01:02:03.421 INFO:tasks.workunit.client.0.smithi002.stdout:7/772: dwrite d1/d24/f46 [4194304,4194304] 0 2024-09-17T01:02:03.421 INFO:tasks.workunit.client.1.smithi099.stdout:0/745: mknod da/ceb 0 2024-09-17T01:02:03.421 INFO:tasks.workunit.client.1.smithi099.stdout:7/698: dwrite d1/d2c/d5c/d12/f32 [0,4194304] 0 2024-09-17T01:02:03.422 INFO:tasks.workunit.client.0.smithi002.stdout:6/757: symlink d2/d1d/d2d/d35/dc1/lf2 0 2024-09-17T01:02:03.422 INFO:tasks.workunit.client.0.smithi002.stdout:6/758: read d2/d1d/d27/d30/fa2 [425539,8672] 0 2024-09-17T01:02:03.423 INFO:tasks.workunit.client.0.smithi002.stdout:7/773: truncate d1/d14/d1d/d28/d6b/f83 3382411 0 2024-09-17T01:02:03.424 INFO:tasks.workunit.client.1.smithi099.stdout:1/919: truncate d0/d2/de/f15 3453158 0 2024-09-17T01:02:03.426 INFO:tasks.workunit.client.1.smithi099.stdout:2/665: rename d2/d9/d17/d83/d8d/cc6 to d2/d9/d17/d58/cd5 0 2024-09-17T01:02:03.427 INFO:tasks.workunit.client.0.smithi002.stdout:1/766: dwrite d4/d11/d12/d23/f64 [0,4194304] 0 2024-09-17T01:02:03.429 INFO:tasks.workunit.client.1.smithi099.stdout:4/754: dwrite d7/dd/de/f14 [0,4194304] 0 2024-09-17T01:02:03.432 INFO:tasks.workunit.client.1.smithi099.stdout:2/666: creat d2/d9/d25/d26/d1b/d61/d7d/d85/d98/fd6 x:0 0 0 2024-09-17T01:02:03.432 INFO:tasks.workunit.client.0.smithi002.stdout:7/774: dread d1/d14/d1d/d28/d40/d58/fca [0,4194304] 0 2024-09-17T01:02:03.433 INFO:tasks.workunit.client.1.smithi099.stdout:1/920: truncate d0/d8/d49/d94/d4b/d59/db9/feb 1732295 0 2024-09-17T01:02:03.434 INFO:tasks.workunit.client.0.smithi002.stdout:1/767: creat d4/d11/d12/d14/d17/d51/dc0/f100 x:0 0 0 2024-09-17T01:02:03.434 INFO:tasks.workunit.client.0.smithi002.stdout:1/768: chown d4/d11/d55/f92 298967 1 2024-09-17T01:02:03.434 INFO:tasks.workunit.client.0.smithi002.stdout:1/769: fsync d4/d11/d12/d30/fb1 0 2024-09-17T01:02:03.434 INFO:tasks.workunit.client.0.smithi002.stdout:1/770: chown d4/d11/d12/d14/d17/d51/dc0/le1 2257850 1 2024-09-17T01:02:03.437 INFO:tasks.workunit.client.0.smithi002.stdout:1/771: rename d4/d11/d12/l96 to d4/d11/d1a/daa/dee/l101 0 2024-09-17T01:02:03.437 INFO:tasks.workunit.client.1.smithi099.stdout:1/921: creat d0/db6/f13f x:0 0 0 2024-09-17T01:02:03.438 INFO:tasks.workunit.client.0.smithi002.stdout:6/759: rmdir d2 39 2024-09-17T01:02:03.438 INFO:tasks.workunit.client.0.smithi002.stdout:6/760: truncate d2/dc/f20 1219183 0 2024-09-17T01:02:03.438 INFO:tasks.workunit.client.1.smithi099.stdout:1/922: mknod d0/d2/de/d8b/c140 0 2024-09-17T01:02:03.439 INFO:tasks.workunit.client.1.smithi099.stdout:1/923: creat d0/d8/d38/f141 x:0 0 0 2024-09-17T01:02:03.440 INFO:tasks.workunit.client.1.smithi099.stdout:1/924: link d0/d2/de/c19 d0/d2/de/d70/de8/dd6/c142 0 2024-09-17T01:02:03.441 INFO:tasks.workunit.client.0.smithi002.stdout:6/761: creat d2/d1d/d26/d49/d7d/ff3 x:0 0 0 2024-09-17T01:02:03.441 INFO:tasks.workunit.client.0.smithi002.stdout:6/762: dread - d2/d1d/d27/d30/fdf zero size 2024-09-17T01:02:03.443 INFO:tasks.workunit.client.0.smithi002.stdout:7/775: dread d1/f20 [0,4194304] 0 2024-09-17T01:02:03.443 INFO:tasks.workunit.client.0.smithi002.stdout:7/776: write d1/d14/d1d/d28/d40/d58/f62 [2576618,60038] 0 2024-09-17T01:02:03.443 INFO:tasks.workunit.client.0.smithi002.stdout:7/777: chown d1/d14/d1d/d28/d6b/d9e/d5e/lb6 35546932 1 2024-09-17T01:02:03.444 INFO:tasks.workunit.client.0.smithi002.stdout:6/763: write d2/d1d/d2d/d5a/d71/d7e/fcf [490994,96050] 0 2024-09-17T01:02:03.444 INFO:tasks.workunit.client.0.smithi002.stdout:1/772: dread d4/d11/d12/d30/d43/f4d [0,4194304] 0 2024-09-17T01:02:03.446 INFO:tasks.workunit.client.0.smithi002.stdout:6/764: link d2/d1d/d99/fee d2/d1d/d27/d80/d93/dd5/ff4 0 2024-09-17T01:02:03.447 INFO:tasks.workunit.client.1.smithi099.stdout:2/667: read d2/d9/d25/d26/d1b/f74 [1347263,35622] 0 2024-09-17T01:02:03.448 INFO:tasks.workunit.client.0.smithi002.stdout:1/773: mkdir d4/d102 0 2024-09-17T01:02:03.448 INFO:tasks.workunit.client.0.smithi002.stdout:1/774: fdatasync d4/d11/d12/d14/f36 0 2024-09-17T01:02:03.450 INFO:tasks.workunit.client.1.smithi099.stdout:2/668: link d2/d9/d17/d83/f9f d2/d9/d25/d26/d1b/d2c/d9b/db1/fd7 0 2024-09-17T01:02:03.450 INFO:tasks.workunit.client.1.smithi099.stdout:2/669: readlink d2/d9/l12 0 2024-09-17T01:02:03.450 INFO:tasks.workunit.client.1.smithi099.stdout:2/670: write d2/d9/d25/d26/d1b/dad/fc3 [972466,78765] 0 2024-09-17T01:02:03.451 INFO:tasks.workunit.client.1.smithi099.stdout:2/671: write d2/d9/d25/d26/d1b/d2c/fa7 [666031,19387] 0 2024-09-17T01:02:03.459 INFO:tasks.workunit.client.0.smithi002.stdout:1/775: write d4/d11/d1a/f29 [4193779,90552] 0 2024-09-17T01:02:03.460 INFO:tasks.workunit.client.1.smithi099.stdout:0/746: dwrite da/f82 [0,4194304] 0 2024-09-17T01:02:03.460 INFO:tasks.workunit.client.1.smithi099.stdout:0/747: write da/df/d1a/d56/fc5 [555427,13126] 0 2024-09-17T01:02:03.461 INFO:tasks.workunit.client.0.smithi002.stdout:1/776: symlink d4/d11/d12/d14/d17/ddb/df9/l103 0 2024-09-17T01:02:03.462 INFO:tasks.workunit.client.1.smithi099.stdout:0/748: creat da/df/d4d/fec x:0 0 0 2024-09-17T01:02:03.462 INFO:tasks.workunit.client.1.smithi099.stdout:0/749: stat da/df/d1a/d49/d71/dcd/de5 0 2024-09-17T01:02:03.462 INFO:tasks.workunit.client.1.smithi099.stdout:0/750: rename da/d12 to da/d12/ded 22 2024-09-17T01:02:03.463 INFO:tasks.workunit.client.0.smithi002.stdout:1/777: mknod d4/d11/d12/d14/d17/ddb/c104 0 2024-09-17T01:02:03.463 INFO:tasks.workunit.client.0.smithi002.stdout:1/778: write d4/fb0 [709715,4513] 0 2024-09-17T01:02:03.464 INFO:tasks.workunit.client.1.smithi099.stdout:0/751: link da/df/d4d/cb6 da/df/d1a/d49/d68/d9f/dd7/de0/cee 0 2024-09-17T01:02:03.464 INFO:tasks.workunit.client.1.smithi099.stdout:0/752: stat da/df/d1a/d49/d68/d9f/dd7/de0 0 2024-09-17T01:02:03.465 INFO:tasks.workunit.client.1.smithi099.stdout:0/753: chown da/d59/d80/d8c/cd6 5571 1 2024-09-17T01:02:03.465 INFO:tasks.workunit.client.1.smithi099.stdout:0/754: mknod da/df/d1a/d56/d72/dd4/cef 0 2024-09-17T01:02:03.465 INFO:tasks.workunit.client.1.smithi099.stdout:0/755: mkdir da/d12/d2b/df0 0 2024-09-17T01:02:03.465 INFO:tasks.workunit.client.1.smithi099.stdout:0/756: write da/df/d31/fd5 [313487,105417] 0 2024-09-17T01:02:03.467 INFO:tasks.workunit.client.1.smithi099.stdout:0/757: link da/df/d31/db0/d1e/l9c da/d59/d80/lf1 0 2024-09-17T01:02:03.467 INFO:tasks.workunit.client.1.smithi099.stdout:0/758: truncate da/df/d1a/fce 602161 0 2024-09-17T01:02:03.468 INFO:tasks.workunit.client.1.smithi099.stdout:7/699: dwrite d1/d2c/d5c/d1c/d72/fdb [0,4194304] 0 2024-09-17T01:02:03.468 INFO:tasks.workunit.client.1.smithi099.stdout:7/700: truncate d1/d36/f46 639472 0 2024-09-17T01:02:03.469 INFO:tasks.workunit.client.0.smithi002.stdout:7/778: dread d1/d14/d1d/d28/d2d/f70 [0,4194304] 0 2024-09-17T01:02:03.469 INFO:tasks.workunit.client.0.smithi002.stdout:7/779: write d1/d14/d1d/d28/d8f/de0/ff3 [440340,105730] 0 2024-09-17T01:02:03.469 INFO:tasks.workunit.client.0.smithi002.stdout:7/780: fsync d1/d14/d1d/d28/d2d/f70 0 2024-09-17T01:02:03.470 INFO:tasks.workunit.client.0.smithi002.stdout:1/779: rename d4/fb0 to d4/d22/d8d/f105 0 2024-09-17T01:02:03.470 INFO:tasks.workunit.client.0.smithi002.stdout:7/781: mknod d1/dac/cf5 0 2024-09-17T01:02:03.470 INFO:tasks.workunit.client.0.smithi002.stdout:7/782: creat d1/d14/d67/dc0/ff6 x:0 0 0 2024-09-17T01:02:03.470 INFO:tasks.workunit.client.0.smithi002.stdout:1/780: mknod d4/d22/d8d/de8/c106 0 2024-09-17T01:02:03.470 INFO:tasks.workunit.client.0.smithi002.stdout:1/781: truncate d4/d11/d1a/daa/dc2/fcd 972183 0 2024-09-17T01:02:03.470 INFO:tasks.workunit.client.0.smithi002.stdout:7/783: dread d1/d14/d1d/d28/d40/d58/fe7 [0,4194304] 0 2024-09-17T01:02:03.470 INFO:tasks.workunit.client.0.smithi002.stdout:7/784: chown d1/d14/d1d/f88 52 1 2024-09-17T01:02:03.470 INFO:tasks.workunit.client.0.smithi002.stdout:7/785: stat d1/l19 0 2024-09-17T01:02:03.471 INFO:tasks.workunit.client.0.smithi002.stdout:1/782: creat d4/d11/d12/d14/d17/d56/f107 x:0 0 0 2024-09-17T01:02:03.471 INFO:tasks.workunit.client.0.smithi002.stdout:1/783: chown d4/d11/d12/d14/d17/d40/c94 1114106637 1 2024-09-17T01:02:03.471 INFO:tasks.workunit.client.1.smithi099.stdout:7/701: write d1/f4 [3794263,121636] 0 2024-09-17T01:02:03.472 INFO:tasks.workunit.client.1.smithi099.stdout:7/702: fsync d1/d37/f56 0 2024-09-17T01:02:03.472 INFO:tasks.workunit.client.1.smithi099.stdout:7/703: link d1/d2c/d5c/d12/l54 d1/d2c/d5c/d1c/d5a/db3/dcd/ldd 0 2024-09-17T01:02:03.479 INFO:tasks.workunit.client.1.smithi099.stdout:0/759: read da/df/d31/f4c [2816189,123918] 0 2024-09-17T01:02:03.479 INFO:tasks.workunit.client.1.smithi099.stdout:0/760: dread - da/f5d zero size 2024-09-17T01:02:03.484 INFO:tasks.workunit.client.0.smithi002.stdout:7/786: dread d1/d14/d1d/d28/d40/d58/fab [0,4194304] 0 2024-09-17T01:02:03.485 INFO:tasks.workunit.client.0.smithi002.stdout:1/784: dread d4/d11/d1c/f66 [4194304,4194304] 0 2024-09-17T01:02:03.485 INFO:tasks.workunit.client.0.smithi002.stdout:1/785: chown d4/d11/d12/d14/d17/d56/f107 59493 1 2024-09-17T01:02:03.485 INFO:tasks.workunit.client.0.smithi002.stdout:1/786: fdatasync d4/d11/d12/d30/d43/d67/fd4 0 2024-09-17T01:02:03.485 INFO:tasks.workunit.client.0.smithi002.stdout:1/787: stat d4/d22/d8d/de8 0 2024-09-17T01:02:03.486 INFO:tasks.workunit.client.0.smithi002.stdout:1/788: write d4/d11/d1a/daa/fe6 [586270,13456] 0 2024-09-17T01:02:03.486 INFO:tasks.workunit.client.0.smithi002.stdout:1/789: fsync d4/d11/d12/d30/d43/d67/ff0 0 2024-09-17T01:02:03.486 INFO:tasks.workunit.client.0.smithi002.stdout:1/790: fsync d4/d11/d55/d7a/fa5 0 2024-09-17T01:02:03.486 INFO:tasks.workunit.client.0.smithi002.stdout:6/765: dwrite d2/d1d/d26/d49/d51/f96 [0,4194304] 0 2024-09-17T01:02:03.487 INFO:tasks.workunit.client.0.smithi002.stdout:7/787: unlink d1/d14/d1d/d28/d6b/d9e/d5e/cf4 0 2024-09-17T01:02:03.487 INFO:tasks.workunit.client.1.smithi099.stdout:4/755: dwrite d7/dd/d21/f38 [0,4194304] 0 2024-09-17T01:02:03.487 INFO:tasks.workunit.client.1.smithi099.stdout:4/756: stat d7/le5 0 2024-09-17T01:02:03.487 INFO:tasks.workunit.client.1.smithi099.stdout:1/925: dwrite d0/d2/de/d8b/ff3 [0,4194304] 0 2024-09-17T01:02:03.487 INFO:tasks.workunit.client.1.smithi099.stdout:2/672: dwrite d2/d9/d25/d26/d1b/d2c/f3d [0,4194304] 0 2024-09-17T01:02:03.490 INFO:tasks.workunit.client.1.smithi099.stdout:1/926: dread d0/f13 [0,4194304] 0 2024-09-17T01:02:03.491 INFO:tasks.workunit.client.1.smithi099.stdout:1/927: creat d0/d8/d49/d94/de0/dba/f143 x:0 0 0 2024-09-17T01:02:03.491 INFO:tasks.workunit.client.1.smithi099.stdout:1/928: write d0/d8/d38/d56/d93/fec [858584,38243] 0 2024-09-17T01:02:03.494 INFO:tasks.workunit.client.1.smithi099.stdout:4/757: link f2 d7/dd/d21/d26/d3f/dff/f102 0 2024-09-17T01:02:03.498 INFO:tasks.workunit.client.1.smithi099.stdout:2/673: creat d2/d9/d25/fd8 x:0 0 0 2024-09-17T01:02:03.498 INFO:tasks.workunit.client.0.smithi002.stdout:6/766: link d2/d1d/d2d/d35/d8d/dab/ce4 d2/d1d/d27/cf5 0 2024-09-17T01:02:03.498 INFO:tasks.workunit.client.0.smithi002.stdout:6/767: chown d2/dc/d24/d53/d83/da9/d4c 150783067 1 2024-09-17T01:02:03.499 INFO:tasks.workunit.client.0.smithi002.stdout:7/788: truncate d1/d14/d1d/d28/d6b/f83 2354656 0 2024-09-17T01:02:03.499 INFO:tasks.workunit.client.0.smithi002.stdout:7/789: chown d1/d14/d1d/l22 6887 1 2024-09-17T01:02:03.500 INFO:tasks.workunit.client.0.smithi002.stdout:7/790: mknod d1/d14/d1d/d28/d8f/cf7 0 2024-09-17T01:02:03.500 INFO:tasks.workunit.client.0.smithi002.stdout:7/791: truncate d1/d14/d1d/d28/d6b/d9e/d5e/fed 712508 0 2024-09-17T01:02:03.503 INFO:tasks.workunit.client.1.smithi099.stdout:1/929: creat d0/d2/de/d70/de8/dd6/f144 x:0 0 0 2024-09-17T01:02:03.503 INFO:tasks.workunit.client.1.smithi099.stdout:1/930: write d0/d2/dd8/d109/f12d [633680,2953] 0 2024-09-17T01:02:03.503 INFO:tasks.workunit.client.1.smithi099.stdout:1/931: dread - d0/d2/fa6 zero size 2024-09-17T01:02:03.503 INFO:tasks.workunit.client.1.smithi099.stdout:1/932: write d0/d8/d38/d8a/dd0/ddc/ffa [4211361,1066] 0 2024-09-17T01:02:03.504 INFO:tasks.workunit.client.1.smithi099.stdout:0/761: getdents da/df/d1a/d49/d68/d9f/dd7/de0 0 2024-09-17T01:02:03.504 INFO:tasks.workunit.client.0.smithi002.stdout:1/791: dwrite d4/fa [0,4194304] 0 2024-09-17T01:02:03.504 INFO:tasks.workunit.client.0.smithi002.stdout:1/792: chown d4/d11/l68 4001 1 2024-09-17T01:02:03.505 INFO:tasks.workunit.client.1.smithi099.stdout:4/758: symlink d7/dd/l103 0 2024-09-17T01:02:03.506 INFO:tasks.workunit.client.0.smithi002.stdout:1/793: symlink d4/d11/d12/d14/l108 0 2024-09-17T01:02:03.506 INFO:tasks.workunit.client.0.smithi002.stdout:6/768: dread d2/f4 [0,4194304] 0 2024-09-17T01:02:03.507 INFO:tasks.workunit.client.1.smithi099.stdout:2/674: unlink d2/d9/d25/d26/d1b/d61/d7d/cd2 0 2024-09-17T01:02:03.507 INFO:tasks.workunit.client.1.smithi099.stdout:2/675: fdatasync d2/d9/d25/d26/d1b/d2c/d5d/fd0 0 2024-09-17T01:02:03.507 INFO:tasks.workunit.client.0.smithi002.stdout:1/794: truncate d4/d11/d55/f65 2306419 0 2024-09-17T01:02:03.508 INFO:tasks.workunit.client.0.smithi002.stdout:6/769: unlink d2/d1d/d2d/d35/l9b 0 2024-09-17T01:02:03.509 INFO:tasks.workunit.client.0.smithi002.stdout:1/795: creat d4/d11/d1a/daa/dbb/f109 x:0 0 0 2024-09-17T01:02:03.510 INFO:tasks.workunit.client.1.smithi099.stdout:0/762: unlink f8 0 2024-09-17T01:02:03.510 INFO:tasks.workunit.client.1.smithi099.stdout:4/759: symlink d7/dd/d21/d7b/de2/l104 0 2024-09-17T01:02:03.511 INFO:tasks.workunit.client.0.smithi002.stdout:6/770: creat d2/d1d/d27/d30/ff6 x:0 0 0 2024-09-17T01:02:03.512 INFO:tasks.workunit.client.0.smithi002.stdout:1/796: symlink d4/d11/d12/d30/d43/d67/l10a 0 2024-09-17T01:02:03.512 INFO:tasks.workunit.client.1.smithi099.stdout:1/933: dread d0/d2/d18/f34 [0,4194304] 0 2024-09-17T01:02:03.512 INFO:tasks.workunit.client.1.smithi099.stdout:1/934: readlink d0/d8/d49/d94/de0/l66 0 2024-09-17T01:02:03.513 INFO:tasks.workunit.client.0.smithi002.stdout:6/771: getdents d2/dc/d24/d53/d9e 0 2024-09-17T01:02:03.513 INFO:tasks.workunit.client.0.smithi002.stdout:6/772: readlink d2/d1d/d2d/d35/d79/da8/le9 0 2024-09-17T01:02:03.513 INFO:tasks.workunit.client.1.smithi099.stdout:2/676: rename d2/d9/d25/d26/d95 to d2/d9/d17/d83/d8d/dd9 0 2024-09-17T01:02:03.514 INFO:tasks.workunit.client.0.smithi002.stdout:1/797: link d4/d11/d12/d14/ca4 d4/d11/d55/c10b 0 2024-09-17T01:02:03.515 INFO:tasks.workunit.client.1.smithi099.stdout:4/760: creat d7/dd/de/d10/d6b/d82/d8a/d9a/da6/f105 x:0 0 0 2024-09-17T01:02:03.517 INFO:tasks.workunit.client.1.smithi099.stdout:4/761: mknod d7/dd/d21/d26/ddb/c106 0 2024-09-17T01:02:03.517 INFO:tasks.workunit.client.1.smithi099.stdout:4/762: dread - d7/dd/d21/d7b/d4b/f27 zero size 2024-09-17T01:02:03.517 INFO:tasks.workunit.client.1.smithi099.stdout:4/763: chown d7/dd/de/d17/caf 3 1 2024-09-17T01:02:03.518 INFO:tasks.workunit.client.1.smithi099.stdout:0/763: write da/df/d1a/d63/d6a/f8a [3024394,18918] 0 2024-09-17T01:02:03.518 INFO:tasks.workunit.client.1.smithi099.stdout:0/764: chown da/d12/d22/fa9 675472450 1 2024-09-17T01:02:03.518 INFO:tasks.workunit.client.1.smithi099.stdout:0/765: write da/d12/d22/fb7 [59992,32950] 0 2024-09-17T01:02:03.518 INFO:tasks.workunit.client.1.smithi099.stdout:0/766: chown da/df/d31/f34 18268943 1 2024-09-17T01:02:03.518 INFO:tasks.workunit.client.1.smithi099.stdout:0/767: readlink da/df/d31/l44 0 2024-09-17T01:02:03.518 INFO:tasks.workunit.client.0.smithi002.stdout:1/798: link d4/l5 d4/d11/d12/d30/d43/d67/l10c 0 2024-09-17T01:02:03.518 INFO:tasks.workunit.client.0.smithi002.stdout:1/799: read d4/d11/f5c [563394,46824] 0 2024-09-17T01:02:03.518 INFO:tasks.workunit.client.0.smithi002.stdout:1/800: truncate d4/d22/d8d/fd5 694603 0 2024-09-17T01:02:03.519 INFO:tasks.workunit.client.0.smithi002.stdout:7/792: truncate d1/d14/d1d/d28/d8f/de0/ff3 223719 0 2024-09-17T01:02:03.522 INFO:tasks.workunit.client.1.smithi099.stdout:0/768: rename da/df/d4d/d6f/lc6 to da/d12/d22/d53/lf2 0 2024-09-17T01:02:03.522 INFO:tasks.workunit.client.0.smithi002.stdout:2/760: sync 2024-09-17T01:02:03.523 INFO:tasks.workunit.client.0.smithi002.stdout:9/674: sync 2024-09-17T01:02:03.523 INFO:tasks.workunit.client.0.smithi002.stdout:3/678: sync 2024-09-17T01:02:03.523 INFO:tasks.workunit.client.0.smithi002.stdout:2/761: fdatasync d1b/d3f/d59/d7f/dc9/dac/ff8 0 2024-09-17T01:02:03.523 INFO:tasks.workunit.client.0.smithi002.stdout:9/675: write d5/dc/f99 [1304876,46352] 0 2024-09-17T01:02:03.523 INFO:tasks.workunit.client.0.smithi002.stdout:9/676: write d5/dc/d26/d46/d47/d89/fc0 [767150,81628] 0 2024-09-17T01:02:03.525 INFO:tasks.workunit.client.0.smithi002.stdout:2/762: link d1b/d8a/d92/fa7 d1b/d8a/d92/f113 0 2024-09-17T01:02:03.525 INFO:tasks.workunit.client.1.smithi099.stdout:2/677: write d2/d9/fa0 [1731159,108416] 0 2024-09-17T01:02:03.526 INFO:tasks.workunit.client.1.smithi099.stdout:0/769: rename da/df/d1a/d63/d6a/f8a to da/df/d1a/d70/ff3 0 2024-09-17T01:02:03.527 INFO:tasks.workunit.client.0.smithi002.stdout:9/677: truncate d5/dc/d26/f2d 1164807 0 2024-09-17T01:02:03.530 INFO:tasks.workunit.client.0.smithi002.stdout:7/793: write d1/d14/d1d/d28/d40/fd6 [1990174,18886] 0 2024-09-17T01:02:03.530 INFO:tasks.workunit.client.1.smithi099.stdout:0/770: creat da/df/d1a/d63/d6a/dd9/ff4 x:0 0 0 2024-09-17T01:02:03.530 INFO:tasks.workunit.client.0.smithi002.stdout:2/763: symlink d1b/d37/d48/l114 0 2024-09-17T01:02:03.531 INFO:tasks.workunit.client.1.smithi099.stdout:4/764: write d7/dd/de/f4f [37250,96192] 0 2024-09-17T01:02:03.531 INFO:tasks.workunit.client.0.smithi002.stdout:1/801: dread d4/d11/d12/d14/d17/d3b/f42 [0,4194304] 0 2024-09-17T01:02:03.531 INFO:tasks.workunit.client.0.smithi002.stdout:9/678: link d5/dc/d26/d5c/d6b/d75/d57/d7a/fb5 d5/dc/d26/d5c/d6b/d75/d57/d8d/fcb 0 2024-09-17T01:02:03.532 INFO:tasks.workunit.client.1.smithi099.stdout:0/771: creat da/df/ff5 x:0 0 0 2024-09-17T01:02:03.532 INFO:tasks.workunit.client.0.smithi002.stdout:7/794: symlink d1/d14/lf8 0 2024-09-17T01:02:03.533 INFO:tasks.workunit.client.0.smithi002.stdout:7/795: stat d1/d14/d1d/d28/d6b/d9e/d5e/fb0 0 2024-09-17T01:02:03.533 INFO:tasks.workunit.client.0.smithi002.stdout:7/796: write d1/f20 [4220136,15932] 0 2024-09-17T01:02:03.533 INFO:tasks.workunit.client.0.smithi002.stdout:2/764: symlink d1b/d37/d48/d78/l115 0 2024-09-17T01:02:03.533 INFO:tasks.workunit.client.0.smithi002.stdout:1/802: mkdir d4/d11/d12/d23/d32/d10d 0 2024-09-17T01:02:03.534 INFO:tasks.workunit.client.0.smithi002.stdout:1/803: write d4/d11/d12/d23/d32/f84 [145593,39341] 0 2024-09-17T01:02:03.535 INFO:tasks.workunit.client.0.smithi002.stdout:7/797: unlink d1/d14/d1d/d28/d40/fc2 0 2024-09-17T01:02:03.535 INFO:tasks.workunit.client.0.smithi002.stdout:7/798: rename d1/d14/d1d/d28/d6b to d1/d14/d1d/d28/d6b/d9e/d54/de8/df9 22 2024-09-17T01:02:03.535 INFO:tasks.workunit.client.0.smithi002.stdout:7/799: creat d1/d14/d1d/ffa x:0 0 0 2024-09-17T01:02:03.535 INFO:tasks.workunit.client.0.smithi002.stdout:7/800: write d1/d14/d67/dc0/dcd/fdc [1838916,43886] 0 2024-09-17T01:02:03.536 INFO:tasks.workunit.client.0.smithi002.stdout:2/765: truncate d1b/d37/f91 728757 0 2024-09-17T01:02:03.536 INFO:tasks.workunit.client.0.smithi002.stdout:2/766: truncate d1b/d1d/dd4/f101 466878 0 2024-09-17T01:02:03.537 INFO:tasks.workunit.client.0.smithi002.stdout:1/804: creat d4/d11/d12/d14/d17/d40/f10e x:0 0 0 2024-09-17T01:02:03.537 INFO:tasks.workunit.client.1.smithi099.stdout:4/765: creat d7/dd/d21/d7b/d4b/dcb/f107 x:0 0 0 2024-09-17T01:02:03.538 INFO:tasks.workunit.client.0.smithi002.stdout:7/801: mkdir d1/d14/d67/dfb 0 2024-09-17T01:02:03.539 INFO:tasks.workunit.client.0.smithi002.stdout:2/767: symlink d1b/d8a/l116 0 2024-09-17T01:02:03.539 INFO:tasks.workunit.client.0.smithi002.stdout:2/768: write d1b/d37/d48/d78/f83 [2593996,46427] 0 2024-09-17T01:02:03.539 INFO:tasks.workunit.client.0.smithi002.stdout:2/769: dread - d1b/f5a zero size 2024-09-17T01:02:03.540 INFO:tasks.workunit.client.1.smithi099.stdout:1/935: dwrite d0/d2/de/d70/de8/f6e [8388608,4194304] 0 2024-09-17T01:02:03.541 INFO:tasks.workunit.client.1.smithi099.stdout:0/772: link da/df/d1a/d56/l7a da/df/d31/dea/lf6 0 2024-09-17T01:02:03.541 INFO:tasks.workunit.client.1.smithi099.stdout:0/773: fdatasync da/d12/f5a 0 2024-09-17T01:02:03.541 INFO:tasks.workunit.client.0.smithi002.stdout:7/802: creat d1/d14/d67/dc0/dcd/ffc x:0 0 0 2024-09-17T01:02:03.542 INFO:tasks.workunit.client.1.smithi099.stdout:4/766: mkdir d7/dbc/d108 0 2024-09-17T01:02:03.544 INFO:tasks.workunit.client.1.smithi099.stdout:0/774: creat da/df/d31/ff7 x:0 0 0 2024-09-17T01:02:03.546 INFO:tasks.workunit.client.1.smithi099.stdout:4/767: link d7/dd/d21/d26/d3f/d5b/f37 d7/dd/de/d10/f109 0 2024-09-17T01:02:03.548 INFO:tasks.workunit.client.0.smithi002.stdout:6/773: dwrite d2/dc/fb6 [0,4194304] 0 2024-09-17T01:02:03.548 INFO:tasks.workunit.client.0.smithi002.stdout:6/774: fsync d2/dc/fb6 0 2024-09-17T01:02:03.548 INFO:tasks.workunit.client.0.smithi002.stdout:6/775: write d2/d1d/d26/d49/f72 [602802,83933] 0 2024-09-17T01:02:03.553 INFO:tasks.workunit.client.1.smithi099.stdout:0/775: truncate da/df/d1a/d63/d6a/f6e 1112767 0 2024-09-17T01:02:03.553 INFO:tasks.workunit.client.1.smithi099.stdout:0/776: dread - da/d12/d2b/dab/db5/f89 zero size 2024-09-17T01:02:03.553 INFO:tasks.workunit.client.1.smithi099.stdout:0/777: read f9 [1569172,86825] 0 2024-09-17T01:02:03.553 INFO:tasks.workunit.client.1.smithi099.stdout:4/768: rename d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/f88 to d7/dd/d21/d26/d3f/f10a 0 2024-09-17T01:02:03.553 INFO:tasks.workunit.client.1.smithi099.stdout:0/778: dread da/df/d31/f34 [0,4194304] 0 2024-09-17T01:02:03.553 INFO:tasks.workunit.client.1.smithi099.stdout:0/779: fdatasync da/d12/d2b/dab/db5/fa2 0 2024-09-17T01:02:03.553 INFO:tasks.workunit.client.1.smithi099.stdout:0/780: mknod da/df/d31/dea/cf8 0 2024-09-17T01:02:03.553 INFO:tasks.workunit.client.1.smithi099.stdout:0/781: chown da/d12/d22/d66/f6d 44 1 2024-09-17T01:02:03.554 INFO:tasks.workunit.client.0.smithi002.stdout:6/776: creat d2/d1d/d27/d80/d93/ff7 x:0 0 0 2024-09-17T01:02:03.554 INFO:tasks.workunit.client.0.smithi002.stdout:6/777: rename d2/dc/f21 to d2/d1d/d2d/d35/d79/de6/ff8 0 2024-09-17T01:02:03.554 INFO:tasks.workunit.client.0.smithi002.stdout:6/778: link d2/dc/d34/c92 d2/d1d/d2d/d35/d79/cf9 0 2024-09-17T01:02:03.555 INFO:tasks.workunit.client.1.smithi099.stdout:0/782: mknod da/d12/d2b/dab/cf9 0 2024-09-17T01:02:03.555 INFO:tasks.workunit.client.1.smithi099.stdout:0/783: dread - da/df/d4d/fec zero size 2024-09-17T01:02:03.555 INFO:tasks.workunit.client.0.smithi002.stdout:6/779: mkdir d2/d1d/d27/dfa 0 2024-09-17T01:02:03.555 INFO:tasks.workunit.client.0.smithi002.stdout:6/780: read - d2/d1d/d27/d80/d93/dd5/d5c/f91 zero size 2024-09-17T01:02:03.556 INFO:tasks.workunit.client.1.smithi099.stdout:0/784: unlink da/df/f28 0 2024-09-17T01:02:03.556 INFO:tasks.workunit.client.1.smithi099.stdout:0/785: fdatasync da/df/d31/f39 0 2024-09-17T01:02:03.557 INFO:tasks.workunit.client.0.smithi002.stdout:6/781: rename d2/d1d/d27/d87/d94/fd4 to d2/d1d/d27/ffb 0 2024-09-17T01:02:03.557 INFO:tasks.workunit.client.1.smithi099.stdout:0/786: mkdir da/d12/d2b/dab/dba/dfa 0 2024-09-17T01:02:03.557 INFO:tasks.workunit.client.0.smithi002.stdout:6/782: creat d2/d1d/d26/ffc x:0 0 0 2024-09-17T01:02:03.558 INFO:tasks.workunit.client.0.smithi002.stdout:6/783: getdents d2/d1d/d27/d87 0 2024-09-17T01:02:03.558 INFO:tasks.workunit.client.0.smithi002.stdout:6/784: readlink d2/l1e 0 2024-09-17T01:02:03.558 INFO:tasks.workunit.client.0.smithi002.stdout:6/785: write d2/d1d/d2d/d35/d6d/fbc [519626,74051] 0 2024-09-17T01:02:03.559 INFO:tasks.workunit.client.0.smithi002.stdout:6/786: write d2/d1d/d27/ffb [51998,26212] 0 2024-09-17T01:02:03.559 INFO:tasks.workunit.client.0.smithi002.stdout:6/787: stat d2/dc/d24/d53/d83/da9/d4c/fc5 0 2024-09-17T01:02:03.559 INFO:tasks.workunit.client.0.smithi002.stdout:6/788: creat d2/dc/d24/ffd x:0 0 0 2024-09-17T01:02:03.559 INFO:tasks.workunit.client.0.smithi002.stdout:6/789: mknod d2/d1d/d2d/d35/d37/cfe 0 2024-09-17T01:02:03.560 INFO:tasks.workunit.client.1.smithi099.stdout:0/787: dread da/df/d31/f4c [0,4194304] 0 2024-09-17T01:02:03.561 INFO:tasks.workunit.client.1.smithi099.stdout:0/788: getdents da/df/d31/db0 0 2024-09-17T01:02:03.561 INFO:tasks.workunit.client.0.smithi002.stdout:6/790: dread d2/f19 [0,4194304] 0 2024-09-17T01:02:03.561 INFO:tasks.workunit.client.0.smithi002.stdout:6/791: write d2/dc/d24/ffd [23092,103875] 0 2024-09-17T01:02:03.562 INFO:tasks.workunit.client.0.smithi002.stdout:6/792: mkdir d2/d1d/d2d/d73/dff 0 2024-09-17T01:02:03.563 INFO:tasks.workunit.client.1.smithi099.stdout:0/789: link da/d59/d80/d8c/cd6 da/df/d31/d8b/cfb 0 2024-09-17T01:02:03.563 INFO:tasks.workunit.client.0.smithi002.stdout:6/793: creat d2/d1d/d99/db9/f100 x:0 0 0 2024-09-17T01:02:03.563 INFO:tasks.workunit.client.0.smithi002.stdout:6/794: read - d2/dc/d34/f8f zero size 2024-09-17T01:02:03.563 INFO:tasks.workunit.client.0.smithi002.stdout:6/795: rmdir d2/d1d/d2d/d35/dc1 39 2024-09-17T01:02:03.564 INFO:tasks.workunit.client.1.smithi099.stdout:0/790: mknod da/df/d20/dbf/cfc 0 2024-09-17T01:02:03.564 INFO:tasks.workunit.client.0.smithi002.stdout:6/796: truncate d2/d1d/d2d/d5a/d71/d7e/f85 693389 0 2024-09-17T01:02:03.564 INFO:tasks.workunit.client.0.smithi002.stdout:6/797: rmdir d2/d1d/d26/d49/d51 39 2024-09-17T01:02:03.565 INFO:tasks.workunit.client.1.smithi099.stdout:0/791: mkdir da/d12/d22/dfd 0 2024-09-17T01:02:03.565 INFO:tasks.workunit.client.0.smithi002.stdout:6/798: getdents d2/d1d/d2d/d35 0 2024-09-17T01:02:03.565 INFO:tasks.workunit.client.0.smithi002.stdout:6/799: chown d2/d1d/d27/c33 165044 1 2024-09-17T01:02:03.566 INFO:tasks.workunit.client.1.smithi099.stdout:0/792: truncate da/df/d31/f4c 2552427 0 2024-09-17T01:02:03.566 INFO:tasks.workunit.client.1.smithi099.stdout:0/793: truncate da/df/d31/fd5 678805 0 2024-09-17T01:02:03.566 INFO:tasks.workunit.client.1.smithi099.stdout:0/794: write da/df/d1a/d63/d6a/dd9/ff4 [338877,94368] 0 2024-09-17T01:02:03.567 INFO:tasks.workunit.client.0.smithi002.stdout:6/800: mknod d2/d1d/d26/d49/d7d/c101 0 2024-09-17T01:02:03.567 INFO:tasks.workunit.client.0.smithi002.stdout:6/801: link d2/d1d/d27/d80/d93/dd5/c5b d2/d1d/d2d/c102 0 2024-09-17T01:02:03.567 INFO:tasks.workunit.client.0.smithi002.stdout:6/802: dread - d2/d1d/d27/d30/d98/fed zero size 2024-09-17T01:02:03.567 INFO:tasks.workunit.client.1.smithi099.stdout:0/795: creat da/df/d1a/d56/ffe x:0 0 0 2024-09-17T01:02:03.567 INFO:tasks.workunit.client.0.smithi002.stdout:6/803: mkdir d2/d1d/d2d/d35/d6d/dd6/d103 0 2024-09-17T01:02:03.569 INFO:tasks.workunit.client.0.smithi002.stdout:6/804: rename d2/d1d/d26/d49/d51/cb1 to d2/d1d/d27/d30/c104 0 2024-09-17T01:02:03.569 INFO:tasks.workunit.client.0.smithi002.stdout:6/805: mknod d2/d1d/d2d/d35/d37/c105 0 2024-09-17T01:02:03.570 INFO:tasks.workunit.client.0.smithi002.stdout:6/806: mkdir d2/d1d/d2d/d35/d6d/d106 0 2024-09-17T01:02:03.571 INFO:tasks.workunit.client.1.smithi099.stdout:0/796: write da/f27 [633504,67767] 0 2024-09-17T01:02:03.572 INFO:tasks.workunit.client.1.smithi099.stdout:0/797: symlink da/df/d31/lff 0 2024-09-17T01:02:03.572 INFO:tasks.workunit.client.1.smithi099.stdout:0/798: write da/df/d1a/d63/d6a/fd2 [374118,112061] 0 2024-09-17T01:02:03.573 INFO:tasks.workunit.client.1.smithi099.stdout:0/799: truncate da/df/d1a/d49/d68/f98 664579 0 2024-09-17T01:02:03.573 INFO:tasks.workunit.client.1.smithi099.stdout:0/800: creat da/d12/d2b/df0/f100 x:0 0 0 2024-09-17T01:02:03.573 INFO:tasks.workunit.client.1.smithi099.stdout:0/801: write da/df/f4f [4641887,45385] 0 2024-09-17T01:02:03.573 INFO:tasks.workunit.client.1.smithi099.stdout:0/802: fsync da/d12/d22/fb7 0 2024-09-17T01:02:03.574 INFO:tasks.workunit.client.1.smithi099.stdout:0/803: mknod da/d12/d22/d66/c101 0 2024-09-17T01:02:03.577 INFO:tasks.workunit.client.0.smithi002.stdout:6/807: write d2/f13 [1353691,316] 0 2024-09-17T01:02:03.578 INFO:tasks.workunit.client.0.smithi002.stdout:6/808: write d2/d1d/d99/fee [2485259,62436] 0 2024-09-17T01:02:03.578 INFO:tasks.workunit.client.0.smithi002.stdout:6/809: readlink d2/d1d/d2d/d35/d79/da8/le9 0 2024-09-17T01:02:03.578 INFO:tasks.workunit.client.0.smithi002.stdout:6/810: readlink d2/d1d/d2d/d35/dc1/lca 0 2024-09-17T01:02:03.579 INFO:tasks.workunit.client.0.smithi002.stdout:6/811: mkdir d2/dc/d24/d53/d83/da9/d4c/d107 0 2024-09-17T01:02:03.581 INFO:tasks.workunit.client.0.smithi002.stdout:6/812: mknod d2/d1d/d27/d80/d93/dd5/d5c/c108 0 2024-09-17T01:02:03.584 INFO:tasks.workunit.client.0.smithi002.stdout:3/679: dwrite d0/d31/d32/f42 [0,4194304] 0 2024-09-17T01:02:03.584 INFO:tasks.workunit.client.0.smithi002.stdout:3/680: chown d0/d3/d17 6 1 2024-09-17T01:02:03.584 INFO:tasks.workunit.client.0.smithi002.stdout:3/681: chown d0/f23 953 1 2024-09-17T01:02:03.584 INFO:tasks.workunit.client.0.smithi002.stdout:9/679: dwrite d5/dc/d26/d63/d66/fc4 [0,4194304] 0 2024-09-17T01:02:03.584 INFO:tasks.workunit.client.0.smithi002.stdout:9/680: chown d5/dc/d26/d63/d66/cac 1101 1 2024-09-17T01:02:03.584 INFO:tasks.workunit.client.0.smithi002.stdout:3/682: write d0/d3/d33/d40/f65 [5227512,103630] 0 2024-09-17T01:02:03.584 INFO:tasks.workunit.client.0.smithi002.stdout:1/805: dread d4/d11/d12/d23/d32/f84 [0,4194304] 0 2024-09-17T01:02:03.584 INFO:tasks.workunit.client.0.smithi002.stdout:1/806: getdents d4/d11/d55/dbc/dff 0 2024-09-17T01:02:03.585 INFO:tasks.workunit.client.1.smithi099.stdout:1/936: dwrite d0/d8/f65 [0,4194304] 0 2024-09-17T01:02:03.585 INFO:tasks.workunit.client.0.smithi002.stdout:7/803: dwrite d1/d14/d1d/d28/d6b/f72 [0,4194304] 0 2024-09-17T01:02:03.585 INFO:tasks.workunit.client.0.smithi002.stdout:6/813: dread d2/d1d/d27/d80/d93/dd5/d5c/dc9/fc7 [0,4194304] 0 2024-09-17T01:02:03.585 INFO:tasks.workunit.client.0.smithi002.stdout:6/814: stat d2/d1d/d2d/d5a 0 2024-09-17T01:02:03.586 INFO:tasks.workunit.client.0.smithi002.stdout:9/681: dread d5/d8a/d9d/fa3 [0,4194304] 0 2024-09-17T01:02:03.587 INFO:tasks.workunit.client.1.smithi099.stdout:1/937: mkdir d0/d8/d49/d94/de0/dba/d145 0 2024-09-17T01:02:03.587 INFO:tasks.workunit.client.1.smithi099.stdout:1/938: creat d0/d8/dbf/f146 x:0 0 0 2024-09-17T01:02:03.587 INFO:tasks.workunit.client.0.smithi002.stdout:3/683: write d0/d3/d8d/f9c [453993,59374] 0 2024-09-17T01:02:03.589 INFO:tasks.workunit.client.1.smithi099.stdout:4/769: getdents d7/dd/d21/d7b/d4b/dcb 0 2024-09-17T01:02:03.592 INFO:tasks.workunit.client.1.smithi099.stdout:1/939: symlink d0/d2/de/l147 0 2024-09-17T01:02:03.592 INFO:tasks.workunit.client.1.smithi099.stdout:1/940: write d0/d2/de/d8b/da7/fe5 [931858,34399] 0 2024-09-17T01:02:03.592 INFO:tasks.workunit.client.1.smithi099.stdout:1/941: truncate d0/d8/d38/f141 943171 0 2024-09-17T01:02:03.594 INFO:tasks.workunit.client.1.smithi099.stdout:4/770: symlink d7/dd/d21/d26/ddb/l10b 0 2024-09-17T01:02:03.594 INFO:tasks.workunit.client.1.smithi099.stdout:1/942: dread d0/d8c/ff6 [0,4194304] 0 2024-09-17T01:02:03.596 INFO:tasks.workunit.client.1.smithi099.stdout:1/943: creat d0/d2/de/d12f/f148 x:0 0 0 2024-09-17T01:02:03.601 INFO:tasks.workunit.client.0.smithi002.stdout:7/804: creat d1/d14/d1d/d28/d6b/d9e/ffd x:0 0 0 2024-09-17T01:02:03.601 INFO:tasks.workunit.client.0.smithi002.stdout:7/805: readlink d1/l16 0 2024-09-17T01:02:03.601 INFO:tasks.workunit.client.1.smithi099.stdout:1/944: mknod d0/d8c/c149 0 2024-09-17T01:02:03.603 INFO:tasks.workunit.client.1.smithi099.stdout:1/945: mknod d0/dbc/c14a 0 2024-09-17T01:02:03.603 INFO:tasks.workunit.client.1.smithi099.stdout:1/946: write d0/f36 [244485,127655] 0 2024-09-17T01:02:03.604 INFO:tasks.workunit.client.1.smithi099.stdout:4/771: dread d7/dd/d21/d26/d3f/d5b/f2c [0,4194304] 0 2024-09-17T01:02:03.605 INFO:tasks.workunit.client.1.smithi099.stdout:1/947: link d0/d8/fbe d0/d8/d38/f14b 0 2024-09-17T01:02:03.605 INFO:tasks.workunit.client.1.smithi099.stdout:1/948: write d0/d2/de/d12f/f148 [469088,54775] 0 2024-09-17T01:02:03.607 INFO:tasks.workunit.client.1.smithi099.stdout:4/772: mkdir d7/dd/de/d10/d6b/d10c 0 2024-09-17T01:02:03.607 INFO:tasks.workunit.client.1.smithi099.stdout:4/773: stat d7/le5 0 2024-09-17T01:02:03.608 INFO:tasks.workunit.client.1.smithi099.stdout:4/774: creat d7/dd/de/d10/d85/f10d x:0 0 0 2024-09-17T01:02:03.608 INFO:tasks.workunit.client.1.smithi099.stdout:4/775: truncate d7/dd/d21/d26/d3f/d5b/f37 4331602 0 2024-09-17T01:02:03.612 INFO:tasks.workunit.client.0.smithi002.stdout:7/806: rename d1/d14/d1d/d28/d6b/d9e/d5e/fcc to d1/d14/d1d/d28/d86/ffe 0 2024-09-17T01:02:03.615 INFO:tasks.workunit.client.1.smithi099.stdout:4/776: dread d7/dd/d21/d7b/fcc [0,4194304] 0 2024-09-17T01:02:03.616 INFO:tasks.workunit.client.1.smithi099.stdout:4/777: rename d7/d35/d98/lfa to d7/dd/d21/d26/d3f/l10e 0 2024-09-17T01:02:03.617 INFO:tasks.workunit.client.1.smithi099.stdout:1/949: dread d0/d8/d38/d75/fa9 [0,4194304] 0 2024-09-17T01:02:03.617 INFO:tasks.workunit.client.1.smithi099.stdout:1/950: creat d0/d8/d49/d94/d4b/d59/db9/dc7/f14c x:0 0 0 2024-09-17T01:02:03.619 INFO:tasks.workunit.client.1.smithi099.stdout:1/951: mknod d0/d8/d49/d94/c14d 0 2024-09-17T01:02:03.619 INFO:tasks.workunit.client.0.smithi002.stdout:6/815: dwrite d2/ff1 [0,4194304] 0 2024-09-17T01:02:03.620 INFO:tasks.workunit.client.0.smithi002.stdout:6/816: read d2/dc/d24/d53/d83/da9/f9a [2534787,20812] 0 2024-09-17T01:02:03.620 INFO:tasks.workunit.client.0.smithi002.stdout:6/817: chown d2/d1d/d2d/d5a/fef 25226233 1 2024-09-17T01:02:03.620 INFO:tasks.workunit.client.0.smithi002.stdout:1/807: dwrite d4/d22/d8d/fd5 [0,4194304] 0 2024-09-17T01:02:03.620 INFO:tasks.workunit.client.0.smithi002.stdout:7/807: write d1/d14/d67/dc0/dcd/f61 [2339222,6003] 0 2024-09-17T01:02:03.620 INFO:tasks.workunit.client.0.smithi002.stdout:3/684: dwrite d0/d3/d33/d40/fc9 [0,4194304] 0 2024-09-17T01:02:03.621 INFO:tasks.workunit.client.1.smithi099.stdout:1/952: creat d0/d2/de/d70/de8/dd6/d114/f14e x:0 0 0 2024-09-17T01:02:03.621 INFO:tasks.workunit.client.1.smithi099.stdout:1/953: write d0/d8/d49/d94/fd7 [896478,22710] 0 2024-09-17T01:02:03.621 INFO:tasks.workunit.client.0.smithi002.stdout:7/808: dread d1/d14/d1d/d28/d8f/de0/ff3 [0,4194304] 0 2024-09-17T01:02:03.625 INFO:tasks.workunit.client.0.smithi002.stdout:6/818: rename d2/d1d/d27/d87/da6 to d2/d1d/d2d/d35/d6d/d106/d109 0 2024-09-17T01:02:03.627 INFO:tasks.workunit.client.0.smithi002.stdout:1/808: creat d4/d11/d55/dbc/dff/f10f x:0 0 0 2024-09-17T01:02:03.628 INFO:tasks.workunit.client.1.smithi099.stdout:1/954: write d0/d8/d49/d94/d4b/d59/f87 [1236532,128347] 0 2024-09-17T01:02:03.629 INFO:tasks.workunit.client.0.smithi002.stdout:3/685: mkdir d0/d31/da7/ddd 0 2024-09-17T01:02:03.629 INFO:tasks.workunit.client.0.smithi002.stdout:3/686: stat d0/f61 0 2024-09-17T01:02:03.630 INFO:tasks.workunit.client.0.smithi002.stdout:6/819: truncate d2/d1d/d27/d30/fb7 991046 0 2024-09-17T01:02:03.630 INFO:tasks.workunit.client.0.smithi002.stdout:6/820: write d2/f4 [3331944,46875] 0 2024-09-17T01:02:03.630 INFO:tasks.workunit.client.0.smithi002.stdout:6/821: chown d2/d1d/d27/d30/d98 31 1 2024-09-17T01:02:03.631 INFO:tasks.workunit.client.1.smithi099.stdout:4/778: dwrite d7/d35/d98/fbf [0,4194304] 0 2024-09-17T01:02:03.631 INFO:tasks.workunit.client.0.smithi002.stdout:1/809: mknod d4/d11/d55/c110 0 2024-09-17T01:02:03.634 INFO:tasks.workunit.client.1.smithi099.stdout:4/779: symlink d7/dd/d21/d26/d3f/d5b/da4/l10f 0 2024-09-17T01:02:03.634 INFO:tasks.workunit.client.0.smithi002.stdout:6/822: rename d2/d1d/d2d/d35/dc1/lf2 to d2/d1d/d2d/d73/dff/l10a 0 2024-09-17T01:02:03.634 INFO:tasks.workunit.client.0.smithi002.stdout:6/823: truncate d2/dc/f8a 1015222 0 2024-09-17T01:02:03.635 INFO:tasks.workunit.client.0.smithi002.stdout:1/810: mknod d4/d11/d12/d14/d17/d51/d88/da3/c111 0 2024-09-17T01:02:03.635 INFO:tasks.workunit.client.1.smithi099.stdout:4/780: rename d7/dd/de/d17/d72 to d7/dd/d92/d110 0 2024-09-17T01:02:03.636 INFO:tasks.workunit.client.0.smithi002.stdout:1/811: readlink d4/d22/lf2 0 2024-09-17T01:02:03.636 INFO:tasks.workunit.client.1.smithi099.stdout:4/781: creat d7/dd/d21/d7b/d74/f111 x:0 0 0 2024-09-17T01:02:03.637 INFO:tasks.workunit.client.1.smithi099.stdout:4/782: write d7/dd/de/d10/fc4 [349683,33536] 0 2024-09-17T01:02:03.637 INFO:tasks.workunit.client.0.smithi002.stdout:6/824: link d2/dc/lf d2/d1d/d27/d87/d94/l10b 0 2024-09-17T01:02:03.638 INFO:tasks.workunit.client.0.smithi002.stdout:1/812: rename d4/d11/d12/d30/d43/d67/f98 to d4/d11/f112 0 2024-09-17T01:02:03.639 INFO:tasks.workunit.client.0.smithi002.stdout:1/813: readlink d4/d11/d12/d30/d43/d67/l10a 0 2024-09-17T01:02:03.639 INFO:tasks.workunit.client.0.smithi002.stdout:6/825: creat d2/d1d/d2d/d35/d6d/f10c x:0 0 0 2024-09-17T01:02:03.640 INFO:tasks.workunit.client.1.smithi099.stdout:4/783: symlink d7/d35/d98/l112 0 2024-09-17T01:02:03.640 INFO:tasks.workunit.client.1.smithi099.stdout:4/784: chown d7/dd/d21/d7b/d4b/dcb 12336650 1 2024-09-17T01:02:03.640 INFO:tasks.workunit.client.1.smithi099.stdout:1/955: dread d0/d2/de/d70/de8/fab [4194304,4194304] 0 2024-09-17T01:02:03.640 INFO:tasks.workunit.client.1.smithi099.stdout:1/956: stat d0/d2/dd8/d109/f113 0 2024-09-17T01:02:03.640 INFO:tasks.workunit.client.1.smithi099.stdout:1/957: readlink d0/d8/d49/d94/l10f 0 2024-09-17T01:02:03.641 INFO:tasks.workunit.client.0.smithi002.stdout:1/814: creat d4/d11/d12/d30/d5e/df1/f113 x:0 0 0 2024-09-17T01:02:03.641 INFO:tasks.workunit.client.1.smithi099.stdout:4/785: creat d7/dd/de/d10/d6b/d82/d8a/d9a/f113 x:0 0 0 2024-09-17T01:02:03.641 INFO:tasks.workunit.client.0.smithi002.stdout:6/826: mkdir d2/d1d/d2d/d35/d79/da8/d10d 0 2024-09-17T01:02:03.642 INFO:tasks.workunit.client.0.smithi002.stdout:6/827: chown d2/d1d/d27/d30/ff6 759138 1 2024-09-17T01:02:03.643 INFO:tasks.workunit.client.1.smithi099.stdout:1/958: stat d0/d8/d38/d8a/dd0/ddc/dfc/c12e 0 2024-09-17T01:02:03.643 INFO:tasks.workunit.client.1.smithi099.stdout:1/959: stat d0/de2/f100 0 2024-09-17T01:02:03.643 INFO:tasks.workunit.client.0.smithi002.stdout:6/828: symlink d2/d1d/d2d/d35/dc1/l10e 0 2024-09-17T01:02:03.643 INFO:tasks.workunit.client.0.smithi002.stdout:1/815: getdents d4/d11/d1a/daa/dbb 0 2024-09-17T01:02:03.644 INFO:tasks.workunit.client.0.smithi002.stdout:6/829: mknod d2/d95/c10f 0 2024-09-17T01:02:03.645 INFO:tasks.workunit.client.0.smithi002.stdout:6/830: creat d2/d1d/d26/d49/d7d/f110 x:0 0 0 2024-09-17T01:02:03.645 INFO:tasks.workunit.client.1.smithi099.stdout:4/786: link d7/dd/d21/d26/d3f/d5b/le4 d7/dbc/l114 0 2024-09-17T01:02:03.645 INFO:tasks.workunit.client.1.smithi099.stdout:1/960: fsync d0/d2/de/d8b/da7/fe5 0 2024-09-17T01:02:03.646 INFO:tasks.workunit.client.0.smithi002.stdout:3/687: dwrite d0/d3/d17/f6d [0,4194304] 0 2024-09-17T01:02:03.646 INFO:tasks.workunit.client.0.smithi002.stdout:6/831: symlink d2/d1d/d27/d80/l111 0 2024-09-17T01:02:03.647 INFO:tasks.workunit.client.1.smithi099.stdout:4/787: mkdir d7/dd/d21/d26/d3f/d5b/d115 0 2024-09-17T01:02:03.647 INFO:tasks.workunit.client.1.smithi099.stdout:4/788: write d7/dd/de/d10/d85/fe7 [801106,91262] 0 2024-09-17T01:02:03.647 INFO:tasks.workunit.client.1.smithi099.stdout:4/789: dread - d7/dd/d21/d26/d3f/d5b/da4/ff0 zero size 2024-09-17T01:02:03.649 INFO:tasks.workunit.client.0.smithi002.stdout:5/716: sync 2024-09-17T01:02:03.649 INFO:tasks.workunit.client.0.smithi002.stdout:4/886: sync 2024-09-17T01:02:03.649 INFO:tasks.workunit.client.0.smithi002.stdout:0/665: sync 2024-09-17T01:02:03.649 INFO:tasks.workunit.client.0.smithi002.stdout:8/941: sync 2024-09-17T01:02:03.650 INFO:tasks.workunit.client.0.smithi002.stdout:8/942: chown d2/d26/dbb/fde 199449 1 2024-09-17T01:02:03.650 INFO:tasks.workunit.client.1.smithi099.stdout:1/961: link d0/d8/d49/d94/de0/l66 d0/d8/d38/d56/l14f 0 2024-09-17T01:02:03.650 INFO:tasks.workunit.client.1.smithi099.stdout:1/962: creat d0/d8/d49/d94/d4b/d59/db9/dc8/f150 x:0 0 0 2024-09-17T01:02:03.652 INFO:tasks.workunit.client.1.smithi099.stdout:0/804: truncate da/df/d31/f4c 61931 0 2024-09-17T01:02:03.653 INFO:tasks.workunit.client.0.smithi002.stdout:5/717: truncate d2/d2d/f17 596592 0 2024-09-17T01:02:03.654 INFO:tasks.workunit.client.1.smithi099.stdout:0/805: symlink da/df/d1a/d70/l102 0 2024-09-17T01:02:03.658 INFO:tasks.workunit.client.0.smithi002.stdout:6/832: dread d2/f18 [0,4194304] 0 2024-09-17T01:02:03.658 INFO:tasks.workunit.client.0.smithi002.stdout:6/833: truncate d2/d1d/d2d/d35/d6d/dd6/fdc 204388 0 2024-09-17T01:02:03.660 INFO:tasks.workunit.client.1.smithi099.stdout:1/963: dread d0/d2/de/d8b/f7f [0,4194304] 0 2024-09-17T01:02:03.660 INFO:tasks.workunit.client.0.smithi002.stdout:4/887: read d7/d19/f21 [7575878,5157] 0 2024-09-17T01:02:03.661 INFO:tasks.workunit.client.1.smithi099.stdout:1/964: creat d0/de2/f151 x:0 0 0 2024-09-17T01:02:03.661 INFO:tasks.workunit.client.1.smithi099.stdout:1/965: write d0/d8/d49/d94/de0/dba/f143 [119268,78102] 0 2024-09-17T01:02:03.662 INFO:tasks.workunit.client.1.smithi099.stdout:6/808: sync 2024-09-17T01:02:03.662 INFO:tasks.workunit.client.1.smithi099.stdout:8/801: sync 2024-09-17T01:02:03.662 INFO:tasks.workunit.client.1.smithi099.stdout:6/809: write dc/d27/d7e/f89 [2184990,101093] 0 2024-09-17T01:02:03.662 INFO:tasks.workunit.client.1.smithi099.stdout:6/810: creat dc/d1a/d49/da8/f114 x:0 0 0 2024-09-17T01:02:03.662 INFO:tasks.workunit.client.1.smithi099.stdout:1/966: dread d0/d8/d49/d94/de0/f58 [0,4194304] 0 2024-09-17T01:02:03.662 INFO:tasks.workunit.client.1.smithi099.stdout:1/967: chown d0/d8/d49/d94/f6f 102 1 2024-09-17T01:02:03.663 INFO:tasks.workunit.client.1.smithi099.stdout:4/790: dread d7/dd/de/d10/d85/fa0 [0,4194304] 0 2024-09-17T01:02:03.664 INFO:tasks.workunit.client.0.smithi002.stdout:4/888: rmdir d7/d19/d9f/d80/d62/dbe 39 2024-09-17T01:02:03.664 INFO:tasks.workunit.client.0.smithi002.stdout:0/666: dread dd/d19/d1c/d33/f7b [0,4194304] 0 2024-09-17T01:02:03.664 INFO:tasks.workunit.client.0.smithi002.stdout:0/667: chown dd/d19/d1c/f8a 941 1 2024-09-17T01:02:03.664 INFO:tasks.workunit.client.1.smithi099.stdout:0/806: dread da/d12/d2b/fa8 [0,4194304] 0 2024-09-17T01:02:03.667 INFO:tasks.workunit.client.0.smithi002.stdout:4/889: unlink d7/d19/d9c/de9/da4/lb4 0 2024-09-17T01:02:03.667 INFO:tasks.workunit.client.0.smithi002.stdout:0/668: dread dd/d19/d1c/d33/d67/f7f [0,4194304] 0 2024-09-17T01:02:03.670 INFO:tasks.workunit.client.0.smithi002.stdout:1/816: dwrite d4/d11/d1c/f66 [0,4194304] 0 2024-09-17T01:02:03.670 INFO:tasks.workunit.client.0.smithi002.stdout:1/817: fsync d4/d22/d8d/f105 0 2024-09-17T01:02:03.670 INFO:tasks.workunit.client.0.smithi002.stdout:1/818: chown d4/d11/d12/d14/l108 236453 1 2024-09-17T01:02:03.670 INFO:tasks.workunit.client.0.smithi002.stdout:1/819: readlink d4/d11/d12/d14/l108 0 2024-09-17T01:02:03.670 INFO:tasks.workunit.client.0.smithi002.stdout:1/820: truncate d4/d11/d55/d7a/fa5 283131 0 2024-09-17T01:02:03.670 INFO:tasks.workunit.client.0.smithi002.stdout:1/821: stat d4/d22/d8d 0 2024-09-17T01:02:03.670 INFO:tasks.workunit.client.0.smithi002.stdout:1/822: write d4/d11/d55/f65 [182188,39284] 0 2024-09-17T01:02:03.671 INFO:tasks.workunit.client.0.smithi002.stdout:0/669: mkdir dd/d19/d1c/d1f/d22/dde 0 2024-09-17T01:02:03.673 INFO:tasks.workunit.client.0.smithi002.stdout:0/670: truncate dd/d19/d1c/f8a 2427747 0 2024-09-17T01:02:03.674 INFO:tasks.workunit.client.0.smithi002.stdout:0/671: rmdir dd/d19/d1c/d33 39 2024-09-17T01:02:03.679 INFO:tasks.workunit.client.1.smithi099.stdout:8/802: symlink d0/d1f/d31/d4c/l107 0 2024-09-17T01:02:03.680 INFO:tasks.workunit.client.1.smithi099.stdout:1/968: symlink d0/d8/d49/d94/d4b/d59/db9/l152 0 2024-09-17T01:02:03.680 INFO:tasks.workunit.client.1.smithi099.stdout:4/791: truncate d7/f8 860057 0 2024-09-17T01:02:03.681 INFO:tasks.workunit.client.1.smithi099.stdout:4/792: read d7/dd/f79 [428899,73795] 0 2024-09-17T01:02:03.681 INFO:tasks.workunit.client.1.smithi099.stdout:4/793: chown d7/dd/d21/d26/d3f/d5b/da4/l10f 410 1 2024-09-17T01:02:03.682 INFO:tasks.workunit.client.1.smithi099.stdout:6/811: unlink dc/d1a/c97 0 2024-09-17T01:02:03.685 INFO:tasks.workunit.client.1.smithi099.stdout:1/969: unlink d0/d8/d49/d94/d4b/d59/db9/feb 0 2024-09-17T01:02:03.686 INFO:tasks.workunit.client.1.smithi099.stdout:6/812: chown dc/d1a/l1f 3 1 2024-09-17T01:02:03.686 INFO:tasks.workunit.client.1.smithi099.stdout:6/813: creat dc/d2b/f115 x:0 0 0 2024-09-17T01:02:03.688 INFO:tasks.workunit.client.0.smithi002.stdout:1/823: write d4/d11/d12/d14/d17/d51/f74 [8148139,80723] 0 2024-09-17T01:02:03.688 INFO:tasks.workunit.client.1.smithi099.stdout:6/814: creat dc/d5d/dae/d96/d60/d106/f116 x:0 0 0 2024-09-17T01:02:03.690 INFO:tasks.workunit.client.0.smithi002.stdout:1/824: creat d4/d11/d12/d14/d17/ddb/df9/f114 x:0 0 0 2024-09-17T01:02:03.690 INFO:tasks.workunit.client.0.smithi002.stdout:1/825: chown d4/d11/d55/fb2 703 1 2024-09-17T01:02:03.692 INFO:tasks.workunit.client.0.smithi002.stdout:1/826: rename d4/d11/d12/d23/l2a to d4/d11/d1c/l115 0 2024-09-17T01:02:03.693 INFO:tasks.workunit.client.0.smithi002.stdout:1/827: getdents d4/d11/d55/d7a 0 2024-09-17T01:02:03.694 INFO:tasks.workunit.client.0.smithi002.stdout:1/828: creat d4/d11/d12/d30/d5e/d8c/f116 x:0 0 0 2024-09-17T01:02:03.694 INFO:tasks.workunit.client.0.smithi002.stdout:1/829: fdatasync d4/d11/f71 0 2024-09-17T01:02:03.695 INFO:tasks.workunit.client.1.smithi099.stdout:0/807: dwrite da/df/d20/f83 [0,4194304] 0 2024-09-17T01:02:03.695 INFO:tasks.workunit.client.0.smithi002.stdout:0/672: write dd/d19/d1c/d1f/d76/f80 [4114840,44806] 0 2024-09-17T01:02:03.695 INFO:tasks.workunit.client.0.smithi002.stdout:0/673: chown dd/d3d/d94/dd1/fd6 981468 1 2024-09-17T01:02:03.696 INFO:tasks.workunit.client.0.smithi002.stdout:8/943: dwrite d2/d9/dd/fe8 [0,4194304] 0 2024-09-17T01:02:03.697 INFO:tasks.workunit.client.0.smithi002.stdout:0/674: mknod dd/d19/d1c/d33/d67/d68/d9d/dbe/cdf 0 2024-09-17T01:02:03.699 INFO:tasks.workunit.client.0.smithi002.stdout:8/944: creat d2/d1c/d28/dad/dcd/dd1/ddb/d10f/dfd/f131 x:0 0 0 2024-09-17T01:02:03.699 INFO:tasks.workunit.client.0.smithi002.stdout:8/945: write d2/d1c/dd4/f12b [658486,69566] 0 2024-09-17T01:02:03.699 INFO:tasks.workunit.client.0.smithi002.stdout:8/946: chown d2/d1c/d28/dad/dcd/dd1/ce7 163 1 2024-09-17T01:02:03.699 INFO:tasks.workunit.client.0.smithi002.stdout:8/947: creat d2/d1c/d28/dad/dcd/dd1/ddb/d10f/dfd/f132 x:0 0 0 2024-09-17T01:02:03.700 INFO:tasks.workunit.client.0.smithi002.stdout:0/675: mknod dd/d19/d1c/d1f/dc4/ce0 0 2024-09-17T01:02:03.702 INFO:tasks.workunit.client.0.smithi002.stdout:8/948: dread d2/d1c/d28/f55 [0,4194304] 0 2024-09-17T01:02:03.702 INFO:tasks.workunit.client.0.smithi002.stdout:0/676: write dd/d19/d1a/d29/d55/d61/f6c [364866,105699] 0 2024-09-17T01:02:03.708 INFO:tasks.workunit.client.1.smithi099.stdout:0/808: dread f9 [0,4194304] 0 2024-09-17T01:02:03.708 INFO:tasks.workunit.client.1.smithi099.stdout:0/809: stat da/df/d1a/d56/fc5 0 2024-09-17T01:02:03.709 INFO:tasks.workunit.client.0.smithi002.stdout:8/949: write d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/f65 [3675399,115757] 0 2024-09-17T01:02:03.716 INFO:tasks.workunit.client.1.smithi099.stdout:8/803: dwrite d0/d1f/d31/f7b [0,4194304] 0 2024-09-17T01:02:03.719 INFO:tasks.workunit.client.1.smithi099.stdout:1/970: dwrite d0/d8/d38/d75/f9b [0,4194304] 0 2024-09-17T01:02:03.721 INFO:tasks.workunit.client.0.smithi002.stdout:0/677: dread dd/d19/f4e [0,4194304] 0 2024-09-17T01:02:03.723 INFO:tasks.workunit.client.0.smithi002.stdout:5/718: dwrite d2/d2d/d10/d14/d19/d39/d64/fb6 [0,4194304] 0 2024-09-17T01:02:03.723 INFO:tasks.workunit.client.0.smithi002.stdout:6/834: dwrite d2/d1d/d27/d80/d93/dd5/d5c/f91 [0,4194304] 0 2024-09-17T01:02:03.723 INFO:tasks.workunit.client.1.smithi099.stdout:0/810: read da/df/d1a/d49/dac/f3c [1127173,33021] 0 2024-09-17T01:02:03.724 INFO:tasks.workunit.client.0.smithi002.stdout:0/678: rename dd/d19/d1a/f96 to dd/d3d/d94/dd1/fe1 0 2024-09-17T01:02:03.727 INFO:tasks.workunit.client.0.smithi002.stdout:5/719: mknod d2/de/d1d/ce7 0 2024-09-17T01:02:03.729 INFO:tasks.workunit.client.0.smithi002.stdout:8/950: dwrite d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d77/d78/f130 [0,4194304] 0 2024-09-17T01:02:03.733 INFO:tasks.workunit.client.0.smithi002.stdout:0/679: mknod dd/d19/d1a/d29/ce2 0 2024-09-17T01:02:03.735 INFO:tasks.workunit.client.0.smithi002.stdout:5/720: mkdir d2/d2d/d10/d9b/de8 0 2024-09-17T01:02:03.743 INFO:tasks.workunit.client.0.smithi002.stdout:0/680: rmdir dd/d19/d1c/d33/ddb 0 2024-09-17T01:02:03.743 INFO:tasks.workunit.client.0.smithi002.stdout:0/681: chown dd/d19/f6f 2 1 2024-09-17T01:02:03.743 INFO:tasks.workunit.client.0.smithi002.stdout:5/721: creat d2/d2d/d10/d20/d24/fe9 x:0 0 0 2024-09-17T01:02:03.745 INFO:tasks.workunit.client.0.smithi002.stdout:0/682: rename dd/d19/d1a/dbc to dd/d19/d1c/d33/de3 0 2024-09-17T01:02:03.745 INFO:tasks.workunit.client.0.smithi002.stdout:0/683: write dd/d19/d1c/db7/f6e [351036,82426] 0 2024-09-17T01:02:03.747 INFO:tasks.workunit.client.0.smithi002.stdout:0/684: rename dd/d19/d1c/d33/f7b to dd/d19/fe4 0 2024-09-17T01:02:03.748 INFO:tasks.workunit.client.0.smithi002.stdout:6/835: dwrite d2/d1d/d2d/d5a/d71/d7e/f86 [0,4194304] 0 2024-09-17T01:02:03.748 INFO:tasks.workunit.client.0.smithi002.stdout:8/951: dwrite d2/d41/fe3 [0,4194304] 0 2024-09-17T01:02:03.749 INFO:tasks.workunit.client.0.smithi002.stdout:0/685: rename dd/d19/d1c/d33/d67 to dd/d19/da9/de5 0 2024-09-17T01:02:03.752 INFO:tasks.workunit.client.0.smithi002.stdout:5/722: dread d2/d2d/d10/d14/d19/d39/d43/f2a [0,4194304] 0 2024-09-17T01:02:03.752 INFO:tasks.workunit.client.0.smithi002.stdout:8/952: mkdir d2/d9/d9c/d133 0 2024-09-17T01:02:03.752 INFO:tasks.workunit.client.0.smithi002.stdout:5/723: chown d2/d2d/d10/d23/d6e/fc1 3 1 2024-09-17T01:02:03.752 INFO:tasks.workunit.client.0.smithi002.stdout:5/724: fsync d2/f54 0 2024-09-17T01:02:03.752 INFO:tasks.workunit.client.0.smithi002.stdout:5/725: dread - d2/d2d/d10/d14/d19/da5/db0/d33/fd7 zero size 2024-09-17T01:02:03.752 INFO:tasks.workunit.client.0.smithi002.stdout:5/726: fdatasync d2/d2d/d10/d20/d24/f77 0 2024-09-17T01:02:03.757 INFO:tasks.workunit.client.0.smithi002.stdout:0/686: unlink dd/d19/d1a/d29/d55/d56/la6 0 2024-09-17T01:02:03.758 INFO:tasks.workunit.client.0.smithi002.stdout:8/953: truncate d2/d1c/d28/da0/f124 4152242 0 2024-09-17T01:02:03.758 INFO:tasks.workunit.client.0.smithi002.stdout:8/954: read - d2/d9/f107 zero size 2024-09-17T01:02:03.758 INFO:tasks.workunit.client.0.smithi002.stdout:5/727: creat d2/d2d/d10/d14/d19/d39/d51/fea x:0 0 0 2024-09-17T01:02:03.758 INFO:tasks.workunit.client.0.smithi002.stdout:0/687: truncate dd/d19/f4e 909640 0 2024-09-17T01:02:03.760 INFO:tasks.workunit.client.0.smithi002.stdout:8/955: creat d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/f134 x:0 0 0 2024-09-17T01:02:03.761 INFO:tasks.workunit.client.0.smithi002.stdout:8/956: chown d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d77/d78/fc5 2 1 2024-09-17T01:02:03.761 INFO:tasks.workunit.client.0.smithi002.stdout:8/957: chown d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d77 3416 1 2024-09-17T01:02:03.761 INFO:tasks.workunit.client.0.smithi002.stdout:8/958: creat d2/d30/f135 x:0 0 0 2024-09-17T01:02:03.764 INFO:tasks.workunit.client.0.smithi002.stdout:8/959: mknod d2/c136 0 2024-09-17T01:02:03.764 INFO:tasks.workunit.client.0.smithi002.stdout:8/960: write d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d71/d89/ff9 [1031708,23085] 0 2024-09-17T01:02:03.766 INFO:tasks.workunit.client.1.smithi099.stdout:8/804: creat d0/d1f/d90/db8/dde/d29/d4b/db3/de9/f108 x:0 0 0 2024-09-17T01:02:03.768 INFO:tasks.workunit.client.1.smithi099.stdout:1/971: symlink d0/d8/d38/d8a/d120/l153 0 2024-09-17T01:02:03.769 INFO:tasks.workunit.client.1.smithi099.stdout:1/972: chown d0/de2/f100 5778384 1 2024-09-17T01:02:03.769 INFO:tasks.workunit.client.1.smithi099.stdout:0/811: mknod da/d12/d2b/dab/c103 0 2024-09-17T01:02:03.770 INFO:tasks.workunit.client.0.smithi002.stdout:5/728: dread d2/d2d/d10/d14/d19/da5/db0/d33/f7c [0,4194304] 0 2024-09-17T01:02:03.770 INFO:tasks.workunit.client.0.smithi002.stdout:6/836: dwrite d2/d1d/d27/d30/fdf [0,4194304] 0 2024-09-17T01:02:03.773 INFO:tasks.workunit.client.1.smithi099.stdout:1/973: creat d0/d2/de/d31/f154 x:0 0 0 2024-09-17T01:02:03.773 INFO:tasks.workunit.client.0.smithi002.stdout:8/961: read d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/fd8 [2920998,63500] 0 2024-09-17T01:02:03.773 INFO:tasks.workunit.client.0.smithi002.stdout:8/962: chown d2/d1c/d28/dad 20777 1 2024-09-17T01:02:03.773 INFO:tasks.workunit.client.0.smithi002.stdout:6/837: creat d2/d1d/d2d/d35/d79/de6/f112 x:0 0 0 2024-09-17T01:02:03.776 INFO:tasks.workunit.client.0.smithi002.stdout:8/963: unlink d2/d1c/d28/dad/dcd/dd1/ddb/d10f/de6/ffa 0 2024-09-17T01:02:03.776 INFO:tasks.workunit.client.0.smithi002.stdout:5/729: write d2/d2d/d10/d14/fda [2530254,33991] 0 2024-09-17T01:02:03.776 INFO:tasks.workunit.client.0.smithi002.stdout:8/964: read d2/d1c/d28/dad/dcd/dd1/ddb/d10f/f6e [672492,4408] 0 2024-09-17T01:02:03.776 INFO:tasks.workunit.client.0.smithi002.stdout:5/730: chown d2/d2d/d10/d20/d24/f7a 14776871 1 2024-09-17T01:02:03.776 INFO:tasks.workunit.client.0.smithi002.stdout:8/965: write d2/d1c/d28/dad/dcd/dd1/ddb/d10f/de6/f10e [705631,56807] 0 2024-09-17T01:02:03.776 INFO:tasks.workunit.client.0.smithi002.stdout:0/688: dwrite dd/d19/d1c/d1f/f77 [0,4194304] 0 2024-09-17T01:02:03.777 INFO:tasks.workunit.client.1.smithi099.stdout:1/974: mknod d0/d8/d49/d94/de0/dba/c155 0 2024-09-17T01:02:03.777 INFO:tasks.workunit.client.0.smithi002.stdout:6/838: creat d2/d1d/d27/f113 x:0 0 0 2024-09-17T01:02:03.777 INFO:tasks.workunit.client.0.smithi002.stdout:8/966: write d2/d1c/d28/dad/dcd/dd1/ddb/d10f/f1b [863848,50441] 0 2024-09-17T01:02:03.778 INFO:tasks.workunit.client.1.smithi099.stdout:6/815: write dc/f21 [4792066,6194] 0 2024-09-17T01:02:03.778 INFO:tasks.workunit.client.1.smithi099.stdout:1/975: truncate d0/d8/d49/d94/de0/fe7 450543 0 2024-09-17T01:02:03.779 INFO:tasks.workunit.client.1.smithi099.stdout:1/976: fdatasync d0/d2/d18/f11e 0 2024-09-17T01:02:03.779 INFO:tasks.workunit.client.1.smithi099.stdout:1/977: chown d0/d8/d49/f82 10685763 1 2024-09-17T01:02:03.779 INFO:tasks.workunit.client.1.smithi099.stdout:1/978: chown d0/d8/d38/d56/lf1 1098550 1 2024-09-17T01:02:03.780 INFO:tasks.workunit.client.1.smithi099.stdout:8/805: write d0/d1f/d55/f7e [795464,58282] 0 2024-09-17T01:02:03.780 INFO:tasks.workunit.client.1.smithi099.stdout:8/806: creat d0/d53/f109 x:0 0 0 2024-09-17T01:02:03.780 INFO:tasks.workunit.client.1.smithi099.stdout:8/807: write d0/d41/d5a/fa3 [452637,1370] 0 2024-09-17T01:02:03.781 INFO:tasks.workunit.client.1.smithi099.stdout:0/812: rename da/df/d1a/d63/d6a/dd9 to da/df/d1a/d49/dac/d92/de4/d104 0 2024-09-17T01:02:03.782 INFO:tasks.workunit.client.0.smithi002.stdout:8/967: dread d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d71/d89/fa8 [0,4194304] 0 2024-09-17T01:02:03.782 INFO:tasks.workunit.client.1.smithi099.stdout:6/816: mknod dc/c117 0 2024-09-17T01:02:03.783 INFO:tasks.workunit.client.1.smithi099.stdout:3/782: sync 2024-09-17T01:02:03.783 INFO:tasks.workunit.client.1.smithi099.stdout:3/783: fsync d9/f25 0 2024-09-17T01:02:03.783 INFO:tasks.workunit.client.1.smithi099.stdout:8/808: dread d0/d1f/d90/db8/dde/d29/f8e [0,4194304] 0 2024-09-17T01:02:03.783 INFO:tasks.workunit.client.1.smithi099.stdout:8/809: creat d0/d1f/d90/db8/dde/d29/f10a x:0 0 0 2024-09-17T01:02:03.786 INFO:tasks.workunit.client.0.smithi002.stdout:0/689: rename dd/d3d/cd0 to dd/d19/d1c/d1f/d76/ce6 0 2024-09-17T01:02:03.786 INFO:tasks.workunit.client.0.smithi002.stdout:0/690: write dd/d19/fe4 [898441,97380] 0 2024-09-17T01:02:03.787 INFO:tasks.workunit.client.1.smithi099.stdout:1/979: rename d0/d2/de/d8b/da7/d98/l11d to d0/d8/d38/d8a/d112/d11b/l156 0 2024-09-17T01:02:03.787 INFO:tasks.workunit.client.0.smithi002.stdout:5/731: getdents d2/de 0 2024-09-17T01:02:03.788 INFO:tasks.workunit.client.1.smithi099.stdout:0/813: creat da/d12/d2b/dab/f105 x:0 0 0 2024-09-17T01:02:03.790 INFO:tasks.workunit.client.1.smithi099.stdout:6/817: symlink dc/d5d/l118 0 2024-09-17T01:02:03.791 INFO:tasks.workunit.client.0.smithi002.stdout:0/691: symlink dd/d19/d1c/d1f/d39/le7 0 2024-09-17T01:02:03.791 INFO:tasks.workunit.client.0.smithi002.stdout:2/770: sync 2024-09-17T01:02:03.791 INFO:tasks.workunit.client.0.smithi002.stdout:2/771: getdents d1b/d3f/d59/d7f/dc9/dac/dbd/dc3/def 0 2024-09-17T01:02:03.791 INFO:tasks.workunit.client.0.smithi002.stdout:2/772: creat d1b/d37/d48/d78/f117 x:0 0 0 2024-09-17T01:02:03.791 INFO:tasks.workunit.client.1.smithi099.stdout:1/980: dread d0/d8c/f99 [0,4194304] 0 2024-09-17T01:02:03.791 INFO:tasks.workunit.client.1.smithi099.stdout:1/981: chown d0/dbc 1593460 1 2024-09-17T01:02:03.793 INFO:tasks.workunit.client.0.smithi002.stdout:5/732: creat d2/d2d/d10/d23/d6a/feb x:0 0 0 2024-09-17T01:02:03.793 INFO:tasks.workunit.client.0.smithi002.stdout:5/733: chown d2/d2d/f13 916866443 1 2024-09-17T01:02:03.793 INFO:tasks.workunit.client.0.smithi002.stdout:5/734: truncate d2/d2d/d10/d23/d6e/fc1 206561 0 2024-09-17T01:02:03.793 INFO:tasks.workunit.client.0.smithi002.stdout:6/839: dwrite d2/d1d/d27/d80/d93/dd5/d5c/dc9/fc7 [0,4194304] 0 2024-09-17T01:02:03.793 INFO:tasks.workunit.client.0.smithi002.stdout:0/692: mknod dd/d19/da9/de5/d68/ce8 0 2024-09-17T01:02:03.793 INFO:tasks.workunit.client.1.smithi099.stdout:3/784: truncate d9/d3b/d44/f6d 506806 0 2024-09-17T01:02:03.794 INFO:tasks.workunit.client.0.smithi002.stdout:2/773: dread d1b/d37/d48/d52/de6/f8d [0,4194304] 0 2024-09-17T01:02:03.795 INFO:tasks.workunit.client.0.smithi002.stdout:8/968: dread d2/d41/fe3 [0,4194304] 0 2024-09-17T01:02:03.796 INFO:tasks.workunit.client.0.smithi002.stdout:8/969: write d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d58/fbc [546975,39594] 0 2024-09-17T01:02:03.796 INFO:tasks.workunit.client.0.smithi002.stdout:8/970: fdatasync d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d77/db0/fda 0 2024-09-17T01:02:03.801 INFO:tasks.workunit.client.0.smithi002.stdout:6/840: getdents d2/d1d/d99 0 2024-09-17T01:02:03.803 INFO:tasks.workunit.client.0.smithi002.stdout:2/774: rename d1b/d37/d48/d78/d112 to d1b/d74/d93/d118 0 2024-09-17T01:02:03.803 INFO:tasks.workunit.client.1.smithi099.stdout:3/785: mkdir d9/d2b/d6b/df2 0 2024-09-17T01:02:03.804 INFO:tasks.workunit.client.0.smithi002.stdout:2/775: dread d1b/d1d/f98 [0,4194304] 0 2024-09-17T01:02:03.804 INFO:tasks.workunit.client.0.smithi002.stdout:8/971: mkdir d2/d1c/d3b/d137 0 2024-09-17T01:02:03.805 INFO:tasks.workunit.client.1.smithi099.stdout:6/818: write dc/d2b/fa6 [2112414,103312] 0 2024-09-17T01:02:03.806 INFO:tasks.workunit.client.0.smithi002.stdout:6/841: creat d2/dc/d24/d53/d9e/f114 x:0 0 0 2024-09-17T01:02:03.806 INFO:tasks.workunit.client.1.smithi099.stdout:3/786: dread d9/d15/d18/d1a/d23/d5c/d6e/f96 [0,4194304] 0 2024-09-17T01:02:03.809 INFO:tasks.workunit.client.0.smithi002.stdout:2/776: rmdir d1b/d37/dc1 39 2024-09-17T01:02:03.809 INFO:tasks.workunit.client.0.smithi002.stdout:2/777: dread - d1b/d1d/dc8/fcd zero size 2024-09-17T01:02:03.810 INFO:tasks.workunit.client.1.smithi099.stdout:0/814: dwrite da/df/d31/db0/d1e/f9d [0,4194304] 0 2024-09-17T01:02:03.811 INFO:tasks.workunit.client.0.smithi002.stdout:8/972: creat d2/d9/d9c/d133/f138 x:0 0 0 2024-09-17T01:02:03.811 INFO:tasks.workunit.client.0.smithi002.stdout:8/973: chown d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/cd6 56978 1 2024-09-17T01:02:03.811 INFO:tasks.workunit.client.0.smithi002.stdout:8/974: write d2/d26/f69 [5173735,9931] 0 2024-09-17T01:02:03.812 INFO:tasks.workunit.client.0.smithi002.stdout:6/842: creat d2/d1d/d2d/d5a/d71/f115 x:0 0 0 2024-09-17T01:02:03.814 INFO:tasks.workunit.client.0.smithi002.stdout:8/975: creat d2/d26/f139 x:0 0 0 2024-09-17T01:02:03.815 INFO:tasks.workunit.client.0.smithi002.stdout:6/843: symlink d2/d1d/d2d/d35/d6d/dd6/l116 0 2024-09-17T01:02:03.818 INFO:tasks.workunit.client.0.smithi002.stdout:6/844: mknod d2/d1d/d27/d87/d94/c117 0 2024-09-17T01:02:03.819 INFO:tasks.workunit.client.1.smithi099.stdout:3/787: write d9/d3b/fe2 [1451534,31720] 0 2024-09-17T01:02:03.819 INFO:tasks.workunit.client.1.smithi099.stdout:3/788: rename d9/d15/d18/d1a to d9/d15/d18/d1a/d23/d5c/df3 22 2024-09-17T01:02:03.819 INFO:tasks.workunit.client.1.smithi099.stdout:3/789: chown d9/d3b/lb7 1 1 2024-09-17T01:02:03.819 INFO:tasks.workunit.client.1.smithi099.stdout:0/815: rmdir da/df/d1a/d56 39 2024-09-17T01:02:03.824 INFO:tasks.workunit.client.0.smithi002.stdout:0/693: dwrite dd/d3d/f3f [0,4194304] 0 2024-09-17T01:02:03.824 INFO:tasks.workunit.client.0.smithi002.stdout:0/694: write dd/f14 [2710939,45007] 0 2024-09-17T01:02:03.824 INFO:tasks.workunit.client.1.smithi099.stdout:0/816: rename da/df/d1a/d49/d68/d9f/lbc to da/df/d1a/d49/dac/d92/de4/l106 0 2024-09-17T01:02:03.825 INFO:tasks.workunit.client.0.smithi002.stdout:5/735: dwrite d2/d2d/d10/d20/d24/f31 [4194304,4194304] 0 2024-09-17T01:02:03.825 INFO:tasks.workunit.client.0.smithi002.stdout:0/695: unlink dd/l20 0 2024-09-17T01:02:03.826 INFO:tasks.workunit.client.1.smithi099.stdout:3/790: link d9/d15/d18/d1a/d23/l9d d9/d15/d18/d1a/d23/d5c/d99/dd8/ded/lf4 0 2024-09-17T01:02:03.827 INFO:tasks.workunit.client.0.smithi002.stdout:0/696: dread dd/d19/d1c/f79 [0,4194304] 0 2024-09-17T01:02:03.827 INFO:tasks.workunit.client.1.smithi099.stdout:0/817: symlink da/d12/d22/d66/l107 0 2024-09-17T01:02:03.828 INFO:tasks.workunit.client.0.smithi002.stdout:0/697: creat dd/d19/d1a/d29/fe9 x:0 0 0 2024-09-17T01:02:03.828 INFO:tasks.workunit.client.0.smithi002.stdout:0/698: write dd/d19/d1c/db7/db4/fc8 [1038297,33098] 0 2024-09-17T01:02:03.829 INFO:tasks.workunit.client.1.smithi099.stdout:3/791: creat d9/d15/d18/dc2/ff5 x:0 0 0 2024-09-17T01:02:03.830 INFO:tasks.workunit.client.1.smithi099.stdout:0/818: creat da/df/d1a/d49/f108 x:0 0 0 2024-09-17T01:02:03.831 INFO:tasks.workunit.client.0.smithi002.stdout:6/845: getdents d2/d1d/d2d/d5a/d71 0 2024-09-17T01:02:03.832 INFO:tasks.workunit.client.1.smithi099.stdout:3/792: symlink d9/d15/d18/d1a/d23/d5c/d6e/lf6 0 2024-09-17T01:02:03.832 INFO:tasks.workunit.client.1.smithi099.stdout:0/819: mkdir da/df/d1a/d49/d68/d9f/dd7/de0/d109 0 2024-09-17T01:02:03.832 INFO:tasks.workunit.client.1.smithi099.stdout:0/820: write da/df/d1a/d63/d6a/f6e [1842534,68541] 0 2024-09-17T01:02:03.833 INFO:tasks.workunit.client.0.smithi002.stdout:6/846: creat d2/d1d/d2d/d35/d37/f118 x:0 0 0 2024-09-17T01:02:03.833 INFO:tasks.workunit.client.0.smithi002.stdout:6/847: stat d2/dc/d24/d53/d83/da9/d4c/f62 0 2024-09-17T01:02:03.834 INFO:tasks.workunit.client.0.smithi002.stdout:6/848: mknod d2/d1d/d27/d80/d93/dd5/d5c/dc9/c119 0 2024-09-17T01:02:03.835 INFO:tasks.workunit.client.0.smithi002.stdout:5/736: write d2/d2d/d10/d14/d19/d39/d25/fe6 [2887386,20394] 0 2024-09-17T01:02:03.835 INFO:tasks.workunit.client.0.smithi002.stdout:5/737: write d2/d2d/d10/d20/fe4 [822061,118285] 0 2024-09-17T01:02:03.835 INFO:tasks.workunit.client.0.smithi002.stdout:5/738: chown d2/d2d/d10/d14/d19/d39/d3f/l94 215091 1 2024-09-17T01:02:03.835 INFO:tasks.workunit.client.0.smithi002.stdout:0/699: dread dd/d19/d9f/fb0 [0,4194304] 0 2024-09-17T01:02:03.836 INFO:tasks.workunit.client.0.smithi002.stdout:6/849: creat d2/d1d/d27/d87/f11a x:0 0 0 2024-09-17T01:02:03.836 INFO:tasks.workunit.client.0.smithi002.stdout:2/778: dwrite d1b/d74/d93/d94/f110 [0,4194304] 0 2024-09-17T01:02:03.837 INFO:tasks.workunit.client.0.smithi002.stdout:5/739: unlink d2/d2d/d10/d14/d19/d39/d3f/l75 0 2024-09-17T01:02:03.837 INFO:tasks.workunit.client.0.smithi002.stdout:5/740: chown d2/d2d/d10/d14/d19/d39/d25/c69 3 1 2024-09-17T01:02:03.838 INFO:tasks.workunit.client.0.smithi002.stdout:0/700: mknod dd/d19/d1c/d33/de3/cea 0 2024-09-17T01:02:03.841 INFO:tasks.workunit.client.0.smithi002.stdout:6/850: link d2/dc/d34/f39 d2/f11b 0 2024-09-17T01:02:03.846 INFO:tasks.workunit.client.0.smithi002.stdout:9/682: sync 2024-09-17T01:02:03.846 INFO:tasks.workunit.client.0.smithi002.stdout:0/701: dread dd/f32 [0,4194304] 0 2024-09-17T01:02:03.847 INFO:tasks.workunit.client.0.smithi002.stdout:0/702: readlink dd/d19/d1a/d29/d55/l75 0 2024-09-17T01:02:03.847 INFO:tasks.workunit.client.0.smithi002.stdout:0/703: write dd/d19/d1c/f79 [455534,27379] 0 2024-09-17T01:02:03.851 INFO:tasks.workunit.client.1.smithi099.stdout:0/821: dwrite da/d12/d22/d53/fe2 [0,4194304] 0 2024-09-17T01:02:03.852 INFO:tasks.workunit.client.0.smithi002.stdout:2/779: rmdir d1b/d37 39 2024-09-17T01:02:03.854 INFO:tasks.workunit.client.1.smithi099.stdout:0/822: getdents da/d12/d2b 0 2024-09-17T01:02:03.855 INFO:tasks.workunit.client.0.smithi002.stdout:2/780: write d1b/d1d/f1f [829832,26504] 0 2024-09-17T01:02:03.855 INFO:tasks.workunit.client.0.smithi002.stdout:2/781: getdents d1b/d3f/d59/dfa 0 2024-09-17T01:02:03.855 INFO:tasks.workunit.client.0.smithi002.stdout:2/782: chown d1b/d74/d93/d118 4701414 1 2024-09-17T01:02:03.855 INFO:tasks.workunit.client.1.smithi099.stdout:0/823: dread da/df/d1a/fce [0,4194304] 0 2024-09-17T01:02:03.856 INFO:tasks.workunit.client.0.smithi002.stdout:2/783: rmdir d1b/d74 39 2024-09-17T01:02:03.857 INFO:tasks.workunit.client.1.smithi099.stdout:3/793: dwrite d9/f7a [0,4194304] 0 2024-09-17T01:02:03.857 INFO:tasks.workunit.client.1.smithi099.stdout:3/794: chown d9/d15/d18/ldf 95207 1 2024-09-17T01:02:03.857 INFO:tasks.workunit.client.1.smithi099.stdout:0/824: mknod da/d12/d22/dfd/c10a 0 2024-09-17T01:02:03.858 INFO:tasks.workunit.client.0.smithi002.stdout:2/784: creat d1b/d74/f119 x:0 0 0 2024-09-17T01:02:03.861 INFO:tasks.workunit.client.1.smithi099.stdout:3/795: link d9/c11 d9/d15/d18/d1a/d23/d5c/d99/dda/db5/dca/cf7 0 2024-09-17T01:02:03.862 INFO:tasks.workunit.client.1.smithi099.stdout:0/825: symlink da/df/d1a/d56/l10b 0 2024-09-17T01:02:03.863 INFO:tasks.workunit.client.0.smithi002.stdout:0/704: rename dd/d19/d1c/d33/de3 to dd/d19/d1c/deb 0 2024-09-17T01:02:03.864 INFO:tasks.workunit.client.1.smithi099.stdout:0/826: dread da/d12/d22/fa9 [0,4194304] 0 2024-09-17T01:02:03.864 INFO:tasks.workunit.client.1.smithi099.stdout:0/827: chown da/df/f4f 50406197 1 2024-09-17T01:02:03.864 INFO:tasks.workunit.client.1.smithi099.stdout:3/796: symlink d9/d15/d18/d1a/lf8 0 2024-09-17T01:02:03.864 INFO:tasks.workunit.client.0.smithi002.stdout:2/785: rename d1b/d74/d93/d94/de2/leb to d1b/d74/d93/d118/l11a 0 2024-09-17T01:02:03.866 INFO:tasks.workunit.client.1.smithi099.stdout:0/828: dread da/df/d1a/d63/d6a/fd2 [0,4194304] 0 2024-09-17T01:02:03.866 INFO:tasks.workunit.client.1.smithi099.stdout:3/797: link d9/l6a d9/d3b/db2/daf/lf9 0 2024-09-17T01:02:03.866 INFO:tasks.workunit.client.0.smithi002.stdout:2/786: link d1b/d37/d48/d4e/l9e d1b/d3f/d59/d7f/dc9/l11b 0 2024-09-17T01:02:03.866 INFO:tasks.workunit.client.0.smithi002.stdout:4/890: sync 2024-09-17T01:02:03.867 INFO:tasks.workunit.client.0.smithi002.stdout:3/688: sync 2024-09-17T01:02:03.867 INFO:tasks.workunit.client.0.smithi002.stdout:1/830: sync 2024-09-17T01:02:03.867 INFO:tasks.workunit.client.0.smithi002.stdout:7/809: sync 2024-09-17T01:02:03.867 INFO:tasks.workunit.client.0.smithi002.stdout:0/705: read dd/f5a [636807,9391] 0 2024-09-17T01:02:03.868 INFO:tasks.workunit.client.0.smithi002.stdout:0/706: chown dd/d19/d1c/d1f/d22 7 1 2024-09-17T01:02:03.868 INFO:tasks.workunit.client.0.smithi002.stdout:0/707: write dd/d3d/d94/dd1/fe1 [2230513,23636] 0 2024-09-17T01:02:03.868 INFO:tasks.workunit.client.1.smithi099.stdout:0/829: rename da/df/d31/ff7 to da/d12/d2b/dab/dba/dfa/f10c 0 2024-09-17T01:02:03.869 INFO:tasks.workunit.client.0.smithi002.stdout:3/689: rename d0/d3/d33/d40/f52 to d0/d31/d8b/d9d/fde 0 2024-09-17T01:02:03.869 INFO:tasks.workunit.client.0.smithi002.stdout:3/690: write d0/d31/d32/fd5 [90439,51586] 0 2024-09-17T01:02:03.870 INFO:tasks.workunit.client.0.smithi002.stdout:3/691: write d0/d3/d37/dac/da1/fb6 [116327,45227] 0 2024-09-17T01:02:03.870 INFO:tasks.workunit.client.0.smithi002.stdout:3/692: getdents d0/d31/d32/dcb/dd7 0 2024-09-17T01:02:03.870 INFO:tasks.workunit.client.0.smithi002.stdout:7/810: unlink d1/d14/d1d/l2c 0 2024-09-17T01:02:03.871 INFO:tasks.workunit.client.1.smithi099.stdout:3/798: unlink d9/f83 0 2024-09-17T01:02:03.871 INFO:tasks.workunit.client.1.smithi099.stdout:3/799: creat d9/d15/d18/dc2/ffa x:0 0 0 2024-09-17T01:02:03.871 INFO:tasks.workunit.client.1.smithi099.stdout:3/800: dread - d9/d15/d18/dc2/ff5 zero size 2024-09-17T01:02:03.872 INFO:tasks.workunit.client.0.smithi002.stdout:1/831: creat d4/d11/d55/f117 x:0 0 0 2024-09-17T01:02:03.872 INFO:tasks.workunit.client.0.smithi002.stdout:1/832: readlink d4/d11/d12/d30/d5e/lf4 0 2024-09-17T01:02:03.872 INFO:tasks.workunit.client.1.smithi099.stdout:3/801: truncate d9/d15/d7d/f8a 55901 0 2024-09-17T01:02:03.874 INFO:tasks.workunit.client.0.smithi002.stdout:0/708: unlink dd/d19/d1c/lb2 0 2024-09-17T01:02:03.876 INFO:tasks.workunit.client.1.smithi099.stdout:3/802: rename d9/d15/d18/d1a/d23/f17 to d9/d15/d18/d1a/d23/d5c/ffb 0 2024-09-17T01:02:03.876 INFO:tasks.workunit.client.1.smithi099.stdout:3/803: chown d9/f9a 334 1 2024-09-17T01:02:03.876 INFO:tasks.workunit.client.0.smithi002.stdout:7/811: mkdir d1/d14/d1d/d28/d86/dff 0 2024-09-17T01:02:03.876 INFO:tasks.workunit.client.0.smithi002.stdout:4/891: dread d7/de/f28 [0,4194304] 0 2024-09-17T01:02:03.877 INFO:tasks.workunit.client.0.smithi002.stdout:4/892: write d7/d19/d9f/d80/fcb [1557745,3370] 0 2024-09-17T01:02:03.877 INFO:tasks.workunit.client.0.smithi002.stdout:4/893: stat d7/de/d3a/d109/dc7/d77/d9b/f57 0 2024-09-17T01:02:03.878 INFO:tasks.workunit.client.0.smithi002.stdout:9/683: dwrite d5/dc/d26/d5c/d6b/d75/fb1 [0,4194304] 0 2024-09-17T01:02:03.878 INFO:tasks.workunit.client.1.smithi099.stdout:3/804: mkdir d9/d15/d38/dfc 0 2024-09-17T01:02:03.879 INFO:tasks.workunit.client.0.smithi002.stdout:5/741: dwrite d2/d2d/d10/d14/d19/d39/fd6 [0,4194304] 0 2024-09-17T01:02:03.879 INFO:tasks.workunit.client.0.smithi002.stdout:5/742: truncate d2/d2d/d10/d23/d6a/feb 143233 0 2024-09-17T01:02:03.879 INFO:tasks.workunit.client.0.smithi002.stdout:7/812: mknod d1/c100 0 2024-09-17T01:02:03.880 INFO:tasks.workunit.client.0.smithi002.stdout:9/684: dread d5/dc/d26/d46/db4/fc1 [0,4194304] 0 2024-09-17T01:02:03.881 INFO:tasks.workunit.client.0.smithi002.stdout:6/851: dwrite d2/d1d/d2d/f4f [0,4194304] 0 2024-09-17T01:02:03.882 INFO:tasks.workunit.client.0.smithi002.stdout:3/693: write d0/d3/d33/d40/f63 [1535913,109539] 0 2024-09-17T01:02:03.882 INFO:tasks.workunit.client.0.smithi002.stdout:3/694: creat d0/d3/d17/d9a/daa/fdf x:0 0 0 2024-09-17T01:02:03.882 INFO:tasks.workunit.client.0.smithi002.stdout:7/813: rename d1/d14/d1d/d28/l9a to d1/d14/d1d/d28/d8f/l101 0 2024-09-17T01:02:03.883 INFO:tasks.workunit.client.0.smithi002.stdout:7/814: chown d1/d14/d1d/d28/d86/f97 83 1 2024-09-17T01:02:03.884 INFO:tasks.workunit.client.0.smithi002.stdout:9/685: mkdir d5/dc/d26/d9c/dcc 0 2024-09-17T01:02:03.887 INFO:tasks.workunit.client.0.smithi002.stdout:9/686: creat d5/dc/d26/d5c/d6b/d75/fcd x:0 0 0 2024-09-17T01:02:03.888 INFO:tasks.workunit.client.0.smithi002.stdout:7/815: write d1/d14/d1d/d28/d86/fd9 [308690,15468] 0 2024-09-17T01:02:03.888 INFO:tasks.workunit.client.0.smithi002.stdout:7/816: read d1/d14/d1d/d28/d6b/f83 [774823,130358] 0 2024-09-17T01:02:03.888 INFO:tasks.workunit.client.0.smithi002.stdout:9/687: creat d5/d8a/d9d/fce x:0 0 0 2024-09-17T01:02:03.889 INFO:tasks.workunit.client.0.smithi002.stdout:7/817: creat d1/d14/d67/dc0/dcd/d45/f102 x:0 0 0 2024-09-17T01:02:03.889 INFO:tasks.workunit.client.0.smithi002.stdout:9/688: write d5/dc/d26/d46/db4/fc1 [1088436,35328] 0 2024-09-17T01:02:03.889 INFO:tasks.workunit.client.0.smithi002.stdout:9/689: chown d5/dc/d26/f2d 12206058 1 2024-09-17T01:02:03.893 INFO:tasks.workunit.client.1.smithi099.stdout:3/805: dread d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/fe8 [0,4194304] 0 2024-09-17T01:02:03.893 INFO:tasks.workunit.client.0.smithi002.stdout:5/743: write d2/d2d/d10/d14/d19/d39/dae/fc9 [3247782,92397] 0 2024-09-17T01:02:03.893 INFO:tasks.workunit.client.0.smithi002.stdout:5/744: chown d2/d2d/d10/d14/d19/d39/d43/l56 219211 1 2024-09-17T01:02:03.894 INFO:tasks.workunit.client.0.smithi002.stdout:5/745: mknod d2/d2d/d10/d14/d19/d39/d48/cec 0 2024-09-17T01:02:03.894 INFO:tasks.workunit.client.0.smithi002.stdout:3/695: dread d0/d3/d33/f7d [0,4194304] 0 2024-09-17T01:02:03.895 INFO:tasks.workunit.client.0.smithi002.stdout:5/746: symlink d2/d2d/d10/d14/d19/d39/de5/led 0 2024-09-17T01:02:03.896 INFO:tasks.workunit.client.0.smithi002.stdout:3/696: mknod d0/d3/da8/ce0 0 2024-09-17T01:02:03.897 INFO:tasks.workunit.client.0.smithi002.stdout:5/747: creat d2/d2d/d10/d14/d19/d39/d43/fee x:0 0 0 2024-09-17T01:02:03.898 INFO:tasks.workunit.client.0.smithi002.stdout:3/697: creat d0/d3/d37/dac/fe1 x:0 0 0 2024-09-17T01:02:03.900 INFO:tasks.workunit.client.0.smithi002.stdout:3/698: mkdir d0/d3/d37/dac/de2 0 2024-09-17T01:02:03.900 INFO:tasks.workunit.client.0.smithi002.stdout:4/894: dread d7/d19/d9c/de9/da4/fd8 [0,4194304] 0 2024-09-17T01:02:03.902 INFO:tasks.workunit.client.0.smithi002.stdout:5/748: rename d2/d2d/d10/d14/d19/d39/d48/d9d/dba to d2/d2d/d10/d14/d19/d39/d48/def 0 2024-09-17T01:02:03.904 INFO:tasks.workunit.client.0.smithi002.stdout:3/699: dread d0/d3/d17/f68 [0,4194304] 0 2024-09-17T01:02:03.905 INFO:tasks.workunit.client.0.smithi002.stdout:3/700: stat d0/d3/d37/dac/c91 0 2024-09-17T01:02:03.907 INFO:tasks.workunit.client.0.smithi002.stdout:3/701: mkdir d0/d3/d37/de3 0 2024-09-17T01:02:03.907 INFO:tasks.workunit.client.0.smithi002.stdout:3/702: chown d0/d3/d37/dac/da1/fc5 483444802 1 2024-09-17T01:02:03.908 INFO:tasks.workunit.client.0.smithi002.stdout:3/703: mkdir d0/d3/d37/dac/da1/de4 0 2024-09-17T01:02:03.908 INFO:tasks.workunit.client.0.smithi002.stdout:3/704: truncate d0/d3/d17/d6a/fb7 4817147 0 2024-09-17T01:02:03.909 INFO:tasks.workunit.client.0.smithi002.stdout:3/705: mknod d0/d31/d8b/ce5 0 2024-09-17T01:02:03.910 INFO:tasks.workunit.client.0.smithi002.stdout:3/706: symlink d0/d3/d17/d9a/daa/le6 0 2024-09-17T01:02:03.910 INFO:tasks.workunit.client.0.smithi002.stdout:3/707: chown d0/d3/fb5 91 1 2024-09-17T01:02:03.911 INFO:tasks.workunit.client.0.smithi002.stdout:3/708: dread - d0/d3/d37/dac/da1/fc5 zero size 2024-09-17T01:02:03.915 INFO:tasks.workunit.client.0.smithi002.stdout:7/818: read d1/d24/f46 [8355263,106656] 0 2024-09-17T01:02:03.915 INFO:tasks.workunit.client.0.smithi002.stdout:7/819: chown d1/d14/d1d/d28/d86/fd9 14906072 1 2024-09-17T01:02:03.916 INFO:tasks.workunit.client.0.smithi002.stdout:4/895: dread d7/d19/d2e/fbd [0,4194304] 0 2024-09-17T01:02:03.916 INFO:tasks.workunit.client.0.smithi002.stdout:4/896: write d7/d19/d2e/f39 [1239597,55092] 0 2024-09-17T01:02:03.916 INFO:tasks.workunit.client.0.smithi002.stdout:4/897: readlink d7/de/d3a/d109/lff 0 2024-09-17T01:02:03.917 INFO:tasks.workunit.client.0.smithi002.stdout:7/820: link d1/d14/d1d/d29/d57/c77 d1/d14/d1d/d28/d6b/d9e/d50/c103 0 2024-09-17T01:02:03.917 INFO:tasks.workunit.client.0.smithi002.stdout:7/821: creat d1/d14/d1d/f104 x:0 0 0 2024-09-17T01:02:03.920 INFO:tasks.workunit.client.0.smithi002.stdout:7/822: symlink d1/d14/d1d/d28/d40/ddd/l105 0 2024-09-17T01:02:03.920 INFO:tasks.workunit.client.0.smithi002.stdout:7/823: creat d1/d14/d67/dc0/dcd/d45/f106 x:0 0 0 2024-09-17T01:02:03.921 INFO:tasks.workunit.client.0.smithi002.stdout:9/690: dread d5/dc/d26/d63/d66/f78 [0,4194304] 0 2024-09-17T01:02:03.922 INFO:tasks.workunit.client.0.smithi002.stdout:2/787: dwrite d1b/d74/f9f [0,4194304] 0 2024-09-17T01:02:03.922 INFO:tasks.workunit.client.1.smithi099.stdout:0/830: dwrite da/d12/f16 [4194304,4194304] 0 2024-09-17T01:02:03.923 INFO:tasks.workunit.client.0.smithi002.stdout:7/824: rename d1/c100 to d1/d14/d1d/d28/d40/c107 0 2024-09-17T01:02:03.923 INFO:tasks.workunit.client.0.smithi002.stdout:7/825: write d1/d14/d1d/d28/d2d/fa4 [453263,33850] 0 2024-09-17T01:02:03.923 INFO:tasks.workunit.client.0.smithi002.stdout:7/826: creat d1/d14/d1d/d28/d8f/de0/f108 x:0 0 0 2024-09-17T01:02:03.923 INFO:tasks.workunit.client.0.smithi002.stdout:7/827: truncate d1/d14/d67/dc0/dcd/d45/fce 436838 0 2024-09-17T01:02:03.923 INFO:tasks.workunit.client.0.smithi002.stdout:7/828: fdatasync d1/d14/d1d/d28/d40/d58/fab 0 2024-09-17T01:02:03.923 INFO:tasks.workunit.client.0.smithi002.stdout:7/829: fdatasync d1/d14/d67/dc0/fda 0 2024-09-17T01:02:03.924 INFO:tasks.workunit.client.0.smithi002.stdout:7/830: chown d1/d14/d1d/d29/d57 16147750 1 2024-09-17T01:02:03.926 INFO:tasks.workunit.client.0.smithi002.stdout:2/788: unlink d1b/d37/d48/d4e/f3b 0 2024-09-17T01:02:03.926 INFO:tasks.workunit.client.0.smithi002.stdout:2/789: dread - d1b/d3f/d59/d7f/dc9/dac/dbd/de8/f108 zero size 2024-09-17T01:02:03.930 INFO:tasks.workunit.client.0.smithi002.stdout:7/831: link d1/d14/d1d/d28/d6b/d9e/f69 d1/d14/d1d/d28/d8f/f109 0 2024-09-17T01:02:03.931 INFO:tasks.workunit.client.0.smithi002.stdout:2/790: mknod d1b/d37/dc1/c11c 0 2024-09-17T01:02:03.932 INFO:tasks.workunit.client.1.smithi099.stdout:0/831: dread da/d12/f5a [0,4194304] 0 2024-09-17T01:02:03.933 INFO:tasks.workunit.client.1.smithi099.stdout:0/832: write da/df/d1a/d56/f74 [2921125,58736] 0 2024-09-17T01:02:03.934 INFO:tasks.workunit.client.1.smithi099.stdout:0/833: getdents da/d12/d22/d66 0 2024-09-17T01:02:03.934 INFO:tasks.workunit.client.0.smithi002.stdout:9/691: dread d5/f19 [0,4194304] 0 2024-09-17T01:02:03.934 INFO:tasks.workunit.client.0.smithi002.stdout:9/692: creat d5/dc/d26/d5c/d6b/d75/fcf x:0 0 0 2024-09-17T01:02:03.934 INFO:tasks.workunit.client.0.smithi002.stdout:7/832: rename d1/d14/d1d/d29/d57/dbb to d1/d14/d1d/d28/d6b/d9e/d10a 0 2024-09-17T01:02:03.934 INFO:tasks.workunit.client.1.smithi099.stdout:0/834: rename da/df/d31/db0 to da/d12/d2b/df0/d10d 0 2024-09-17T01:02:03.941 INFO:tasks.workunit.client.0.smithi002.stdout:9/693: write d5/dc/d26/d5c/d6b/f9b [3631365,56947] 0 2024-09-17T01:02:03.941 INFO:tasks.workunit.client.0.smithi002.stdout:9/694: write d5/dc/d26/d46/d47/da1/fb3 [951491,117012] 0 2024-09-17T01:02:03.946 INFO:tasks.workunit.client.1.smithi099.stdout:0/835: write da/d12/d2b/df0/d10d/f3d [4128527,129360] 0 2024-09-17T01:02:03.946 INFO:tasks.workunit.client.0.smithi002.stdout:6/852: dwrite d2/d1d/d2d/d35/d79/de6/ff8 [4194304,4194304] 0 2024-09-17T01:02:03.948 INFO:tasks.workunit.client.1.smithi099.stdout:0/836: creat da/df/d1a/d49/d71/dcd/f10e x:0 0 0 2024-09-17T01:02:03.948 INFO:tasks.workunit.client.0.smithi002.stdout:5/749: dwrite d2/d2d/d10/d14/d19/da5/db0/fc0 [0,4194304] 0 2024-09-17T01:02:03.950 INFO:tasks.workunit.client.0.smithi002.stdout:2/791: dread d1b/d1d/f28 [4194304,4194304] 0 2024-09-17T01:02:03.951 INFO:tasks.workunit.client.0.smithi002.stdout:2/792: read - d1b/d1d/d79/fd2 zero size 2024-09-17T01:02:03.951 INFO:tasks.workunit.client.0.smithi002.stdout:5/750: creat d2/d2d/d10/d9b/de8/ff0 x:0 0 0 2024-09-17T01:02:03.951 INFO:tasks.workunit.client.0.smithi002.stdout:5/751: creat d2/ff1 x:0 0 0 2024-09-17T01:02:03.951 INFO:tasks.workunit.client.1.smithi099.stdout:0/837: creat da/d12/d2b/dab/db5/f10f x:0 0 0 2024-09-17T01:02:03.952 INFO:tasks.workunit.client.0.smithi002.stdout:5/752: dread d2/d2d/d10/d23/d6a/feb [0,4194304] 0 2024-09-17T01:02:03.952 INFO:tasks.workunit.client.0.smithi002.stdout:0/709: dwrite dd/d19/da9/de5/db9/fd2 [0,4194304] 0 2024-09-17T01:02:03.957 INFO:tasks.workunit.client.0.smithi002.stdout:7/833: getdents d1/d14/d1d/d28/d86 0 2024-09-17T01:02:03.961 INFO:tasks.workunit.client.1.smithi099.stdout:0/838: dread da/df/d1a/d49/dac/f50 [0,4194304] 0 2024-09-17T01:02:03.961 INFO:tasks.workunit.client.1.smithi099.stdout:0/839: chown da/d12/d2b 0 1 2024-09-17T01:02:03.962 INFO:tasks.workunit.client.1.smithi099.stdout:0/840: link da/d12/d2b/dab/db5/f58 da/d3b/f110 0 2024-09-17T01:02:03.964 INFO:tasks.workunit.client.1.smithi099.stdout:0/841: creat da/df/d1a/d56/f111 x:0 0 0 2024-09-17T01:02:03.965 INFO:tasks.workunit.client.1.smithi099.stdout:3/806: dwrite d9/d15/d18/dc2/ffa [0,4194304] 0 2024-09-17T01:02:03.965 INFO:tasks.workunit.client.0.smithi002.stdout:0/710: dread dd/d19/f24 [0,4194304] 0 2024-09-17T01:02:03.965 INFO:tasks.workunit.client.1.smithi099.stdout:0/842: rename da/df/d1a/d49/dac/f50 to da/df/d20/dbf/f112 0 2024-09-17T01:02:03.968 INFO:tasks.workunit.client.0.smithi002.stdout:3/709: dwrite d0/d31/d8b/d9d/fde [0,4194304] 0 2024-09-17T01:02:03.969 INFO:tasks.workunit.client.1.smithi099.stdout:3/807: creat d9/d15/d18/d1a/d23/d5c/d6e/d7e/ffd x:0 0 0 2024-09-17T01:02:03.970 INFO:tasks.workunit.client.0.smithi002.stdout:7/834: truncate d1/d14/d1d/d29/f85 268473 0 2024-09-17T01:02:03.971 INFO:tasks.workunit.client.1.smithi099.stdout:3/808: write d9/d15/d18/d1a/d23/f5f [748342,113532] 0 2024-09-17T01:02:03.972 INFO:tasks.workunit.client.1.smithi099.stdout:3/809: write d9/d15/d18/d1a/d23/d5c/fa1 [718148,62824] 0 2024-09-17T01:02:03.972 INFO:tasks.workunit.client.1.smithi099.stdout:3/810: chown d9/d3b/d44/f48 1757504 1 2024-09-17T01:02:03.979 INFO:tasks.workunit.client.0.smithi002.stdout:9/695: dwrite d5/dc/d26/d5c/d6b/d75/fcd [0,4194304] 0 2024-09-17T01:02:03.979 INFO:tasks.workunit.client.0.smithi002.stdout:9/696: write d5/dc/d26/d46/d47/da1/fc7 [517482,128713] 0 2024-09-17T01:02:03.979 INFO:tasks.workunit.client.0.smithi002.stdout:4/898: dwrite d7/de/d32/d59/d10f/dfa/ffb [0,4194304] 0 2024-09-17T01:02:03.979 INFO:tasks.workunit.client.0.smithi002.stdout:4/899: stat d7/d19/d9f/d80/f5a 0 2024-09-17T01:02:03.979 INFO:tasks.workunit.client.1.smithi099.stdout:3/811: rename d9/d15/d38/fe0 to d9/d15/d18/d1a/d23/d5c/d99/ffe 0 2024-09-17T01:02:03.980 INFO:tasks.workunit.client.0.smithi002.stdout:9/697: creat d5/dc/d26/d5c/fd0 x:0 0 0 2024-09-17T01:02:03.981 INFO:tasks.workunit.client.0.smithi002.stdout:9/698: write d5/dc/d26/d5c/d6b/d75/d36/f67 [727980,85597] 0 2024-09-17T01:02:03.983 INFO:tasks.workunit.client.0.smithi002.stdout:4/900: link d7/de/d3a/d109/dc7/d77/d9b/f9a d7/d19/d9c/de9/f113 0 2024-09-17T01:02:03.983 INFO:tasks.workunit.client.0.smithi002.stdout:4/901: truncate d7/d19/d9f/db2/fc1 879902 0 2024-09-17T01:02:03.983 INFO:tasks.workunit.client.0.smithi002.stdout:4/902: getdents d7/d19/d9f/d80/d62/dbe/df4 0 2024-09-17T01:02:03.985 INFO:tasks.workunit.client.0.smithi002.stdout:9/699: symlink d5/dc/d26/d46/ld1 0 2024-09-17T01:02:03.985 INFO:tasks.workunit.client.0.smithi002.stdout:9/700: chown d5/dc/d26/d5c/d6b/d75/d57/d7a/da2/cb9 470920 1 2024-09-17T01:02:03.985 INFO:tasks.workunit.client.0.smithi002.stdout:9/701: creat d5/d8a/fd2 x:0 0 0 2024-09-17T01:02:03.986 INFO:tasks.workunit.client.0.smithi002.stdout:4/903: link d7/d71/d8e/fba d7/de/f114 0 2024-09-17T01:02:03.988 INFO:tasks.workunit.client.1.smithi099.stdout:3/812: dread d9/d3b/d44/f6d [0,4194304] 0 2024-09-17T01:02:03.988 INFO:tasks.workunit.client.0.smithi002.stdout:9/702: mkdir d5/d8a/dd3 0 2024-09-17T01:02:03.989 INFO:tasks.workunit.client.1.smithi099.stdout:3/813: creat d9/d15/d18/d1a/d23/d5c/d99/dda/fff x:0 0 0 2024-09-17T01:02:03.990 INFO:tasks.workunit.client.1.smithi099.stdout:3/814: creat d9/d15/d18/d1a/d23/d5c/d6e/f100 x:0 0 0 2024-09-17T01:02:03.990 INFO:tasks.workunit.client.1.smithi099.stdout:3/815: chown d9/f25 4332740 1 2024-09-17T01:02:03.990 INFO:tasks.workunit.client.0.smithi002.stdout:4/904: rename d7/d71/d8e/d95/fb0 to d7/de/d3a/d109/f115 0 2024-09-17T01:02:03.991 INFO:tasks.workunit.client.1.smithi099.stdout:3/816: creat d9/d15/d18/d1a/d23/d5c/d99/dd8/ded/f101 x:0 0 0 2024-09-17T01:02:03.991 INFO:tasks.workunit.client.1.smithi099.stdout:3/817: fsync d9/d15/d18/f4e 0 2024-09-17T01:02:03.991 INFO:tasks.workunit.client.1.smithi099.stdout:3/818: rmdir d9/d15/d8f/d97 39 2024-09-17T01:02:03.991 INFO:tasks.workunit.client.0.smithi002.stdout:4/905: creat d7/d19/d9c/de9/f116 x:0 0 0 2024-09-17T01:02:03.992 INFO:tasks.workunit.client.0.smithi002.stdout:9/703: getdents d5/dc/d26/d5c/d6b/d75/d57/d8d 0 2024-09-17T01:02:03.993 INFO:tasks.workunit.client.0.smithi002.stdout:9/704: chown d5/dc/d26/d5c/d6b/d75 175 1 2024-09-17T01:02:03.993 INFO:tasks.workunit.client.0.smithi002.stdout:4/906: symlink d7/de/d3a/dac/l117 0 2024-09-17T01:02:03.994 INFO:tasks.workunit.client.1.smithi099.stdout:3/819: mkdir d9/d15/d18/d1a/d23/d102 0 2024-09-17T01:02:03.994 INFO:tasks.workunit.client.1.smithi099.stdout:3/820: truncate d9/d15/d18/f2a 2961918 0 2024-09-17T01:02:03.994 INFO:tasks.workunit.client.1.smithi099.stdout:3/821: link d9/fd3 d9/d15/d18/d1a/d23/d5c/d99/dda/db5/dca/f103 0 2024-09-17T01:02:03.995 INFO:tasks.workunit.client.1.smithi099.stdout:3/822: creat d9/d15/d18/d1a/d23/d4c/d64/f104 x:0 0 0 2024-09-17T01:02:03.995 INFO:tasks.workunit.client.0.smithi002.stdout:4/907: creat d7/de/d32/d59/d10f/f118 x:0 0 0 2024-09-17T01:02:03.995 INFO:tasks.workunit.client.0.smithi002.stdout:4/908: write d7/de6/ff7 [19736,76950] 0 2024-09-17T01:02:03.995 INFO:tasks.workunit.client.0.smithi002.stdout:4/909: fdatasync d7/de/fae 0 2024-09-17T01:02:03.996 INFO:tasks.workunit.client.1.smithi099.stdout:3/823: creat d9/d15/d18/d1a/d23/d5c/d99/dd8/f105 x:0 0 0 2024-09-17T01:02:03.998 INFO:tasks.workunit.client.0.smithi002.stdout:9/705: dread d5/dc/f4b [0,4194304] 0 2024-09-17T01:02:03.998 INFO:tasks.workunit.client.0.smithi002.stdout:9/706: fsync d5/dc/d26/d63/d66/f88 0 2024-09-17T01:02:03.998 INFO:tasks.workunit.client.0.smithi002.stdout:5/753: dwrite d2/d2d/d10/d23/d6e/d60/fb1 [0,4194304] 0 2024-09-17T01:02:03.998 INFO:tasks.workunit.client.0.smithi002.stdout:5/754: write d2/d2d/d10/d14/fda [1013737,10963] 0 2024-09-17T01:02:03.999 INFO:tasks.workunit.client.0.smithi002.stdout:9/707: mknod d5/dc/d26/d9c/cd4 0 2024-09-17T01:02:04.000 INFO:tasks.workunit.client.0.smithi002.stdout:0/711: dwrite dd/d19/d1a/d29/d55/f95 [0,4194304] 0 2024-09-17T01:02:04.000 INFO:tasks.workunit.client.0.smithi002.stdout:0/712: truncate dd/d19/d1c/db7/db4/fa3 4901340 0 2024-09-17T01:02:04.001 INFO:tasks.workunit.client.0.smithi002.stdout:3/710: dwrite d0/d3/d17/d9a/daa/fb1 [0,4194304] 0 2024-09-17T01:02:04.007 INFO:tasks.workunit.client.0.smithi002.stdout:0/713: link dd/d19/d1a/f1d dd/d19/d1c/d1f/d22/dc3/fec 0 2024-09-17T01:02:04.007 INFO:tasks.workunit.client.0.smithi002.stdout:0/714: write dd/d3d/f8d [659146,119468] 0 2024-09-17T01:02:04.007 INFO:tasks.workunit.client.0.smithi002.stdout:0/715: stat dd/d19/l23 0 2024-09-17T01:02:04.012 INFO:tasks.workunit.client.0.smithi002.stdout:0/716: creat dd/d19/d1c/deb/fed x:0 0 0 2024-09-17T01:02:04.012 INFO:tasks.workunit.client.0.smithi002.stdout:9/708: write d5/dc/d26/d5c/d6b/d75/d57/fbe [169101,8034] 0 2024-09-17T01:02:04.012 INFO:tasks.workunit.client.0.smithi002.stdout:9/709: dread - d5/d8a/d9d/da7/fc2 zero size 2024-09-17T01:02:04.012 INFO:tasks.workunit.client.0.smithi002.stdout:5/755: write d2/d2d/d10/d14/d19/d39/f3c [5601239,26580] 0 2024-09-17T01:02:04.012 INFO:tasks.workunit.client.0.smithi002.stdout:5/756: readlink d2/d2d/d10/d95/lbc 0 2024-09-17T01:02:04.013 INFO:tasks.workunit.client.0.smithi002.stdout:3/711: write d0/d3/d17/f6d [2501994,127339] 0 2024-09-17T01:02:04.014 INFO:tasks.workunit.client.0.smithi002.stdout:9/710: rename d5/dc/d26/d46/d47/da1/cc9 to d5/dc/d26/d5c/d6b/d75/cd5 0 2024-09-17T01:02:04.014 INFO:tasks.workunit.client.0.smithi002.stdout:9/711: write d5/dc/d26/d46/d47/da1/fb3 [978791,108391] 0 2024-09-17T01:02:04.015 INFO:tasks.workunit.client.1.smithi099.stdout:3/824: dwrite d9/d3b/f62 [4194304,4194304] 0 2024-09-17T01:02:04.015 INFO:tasks.workunit.client.0.smithi002.stdout:4/910: dwrite d7/de/f5c [0,4194304] 0 2024-09-17T01:02:04.015 INFO:tasks.workunit.client.0.smithi002.stdout:4/911: readlink d7/de/d3a/d109/dc7/d77/d9b/l7d 0 2024-09-17T01:02:04.016 INFO:tasks.workunit.client.1.smithi099.stdout:3/825: creat d9/d15/d18/f106 x:0 0 0 2024-09-17T01:02:04.017 INFO:tasks.workunit.client.0.smithi002.stdout:0/717: dread dd/d19/f2c [0,4194304] 0 2024-09-17T01:02:04.017 INFO:tasks.workunit.client.0.smithi002.stdout:3/712: mkdir d0/d31/d32/dcb/de7 0 2024-09-17T01:02:04.017 INFO:tasks.workunit.client.0.smithi002.stdout:3/713: dread - d0/d3/d17/d9a/f5d zero size 2024-09-17T01:02:04.017 INFO:tasks.workunit.client.1.smithi099.stdout:3/826: unlink d9/d15/l71 0 2024-09-17T01:02:04.018 INFO:tasks.workunit.client.1.smithi099.stdout:3/827: stat d9/d15/d18/d1a/d23/f2c 0 2024-09-17T01:02:04.018 INFO:tasks.workunit.client.1.smithi099.stdout:3/828: creat d9/d15/d18/de5/f107 x:0 0 0 2024-09-17T01:02:04.018 INFO:tasks.workunit.client.0.smithi002.stdout:9/712: truncate d5/f29 707851 0 2024-09-17T01:02:04.018 INFO:tasks.workunit.client.0.smithi002.stdout:9/713: write d5/f4f [938538,78451] 0 2024-09-17T01:02:04.019 INFO:tasks.workunit.client.0.smithi002.stdout:4/912: rmdir d7/d19/d9f/d80/d62/dbe 39 2024-09-17T01:02:04.019 INFO:tasks.workunit.client.0.smithi002.stdout:4/913: readlink d7/de/d3a/d109/l10b 0 2024-09-17T01:02:04.019 INFO:tasks.workunit.client.0.smithi002.stdout:4/914: chown d7/de/fe7 873970482 1 2024-09-17T01:02:04.019 INFO:tasks.workunit.client.1.smithi099.stdout:3/829: unlink d9/d15/fc0 0 2024-09-17T01:02:04.019 INFO:tasks.workunit.client.1.smithi099.stdout:3/830: fdatasync d9/d15/d18/d1a/d23/d5c/d99/fcc 0 2024-09-17T01:02:04.020 INFO:tasks.workunit.client.0.smithi002.stdout:0/718: getdents dd/d19/d1a 0 2024-09-17T01:02:04.021 INFO:tasks.workunit.client.1.smithi099.stdout:3/831: mkdir d9/d15/d8f/de3/d108 0 2024-09-17T01:02:04.023 INFO:tasks.workunit.client.1.smithi099.stdout:3/832: dread d9/d15/d8f/f9f [0,4194304] 0 2024-09-17T01:02:04.027 INFO:tasks.workunit.client.0.smithi002.stdout:4/915: creat d7/d19/d9f/d80/d62/dbe/df4/f119 x:0 0 0 2024-09-17T01:02:04.030 INFO:tasks.workunit.client.0.smithi002.stdout:3/714: getdents d0/d3/d8d 0 2024-09-17T01:02:04.032 INFO:tasks.workunit.client.1.smithi099.stdout:3/833: fsync d9/d15/d18/de5/f107 0 2024-09-17T01:02:04.035 INFO:tasks.workunit.client.1.smithi099.stdout:3/834: dread d9/d15/d18/d1a/d23/d5c/d6e/f96 [0,4194304] 0 2024-09-17T01:02:04.035 INFO:tasks.workunit.client.0.smithi002.stdout:4/916: mknod d7/d19/d9f/d80/d62/dbe/c11a 0 2024-09-17T01:02:04.036 INFO:tasks.workunit.client.1.smithi099.stdout:3/835: link d9/d3b/d44/f48 d9/d15/d18/d1a/d23/d4c/de4/f109 0 2024-09-17T01:02:04.036 INFO:tasks.workunit.client.0.smithi002.stdout:3/715: getdents d0/d3/d17/d87 0 2024-09-17T01:02:04.037 INFO:tasks.workunit.client.0.smithi002.stdout:3/716: symlink d0/d3/d37/de3/le8 0 2024-09-17T01:02:04.037 INFO:tasks.workunit.client.1.smithi099.stdout:3/836: unlink d9/d15/d18/d1a/d23/l3e 0 2024-09-17T01:02:04.037 INFO:tasks.workunit.client.1.smithi099.stdout:3/837: readlink d9/l1d 0 2024-09-17T01:02:04.047 INFO:tasks.workunit.client.0.smithi002.stdout:5/757: dwrite d2/d2d/d10/d14/d19/d39/f3c [4194304,4194304] 0 2024-09-17T01:02:04.047 INFO:tasks.workunit.client.0.smithi002.stdout:0/719: dwrite dd/d19/d1c/db7/db4/fa3 [0,4194304] 0 2024-09-17T01:02:04.049 INFO:tasks.workunit.client.1.smithi099.stdout:9/766: sync 2024-09-17T01:02:04.049 INFO:tasks.workunit.client.1.smithi099.stdout:9/767: creat da/d56/d84/db9/ff7 x:0 0 0 2024-09-17T01:02:04.051 INFO:tasks.workunit.client.0.smithi002.stdout:0/720: creat dd/d19/d1c/d33/fee x:0 0 0 2024-09-17T01:02:04.053 INFO:tasks.workunit.client.0.smithi002.stdout:4/917: dread d7/d3f/da9/fbc [0,4194304] 0 2024-09-17T01:02:04.055 INFO:tasks.workunit.client.0.smithi002.stdout:0/721: symlink dd/d3d/lef 0 2024-09-17T01:02:04.056 INFO:tasks.workunit.client.0.smithi002.stdout:0/722: dread dd/fae [0,4194304] 0 2024-09-17T01:02:04.057 INFO:tasks.workunit.client.0.smithi002.stdout:5/758: write d2/d2d/d10/d14/d19/da5/db0/fc0 [2162964,86565] 0 2024-09-17T01:02:04.058 INFO:tasks.workunit.client.0.smithi002.stdout:0/723: truncate dd/d19/d1c/d1f/f77 3727782 0 2024-09-17T01:02:04.058 INFO:tasks.workunit.client.0.smithi002.stdout:3/717: dwrite d0/d3/d37/f47 [0,4194304] 0 2024-09-17T01:02:04.061 INFO:tasks.workunit.client.0.smithi002.stdout:3/718: unlink d0/d3/l4b 0 2024-09-17T01:02:04.061 INFO:tasks.workunit.client.0.smithi002.stdout:3/719: fdatasync d0/d3/d17/d9a/f7c 0 2024-09-17T01:02:04.062 INFO:tasks.workunit.client.0.smithi002.stdout:3/720: unlink d0/d31/l70 0 2024-09-17T01:02:04.063 INFO:tasks.workunit.client.0.smithi002.stdout:3/721: write d0/d3/d33/d40/fc3 [734735,52242] 0 2024-09-17T01:02:04.066 INFO:tasks.workunit.client.0.smithi002.stdout:8/976: sync 2024-09-17T01:02:04.066 INFO:tasks.workunit.client.0.smithi002.stdout:8/977: fsync d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d71/d89/fa8 0 2024-09-17T01:02:04.066 INFO:tasks.workunit.client.1.smithi099.stdout:9/768: dread da/d9a/f3d [0,4194304] 0 2024-09-17T01:02:04.066 INFO:tasks.workunit.client.1.smithi099.stdout:3/838: dwrite d9/d2b/fb0 [0,4194304] 0 2024-09-17T01:02:04.066 INFO:tasks.workunit.client.1.smithi099.stdout:9/769: chown da/d14/d40/l46 348291139 1 2024-09-17T01:02:04.066 INFO:tasks.workunit.client.1.smithi099.stdout:9/770: chown da/d14/d48/d69/f79 283194683 1 2024-09-17T01:02:04.070 INFO:tasks.workunit.client.1.smithi099.stdout:9/771: creat da/d14/ff8 x:0 0 0 2024-09-17T01:02:04.070 INFO:tasks.workunit.client.1.smithi099.stdout:9/772: fdatasync da/d14/d62/dad/ddc/fdf 0 2024-09-17T01:02:04.072 INFO:tasks.workunit.client.1.smithi099.stdout:3/839: creat d9/d15/d18/d1a/d23/d4c/de4/f10a x:0 0 0 2024-09-17T01:02:04.073 INFO:tasks.workunit.client.1.smithi099.stdout:9/773: mkdir da/d18/db3/df9 0 2024-09-17T01:02:04.073 INFO:tasks.workunit.client.1.smithi099.stdout:9/774: creat da/d50/ffa x:0 0 0 2024-09-17T01:02:04.074 INFO:tasks.workunit.client.1.smithi099.stdout:9/775: read da/d21/d2a/f54 [4983327,42976] 0 2024-09-17T01:02:04.074 INFO:tasks.workunit.client.1.smithi099.stdout:9/776: readlink da/d14/d48/l4e 0 2024-09-17T01:02:04.074 INFO:tasks.workunit.client.1.smithi099.stdout:3/840: mknod d9/d3b/c10b 0 2024-09-17T01:02:04.074 INFO:tasks.workunit.client.1.smithi099.stdout:3/841: creat d9/d15/f10c x:0 0 0 2024-09-17T01:02:04.075 INFO:tasks.workunit.client.0.smithi002.stdout:5/759: dread d2/d2d/d10/d23/d6a/fc6 [0,4194304] 0 2024-09-17T01:02:04.076 INFO:tasks.workunit.client.0.smithi002.stdout:5/760: rmdir d2/d2d/d10/d14/d19/d39/d48/def 39 2024-09-17T01:02:04.076 INFO:tasks.workunit.client.0.smithi002.stdout:5/761: dread - d2/de/d57/d80/fbb zero size 2024-09-17T01:02:04.076 INFO:tasks.workunit.client.0.smithi002.stdout:5/762: truncate d2/d2d/d10/d23/d6e/fd1 480157 0 2024-09-17T01:02:04.081 INFO:tasks.workunit.client.0.smithi002.stdout:4/918: dwrite d7/d19/d9c/de9/da4/fe1 [0,4194304] 0 2024-09-17T01:02:04.081 INFO:tasks.workunit.client.0.smithi002.stdout:4/919: chown d7/d19/f21 11751 1 2024-09-17T01:02:04.083 INFO:tasks.workunit.client.0.smithi002.stdout:4/920: mkdir d7/d71/d11b 0 2024-09-17T01:02:04.083 INFO:tasks.workunit.client.0.smithi002.stdout:4/921: mkdir d7/de/d32/d11c 0 2024-09-17T01:02:04.089 INFO:tasks.workunit.client.1.smithi099.stdout:3/842: truncate d9/d3b/f62 2593028 0 2024-09-17T01:02:04.090 INFO:tasks.workunit.client.1.smithi099.stdout:3/843: symlink d9/l10d 0 2024-09-17T01:02:04.123 INFO:tasks.workunit.client.0.smithi002.stdout:0/724: dwrite dd/d19/d1c/d1f/d76/f86 [0,4194304] 0 2024-09-17T01:02:04.123 INFO:tasks.workunit.client.0.smithi002.stdout:0/725: fsync dd/d19/d1a/d29/d55/f95 0 2024-09-17T01:02:04.123 INFO:tasks.workunit.client.0.smithi002.stdout:8/978: dwrite d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d58/fbc [0,4194304] 0 2024-09-17T01:02:04.123 INFO:tasks.workunit.client.0.smithi002.stdout:3/722: dwrite d0/d3/d17/d9a/f89 [0,4194304] 0 2024-09-17T01:02:04.124 INFO:tasks.workunit.client.0.smithi002.stdout:8/979: write d2/d9/dd/f2c [5262213,125673] 0 2024-09-17T01:02:04.128 INFO:tasks.workunit.client.0.smithi002.stdout:0/726: rename dd/d19/d1c/d1f/d22/f51 to dd/d19/d1a/d29/d55/d61/ff0 0 2024-09-17T01:02:04.129 INFO:tasks.workunit.client.0.smithi002.stdout:0/727: truncate dd/d19/d1c/f79 1459543 0 2024-09-17T01:02:04.129 INFO:tasks.workunit.client.0.smithi002.stdout:5/763: dwrite d2/d2d/d10/d23/d6e/d60/f8e [0,4194304] 0 2024-09-17T01:02:04.129 INFO:tasks.workunit.client.0.smithi002.stdout:5/764: chown d2/d2d/cd9 206044973 1 2024-09-17T01:02:04.129 INFO:tasks.workunit.client.0.smithi002.stdout:4/922: dwrite d7/d19/d9f/fb3 [0,4194304] 0 2024-09-17T01:02:04.130 INFO:tasks.workunit.client.1.smithi099.stdout:3/844: dwrite d9/d15/d18/d1a/f1b [8388608,4194304] 0 2024-09-17T01:02:04.130 INFO:tasks.workunit.client.1.smithi099.stdout:3/845: truncate d9/d15/d18/d1a/d23/d5c/d6e/d7e/fde 451507 0 2024-09-17T01:02:04.131 INFO:tasks.workunit.client.0.smithi002.stdout:3/723: creat d0/d3/d17/d87/fe9 x:0 0 0 2024-09-17T01:02:04.132 INFO:tasks.workunit.client.1.smithi099.stdout:3/846: read d9/d15/d18/d1a/d23/d5c/d6e/f96 [107109,100849] 0 2024-09-17T01:02:04.134 INFO:tasks.workunit.client.0.smithi002.stdout:5/765: mknod d2/de/cf2 0 2024-09-17T01:02:04.135 INFO:tasks.workunit.client.0.smithi002.stdout:3/724: symlink d0/d31/lea 0 2024-09-17T01:02:04.135 INFO:tasks.workunit.client.0.smithi002.stdout:3/725: write d0/d3/d17/d9a/daa/f8f [215576,65911] 0 2024-09-17T01:02:04.135 INFO:tasks.workunit.client.0.smithi002.stdout:3/726: chown d0/d3/d37/c9f 6 1 2024-09-17T01:02:04.136 INFO:tasks.workunit.client.0.smithi002.stdout:5/766: creat d2/de/ff3 x:0 0 0 2024-09-17T01:02:04.136 INFO:tasks.workunit.client.0.smithi002.stdout:4/923: getdents d7/de6 0 2024-09-17T01:02:04.136 INFO:tasks.workunit.client.0.smithi002.stdout:4/924: chown d7/d19/caf 2 1 2024-09-17T01:02:04.136 INFO:tasks.workunit.client.1.smithi099.stdout:3/847: link d9/d15/d18/d1a/d23/d5c/d99/ffe d9/d3b/d44/f10e 0 2024-09-17T01:02:04.137 INFO:tasks.workunit.client.0.smithi002.stdout:5/767: creat d2/d2d/d10/d23/d6e/d60/ff4 x:0 0 0 2024-09-17T01:02:04.137 INFO:tasks.workunit.client.0.smithi002.stdout:5/768: truncate d2/d2d/d10/d14/d19/d39/d43/fee 323319 0 2024-09-17T01:02:04.141 INFO:tasks.workunit.client.0.smithi002.stdout:5/769: link d2/d2d/d10/d14/d19/d39/d3f/l90 d2/de/d1d/lf5 0 2024-09-17T01:02:04.150 INFO:tasks.workunit.client.0.smithi002.stdout:3/727: write d0/d3/d33/d40/fc9 [1666774,87624] 0 2024-09-17T01:02:04.150 INFO:tasks.workunit.client.0.smithi002.stdout:8/980: dwrite d2/d1c/ff8 [0,4194304] 0 2024-09-17T01:02:04.151 INFO:tasks.workunit.client.0.smithi002.stdout:3/728: mknod d0/d31/d32/dcb/de7/ceb 0 2024-09-17T01:02:04.152 INFO:tasks.workunit.client.0.smithi002.stdout:3/729: creat d0/d3/d17/d9a/daa/fec x:0 0 0 2024-09-17T01:02:04.152 INFO:tasks.workunit.client.0.smithi002.stdout:3/730: fdatasync d0/f2f 0 2024-09-17T01:02:04.152 INFO:tasks.workunit.client.0.smithi002.stdout:3/731: read d0/d3/f8 [1342898,68536] 0 2024-09-17T01:02:04.152 INFO:tasks.workunit.client.0.smithi002.stdout:3/732: chown d0/d31/c8e 736789557 1 2024-09-17T01:02:04.152 INFO:tasks.workunit.client.1.smithi099.stdout:7/704: sync 2024-09-17T01:02:04.152 INFO:tasks.workunit.client.1.smithi099.stdout:5/830: sync 2024-09-17T01:02:04.154 INFO:tasks.workunit.client.0.smithi002.stdout:0/728: dwrite dd/f18 [4194304,4194304] 0 2024-09-17T01:02:04.155 INFO:tasks.workunit.client.0.smithi002.stdout:8/981: unlink d2/d41/lba 0 2024-09-17T01:02:04.157 INFO:tasks.workunit.client.0.smithi002.stdout:3/733: getdents d0/d3/d37/de3 0 2024-09-17T01:02:04.158 INFO:tasks.workunit.client.1.smithi099.stdout:7/705: rmdir d1/d37 39 2024-09-17T01:02:04.159 INFO:tasks.workunit.client.1.smithi099.stdout:7/706: rename d1/d2c/l31 to d1/d37/d4f/lde 0 2024-09-17T01:02:04.159 INFO:tasks.workunit.client.1.smithi099.stdout:7/707: chown d1/d2c/d5c/d1c/c42 9 1 2024-09-17T01:02:04.160 INFO:tasks.workunit.client.1.smithi099.stdout:7/708: chown d1/d2c/d47/d48/d60/l83 37413 1 2024-09-17T01:02:04.164 INFO:tasks.workunit.client.1.smithi099.stdout:7/709: rename d1/d2c/d5c/c8b to d1/d2c/cdf 0 2024-09-17T01:02:04.165 INFO:tasks.workunit.client.1.smithi099.stdout:7/710: truncate d1/d36/fa4 564887 0 2024-09-17T01:02:04.165 INFO:tasks.workunit.client.1.smithi099.stdout:7/711: creat d1/d2c/d47/d48/d60/fe0 x:0 0 0 2024-09-17T01:02:04.165 INFO:tasks.workunit.client.1.smithi099.stdout:7/712: link d1/d2c/d47/lb1 d1/d2c/d47/d48/d60/le1 0 2024-09-17T01:02:04.165 INFO:tasks.workunit.client.0.smithi002.stdout:0/729: creat dd/d19/d1c/d1f/d22/dde/ff1 x:0 0 0 2024-09-17T01:02:04.165 INFO:tasks.workunit.client.0.smithi002.stdout:0/730: stat dd/d19/d1a/l8b 0 2024-09-17T01:02:04.166 INFO:tasks.workunit.client.0.smithi002.stdout:0/731: write dd/d19/da9/de5/f66 [1221144,60739] 0 2024-09-17T01:02:04.166 INFO:tasks.workunit.client.0.smithi002.stdout:0/732: rename dd/d19/d1c/db7/db4/f9b to dd/d19/d1c/d1f/d39/ff2 0 2024-09-17T01:02:04.166 INFO:tasks.workunit.client.1.smithi099.stdout:7/713: truncate d1/d2c/d5c/d12/f4b 595465 0 2024-09-17T01:02:04.166 INFO:tasks.workunit.client.1.smithi099.stdout:7/714: chown d1/d8f 870146 1 2024-09-17T01:02:04.167 INFO:tasks.workunit.client.0.smithi002.stdout:0/733: rename dd/d19/d1c/l45 to dd/d19/d1c/db7/db4/lf3 0 2024-09-17T01:02:04.167 INFO:tasks.workunit.client.1.smithi099.stdout:7/715: link d1/d37/l5e d1/d2c/d5c/d1c/d72/le2 0 2024-09-17T01:02:04.177 INFO:tasks.workunit.client.0.smithi002.stdout:4/925: dwrite d7/f4f [0,4194304] 0 2024-09-17T01:02:04.182 INFO:tasks.workunit.client.1.smithi099.stdout:7/716: dread d1/d2c/d5c/d1c/d72/f86 [0,4194304] 0 2024-09-17T01:02:04.182 INFO:tasks.workunit.client.1.smithi099.stdout:7/717: readlink d1/d2c/d5c/d1c/l8c 0 2024-09-17T01:02:04.186 INFO:tasks.workunit.client.0.smithi002.stdout:5/770: dwrite d2/de/f4f [4194304,4194304] 0 2024-09-17T01:02:04.188 INFO:tasks.workunit.client.1.smithi099.stdout:5/831: dwrite d2/d8/f7a [0,4194304] 0 2024-09-17T01:02:04.189 INFO:tasks.workunit.client.0.smithi002.stdout:3/734: dwrite d0/d3/d37/dac/da1/fb6 [0,4194304] 0 2024-09-17T01:02:04.189 INFO:tasks.workunit.client.0.smithi002.stdout:3/735: chown d0/d3/d33/d40/f45 3 1 2024-09-17T01:02:04.189 INFO:tasks.workunit.client.0.smithi002.stdout:3/736: write d0/d31/d32/f81 [665743,40127] 0 2024-09-17T01:02:04.189 INFO:tasks.workunit.client.0.smithi002.stdout:3/737: chown d0/d3/d33/d40/fc3 6120 1 2024-09-17T01:02:04.190 INFO:tasks.workunit.client.0.smithi002.stdout:5/771: unlink d2/d2d/d10/d14/d19/d39/fd6 0 2024-09-17T01:02:04.190 INFO:tasks.workunit.client.0.smithi002.stdout:5/772: read - d2/d2d/d10/d14/f88 zero size 2024-09-17T01:02:04.190 INFO:tasks.workunit.client.0.smithi002.stdout:4/926: write d7/de/fe7 [3021753,84949] 0 2024-09-17T01:02:04.190 INFO:tasks.workunit.client.0.smithi002.stdout:4/927: readlink d7/d19/d9f/d80/l10a 0 2024-09-17T01:02:04.194 INFO:tasks.workunit.client.0.smithi002.stdout:3/738: unlink d0/d3/lbe 0 2024-09-17T01:02:04.194 INFO:tasks.workunit.client.0.smithi002.stdout:3/739: stat d0/d3/d37/dac/da1/de4 0 2024-09-17T01:02:04.195 INFO:tasks.workunit.client.0.smithi002.stdout:5/773: dread d2/d2d/d10/d3b/f5e [0,4194304] 0 2024-09-17T01:02:04.197 INFO:tasks.workunit.client.0.smithi002.stdout:5/774: mknod d2/d2d/d10/d23/cf6 0 2024-09-17T01:02:04.197 INFO:tasks.workunit.client.0.smithi002.stdout:5/775: readlink d2/de/d1d/l30 0 2024-09-17T01:02:04.198 INFO:tasks.workunit.client.0.smithi002.stdout:1/833: sync 2024-09-17T01:02:04.203 INFO:tasks.workunit.client.0.smithi002.stdout:9/714: sync 2024-09-17T01:02:04.203 INFO:tasks.workunit.client.0.smithi002.stdout:6/853: sync 2024-09-17T01:02:04.203 INFO:tasks.workunit.client.0.smithi002.stdout:2/793: sync 2024-09-17T01:02:04.203 INFO:tasks.workunit.client.0.smithi002.stdout:7/835: sync 2024-09-17T01:02:04.203 INFO:tasks.workunit.client.0.smithi002.stdout:7/836: dread - d1/d14/d1d/d28/d8f/de0/f108 zero size 2024-09-17T01:02:04.207 INFO:tasks.workunit.client.0.smithi002.stdout:1/834: dread d4/d11/d1a/d95/f9b [0,4194304] 0 2024-09-17T01:02:04.208 INFO:tasks.workunit.client.0.smithi002.stdout:4/928: dwrite d7/de/d3a/d99/fbf [0,4194304] 0 2024-09-17T01:02:04.208 INFO:tasks.workunit.client.0.smithi002.stdout:4/929: chown d7/de/d32/d59/d10f/dfa/ffb 9 1 2024-09-17T01:02:04.209 INFO:tasks.workunit.client.0.smithi002.stdout:4/930: stat d7/d19/d2e/dc0/f101 0 2024-09-17T01:02:04.209 INFO:tasks.workunit.client.0.smithi002.stdout:1/835: creat d4/f118 x:0 0 0 2024-09-17T01:02:04.210 INFO:tasks.workunit.client.0.smithi002.stdout:4/931: rmdir d7 39 2024-09-17T01:02:04.211 INFO:tasks.workunit.client.0.smithi002.stdout:1/836: creat d4/d11/d12/d23/d32/de3/f119 x:0 0 0 2024-09-17T01:02:04.211 INFO:tasks.workunit.client.0.smithi002.stdout:1/837: creat d4/d11/d12/d23/d32/d86/f11a x:0 0 0 2024-09-17T01:02:04.214 INFO:tasks.workunit.client.0.smithi002.stdout:6/854: dread d2/f13 [0,4194304] 0 2024-09-17T01:02:04.216 INFO:tasks.workunit.client.0.smithi002.stdout:1/838: rmdir d4/d11/d1a/daa 39 2024-09-17T01:02:04.217 INFO:tasks.workunit.client.0.smithi002.stdout:6/855: symlink d2/d1d/d2d/d73/l11c 0 2024-09-17T01:02:04.217 INFO:tasks.workunit.client.0.smithi002.stdout:7/837: dread d1/d14/d1d/d28/d40/d58/fab [0,4194304] 0 2024-09-17T01:02:04.218 INFO:tasks.workunit.client.0.smithi002.stdout:1/839: creat d4/d11/d12/d14/d17/d3b/f11b x:0 0 0 2024-09-17T01:02:04.219 INFO:tasks.workunit.client.0.smithi002.stdout:6/856: mknod d2/d95/c11d 0 2024-09-17T01:02:04.220 INFO:tasks.workunit.client.0.smithi002.stdout:7/838: mkdir d1/d14/d1d/d28/d86/d10b 0 2024-09-17T01:02:04.222 INFO:tasks.workunit.client.0.smithi002.stdout:1/840: rmdir d4/d11/d12/d23/d32/d10d 0 2024-09-17T01:02:04.223 INFO:tasks.workunit.client.0.smithi002.stdout:6/857: mknod d2/d1d/d27/d80/d93/dd5/c11e 0 2024-09-17T01:02:04.223 INFO:tasks.workunit.client.0.smithi002.stdout:6/858: truncate d2/f19 1322765 0 2024-09-17T01:02:04.224 INFO:tasks.workunit.client.0.smithi002.stdout:7/839: symlink d1/dac/l10c 0 2024-09-17T01:02:04.225 INFO:tasks.workunit.client.0.smithi002.stdout:1/841: mkdir d4/d11/d55/dbc/dff/d11c 0 2024-09-17T01:02:04.226 INFO:tasks.workunit.client.0.smithi002.stdout:6/859: link d2/dc/d24/d53/d83/da9/c60 d2/d1d/d26/d49/c11f 0 2024-09-17T01:02:04.227 INFO:tasks.workunit.client.0.smithi002.stdout:6/860: symlink d2/d1d/d27/d80/l120 0 2024-09-17T01:02:04.234 INFO:tasks.workunit.client.0.smithi002.stdout:7/840: write d1/d14/d1d/d28/d40/f5f [3801772,79984] 0 2024-09-17T01:02:04.236 INFO:tasks.workunit.client.0.smithi002.stdout:7/841: symlink d1/d14/d1d/d28/d86/l10d 0 2024-09-17T01:02:04.236 INFO:tasks.workunit.client.0.smithi002.stdout:7/842: getdents d1/d14/d1d/d28/d86/dff 0 2024-09-17T01:02:04.236 INFO:tasks.workunit.client.0.smithi002.stdout:7/843: fsync d1/d14/d1d/d28/f6e 0 2024-09-17T01:02:04.237 INFO:tasks.workunit.client.0.smithi002.stdout:7/844: chown d1/d14/d1d/d29/d57 8408729 1 2024-09-17T01:02:04.237 INFO:tasks.workunit.client.0.smithi002.stdout:7/845: dread - d1/d14/d1d/d28/d6b/d9e/d54/fbe zero size 2024-09-17T01:02:04.237 INFO:tasks.workunit.client.0.smithi002.stdout:7/846: creat d1/d14/d1d/d28/d6b/d9e/f10e x:0 0 0 2024-09-17T01:02:04.237 INFO:tasks.workunit.client.0.smithi002.stdout:1/842: write d4/d11/fa8 [742496,85956] 0 2024-09-17T01:02:04.238 INFO:tasks.workunit.client.0.smithi002.stdout:7/847: unlink d1/d14/d67/dc0/dcd/ffc 0 2024-09-17T01:02:04.239 INFO:tasks.workunit.client.1.smithi099.stdout:5/832: symlink d2/dc4/l114 0 2024-09-17T01:02:04.239 INFO:tasks.workunit.client.1.smithi099.stdout:5/833: fdatasync d2/f5 0 2024-09-17T01:02:04.239 INFO:tasks.workunit.client.0.smithi002.stdout:1/843: symlink d4/d11/d12/d14/d17/ddb/df9/l11d 0 2024-09-17T01:02:04.241 INFO:tasks.workunit.client.1.smithi099.stdout:5/834: symlink d2/dc/d17/d3c/d72/l115 0 2024-09-17T01:02:04.241 INFO:tasks.workunit.client.1.smithi099.stdout:5/835: write d2/dc/d17/f5d [5700954,58172] 0 2024-09-17T01:02:04.244 INFO:tasks.workunit.client.0.smithi002.stdout:3/740: dwrite d0/d3/d33/d93/fb0 [0,4194304] 0 2024-09-17T01:02:04.244 INFO:tasks.workunit.client.0.smithi002.stdout:3/741: chown d0/d3/d33/f55 104419360 1 2024-09-17T01:02:04.245 INFO:tasks.workunit.client.0.smithi002.stdout:8/982: dwrite d2/d9/f97 [0,4194304] 0 2024-09-17T01:02:04.245 INFO:tasks.workunit.client.0.smithi002.stdout:7/848: dread d1/d14/d1d/d28/d6b/d9e/f69 [0,4194304] 0 2024-09-17T01:02:04.247 INFO:tasks.workunit.client.0.smithi002.stdout:4/932: dwrite d7/d19/d9f/d80/fcb [0,4194304] 0 2024-09-17T01:02:04.248 INFO:tasks.workunit.client.0.smithi002.stdout:8/983: creat d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d47/d102/f13a x:0 0 0 2024-09-17T01:02:04.248 INFO:tasks.workunit.client.0.smithi002.stdout:8/984: chown d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/fb7 3537147 1 2024-09-17T01:02:04.248 INFO:tasks.workunit.client.0.smithi002.stdout:8/985: chown d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d58/fec 43 1 2024-09-17T01:02:04.248 INFO:tasks.workunit.client.0.smithi002.stdout:7/849: symlink d1/d14/d1d/d28/d6b/d9e/d10a/l10f 0 2024-09-17T01:02:04.251 INFO:tasks.workunit.client.0.smithi002.stdout:7/850: unlink d1/d14/d1d/d28/d6b/l74 0 2024-09-17T01:02:04.251 INFO:tasks.workunit.client.0.smithi002.stdout:7/851: truncate d1/d14/d1d/d28/d40/f92 4897615 0 2024-09-17T01:02:04.251 INFO:tasks.workunit.client.0.smithi002.stdout:8/986: dread d2/d1c/d28/f81 [0,4194304] 0 2024-09-17T01:02:04.251 INFO:tasks.workunit.client.0.smithi002.stdout:8/987: readlink d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d47/d80/lb6 0 2024-09-17T01:02:04.252 INFO:tasks.workunit.client.0.smithi002.stdout:3/742: dread d0/d3/d17/d6a/fb7 [0,4194304] 0 2024-09-17T01:02:04.252 INFO:tasks.workunit.client.0.smithi002.stdout:3/743: chown d0/d3/d37/f7e 108815991 1 2024-09-17T01:02:04.252 INFO:tasks.workunit.client.0.smithi002.stdout:9/715: dwrite d5/dc/f99 [0,4194304] 0 2024-09-17T01:02:04.253 INFO:tasks.workunit.client.0.smithi002.stdout:9/716: write d5/d8a/d9d/fce [575127,22388] 0 2024-09-17T01:02:04.253 INFO:tasks.workunit.client.0.smithi002.stdout:9/717: stat d5/dc/f99 0 2024-09-17T01:02:04.253 INFO:tasks.workunit.client.0.smithi002.stdout:8/988: rmdir d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d47/d80 39 2024-09-17T01:02:04.253 INFO:tasks.workunit.client.0.smithi002.stdout:8/989: write d2/d9/d9c/d133/f138 [427951,46754] 0 2024-09-17T01:02:04.255 INFO:tasks.workunit.client.0.smithi002.stdout:8/990: dread d2/d1c/d28/dad/dcd/dd1/ddb/d10f/de6/f10e [0,4194304] 0 2024-09-17T01:02:04.257 INFO:tasks.workunit.client.0.smithi002.stdout:8/991: symlink d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d58/dbd/l13b 0 2024-09-17T01:02:04.258 INFO:tasks.workunit.client.0.smithi002.stdout:9/718: dread d5/dc/d26/d5c/d6b/f9b [0,4194304] 0 2024-09-17T01:02:04.259 INFO:tasks.workunit.client.0.smithi002.stdout:8/992: symlink d2/d26/dbb/l13c 0 2024-09-17T01:02:04.260 INFO:tasks.workunit.client.0.smithi002.stdout:9/719: mkdir d5/dc/d26/d5c/d6b/d75/d57/d8d/dd6 0 2024-09-17T01:02:04.262 INFO:tasks.workunit.client.0.smithi002.stdout:6/861: dwrite d2/d1d/d99/fee [0,4194304] 0 2024-09-17T01:02:04.263 INFO:tasks.workunit.client.0.smithi002.stdout:6/862: mknod d2/d95/c121 0 2024-09-17T01:02:04.264 INFO:tasks.workunit.client.0.smithi002.stdout:4/933: write d7/d19/fe4 [5638492,60482] 0 2024-09-17T01:02:04.264 INFO:tasks.workunit.client.0.smithi002.stdout:5/776: dwrite d2/d2d/d10/d20/d24/fe9 [0,4194304] 0 2024-09-17T01:02:04.264 INFO:tasks.workunit.client.0.smithi002.stdout:4/934: chown d7/d19/d2e/c35 551 1 2024-09-17T01:02:04.264 INFO:tasks.workunit.client.0.smithi002.stdout:4/935: chown d7/d19/d2e/c35 127669809 1 2024-09-17T01:02:04.268 INFO:tasks.workunit.client.0.smithi002.stdout:4/936: rename d7/d19/d2e to d7/de/d3a/d109/dc7/d11d 0 2024-09-17T01:02:04.270 INFO:tasks.workunit.client.0.smithi002.stdout:7/852: write d1/d14/d1d/d28/f6e [1120310,6907] 0 2024-09-17T01:02:04.271 INFO:tasks.workunit.client.0.smithi002.stdout:4/937: unlink d7/d19/d9f/d80/f5a 0 2024-09-17T01:02:04.274 INFO:tasks.workunit.client.0.smithi002.stdout:4/938: truncate d7/de/d3a/d109/dc7/d11d/d103/d108/f110 1568746 0 2024-09-17T01:02:04.276 INFO:tasks.workunit.client.0.smithi002.stdout:8/993: write d2/d26/f57 [1410254,92606] 0 2024-09-17T01:02:04.276 INFO:tasks.workunit.client.0.smithi002.stdout:8/994: write d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/f134 [592928,64407] 0 2024-09-17T01:02:04.276 INFO:tasks.workunit.client.0.smithi002.stdout:8/995: fdatasync d2/d9/dd/f8c 0 2024-09-17T01:02:04.282 INFO:tasks.workunit.client.1.smithi099.stdout:5/836: write d2/f7 [1305836,3499] 0 2024-09-17T01:02:04.283 INFO:tasks.workunit.client.0.smithi002.stdout:8/996: unlink d2/d1c/d28/dad/dcd/dd1/ddb/d10f/d5f/d98/da5/d4f/d58/f60 0 2024-09-17T01:02:04.283 INFO:tasks.workunit.client.0.smithi002.stdout:8/997: chown d2/d9/f20 377934209 1 2024-09-17T01:02:04.283 INFO:tasks.workunit.client.0.smithi002.stdout:8/998: write d2/d1c/d28/dad/dcd/dd1/ddb/d10f/f6e [954782,107070] 0 2024-09-17T01:02:04.284 INFO:tasks.workunit.client.1.smithi099.stdout:5/837: rename d2/d8/f35 to d2/dc4/d99/dd0/f116 0 2024-09-17T01:02:04.285 INFO:tasks.workunit.client.1.smithi099.stdout:5/838: rmdir d2/dc/d14/d36/d9a 39 2024-09-17T01:02:04.285 INFO:tasks.workunit.client.1.smithi099.stdout:5/839: chown d2/dc/d14/c1f 27 1 2024-09-17T01:02:04.285 INFO:tasks.workunit.client.1.smithi099.stdout:5/840: write d2/dc/d6c/fff [1027208,104277] 0 2024-09-17T01:02:04.285 INFO:tasks.workunit.client.1.smithi099.stdout:2/678: sync 2024-09-17T01:02:04.286 INFO:tasks.workunit.client.0.smithi002.stdout:1/844: dwrite d4/d11/d12/d14/d17/d3b/f42 [0,4194304] 0 2024-09-17T01:02:04.287 INFO:tasks.workunit.client.0.smithi002.stdout:1/845: creat d4/d11/d55/dbc/dff/f11e x:0 0 0 2024-09-17T01:02:04.291 INFO:tasks.workunit.client.0.smithi002.stdout:8/999: write d2/d41/fe3 [1577258,57005] 0 2024-09-17T01:02:04.291 INFO:tasks.workunit.client.0.smithi002.stdout:3/744: dwrite d0/d31/fce [0,4194304] 0 2024-09-17T01:02:04.292 INFO:tasks.workunit.client.0.smithi002.stdout:3/745: write d0/d3/d17/f29 [3916716,114607] 0 2024-09-17T01:02:04.294 INFO:tasks.workunit.client.0.smithi002.stdout:5/777: dwrite d2/d2d/d10/d14/d19/d39/d64/fb6 [0,4194304] 0 2024-09-17T01:02:04.296 INFO:tasks.workunit.client.0.smithi002.stdout:3/746: mkdir d0/d3/d33/d99/dab/ded 0 2024-09-17T01:02:04.297 INFO:tasks.workunit.client.0.smithi002.stdout:5/778: truncate d2/d2d/d10/d14/d59/f8f 206863 0 2024-09-17T01:02:04.298 INFO:tasks.workunit.client.1.smithi099.stdout:2/679: write d2/d9/d17/f69 [1926759,76045] 0 2024-09-17T01:02:04.298 INFO:tasks.workunit.client.1.smithi099.stdout:5/841: dread d2/f18 [0,4194304] 0 2024-09-17T01:02:04.298 INFO:tasks.workunit.client.0.smithi002.stdout:3/747: creat d0/d3/d8d/fee x:0 0 0 2024-09-17T01:02:04.302 INFO:tasks.workunit.client.1.smithi099.stdout:2/680: unlink d2/d9/d17/ld1 0 2024-09-17T01:02:04.302 INFO:tasks.workunit.client.1.smithi099.stdout:2/681: rename d2/d9 to d2/d9/d25/d26/d1b/d2c/d9b/db1/dda 22 2024-09-17T01:02:04.302 INFO:tasks.workunit.client.1.smithi099.stdout:2/682: write d2/d9/d25/d26/d1b/d2c/d3f/f45 [2476655,75952] 0 2024-09-17T01:02:04.303 INFO:tasks.workunit.client.1.smithi099.stdout:2/683: mknod d2/d9/d25/d26/d1b/d2c/d3f/db8/cdb 0 2024-09-17T01:02:04.303 INFO:tasks.workunit.client.1.smithi099.stdout:2/684: fsync d2/d9/d17/d58/faa 0 2024-09-17T01:02:04.303 INFO:tasks.workunit.client.1.smithi099.stdout:2/685: fdatasync d2/d9/d25/d26/d1b/d2c/d3f/fa9 0 2024-09-17T01:02:04.303 INFO:tasks.workunit.client.1.smithi099.stdout:2/686: stat d2/d9/d17/d83/dae/lb0 0 2024-09-17T01:02:04.304 INFO:tasks.workunit.client.0.smithi002.stdout:1/846: dread d4/d11/d12/d30/d5e/d8c/fc1 [0,4194304] 0 2024-09-17T01:02:04.304 INFO:tasks.workunit.client.0.smithi002.stdout:1/847: symlink d4/d11/d55/dbc/dff/l11f 0 2024-09-17T01:02:04.305 INFO:tasks.workunit.client.1.smithi099.stdout:5/842: dread d2/dc/d14/f4f [0,4194304] 0 2024-09-17T01:02:04.306 INFO:tasks.workunit.client.0.smithi002.stdout:1/848: link d4/d11/d1c/l5f d4/d11/d12/d14/d17/d51/d88/da3/l120 0 2024-09-17T01:02:04.307 INFO:tasks.workunit.client.0.smithi002.stdout:3/748: write d0/d3/d17/f6f [2941799,54487] 0 2024-09-17T01:02:04.308 INFO:tasks.workunit.client.0.smithi002.stdout:4/939: dwrite d7/d19/d9c/de9/da4/fe1 [0,4194304] 0 2024-09-17T01:02:04.308 INFO:tasks.workunit.client.1.smithi099.stdout:5/843: truncate d2/dc4/f10a 4106834 0 2024-09-17T01:02:04.309 INFO:tasks.workunit.client.1.smithi099.stdout:2/687: dread d2/d9/d17/d83/dca/fd3 [0,4194304] 0 2024-09-17T01:02:04.309 INFO:tasks.workunit.client.1.smithi099.stdout:5/844: symlink d2/d26/d64/l117 0 2024-09-17T01:02:04.311 INFO:tasks.workunit.client.0.smithi002.stdout:1/849: dread d4/d11/fa8 [0,4194304] 0 2024-09-17T01:02:04.312 INFO:tasks.workunit.client.1.smithi099.stdout:2/688: rename d2/d9/d25/d26/d1b/d61/d7d/d85/d98/fd6 to d2/d9/d25/d26/d1b/d2c/fdc 0 2024-09-17T01:02:04.312 INFO:tasks.workunit.client.1.smithi099.stdout:2/689: readlink d2/d9/d25/d26/d1b/d61/d7d/d85/lcc 0 2024-09-17T01:02:04.312 INFO:tasks.workunit.client.1.smithi099.stdout:2/690: write d2/d9/d25/d26/d1b/d2c/d9b/db1/fd7 [413931,108290] 0 2024-09-17T01:02:04.313 INFO:tasks.workunit.client.1.smithi099.stdout:5/845: link d2/dc/d17/d6b/lcd d2/l118 0 2024-09-17T01:02:04.315 INFO:tasks.workunit.client.0.smithi002.stdout:5/779: dread d2/d2d/d10/d14/d19/f1c [0,4194304] 0 2024-09-17T01:02:04.315 INFO:tasks.workunit.client.0.smithi002.stdout:5/780: creat d2/d2d/d10/d23/d6e/ff7 x:0 0 0 2024-09-17T01:02:04.315 INFO:tasks.workunit.client.0.smithi002.stdout:5/781: read d2/d2d/d10/d14/d19/d39/d25/fe6 [3167481,44898] 0 2024-09-17T01:02:04.315 INFO:tasks.workunit.client.0.smithi002.stdout:7/853: dwrite d1/d14/d1d/d28/d40/fd6 [4194304,4194304] 0 2024-09-17T01:02:04.316 INFO:tasks.workunit.client.0.smithi002.stdout:7/854: write d1/d14/d1d/d28/d6b/f83 [2144651,8143] 0 2024-09-17T01:02:04.316 INFO:tasks.workunit.client.0.smithi002.stdout:7/855: dread - d1/d14/d1d/d28/d8f/de0/f108 zero size 2024-09-17T01:02:04.316 INFO:tasks.workunit.client.0.smithi002.stdout:3/749: dread d0/d3/d17/d9a/fc0 [0,4194304] 0 2024-09-17T01:02:04.316 INFO:tasks.workunit.client.0.smithi002.stdout:4/940: rename d7/f18 to d7/d71/d8e/f11e 0 2024-09-17T01:02:04.317 INFO:tasks.workunit.client.0.smithi002.stdout:3/750: dread d0/d3/d17/f68 [0,4194304] 0 2024-09-17T01:02:04.318 INFO:tasks.workunit.client.0.smithi002.stdout:5/782: truncate d2/d2d/d10/d14/d19/d39/f52 210445 0 2024-09-17T01:02:04.318 INFO:tasks.workunit.client.1.smithi099.stdout:2/691: rename d2/d9/d25/d26/d1b/d2c/d3f/l56 to d2/d9/d25/d26/d1b/d2c/d9b/db1/ldd 0 2024-09-17T01:02:04.318 INFO:tasks.workunit.client.1.smithi099.stdout:5/846: unlink d2/d26/c86 0 2024-09-17T01:02:04.319 INFO:tasks.workunit.client.1.smithi099.stdout:5/847: mknod d2/dc/d14/d89/c119 0 2024-09-17T01:02:04.321 INFO:tasks.workunit.client.1.smithi099.stdout:5/848: symlink d2/d26/d64/df8/l11a 0 2024-09-17T01:02:04.326 INFO:tasks.workunit.client.1.smithi099.stdout:5/849: symlink d2/dc/d17/d3c/d81/l11b 0 2024-09-17T01:02:04.326 INFO:tasks.workunit.client.1.smithi099.stdout:5/850: read d2/f18 [5023321,70380] 0 2024-09-17T01:02:04.327 INFO:tasks.workunit.client.0.smithi002.stdout:1/850: rename d4/d11/d12/d30/d5e/d8c/f116 to d4/d11/d12/d30/d5e/df1/f121 0 2024-09-17T01:02:04.329 INFO:tasks.workunit.client.1.smithi099.stdout:5/851: getdents d2/d45 0 2024-09-17T01:02:04.329 INFO:tasks.workunit.client.1.smithi099.stdout:5/852: fdatasync d2/f3 0 2024-09-17T01:02:04.332 INFO:tasks.workunit.client.0.smithi002.stdout:3/751: unlink d0/d31/d8b/fc2 0 2024-09-17T01:02:04.332 INFO:tasks.workunit.client.0.smithi002.stdout:1/851: getdents d4/d22/d8d/de8 0 2024-09-17T01:02:04.333 INFO:tasks.workunit.client.1.smithi099.stdout:5/853: symlink d2/d26/d64/df8/l11c 0 2024-09-17T01:02:04.334 INFO:tasks.workunit.client.0.smithi002.stdout:7/856: rename d1/d14/d1d/d28/d86/dff to d1/d14/d1d/d28/d86/d10b/d110 0 2024-09-17T01:02:04.337 INFO:tasks.workunit.client.0.smithi002.stdout:1/852: creat d4/d11/d12/d14/d17/d51/d88/da3/f122 x:0 0 0 2024-09-17T01:02:04.338 INFO:tasks.workunit.client.0.smithi002.stdout:1/853: chown d4/d11/d12/d14/d17/lec 1 1 2024-09-17T01:02:04.341 INFO:tasks.workunit.client.0.smithi002.stdout:7/857: rename d1/d14/d1d/d28/d40/d58/de5 to d1/d14/d1d/d28/d111 0 2024-09-17T01:02:04.341 INFO:tasks.workunit.client.0.smithi002.stdout:7/858: fsync d1/d14/d1d/d28/d40/f92 0 2024-09-17T01:02:04.343 INFO:tasks.workunit.client.0.smithi002.stdout:7/859: dread d1/f26 [0,4194304] 0 2024-09-17T01:02:04.343 INFO:tasks.workunit.client.0.smithi002.stdout:7/860: creat d1/d14/d1d/d28/d8f/f112 x:0 0 0 2024-09-17T01:02:04.346 INFO:tasks.workunit.client.0.smithi002.stdout:1/854: dread d4/d11/d1c/f66 [0,4194304] 0 2024-09-17T01:02:04.358 INFO:tasks.workunit.client.0.smithi002.stdout:3/752: dread d0/d3/d37/f7e [0,4194304] 0 2024-09-17T01:02:04.358 INFO:tasks.workunit.client.0.smithi002.stdout:3/753: truncate d0/d3/d37/f47 4271352 0 2024-09-17T01:02:04.358 INFO:tasks.workunit.client.0.smithi002.stdout:3/754: chown d0/d3/d37/lbc 57043887 1 2024-09-17T01:02:04.370 INFO:tasks.workunit.client.1.smithi099.stdout:5/854: write d2/d26/fdd [1822161,57618] 0 2024-09-17T01:02:04.370 INFO:tasks.workunit.client.1.smithi099.stdout:5/855: chown d2/dc4/lae 626617647 1 2024-09-17T01:02:04.371 INFO:tasks.workunit.client.1.smithi099.stdout:5/856: mkdir d2/dc4/d99/dd0/dc3/dc8/d11d 0 2024-09-17T01:02:04.371 INFO:tasks.workunit.client.1.smithi099.stdout:5/857: truncate d2/dc/d17/f3a 5065451 0 2024-09-17T01:02:04.371 INFO:tasks.workunit.client.1.smithi099.stdout:5/858: creat d2/dc4/d99/dd0/db2/f11e x:0 0 0 2024-09-17T01:02:04.373 INFO:tasks.workunit.client.1.smithi099.stdout:5/859: creat d2/dc/d17/d6b/f11f x:0 0 0 2024-09-17T01:02:04.373 INFO:tasks.workunit.client.1.smithi099.stdout:5/860: readlink d2/dc/l1e 0 2024-09-17T01:02:04.385 INFO:tasks.workunit.client.1.smithi099.stdout:5/861: dread d2/dc4/f10a [0,4194304] 0 2024-09-17T01:02:04.391 INFO:tasks.workunit.client.1.smithi099.stdout:2/692: dwrite d2/d9/d25/f7b [0,4194304] 0 2024-09-17T01:02:04.392 INFO:tasks.workunit.client.0.smithi002.stdout:4/941: dwrite d7/de/d3a/f97 [0,4194304] 0 2024-09-17T01:02:04.393 INFO:tasks.workunit.client.0.smithi002.stdout:3/755: dwrite d0/f21 [0,4194304] 0 2024-09-17T01:02:04.393 INFO:tasks.workunit.client.1.smithi099.stdout:5/862: write f0 [880413,81863] 0 2024-09-17T01:02:04.394 INFO:tasks.workunit.client.0.smithi002.stdout:5/783: dwrite d2/d2d/d10/d14/d19/d39/dae/fc9 [0,4194304] 0 2024-09-17T01:02:04.396 INFO:tasks.workunit.client.1.smithi099.stdout:2/693: stat d2/d9/d17/ca4 0 2024-09-17T01:02:04.396 INFO:tasks.workunit.client.0.smithi002.stdout:3/756: dread d0/d3/d33/d40/fc3 [0,4194304] 0 2024-09-17T01:02:04.397 INFO:tasks.workunit.client.0.smithi002.stdout:3/757: truncate d0/f61 909303 0 2024-09-17T01:02:04.401 INFO:tasks.workunit.client.1.smithi099.stdout:5/863: creat d2/d45/f120 x:0 0 0 2024-09-17T01:02:04.401 INFO:tasks.workunit.client.1.smithi099.stdout:5/864: chown d2/dc/d17/f70 51 1 2024-09-17T01:02:04.401 INFO:tasks.workunit.client.0.smithi002.stdout:4/942: write d7/d71/d8e/dd0/f81 [185618,116083] 0 2024-09-17T01:02:04.403 INFO:tasks.workunit.client.1.smithi099.stdout:2/694: rename d2/d9/d17/d83/f9f to d2/d9/d17/d83/dca/fde 0 2024-09-17T01:02:04.405 INFO:tasks.workunit.client.1.smithi099.stdout:5/865: unlink d2/dc/d6c/c88 0 2024-09-17T01:02:04.405 INFO:tasks.workunit.client.0.smithi002.stdout:4/943: symlink d7/de/d3a/d109/dc7/d77/d9b/dcc/l11f 0 2024-09-17T01:02:04.406 INFO:tasks.workunit.client.1.smithi099.stdout:5/866: creat d2/dc/d14/d36/d9a/f121 x:0 0 0 2024-09-17T01:02:04.407 INFO:tasks.workunit.client.1.smithi099.stdout:2/695: dread d2/d9/d25/d26/d1b/d2c/d9b/db1/fd7 [0,4194304] 0 2024-09-17T01:02:04.410 INFO:tasks.workunit.client.0.smithi002.stdout:7/861: rename d1/d14/d1d/d28/d40/d58 to d1/d14/d67/dc0/dcd/d45/d113 0 2024-09-17T01:02:04.410 INFO:tasks.workunit.client.0.smithi002.stdout:7/862: chown d1/d14/f3f 198 1 2024-09-17T01:02:04.410 INFO:tasks.workunit.client.1.smithi099.stdout:2/696: rename d2/d9/d25/d26/d1b/d2c/d3f/fa9 to d2/d9/d25/d26/d1b/d2c/d9b/fdf 0 2024-09-17T01:02:04.411 INFO:tasks.workunit.client.0.smithi002.stdout:1/855: rename d4/d11/d12/d14/d17/d20/cca to d4/d11/d1c/c123 0 2024-09-17T01:02:04.415 INFO:tasks.workunit.client.0.smithi002.stdout:5/784: rename d2/d2d/d10/d20/d24/fe9 to d2/d2d/d10/d14/d19/d39/d64/ff8 0 2024-09-17T01:02:04.415 INFO:tasks.workunit.client.0.smithi002.stdout:5/785: chown d2/d2d/d10/d14/d19/d39/de5/led 14310 1 2024-09-17T01:02:04.417 INFO:tasks.workunit.client.0.smithi002.stdout:1/856: mknod d4/d11/d12/d14/d17/d51/d88/c124 0 2024-09-17T01:02:04.419 INFO:tasks.workunit.client.0.smithi002.stdout:7/863: rmdir d1/d14/d1d/d28/d8f/de0 39 2024-09-17T01:02:04.419 INFO:tasks.workunit.client.0.smithi002.stdout:7/864: creat d1/d14/d67/dc0/dcd/f114 x:0 0 0 2024-09-17T01:02:04.423 INFO:tasks.workunit.client.0.smithi002.stdout:3/758: rename d0/d31/c8e to d0/d31/d32/cef 0 2024-09-17T01:02:04.424 INFO:tasks.workunit.client.0.smithi002.stdout:5/786: truncate d2/d2d/d10/d23/d6a/fc6 1509811 0 2024-09-17T01:02:04.425 INFO:tasks.workunit.client.0.smithi002.stdout:1/857: link d4/d11/d12/d14/c2e d4/d11/d1a/daa/c125 0 2024-09-17T01:02:04.426 INFO:tasks.workunit.client.1.smithi099.stdout:4/794: sync 2024-09-17T01:02:04.427 INFO:tasks.workunit.client.1.smithi099.stdout:8/810: sync 2024-09-17T01:02:04.427 INFO:tasks.workunit.client.1.smithi099.stdout:6/819: sync 2024-09-17T01:02:04.427 INFO:tasks.workunit.client.1.smithi099.stdout:1/982: sync 2024-09-17T01:02:04.427 INFO:tasks.workunit.client.0.smithi002.stdout:3/759: symlink d0/d3/da8/lf0 0 2024-09-17T01:02:04.428 INFO:tasks.workunit.client.1.smithi099.stdout:4/795: mkdir d7/dd/de/d10/d6b/d82/d116 0 2024-09-17T01:02:04.429 INFO:tasks.workunit.client.1.smithi099.stdout:1/983: mkdir d0/d8/d49/d94/d4b/d157 0 2024-09-17T01:02:04.430 INFO:tasks.workunit.client.0.smithi002.stdout:4/944: rename d7/de/d3a/lb9 to d7/d19/d9f/d80/d62/dbe/df4/l120 0 2024-09-17T01:02:04.431 INFO:tasks.workunit.client.1.smithi099.stdout:4/796: unlink d7/c8d 0 2024-09-17T01:02:04.431 INFO:tasks.workunit.client.1.smithi099.stdout:4/797: readlink d7/ldd 0 2024-09-17T01:02:04.432 INFO:tasks.workunit.client.1.smithi099.stdout:6/820: getdents dc/d5d/dc9 0 2024-09-17T01:02:04.432 INFO:tasks.workunit.client.1.smithi099.stdout:6/821: write dc/d5d/dae/d96/d60/f9b [1817049,119172] 0 2024-09-17T01:02:04.432 INFO:tasks.workunit.client.1.smithi099.stdout:8/811: dread d0/d1f/d90/db8/dde/d29/f57 [0,4194304] 0 2024-09-17T01:02:04.432 INFO:tasks.workunit.client.1.smithi099.stdout:8/812: dread - d0/d41/f9a zero size 2024-09-17T01:02:04.433 INFO:tasks.workunit.client.0.smithi002.stdout:4/945: mkdir d7/de/d3a/d109/dc7/d11d/d121 0 2024-09-17T01:02:04.433 INFO:tasks.workunit.client.1.smithi099.stdout:1/984: mknod d0/d8/d38/d8a/dd0/ddc/c158 0 2024-09-17T01:02:04.433 INFO:tasks.workunit.client.0.smithi002.stdout:3/760: rmdir d0/d3/d33/d77 39 2024-09-17T01:02:04.434 INFO:tasks.workunit.client.1.smithi099.stdout:4/798: truncate d7/dd/d21/d7b/d4b/f3e 421021 0 2024-09-17T01:02:04.435 INFO:tasks.workunit.client.0.smithi002.stdout:3/761: dread d0/d31/d32/d92/fa4 [0,4194304] 0 2024-09-17T01:02:04.435 INFO:tasks.workunit.client.0.smithi002.stdout:7/865: dread d1/d14/d67/dc0/dcd/d45/d113/f62 [0,4194304] 0 2024-09-17T01:02:04.435 INFO:tasks.workunit.client.0.smithi002.stdout:3/762: write d0/d3/f19 [948918,52208] 0 2024-09-17T01:02:04.435 INFO:tasks.workunit.client.0.smithi002.stdout:3/763: creat d0/d3/d8d/ff1 x:0 0 0 2024-09-17T01:02:04.435 INFO:tasks.workunit.client.0.smithi002.stdout:7/866: creat d1/d14/d1d/d28/d6b/d9e/f115 x:0 0 0 2024-09-17T01:02:04.435 INFO:tasks.workunit.client.0.smithi002.stdout:7/867: chown d1/d14/d1d/d28/d6b/l93 1 1 2024-09-17T01:02:04.435 INFO:tasks.workunit.client.0.smithi002.stdout:4/946: creat d7/de/d32/d59/f122 x:0 0 0 2024-09-17T01:02:04.435 INFO:tasks.workunit.client.0.smithi002.stdout:4/947: fdatasync d7/de/f2a 0 2024-09-17T01:02:04.435 INFO:tasks.workunit.client.0.smithi002.stdout:4/948: stat d7/d19/d9c/de9/df8/f10e 0 2024-09-17T01:02:04.436 INFO:tasks.workunit.client.0.smithi002.stdout:3/764: creat d0/d3/d17/ff2 x:0 0 0 2024-09-17T01:02:04.436 INFO:tasks.workunit.client.0.smithi002.stdout:3/765: write d0/d3/d37/f51 [709793,21710] 0 2024-09-17T01:02:04.437 INFO:tasks.workunit.client.0.smithi002.stdout:7/868: unlink d1/d14/d67/f9d 0 2024-09-17T01:02:04.437 INFO:tasks.workunit.client.1.smithi099.stdout:8/813: link d0/d41/d5a/c87 d0/d1f/d90/db8/dde/d29/d4b/db3/de9/c10b 0 2024-09-17T01:02:04.437 INFO:tasks.workunit.client.1.smithi099.stdout:8/814: creat d0/d1f/d90/db8/dde/dbc/f10c x:0 0 0 2024-09-17T01:02:04.437 INFO:tasks.workunit.client.1.smithi099.stdout:8/815: chown d0/d1f/d90/db8/dde/d29/d4b/ld3 0 1 2024-09-17T01:02:04.438 INFO:tasks.workunit.client.0.smithi002.stdout:4/949: getdents d7/d19/d9f/d80 0 2024-09-17T01:02:04.439 INFO:tasks.workunit.client.1.smithi099.stdout:1/985: rename d0/d8/d49/d94/c14d to d0/de2/dfd/d104/c159 0 2024-09-17T01:02:04.439 INFO:tasks.workunit.client.1.smithi099.stdout:1/986: chown d0/d8/d38/d56/d93/lc2 1887 1 2024-09-17T01:02:04.439 INFO:tasks.workunit.client.0.smithi002.stdout:3/766: mkdir d0/d3/df3 0 2024-09-17T01:02:04.440 INFO:tasks.workunit.client.0.smithi002.stdout:4/950: creat d7/d19/d9c/de9/da4/f123 x:0 0 0 2024-09-17T01:02:04.440 INFO:tasks.workunit.client.1.smithi099.stdout:4/799: symlink d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/l117 0 2024-09-17T01:02:04.441 INFO:tasks.workunit.client.0.smithi002.stdout:3/767: mknod d0/d3/d17/d84/dd9/cf4 0 2024-09-17T01:02:04.441 INFO:tasks.workunit.client.0.smithi002.stdout:4/951: rmdir d7/d19 39 2024-09-17T01:02:04.442 INFO:tasks.workunit.client.0.smithi002.stdout:3/768: creat d0/d3/d17/d84/ff5 x:0 0 0 2024-09-17T01:02:04.443 INFO:tasks.workunit.client.0.smithi002.stdout:6/863: sync 2024-09-17T01:02:04.443 INFO:tasks.workunit.client.0.smithi002.stdout:2/794: sync 2024-09-17T01:02:04.443 INFO:tasks.workunit.client.0.smithi002.stdout:9/720: sync 2024-09-17T01:02:04.444 INFO:tasks.workunit.client.0.smithi002.stdout:0/734: sync 2024-09-17T01:02:04.445 INFO:tasks.workunit.client.0.smithi002.stdout:4/952: creat d7/de/d3a/d109/dc7/d11d/d103/f124 x:0 0 0 2024-09-17T01:02:04.445 INFO:tasks.workunit.client.1.smithi099.stdout:8/816: write d0/d1f/d31/f79 [85578,43509] 0 2024-09-17T01:02:04.445 INFO:tasks.workunit.client.1.smithi099.stdout:8/817: stat d0/d1f/d90/ffc 0 2024-09-17T01:02:04.447 INFO:tasks.workunit.client.1.smithi099.stdout:1/987: creat d0/d8/d49/d94/d4b/d157/f15a x:0 0 0 2024-09-17T01:02:04.447 INFO:tasks.workunit.client.1.smithi099.stdout:1/988: read d0/f36 [151149,107444] 0 2024-09-17T01:02:04.447 INFO:tasks.workunit.client.1.smithi099.stdout:1/989: dread - d0/d8/d49/d94/d4b/d59/db9/dc7/f14c zero size 2024-09-17T01:02:04.448 INFO:tasks.workunit.client.1.smithi099.stdout:1/990: mkdir d0/d2/dd8/d15b 0 2024-09-17T01:02:04.450 INFO:tasks.workunit.client.1.smithi099.stdout:1/991: creat d0/d8/d38/d75/d135/f15c x:0 0 0 2024-09-17T01:02:04.451 INFO:tasks.workunit.client.1.smithi099.stdout:1/992: symlink d0/d2/de/d8b/da7/d98/l15d 0 2024-09-17T01:02:04.452 INFO:tasks.workunit.client.1.smithi099.stdout:1/993: mknod d0/d8/dbf/c15e 0 2024-09-17T01:02:04.455 INFO:tasks.workunit.client.0.smithi002.stdout:0/735: link dd/d19/d1a/f4a dd/d19/d1c/d1f/dc4/ff4 0 2024-09-17T01:02:04.455 INFO:tasks.workunit.client.0.smithi002.stdout:6/864: mkdir d2/dc/d24/d53/d83/da9/d4c/d107/d122 0 2024-09-17T01:02:04.458 INFO:tasks.workunit.client.0.smithi002.stdout:9/721: mkdir d5/dc/d26/d63/d66/dd7 0 2024-09-17T01:02:04.461 INFO:tasks.workunit.client.0.smithi002.stdout:2/795: mknod d1b/d37/d48/d52/de6/c11d 0 2024-09-17T01:02:04.461 INFO:tasks.workunit.client.0.smithi002.stdout:2/796: write d1b/d3f/d59/d7f/dc9/f51 [629873,14186] 0 2024-09-17T01:02:04.461 INFO:tasks.workunit.client.0.smithi002.stdout:4/953: creat d7/de/d3a/f125 x:0 0 0 2024-09-17T01:02:04.461 INFO:tasks.workunit.client.0.smithi002.stdout:3/769: getdents d0/d31/d8b 0 2024-09-17T01:02:04.462 INFO:tasks.workunit.client.0.smithi002.stdout:6/865: mknod d2/d1d/d2d/d35/d8d/c123 0 2024-09-17T01:02:04.463 INFO:tasks.workunit.client.1.smithi099.stdout:8/818: write d0/d41/f9b [861207,3777] 0 2024-09-17T01:02:04.465 INFO:tasks.workunit.client.0.smithi002.stdout:9/722: rename d5/l6 to d5/dc/d26/d5c/d6b/d75/d57/d7a/ld8 0 2024-09-17T01:02:04.465 INFO:tasks.workunit.client.0.smithi002.stdout:9/723: readlink d5/dc/d26/d46/d47/l9e 0 2024-09-17T01:02:04.465 INFO:tasks.workunit.client.1.smithi099.stdout:8/819: creat d0/d1f/d90/db8/dde/d29/d4b/db3/dd8/f10d x:0 0 0 2024-09-17T01:02:04.466 INFO:tasks.workunit.client.1.smithi099.stdout:8/820: write d0/d1f/d90/fec [386287,80130] 0 2024-09-17T01:02:04.466 INFO:tasks.workunit.client.1.smithi099.stdout:8/821: fsync d0/d1f/d90/db8/dde/f50 0 2024-09-17T01:02:04.466 INFO:tasks.workunit.client.1.smithi099.stdout:8/822: write d0/d1f/d90/fdc [776317,12384] 0 2024-09-17T01:02:04.468 INFO:tasks.workunit.client.1.smithi099.stdout:8/823: unlink d0/d1f/l6a 0 2024-09-17T01:02:04.468 INFO:tasks.workunit.client.0.smithi002.stdout:9/724: mknod d5/dc/d26/d5c/d6b/cd9 0 2024-09-17T01:02:04.468 INFO:tasks.workunit.client.0.smithi002.stdout:9/725: fdatasync d5/f3e 0 2024-09-17T01:02:04.469 INFO:tasks.workunit.client.1.smithi099.stdout:1/994: dread d0/d8/d49/f4c [0,4194304] 0 2024-09-17T01:02:04.469 INFO:tasks.workunit.client.1.smithi099.stdout:1/995: chown d0/d8/d38/d75/f9b 8998 1 2024-09-17T01:02:04.470 INFO:tasks.workunit.client.1.smithi099.stdout:8/824: creat d0/d1f/d90/db8/dde/d29/d4b/db3/f10e x:0 0 0 2024-09-17T01:02:04.470 INFO:tasks.workunit.client.1.smithi099.stdout:8/825: creat d0/f10f x:0 0 0 2024-09-17T01:02:04.470 INFO:tasks.workunit.client.0.smithi002.stdout:4/954: rename d7/d71 to d7/de/d32/d126 0 2024-09-17T01:02:04.473 INFO:tasks.workunit.client.1.smithi099.stdout:8/826: mknod d0/d1f/d31/c110 0 2024-09-17T01:02:04.474 INFO:tasks.workunit.client.0.smithi002.stdout:9/726: creat d5/dc/d26/d63/fda x:0 0 0 2024-09-17T01:02:04.474 INFO:tasks.workunit.client.0.smithi002.stdout:3/770: dread d0/d3/d33/f86 [0,4194304] 0 2024-09-17T01:02:04.475 INFO:tasks.workunit.client.0.smithi002.stdout:4/955: mknod d7/d3f/da9/c127 0 2024-09-17T01:02:04.475 INFO:tasks.workunit.client.0.smithi002.stdout:4/956: chown d7/de/d32/d126/d11b 48015214 1 2024-09-17T01:02:04.475 INFO:tasks.workunit.client.0.smithi002.stdout:9/727: dread d5/dc/d26/d63/f94 [0,4194304] 0 2024-09-17T01:02:04.477 INFO:tasks.workunit.client.0.smithi002.stdout:9/728: creat d5/dc/d26/d9c/fdb x:0 0 0 2024-09-17T01:02:04.488 INFO:tasks.workunit.client.1.smithi099.stdout:5/867: dwrite d2/dc4/d90/da4/f4b [0,4194304] 0 2024-09-17T01:02:04.489 INFO:tasks.workunit.client.1.smithi099.stdout:2/697: dwrite d2/d9/d25/f2e [0,4194304] 0 2024-09-17T01:02:04.491 INFO:tasks.workunit.client.1.smithi099.stdout:2/698: rename d2/d9/d25/d26/d1b/d2c/d5d to d2/d9/d17/de0 0 2024-09-17T01:02:04.493 INFO:tasks.workunit.client.1.smithi099.stdout:2/699: dread d2/d9/d25/d26/d1b/d2c/f52 [0,4194304] 0 2024-09-17T01:02:04.494 INFO:tasks.workunit.client.1.smithi099.stdout:2/700: truncate d2/d9/d25/f7b 2674187 0 2024-09-17T01:02:04.494 INFO:tasks.workunit.client.1.smithi099.stdout:2/701: fsync d2/d9/d25/d26/d1b/f7c 0 2024-09-17T01:02:04.502 INFO:tasks.workunit.client.0.smithi002.stdout:3/771: dwrite d0/d3/d17/f29 [0,4194304] 0 2024-09-17T01:02:04.503 INFO:tasks.workunit.client.0.smithi002.stdout:3/772: symlink d0/d31/d32/dcb/lf6 0 2024-09-17T01:02:04.516 INFO:tasks.workunit.client.0.smithi002.stdout:2/797: write d1b/d37/d48/d4e/dc5/ff7 [3457253,103894] 0 2024-09-17T01:02:04.517 INFO:tasks.workunit.client.0.smithi002.stdout:2/798: rename d1b/d1d/dc8/ff9 to d1b/d3f/d59/d7f/dc9/f11e 0 2024-09-17T01:02:04.533 INFO:tasks.workunit.client.1.smithi099.stdout:2/702: dread d2/d9/d25/d26/f33 [0,4194304] 0 2024-09-17T01:02:04.533 INFO:tasks.workunit.client.0.smithi002.stdout:5/787: dwrite d2/d2d/d10/d14/d19/d39/f3c [8388608,4194304] 0 2024-09-17T01:02:04.556 INFO:tasks.workunit.client.0.smithi002.stdout:3/773: dread d0/d31/d8b/d9d/fde [0,4194304] 0 2024-09-17T01:02:04.556 INFO:tasks.workunit.client.0.smithi002.stdout:3/774: mknod d0/d31/da7/cf7 0 2024-09-17T01:02:04.557 INFO:tasks.workunit.client.0.smithi002.stdout:3/775: mknod d0/cf8 0 2024-09-17T01:02:04.558 INFO:tasks.workunit.client.0.smithi002.stdout:3/776: symlink d0/d3/da8/lf9 0 2024-09-17T01:02:04.558 INFO:tasks.workunit.client.0.smithi002.stdout:3/777: chown d0/d3/da8/ce0 176593 1 2024-09-17T01:02:04.558 INFO:tasks.workunit.client.0.smithi002.stdout:3/778: fdatasync d0/d31/fce 0 2024-09-17T01:02:04.558 INFO:tasks.workunit.client.0.smithi002.stdout:3/779: creat d0/d31/ffa x:0 0 0 2024-09-17T01:02:04.559 INFO:tasks.workunit.client.0.smithi002.stdout:3/780: symlink d0/d3/d37/dac/da1/dd8/dc6/lfb 0 2024-09-17T01:02:04.561 INFO:tasks.workunit.client.1.smithi099.stdout:2/703: dread d2/d9/d25/d26/f29 [0,4194304] 0 2024-09-17T01:02:04.562 INFO:tasks.workunit.client.1.smithi099.stdout:2/704: mkdir d2/d9/d25/d26/d1b/d61/d7d/d85/d98/de1 0 2024-09-17T01:02:04.563 INFO:tasks.workunit.client.1.smithi099.stdout:2/705: fsync d2/d9/d17/f21 0 2024-09-17T01:02:04.563 INFO:tasks.workunit.client.1.smithi099.stdout:2/706: readlink d2/d9/d17/de0/lbe 0 2024-09-17T01:02:04.563 INFO:tasks.workunit.client.1.smithi099.stdout:2/707: fsync d2/d9/d17/f93 0 2024-09-17T01:02:04.563 INFO:tasks.workunit.client.1.smithi099.stdout:2/708: creat d2/d9/d17/d83/dca/fe2 x:0 0 0 2024-09-17T01:02:04.564 INFO:tasks.workunit.client.1.smithi099.stdout:2/709: creat d2/d9/d25/d97/fe3 x:0 0 0 2024-09-17T01:02:04.581 INFO:tasks.workunit.client.0.smithi002.stdout:7/869: dwrite d1/d14/d67/dc0/dcd/d45/f43 [0,4194304] 0 2024-09-17T01:02:04.581 INFO:tasks.workunit.client.0.smithi002.stdout:7/870: dread - d1/d14/d67/dc0/dcd/d45/fea zero size 2024-09-17T01:02:04.581 INFO:tasks.workunit.client.0.smithi002.stdout:7/871: symlink d1/d14/d1d/d28/d6b/d9e/d5e/l116 0 2024-09-17T01:02:04.583 INFO:tasks.workunit.client.0.smithi002.stdout:7/872: mkdir d1/d14/d1d/d28/d6b/d9e/d10a/d117 0 2024-09-17T01:02:04.583 INFO:tasks.workunit.client.0.smithi002.stdout:7/873: fsync d1/d24/f31 0 2024-09-17T01:02:04.583 INFO:tasks.workunit.client.0.smithi002.stdout:7/874: symlink d1/d14/d1d/d28/d40/l118 0 2024-09-17T01:02:04.584 INFO:tasks.workunit.client.0.smithi002.stdout:7/875: link d1/d14/d1d/d28/d6b/d9e/d54/laa d1/d14/d1d/d29/l119 0 2024-09-17T01:02:04.585 INFO:tasks.workunit.client.0.smithi002.stdout:7/876: write d1/d14/d67/dc0/dcd/d45/fea [751205,45420] 0 2024-09-17T01:02:04.592 INFO:tasks.workunit.client.0.smithi002.stdout:0/736: dwrite dd/d19/d1c/d1f/d76/fd5 [0,4194304] 0 2024-09-17T01:02:04.592 INFO:tasks.workunit.client.0.smithi002.stdout:0/737: stat dd/f13 0 2024-09-17T01:02:04.594 INFO:tasks.workunit.client.0.smithi002.stdout:0/738: rename dd/d19/d1c/d1f/d76/ddd to dd/d19/da9/de5/d68/d9d/dbe/df5 0 2024-09-17T01:02:04.596 INFO:tasks.workunit.client.0.smithi002.stdout:0/739: rename dd/d19/d1c/deb/cea to dd/d19/d1c/dba/cf6 0 2024-09-17T01:02:04.597 INFO:tasks.workunit.client.0.smithi002.stdout:0/740: creat dd/d19/da9/ff7 x:0 0 0 2024-09-17T01:02:04.598 INFO:tasks.workunit.client.0.smithi002.stdout:0/741: link dd/d19/d1a/d29/l37 dd/d19/d1c/d1f/lf8 0 2024-09-17T01:02:04.598 INFO:tasks.workunit.client.0.smithi002.stdout:4/957: rmdir d7/de/d3a/d109/dc7/d11d/d103 39 2024-09-17T01:02:04.607 INFO:tasks.workunit.client.1.smithi099.stdout:6/822: dwrite dc/d1a/d49/d4c/f9d [0,4194304] 0 2024-09-17T01:02:04.607 INFO:tasks.workunit.client.1.smithi099.stdout:6/823: write dc/d27/dd7/d87/fb9 [1648108,66661] 0 2024-09-17T01:02:04.607 INFO:tasks.workunit.client.1.smithi099.stdout:4/800: dwrite d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/d83/ff1 [0,4194304] 0 2024-09-17T01:02:04.608 INFO:tasks.workunit.client.1.smithi099.stdout:4/801: chown d7/dd/d21/d26/d3f/f94 2001 1 2024-09-17T01:02:04.608 INFO:tasks.workunit.client.0.smithi002.stdout:5/788: dwrite d2/d2d/d10/d14/d19/d39/d64/fb8 [0,4194304] 0 2024-09-17T01:02:04.608 INFO:tasks.workunit.client.0.smithi002.stdout:9/729: dwrite d5/dc/d26/d5c/d6b/d75/d57/d7a/f8b [0,4194304] 0 2024-09-17T01:02:04.608 INFO:tasks.workunit.client.0.smithi002.stdout:5/789: fdatasync d2/de/f4f 0 2024-09-17T01:02:04.608 INFO:tasks.workunit.client.0.smithi002.stdout:9/730: fsync d5/dc/d26/d5c/d6b/d75/d36/fb8 0 2024-09-17T01:02:04.609 INFO:tasks.workunit.client.0.smithi002.stdout:6/866: dwrite d2/f11b [0,4194304] 0 2024-09-17T01:02:04.609 INFO:tasks.workunit.client.1.smithi099.stdout:5/868: dwrite d2/dc/d17/d3c/dca/f100 [0,4194304] 0 2024-09-17T01:02:04.609 INFO:tasks.workunit.client.1.smithi099.stdout:5/869: readlink d2/d45/l87 0 2024-09-17T01:02:04.609 INFO:tasks.workunit.client.1.smithi099.stdout:8/827: dwrite d0/d1f/db5/fd2 [0,4194304] 0 2024-09-17T01:02:04.610 INFO:tasks.workunit.client.1.smithi099.stdout:6/824: mkdir dc/d1a/d49/da8/d110/d119 0 2024-09-17T01:02:04.610 INFO:tasks.workunit.client.1.smithi099.stdout:6/825: truncate dc/d27/dd7/dde/ddf/de9/f105 541486 0 2024-09-17T01:02:04.611 INFO:tasks.workunit.client.0.smithi002.stdout:2/799: dwrite d1b/d1d/f1f [0,4194304] 0 2024-09-17T01:02:04.611 INFO:tasks.workunit.client.1.smithi099.stdout:2/710: dwrite d2/d9/d25/d26/d1b/f7c [0,4194304] 0 2024-09-17T01:02:04.616 INFO:tasks.workunit.client.1.smithi099.stdout:5/870: rename d2/dc4/dad/lef to d2/dc/d17/d3c/d72/l122 0 2024-09-17T01:02:04.616 INFO:tasks.workunit.client.1.smithi099.stdout:5/871: chown d2/dc/d14/d89/l92 896643 1 2024-09-17T01:02:04.616 INFO:tasks.workunit.client.0.smithi002.stdout:0/742: dread dd/d19/d1c/d1f/d76/fd5 [0,4194304] 0 2024-09-17T01:02:04.617 INFO:tasks.workunit.client.0.smithi002.stdout:0/743: creat dd/d19/d1a/d29/ff9 x:0 0 0 2024-09-17T01:02:04.617 INFO:tasks.workunit.client.0.smithi002.stdout:0/744: chown dd/d19/d1c/d1f/dc4 2236749 1 2024-09-17T01:02:04.618 INFO:tasks.workunit.client.0.smithi002.stdout:2/800: mknod d1b/d37/d48/d52/de6/c11f 0 2024-09-17T01:02:04.619 INFO:tasks.workunit.client.0.smithi002.stdout:2/801: chown d1b/d37/d48/d4e/f90 3 1 2024-09-17T01:02:04.622 INFO:tasks.workunit.client.1.smithi099.stdout:8/828: rmdir d0/d1f/d55/d95 39 2024-09-17T01:02:04.622 INFO:tasks.workunit.client.0.smithi002.stdout:2/802: rename d1b/d8a/d92/dae/d10d to d1b/d74/d93/d118/d120 0 2024-09-17T01:02:04.623 INFO:tasks.workunit.client.1.smithi099.stdout:6/826: rmdir dc/d5d/dae/d96/dfd 39 2024-09-17T01:02:04.623 INFO:tasks.workunit.client.1.smithi099.stdout:6/827: dread - dc/d27/d7e/f9a zero size 2024-09-17T01:02:04.623 INFO:tasks.workunit.client.1.smithi099.stdout:6/828: chown dc/d5d/f69 533209185 1 2024-09-17T01:02:04.625 INFO:tasks.workunit.client.0.smithi002.stdout:5/790: dread d2/f2c [0,4194304] 0 2024-09-17T01:02:04.625 INFO:tasks.workunit.client.0.smithi002.stdout:5/791: readlink d2/d2d/d10/d14/d19/da5/db0/d33/l37 0 2024-09-17T01:02:04.625 INFO:tasks.workunit.client.0.smithi002.stdout:5/792: dread - d2/d2d/d10/d14/d19/d39/d48/def/f81 zero size 2024-09-17T01:02:04.625 INFO:tasks.workunit.client.0.smithi002.stdout:2/803: link d1b/d1d/led d1b/d37/d48/d4e/dc5/l121 0 2024-09-17T01:02:04.625 INFO:tasks.workunit.client.0.smithi002.stdout:5/793: symlink d2/d2d/d10/d9b/dd3/lf9 0 2024-09-17T01:02:04.626 INFO:tasks.workunit.client.0.smithi002.stdout:9/731: dwrite d5/dc/d26/d5c/d6b/f9b [4194304,4194304] 0 2024-09-17T01:02:04.626 INFO:tasks.workunit.client.0.smithi002.stdout:9/732: read - d5/dc/d26/d46/d47/da1/fad zero size 2024-09-17T01:02:04.626 INFO:tasks.workunit.client.0.smithi002.stdout:9/733: truncate d5/d8a/fc8 482381 0 2024-09-17T01:02:04.626 INFO:tasks.workunit.client.0.smithi002.stdout:2/804: creat d1b/d3f/d59/dfa/f122 x:0 0 0 2024-09-17T01:02:04.626 INFO:tasks.workunit.client.0.smithi002.stdout:2/805: fsync d1b/d1d/d79/fb2 0 2024-09-17T01:02:04.627 INFO:tasks.workunit.client.0.smithi002.stdout:2/806: write d1b/d1d/f9d [5808,8259] 0 2024-09-17T01:02:04.629 INFO:tasks.workunit.client.1.smithi099.stdout:2/711: unlink d2/d9/d25/d26/d1b/d2c/d9b/fdf 0 2024-09-17T01:02:04.630 INFO:tasks.workunit.client.0.smithi002.stdout:6/867: write d2/d1d/d27/d80/d93/dd5/d5c/dc9/fbd [3588472,43874] 0 2024-09-17T01:02:04.630 INFO:tasks.workunit.client.0.smithi002.stdout:4/958: dwrite d7/d19/d9f/d80/fb5 [0,4194304] 0 2024-09-17T01:02:04.630 INFO:tasks.workunit.client.0.smithi002.stdout:5/794: mkdir d2/d2d/d10/d14/d19/d39/d48/def/dfa 0 2024-09-17T01:02:04.630 INFO:tasks.workunit.client.0.smithi002.stdout:5/795: write d2/d2d/d10/d14/d19/da5/db0/f74 [881299,117100] 0 2024-09-17T01:02:04.631 INFO:tasks.workunit.client.1.smithi099.stdout:5/872: rename d2/dc/d6c/fff to d2/dc/d17/d3c/d81/f123 0 2024-09-17T01:02:04.631 INFO:tasks.workunit.client.0.smithi002.stdout:4/959: read d7/de/d3a/d109/dc7/d11d/f39 [846818,9563] 0 2024-09-17T01:02:04.632 INFO:tasks.workunit.client.0.smithi002.stdout:9/734: mknod d5/dc/d26/d46/db4/cdc 0 2024-09-17T01:02:04.632 INFO:tasks.workunit.client.0.smithi002.stdout:9/735: chown d5/dc/f32 24 1 2024-09-17T01:02:04.633 INFO:tasks.workunit.client.0.smithi002.stdout:6/868: creat d2/dc/f124 x:0 0 0 2024-09-17T01:02:04.634 INFO:tasks.workunit.client.1.smithi099.stdout:6/829: mkdir dc/d5d/d11a 0 2024-09-17T01:02:04.634 INFO:tasks.workunit.client.1.smithi099.stdout:6/830: write dc/d5d/d66/dbb/d10c/f6e [861461,69640] 0 2024-09-17T01:02:04.634 INFO:tasks.workunit.client.0.smithi002.stdout:4/960: creat d7/de/d32/f128 x:0 0 0 2024-09-17T01:02:04.634 INFO:tasks.workunit.client.0.smithi002.stdout:4/961: truncate d7/d19/d9f/d80/d62/dbe/df4/f119 1000158 0 2024-09-17T01:02:04.635 INFO:tasks.workunit.client.1.smithi099.stdout:8/829: mkdir d0/d1f/d90/db8/dde/d111 0 2024-09-17T01:02:04.638 INFO:tasks.workunit.client.1.smithi099.stdout:4/802: write d7/f8 [1661798,58292] 0 2024-09-17T01:02:04.640 INFO:tasks.workunit.client.1.smithi099.stdout:4/803: creat d7/dd/d21/d26/d3f/d5b/da4/dde/f118 x:0 0 0 2024-09-17T01:02:04.640 INFO:tasks.workunit.client.1.smithi099.stdout:4/804: chown d7/dd/d21/d26/f56 41033 1 2024-09-17T01:02:04.641 INFO:tasks.workunit.client.1.smithi099.stdout:4/805: truncate d7/dd/de/d10/d85/f10d 703654 0 2024-09-17T01:02:04.641 INFO:tasks.workunit.client.0.smithi002.stdout:9/736: fsync d5/dc/f84 0 2024-09-17T01:02:04.643 INFO:tasks.workunit.client.0.smithi002.stdout:4/962: rename d7/de/d3a/d109/dc7/d11d/dc0/f101 to d7/de/d3a/d109/dc7/d11d/d103/f129 0 2024-09-17T01:02:04.646 INFO:tasks.workunit.client.1.smithi099.stdout:8/830: dread d0/fcb [0,4194304] 0 2024-09-17T01:02:04.646 INFO:tasks.workunit.client.1.smithi099.stdout:8/831: dread - d0/d1f/d90/db8/dde/d29/f10a zero size 2024-09-17T01:02:04.650 INFO:tasks.workunit.client.1.smithi099.stdout:6/831: dread dc/d27/fbc [0,4194304] 0 2024-09-17T01:02:04.650 INFO:tasks.workunit.client.0.smithi002.stdout:9/737: mkdir d5/dc/d26/d63/ddd 0 2024-09-17T01:02:04.652 INFO:tasks.workunit.client.1.smithi099.stdout:7/718: sync 2024-09-17T01:02:04.653 INFO:tasks.workunit.client.1.smithi099.stdout:6/832: link dc/d27/d7e/dad/lb4 dc/l11b 0 2024-09-17T01:02:04.653 INFO:tasks.workunit.client.1.smithi099.stdout:0/843: sync 2024-09-17T01:02:04.653 INFO:tasks.workunit.client.1.smithi099.stdout:9/777: sync 2024-09-17T01:02:04.654 INFO:tasks.workunit.client.1.smithi099.stdout:3/848: sync 2024-09-17T01:02:04.654 INFO:tasks.workunit.client.0.smithi002.stdout:9/738: symlink d5/dc/d26/d5c/lde 0 2024-09-17T01:02:04.656 INFO:tasks.workunit.client.0.smithi002.stdout:9/739: creat d5/dc/d26/d5c/d6b/d75/d57/dba/fdf x:0 0 0 2024-09-17T01:02:04.656 INFO:tasks.workunit.client.1.smithi099.stdout:6/833: rename dc/d5d/dae/d96/dfd/d101/l104 to dc/d5d/dae/l11c 0 2024-09-17T01:02:04.657 INFO:tasks.workunit.client.1.smithi099.stdout:0/844: truncate da/d12/d2b/df0/d10d/d1e/f38 3349544 0 2024-09-17T01:02:04.661 INFO:tasks.workunit.client.1.smithi099.stdout:9/778: dread da/d14/d40/ff2 [0,4194304] 0 2024-09-17T01:02:04.661 INFO:tasks.workunit.client.1.smithi099.stdout:2/712: dwrite d2/d9/d17/f51 [0,4194304] 0 2024-09-17T01:02:04.661 INFO:tasks.workunit.client.1.smithi099.stdout:6/834: creat dc/d5d/d66/f11d x:0 0 0 2024-09-17T01:02:04.661 INFO:tasks.workunit.client.1.smithi099.stdout:6/835: truncate dc/d2b/f9e 414498 0 2024-09-17T01:02:04.661 INFO:tasks.workunit.client.1.smithi099.stdout:5/873: dwrite d2/dc/f93 [0,4194304] 0 2024-09-17T01:02:04.662 INFO:tasks.workunit.client.1.smithi099.stdout:0/845: symlink da/df/d1a/d49/d68/d9f/dd7/l113 0 2024-09-17T01:02:04.663 INFO:tasks.workunit.client.1.smithi099.stdout:2/713: mknod d2/d9/d25/d97/ce4 0 2024-09-17T01:02:04.664 INFO:tasks.workunit.client.1.smithi099.stdout:9/779: dread da/d14/d48/d69/d6c/fa2 [0,4194304] 0 2024-09-17T01:02:04.669 INFO:tasks.workunit.client.1.smithi099.stdout:5/874: creat d2/de4/f124 x:0 0 0 2024-09-17T01:02:04.670 INFO:tasks.workunit.client.1.smithi099.stdout:0/846: link da/d3b/cc8 da/d12/d22/c114 0 2024-09-17T01:02:04.673 INFO:tasks.workunit.client.1.smithi099.stdout:3/849: write d9/d15/d18/d1a/d23/d5c/d99/dbb/dcb/f9b [2191128,20641] 0 2024-09-17T01:02:04.674 INFO:tasks.workunit.client.1.smithi099.stdout:5/875: link d2/f5 d2/dc/d6c/f125 0 2024-09-17T01:02:04.674 INFO:tasks.workunit.client.1.smithi099.stdout:0/847: mknod da/d12/d2b/df0/d10d/c115 0 2024-09-17T01:02:04.675 INFO:tasks.workunit.client.1.smithi099.stdout:6/836: rename dc/d5d/dae/d96/d60 to dc/d2b/d11e 0 2024-09-17T01:02:04.676 INFO:tasks.workunit.client.1.smithi099.stdout:9/780: write da/d9a/d3a/f26 [2075335,81603] 0 2024-09-17T01:02:04.678 INFO:tasks.workunit.client.1.smithi099.stdout:5/876: creat d2/dc4/d90/da4/d9c/f126 x:0 0 0 2024-09-17T01:02:04.678 INFO:tasks.workunit.client.1.smithi099.stdout:7/719: dread d1/d2c/d5c/d12/f18 [0,4194304] 0 2024-09-17T01:02:04.678 INFO:tasks.workunit.client.1.smithi099.stdout:7/720: chown d1/d2c/d5c/d12/f53 25 1 2024-09-17T01:02:04.679 INFO:tasks.workunit.client.1.smithi099.stdout:0/848: creat da/df/d4d/d6f/f116 x:0 0 0 2024-09-17T01:02:04.680 INFO:tasks.workunit.client.1.smithi099.stdout:0/849: write da/d12/d22/d66/f6d [322081,48620] 0 2024-09-17T01:02:04.680 INFO:tasks.workunit.client.1.smithi099.stdout:0/850: fsync da/d3b/f5b 0 2024-09-17T01:02:04.680 INFO:tasks.workunit.client.1.smithi099.stdout:6/837: getdents dc/d2b/d11e/d106 0 2024-09-17T01:02:04.681 INFO:tasks.workunit.client.1.smithi099.stdout:7/721: rename d1/d2c/l4e to d1/d2c/d47/d48/d60/le3 0 2024-09-17T01:02:04.681 INFO:tasks.workunit.client.1.smithi099.stdout:7/722: write d1/d2c/f6b [3323639,95405] 0 2024-09-17T01:02:04.682 INFO:tasks.workunit.client.1.smithi099.stdout:6/838: dread dc/d5d/dae/d96/fbe [0,4194304] 0 2024-09-17T01:02:04.682 INFO:tasks.workunit.client.1.smithi099.stdout:0/851: symlink da/df/d1a/d70/l117 0 2024-09-17T01:02:04.684 INFO:tasks.workunit.client.1.smithi099.stdout:0/852: truncate da/f27 3675426 0 2024-09-17T01:02:04.684 INFO:tasks.workunit.client.1.smithi099.stdout:0/853: readlink da/d12/d2b/dab/db5/l7b 0 2024-09-17T01:02:04.684 INFO:tasks.workunit.client.0.smithi002.stdout:6/869: write d2/dc/f8a [506101,40675] 0 2024-09-17T01:02:04.685 INFO:tasks.workunit.client.0.smithi002.stdout:6/870: mknod d2/d1d/d2d/d35/d37/c125 0 2024-09-17T01:02:04.686 INFO:tasks.workunit.client.0.smithi002.stdout:6/871: readlink d2/l1e 0 2024-09-17T01:02:04.686 INFO:tasks.workunit.client.1.smithi099.stdout:9/781: dread da/d9a/f78 [0,4194304] 0 2024-09-17T01:02:04.686 INFO:tasks.workunit.client.1.smithi099.stdout:9/782: write da/d21/deb/ff6 [653868,113874] 0 2024-09-17T01:02:04.688 INFO:tasks.workunit.client.1.smithi099.stdout:9/783: rename da/d14/d62/dd3 to da/d8e/d96/dfb 0 2024-09-17T01:02:04.688 INFO:tasks.workunit.client.1.smithi099.stdout:9/784: write da/d9a/d3a/f26 [2830471,95336] 0 2024-09-17T01:02:04.691 INFO:tasks.workunit.client.1.smithi099.stdout:9/785: truncate da/f64 8366377 0 2024-09-17T01:02:04.694 INFO:tasks.workunit.client.0.smithi002.stdout:5/796: dwrite d2/d2d/d10/d14/d19/da5/db0/d33/fd7 [0,4194304] 0 2024-09-17T01:02:04.699 INFO:tasks.workunit.client.1.smithi099.stdout:8/832: dwrite d0/d1f/d55/faf [0,4194304] 0 2024-09-17T01:02:04.699 INFO:tasks.workunit.client.0.smithi002.stdout:5/797: link d2/f3a d2/d2d/d10/d95/d96/ffb 0 2024-09-17T01:02:04.701 INFO:tasks.workunit.client.1.smithi099.stdout:8/833: fsync d0/d1f/d90/db8/dde/fb 0 2024-09-17T01:02:04.702 INFO:tasks.workunit.client.0.smithi002.stdout:5/798: rename d2/d2d/d10/d9b/dcb to d2/de/dfc 0 2024-09-17T01:02:04.704 INFO:tasks.workunit.client.0.smithi002.stdout:5/799: creat d2/d2d/d10/d9b/ffd x:0 0 0 2024-09-17T01:02:04.705 INFO:tasks.workunit.client.0.smithi002.stdout:9/740: dwrite d5/dc/d26/d63/f94 [0,4194304] 0 2024-09-17T01:02:04.705 INFO:tasks.workunit.client.0.smithi002.stdout:9/741: chown d5/f10 1169515 1 2024-09-17T01:02:04.705 INFO:tasks.workunit.client.0.smithi002.stdout:9/742: write d5/dc/d26/d63/fb7 [3230189,41902] 0 2024-09-17T01:02:04.710 INFO:tasks.workunit.client.0.smithi002.stdout:9/743: mknod d5/dc/d26/d63/d66/ce0 0 2024-09-17T01:02:04.715 INFO:tasks.workunit.client.0.smithi002.stdout:9/744: dread d5/dc/d26/d46/d47/d89/f95 [0,4194304] 0 2024-09-17T01:02:04.717 INFO:tasks.workunit.client.0.smithi002.stdout:9/745: rename d5/dc/d26/d63/fda to d5/dc/d26/d5c/d6b/d75/d57/d7a/fe1 0 2024-09-17T01:02:04.719 INFO:tasks.workunit.client.1.smithi099.stdout:1/996: sync 2024-09-17T01:02:04.719 INFO:tasks.workunit.client.1.smithi099.stdout:1/997: chown d0/d8/d49/d94/de0/f58 191 1 2024-09-17T01:02:04.720 INFO:tasks.workunit.client.1.smithi099.stdout:1/998: rmdir d0/d8/d49/d94/de0/de6 39 2024-09-17T01:02:04.725 INFO:tasks.workunit.client.1.smithi099.stdout:3/850: dwrite d9/d3b/d44/f7b [4194304,4194304] 0 2024-09-17T01:02:04.725 INFO:tasks.workunit.client.1.smithi099.stdout:3/851: chown d9/d3b/d44 6671 1 2024-09-17T01:02:04.727 INFO:tasks.workunit.client.1.smithi099.stdout:3/852: dread d9/d15/d18/d1a/d23/d5c/d99/fcc [0,4194304] 0 2024-09-17T01:02:04.729 INFO:tasks.workunit.client.0.smithi002.stdout:9/746: dread d5/dc/d26/d46/f58 [0,4194304] 0 2024-09-17T01:02:04.731 INFO:tasks.workunit.client.0.smithi002.stdout:9/747: truncate d5/dc/d26/f31 787833 0 2024-09-17T01:02:04.731 INFO:tasks.workunit.client.0.smithi002.stdout:9/748: fdatasync d5/d8a/fc8 0 2024-09-17T01:02:04.732 INFO:tasks.workunit.client.0.smithi002.stdout:9/749: mknod d5/d8a/ce2 0 2024-09-17T01:02:04.733 INFO:tasks.workunit.client.0.smithi002.stdout:9/750: symlink d5/dc/d26/d5c/le3 0 2024-09-17T01:02:04.734 INFO:tasks.workunit.client.0.smithi002.stdout:9/751: rmdir d5/dc/d26/d5c/d6b/d75/d57/d7a/da2 39 2024-09-17T01:02:04.737 INFO:tasks.workunit.client.0.smithi002.stdout:9/752: rename d5/dc/d26/d9c/dcc to d5/dc/d26/d5c/de4 0 2024-09-17T01:02:04.737 INFO:tasks.workunit.client.0.smithi002.stdout:9/753: write d5/dc/d26/d5c/d6b/d75/d57/d8d/f83 [473328,100221] 0 2024-09-17T01:02:04.737 INFO:tasks.workunit.client.0.smithi002.stdout:9/754: fsync d5/dc/d26/d46/d47/d89/fa8 0 2024-09-17T01:02:04.740 INFO:tasks.workunit.client.0.smithi002.stdout:9/755: link d5/dc/d26/d5c/d6b/d75/d57/d8d/f83 d5/dc/d26/d63/fe5 0 2024-09-17T01:02:04.741 INFO:tasks.workunit.client.1.smithi099.stdout:7/723: dread d1/d2c/f6b [0,4194304] 0 2024-09-17T01:02:04.742 INFO:tasks.workunit.client.1.smithi099.stdout:7/724: chown d1/d2c/d47/l77 410025662 1 2024-09-17T01:02:04.742 INFO:tasks.workunit.client.1.smithi099.stdout:7/725: stat d1/d2c/d5c/d12/l54 0 2024-09-17T01:02:04.744 INFO:tasks.workunit.client.1.smithi099.stdout:7/726: truncate d1/d2c/d5c/d12/f4b 1324751 0 2024-09-17T01:02:04.752 INFO:tasks.workunit.client.0.smithi002.stdout:6/872: dwrite d2/d1d/d2d/d35/d6d/f7c [0,4194304] 0 2024-09-17T01:02:04.754 INFO:tasks.workunit.client.0.smithi002.stdout:6/873: link d2/dc/fb6 d2/d1d/d2d/d35/d79/da8/f126 0 2024-09-17T01:02:04.754 INFO:tasks.workunit.client.0.smithi002.stdout:6/874: chown d2/d1d/d99/fee 2673321 1 2024-09-17T01:02:04.755 INFO:tasks.workunit.client.0.smithi002.stdout:6/875: mknod d2/d1d/d27/dfa/c127 0 2024-09-17T01:02:04.755 INFO:tasks.workunit.client.0.smithi002.stdout:6/876: getdents d2/dc/d34 0 2024-09-17T01:02:04.755 INFO:tasks.workunit.client.0.smithi002.stdout:6/877: dread - d2/d1d/d2d/d5a/d71/d7e/fd9 zero size 2024-09-17T01:02:04.757 INFO:tasks.workunit.client.0.smithi002.stdout:6/878: rename d2/f15 to d2/d1d/d27/d80/d93/dd5/d5c/f128 0 2024-09-17T01:02:04.758 INFO:tasks.workunit.client.0.smithi002.stdout:6/879: mkdir d2/d1d/d27/d30/d98/d129 0 2024-09-17T01:02:04.758 INFO:tasks.workunit.client.0.smithi002.stdout:6/880: fdatasync d2/d1d/f57 0 2024-09-17T01:02:04.760 INFO:tasks.workunit.client.1.smithi099.stdout:6/839: dwrite dc/f34 [0,4194304] 0 2024-09-17T01:02:04.760 INFO:tasks.workunit.client.1.smithi099.stdout:6/840: chown dc/d5d/dae/dd0/fdb 1262 1 2024-09-17T01:02:04.760 INFO:tasks.workunit.client.1.smithi099.stdout:6/841: fsync dc/d5d/d66/dbb/d10c/f8a 0 2024-09-17T01:02:04.760 INFO:tasks.workunit.client.1.smithi099.stdout:6/842: stat dc/d27/dd7/dde/ddf/f88 0 2024-09-17T01:02:04.760 INFO:tasks.workunit.client.1.smithi099.stdout:0/854: dwrite da/d12/d2b/dab/f105 [0,4194304] 0 2024-09-17T01:02:04.760 INFO:tasks.workunit.client.1.smithi099.stdout:9/786: dwrite da/d14/f77 [0,4194304] 0 2024-09-17T01:02:04.762 INFO:tasks.workunit.client.1.smithi099.stdout:6/843: dread dc/d1a/d49/d4c/f5c [0,4194304] 0 2024-09-17T01:02:04.765 INFO:tasks.workunit.client.1.smithi099.stdout:0/855: link da/d12/d2b/dab/db5/l7b da/df/d1a/d56/d72/dd4/l118 0 2024-09-17T01:02:04.765 INFO:tasks.workunit.client.1.smithi099.stdout:0/856: write da/d12/d2b/df0/f100 [958317,128598] 0 2024-09-17T01:02:04.766 INFO:tasks.workunit.client.1.smithi099.stdout:9/787: mknod da/d14/d48/d69/d6c/cfc 0 2024-09-17T01:02:04.767 INFO:tasks.workunit.client.1.smithi099.stdout:6/844: symlink dc/d1a/d49/da8/l11f 0 2024-09-17T01:02:04.767 INFO:tasks.workunit.client.1.smithi099.stdout:0/857: creat da/df/d1a/d49/f119 x:0 0 0 2024-09-17T01:02:04.768 INFO:tasks.workunit.client.1.smithi099.stdout:6/845: creat dc/d27/dd7/f120 x:0 0 0 2024-09-17T01:02:04.784 INFO:tasks.workunit.client.1.smithi099.stdout:8/834: dwrite d0/d1f/f12 [0,4194304] 0 2024-09-17T01:02:04.785 INFO:tasks.workunit.client.1.smithi099.stdout:8/835: readlink d0/d1f/d90/db8/dde/d29/d4b/ld3 0 2024-09-17T01:02:04.785 INFO:tasks.workunit.client.1.smithi099.stdout:3/853: dwrite d9/d2b/f2d [0,4194304] 0 2024-09-17T01:02:04.785 INFO:tasks.workunit.client.1.smithi099.stdout:8/836: mkdir d0/d1f/d90/db8/dde/d111/d112 0 2024-09-17T01:02:04.786 INFO:tasks.workunit.client.0.smithi002.stdout:5/800: dwrite d2/d2d/d10/d14/d19/d39/d43/fee [0,4194304] 0 2024-09-17T01:02:04.786 INFO:tasks.workunit.client.1.smithi099.stdout:3/854: creat d9/d2b/d6b/f10f x:0 0 0 2024-09-17T01:02:04.787 INFO:tasks.workunit.client.1.smithi099.stdout:3/855: truncate d9/d15/d18/d1a/d23/d5c/d6e/f96 82807 0 2024-09-17T01:02:04.787 INFO:tasks.workunit.client.1.smithi099.stdout:3/856: chown d9/d15/d18/f2a 289820 1 2024-09-17T01:02:04.788 INFO:tasks.workunit.client.1.smithi099.stdout:3/857: chown d9/d15/d18/d1a/d23/d5c/d99/dda/db5 290938449 1 2024-09-17T01:02:04.788 INFO:tasks.workunit.client.1.smithi099.stdout:3/858: readlink d9/d3b/db2/l87 0 2024-09-17T01:02:04.789 INFO:tasks.workunit.client.1.smithi099.stdout:8/837: rename d0/d1f/l48 to d0/d1f/d55/d95/l113 0 2024-09-17T01:02:04.789 INFO:tasks.workunit.client.1.smithi099.stdout:3/859: truncate d9/d15/d18/f2a 1849964 0 2024-09-17T01:02:04.790 INFO:tasks.workunit.client.1.smithi099.stdout:8/838: creat d0/d1f/d90/db8/dde/d111/f114 x:0 0 0 2024-09-17T01:02:04.791 INFO:tasks.workunit.client.1.smithi099.stdout:8/839: link d0/d1f/d90/db8/dde/d64/f8d d0/d1f/d31/f115 0 2024-09-17T01:02:04.792 INFO:tasks.workunit.client.1.smithi099.stdout:8/840: rename d0/feb to d0/d1f/d31/d4c/d8c/f116 0 2024-09-17T01:02:04.793 INFO:tasks.workunit.client.1.smithi099.stdout:8/841: write d0/d41/f9a [169014,39503] 0 2024-09-17T01:02:04.793 INFO:tasks.workunit.client.0.smithi002.stdout:5/801: getdents d2/d2d/d10/d14/d19/d39/d48/d9d 0 2024-09-17T01:02:04.793 INFO:tasks.workunit.client.0.smithi002.stdout:5/802: read - d2/d2d/d10/d14/d19/d39/d48/def/f81 zero size 2024-09-17T01:02:04.793 INFO:tasks.workunit.client.1.smithi099.stdout:8/842: dread d0/d1f/d90/fac [0,4194304] 0 2024-09-17T01:02:04.795 INFO:tasks.workunit.client.0.smithi002.stdout:7/877: sync 2024-09-17T01:02:04.795 INFO:tasks.workunit.client.0.smithi002.stdout:3/781: sync 2024-09-17T01:02:04.795 INFO:tasks.workunit.client.0.smithi002.stdout:1/858: sync 2024-09-17T01:02:04.796 INFO:tasks.workunit.client.0.smithi002.stdout:7/878: truncate d1/f20 2133727 0 2024-09-17T01:02:04.797 INFO:tasks.workunit.client.0.smithi002.stdout:5/803: dread d2/d2d/d10/d14/d19/da5/db0/fc0 [0,4194304] 0 2024-09-17T01:02:04.797 INFO:tasks.workunit.client.0.smithi002.stdout:3/782: truncate d0/d3/d33/f7d 2193754 0 2024-09-17T01:02:04.798 INFO:tasks.workunit.client.0.smithi002.stdout:1/859: getdents d4/d11/d1a/daa/dee 0 2024-09-17T01:02:04.798 INFO:tasks.workunit.client.0.smithi002.stdout:1/860: readlink d4/d11/d12/d30/d43/d67/l10c 0 2024-09-17T01:02:04.798 INFO:tasks.workunit.client.1.smithi099.stdout:3/860: dread d9/d15/d18/d1a/d23/fd2 [0,4194304] 0 2024-09-17T01:02:04.799 INFO:tasks.workunit.client.1.smithi099.stdout:3/861: mkdir d9/d15/d18/d1a/d23/d5c/d99/dda/db5/dca/d110 0 2024-09-17T01:02:04.799 INFO:tasks.workunit.client.1.smithi099.stdout:3/862: creat d9/d15/d18/de5/f111 x:0 0 0 2024-09-17T01:02:04.800 INFO:tasks.workunit.client.1.smithi099.stdout:3/863: stat d9/d15/d38/l3a 0 2024-09-17T01:02:04.800 INFO:tasks.workunit.client.1.smithi099.stdout:3/864: creat d9/d15/d18/d1a/d23/d5c/d6e/d7e/f112 x:0 0 0 2024-09-17T01:02:04.800 INFO:tasks.workunit.client.0.smithi002.stdout:5/804: mkdir d2/d2d/d10/d14/d19/d39/d51/dfe 0 2024-09-17T01:02:04.800 INFO:tasks.workunit.client.0.smithi002.stdout:5/805: fdatasync d2/f3a 0 2024-09-17T01:02:04.800 INFO:tasks.workunit.client.0.smithi002.stdout:5/806: chown d2/d2d/d10/d14/d19/d39/d25/l63 7459 1 2024-09-17T01:02:04.802 INFO:tasks.workunit.client.0.smithi002.stdout:1/861: mknod d4/d11/d1c/c126 0 2024-09-17T01:02:04.802 INFO:tasks.workunit.client.1.smithi099.stdout:3/865: symlink d9/l113 0 2024-09-17T01:02:04.802 INFO:tasks.workunit.client.1.smithi099.stdout:3/866: creat d9/d15/d18/d1a/d23/d5c/d99/dda/db5/dca/f114 x:0 0 0 2024-09-17T01:02:04.802 INFO:tasks.workunit.client.1.smithi099.stdout:3/867: chown d9/d15/d18/d1a/d23/f5f 40897608 1 2024-09-17T01:02:04.803 INFO:tasks.workunit.client.1.smithi099.stdout:1/999: dwrite d0/d2/d18/f34 [0,4194304] 0 2024-09-17T01:02:04.803 INFO:tasks.workunit.client.1.smithi099.stdout:7/727: dwrite d1/d2c/d47/f50 [0,4194304] 0 2024-09-17T01:02:04.803 INFO:tasks.workunit.client.0.smithi002.stdout:7/879: dread d1/d14/d1d/d28/d86/ffe [0,4194304] 0 2024-09-17T01:02:04.803 INFO:tasks.workunit.client.0.smithi002.stdout:7/880: fsync d1/d14/d1d/d28/d40/fd6 0 2024-09-17T01:02:04.803 INFO:tasks.workunit.client.0.smithi002.stdout:9/756: dwrite d5/dc/d26/d46/faf [0,4194304] 0 2024-09-17T01:02:04.803 INFO:tasks.workunit.client.0.smithi002.stdout:5/807: creat d2/d2d/d10/d14/d19/d39/d48/def/dfa/fff x:0 0 0 2024-09-17T01:02:04.804 INFO:tasks.workunit.client.1.smithi099.stdout:0/858: dwrite da/df/f94 [0,4194304] 0 2024-09-17T01:02:04.804 INFO:tasks.workunit.client.1.smithi099.stdout:3/868: creat d9/d15/d7d/f115 x:0 0 0 2024-09-17T01:02:04.805 INFO:tasks.workunit.client.1.smithi099.stdout:9/788: dwrite da/d21/d2a/f36 [0,4194304] 0 2024-09-17T01:02:04.808 INFO:tasks.workunit.client.0.smithi002.stdout:1/862: mknod d4/d11/d55/dbc/c127 0 2024-09-17T01:02:04.809 INFO:tasks.workunit.client.0.smithi002.stdout:7/881: mknod d1/d14/d1d/d28/d6b/d9e/d54/de8/c11a 0 2024-09-17T01:02:04.810 INFO:tasks.workunit.client.0.smithi002.stdout:3/783: rmdir d0/d3 39 2024-09-17T01:02:04.812 INFO:tasks.workunit.client.1.smithi099.stdout:7/728: symlink d1/d2c/d5c/d1c/d5a/le4 0 2024-09-17T01:02:04.813 INFO:tasks.workunit.client.1.smithi099.stdout:7/729: fsync d1/d2c/d47/fca 0 2024-09-17T01:02:04.813 INFO:tasks.workunit.client.1.smithi099.stdout:7/730: creat d1/d37/d4f/fe5 x:0 0 0 2024-09-17T01:02:04.813 INFO:tasks.workunit.client.1.smithi099.stdout:7/731: chown d1/d2c/d5c/d12/f7f 452 1 2024-09-17T01:02:04.813 INFO:tasks.workunit.client.1.smithi099.stdout:7/732: chown d1/d2c/d7a/faa 7850 1 2024-09-17T01:02:04.814 INFO:tasks.workunit.client.0.smithi002.stdout:9/757: rename d5/dc/d26/d46/l87 to d5/le6 0 2024-09-17T01:02:04.815 INFO:tasks.workunit.client.0.smithi002.stdout:5/808: mknod d2/d2d/d10/d9b/c100 0 2024-09-17T01:02:04.816 INFO:tasks.workunit.client.0.smithi002.stdout:5/809: chown d2/d2d/d10/d14/d59/f8f 807 1 2024-09-17T01:02:04.816 INFO:tasks.workunit.client.0.smithi002.stdout:5/810: write d2/d2d/d10/d9b/fdd [1551413,31592] 0 2024-09-17T01:02:04.816 INFO:tasks.workunit.client.0.smithi002.stdout:5/811: creat d2/d2d/d10/d14/d19/da5/db0/d33/f101 x:0 0 0 2024-09-17T01:02:04.816 INFO:tasks.workunit.client.0.smithi002.stdout:5/812: creat d2/d2d/d10/d23/d6e/d60/f102 x:0 0 0 2024-09-17T01:02:04.816 INFO:tasks.workunit.client.0.smithi002.stdout:5/813: readlink d2/d2d/l67 0 2024-09-17T01:02:04.816 INFO:tasks.workunit.client.0.smithi002.stdout:5/814: chown d2/d2d/d10/d14/d19/d39/d25/fe6 4 1 2024-09-17T01:02:04.816 INFO:tasks.workunit.client.0.smithi002.stdout:5/815: chown d2/ff1 1859 1 2024-09-17T01:02:04.816 INFO:tasks.workunit.client.1.smithi099.stdout:0/859: creat da/d12/d22/dfd/f11a x:0 0 0 2024-09-17T01:02:04.817 INFO:tasks.workunit.client.0.smithi002.stdout:1/863: creat d4/d22/d8d/de8/f128 x:0 0 0 2024-09-17T01:02:04.817 INFO:tasks.workunit.client.0.smithi002.stdout:1/864: fsync d4/d11/d12/d30/d5e/f77 0 2024-09-17T01:02:04.819 INFO:tasks.workunit.client.0.smithi002.stdout:7/882: rename d1/d14/d1d/d28/d6b/d9e/f53 to d1/d14/d1d/d29/d98/dcf/f11b 0 2024-09-17T01:02:04.820 INFO:tasks.workunit.client.1.smithi099.stdout:9/789: read da/d56/da5/fa6 [4132598,26534] 0 2024-09-17T01:02:04.821 INFO:tasks.workunit.client.1.smithi099.stdout:7/733: rename d1/d2c/d5c/d1c/d5a/d6f/lba to d1/d37/d4f/le6 0 2024-09-17T01:02:04.821 INFO:tasks.workunit.client.0.smithi002.stdout:9/758: mkdir d5/dc/d26/d46/d47/da1/de7 0 2024-09-17T01:02:04.822 INFO:tasks.workunit.client.0.smithi002.stdout:3/784: dread d0/d3/d33/d4a/f78 [0,4194304] 0 2024-09-17T01:02:04.822 INFO:tasks.workunit.client.0.smithi002.stdout:9/759: write d5/dc/d26/d5c/d6b/d75/d57/d8d/f83 [44279,75130] 0 2024-09-17T01:02:04.823 INFO:tasks.workunit.client.1.smithi099.stdout:0/860: link da/df/d31/lff da/df/d1a/d49/d68/d9f/l11b 0 2024-09-17T01:02:04.823 INFO:tasks.workunit.client.1.smithi099.stdout:0/861: chown da/df/d1a/d56/d72/fdf 50 1 2024-09-17T01:02:04.824 INFO:tasks.workunit.client.0.smithi002.stdout:1/865: mkdir d4/d11/d12/d23/d32/de3/d129 0 2024-09-17T01:02:04.825 INFO:tasks.workunit.client.1.smithi099.stdout:9/790: link da/d18/d5e/fd2 da/d18/d49/ffd 0 2024-09-17T01:02:04.825 INFO:tasks.workunit.client.1.smithi099.stdout:9/791: creat da/ffe x:0 0 0 2024-09-17T01:02:04.825 INFO:tasks.workunit.client.1.smithi099.stdout:9/792: read - da/d8e/dbf/fe2 zero size 2024-09-17T01:02:04.825 INFO:tasks.workunit.client.1.smithi099.stdout:9/793: write da/ffe [755226,10605] 0 2024-09-17T01:02:04.825 INFO:tasks.workunit.client.1.smithi099.stdout:9/794: fdatasync da/d14/d40/f97 0 2024-09-17T01:02:04.825 INFO:tasks.workunit.client.1.smithi099.stdout:9/795: write da/d21/d2a/f7f [1729372,17248] 0 2024-09-17T01:02:04.825 INFO:tasks.workunit.client.1.smithi099.stdout:9/796: write da/d14/ff8 [125684,55181] 0 2024-09-17T01:02:04.826 INFO:tasks.workunit.client.1.smithi099.stdout:9/797: write da/d14/d48/d69/ff3 [968622,123609] 0 2024-09-17T01:02:04.826 INFO:tasks.workunit.client.1.smithi099.stdout:7/734: mknod d1/d2c/d47/d48/ce7 0 2024-09-17T01:02:04.826 INFO:tasks.workunit.client.1.smithi099.stdout:0/862: truncate da/d12/fa6 929480 0 2024-09-17T01:02:04.828 INFO:tasks.workunit.client.1.smithi099.stdout:9/798: rename da/d14/d40/cc5 to da/d18/db3/cff 0 2024-09-17T01:02:04.828 INFO:tasks.workunit.client.1.smithi099.stdout:9/799: write da/d14/d40/ff2 [1362283,30478] 0 2024-09-17T01:02:04.828 INFO:tasks.workunit.client.1.smithi099.stdout:9/800: creat da/d14/d48/d69/d6c/f100 x:0 0 0 2024-09-17T01:02:04.828 INFO:tasks.workunit.client.1.smithi099.stdout:0/863: creat da/d12/d2b/dab/dba/dfa/f11c x:0 0 0 2024-09-17T01:02:04.829 INFO:tasks.workunit.client.1.smithi099.stdout:0/864: fsync da/d12/d2b/dab/db5/f58 0 2024-09-17T01:02:04.830 INFO:tasks.workunit.client.1.smithi099.stdout:8/843: dwrite d0/d1f/f4d [0,4194304] 0 2024-09-17T01:02:04.831 INFO:tasks.workunit.client.1.smithi099.stdout:7/735: rename d1/d2c/d5c/d12/f53 to d1/d2c/d5c/d1c/d5a/d76/fe8 0 2024-09-17T01:02:04.832 INFO:tasks.workunit.client.1.smithi099.stdout:3/869: dwrite d9/d15/d18/f106 [0,4194304] 0 2024-09-17T01:02:04.832 INFO:tasks.workunit.client.1.smithi099.stdout:3/870: fsync d9/d15/d18/d1a/d23/d5c/d6e/f100 0 2024-09-17T01:02:04.832 INFO:tasks.workunit.client.1.smithi099.stdout:3/871: creat d9/d15/d18/de5/f116 x:0 0 0 2024-09-17T01:02:04.833 INFO:tasks.workunit.client.0.smithi002.stdout:9/760: dread d5/dc/d26/d63/d66/f78 [0,4194304] 0 2024-09-17T01:02:04.833 INFO:tasks.workunit.client.0.smithi002.stdout:9/761: chown d5/dc/d26/d5c/d6b/d75/d36 20 1 2024-09-17T01:02:04.833 INFO:tasks.workunit.client.1.smithi099.stdout:9/801: truncate da/d50/f60 3239541 0 2024-09-17T01:02:04.833 INFO:tasks.workunit.client.1.smithi099.stdout:9/802: write da/d21/d5b/fbc [1214352,95429] 0 2024-09-17T01:02:04.834 INFO:tasks.workunit.client.1.smithi099.stdout:0/865: symlink da/d59/l11d 0 2024-09-17T01:02:04.834 INFO:tasks.workunit.client.1.smithi099.stdout:0/866: fsync da/df/d1a/d56/f111 0 2024-09-17T01:02:04.834 INFO:tasks.workunit.client.1.smithi099.stdout:0/867: dread - da/d12/d22/dfd/f11a zero size 2024-09-17T01:02:04.835 INFO:tasks.workunit.client.1.smithi099.stdout:0/868: stat da/df/d1a 0 2024-09-17T01:02:04.837 INFO:tasks.workunit.client.1.smithi099.stdout:8/844: rmdir d0/d1f/d90/db8/dde/d29/d4b 39 2024-09-17T01:02:04.837 INFO:tasks.workunit.client.1.smithi099.stdout:7/736: read d1/d2c/d5c/f1b [4906925,122001] 0 2024-09-17T01:02:04.837 INFO:tasks.workunit.client.1.smithi099.stdout:7/737: chown d1/f11 7056206 1 2024-09-17T01:02:04.840 INFO:tasks.workunit.client.1.smithi099.stdout:3/872: rmdir d9/d2b/d6b/dae 39 2024-09-17T01:02:04.840 INFO:tasks.workunit.client.1.smithi099.stdout:3/873: creat d9/d15/d18/d1a/d23/d5c/d99/dd8/ded/f117 x:0 0 0 2024-09-17T01:02:04.842 INFO:tasks.workunit.client.1.smithi099.stdout:9/803: rename da/d9b/fa0 to da/d8e/d96/dfb/f101 0 2024-09-17T01:02:04.844 INFO:tasks.workunit.client.1.smithi099.stdout:7/738: creat d1/d2c/d5c/d1c/d5a/d6f/db6/fe9 x:0 0 0 2024-09-17T01:02:04.844 INFO:tasks.workunit.client.1.smithi099.stdout:7/739: readlink d1/d2c/d47/l77 0 2024-09-17T01:02:04.845 INFO:tasks.workunit.client.1.smithi099.stdout:0/869: dread f9 [0,4194304] 0 2024-09-17T01:02:04.845 INFO:tasks.workunit.client.1.smithi099.stdout:0/870: truncate da/df/d31/f39 1034078 0 2024-09-17T01:02:04.846 INFO:tasks.workunit.client.1.smithi099.stdout:9/804: creat da/d21/d2a/f102 x:0 0 0 2024-09-17T01:02:04.848 INFO:tasks.workunit.client.1.smithi099.stdout:7/740: rename d1/d2c/d5c/d1c/l2e to d1/d37/lea 0 2024-09-17T01:02:04.850 INFO:tasks.workunit.client.1.smithi099.stdout:0/871: mkdir da/df/d1a/d56/d72/d11e 0 2024-09-17T01:02:04.850 INFO:tasks.workunit.client.1.smithi099.stdout:3/874: dread d9/d15/d38/fe9 [0,4194304] 0 2024-09-17T01:02:04.851 INFO:tasks.workunit.client.1.smithi099.stdout:9/805: mknod da/d8e/d96/c103 0 2024-09-17T01:02:04.856 INFO:tasks.workunit.client.1.smithi099.stdout:7/741: link d1/d2c/d5c/d12/f32 d1/d8f/feb 0 2024-09-17T01:02:04.856 INFO:tasks.workunit.client.1.smithi099.stdout:9/806: mkdir da/d50/d104 0 2024-09-17T01:02:04.857 INFO:tasks.workunit.client.1.smithi099.stdout:8/845: dwrite d0/d1f/d31/d4c/d8c/fc0 [0,4194304] 0 2024-09-17T01:02:04.859 INFO:tasks.workunit.client.1.smithi099.stdout:8/846: symlink d0/d41/l117 0 2024-09-17T01:02:04.861 INFO:tasks.workunit.client.1.smithi099.stdout:7/742: dread d1/d2c/d5c/d12/f18 [0,4194304] 0 2024-09-17T01:02:04.868 INFO:tasks.workunit.client.1.smithi099.stdout:9/807: rename da/d14/d62 to da/d50/d104/d105 0 2024-09-17T01:02:04.873 INFO:tasks.workunit.client.1.smithi099.stdout:8/847: dread d0/d1f/d55/fc7 [0,4194304] 0 2024-09-17T01:02:04.873 INFO:tasks.workunit.client.1.smithi099.stdout:7/743: write d1/d2c/d7a/dac/fb9 [1437667,79872] 0 2024-09-17T01:02:04.873 INFO:tasks.workunit.client.1.smithi099.stdout:8/848: chown d0/d1f/d31/f7b 11262084 1 2024-09-17T01:02:04.873 INFO:tasks.workunit.client.1.smithi099.stdout:8/849: stat d0/d41/d5a/dcd/cee 0 2024-09-17T01:02:04.873 INFO:tasks.workunit.client.1.smithi099.stdout:8/850: fsync d0/d1f/d90/db8/dde/d29/d9c/f100 0 2024-09-17T01:02:04.873 INFO:tasks.workunit.client.1.smithi099.stdout:8/851: stat d0/d1f/d90/db8/dde/d64/f93 0 2024-09-17T01:02:04.874 INFO:tasks.workunit.client.1.smithi099.stdout:0/872: dwrite da/df/d31/f4c [0,4194304] 0 2024-09-17T01:02:04.874 INFO:tasks.workunit.client.1.smithi099.stdout:0/873: chown da/d12/d22/fc7 14977942 1 2024-09-17T01:02:04.874 INFO:tasks.workunit.client.1.smithi099.stdout:3/875: dwrite d9/d15/d18/d1a/d23/d4c/de4/f10a [0,4194304] 0 2024-09-17T01:02:04.874 INFO:tasks.workunit.client.1.smithi099.stdout:0/874: read da/df/d1a/d49/dac/f3c [2934951,93712] 0 2024-09-17T01:02:04.874 INFO:tasks.workunit.client.1.smithi099.stdout:3/876: chown d9/d15/d18/d1a/d23/d5c/d99/dda/db5/dca/f103 6849 1 2024-09-17T01:02:04.875 INFO:tasks.workunit.client.1.smithi099.stdout:7/744: mknod d1/d37/cec 0 2024-09-17T01:02:04.876 INFO:tasks.workunit.client.1.smithi099.stdout:8/852: creat d0/d1f/d90/db8/dde/d64/dcf/f118 x:0 0 0 2024-09-17T01:02:04.876 INFO:tasks.workunit.client.1.smithi099.stdout:8/853: creat d0/d1f/d55/d95/de2/f119 x:0 0 0 2024-09-17T01:02:04.880 INFO:tasks.workunit.client.1.smithi099.stdout:0/875: rename da/df/d31/l9b to da/df/d1a/d63/l11f 0 2024-09-17T01:02:04.881 INFO:tasks.workunit.client.1.smithi099.stdout:3/877: mkdir d9/d15/d18/d1a/d23/d5c/d99/dda/db5/dca/d118 0 2024-09-17T01:02:04.883 INFO:tasks.workunit.client.0.smithi002.stdout:5/816: rename d2/d2d/d10/d20/d24/laa to d2/d99/l103 0 2024-09-17T01:02:04.884 INFO:tasks.workunit.client.0.smithi002.stdout:3/785: mknod d0/d3/d17/d84/dd9/cfc 0 2024-09-17T01:02:04.887 INFO:tasks.workunit.client.0.smithi002.stdout:1/866: unlink d4/d11/d12/d14/d17/d51/fc8 0 2024-09-17T01:02:04.887 INFO:tasks.workunit.client.0.smithi002.stdout:1/867: chown d4/d11/d12/d14/d17/d51/dc0/cfd 359615 1 2024-09-17T01:02:04.888 INFO:tasks.workunit.client.1.smithi099.stdout:8/854: write d0/d1f/d90/db8/dde/d29/d4b/fa6 [1943321,93509] 0 2024-09-17T01:02:04.890 INFO:tasks.workunit.client.1.smithi099.stdout:9/808: dwrite da/d56/da5/fa6 [0,4194304] 0 2024-09-17T01:02:04.890 INFO:tasks.workunit.client.0.smithi002.stdout:9/762: link d5/f20 d5/dc/d26/d5c/d6b/d75/d57/fe8 0 2024-09-17T01:02:04.892 INFO:tasks.workunit.client.1.smithi099.stdout:7/745: getdents d1/d37/d78/db2 0 2024-09-17T01:02:04.893 INFO:tasks.workunit.client.1.smithi099.stdout:9/809: dread da/ffe [0,4194304] 0 2024-09-17T01:02:04.893 INFO:tasks.workunit.client.0.smithi002.stdout:5/817: rmdir d2/de/dfc 39 2024-09-17T01:02:04.893 INFO:tasks.workunit.client.0.smithi002.stdout:5/818: stat d2/d2d/d10/d14/d19/da5/db0/f40 0 2024-09-17T01:02:04.893 INFO:tasks.workunit.client.0.smithi002.stdout:5/819: fdatasync d2/d2d/d10/d20/d24/f31 0 2024-09-17T01:02:04.894 INFO:tasks.workunit.client.0.smithi002.stdout:5/820: read - d2/d2d/d10/d14/d19/d39/fe1 zero size 2024-09-17T01:02:04.894 INFO:tasks.workunit.client.1.smithi099.stdout:0/876: mkdir da/d12/d22/d120 0 2024-09-17T01:02:04.894 INFO:tasks.workunit.client.1.smithi099.stdout:3/878: symlink d9/d15/d8f/l119 0 2024-09-17T01:02:04.895 INFO:tasks.workunit.client.0.smithi002.stdout:3/786: unlink d0/d31/d32/ca3 0 2024-09-17T01:02:04.898 INFO:tasks.workunit.client.1.smithi099.stdout:7/746: unlink d1/d2c/fae 0 2024-09-17T01:02:04.898 INFO:tasks.workunit.client.1.smithi099.stdout:7/747: dread - d1/d2c/d7a/fa9 zero size 2024-09-17T01:02:04.899 INFO:tasks.workunit.client.0.smithi002.stdout:1/868: truncate d4/d11/d12/d30/d5e/f60 1545933 0 2024-09-17T01:02:04.900 INFO:tasks.workunit.client.1.smithi099.stdout:9/810: truncate da/d21/d2a/f8c 2071027 0 2024-09-17T01:02:04.902 INFO:tasks.workunit.client.1.smithi099.stdout:0/877: rename da/df/d1a/d56/d72/dd4 to da/df/d1a/d56/d121 0 2024-09-17T01:02:04.902 INFO:tasks.workunit.client.1.smithi099.stdout:0/878: creat da/d12/d22/dfd/f122 x:0 0 0 2024-09-17T01:02:04.902 INFO:tasks.workunit.client.0.smithi002.stdout:1/869: rename d4/d11/d12/d14/d17/ddb/df9/l103 to d4/d11/d1a/daa/dbb/l12a 0 2024-09-17T01:02:04.903 INFO:tasks.workunit.client.1.smithi099.stdout:8/855: read d0/d41/f9b [1346737,84560] 0 2024-09-17T01:02:04.903 INFO:tasks.workunit.client.1.smithi099.stdout:8/856: fsync d0/ff3 0 2024-09-17T01:02:04.903 INFO:tasks.workunit.client.1.smithi099.stdout:8/857: rename d0 to d0/d1f/d90/db8/dde/d64/dbe/d11a 22 2024-09-17T01:02:04.903 INFO:tasks.workunit.client.1.smithi099.stdout:8/858: dread - d0/d1f/d90/db8/dde/dc3/fd1 zero size 2024-09-17T01:02:04.903 INFO:tasks.workunit.client.1.smithi099.stdout:3/879: dread d9/d15/d18/d1a/f1b [4194304,4194304] 0 2024-09-17T01:02:04.903 INFO:tasks.workunit.client.1.smithi099.stdout:7/748: mknod d1/d2c/d5c/d1c/d72/ced 0 2024-09-17T01:02:04.906 INFO:tasks.workunit.client.1.smithi099.stdout:9/811: mkdir da/d9b/dac/d106 0 2024-09-17T01:02:04.906 INFO:tasks.workunit.client.1.smithi099.stdout:9/812: creat da/d56/d84/db9/de8/f107 x:0 0 0 2024-09-17T01:02:04.906 INFO:tasks.workunit.client.1.smithi099.stdout:9/813: creat da/d56/da5/f108 x:0 0 0 2024-09-17T01:02:04.906 INFO:tasks.workunit.client.1.smithi099.stdout:9/814: chown da/d14/d48/l4e 6712 1 2024-09-17T01:02:04.907 INFO:tasks.workunit.client.0.smithi002.stdout:9/763: rmdir d5/dc/d26/d5c/d6b 39 2024-09-17T01:02:04.907 INFO:tasks.workunit.client.0.smithi002.stdout:9/764: fsync d5/dc/d26/d5c/d6b/d75/f5a 0 2024-09-17T01:02:04.908 INFO:tasks.workunit.client.1.smithi099.stdout:0/879: mknod da/df/d1a/d49/d71/c123 0 2024-09-17T01:02:04.908 INFO:tasks.workunit.client.1.smithi099.stdout:0/880: write da/d12/d2b/dab/db5/f10f [282187,16495] 0 2024-09-17T01:02:04.908 INFO:tasks.workunit.client.0.smithi002.stdout:0/745: sync 2024-09-17T01:02:04.910 INFO:tasks.workunit.client.0.smithi002.stdout:1/870: rename d4/d22/f39 to d4/d11/d12/d30/d43/d67/f12b 0 2024-09-17T01:02:04.913 INFO:tasks.workunit.client.1.smithi099.stdout:3/880: rename d9/d15/d18/l26 to d9/d3b/db2/l11a 0 2024-09-17T01:02:04.913 INFO:tasks.workunit.client.1.smithi099.stdout:3/881: creat d9/d15/d18/d1a/d23/d4c/d64/f11b x:0 0 0 2024-09-17T01:02:04.913 INFO:tasks.workunit.client.0.smithi002.stdout:9/765: unlink d5/l2c 0 2024-09-17T01:02:04.914 INFO:tasks.workunit.client.0.smithi002.stdout:9/766: chown d5/d8a/d9d/fce 5858 1 2024-09-17T01:02:04.914 INFO:tasks.workunit.client.0.smithi002.stdout:9/767: chown d5/dc/dbc 13524 1 2024-09-17T01:02:04.914 INFO:tasks.workunit.client.0.smithi002.stdout:9/768: write d5/dc/d26/d5c/d6b/d75/d57/f85 [1652154,74746] 0 2024-09-17T01:02:04.914 INFO:tasks.workunit.client.1.smithi099.stdout:8/859: write d0/d1f/d90/db8/dde/f3a [763368,14040] 0 2024-09-17T01:02:04.916 INFO:tasks.workunit.client.0.smithi002.stdout:9/769: truncate d5/dc/f99 174910 0 2024-09-17T01:02:04.917 INFO:tasks.workunit.client.0.smithi002.stdout:5/821: dwrite d2/d2d/d10/d14/d19/d39/d43/fee [0,4194304] 0 2024-09-17T01:02:04.917 INFO:tasks.workunit.client.0.smithi002.stdout:5/822: fsync d2/d2d/d10/d14/d19/da5/fb5 0 2024-09-17T01:02:04.918 INFO:tasks.workunit.client.1.smithi099.stdout:9/815: getdents da/d8e/d96/dfb 0 2024-09-17T01:02:04.920 INFO:tasks.workunit.client.0.smithi002.stdout:9/770: symlink d5/dc/d26/d63/le9 0 2024-09-17T01:02:04.921 INFO:tasks.workunit.client.1.smithi099.stdout:9/816: truncate da/d56/d84/db9/de8/fe9 422016 0 2024-09-17T01:02:04.923 INFO:tasks.workunit.client.0.smithi002.stdout:5/823: mkdir d2/d2d/d10/d14/d19/d39/d48/d9d/d104 0 2024-09-17T01:02:04.925 INFO:tasks.workunit.client.0.smithi002.stdout:9/771: read d5/f4f [918915,101605] 0 2024-09-17T01:02:04.926 INFO:tasks.workunit.client.0.smithi002.stdout:9/772: creat d5/d8a/d9d/da7/fea x:0 0 0 2024-09-17T01:02:04.926 INFO:tasks.workunit.client.0.smithi002.stdout:5/824: getdents d2/d2d/d10/d95/d96 0 2024-09-17T01:02:04.927 INFO:tasks.workunit.client.1.smithi099.stdout:8/860: mkdir d0/d1f/d11b 0 2024-09-17T01:02:04.927 INFO:tasks.workunit.client.1.smithi099.stdout:8/861: chown d0/d1f/d90/db8/dde/d111 34 1 2024-09-17T01:02:04.927 INFO:tasks.workunit.client.1.smithi099.stdout:8/862: symlink d0/d1f/d11b/l11c 0 2024-09-17T01:02:04.927 INFO:tasks.workunit.client.1.smithi099.stdout:3/882: dread d9/d2b/fb0 [0,4194304] 0 2024-09-17T01:02:04.927 INFO:tasks.workunit.client.1.smithi099.stdout:8/863: mkdir d0/d1f/d90/db8/dde/d29/d4b/d11d 0 2024-09-17T01:02:04.927 INFO:tasks.workunit.client.1.smithi099.stdout:8/864: mknod d0/d1f/d90/db8/dde/dbc/c11e 0 2024-09-17T01:02:04.928 INFO:tasks.workunit.client.0.smithi002.stdout:9/773: dread d5/dc/d26/f31 [0,4194304] 0 2024-09-17T01:02:04.929 INFO:tasks.workunit.client.0.smithi002.stdout:9/774: unlink d5/dc/d26/d46/d47/lc6 0 2024-09-17T01:02:04.929 INFO:tasks.workunit.client.0.smithi002.stdout:9/775: chown d5/dc/d26/d46/d47/da1 131284 1 2024-09-17T01:02:04.932 INFO:tasks.workunit.client.1.smithi099.stdout:0/881: dwrite da/d12/f62 [0,4194304] 0 2024-09-17T01:02:04.932 INFO:tasks.workunit.client.1.smithi099.stdout:0/882: creat da/d12/d22/d53/f124 x:0 0 0 2024-09-17T01:02:04.933 INFO:tasks.workunit.client.0.smithi002.stdout:1/871: dwrite d4/d11/d12/fa7 [0,4194304] 0 2024-09-17T01:02:04.934 INFO:tasks.workunit.client.0.smithi002.stdout:1/872: creat d4/d11/d12/d23/d32/d86/f12c x:0 0 0 2024-09-17T01:02:04.934 INFO:tasks.workunit.client.0.smithi002.stdout:1/873: chown d4/d11/d12/d14/d17/lec 3571 1 2024-09-17T01:02:04.934 INFO:tasks.workunit.client.0.smithi002.stdout:1/874: creat d4/d11/d55/dbc/dff/f12d x:0 0 0 2024-09-17T01:02:04.937 INFO:tasks.workunit.client.1.smithi099.stdout:0/883: creat da/d59/d80/f125 x:0 0 0 2024-09-17T01:02:04.937 INFO:tasks.workunit.client.1.smithi099.stdout:9/817: dread da/d50/f82 [4194304,4194304] 0 2024-09-17T01:02:04.937 INFO:tasks.workunit.client.1.smithi099.stdout:3/883: read d9/f7a [3070290,1405] 0 2024-09-17T01:02:04.938 INFO:tasks.workunit.client.1.smithi099.stdout:0/884: rmdir da/df/d1a/d63 39 2024-09-17T01:02:04.938 INFO:tasks.workunit.client.0.smithi002.stdout:9/776: symlink d5/dc/d26/d5c/d6b/d75/d36/leb 0 2024-09-17T01:02:04.939 INFO:tasks.workunit.client.1.smithi099.stdout:9/818: mknod da/d50/d104/c109 0 2024-09-17T01:02:04.940 INFO:tasks.workunit.client.1.smithi099.stdout:3/884: mknod d9/d15/d18/d1a/d23/d5c/d99/dda/c11c 0 2024-09-17T01:02:04.942 INFO:tasks.workunit.client.1.smithi099.stdout:9/819: mkdir da/d50/d104/d105/d10a 0 2024-09-17T01:02:04.942 INFO:tasks.workunit.client.0.smithi002.stdout:1/875: rmdir d4/d22/d8d 39 2024-09-17T01:02:04.944 INFO:tasks.workunit.client.0.smithi002.stdout:1/876: unlink d4/d11/f71 0 2024-09-17T01:02:04.944 INFO:tasks.workunit.client.1.smithi099.stdout:3/885: creat d9/d15/d8f/de3/f11d x:0 0 0 2024-09-17T01:02:04.944 INFO:tasks.workunit.client.1.smithi099.stdout:3/886: rename d9/d15 to d9/d15/d18/d1a/d23/d5c/d99/d11e 22 2024-09-17T01:02:04.944 INFO:tasks.workunit.client.1.smithi099.stdout:3/887: chown d9/d15/d18/d1a/d23/d5c/d99/dda 44 1 2024-09-17T01:02:04.945 INFO:tasks.workunit.client.0.smithi002.stdout:1/877: link d4/d11/d1a/ld2 d4/d11/d12/d14/d17/d51/dc0/l12e 0 2024-09-17T01:02:04.946 INFO:tasks.workunit.client.1.smithi099.stdout:3/888: creat d9/d15/d18/d1a/d23/d102/f11f x:0 0 0 2024-09-17T01:02:04.947 INFO:tasks.workunit.client.1.smithi099.stdout:3/889: stat d9/d3b/lb7 0 2024-09-17T01:02:04.949 INFO:tasks.workunit.client.1.smithi099.stdout:3/890: link d9/d15/d18/d1a/lf8 d9/d15/d8f/l120 0 2024-09-17T01:02:04.952 INFO:tasks.workunit.client.1.smithi099.stdout:3/891: mkdir d9/d15/d121 0 2024-09-17T01:02:04.952 INFO:tasks.workunit.client.1.smithi099.stdout:3/892: write d9/d15/d18/f88 [560951,97345] 0 2024-09-17T01:02:04.953 INFO:tasks.workunit.client.1.smithi099.stdout:3/893: symlink d9/d3b/d44/l122 0 2024-09-17T01:02:04.954 INFO:tasks.workunit.client.1.smithi099.stdout:0/885: read da/df/d1a/d49/f4a [624568,67043] 0 2024-09-17T01:02:04.954 INFO:tasks.workunit.client.0.smithi002.stdout:5/825: dwrite d2/d2d/d10/d23/d6e/d60/ff4 [0,4194304] 0 2024-09-17T01:02:04.955 INFO:tasks.workunit.client.0.smithi002.stdout:5/826: readlink d2/d2d/d10/d20/l55 0 2024-09-17T01:02:04.956 INFO:tasks.workunit.client.1.smithi099.stdout:3/894: rename d9/d15/c21 to d9/d2b/d6b/de7/c123 0 2024-09-17T01:02:04.957 INFO:tasks.workunit.client.1.smithi099.stdout:3/895: dread - d9/d15/d18/d1a/d23/d5c/d99/dd8/f105 zero size 2024-09-17T01:02:04.957 INFO:tasks.workunit.client.1.smithi099.stdout:3/896: chown d9/d15/d18/d1a/d23/d5c/d6e/d7e/ffd 3523 1 2024-09-17T01:02:04.957 INFO:tasks.workunit.client.1.smithi099.stdout:3/897: dread - d9/d15/d7d/f115 zero size 2024-09-17T01:02:04.957 INFO:tasks.workunit.client.1.smithi099.stdout:3/898: fsync d9/fd3 0 2024-09-17T01:02:04.957 INFO:tasks.workunit.client.1.smithi099.stdout:8/865: dwrite d0/d1f/d90/fec [0,4194304] 0 2024-09-17T01:02:04.957 INFO:tasks.workunit.client.1.smithi099.stdout:8/866: chown d0/d41/d5a/l92 112884911 1 2024-09-17T01:02:04.957 INFO:tasks.workunit.client.1.smithi099.stdout:8/867: write d0/d1f/d90/db8/dde/d29/d4b/f96 [1712109,63703] 0 2024-09-17T01:02:04.957 INFO:tasks.workunit.client.1.smithi099.stdout:8/868: write d0/d1f/d90/db8/dde/d29/d4b/f8f [1592571,80295] 0 2024-09-17T01:02:04.957 INFO:tasks.workunit.client.1.smithi099.stdout:8/869: fdatasync d0/d1f/d90/db8/dde/fb 0 2024-09-17T01:02:04.957 INFO:tasks.workunit.client.1.smithi099.stdout:8/870: chown d0/d1f/d90/db8/dde/d111/d112 3 1 2024-09-17T01:02:04.957 INFO:tasks.workunit.client.1.smithi099.stdout:8/871: fsync d0/d1f/d31/d4c/f76 0 2024-09-17T01:02:04.957 INFO:tasks.workunit.client.1.smithi099.stdout:8/872: chown d0/d1f/d55/d95/f99 1 1 2024-09-17T01:02:04.957 INFO:tasks.workunit.client.1.smithi099.stdout:0/886: rename da/df/d4d/cdc to da/df/d1a/d56/d72/dd0/c126 0 2024-09-17T01:02:04.958 INFO:tasks.workunit.client.1.smithi099.stdout:0/887: chown da/df/d1a/d56/d72/dd0/c126 240105672 1 2024-09-17T01:02:04.958 INFO:tasks.workunit.client.0.smithi002.stdout:5/827: getdents d2/d2d/d10/d14/d19/d39/d48 0 2024-09-17T01:02:04.958 INFO:tasks.workunit.client.1.smithi099.stdout:3/899: mknod d9/d15/c124 0 2024-09-17T01:02:04.958 INFO:tasks.workunit.client.1.smithi099.stdout:3/900: dread - d9/d15/d18/d1a/d23/d5c/d6e/d7e/f112 zero size 2024-09-17T01:02:04.960 INFO:tasks.workunit.client.0.smithi002.stdout:5/828: rename d2/de/c36 to d2/d2d/d10/d14/c105 0 2024-09-17T01:02:04.964 INFO:tasks.workunit.client.1.smithi099.stdout:8/873: rmdir d0/d1f/d90/db8 39 2024-09-17T01:02:04.964 INFO:tasks.workunit.client.1.smithi099.stdout:8/874: fdatasync d0/d1f/d31/d4c/d8c/fc0 0 2024-09-17T01:02:04.964 INFO:tasks.workunit.client.1.smithi099.stdout:8/875: write d0/d1f/d90/db8/dde/f50 [2236679,125227] 0 2024-09-17T01:02:04.964 INFO:tasks.workunit.client.1.smithi099.stdout:8/876: fsync d0/d1f/d31/f38 0 2024-09-17T01:02:04.965 INFO:tasks.workunit.client.1.smithi099.stdout:0/888: creat da/d59/d80/d8c/dcc/f127 x:0 0 0 2024-09-17T01:02:04.966 INFO:tasks.workunit.client.1.smithi099.stdout:3/901: mkdir d9/d15/d18/d1a/d23/d5c/d99/dda/db5/d125 0 2024-09-17T01:02:04.968 INFO:tasks.workunit.client.1.smithi099.stdout:8/877: mkdir d0/d1f/d90/db8/dde/d29/d4b/dff/d11f 0 2024-09-17T01:02:04.968 INFO:tasks.workunit.client.1.smithi099.stdout:8/878: fdatasync d0/d1f/d90/db8/dde/d29/fbd 0 2024-09-17T01:02:04.970 INFO:tasks.workunit.client.1.smithi099.stdout:0/889: unlink da/df/d1a/d56/d72/f93 0 2024-09-17T01:02:04.971 INFO:tasks.workunit.client.1.smithi099.stdout:8/879: rename d0/d1f/d55/fc7 to d0/d1f/d31/d4c/f120 0 2024-09-17T01:02:04.972 INFO:tasks.workunit.client.1.smithi099.stdout:8/880: stat d0/d1f/d31 0 2024-09-17T01:02:04.972 INFO:tasks.workunit.client.1.smithi099.stdout:8/881: stat d0/d1f/d90/db8/dde/d29/c86 0 2024-09-17T01:02:04.973 INFO:tasks.workunit.client.1.smithi099.stdout:8/882: chown d0/d1f/d55/d95/l113 505696 1 2024-09-17T01:02:04.973 INFO:tasks.workunit.client.1.smithi099.stdout:8/883: fdatasync d0/d1f/d90/db8/dde/f3c 0 2024-09-17T01:02:04.974 INFO:tasks.workunit.client.1.smithi099.stdout:9/820: dwrite da/d21/d2a/f7f [0,4194304] 0 2024-09-17T01:02:04.975 INFO:tasks.workunit.client.1.smithi099.stdout:8/884: mknod d0/d1f/d90/db8/dde/d64/dbe/c121 0 2024-09-17T01:02:04.977 INFO:tasks.workunit.client.1.smithi099.stdout:9/821: stat da/d18/c92 0 2024-09-17T01:02:04.977 INFO:tasks.workunit.client.1.smithi099.stdout:9/822: creat da/d56/d84/db9/f10b x:0 0 0 2024-09-17T01:02:04.978 INFO:tasks.workunit.client.1.smithi099.stdout:0/890: dread da/d3b/f5e [0,4194304] 0 2024-09-17T01:02:04.979 INFO:tasks.workunit.client.1.smithi099.stdout:0/891: chown da/d3b/f110 71236648 1 2024-09-17T01:02:04.980 INFO:tasks.workunit.client.0.smithi002.stdout:9/777: dwrite d5/f3e [0,4194304] 0 2024-09-17T01:02:04.981 INFO:tasks.workunit.client.0.smithi002.stdout:1/878: dwrite d4/d11/d1a/daa/dc2/fcd [0,4194304] 0 2024-09-17T01:02:04.981 INFO:tasks.workunit.client.0.smithi002.stdout:1/879: dread - d4/d11/d12/d14/d17/d51/ffc zero size 2024-09-17T01:02:04.981 INFO:tasks.workunit.client.0.smithi002.stdout:9/778: mkdir d5/dc/d26/d46/d47/d89/dec 0 2024-09-17T01:02:04.982 INFO:tasks.workunit.client.0.smithi002.stdout:9/779: write d5/dc/d26/d5c/d6b/d75/d57/d7a/fe1 [495414,118417] 0 2024-09-17T01:02:04.982 INFO:tasks.workunit.client.1.smithi099.stdout:9/823: symlink da/d9a/l10c 0 2024-09-17T01:02:04.982 INFO:tasks.workunit.client.0.smithi002.stdout:9/780: write d5/dc/d26/d5c/d6b/d75/f62 [1917714,89978] 0 2024-09-17T01:02:04.984 INFO:tasks.workunit.client.0.smithi002.stdout:1/880: truncate d4/d11/d55/dbc/fde 1735875 0 2024-09-17T01:02:04.985 INFO:tasks.workunit.client.0.smithi002.stdout:9/781: symlink d5/dc/d26/d46/db4/led 0 2024-09-17T01:02:04.986 INFO:tasks.workunit.client.0.smithi002.stdout:1/881: unlink d4/d11/c52 0 2024-09-17T01:02:04.986 INFO:tasks.workunit.client.0.smithi002.stdout:1/882: fsync d4/ff 0 2024-09-17T01:02:04.989 INFO:tasks.workunit.client.0.smithi002.stdout:1/883: read d4/d11/d12/f4c [817901,9277] 0 2024-09-17T01:02:04.990 INFO:tasks.workunit.client.0.smithi002.stdout:9/782: creat d5/dc/d26/d5c/d6b/d75/fee x:0 0 0 2024-09-17T01:02:04.994 INFO:tasks.workunit.client.0.smithi002.stdout:9/783: link d5/dc/d26/d5c/d6b/d75/d36/l71 d5/dc/d26/d5c/d6b/d75/d57/d7a/lef 0 2024-09-17T01:02:04.995 INFO:tasks.workunit.client.0.smithi002.stdout:9/784: chown d5/dc/d26/d5c/d6b/d75/c7c 3414850 1 2024-09-17T01:02:04.995 INFO:tasks.workunit.client.0.smithi002.stdout:9/785: chown d5/dc/d26/d5c/d6b/d75/d57/d7a/la5 1 1 2024-09-17T01:02:04.995 INFO:tasks.workunit.client.0.smithi002.stdout:9/786: fsync d5/dc/d26/d46/f58 0 2024-09-17T01:02:05.001 INFO:tasks.workunit.client.0.smithi002.stdout:5/829: dwrite d2/d2d/d10/d14/d19/d39/d64/ff8 [0,4194304] 0 2024-09-17T01:02:05.042 INFO:tasks.workunit.client.1.smithi099.stdout:3/902: dwrite d9/d2b/d6b/f10f [0,4194304] 0 2024-09-17T01:02:05.045 INFO:tasks.workunit.client.1.smithi099.stdout:3/903: rename d9/d15/d18/f4e to d9/d15/d18/f126 0 2024-09-17T01:02:05.048 INFO:tasks.workunit.client.1.smithi099.stdout:3/904: mknod d9/d15/d8f/c127 0 2024-09-17T01:02:05.049 INFO:tasks.workunit.client.1.smithi099.stdout:3/905: symlink d9/d15/d18/dc2/l128 0 2024-09-17T01:02:05.049 INFO:tasks.workunit.client.1.smithi099.stdout:3/906: mkdir d9/d15/d18/d1a/d23/d5c/d129 0 2024-09-17T01:02:05.049 INFO:tasks.workunit.client.1.smithi099.stdout:3/907: dread - d9/d15/d18/f42 zero size 2024-09-17T01:02:05.051 INFO:tasks.workunit.client.1.smithi099.stdout:3/908: mkdir d9/d12a 0 2024-09-17T01:02:05.051 INFO:tasks.workunit.client.1.smithi099.stdout:3/909: readlink d9/d15/d18/d1a/d23/l1e 0 2024-09-17T01:02:05.052 INFO:tasks.workunit.client.1.smithi099.stdout:3/910: fsync d9/d15/d18/d1a/d23/d4c/d64/f104 0 2024-09-17T01:02:05.052 INFO:tasks.workunit.client.1.smithi099.stdout:3/911: creat d9/f12b x:0 0 0 2024-09-17T01:02:05.052 INFO:tasks.workunit.client.1.smithi099.stdout:3/912: dread - d9/d15/d18/d1a/d23/d5c/d99/dda/db5/dca/f114 zero size 2024-09-17T01:02:05.055 INFO:tasks.workunit.client.1.smithi099.stdout:0/892: dwrite da/df/d1a/d49/f51 [0,4194304] 0 2024-09-17T01:02:05.057 INFO:tasks.workunit.client.0.smithi002.stdout:4/963: sync 2024-09-17T01:02:05.057 INFO:tasks.workunit.client.0.smithi002.stdout:2/807: sync 2024-09-17T01:02:05.059 INFO:tasks.workunit.client.0.smithi002.stdout:4/964: creat d7/d19/d9f/dc2/dde/f12a x:0 0 0 2024-09-17T01:02:05.063 INFO:tasks.workunit.client.0.smithi002.stdout:9/787: dwrite d5/dc/d26/f2e [0,4194304] 0 2024-09-17T01:02:05.063 INFO:tasks.workunit.client.0.smithi002.stdout:9/788: chown d5/dc/d26/d5c/d6b/d75/d57/d7a/da2/cb9 14 1 2024-09-17T01:02:05.063 INFO:tasks.workunit.client.0.smithi002.stdout:9/789: stat d5/dc/l39 0 2024-09-17T01:02:05.074 INFO:tasks.workunit.client.0.smithi002.stdout:4/965: dread d7/de/f114 [0,4194304] 0 2024-09-17T01:02:05.075 INFO:tasks.workunit.client.0.smithi002.stdout:4/966: creat d7/d19/d9f/dc2/dde/f12b x:0 0 0 2024-09-17T01:02:05.078 INFO:tasks.workunit.client.1.smithi099.stdout:3/913: dwrite d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/f9e [0,4194304] 0 2024-09-17T01:02:05.078 INFO:tasks.workunit.client.1.smithi099.stdout:3/914: write d9/d15/d18/d1a/d23/f5f [450164,129491] 0 2024-09-17T01:02:05.078 INFO:tasks.workunit.client.1.smithi099.stdout:3/915: rename d9/d15/d18 to d9/d15/d18/d1a/d23/d5c/d99/dda/db5/dca/d118/d12c 22 2024-09-17T01:02:05.085 INFO:tasks.workunit.client.0.smithi002.stdout:5/830: dwrite d2/d2d/d10/d14/d19/d39/d51/f79 [0,4194304] 0 2024-09-17T01:02:05.087 INFO:tasks.workunit.client.1.smithi099.stdout:0/893: dwrite da/d12/d22/fa9 [0,4194304] 0 2024-09-17T01:02:05.088 INFO:tasks.workunit.client.0.smithi002.stdout:2/808: dwrite d1b/d1d/d79/fd2 [0,4194304] 0 2024-09-17T01:02:05.088 INFO:tasks.workunit.client.0.smithi002.stdout:9/790: dwrite d5/dc/d26/d46/db4/fc1 [0,4194304] 0 2024-09-17T01:02:05.088 INFO:tasks.workunit.client.0.smithi002.stdout:4/967: dread d7/de/d32/d126/d8e/f11e [0,4194304] 0 2024-09-17T01:02:05.090 INFO:tasks.workunit.client.1.smithi099.stdout:0/894: mkdir da/df/d31/d8b/d128 0 2024-09-17T01:02:05.093 INFO:tasks.workunit.client.1.smithi099.stdout:8/885: dwrite d0/d1f/d90/db8/dde/dc3/fd1 [0,4194304] 0 2024-09-17T01:02:05.093 INFO:tasks.workunit.client.0.smithi002.stdout:2/809: link d1b/d8a/ff4 d1b/d37/d48/db1/dbb/f123 0 2024-09-17T01:02:05.093 INFO:tasks.workunit.client.0.smithi002.stdout:2/810: chown d1b/ce1 3729 1 2024-09-17T01:02:05.094 INFO:tasks.workunit.client.1.smithi099.stdout:0/895: getdents da/d12/d2b/df0 0 2024-09-17T01:02:05.094 INFO:tasks.workunit.client.0.smithi002.stdout:9/791: rename d5/dc/d26/d9c/cd4 to d5/dc/d26/d5c/d6b/d75/d57/cf0 0 2024-09-17T01:02:05.097 INFO:tasks.workunit.client.0.smithi002.stdout:2/811: read d1b/d37/d48/d52/de6/fc4 [594411,11622] 0 2024-09-17T01:02:05.098 INFO:tasks.workunit.client.0.smithi002.stdout:4/968: unlink d7/c2c 0 2024-09-17T01:02:05.098 INFO:tasks.workunit.client.1.smithi099.stdout:8/886: creat d0/d1f/d90/db8/dde/d29/d4b/df2/f122 x:0 0 0 2024-09-17T01:02:05.098 INFO:tasks.workunit.client.1.smithi099.stdout:0/896: mknod da/df/d1a/d49/dac/c129 0 2024-09-17T01:02:05.098 INFO:tasks.workunit.client.1.smithi099.stdout:0/897: creat da/d59/f12a x:0 0 0 2024-09-17T01:02:05.099 INFO:tasks.workunit.client.1.smithi099.stdout:3/916: write d9/d15/d7d/f8a [753902,3120] 0 2024-09-17T01:02:05.099 INFO:tasks.workunit.client.0.smithi002.stdout:2/812: creat d1b/d1d/f124 x:0 0 0 2024-09-17T01:02:05.100 INFO:tasks.workunit.client.1.smithi099.stdout:3/917: rename d9/d2b/f2d to d9/d15/d18/d1a/d23/d5c/d99/dda/db5/f12d 0 2024-09-17T01:02:05.100 INFO:tasks.workunit.client.0.smithi002.stdout:2/813: dread d1b/d1d/f98 [0,4194304] 0 2024-09-17T01:02:05.102 INFO:tasks.workunit.client.1.smithi099.stdout:3/918: unlink d9/d15/d18/d1a/d23/d5c/d99/dda/caa 0 2024-09-17T01:02:05.103 INFO:tasks.workunit.client.1.smithi099.stdout:3/919: truncate d9/d15/d18/f82 1548664 0 2024-09-17T01:02:05.105 INFO:tasks.workunit.client.0.smithi002.stdout:9/792: write d5/dc/f3d [3284875,41153] 0 2024-09-17T01:02:05.105 INFO:tasks.workunit.client.0.smithi002.stdout:9/793: chown d5/dc/d26/d63/lc3 1436727 1 2024-09-17T01:02:05.105 INFO:tasks.workunit.client.0.smithi002.stdout:2/814: dread d1b/d37/f4d [4194304,4194304] 0 2024-09-17T01:02:05.106 INFO:tasks.workunit.client.1.smithi099.stdout:3/920: rmdir d9/d15/d18/d1a/d23/d5c/d99/dda/db5/dca 39 2024-09-17T01:02:05.108 INFO:tasks.workunit.client.0.smithi002.stdout:5/831: dwrite d2/d2d/d10/d23/d6e/f6b [0,4194304] 0 2024-09-17T01:02:05.108 INFO:tasks.workunit.client.0.smithi002.stdout:5/832: write d2/d2d/d10/d14/d19/da5/fb5 [1766756,16071] 0 2024-09-17T01:02:05.108 INFO:tasks.workunit.client.0.smithi002.stdout:9/794: mknod d5/dc/d26/d63/d66/dd7/cf1 0 2024-09-17T01:02:05.108 INFO:tasks.workunit.client.0.smithi002.stdout:2/815: truncate d1b/d37/d48/fba 728031 0 2024-09-17T01:02:05.108 INFO:tasks.workunit.client.0.smithi002.stdout:2/816: write d1b/d37/d48/d52/f9a [5238586,24563] 0 2024-09-17T01:02:05.108 INFO:tasks.workunit.client.0.smithi002.stdout:2/817: fdatasync d1b/d37/d48/d52/de6/f8d 0 2024-09-17T01:02:05.109 INFO:tasks.workunit.client.0.smithi002.stdout:2/818: truncate d1b/f29 1167875 0 2024-09-17T01:02:05.110 INFO:tasks.workunit.client.0.smithi002.stdout:5/833: mkdir d2/d2d/d10/d14/d19/d39/d48/def/d106 0 2024-09-17T01:02:05.110 INFO:tasks.workunit.client.1.smithi099.stdout:0/898: dread da/d12/d2b/df0/d10d/f3d [0,4194304] 0 2024-09-17T01:02:05.110 INFO:tasks.workunit.client.1.smithi099.stdout:0/899: stat da/df/d1a/d56/d72/dd0 0 2024-09-17T01:02:05.125 INFO:tasks.workunit.client.1.smithi099.stdout:0/900: read da/df/d1a/d49/dac/f40 [2289430,90863] 0 2024-09-17T01:02:05.125 INFO:tasks.workunit.client.1.smithi099.stdout:0/901: write da/df/d20/dbf/f112 [2666243,14208] 0 2024-09-17T01:02:05.125 INFO:tasks.workunit.client.1.smithi099.stdout:0/902: chown da/d12/d22/d53 3473269 1 2024-09-17T01:02:05.125 INFO:tasks.workunit.client.1.smithi099.stdout:0/903: chown da/d3b/f5b 2049188811 1 2024-09-17T01:02:05.125 INFO:tasks.workunit.client.1.smithi099.stdout:0/904: creat da/d59/d80/f12b x:0 0 0 2024-09-17T01:02:05.127 INFO:tasks.workunit.client.1.smithi099.stdout:0/905: creat da/d12/d2b/f12c x:0 0 0 2024-09-17T01:02:05.128 INFO:tasks.workunit.client.1.smithi099.stdout:0/906: dread - da/d12/d2b/dab/db5/f89 zero size 2024-09-17T01:02:05.128 INFO:tasks.workunit.client.1.smithi099.stdout:0/907: creat da/df/d20/dbf/f12d x:0 0 0 2024-09-17T01:02:05.128 INFO:tasks.workunit.client.1.smithi099.stdout:0/908: readlink da/l2e 0 2024-09-17T01:02:05.129 INFO:tasks.workunit.client.1.smithi099.stdout:0/909: mkdir da/d12/d22/d120/d12e 0 2024-09-17T01:02:05.131 INFO:tasks.workunit.client.1.smithi099.stdout:8/887: dwrite d0/d1f/d90/db8/dde/d29/d4b/db3/de9/f108 [0,4194304] 0 2024-09-17T01:02:05.132 INFO:tasks.workunit.client.0.smithi002.stdout:4/969: dwrite d7/de/d3a/dac/ff1 [0,4194304] 0 2024-09-17T01:02:05.135 INFO:tasks.workunit.client.1.smithi099.stdout:8/888: unlink d0/d1f/d90/db8/dde/f49 0 2024-09-17T01:02:05.136 INFO:tasks.workunit.client.1.smithi099.stdout:8/889: symlink d0/d1f/d90/db8/dde/d64/dbe/l123 0 2024-09-17T01:02:05.136 INFO:tasks.workunit.client.1.smithi099.stdout:8/890: read d0/d1f/d90/db8/dde/d29/d4b/fa6 [98978,110710] 0 2024-09-17T01:02:05.136 INFO:tasks.workunit.client.1.smithi099.stdout:8/891: truncate d0/d1f/d90/db8/dde/dc3/ffd 542177 0 2024-09-17T01:02:05.137 INFO:tasks.workunit.client.1.smithi099.stdout:8/892: mkdir d0/d53/de0/d124 0 2024-09-17T01:02:05.139 INFO:tasks.workunit.client.1.smithi099.stdout:8/893: dread d0/d41/f9a [0,4194304] 0 2024-09-17T01:02:05.139 INFO:tasks.workunit.client.1.smithi099.stdout:8/894: truncate d0/d1f/d90/db8/dde/d29/ff4 993445 0 2024-09-17T01:02:05.139 INFO:tasks.workunit.client.1.smithi099.stdout:8/895: mkdir d0/d53/de0/d124/d125 0 2024-09-17T01:02:05.150 INFO:tasks.workunit.client.0.smithi002.stdout:4/970: write d7/d19/d9f/fb3 [2104403,123477] 0 2024-09-17T01:02:05.155 INFO:tasks.workunit.client.0.smithi002.stdout:9/795: dwrite d5/dc/d26/f7e [0,4194304] 0 2024-09-17T01:02:05.166 INFO:tasks.workunit.client.0.smithi002.stdout:4/971: dread d7/de/d3a/f97 [0,4194304] 0 2024-09-17T01:02:05.167 INFO:tasks.workunit.client.0.smithi002.stdout:4/972: readlink d7/de/d3a/d109/lff 0 2024-09-17T01:02:05.169 INFO:tasks.workunit.client.0.smithi002.stdout:1/884: dwrite d4/d11/fa8 [0,4194304] 0 2024-09-17T01:02:05.169 INFO:tasks.workunit.client.0.smithi002.stdout:5/834: dwrite d2/d2d/d10/d20/d24/f7a [0,4194304] 0 2024-09-17T01:02:05.169 INFO:tasks.workunit.client.0.smithi002.stdout:1/885: dread - d4/f118 zero size 2024-09-17T01:02:05.169 INFO:tasks.workunit.client.0.smithi002.stdout:1/886: creat d4/d11/d12/d30/d5e/df1/f12f x:0 0 0 2024-09-17T01:02:05.171 INFO:tasks.workunit.client.0.smithi002.stdout:2/819: dwrite d1b/d37/d48/d52/db5/fd3 [0,4194304] 0 2024-09-17T01:02:05.172 INFO:tasks.workunit.client.0.smithi002.stdout:2/820: fsync d1b/d1d/f7c 0 2024-09-17T01:02:05.172 INFO:tasks.workunit.client.1.smithi099.stdout:3/921: dwrite d9/d15/d18/d1a/d23/d4c/d64/ff1 [4194304,4194304] 0 2024-09-17T01:02:05.172 INFO:tasks.workunit.client.1.smithi099.stdout:3/922: readlink d9/d3b/d44/l122 0 2024-09-17T01:02:05.172 INFO:tasks.workunit.client.0.smithi002.stdout:9/796: dwrite d5/dc/d26/d5c/d6b/d75/d57/fbe [0,4194304] 0 2024-09-17T01:02:05.173 INFO:tasks.workunit.client.1.smithi099.stdout:0/910: dwrite da/df/d1a/d56/f74 [0,4194304] 0 2024-09-17T01:02:05.173 INFO:tasks.workunit.client.1.smithi099.stdout:8/896: dwrite d0/d53/f83 [0,4194304] 0 2024-09-17T01:02:05.173 INFO:tasks.workunit.client.1.smithi099.stdout:0/911: write da/df/d1a/d63/d6a/f6e [18117,126254] 0 2024-09-17T01:02:05.176 INFO:tasks.workunit.client.0.smithi002.stdout:1/887: mkdir d4/d11/d1c/d130 0 2024-09-17T01:02:05.176 INFO:tasks.workunit.client.1.smithi099.stdout:8/897: rename d0/d1f/d90/db8/dde/d64/dbe/fc2 to d0/d1f/d90/db8/f126 0 2024-09-17T01:02:05.177 INFO:tasks.workunit.client.1.smithi099.stdout:0/912: link da/fae da/df/d1a/d56/d72/d11e/f12f 0 2024-09-17T01:02:05.177 INFO:tasks.workunit.client.1.smithi099.stdout:0/913: write da/df/d1a/d63/d6a/f6e [41979,47820] 0 2024-09-17T01:02:05.177 INFO:tasks.workunit.client.1.smithi099.stdout:0/914: creat da/d12/d2b/dab/dba/dfa/f130 x:0 0 0 2024-09-17T01:02:05.177 INFO:tasks.workunit.client.1.smithi099.stdout:0/915: creat da/df/d31/f131 x:0 0 0 2024-09-17T01:02:05.178 INFO:tasks.workunit.client.0.smithi002.stdout:2/821: creat d1b/d3f/d59/d7f/dc9/d72/dda/f125 x:0 0 0 2024-09-17T01:02:05.179 INFO:tasks.workunit.client.1.smithi099.stdout:8/898: mknod d0/d1f/d90/db8/dde/dc3/c127 0 2024-09-17T01:02:05.179 INFO:tasks.workunit.client.1.smithi099.stdout:8/899: write d0/d1f/d90/db8/dde/d29/fc1 [1392892,82188] 0 2024-09-17T01:02:05.180 INFO:tasks.workunit.client.1.smithi099.stdout:8/900: fdatasync d0/d1f/d90/db8/dde/f6c 0 2024-09-17T01:02:05.180 INFO:tasks.workunit.client.1.smithi099.stdout:8/901: creat d0/d1f/d90/db8/dde/f128 x:0 0 0 2024-09-17T01:02:05.180 INFO:tasks.workunit.client.0.smithi002.stdout:9/797: mkdir d5/dc/d26/d5c/de4/df2 0 2024-09-17T01:02:05.180 INFO:tasks.workunit.client.0.smithi002.stdout:5/835: dread d2/d2d/d10/d14/d19/d39/d43/fee [0,4194304] 0 2024-09-17T01:02:05.181 INFO:tasks.workunit.client.0.smithi002.stdout:2/822: creat d1b/d37/d48/d52/f126 x:0 0 0 2024-09-17T01:02:05.182 INFO:tasks.workunit.client.0.smithi002.stdout:4/973: dwrite d7/f82 [0,4194304] 0 2024-09-17T01:02:05.183 INFO:tasks.workunit.client.0.smithi002.stdout:9/798: rename d5/dc/f4b to d5/dc/d26/d5c/d6b/d75/d57/d8d/ff3 0 2024-09-17T01:02:05.183 INFO:tasks.workunit.client.0.smithi002.stdout:9/799: stat d5/dc/d26/d5c/d6b/d75/d57/d8d/faa 0 2024-09-17T01:02:05.184 INFO:tasks.workunit.client.0.smithi002.stdout:9/800: creat d5/dc/d26/d46/d47/d89/ff4 x:0 0 0 2024-09-17T01:02:05.184 INFO:tasks.workunit.client.0.smithi002.stdout:5/836: symlink d2/de/dfc/dd5/l107 0 2024-09-17T01:02:05.185 INFO:tasks.workunit.client.0.smithi002.stdout:2/823: mknod d1b/d37/d48/d52/c127 0 2024-09-17T01:02:05.186 INFO:tasks.workunit.client.0.smithi002.stdout:2/824: write d1b/d37/d48/d52/de6/fca [1370799,72921] 0 2024-09-17T01:02:05.187 INFO:tasks.workunit.client.0.smithi002.stdout:7/883: sync 2024-09-17T01:02:05.187 INFO:tasks.workunit.client.0.smithi002.stdout:3/787: sync 2024-09-17T01:02:05.187 INFO:tasks.workunit.client.0.smithi002.stdout:6/881: sync 2024-09-17T01:02:05.187 INFO:tasks.workunit.client.0.smithi002.stdout:0/746: sync 2024-09-17T01:02:05.187 INFO:tasks.workunit.client.0.smithi002.stdout:7/884: stat d1/d14/d1d/d28/d6b/d9e/d54/de8 0 2024-09-17T01:02:05.189 INFO:tasks.workunit.client.0.smithi002.stdout:4/974: creat d7/d19/d9f/d10d/f12c x:0 0 0 2024-09-17T01:02:05.193 INFO:tasks.workunit.client.0.smithi002.stdout:9/801: rename d5/dc/d26/d46/d47/da1/fad to d5/dc/d26/d63/d66/dd7/ff5 0 2024-09-17T01:02:05.196 INFO:tasks.workunit.client.0.smithi002.stdout:5/837: symlink d2/d2d/d10/d14/d19/d39/d48/d9d/l108 0 2024-09-17T01:02:05.196 INFO:tasks.workunit.client.0.smithi002.stdout:5/838: write d2/d2d/f17 [260649,68792] 0 2024-09-17T01:02:05.196 INFO:tasks.workunit.client.0.smithi002.stdout:5/839: fsync d2/d2d/d10/d14/d19/da5/db0/d33/fd7 0 2024-09-17T01:02:05.197 INFO:tasks.workunit.client.0.smithi002.stdout:2/825: unlink d1b/d37/d48/d52/c127 0 2024-09-17T01:02:05.197 INFO:tasks.workunit.client.0.smithi002.stdout:6/882: dread d2/d1d/d26/d49/fa0 [0,4194304] 0 2024-09-17T01:02:05.198 INFO:tasks.workunit.client.0.smithi002.stdout:0/747: mknod dd/d19/da9/de5/db9/cfa 0 2024-09-17T01:02:05.201 INFO:tasks.workunit.client.0.smithi002.stdout:4/975: mkdir d7/de/d32/d126/d8e/dd0/d12d 0 2024-09-17T01:02:05.202 INFO:tasks.workunit.client.0.smithi002.stdout:4/976: creat d7/d19/d9f/d80/d62/dbe/df4/f12e x:0 0 0 2024-09-17T01:02:05.202 INFO:tasks.workunit.client.0.smithi002.stdout:5/840: symlink d2/d2d/d10/d14/d19/d39/d48/def/dfa/l109 0 2024-09-17T01:02:05.204 INFO:tasks.workunit.client.1.smithi099.stdout:0/916: dwrite da/d12/d2b/dab/db5/f89 [0,4194304] 0 2024-09-17T01:02:05.204 INFO:tasks.workunit.client.1.smithi099.stdout:0/917: truncate da/df/d20/fcf 3431562 0 2024-09-17T01:02:05.205 INFO:tasks.workunit.client.0.smithi002.stdout:6/883: unlink d2/d1d/d2d/ccb 0 2024-09-17T01:02:05.205 INFO:tasks.workunit.client.0.smithi002.stdout:9/802: dread d5/dc/d26/d63/fb7 [0,4194304] 0 2024-09-17T01:02:05.206 INFO:tasks.workunit.client.0.smithi002.stdout:0/748: rename dd/d19/d1c/d1f/l58 to dd/d19/da9/de5/d68/d9d/dbe/df5/lfb 0 2024-09-17T01:02:05.207 INFO:tasks.workunit.client.0.smithi002.stdout:3/788: dwrite d0/d3/d17/d6a/fb7 [0,4194304] 0 2024-09-17T01:02:05.209 INFO:tasks.workunit.client.0.smithi002.stdout:5/841: symlink d2/de/d57/l10a 0 2024-09-17T01:02:05.209 INFO:tasks.workunit.client.0.smithi002.stdout:5/842: write d2/d2d/d10/d9b/fa2 [247865,7924] 0 2024-09-17T01:02:05.210 INFO:tasks.workunit.client.0.smithi002.stdout:6/884: rmdir d2 39 2024-09-17T01:02:05.211 INFO:tasks.workunit.client.0.smithi002.stdout:6/885: dread - d2/d1d/d27/d87/f11a zero size 2024-09-17T01:02:05.212 INFO:tasks.workunit.client.0.smithi002.stdout:9/803: link d5/dc/d26/d5c/d6b/d75/d57/d8d/faa d5/dc/d26/d46/d47/d89/dec/ff6 0 2024-09-17T01:02:05.212 INFO:tasks.workunit.client.0.smithi002.stdout:9/804: stat d5/dc/d26/d5c/d6b/d75/c70 0 2024-09-17T01:02:05.213 INFO:tasks.workunit.client.0.smithi002.stdout:2/826: dwrite d1b/d37/f91 [0,4194304] 0 2024-09-17T01:02:05.214 INFO:tasks.workunit.client.0.smithi002.stdout:3/789: rmdir d0/d3/d37 39 2024-09-17T01:02:05.216 INFO:tasks.workunit.client.0.smithi002.stdout:4/977: link d7/de/d3a/d109/dc7/d11d/f39 d7/d19/d9f/d80/d62/dbe/df5/d102/f12f 0 2024-09-17T01:02:05.218 INFO:tasks.workunit.client.0.smithi002.stdout:5/843: mkdir d2/d2d/d10/d14/dce/d10b 0 2024-09-17T01:02:05.218 INFO:tasks.workunit.client.0.smithi002.stdout:5/844: creat d2/de/f10c x:0 0 0 2024-09-17T01:02:05.219 INFO:tasks.workunit.client.0.smithi002.stdout:5/845: stat d2/d2d/d10/d95/lac 0 2024-09-17T01:02:05.221 INFO:tasks.workunit.client.0.smithi002.stdout:6/886: rename d2/d1d/d2d/d35/dc1/lca to d2/d1d/d2d/d35/d37/l12a 0 2024-09-17T01:02:05.221 INFO:tasks.workunit.client.0.smithi002.stdout:6/887: readlink d2/d1d/d2d/d35/d79/la4 0 2024-09-17T01:02:05.222 INFO:tasks.workunit.client.0.smithi002.stdout:9/805: rmdir d5/dc/d26/d5c/d6b/d75/d57/d7a 39 2024-09-17T01:02:05.226 INFO:tasks.workunit.client.0.smithi002.stdout:3/790: symlink d0/d3/d17/d87/lfd 0 2024-09-17T01:02:05.229 INFO:tasks.workunit.client.0.smithi002.stdout:2/827: dwrite d1b/d37/d48/db1/dbb/f103 [0,4194304] 0 2024-09-17T01:02:05.229 INFO:tasks.workunit.client.0.smithi002.stdout:2/828: creat d1b/d3f/d59/d7f/dc9/d72/dda/f128 x:0 0 0 2024-09-17T01:02:05.229 INFO:tasks.workunit.client.0.smithi002.stdout:2/829: creat d1b/d1d/dc8/f129 x:0 0 0 2024-09-17T01:02:05.229 INFO:tasks.workunit.client.0.smithi002.stdout:0/749: dwrite dd/d19/d1c/fa0 [0,4194304] 0 2024-09-17T01:02:05.230 INFO:tasks.workunit.client.0.smithi002.stdout:3/791: link d0/d3/d33/d77/l8c d0/d31/d32/dcb/de7/lfe 0 2024-09-17T01:02:05.231 INFO:tasks.workunit.client.0.smithi002.stdout:4/978: symlink d7/de/d3a/d109/dc7/d11d/dc0/dcf/l130 0 2024-09-17T01:02:05.231 INFO:tasks.workunit.client.1.smithi099.stdout:8/902: rename d0/d1f/d90/db8/dde/d64 to d0/d1f/d90/db8/dde/d29/d4b/df2/d129 0 2024-09-17T01:02:05.234 INFO:tasks.workunit.client.1.smithi099.stdout:0/918: rename da/d12/d2b/dab/db5/l7b to da/d12/d22/d66/l132 0 2024-09-17T01:02:05.234 INFO:tasks.workunit.client.1.smithi099.stdout:0/919: stat da/l2e 0 2024-09-17T01:02:05.236 INFO:tasks.workunit.client.0.smithi002.stdout:0/750: link dd/d19/da9/de5/db9/fd2 dd/d19/d1a/d29/d55/d61/ffc 0 2024-09-17T01:02:05.236 INFO:tasks.workunit.client.0.smithi002.stdout:0/751: write dd/d3d/f8d [747275,36340] 0 2024-09-17T01:02:05.239 INFO:tasks.workunit.client.0.smithi002.stdout:3/792: unlink d0/d3/d17/f6d 0 2024-09-17T01:02:05.242 INFO:tasks.workunit.client.0.smithi002.stdout:4/979: mkdir d7/d3f/da9/dca/d112/d131 0 2024-09-17T01:02:05.242 INFO:tasks.workunit.client.0.smithi002.stdout:4/980: chown d7/de/c47 225 1 2024-09-17T01:02:05.243 INFO:tasks.workunit.client.0.smithi002.stdout:6/888: dwrite d2/d1d/d2d/d35/d37/f8b [0,4194304] 0 2024-09-17T01:02:05.243 INFO:tasks.workunit.client.0.smithi002.stdout:6/889: fsync d2/d1d/d26/ffc 0 2024-09-17T01:02:05.243 INFO:tasks.workunit.client.0.smithi002.stdout:6/890: stat d2/d1d/d27/d80/d93/dd5/d5c/c108 0 2024-09-17T01:02:05.243 INFO:tasks.workunit.client.0.smithi002.stdout:6/891: fdatasync d2/d1d/d99/db9/f100 0 2024-09-17T01:02:05.243 INFO:tasks.workunit.client.0.smithi002.stdout:0/752: creat dd/d19/da9/de5/d68/d9d/ffd x:0 0 0 2024-09-17T01:02:05.245 INFO:tasks.workunit.client.0.smithi002.stdout:3/793: mknod d0/d3/d37/dac/da1/dd8/cff 0 2024-09-17T01:02:05.249 INFO:tasks.workunit.client.0.smithi002.stdout:4/981: read d7/f82 [2440201,37277] 0 2024-09-17T01:02:05.249 INFO:tasks.workunit.client.0.smithi002.stdout:6/892: mkdir d2/d1d/d2d/d35/d6d/d106/d12b 0 2024-09-17T01:02:05.249 INFO:tasks.workunit.client.0.smithi002.stdout:6/893: readlink d2/d1d/d2d/d73/l11c 0 2024-09-17T01:02:05.250 INFO:tasks.workunit.client.0.smithi002.stdout:0/753: link dd/d19/d1a/d29/d55/d61/ld7 dd/d19/d1c/deb/lfe 0 2024-09-17T01:02:05.250 INFO:tasks.workunit.client.0.smithi002.stdout:0/754: dread - dd/d19/d1a/d29/d55/fcb zero size 2024-09-17T01:02:05.251 INFO:tasks.workunit.client.0.smithi002.stdout:3/794: rmdir d0/d3/d37/dac/da1/dd8 39 2024-09-17T01:02:05.251 INFO:tasks.workunit.client.0.smithi002.stdout:3/795: fdatasync d0/d3/d37/dac/da1/dd8/fc8 0 2024-09-17T01:02:05.251 INFO:tasks.workunit.client.0.smithi002.stdout:3/796: chown d0/d3/d17/d35 12222 1 2024-09-17T01:02:05.251 INFO:tasks.workunit.client.0.smithi002.stdout:3/797: readlink d0/d3/d37/lbc 0 2024-09-17T01:02:05.251 INFO:tasks.workunit.client.0.smithi002.stdout:3/798: dread - d0/d3/d17/d9a/f5d zero size 2024-09-17T01:02:05.252 INFO:tasks.workunit.client.0.smithi002.stdout:4/982: getdents d7/d19/d9f/d80/d62/dbe/df5 0 2024-09-17T01:02:05.252 INFO:tasks.workunit.client.0.smithi002.stdout:0/755: write dd/f36 [264834,20733] 0 2024-09-17T01:02:05.253 INFO:tasks.workunit.client.0.smithi002.stdout:6/894: creat d2/d1d/d2d/d35/dc1/f12c x:0 0 0 2024-09-17T01:02:05.253 INFO:tasks.workunit.client.0.smithi002.stdout:3/799: symlink d0/d31/d32/d92/l100 0 2024-09-17T01:02:05.255 INFO:tasks.workunit.client.0.smithi002.stdout:4/983: write d7/de/d3a/d109/dc7/d11d/fbd [3183746,32302] 0 2024-09-17T01:02:05.258 INFO:tasks.workunit.client.1.smithi099.stdout:8/903: dwrite d0/d1f/d90/db8/dde/fb [4194304,4194304] 0 2024-09-17T01:02:05.259 INFO:tasks.workunit.client.1.smithi099.stdout:8/904: creat d0/d1f/d90/db8/dde/dc3/f12a x:0 0 0 2024-09-17T01:02:05.260 INFO:tasks.workunit.client.1.smithi099.stdout:8/905: truncate d0/d53/fb9 397856 0 2024-09-17T01:02:05.260 INFO:tasks.workunit.client.1.smithi099.stdout:8/906: write d0/d1f/d90/db8/dde/f3a [5475367,7071] 0 2024-09-17T01:02:05.261 INFO:tasks.workunit.client.1.smithi099.stdout:0/920: dwrite da/d12/f16 [0,4194304] 0 2024-09-17T01:02:05.262 INFO:tasks.workunit.client.0.smithi002.stdout:4/984: mkdir d7/d19/d9c/d132 0 2024-09-17T01:02:05.263 INFO:tasks.workunit.client.0.smithi002.stdout:0/756: rmdir dd/d19/da9 39 2024-09-17T01:02:05.267 INFO:tasks.workunit.client.1.smithi099.stdout:8/907: getdents d0/d1f/d90/db8/dde 0 2024-09-17T01:02:05.267 INFO:tasks.workunit.client.0.smithi002.stdout:0/757: mkdir dd/d19/d1c/db7/db4/dff 0 2024-09-17T01:02:05.267 INFO:tasks.workunit.client.0.smithi002.stdout:0/758: creat dd/d19/d1c/deb/f100 x:0 0 0 2024-09-17T01:02:05.269 INFO:tasks.workunit.client.1.smithi099.stdout:8/908: symlink d0/d1f/d90/db8/dde/d29/d4b/db3/l12b 0 2024-09-17T01:02:05.270 INFO:tasks.workunit.client.1.smithi099.stdout:8/909: mknod d0/d1f/d90/db8/dde/d29/d4b/df2/d129/dcf/c12c 0 2024-09-17T01:02:05.270 INFO:tasks.workunit.client.1.smithi099.stdout:8/910: stat d0/d1f/d31/f43 0 2024-09-17T01:02:05.270 INFO:tasks.workunit.client.1.smithi099.stdout:8/911: write d0/d1f/d90/db8/dde/d29/d4b/db3/dd8/f10d [184749,15143] 0 2024-09-17T01:02:05.271 INFO:tasks.workunit.client.1.smithi099.stdout:8/912: chown d0/d1f/d90/ffc 1350 1 2024-09-17T01:02:05.271 INFO:tasks.workunit.client.1.smithi099.stdout:8/913: getdents d0/d41/d5a/dcd 0 2024-09-17T01:02:05.273 INFO:tasks.workunit.client.1.smithi099.stdout:8/914: getdents d0/d1f/d90/db8/dde/d29/d4b/df2 0 2024-09-17T01:02:05.273 INFO:tasks.workunit.client.0.smithi002.stdout:4/985: write d7/de/d3a/d109/dc7/d11d/f33 [1445398,121486] 0 2024-09-17T01:02:05.274 INFO:tasks.workunit.client.1.smithi099.stdout:8/915: creat d0/d1f/d90/db8/dde/d29/d4b/df2/d129/f12d x:0 0 0 2024-09-17T01:02:05.275 INFO:tasks.workunit.client.0.smithi002.stdout:4/986: rename d7/de/d32/c60 to d7/d19/d9f/dc2/c133 0 2024-09-17T01:02:05.275 INFO:tasks.workunit.client.0.smithi002.stdout:4/987: fsync d7/d19/d9f/d80/d62/dbe/ff2 0 2024-09-17T01:02:05.293 INFO:tasks.workunit.client.0.smithi002.stdout:3/800: dwrite d0/d3/fb5 [0,4194304] 0 2024-09-17T01:02:05.293 INFO:tasks.workunit.client.0.smithi002.stdout:3/801: write d0/d3/d8d/f9c [40309,73762] 0 2024-09-17T01:02:05.293 INFO:tasks.workunit.client.0.smithi002.stdout:3/802: chown d0/d3/d17/d9a/f89 847628 1 2024-09-17T01:02:05.293 INFO:tasks.workunit.client.0.smithi002.stdout:3/803: unlink d0/d3/d17/f3a 0 2024-09-17T01:02:05.310 INFO:tasks.workunit.client.0.smithi002.stdout:6/895: dwrite d2/d1d/d26/f2b [0,4194304] 0 2024-09-17T01:02:05.310 INFO:tasks.workunit.client.0.smithi002.stdout:6/896: fdatasync d2/d1d/d27/d30/ff6 0 2024-09-17T01:02:05.316 INFO:tasks.workunit.client.1.smithi099.stdout:0/921: dwrite da/df/d1a/d56/ffe [0,4194304] 0 2024-09-17T01:02:05.317 INFO:tasks.workunit.client.0.smithi002.stdout:0/759: dwrite dd/fa5 [0,4194304] 0 2024-09-17T01:02:05.317 INFO:tasks.workunit.client.0.smithi002.stdout:4/988: dwrite d7/d19/d9c/de9/f116 [0,4194304] 0 2024-09-17T01:02:05.317 INFO:tasks.workunit.client.0.smithi002.stdout:4/989: dread - d7/d19/d9c/de9/da4/f123 zero size 2024-09-17T01:02:05.317 INFO:tasks.workunit.client.0.smithi002.stdout:4/990: stat d7/de/d3a/dac 0 2024-09-17T01:02:05.318 INFO:tasks.workunit.client.1.smithi099.stdout:8/916: dwrite d0/d1f/d90/fb7 [0,4194304] 0 2024-09-17T01:02:05.318 INFO:tasks.workunit.client.1.smithi099.stdout:8/917: rmdir d0/d41/d5a/dcd 39 2024-09-17T01:02:05.323 INFO:tasks.workunit.client.1.smithi099.stdout:0/922: write da/df/d1a/d49/d68/f7f [1572791,253] 0 2024-09-17T01:02:05.324 INFO:tasks.workunit.client.1.smithi099.stdout:0/923: link da/d12/d2b/df0/d10d/d1e/f9d da/df/d4d/d6f/f133 0 2024-09-17T01:02:05.325 INFO:tasks.workunit.client.1.smithi099.stdout:0/924: truncate da/df/d1a/d56/fbd 3243937 0 2024-09-17T01:02:05.325 INFO:tasks.workunit.client.1.smithi099.stdout:0/925: write da/d12/d2b/dab/dba/dfa/f11c [200362,73789] 0 2024-09-17T01:02:05.325 INFO:tasks.workunit.client.1.smithi099.stdout:0/926: write da/d12/d22/fc4 [983834,130791] 0 2024-09-17T01:02:05.326 INFO:tasks.workunit.client.1.smithi099.stdout:0/927: creat da/df/d1a/d49/d68/d9f/dd7/f134 x:0 0 0 2024-09-17T01:02:05.328 INFO:tasks.workunit.client.1.smithi099.stdout:8/918: dread d0/d1f/d90/db8/dde/fb [4194304,4194304] 0 2024-09-17T01:02:05.328 INFO:tasks.workunit.client.1.smithi099.stdout:8/919: write d0/d1f/d90/db8/dde/dc3/ffd [926297,69056] 0 2024-09-17T01:02:05.330 INFO:tasks.workunit.client.1.smithi099.stdout:8/920: unlink d0/d1f/d90/db8/dde/d29/d4b/df2/d129/l9e 0 2024-09-17T01:02:05.331 INFO:tasks.workunit.client.1.smithi099.stdout:8/921: dread - d0/d1f/d90/db8/dde/fba zero size 2024-09-17T01:02:05.331 INFO:tasks.workunit.client.1.smithi099.stdout:8/922: write d0/d41/d5a/fa3 [1040668,7717] 0 2024-09-17T01:02:05.331 INFO:tasks.workunit.client.1.smithi099.stdout:8/923: creat d0/d1f/d90/db8/dde/d29/d4b/db3/f12e x:0 0 0 2024-09-17T01:02:05.333 INFO:tasks.workunit.client.0.smithi002.stdout:0/760: rmdir dd/d19/d1c 39 2024-09-17T01:02:05.334 INFO:tasks.workunit.client.0.smithi002.stdout:4/991: mknod d7/de/d3a/d109/dc7/d11d/d103/c134 0 2024-09-17T01:02:05.335 INFO:tasks.workunit.client.0.smithi002.stdout:0/761: symlink dd/d19/d1c/d1f/l101 0 2024-09-17T01:02:05.337 INFO:tasks.workunit.client.0.smithi002.stdout:4/992: unlink d7/de/d32/d126/d8e/dd0/d89/lea 0 2024-09-17T01:02:05.337 INFO:tasks.workunit.client.1.smithi099.stdout:8/924: rename d0/d1f/c8a to d0/d1f/d31/c12f 0 2024-09-17T01:02:05.337 INFO:tasks.workunit.client.1.smithi099.stdout:8/925: write d0/d1f/d31/f79 [4424871,111213] 0 2024-09-17T01:02:05.338 INFO:tasks.workunit.client.1.smithi099.stdout:8/926: creat d0/d1f/d90/db8/dde/f130 x:0 0 0 2024-09-17T01:02:05.343 INFO:tasks.workunit.client.1.smithi099.stdout:8/927: dread d0/d41/f9a [0,4194304] 0 2024-09-17T01:02:05.344 INFO:tasks.workunit.client.0.smithi002.stdout:0/762: dread dd/fa5 [0,4194304] 0 2024-09-17T01:02:05.345 INFO:tasks.workunit.client.1.smithi099.stdout:4/806: sync 2024-09-17T01:02:05.345 INFO:tasks.workunit.client.1.smithi099.stdout:2/714: sync 2024-09-17T01:02:05.345 INFO:tasks.workunit.client.1.smithi099.stdout:4/807: readlink d7/dd/d21/d26/d3f/d5b/le4 0 2024-09-17T01:02:05.345 INFO:tasks.workunit.client.1.smithi099.stdout:2/715: creat d2/d9/d17/d58/fe5 x:0 0 0 2024-09-17T01:02:05.346 INFO:tasks.workunit.client.0.smithi002.stdout:0/763: dread dd/d3d/f8d [0,4194304] 0 2024-09-17T01:02:05.348 INFO:tasks.workunit.client.1.smithi099.stdout:4/808: unlink d7/dd/d21/d26/d3f/d5b/l45 0 2024-09-17T01:02:05.355 INFO:tasks.workunit.client.0.smithi002.stdout:4/993: dwrite d7/d19/d9f/d80/fcb [4194304,4194304] 0 2024-09-17T01:02:05.357 INFO:tasks.workunit.client.0.smithi002.stdout:4/994: mknod d7/d19/d9c/c135 0 2024-09-17T01:02:05.359 INFO:tasks.workunit.client.0.smithi002.stdout:4/995: mkdir d7/d3f/da9/d136 0 2024-09-17T01:02:05.377 INFO:tasks.workunit.client.1.smithi099.stdout:8/928: dwrite d0/d1f/db5/fd2 [0,4194304] 0 2024-09-17T01:02:05.377 INFO:tasks.workunit.client.1.smithi099.stdout:8/929: readlink d0/d1f/d90/db8/dde/l24 0 2024-09-17T01:02:05.380 INFO:tasks.workunit.client.1.smithi099.stdout:8/930: symlink d0/d1f/d11b/l131 0 2024-09-17T01:02:05.382 INFO:tasks.workunit.client.1.smithi099.stdout:8/931: dread d0/d53/f66 [0,4194304] 0 2024-09-17T01:02:05.382 INFO:tasks.workunit.client.1.smithi099.stdout:8/932: chown d0/d1f/d31/c12f 50297 1 2024-09-17T01:02:05.382 INFO:tasks.workunit.client.1.smithi099.stdout:8/933: chown d0/d1f/fb4 1 1 2024-09-17T01:02:05.382 INFO:tasks.workunit.client.1.smithi099.stdout:8/934: stat d0/d1f/d90/db8/dde/d29/l102 0 2024-09-17T01:02:05.383 INFO:tasks.workunit.client.1.smithi099.stdout:8/935: rmdir d0/d1f/d90/db8/dde/d29/d4b/df2 39 2024-09-17T01:02:05.391 INFO:tasks.workunit.client.1.smithi099.stdout:8/936: write d0/d41/f91 [3718375,11207] 0 2024-09-17T01:02:05.400 INFO:tasks.workunit.client.1.smithi099.stdout:2/716: dwrite d2/d9/d25/f2e [0,4194304] 0 2024-09-17T01:02:05.401 INFO:tasks.workunit.client.1.smithi099.stdout:2/717: write d2/d9/d17/de0/fba [4566577,84483] 0 2024-09-17T01:02:05.401 INFO:tasks.workunit.client.1.smithi099.stdout:2/718: readlink d2/d9/d25/l39 0 2024-09-17T01:02:05.401 INFO:tasks.workunit.client.1.smithi099.stdout:4/809: dwrite d7/dd/de/d17/f91 [0,4194304] 0 2024-09-17T01:02:05.402 INFO:tasks.workunit.client.1.smithi099.stdout:2/719: mkdir d2/d9/d25/d26/d1b/d2c/d9b/de6 0 2024-09-17T01:02:05.402 INFO:tasks.workunit.client.1.smithi099.stdout:2/720: truncate d2/d9/d25/d26/d1b/d2c/f9c 832864 0 2024-09-17T01:02:05.403 INFO:tasks.workunit.client.1.smithi099.stdout:2/721: symlink d2/d9/d25/d26/d1b/d61/d7d/le7 0 2024-09-17T01:02:05.404 INFO:tasks.workunit.client.1.smithi099.stdout:2/722: read d2/d9/d25/d26/d1b/d2c/d3f/fb6 [479094,65995] 0 2024-09-17T01:02:05.404 INFO:tasks.workunit.client.1.smithi099.stdout:2/723: truncate d2/d9/d17/f69 4732682 0 2024-09-17T01:02:05.406 INFO:tasks.workunit.client.0.smithi002.stdout:4/996: dwrite d7/f14 [0,4194304] 0 2024-09-17T01:02:05.406 INFO:tasks.workunit.client.0.smithi002.stdout:4/997: read - d7/d19/d9c/de9/da4/f123 zero size 2024-09-17T01:02:05.406 INFO:tasks.workunit.client.1.smithi099.stdout:2/724: rename d2/d9/d25/d26/f20 to d2/d9/d25/d26/d1b/d61/fe8 0 2024-09-17T01:02:05.407 INFO:tasks.workunit.client.0.smithi002.stdout:4/998: mkdir d7/de/d3a/d109/dc7/d77/d137 0 2024-09-17T01:02:05.409 INFO:tasks.workunit.client.0.smithi002.stdout:4/999: truncate d7/de/d3a/d109/dc7/d11d/f46 8033217 0 2024-09-17T01:02:05.410 INFO:tasks.workunit.client.1.smithi099.stdout:2/725: dread d2/d9/d25/d26/d1b/d61/f6f [0,4194304] 0 2024-09-17T01:02:05.411 INFO:tasks.workunit.client.1.smithi099.stdout:2/726: getdents d2/d9/d25/d26/d1b/d61/d7d/d85 0 2024-09-17T01:02:05.412 INFO:tasks.workunit.client.1.smithi099.stdout:2/727: rename d2/d9/d25/d26/d1b/d2c/f48 to d2/d9/fe9 0 2024-09-17T01:02:05.413 INFO:tasks.workunit.client.1.smithi099.stdout:2/728: creat d2/d9/d25/d26/d1b/d61/d7d/d85/d98/de1/fea x:0 0 0 2024-09-17T01:02:05.413 INFO:tasks.workunit.client.1.smithi099.stdout:2/729: fsync d2/d9/d25/f2d 0 2024-09-17T01:02:05.415 INFO:tasks.workunit.client.1.smithi099.stdout:2/730: unlink d2/d9/d25/d26/l67 0 2024-09-17T01:02:05.416 INFO:tasks.workunit.client.1.smithi099.stdout:2/731: symlink d2/d9/d17/d83/dca/leb 0 2024-09-17T01:02:05.416 INFO:tasks.workunit.client.1.smithi099.stdout:2/732: creat d2/d9/d25/d26/d1b/d61/d7d/d85/d98/fec x:0 0 0 2024-09-17T01:02:05.418 INFO:tasks.workunit.client.1.smithi099.stdout:8/937: dwrite d0/d1f/d90/db8/dde/d29/fbd [0,4194304] 0 2024-09-17T01:02:05.427 INFO:tasks.workunit.client.1.smithi099.stdout:4/810: dwrite d7/dd/d21/fe8 [0,4194304] 0 2024-09-17T01:02:05.427 INFO:tasks.workunit.client.1.smithi099.stdout:4/811: fsync d7/dd/d21/d26/d3f/f94 0 2024-09-17T01:02:05.427 INFO:tasks.workunit.client.1.smithi099.stdout:4/812: write d7/fb [2806172,94978] 0 2024-09-17T01:02:05.437 INFO:tasks.workunit.client.1.smithi099.stdout:8/938: dwrite d0/d1f/d90/db8/dde/d29/d4b/df2/d129/f8d [0,4194304] 0 2024-09-17T01:02:05.438 INFO:tasks.workunit.client.1.smithi099.stdout:9/824: sync 2024-09-17T01:02:05.438 INFO:tasks.workunit.client.1.smithi099.stdout:6/846: sync 2024-09-17T01:02:05.438 INFO:tasks.workunit.client.1.smithi099.stdout:7/749: sync 2024-09-17T01:02:05.438 INFO:tasks.workunit.client.1.smithi099.stdout:9/825: write da/fd4 [401001,17728] 0 2024-09-17T01:02:05.438 INFO:tasks.workunit.client.1.smithi099.stdout:5/877: sync 2024-09-17T01:02:05.438 INFO:tasks.workunit.client.1.smithi099.stdout:5/878: fdatasync d2/dc/d14/f94 0 2024-09-17T01:02:05.439 INFO:tasks.workunit.client.1.smithi099.stdout:6/847: dread dc/d5d/d66/dc3/fd2 [0,4194304] 0 2024-09-17T01:02:05.439 INFO:tasks.workunit.client.1.smithi099.stdout:6/848: chown dc/d5d/dae/dd0 87575251 1 2024-09-17T01:02:05.439 INFO:tasks.workunit.client.1.smithi099.stdout:6/849: truncate dc/d2b/d11e/fdd 92249 0 2024-09-17T01:02:05.439 INFO:tasks.workunit.client.1.smithi099.stdout:6/850: fdatasync dc/d1a/d49/d4c/f5c 0 2024-09-17T01:02:05.439 INFO:tasks.workunit.client.1.smithi099.stdout:6/851: write dc/d5d/dae/dd0/fdb [4976930,33075] 0 2024-09-17T01:02:05.439 INFO:tasks.workunit.client.1.smithi099.stdout:6/852: write dc/d2b/fa6 [3430801,48951] 0 2024-09-17T01:02:05.440 INFO:tasks.workunit.client.1.smithi099.stdout:9/826: truncate da/d14/d48/d69/d6c/fcd 772008 0 2024-09-17T01:02:05.442 INFO:tasks.workunit.client.1.smithi099.stdout:6/853: getdents dc/d5d/dae/d96 0 2024-09-17T01:02:05.443 INFO:tasks.workunit.client.1.smithi099.stdout:6/854: mknod dc/d5d/dae/d96/dfd/d101/c121 0 2024-09-17T01:02:05.445 INFO:tasks.workunit.client.1.smithi099.stdout:4/813: write d7/dd/d21/d7b/d4b/f3e [255581,11549] 0 2024-09-17T01:02:05.447 INFO:tasks.workunit.client.1.smithi099.stdout:6/855: dread dc/d5d/dae/d96/dfd/d101/f10f [0,4194304] 0 2024-09-17T01:02:05.447 INFO:tasks.workunit.client.1.smithi099.stdout:6/856: fsync dc/d1a/d49/fba 0 2024-09-17T01:02:05.447 INFO:tasks.workunit.client.1.smithi099.stdout:6/857: readlink dc/d27/d7e/l83 0 2024-09-17T01:02:05.449 INFO:tasks.workunit.client.1.smithi099.stdout:7/750: write d1/d2c/d5c/f1d [983199,25384] 0 2024-09-17T01:02:05.449 INFO:tasks.workunit.client.1.smithi099.stdout:7/751: fdatasync d1/d2c/fa6 0 2024-09-17T01:02:05.449 INFO:tasks.workunit.client.1.smithi099.stdout:5/879: read d2/dc/d17/f70 [3488168,47486] 0 2024-09-17T01:02:05.452 INFO:tasks.workunit.client.1.smithi099.stdout:5/880: unlink d2/d45/l87 0 2024-09-17T01:02:05.452 INFO:tasks.workunit.client.1.smithi099.stdout:5/881: chown d2/dc/d17/f5d 122338750 1 2024-09-17T01:02:05.453 INFO:tasks.workunit.client.1.smithi099.stdout:7/752: creat d1/d2c/d5c/d1c/d5a/d76/dbf/fee x:0 0 0 2024-09-17T01:02:05.453 INFO:tasks.workunit.client.1.smithi099.stdout:4/814: dread d7/dd/d21/d7b/d74/f7c [0,4194304] 0 2024-09-17T01:02:05.453 INFO:tasks.workunit.client.1.smithi099.stdout:5/882: mkdir d2/dc/d17/d6b/d127 0 2024-09-17T01:02:05.454 INFO:tasks.workunit.client.1.smithi099.stdout:5/883: read - d2/dc/d17/d3c/d72/f9f zero size 2024-09-17T01:02:05.454 INFO:tasks.workunit.client.0.smithi002.stdout:5/846: sync 2024-09-17T01:02:05.454 INFO:tasks.workunit.client.0.smithi002.stdout:7/885: sync 2024-09-17T01:02:05.454 INFO:tasks.workunit.client.0.smithi002.stdout:5/847: stat d2/d2d/d10/d23/d6a 0 2024-09-17T01:02:05.454 INFO:tasks.workunit.client.0.smithi002.stdout:1/888: sync 2024-09-17T01:02:05.454 INFO:tasks.workunit.client.0.smithi002.stdout:1/889: chown d4/d22/d8d/f105 72394 1 2024-09-17T01:02:05.454 INFO:tasks.workunit.client.0.smithi002.stdout:7/886: creat d1/d14/d67/dc0/dcd/f11c x:0 0 0 2024-09-17T01:02:05.455 INFO:tasks.workunit.client.0.smithi002.stdout:5/848: dread d2/d2d/d10/d23/d6a/feb [0,4194304] 0 2024-09-17T01:02:05.456 INFO:tasks.workunit.client.0.smithi002.stdout:1/890: mkdir d4/d11/d12/d14/d17/d51/d88/da3/d131 0 2024-09-17T01:02:05.458 INFO:tasks.workunit.client.0.smithi002.stdout:7/887: creat d1/d14/d1d/d28/d6b/d9e/d10a/f11d x:0 0 0 2024-09-17T01:02:05.459 INFO:tasks.workunit.client.0.smithi002.stdout:5/849: mknod d2/d2d/d10/d95/d96/c10d 0 2024-09-17T01:02:05.459 INFO:tasks.workunit.client.0.smithi002.stdout:5/850: dread - d2/d2d/d10/d14/d19/da5/db0/d33/f101 zero size 2024-09-17T01:02:05.459 INFO:tasks.workunit.client.0.smithi002.stdout:5/851: readlink d2/d2d/d10/d14/d19/d39/d3f/l90 0 2024-09-17T01:02:05.461 INFO:tasks.workunit.client.0.smithi002.stdout:1/891: mknod d4/d11/d1a/daa/dbb/c132 0 2024-09-17T01:02:05.461 INFO:tasks.workunit.client.1.smithi099.stdout:9/827: dwrite da/d9b/fa1 [0,4194304] 0 2024-09-17T01:02:05.462 INFO:tasks.workunit.client.0.smithi002.stdout:5/852: mkdir d2/d2d/d10/d14/d19/da5/db0/dcd/d10e 0 2024-09-17T01:02:05.464 INFO:tasks.workunit.client.0.smithi002.stdout:5/853: getdents d2/d2d/d10/d14/d19/d39/d48/def/dfa 0 2024-09-17T01:02:05.467 INFO:tasks.workunit.client.0.smithi002.stdout:5/854: mknod d2/de/d57/c10f 0 2024-09-17T01:02:05.468 INFO:tasks.workunit.client.0.smithi002.stdout:5/855: rename d2/d2d/d10/d14/d19/da5/db0/fc0 to d2/d2d/d10/d14/d19/d39/de5/f110 0 2024-09-17T01:02:05.468 INFO:tasks.workunit.client.0.smithi002.stdout:5/856: read - d2/ff1 zero size 2024-09-17T01:02:05.469 INFO:tasks.workunit.client.0.smithi002.stdout:5/857: symlink d2/d2d/l111 0 2024-09-17T01:02:05.469 INFO:tasks.workunit.client.1.smithi099.stdout:4/815: dread d7/dd/d21/d26/d3f/d5b/f37 [0,4194304] 0 2024-09-17T01:02:05.470 INFO:tasks.workunit.client.1.smithi099.stdout:5/884: dread d2/dc/f74 [0,4194304] 0 2024-09-17T01:02:05.471 INFO:tasks.workunit.client.1.smithi099.stdout:9/828: write da/d21/f8f [8616,76204] 0 2024-09-17T01:02:05.472 INFO:tasks.workunit.client.1.smithi099.stdout:9/829: creat da/d56/d84/f10d x:0 0 0 2024-09-17T01:02:05.473 INFO:tasks.workunit.client.1.smithi099.stdout:9/830: write da/d56/d84/db9/fcb [4737930,64710] 0 2024-09-17T01:02:05.473 INFO:tasks.workunit.client.1.smithi099.stdout:9/831: chown da/d18/cc3 456 1 2024-09-17T01:02:05.473 INFO:tasks.workunit.client.1.smithi099.stdout:9/832: fdatasync da/d18/d49/f63 0 2024-09-17T01:02:05.473 INFO:tasks.workunit.client.1.smithi099.stdout:9/833: readlink da/d50/d104/d105/lab 0 2024-09-17T01:02:05.474 INFO:tasks.workunit.client.1.smithi099.stdout:9/834: read - da/d56/d84/db9/f10b zero size 2024-09-17T01:02:05.475 INFO:tasks.workunit.client.0.smithi002.stdout:1/892: write d4/d11/d12/d14/d17/d56/fbf [1224865,35546] 0 2024-09-17T01:02:05.477 INFO:tasks.workunit.client.0.smithi002.stdout:1/893: creat d4/f133 x:0 0 0 2024-09-17T01:02:05.478 INFO:tasks.workunit.client.1.smithi099.stdout:4/816: dread d7/dd/d21/d26/d3f/d5b/ff7 [0,4194304] 0 2024-09-17T01:02:05.478 INFO:tasks.workunit.client.1.smithi099.stdout:4/817: creat d7/dd/de/d10/d85/f119 x:0 0 0 2024-09-17T01:02:05.478 INFO:tasks.workunit.client.1.smithi099.stdout:4/818: dread - d7/dd/de/d10/d85/f119 zero size 2024-09-17T01:02:05.478 INFO:tasks.workunit.client.1.smithi099.stdout:4/819: write d7/dd/d21/f41 [188518,90234] 0 2024-09-17T01:02:05.480 INFO:tasks.workunit.client.0.smithi002.stdout:1/894: mkdir d4/d11/d12/d30/d134 0 2024-09-17T01:02:05.480 INFO:tasks.workunit.client.0.smithi002.stdout:1/895: dread - d4/d11/d12/d23/d32/d86/f12c zero size 2024-09-17T01:02:05.480 INFO:tasks.workunit.client.0.smithi002.stdout:5/858: dread d2/d2d/d10/d14/d19/d39/d64/fb6 [0,4194304] 0 2024-09-17T01:02:05.480 INFO:tasks.workunit.client.0.smithi002.stdout:5/859: stat d2/de/f4f 0 2024-09-17T01:02:05.480 INFO:tasks.workunit.client.1.smithi099.stdout:4/820: mkdir d7/dd/d21/d26/d11a 0 2024-09-17T01:02:05.481 INFO:tasks.workunit.client.0.smithi002.stdout:5/860: rmdir d2/d2d/d10/d14/d59 39 2024-09-17T01:02:05.481 INFO:tasks.workunit.client.0.smithi002.stdout:5/861: dread - d2/d2d/d10/d14/d19/d39/d51/fea zero size 2024-09-17T01:02:05.486 INFO:tasks.workunit.client.0.smithi002.stdout:5/862: unlink d2/d2d/d10/d23/d6a/feb 0 2024-09-17T01:02:05.486 INFO:tasks.workunit.client.0.smithi002.stdout:5/863: chown d2/d2d/d10/d20/d24/l72 58 1 2024-09-17T01:02:05.486 INFO:tasks.workunit.client.1.smithi099.stdout:9/835: dread da/f44 [0,4194304] 0 2024-09-17T01:02:05.487 INFO:tasks.workunit.client.1.smithi099.stdout:9/836: mknod da/d18/db3/c10e 0 2024-09-17T01:02:05.487 INFO:tasks.workunit.client.0.smithi002.stdout:5/864: creat d2/de/d57/f112 x:0 0 0 2024-09-17T01:02:05.488 INFO:tasks.workunit.client.1.smithi099.stdout:5/885: dread d2/dc/d17/d3c/fa9 [0,4194304] 0 2024-09-17T01:02:05.488 INFO:tasks.workunit.client.1.smithi099.stdout:5/886: stat d2/dc4/d99/dd0 0 2024-09-17T01:02:05.489 INFO:tasks.workunit.client.0.smithi002.stdout:5/865: creat d2/d2d/d10/d14/d19/d39/d64/f113 x:0 0 0 2024-09-17T01:02:05.489 INFO:tasks.workunit.client.0.smithi002.stdout:5/866: creat d2/d2d/d10/d14/d19/d39/f114 x:0 0 0 2024-09-17T01:02:05.489 INFO:tasks.workunit.client.1.smithi099.stdout:5/887: stat d2/d26/d64/l7b 0 2024-09-17T01:02:05.490 INFO:tasks.workunit.client.1.smithi099.stdout:5/888: mknod d2/dc4/d90/da4/c128 0 2024-09-17T01:02:05.490 INFO:tasks.workunit.client.1.smithi099.stdout:5/889: chown d2/dc/l12 14785978 1 2024-09-17T01:02:05.491 INFO:tasks.workunit.client.1.smithi099.stdout:9/837: dread da/d18/d5e/f67 [0,4194304] 0 2024-09-17T01:02:05.491 INFO:tasks.workunit.client.1.smithi099.stdout:9/838: creat da/d56/d84/db9/f10f x:0 0 0 2024-09-17T01:02:05.491 INFO:tasks.workunit.client.1.smithi099.stdout:9/839: chown da/d50/d104/d105/dad 45912 1 2024-09-17T01:02:05.491 INFO:tasks.workunit.client.1.smithi099.stdout:9/840: fsync da/d21/d2a/f36 0 2024-09-17T01:02:05.492 INFO:tasks.workunit.client.1.smithi099.stdout:4/821: write d7/dd/d92/f9e [1632760,4960] 0 2024-09-17T01:02:05.492 INFO:tasks.workunit.client.1.smithi099.stdout:4/822: chown d7/dd/de/d10/d6b/d82/d8a 33 1 2024-09-17T01:02:05.492 INFO:tasks.workunit.client.1.smithi099.stdout:4/823: write d7/dd/f79 [1493033,68311] 0 2024-09-17T01:02:05.493 INFO:tasks.workunit.client.0.smithi002.stdout:1/896: write d4/d11/d1a/daa/dc2/fcd [3396973,33103] 0 2024-09-17T01:02:05.493 INFO:tasks.workunit.client.0.smithi002.stdout:7/888: dwrite d1/d14/d1d/d28/d6b/d9e/d5e/fed [0,4194304] 0 2024-09-17T01:02:05.493 INFO:tasks.workunit.client.1.smithi099.stdout:5/890: creat d2/dc/d17/d6b/d127/f129 x:0 0 0 2024-09-17T01:02:05.493 INFO:tasks.workunit.client.1.smithi099.stdout:9/841: getdents da/d50/d104/d105/dad 0 2024-09-17T01:02:05.493 INFO:tasks.workunit.client.1.smithi099.stdout:9/842: chown da/d21/d5b 532372092 1 2024-09-17T01:02:05.495 INFO:tasks.workunit.client.0.smithi002.stdout:1/897: creat d4/d11/d12/d30/f135 x:0 0 0 2024-09-17T01:02:05.497 INFO:tasks.workunit.client.0.smithi002.stdout:7/889: link d1/d14/d1d/d28/d2d/f35 d1/d14/d67/dc0/dcd/d45/f11e 0 2024-09-17T01:02:05.497 INFO:tasks.workunit.client.0.smithi002.stdout:7/890: read d1/d14/d1d/d28/d86/fd9 [15474,125909] 0 2024-09-17T01:02:05.498 INFO:tasks.workunit.client.1.smithi099.stdout:7/753: dwrite d1/d36/f46 [0,4194304] 0 2024-09-17T01:02:05.498 INFO:tasks.workunit.client.1.smithi099.stdout:7/754: stat d1/d2c/d47/f6c 0 2024-09-17T01:02:05.499 INFO:tasks.workunit.client.1.smithi099.stdout:4/824: rename d7/dd/de/d10/d6b/d82/d8a/d9a/ca2 to d7/dd/de/d10/d6b/d82/d8a/d9a/da6/c11b 0 2024-09-17T01:02:05.499 INFO:tasks.workunit.client.0.smithi002.stdout:1/898: mkdir d4/d11/d12/d14/d17/d40/deb/d136 0 2024-09-17T01:02:05.511 INFO:tasks.workunit.client.0.smithi002.stdout:7/891: read d1/d24/f31 [3560699,63149] 0 2024-09-17T01:02:05.512 INFO:tasks.workunit.client.1.smithi099.stdout:5/891: dwrite d2/d26/f2a [4194304,4194304] 0 2024-09-17T01:02:05.513 INFO:tasks.workunit.client.1.smithi099.stdout:5/892: chown d2/dc/d14/d36/d9a/daa/c10e 1 1 2024-09-17T01:02:05.513 INFO:tasks.workunit.client.0.smithi002.stdout:5/867: dwrite d2/d2d/d10/d3b/fe3 [0,4194304] 0 2024-09-17T01:02:05.515 INFO:tasks.workunit.client.0.smithi002.stdout:5/868: getdents d2/d2d/d10/d23 0 2024-09-17T01:02:05.517 INFO:tasks.workunit.client.0.smithi002.stdout:5/869: mkdir d2/d2d/d10/d20/d115 0 2024-09-17T01:02:05.518 INFO:tasks.workunit.client.0.smithi002.stdout:7/892: dread d1/f20 [0,4194304] 0 2024-09-17T01:02:05.518 INFO:tasks.workunit.client.0.smithi002.stdout:7/893: chown d1/d14/d1d/d28/f4f 114 1 2024-09-17T01:02:05.518 INFO:tasks.workunit.client.0.smithi002.stdout:5/870: symlink d2/d2d/d10/d14/d19/da5/db0/l116 0 2024-09-17T01:02:05.518 INFO:tasks.workunit.client.0.smithi002.stdout:5/871: creat d2/d2d/d10/d95/f117 x:0 0 0 2024-09-17T01:02:05.519 INFO:tasks.workunit.client.1.smithi099.stdout:4/825: dread d7/dd/d21/d26/f60 [0,4194304] 0 2024-09-17T01:02:05.519 INFO:tasks.workunit.client.1.smithi099.stdout:4/826: chown d7/dd/d21/d7b/d4b/l23 225979 1 2024-09-17T01:02:05.520 INFO:tasks.workunit.client.0.smithi002.stdout:5/872: mkdir d2/d2d/d10/d14/d19/da5/db0/dcd/d10e/d118 0 2024-09-17T01:02:05.521 INFO:tasks.workunit.client.1.smithi099.stdout:4/827: unlink d7/d35/l7a 0 2024-09-17T01:02:05.522 INFO:tasks.workunit.client.0.smithi002.stdout:5/873: getdents d2/d2d/d10/d23/d6a 0 2024-09-17T01:02:05.523 INFO:tasks.workunit.client.1.smithi099.stdout:4/828: read d7/dd/de/d10/fc4 [15173,109572] 0 2024-09-17T01:02:05.523 INFO:tasks.workunit.client.1.smithi099.stdout:4/829: chown d7/dd/de/d10/c7e 7585634 1 2024-09-17T01:02:05.525 INFO:tasks.workunit.client.1.smithi099.stdout:4/830: unlink d7/dd/de/d10/d6b/la3 0 2024-09-17T01:02:05.526 INFO:tasks.workunit.client.0.smithi002.stdout:0/764: sync 2024-09-17T01:02:05.526 INFO:tasks.workunit.client.0.smithi002.stdout:6/897: sync 2024-09-17T01:02:05.526 INFO:tasks.workunit.client.0.smithi002.stdout:3/804: sync 2024-09-17T01:02:05.526 INFO:tasks.workunit.client.0.smithi002.stdout:9/806: sync 2024-09-17T01:02:05.526 INFO:tasks.workunit.client.0.smithi002.stdout:9/807: fdatasync d5/dc/d26/d63/d66/fc4 0 2024-09-17T01:02:05.526 INFO:tasks.workunit.client.0.smithi002.stdout:2/830: sync 2024-09-17T01:02:05.526 INFO:tasks.workunit.client.0.smithi002.stdout:2/831: write d1b/d37/d48/d78/f117 [940761,105193] 0 2024-09-17T01:02:05.527 INFO:tasks.workunit.client.0.smithi002.stdout:0/765: creat dd/d19/d1a/d29/d55/d56/f102 x:0 0 0 2024-09-17T01:02:05.528 INFO:tasks.workunit.client.0.smithi002.stdout:0/766: read dd/d19/fe4 [526235,74271] 0 2024-09-17T01:02:05.529 INFO:tasks.workunit.client.0.smithi002.stdout:6/898: mknod d2/d1d/d26/d49/d7d/d8c/c12d 0 2024-09-17T01:02:05.529 INFO:tasks.workunit.client.0.smithi002.stdout:6/899: write d2/d1d/d2d/d35/dc1/fd0 [415337,10783] 0 2024-09-17T01:02:05.529 INFO:tasks.workunit.client.0.smithi002.stdout:6/900: chown d2/d1d/d99/db9/f100 9205393 1 2024-09-17T01:02:05.531 INFO:tasks.workunit.client.1.smithi099.stdout:4/831: dread d7/dd/f79 [0,4194304] 0 2024-09-17T01:02:05.531 INFO:tasks.workunit.client.0.smithi002.stdout:3/805: symlink d0/d3/d17/l101 0 2024-09-17T01:02:05.532 INFO:tasks.workunit.client.1.smithi099.stdout:4/832: write d7/dd/d21/d7b/d74/f75 [411760,23437] 0 2024-09-17T01:02:05.532 INFO:tasks.workunit.client.1.smithi099.stdout:4/833: chown d7/dd/l103 606163 1 2024-09-17T01:02:05.532 INFO:tasks.workunit.client.1.smithi099.stdout:4/834: fsync d7/dd/d21/d7b/d4b/dcb/f107 0 2024-09-17T01:02:05.532 INFO:tasks.workunit.client.1.smithi099.stdout:4/835: chown d7/dd/de/d10/d6b/d82/d8a/cc7 649078410 1 2024-09-17T01:02:05.533 INFO:tasks.workunit.client.0.smithi002.stdout:2/832: rename d1b/d3f/dea to d1b/d3f/d12a 0 2024-09-17T01:02:05.533 INFO:tasks.workunit.client.1.smithi099.stdout:4/836: creat d7/dd/de/d10/d6b/f11c x:0 0 0 2024-09-17T01:02:05.534 INFO:tasks.workunit.client.1.smithi099.stdout:4/837: rmdir d7/dbc 39 2024-09-17T01:02:05.534 INFO:tasks.workunit.client.1.smithi099.stdout:4/838: chown d7/dd/d21/d26/f60 26100 1 2024-09-17T01:02:05.535 INFO:tasks.workunit.client.0.smithi002.stdout:0/767: unlink dd/d19/da9/de5/db9/fcf 0 2024-09-17T01:02:05.536 INFO:tasks.workunit.client.0.smithi002.stdout:3/806: truncate d0/d31/d32/f81 123167 0 2024-09-17T01:02:05.538 INFO:tasks.workunit.client.0.smithi002.stdout:3/807: creat d0/d3/d17/d6a/f102 x:0 0 0 2024-09-17T01:02:05.538 INFO:tasks.workunit.client.0.smithi002.stdout:3/808: chown d0/d3/d17/d87/d9e 84925070 1 2024-09-17T01:02:05.538 INFO:tasks.workunit.client.0.smithi002.stdout:3/809: write d0/d3/d17/d9a/f66 [596512,52153] 0 2024-09-17T01:02:05.538 INFO:tasks.workunit.client.0.smithi002.stdout:3/810: readlink d0/d3/d17/d9a/daa/l76 0 2024-09-17T01:02:05.543 INFO:tasks.workunit.client.0.smithi002.stdout:1/899: dwrite d4/d11/d12/d30/d43/d67/fd4 [8388608,4194304] 0 2024-09-17T01:02:05.544 INFO:tasks.workunit.client.1.smithi099.stdout:7/755: dwrite d1/f25 [0,4194304] 0 2024-09-17T01:02:05.544 INFO:tasks.workunit.client.1.smithi099.stdout:7/756: fdatasync d1/d36/fa4 0 2024-09-17T01:02:05.544 INFO:tasks.workunit.client.1.smithi099.stdout:5/893: dwrite d2/f7 [0,4194304] 0 2024-09-17T01:02:05.545 INFO:tasks.workunit.client.0.smithi002.stdout:1/900: getdents d4/d11/d55 0 2024-09-17T01:02:05.545 INFO:tasks.workunit.client.0.smithi002.stdout:1/901: readlink d4/d11/d12/d14/d17/l3c 0 2024-09-17T01:02:05.547 INFO:tasks.workunit.client.0.smithi002.stdout:0/768: write dd/d19/d1c/f79 [1029826,13319] 0 2024-09-17T01:02:05.547 INFO:tasks.workunit.client.0.smithi002.stdout:7/894: dwrite d1/d14/d67/dc0/dcd/d45/fa9 [0,4194304] 0 2024-09-17T01:02:05.548 INFO:tasks.workunit.client.0.smithi002.stdout:7/895: readlink d1/d14/d1d/d28/d8f/l101 0 2024-09-17T01:02:05.548 INFO:tasks.workunit.client.1.smithi099.stdout:4/839: dread f6 [0,4194304] 0 2024-09-17T01:02:05.551 INFO:tasks.workunit.client.1.smithi099.stdout:5/894: mknod d2/dc/d17/d6b/c12a 0 2024-09-17T01:02:05.552 INFO:tasks.workunit.client.0.smithi002.stdout:0/769: creat dd/d19/d1a/d29/d55/f103 x:0 0 0 2024-09-17T01:02:05.553 INFO:tasks.workunit.client.0.smithi002.stdout:7/896: symlink d1/d14/d67/dc0/l11f 0 2024-09-17T01:02:05.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/874: dwrite d2/d2d/d10/d23/d6e/ff7 [0,4194304] 0 2024-09-17T01:02:05.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/875: write d2/d2d/d10/d14/d19/da5/fb5 [2003962,44760] 0 2024-09-17T01:02:05.557 INFO:tasks.workunit.client.0.smithi002.stdout:7/897: mkdir d1/d14/d1d/d28/d111/d120 0 2024-09-17T01:02:05.560 INFO:tasks.workunit.client.0.smithi002.stdout:5/876: creat d2/d2d/d10/d14/d19/d39/d48/d9d/d104/f119 x:0 0 0 2024-09-17T01:02:05.561 INFO:tasks.workunit.client.0.smithi002.stdout:3/811: write d0/d3/d17/f20 [4104736,62333] 0 2024-09-17T01:02:05.562 INFO:tasks.workunit.client.1.smithi099.stdout:5/895: dread d2/f32 [0,4194304] 0 2024-09-17T01:02:05.563 INFO:tasks.workunit.client.0.smithi002.stdout:5/877: rename d2/d2d/d10/d20/d24/l73 to d2/d2d/l11a 0 2024-09-17T01:02:05.563 INFO:tasks.workunit.client.1.smithi099.stdout:5/896: creat d2/dc4/d90/da4/f12b x:0 0 0 2024-09-17T01:02:05.565 INFO:tasks.workunit.client.0.smithi002.stdout:3/812: mkdir d0/d3/d37/dac/de2/d103 0 2024-09-17T01:02:05.565 INFO:tasks.workunit.client.0.smithi002.stdout:0/770: dread dd/f14 [0,4194304] 0 2024-09-17T01:02:05.565 INFO:tasks.workunit.client.0.smithi002.stdout:0/771: fsync dd/f40 0 2024-09-17T01:02:05.566 INFO:tasks.workunit.client.0.smithi002.stdout:3/813: getdents d0/d3/d17/d87/d9e 0 2024-09-17T01:02:05.567 INFO:tasks.workunit.client.0.smithi002.stdout:0/772: symlink dd/d19/d1c/db7/db4/dff/l104 0 2024-09-17T01:02:05.568 INFO:tasks.workunit.client.0.smithi002.stdout:3/814: mknod d0/d3/d37/de3/c104 0 2024-09-17T01:02:05.570 INFO:tasks.workunit.client.0.smithi002.stdout:0/773: rename dd/d19/d1c/d1f/d39/l6d to dd/d19/da9/de5/l105 0 2024-09-17T01:02:05.570 INFO:tasks.workunit.client.0.smithi002.stdout:0/774: getdents dd/d19/d1c/d1f/d22/dc3 0 2024-09-17T01:02:05.572 INFO:tasks.workunit.client.0.smithi002.stdout:0/775: creat dd/d19/d1c/d33/f106 x:0 0 0 2024-09-17T01:02:05.576 INFO:tasks.workunit.client.0.smithi002.stdout:9/808: dwrite d5/dc/f3d [0,4194304] 0 2024-09-17T01:02:05.578 INFO:tasks.workunit.client.1.smithi099.stdout:7/757: dwrite d1/d2c/d5c/fbb [0,4194304] 0 2024-09-17T01:02:05.582 INFO:tasks.workunit.client.0.smithi002.stdout:3/815: read d0/d3/d17/d9a/fc0 [483506,88009] 0 2024-09-17T01:02:05.582 INFO:tasks.workunit.client.0.smithi002.stdout:3/816: creat d0/d31/da7/f105 x:0 0 0 2024-09-17T01:02:05.583 INFO:tasks.workunit.client.1.smithi099.stdout:7/758: mknod d1/d2c/d5c/d1c/d5a/db3/dcd/cef 0 2024-09-17T01:02:05.583 INFO:tasks.workunit.client.1.smithi099.stdout:7/759: write d1/d2c/d5c/d12/f16 [247029,21304] 0 2024-09-17T01:02:05.583 INFO:tasks.workunit.client.1.smithi099.stdout:7/760: creat d1/d2c/d5c/d12/dc2/ff0 x:0 0 0 2024-09-17T01:02:05.583 INFO:tasks.workunit.client.1.smithi099.stdout:7/761: chown d1/d37/d78/db2 24335 1 2024-09-17T01:02:05.583 INFO:tasks.workunit.client.1.smithi099.stdout:7/762: write d1/d36/fa4 [797321,30827] 0 2024-09-17T01:02:05.585 INFO:tasks.workunit.client.1.smithi099.stdout:7/763: unlink d1/d37/c97 0 2024-09-17T01:02:05.585 INFO:tasks.workunit.client.1.smithi099.stdout:7/764: fsync d1/d36/f62 0 2024-09-17T01:02:05.585 INFO:tasks.workunit.client.1.smithi099.stdout:7/765: write d1/d2c/d5c/d1c/d72/fdb [4819895,14364] 0 2024-09-17T01:02:05.585 INFO:tasks.workunit.client.1.smithi099.stdout:7/766: truncate d1/d2c/d47/fca 992146 0 2024-09-17T01:02:05.585 INFO:tasks.workunit.client.1.smithi099.stdout:7/767: read - d1/d37/d4f/fe5 zero size 2024-09-17T01:02:05.585 INFO:tasks.workunit.client.1.smithi099.stdout:7/768: write d1/d2c/d7a/dac/fb9 [2399440,51028] 0 2024-09-17T01:02:05.587 INFO:tasks.workunit.client.0.smithi002.stdout:2/833: dwrite d1b/d3f/d59/d7f/dc9/fa6 [0,4194304] 0 2024-09-17T01:02:05.590 INFO:tasks.workunit.client.0.smithi002.stdout:0/776: dread dd/d3d/d94/dd1/fe1 [0,4194304] 0 2024-09-17T01:02:05.590 INFO:tasks.workunit.client.0.smithi002.stdout:6/901: dwrite d2/d1d/d2d/d35/d6d/fa1 [0,4194304] 0 2024-09-17T01:02:05.590 INFO:tasks.workunit.client.0.smithi002.stdout:0/777: truncate dd/d19/d1a/d29/d55/d56/f102 84924 0 2024-09-17T01:02:05.591 INFO:tasks.workunit.client.0.smithi002.stdout:2/834: unlink d1b/d3f/c4a 0 2024-09-17T01:02:05.592 INFO:tasks.workunit.client.0.smithi002.stdout:6/902: symlink d2/d1d/d26/l12e 0 2024-09-17T01:02:05.593 INFO:tasks.workunit.client.0.smithi002.stdout:0/778: mknod dd/d19/d9f/c107 0 2024-09-17T01:02:05.594 INFO:tasks.workunit.client.0.smithi002.stdout:3/817: write d0/d3/d33/d40/f45 [2345878,10718] 0 2024-09-17T01:02:05.594 INFO:tasks.workunit.client.0.smithi002.stdout:3/818: chown d0/d3/d8d/fa0 1853427 1 2024-09-17T01:02:05.595 INFO:tasks.workunit.client.0.smithi002.stdout:3/819: readlink d0/d31/lea 0 2024-09-17T01:02:05.595 INFO:tasks.workunit.client.0.smithi002.stdout:3/820: chown d0/d3/d17/d9a/f7c 8431 1 2024-09-17T01:02:05.595 INFO:tasks.workunit.client.0.smithi002.stdout:2/835: mkdir d1b/d74/d93/d118/d12b 0 2024-09-17T01:02:05.595 INFO:tasks.workunit.client.0.smithi002.stdout:6/903: mkdir d2/d1d/d2d/d35/d37/d12f 0 2024-09-17T01:02:05.596 INFO:tasks.workunit.client.0.smithi002.stdout:0/779: truncate dd/d19/f4e 871422 0 2024-09-17T01:02:05.596 INFO:tasks.workunit.client.0.smithi002.stdout:0/780: dread - dd/fcc zero size 2024-09-17T01:02:05.600 INFO:tasks.workunit.client.0.smithi002.stdout:3/821: mkdir d0/d3/d17/d84/dd9/d106 0 2024-09-17T01:02:05.600 INFO:tasks.workunit.client.0.smithi002.stdout:2/836: truncate d1b/d37/d48/d52/de6/ff2 2778698 0 2024-09-17T01:02:05.601 INFO:tasks.workunit.client.0.smithi002.stdout:3/822: creat d0/d31/da7/ddd/f107 x:0 0 0 2024-09-17T01:02:05.602 INFO:tasks.workunit.client.0.smithi002.stdout:3/823: dread - d0/d3/d8d/fee zero size 2024-09-17T01:02:05.603 INFO:tasks.workunit.client.0.smithi002.stdout:2/837: unlink d1b/d74/d93/fa1 0 2024-09-17T01:02:05.603 INFO:tasks.workunit.client.0.smithi002.stdout:6/904: dread d2/d1d/f25 [0,4194304] 0 2024-09-17T01:02:05.604 INFO:tasks.workunit.client.0.smithi002.stdout:0/781: mknod dd/c108 0 2024-09-17T01:02:05.605 INFO:tasks.workunit.client.0.smithi002.stdout:3/824: unlink d0/d31/d32/l58 0 2024-09-17T01:02:05.606 INFO:tasks.workunit.client.0.smithi002.stdout:2/838: mkdir d1b/d3f/d59/d12c 0 2024-09-17T01:02:05.608 INFO:tasks.workunit.client.0.smithi002.stdout:0/782: rename dd/d19/d1a/c35 to dd/d3d/c109 0 2024-09-17T01:02:05.609 INFO:tasks.workunit.client.0.smithi002.stdout:0/783: chown dd/d19/d1c/fa0 5 1 2024-09-17T01:02:05.611 INFO:tasks.workunit.client.1.smithi099.stdout:3/923: sync 2024-09-17T01:02:05.615 INFO:tasks.workunit.client.0.smithi002.stdout:2/839: dread d1b/d37/d48/d4e/f69 [0,4194304] 0 2024-09-17T01:02:05.617 INFO:tasks.workunit.client.1.smithi099.stdout:5/897: dwrite d2/dc/f93 [0,4194304] 0 2024-09-17T01:02:05.617 INFO:tasks.workunit.client.1.smithi099.stdout:5/898: chown d2/dc/d17/f70 6787582 1 2024-09-17T01:02:05.618 INFO:tasks.workunit.client.1.smithi099.stdout:4/840: dwrite d7/dd/d21/d7b/d4b/fa9 [0,4194304] 0 2024-09-17T01:02:05.618 INFO:tasks.workunit.client.1.smithi099.stdout:4/841: write d7/dd/de/d10/d6b/d82/d8a/d9a/f113 [1006075,44628] 0 2024-09-17T01:02:05.619 INFO:tasks.workunit.client.1.smithi099.stdout:5/899: dread d2/dc/d6c/fcc [0,4194304] 0 2024-09-17T01:02:05.619 INFO:tasks.workunit.client.1.smithi099.stdout:5/900: stat d2/dc4/d90/da4/ce6 0 2024-09-17T01:02:05.619 INFO:tasks.workunit.client.0.smithi002.stdout:5/878: dwrite d2/d2d/d10/d23/d6e/f6b [0,4194304] 0 2024-09-17T01:02:05.622 INFO:tasks.workunit.client.0.smithi002.stdout:5/879: mkdir d2/d2d/d10/d14/dce/d11b 0 2024-09-17T01:02:05.622 INFO:tasks.workunit.client.0.smithi002.stdout:5/880: stat d2/d2d/d10/d9b/ffd 0 2024-09-17T01:02:05.623 INFO:tasks.workunit.client.0.smithi002.stdout:7/898: dwrite d1/d24/fb1 [0,4194304] 0 2024-09-17T01:02:05.623 INFO:tasks.workunit.client.0.smithi002.stdout:1/902: dwrite d4/d11/d12/d14/d17/d51/fc7 [0,4194304] 0 2024-09-17T01:02:05.623 INFO:tasks.workunit.client.0.smithi002.stdout:3/825: write d0/d3/f3c [3804947,31080] 0 2024-09-17T01:02:05.623 INFO:tasks.workunit.client.0.smithi002.stdout:3/826: chown d0/d31/d8b/d9d/lcc 167 1 2024-09-17T01:02:05.623 INFO:tasks.workunit.client.0.smithi002.stdout:3/827: dread - d0/d3/d8d/ff1 zero size 2024-09-17T01:02:05.623 INFO:tasks.workunit.client.0.smithi002.stdout:3/828: write d0/d3/d33/d99/fd2 [605556,126211] 0 2024-09-17T01:02:05.623 INFO:tasks.workunit.client.0.smithi002.stdout:3/829: chown d0/d31/d32/db8 85262510 1 2024-09-17T01:02:05.624 INFO:tasks.workunit.client.0.smithi002.stdout:2/840: dread d1b/d3f/d59/d7f/dc9/fa6 [0,4194304] 0 2024-09-17T01:02:05.626 INFO:tasks.workunit.client.0.smithi002.stdout:7/899: symlink d1/d14/d1d/d28/d6b/d9e/d54/l121 0 2024-09-17T01:02:05.627 INFO:tasks.workunit.client.0.smithi002.stdout:3/830: chown d0/lc 2791307 1 2024-09-17T01:02:05.627 INFO:tasks.workunit.client.0.smithi002.stdout:3/831: fsync d0/f97 0 2024-09-17T01:02:05.628 INFO:tasks.workunit.client.0.smithi002.stdout:2/841: creat d1b/d3f/d12a/f12d x:0 0 0 2024-09-17T01:02:05.628 INFO:tasks.workunit.client.0.smithi002.stdout:2/842: chown d1b/d37/d48/d4e/l10f 1180414909 1 2024-09-17T01:02:05.628 INFO:tasks.workunit.client.0.smithi002.stdout:2/843: write d1b/d37/f6a [1042118,72688] 0 2024-09-17T01:02:05.629 INFO:tasks.workunit.client.1.smithi099.stdout:5/901: read d2/dc4/d99/fd8 [2134604,19028] 0 2024-09-17T01:02:05.629 INFO:tasks.workunit.client.0.smithi002.stdout:3/832: mkdir d0/d3/d33/d4f/d108 0 2024-09-17T01:02:05.630 INFO:tasks.workunit.client.0.smithi002.stdout:1/903: dread d4/d11/d12/d14/d17/d56/f6f [0,4194304] 0 2024-09-17T01:02:05.630 INFO:tasks.workunit.client.0.smithi002.stdout:1/904: creat d4/d11/d12/d14/d17/d56/f137 x:0 0 0 2024-09-17T01:02:05.630 INFO:tasks.workunit.client.0.smithi002.stdout:1/905: write d4/d11/d12/d14/d17/d20/fb9 [368453,112488] 0 2024-09-17T01:02:05.631 INFO:tasks.workunit.client.0.smithi002.stdout:2/844: symlink d1b/d3f/l12e 0 2024-09-17T01:02:05.631 INFO:tasks.workunit.client.0.smithi002.stdout:2/845: fsync d1b/d37/d48/d4e/fa0 0 2024-09-17T01:02:05.632 INFO:tasks.workunit.client.0.smithi002.stdout:5/881: write d2/d2d/d10/d14/d19/d39/d48/def/f8d [1501057,117500] 0 2024-09-17T01:02:05.633 INFO:tasks.workunit.client.1.smithi099.stdout:7/769: dread d1/d2c/d5c/d1c/d72/fdb [0,4194304] 0 2024-09-17T01:02:05.636 INFO:tasks.workunit.client.1.smithi099.stdout:4/842: read d7/dd/d21/d26/d3f/d5b/f2c [1156491,123615] 0 2024-09-17T01:02:05.636 INFO:tasks.workunit.client.0.smithi002.stdout:1/906: rename d4/d11/d12/d30/f135 to d4/d11/d12/d30/dc4/f138 0 2024-09-17T01:02:05.637 INFO:tasks.workunit.client.1.smithi099.stdout:5/902: dread d2/dc4/d99/dd0/ff7 [0,4194304] 0 2024-09-17T01:02:05.637 INFO:tasks.workunit.client.1.smithi099.stdout:5/903: truncate d2/dc/d6c/fac 883843 0 2024-09-17T01:02:05.638 INFO:tasks.workunit.client.0.smithi002.stdout:7/900: write d1/d14/d1d/d29/d57/fb8 [3183639,36107] 0 2024-09-17T01:02:05.638 INFO:tasks.workunit.client.1.smithi099.stdout:5/904: truncate d2/dc4/f10a 1881835 0 2024-09-17T01:02:05.641 INFO:tasks.workunit.client.0.smithi002.stdout:6/905: dwrite d2/dc/f124 [0,4194304] 0 2024-09-17T01:02:05.642 INFO:tasks.workunit.client.1.smithi099.stdout:5/905: rename d2/dc4/d90/de7 to d2/dc/d14/d36/d9a/d12c 0 2024-09-17T01:02:05.643 INFO:tasks.workunit.client.0.smithi002.stdout:7/901: rename d1/d14/d1d/ffa to d1/d14/d1d/d29/d98/dcf/f122 0 2024-09-17T01:02:05.644 INFO:tasks.workunit.client.1.smithi099.stdout:5/906: link d2/dc4/d90/da4/l76 d2/dc/d17/d3c/da8/l12d 0 2024-09-17T01:02:05.646 INFO:tasks.workunit.client.0.smithi002.stdout:6/906: mknod d2/d1d/d2d/d73/dff/c130 0 2024-09-17T01:02:05.646 INFO:tasks.workunit.client.1.smithi099.stdout:7/770: dread d1/d2c/d47/d48/d60/f91 [0,4194304] 0 2024-09-17T01:02:05.646 INFO:tasks.workunit.client.1.smithi099.stdout:3/924: dwrite d9/d15/d18/d1a/d23/d5c/d99/dd8/ded/f101 [0,4194304] 0 2024-09-17T01:02:05.647 INFO:tasks.workunit.client.1.smithi099.stdout:5/907: rename d2/dc/d17/d3c/fd9 to d2/dc4/dad/dc2/f12e 0 2024-09-17T01:02:05.647 INFO:tasks.workunit.client.0.smithi002.stdout:7/902: mknod d1/d14/d1d/d28/d86/d10b/d110/c123 0 2024-09-17T01:02:05.647 INFO:tasks.workunit.client.0.smithi002.stdout:7/903: write d1/d14/d1d/d28/d86/ffe [3369265,59090] 0 2024-09-17T01:02:05.649 INFO:tasks.workunit.client.0.smithi002.stdout:3/833: read d0/f2f [3021944,14777] 0 2024-09-17T01:02:05.649 INFO:tasks.workunit.client.0.smithi002.stdout:3/834: fdatasync d0/d3/d8d/f9c 0 2024-09-17T01:02:05.649 INFO:tasks.workunit.client.0.smithi002.stdout:9/809: dwrite d5/f1d [0,4194304] 0 2024-09-17T01:02:05.649 INFO:tasks.workunit.client.0.smithi002.stdout:5/882: dread d2/d2d/d10/d14/d19/d39/f35 [0,4194304] 0 2024-09-17T01:02:05.652 INFO:tasks.workunit.client.0.smithi002.stdout:6/907: creat d2/dc/d24/d53/d83/da9/d4c/f131 x:0 0 0 2024-09-17T01:02:05.652 INFO:tasks.workunit.client.0.smithi002.stdout:6/908: creat d2/dc/d24/d53/d83/da9/d4c/f132 x:0 0 0 2024-09-17T01:02:05.652 INFO:tasks.workunit.client.0.smithi002.stdout:1/907: write d4/d11/f82 [1682994,127556] 0 2024-09-17T01:02:05.653 INFO:tasks.workunit.client.1.smithi099.stdout:3/925: mkdir d9/d15/d18/d1a/d23/d5c/d99/dd8/ded/d12e 0 2024-09-17T01:02:05.654 INFO:tasks.workunit.client.1.smithi099.stdout:5/908: rename d2/dc4/d90/da4/f12b to d2/de4/f12f 0 2024-09-17T01:02:05.654 INFO:tasks.workunit.client.0.smithi002.stdout:7/904: mkdir d1/d14/d67/dc0/d124 0 2024-09-17T01:02:05.654 INFO:tasks.workunit.client.0.smithi002.stdout:7/905: dread - d1/d14/d1d/d28/d6b/d9e/d54/fbe zero size 2024-09-17T01:02:05.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:05 smithi002 ceph-mon[27650]: pgmap v256: 65 pgs: 65 active+clean; 2.8 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 305 MiB/s rd, 380 MiB/s wr, 488 op/s 2024-09-17T01:02:05.655 INFO:tasks.workunit.client.1.smithi099.stdout:7/771: getdents d1/d2c/d47 0 2024-09-17T01:02:05.656 INFO:tasks.workunit.client.0.smithi002.stdout:3/835: mkdir d0/d31/d32/dcb/dd7/d109 0 2024-09-17T01:02:05.656 INFO:tasks.workunit.client.0.smithi002.stdout:3/836: dread - d0/d3/d33/d4a/f5f zero size 2024-09-17T01:02:05.656 INFO:tasks.workunit.client.1.smithi099.stdout:3/926: symlink d9/d15/l12f 0 2024-09-17T01:02:05.656 INFO:tasks.workunit.client.0.smithi002.stdout:9/810: mknod d5/dc/d26/d46/d47/d89/cf7 0 2024-09-17T01:02:05.657 INFO:tasks.workunit.client.0.smithi002.stdout:2/846: dwrite d1b/d37/d48/db1/dbb/f123 [4194304,4194304] 0 2024-09-17T01:02:05.657 INFO:tasks.workunit.client.1.smithi099.stdout:5/909: mknod d2/d45/dc5/c130 0 2024-09-17T01:02:05.658 INFO:tasks.workunit.client.0.smithi002.stdout:6/909: getdents d2/d95 0 2024-09-17T01:02:05.659 INFO:tasks.workunit.client.1.smithi099.stdout:3/927: symlink d9/d15/d8f/l130 0 2024-09-17T01:02:05.659 INFO:tasks.workunit.client.1.smithi099.stdout:3/928: chown d9/d12a 501 1 2024-09-17T01:02:05.659 INFO:tasks.workunit.client.0.smithi002.stdout:1/908: symlink d4/d11/d12/d14/d17/d20/de9/l139 0 2024-09-17T01:02:05.661 INFO:tasks.workunit.client.1.smithi099.stdout:3/929: mknod d9/d15/d18/d1a/d23/d5c/d99/dda/db5/dca/c131 0 2024-09-17T01:02:05.661 INFO:tasks.workunit.client.1.smithi099.stdout:3/930: read - d9/d15/d18/d1a/d23/d5c/d99/dda/db5/dca/f103 zero size 2024-09-17T01:02:05.662 INFO:tasks.workunit.client.0.smithi002.stdout:7/906: rename d1/d14/d1d/d28/d6b/d9e/d54/fcb to d1/d14/d1d/d28/d86/d10b/f125 0 2024-09-17T01:02:05.662 INFO:tasks.workunit.client.1.smithi099.stdout:3/931: mknod d9/d15/d18/d1a/d23/d5c/d6e/d7e/c132 0 2024-09-17T01:02:05.664 INFO:tasks.workunit.client.1.smithi099.stdout:3/932: symlink d9/d15/d18/de5/l133 0 2024-09-17T01:02:05.664 INFO:tasks.workunit.client.0.smithi002.stdout:3/837: truncate d0/d3/f1a 10079464 0 2024-09-17T01:02:05.664 INFO:tasks.workunit.client.0.smithi002.stdout:9/811: symlink d5/dc/d26/d46/lf8 0 2024-09-17T01:02:05.666 INFO:tasks.workunit.client.0.smithi002.stdout:2/847: link d1b/d37/d48/d78/fe4 d1b/d37/d48/d78/f12f 0 2024-09-17T01:02:05.667 INFO:tasks.workunit.client.0.smithi002.stdout:1/909: mknod d4/d11/d12/d14/d17/d40/c13a 0 2024-09-17T01:02:05.667 INFO:tasks.workunit.client.1.smithi099.stdout:7/772: write d1/d2c/d5c/fbb [2484100,55728] 0 2024-09-17T01:02:05.667 INFO:tasks.workunit.client.1.smithi099.stdout:7/773: chown d1/d37/d4f/c57 2 1 2024-09-17T01:02:05.669 INFO:tasks.workunit.client.0.smithi002.stdout:7/907: creat d1/d14/d1d/d28/d111/f126 x:0 0 0 2024-09-17T01:02:05.669 INFO:tasks.workunit.client.0.smithi002.stdout:7/908: creat d1/d14/d1d/d28/d6b/f127 x:0 0 0 2024-09-17T01:02:05.670 INFO:tasks.workunit.client.1.smithi099.stdout:7/774: mknod d1/d2c/d47/cf1 0 2024-09-17T01:02:05.671 INFO:tasks.workunit.client.1.smithi099.stdout:7/775: write d1/d2c/f66 [4121972,94096] 0 2024-09-17T01:02:05.672 INFO:tasks.workunit.client.1.smithi099.stdout:7/776: truncate d1/d36/fa4 1266326 0 2024-09-17T01:02:05.672 INFO:tasks.workunit.client.1.smithi099.stdout:7/777: write d1/d37/f56 [726823,19520] 0 2024-09-17T01:02:05.672 INFO:tasks.workunit.client.1.smithi099.stdout:7/778: truncate d1/f19 2153509 0 2024-09-17T01:02:05.673 INFO:tasks.workunit.client.0.smithi002.stdout:3/838: mknod d0/d3/d17/d84/dd9/c10a 0 2024-09-17T01:02:05.673 INFO:tasks.workunit.client.1.smithi099.stdout:7/779: rename d1/d2c/d5c/d1c/d72/le2 to d1/d2c/d5c/d1c/d5a/lf2 0 2024-09-17T01:02:05.674 INFO:tasks.workunit.client.1.smithi099.stdout:7/780: mknod d1/d2c/d5c/d12/cf3 0 2024-09-17T01:02:05.676 INFO:tasks.workunit.client.1.smithi099.stdout:7/781: mkdir d1/d2c/d5c/d1c/d5a/db3/df4 0 2024-09-17T01:02:05.677 INFO:tasks.workunit.client.1.smithi099.stdout:7/782: dread - d1/d2c/d5c/d1c/d5a/db3/dcd/fd8 zero size 2024-09-17T01:02:05.677 INFO:tasks.workunit.client.1.smithi099.stdout:7/783: fdatasync d1/d2c/d5c/d1c/d72/f86 0 2024-09-17T01:02:05.678 INFO:tasks.workunit.client.0.smithi002.stdout:1/910: read d4/d11/d12/d14/d17/d51/fbd [3343072,50975] 0 2024-09-17T01:02:05.678 INFO:tasks.workunit.client.0.smithi002.stdout:7/909: symlink d1/d14/d1d/d28/d6b/d9e/d10a/l128 0 2024-09-17T01:02:05.678 INFO:tasks.workunit.client.0.smithi002.stdout:7/910: write d1/d14/d1d/d28/d6b/d9e/d10a/f11d [945875,30884] 0 2024-09-17T01:02:05.678 INFO:tasks.workunit.client.0.smithi002.stdout:7/911: truncate d1/d14/d1d/d28/d86/fd9 1292538 0 2024-09-17T01:02:05.678 INFO:tasks.workunit.client.0.smithi002.stdout:7/912: readlink d1/d14/l47 0 2024-09-17T01:02:05.679 INFO:tasks.workunit.client.1.smithi099.stdout:7/784: mknod d1/d2c/d47/d48/d60/cf5 0 2024-09-17T01:02:05.679 INFO:tasks.workunit.client.0.smithi002.stdout:9/812: rmdir d5/d8a/d9d 39 2024-09-17T01:02:05.679 INFO:tasks.workunit.client.0.smithi002.stdout:5/883: dwrite d2/d2d/d10/d23/f76 [0,4194304] 0 2024-09-17T01:02:05.679 INFO:tasks.workunit.client.1.smithi099.stdout:3/933: write d9/d15/d18/f35 [251171,71988] 0 2024-09-17T01:02:05.683 INFO:tasks.workunit.client.1.smithi099.stdout:7/785: symlink d1/d2c/d47/d48/lf6 0 2024-09-17T01:02:05.683 INFO:tasks.workunit.client.1.smithi099.stdout:7/786: fsync d1/d2c/d47/fd1 0 2024-09-17T01:02:05.683 INFO:tasks.workunit.client.1.smithi099.stdout:3/934: read d9/f79 [79109,127355] 0 2024-09-17T01:02:05.683 INFO:tasks.workunit.client.0.smithi002.stdout:6/910: dwrite d2/d1d/d2d/d5a/d71/d7e/fd9 [0,4194304] 0 2024-09-17T01:02:05.684 INFO:tasks.workunit.client.0.smithi002.stdout:5/884: rename d2/d2d/d10/d14/d19/d39/de5 to d2/d2d/d10/d20/d24/d11c 0 2024-09-17T01:02:05.684 INFO:tasks.workunit.client.0.smithi002.stdout:5/885: write d2/de/f10c [316347,71004] 0 2024-09-17T01:02:05.684 INFO:tasks.workunit.client.0.smithi002.stdout:5/886: write d2/d2d/d10/d14/d19/d39/d48/def/dfa/fff [556820,87799] 0 2024-09-17T01:02:05.685 INFO:tasks.workunit.client.0.smithi002.stdout:5/887: fsync d2/fa3 0 2024-09-17T01:02:05.685 INFO:tasks.workunit.client.0.smithi002.stdout:5/888: chown d2/d2d/d10/d23/d6e/d60/ff4 99 1 2024-09-17T01:02:05.685 INFO:tasks.workunit.client.0.smithi002.stdout:5/889: dread - d2/d2d/d10/d14/d19/d39/d48/d9d/d104/f119 zero size 2024-09-17T01:02:05.685 INFO:tasks.workunit.client.0.smithi002.stdout:5/890: chown d2/f92 147933 1 2024-09-17T01:02:05.686 INFO:tasks.workunit.client.1.smithi099.stdout:7/787: rename d1/d2c/d5c/d3f/f92 to d1/d2c/d7a/dac/db4/ff7 0 2024-09-17T01:02:05.688 INFO:tasks.workunit.client.0.smithi002.stdout:5/891: mknod d2/d2d/c11d 0 2024-09-17T01:02:05.691 INFO:tasks.workunit.client.0.smithi002.stdout:5/892: rename d2/d2d/d10/d14/d19/d39/d48/d9d/d104/f119 to d2/d2d/d10/d23/d6e/f11e 0 2024-09-17T01:02:05.695 INFO:tasks.workunit.client.0.smithi002.stdout:5/893: rmdir d2/d99 39 2024-09-17T01:02:05.697 INFO:tasks.workunit.client.0.smithi002.stdout:2/848: dwrite d1b/d8a/d92/fa7 [0,4194304] 0 2024-09-17T01:02:05.697 INFO:tasks.workunit.client.0.smithi002.stdout:1/911: dread d4/d11/d1a/fb4 [0,4194304] 0 2024-09-17T01:02:05.698 INFO:tasks.workunit.client.1.smithi099.stdout:7/788: dread d1/f25 [0,4194304] 0 2024-09-17T01:02:05.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:05 smithi099 ceph-mon[34357]: pgmap v256: 65 pgs: 65 active+clean; 2.8 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 305 MiB/s rd, 380 MiB/s wr, 488 op/s 2024-09-17T01:02:05.700 INFO:tasks.workunit.client.1.smithi099.stdout:7/789: mkdir d1/d2c/d5c/d12/dc2/df8 0 2024-09-17T01:02:05.700 INFO:tasks.workunit.client.1.smithi099.stdout:7/790: fdatasync d1/f25 0 2024-09-17T01:02:05.702 INFO:tasks.workunit.client.0.smithi002.stdout:2/849: symlink d1b/d3f/d59/l130 0 2024-09-17T01:02:05.702 INFO:tasks.workunit.client.0.smithi002.stdout:2/850: fdatasync d1b/d1d/d79/f6d 0 2024-09-17T01:02:05.702 INFO:tasks.workunit.client.0.smithi002.stdout:7/913: rmdir d1/d14/d1d/d28/d111 39 2024-09-17T01:02:05.703 INFO:tasks.workunit.client.0.smithi002.stdout:3/839: dwrite d0/f21 [0,4194304] 0 2024-09-17T01:02:05.706 INFO:tasks.workunit.client.1.smithi099.stdout:0/928: sync 2024-09-17T01:02:05.706 INFO:tasks.workunit.client.0.smithi002.stdout:1/912: creat d4/d22/d8d/da9/f13b x:0 0 0 2024-09-17T01:02:05.709 INFO:tasks.workunit.client.0.smithi002.stdout:5/894: write d2/d2d/d10/d14/d19/da5/db0/f40 [2588138,73339] 0 2024-09-17T01:02:05.709 INFO:tasks.workunit.client.0.smithi002.stdout:5/895: write d2/d2d/d10/d14/d19/da5/db0/f74 [961823,35009] 0 2024-09-17T01:02:05.713 INFO:tasks.workunit.client.1.smithi099.stdout:7/791: write d1/d2c/d7a/dac/fc5 [3201473,78521] 0 2024-09-17T01:02:05.713 INFO:tasks.workunit.client.0.smithi002.stdout:6/911: dwrite d2/d1d/d2d/d35/d79/da8/f69 [0,4194304] 0 2024-09-17T01:02:05.714 INFO:tasks.workunit.client.0.smithi002.stdout:2/851: symlink d1b/d8a/d92/dae/df3/l131 0 2024-09-17T01:02:05.715 INFO:tasks.workunit.client.1.smithi099.stdout:3/935: dwrite d9/d15/d18/de5/f116 [0,4194304] 0 2024-09-17T01:02:05.715 INFO:tasks.workunit.client.1.smithi099.stdout:3/936: fsync d9/d3b/d44/f67 0 2024-09-17T01:02:05.715 INFO:tasks.workunit.client.1.smithi099.stdout:3/937: write d9/d15/d18/d1a/d23/d5c/d99/dda/db5/dca/fee [981580,40894] 0 2024-09-17T01:02:05.716 INFO:tasks.workunit.client.0.smithi002.stdout:7/914: creat d1/d14/d1d/d28/d40/ddd/f129 x:0 0 0 2024-09-17T01:02:05.716 INFO:tasks.workunit.client.0.smithi002.stdout:7/915: write d1/d14/d1d/d28/d6b/f83 [3079384,57064] 0 2024-09-17T01:02:05.717 INFO:tasks.workunit.client.0.smithi002.stdout:3/840: link d0/d3/d33/d93/fb0 d0/d3/d17/d87/d9e/dd4/f10b 0 2024-09-17T01:02:05.720 INFO:tasks.workunit.client.0.smithi002.stdout:1/913: rename d4/d11/d12/d14/d17/d3b/f42 to d4/d11/d12/d30/dc4/f13c 0 2024-09-17T01:02:05.720 INFO:tasks.workunit.client.0.smithi002.stdout:1/914: write d4/d11/d12/d14/d17/d20/f50 [830912,419] 0 2024-09-17T01:02:05.724 INFO:tasks.workunit.client.1.smithi099.stdout:7/792: read d1/d2c/d5c/f34 [361123,86249] 0 2024-09-17T01:02:05.724 INFO:tasks.workunit.client.1.smithi099.stdout:7/793: fdatasync d1/fb7 0 2024-09-17T01:02:05.725 INFO:tasks.workunit.client.0.smithi002.stdout:5/896: creat d2/d2d/d10/d14/d19/d39/d48/def/f11f x:0 0 0 2024-09-17T01:02:05.725 INFO:tasks.workunit.client.0.smithi002.stdout:5/897: readlink d2/d2d/l67 0 2024-09-17T01:02:05.728 INFO:tasks.workunit.client.0.smithi002.stdout:6/912: creat d2/dc/d24/d53/d83/da9/d4c/d107/f133 x:0 0 0 2024-09-17T01:02:05.728 INFO:tasks.workunit.client.0.smithi002.stdout:6/913: fsync d2/d1d/d27/d80/d93/ff7 0 2024-09-17T01:02:05.729 INFO:tasks.workunit.client.0.smithi002.stdout:2/852: symlink d1b/d3f/l132 0 2024-09-17T01:02:05.729 INFO:tasks.workunit.client.0.smithi002.stdout:2/853: chown d1b/d1d/d79/fd2 10 1 2024-09-17T01:02:05.730 INFO:tasks.workunit.client.0.smithi002.stdout:2/854: dread - d1b/d3f/d59/d7f/dc9/f3c zero size 2024-09-17T01:02:05.732 INFO:tasks.workunit.client.0.smithi002.stdout:7/916: creat d1/d14/d1d/d28/d86/d10b/d110/f12a x:0 0 0 2024-09-17T01:02:05.732 INFO:tasks.workunit.client.0.smithi002.stdout:7/917: chown d1/d14/d1d/d28/d40 1025138 1 2024-09-17T01:02:05.733 INFO:tasks.workunit.client.0.smithi002.stdout:1/915: mkdir d4/d11/d12/d14/d17/d51/d88/da3/d131/d13d 0 2024-09-17T01:02:05.735 INFO:tasks.workunit.client.0.smithi002.stdout:6/914: mkdir d2/d1d/d2d/d35/d37/d12f/d134 0 2024-09-17T01:02:05.736 INFO:tasks.workunit.client.1.smithi099.stdout:3/938: dwrite d9/d2b/fb0 [0,4194304] 0 2024-09-17T01:02:05.736 INFO:tasks.workunit.client.0.smithi002.stdout:3/841: dwrite d0/d3/d33/d4f/f53 [0,4194304] 0 2024-09-17T01:02:05.736 INFO:tasks.workunit.client.0.smithi002.stdout:2/855: mkdir d1b/d74/d93/d94/d133 0 2024-09-17T01:02:05.738 INFO:tasks.workunit.client.0.smithi002.stdout:7/918: link d1/d14/d67/dc0/dcd/fdc d1/d14/d1d/d28/d6b/d9e/d50/f12b 0 2024-09-17T01:02:05.739 INFO:tasks.workunit.client.0.smithi002.stdout:6/915: creat d2/dc/d24/d53/d83/f135 x:0 0 0 2024-09-17T01:02:05.740 INFO:tasks.workunit.client.0.smithi002.stdout:3/842: mkdir d0/d3/d17/d87/d10c 0 2024-09-17T01:02:05.740 INFO:tasks.workunit.client.0.smithi002.stdout:3/843: chown d0/d3/d33/f7d 9015425 1 2024-09-17T01:02:05.740 INFO:tasks.workunit.client.0.smithi002.stdout:3/844: fdatasync d0/d3/fb5 0 2024-09-17T01:02:05.741 INFO:tasks.workunit.client.0.smithi002.stdout:5/898: dread d2/d2d/d10/d3b/fe3 [0,4194304] 0 2024-09-17T01:02:05.741 INFO:tasks.workunit.client.0.smithi002.stdout:2/856: unlink d1b/d3f/d59/d7f/dc9/c73 0 2024-09-17T01:02:05.743 INFO:tasks.workunit.client.0.smithi002.stdout:7/919: creat d1/d14/d1d/d29/d98/dcf/f12c x:0 0 0 2024-09-17T01:02:05.743 INFO:tasks.workunit.client.0.smithi002.stdout:7/920: fdatasync d1/d14/d1d/d28/d6b/d9e/d10a/f11d 0 2024-09-17T01:02:05.744 INFO:tasks.workunit.client.0.smithi002.stdout:6/916: symlink d2/d1d/d2d/d35/d79/de6/l136 0 2024-09-17T01:02:05.744 INFO:tasks.workunit.client.0.smithi002.stdout:6/917: read - d2/d1d/d2d/d5a/fef zero size 2024-09-17T01:02:05.746 INFO:tasks.workunit.client.0.smithi002.stdout:3/845: unlink d0/d3/d37/dac/c91 0 2024-09-17T01:02:05.746 INFO:tasks.workunit.client.0.smithi002.stdout:3/846: readlink d0/d3/l9 0 2024-09-17T01:02:05.748 INFO:tasks.workunit.client.1.smithi099.stdout:3/939: dread d9/d15/d18/d1a/d23/d5c/d99/dd8/ded/f101 [0,4194304] 0 2024-09-17T01:02:05.748 INFO:tasks.workunit.client.1.smithi099.stdout:3/940: write d9/f79 [1057953,72176] 0 2024-09-17T01:02:05.750 INFO:tasks.workunit.client.0.smithi002.stdout:2/857: unlink d1b/f3a 0 2024-09-17T01:02:05.751 INFO:tasks.workunit.client.0.smithi002.stdout:7/921: rmdir d1/d14/d1d/d28/d111 39 2024-09-17T01:02:05.751 INFO:tasks.workunit.client.0.smithi002.stdout:7/922: creat d1/d14/d67/dc0/f12d x:0 0 0 2024-09-17T01:02:05.753 INFO:tasks.workunit.client.0.smithi002.stdout:6/918: mkdir d2/d1d/d27/d80/d93/dd5/d5c/dc9/d137 0 2024-09-17T01:02:05.753 INFO:tasks.workunit.client.0.smithi002.stdout:6/919: fsync d2/dc/d34/f8f 0 2024-09-17T01:02:05.755 INFO:tasks.workunit.client.0.smithi002.stdout:3/847: creat d0/d3/d17/d35/f10d x:0 0 0 2024-09-17T01:02:05.758 INFO:tasks.workunit.client.0.smithi002.stdout:2/858: link d1b/d74/c77 d1b/c134 0 2024-09-17T01:02:05.761 INFO:tasks.workunit.client.0.smithi002.stdout:7/923: unlink d1/d14/d67/dc0/dcd/l3b 0 2024-09-17T01:02:05.763 INFO:tasks.workunit.client.0.smithi002.stdout:5/899: rename d2/d2d/d10/d23/d6e/d60 to d2/d2d/d10/d14/d19/d39/d48/d120 0 2024-09-17T01:02:05.763 INFO:tasks.workunit.client.0.smithi002.stdout:3/848: rename d0/d3/d37/dac to d0/d3/d37/dac/da1/dd8/d10e 22 2024-09-17T01:02:05.765 INFO:tasks.workunit.client.1.smithi099.stdout:7/794: dwrite d1/d2c/d5c/d12/f18 [0,4194304] 0 2024-09-17T01:02:05.765 INFO:tasks.workunit.client.0.smithi002.stdout:2/859: symlink d1b/d37/d48/db1/dbb/l135 0 2024-09-17T01:02:05.765 INFO:tasks.workunit.client.0.smithi002.stdout:2/860: truncate d1b/d1d/dd4/f101 1249163 0 2024-09-17T01:02:05.765 INFO:tasks.workunit.client.0.smithi002.stdout:1/916: dwrite d4/d11/d12/d23/d32/d86/f12c [0,4194304] 0 2024-09-17T01:02:05.765 INFO:tasks.workunit.client.0.smithi002.stdout:1/917: write d4/d11/d55/f65 [1605504,2143] 0 2024-09-17T01:02:05.766 INFO:tasks.workunit.client.1.smithi099.stdout:3/941: dwrite d9/d15/d7d/f115 [0,4194304] 0 2024-09-17T01:02:05.766 INFO:tasks.workunit.client.1.smithi099.stdout:7/795: mkdir d1/d37/d78/df9 0 2024-09-17T01:02:05.768 INFO:tasks.workunit.client.0.smithi002.stdout:2/861: mkdir d1b/d3f/d59/d7f/dc9/d72/dda/d136 0 2024-09-17T01:02:05.770 INFO:tasks.workunit.client.0.smithi002.stdout:5/900: dread d2/d2d/d10/d14/d19/d39/d43/f2a [0,4194304] 0 2024-09-17T01:02:05.770 INFO:tasks.workunit.client.0.smithi002.stdout:5/901: stat d2/d2d/d10/d20 0 2024-09-17T01:02:05.770 INFO:tasks.workunit.client.0.smithi002.stdout:5/902: dread - d2/de/fa4 zero size 2024-09-17T01:02:05.770 INFO:tasks.workunit.client.1.smithi099.stdout:3/942: rmdir d9/d2b/d6b/df2 0 2024-09-17T01:02:05.772 INFO:tasks.workunit.client.1.smithi099.stdout:7/796: creat d1/d37/d78/db2/ffa x:0 0 0 2024-09-17T01:02:05.773 INFO:tasks.workunit.client.0.smithi002.stdout:1/918: symlink d4/d102/l13e 0 2024-09-17T01:02:05.774 INFO:tasks.workunit.client.0.smithi002.stdout:2/862: creat d1b/d37/d48/db1/f137 x:0 0 0 2024-09-17T01:02:05.776 INFO:tasks.workunit.client.0.smithi002.stdout:1/919: mknod d4/d11/d12/d23/d32/d86/c13f 0 2024-09-17T01:02:05.794 INFO:tasks.workunit.client.1.smithi099.stdout:7/797: dread d1/d2c/d47/d48/d60/fcf [0,4194304] 0 2024-09-17T01:02:05.795 INFO:tasks.workunit.client.1.smithi099.stdout:7/798: mknod d1/cfb 0 2024-09-17T01:02:05.795 INFO:tasks.workunit.client.1.smithi099.stdout:7/799: chown d1/d2c/d5c/d1c/d5a/d6f/db6/fe9 4588635 1 2024-09-17T01:02:05.796 INFO:tasks.workunit.client.0.smithi002.stdout:5/903: write d2/d2d/d10/f71 [3960025,102748] 0 2024-09-17T01:02:05.796 INFO:tasks.workunit.client.1.smithi099.stdout:7/800: getdents d1/d37/d78 0 2024-09-17T01:02:05.797 INFO:tasks.workunit.client.0.smithi002.stdout:5/904: mknod d2/d2d/d10/d14/d19/d39/d3f/c121 0 2024-09-17T01:02:05.797 INFO:tasks.workunit.client.0.smithi002.stdout:5/905: write d2/d2d/d10/d9b/dd3/fd4 [1013572,129105] 0 2024-09-17T01:02:05.798 INFO:tasks.workunit.client.1.smithi099.stdout:7/801: mknod d1/d37/d4f/cfc 0 2024-09-17T01:02:05.800 INFO:tasks.workunit.client.0.smithi002.stdout:7/924: dwrite d1/d14/d1d/d29/d98/fb5 [0,4194304] 0 2024-09-17T01:02:05.802 INFO:tasks.workunit.client.0.smithi002.stdout:7/925: getdents d1/d14/d1d/d28/d40/ddd 0 2024-09-17T01:02:05.802 INFO:tasks.workunit.client.0.smithi002.stdout:7/926: fsync d1/d14/d1d/d28/d86/f97 0 2024-09-17T01:02:05.803 INFO:tasks.workunit.client.0.smithi002.stdout:7/927: creat d1/dac/f12e x:0 0 0 2024-09-17T01:02:05.805 INFO:tasks.workunit.client.0.smithi002.stdout:7/928: creat d1/d14/d1d/d28/d40/f12f x:0 0 0 2024-09-17T01:02:05.805 INFO:tasks.workunit.client.0.smithi002.stdout:7/929: creat d1/d14/d67/dc0/dcd/f130 x:0 0 0 2024-09-17T01:02:05.805 INFO:tasks.workunit.client.0.smithi002.stdout:7/930: fsync d1/d14/d1d/d28/d40/fd6 0 2024-09-17T01:02:05.807 INFO:tasks.workunit.client.0.smithi002.stdout:7/931: mknod d1/d14/d1d/d28/d6b/d9e/d5e/c131 0 2024-09-17T01:02:05.809 INFO:tasks.workunit.client.0.smithi002.stdout:5/906: dread d2/fb9 [0,4194304] 0 2024-09-17T01:02:05.809 INFO:tasks.workunit.client.0.smithi002.stdout:7/932: mknod d1/d14/d67/dc0/dcd/d45/d113/c132 0 2024-09-17T01:02:05.810 INFO:tasks.workunit.client.0.smithi002.stdout:5/907: mknod d2/d2d/d10/d14/d19/d39/c122 0 2024-09-17T01:02:05.810 INFO:tasks.workunit.client.1.smithi099.stdout:7/802: dread d1/d8f/feb [0,4194304] 0 2024-09-17T01:02:05.811 INFO:tasks.workunit.client.0.smithi002.stdout:7/933: stat d1/d14/d1d/d28/d6b/d9e/cec 0 2024-09-17T01:02:05.811 INFO:tasks.workunit.client.0.smithi002.stdout:7/934: creat d1/dac/f133 x:0 0 0 2024-09-17T01:02:05.811 INFO:tasks.workunit.client.0.smithi002.stdout:7/935: chown d1/l19 6888 1 2024-09-17T01:02:05.812 INFO:tasks.workunit.client.0.smithi002.stdout:7/936: write d1/d14/d67/dc0/dcd/d45/d113/f62 [3019978,6756] 0 2024-09-17T01:02:05.812 INFO:tasks.workunit.client.0.smithi002.stdout:7/937: chown d1/dac/f133 0 1 2024-09-17T01:02:05.812 INFO:tasks.workunit.client.0.smithi002.stdout:5/908: mkdir d2/de/d57/d123 0 2024-09-17T01:02:05.812 INFO:tasks.workunit.client.0.smithi002.stdout:5/909: write d2/ff1 [67031,1644] 0 2024-09-17T01:02:05.812 INFO:tasks.workunit.client.1.smithi099.stdout:7/803: unlink d1/d2c/d47/d48/lf6 0 2024-09-17T01:02:05.813 INFO:tasks.workunit.client.0.smithi002.stdout:7/938: symlink d1/d14/d1d/d29/d98/dcf/l134 0 2024-09-17T01:02:05.813 INFO:tasks.workunit.client.0.smithi002.stdout:7/939: write d1/d14/d1d/d29/f85 [990337,11429] 0 2024-09-17T01:02:05.815 INFO:tasks.workunit.client.0.smithi002.stdout:7/940: creat d1/d14/d1d/d28/d6b/d9e/d10a/f135 x:0 0 0 2024-09-17T01:02:05.815 INFO:tasks.workunit.client.0.smithi002.stdout:7/941: write d1/d14/d1d/d28/d6b/d9e/d54/f66 [3926527,105977] 0 2024-09-17T01:02:05.815 INFO:tasks.workunit.client.0.smithi002.stdout:7/942: fsync d1/d14/d67/dc0/dcd/f61 0 2024-09-17T01:02:05.815 INFO:tasks.workunit.client.0.smithi002.stdout:7/943: creat d1/dac/f136 x:0 0 0 2024-09-17T01:02:05.818 INFO:tasks.workunit.client.0.smithi002.stdout:3/849: dwrite d0/d3/d33/d40/f65 [0,4194304] 0 2024-09-17T01:02:05.818 INFO:tasks.workunit.client.1.smithi099.stdout:3/943: dwrite d9/f30 [4194304,4194304] 0 2024-09-17T01:02:05.819 INFO:tasks.workunit.client.0.smithi002.stdout:3/850: mknod d0/d3/df3/c10f 0 2024-09-17T01:02:05.823 INFO:tasks.workunit.client.0.smithi002.stdout:7/944: rename d1/d14/d67/dc0 to d1/d14/d1d/d28/d6b/d9e/d50/d137 0 2024-09-17T01:02:05.824 INFO:tasks.workunit.client.1.smithi099.stdout:3/944: rename d9/d3b to d9/d2b/d6b/de7/d134 0 2024-09-17T01:02:05.824 INFO:tasks.workunit.client.1.smithi099.stdout:3/945: fdatasync d9/d15/d18/d1a/d23/d5c/d99/dda/fff 0 2024-09-17T01:02:05.824 INFO:tasks.workunit.client.1.smithi099.stdout:3/946: readlink d9/d2b/d6b/de7/d134/db2/daf/lf9 0 2024-09-17T01:02:05.824 INFO:tasks.workunit.client.1.smithi099.stdout:7/804: dread d1/f35 [4194304,4194304] 0 2024-09-17T01:02:05.825 INFO:tasks.workunit.client.0.smithi002.stdout:1/920: dwrite d4/d11/f82 [0,4194304] 0 2024-09-17T01:02:05.825 INFO:tasks.workunit.client.0.smithi002.stdout:2/863: dwrite d1b/d37/d48/d4e/dc5/fcb [0,4194304] 0 2024-09-17T01:02:05.825 INFO:tasks.workunit.client.0.smithi002.stdout:1/921: write d4/d11/d12/d30/d5e/d8c/faf [140426,29563] 0 2024-09-17T01:02:05.828 INFO:tasks.workunit.client.0.smithi002.stdout:3/851: dread d0/d3/d37/f47 [0,4194304] 0 2024-09-17T01:02:05.828 INFO:tasks.workunit.client.1.smithi099.stdout:3/947: unlink d9/d15/d18/d1a/d23/d102/f11f 0 2024-09-17T01:02:05.828 INFO:tasks.workunit.client.1.smithi099.stdout:3/948: readlink d9/d15/d18/d1a/d23/d5c/d6e/lf6 0 2024-09-17T01:02:05.830 INFO:tasks.workunit.client.1.smithi099.stdout:7/805: write d1/f35 [3579377,43457] 0 2024-09-17T01:02:05.833 INFO:tasks.workunit.client.1.smithi099.stdout:3/949: rename d9/d2b/d6b/de7/d134/d44/f6d to d9/d15/d18/d1a/d23/d5c/d99/dbb/f135 0 2024-09-17T01:02:05.839 INFO:tasks.workunit.client.0.smithi002.stdout:5/910: dwrite d2/d2d/d10/d14/d19/da5/db0/f40 [0,4194304] 0 2024-09-17T01:02:05.846 INFO:tasks.workunit.client.0.smithi002.stdout:5/911: dread d2/d2d/d10/d14/d19/da5/fb5 [0,4194304] 0 2024-09-17T01:02:05.851 INFO:tasks.workunit.client.0.smithi002.stdout:7/945: rename d1/d14/d1d/d28/d6b/d9e/d50/d137/dcd/d45/d113/l6a to d1/d14/d1d/d28/d6b/d9e/d10a/l138 0 2024-09-17T01:02:05.854 INFO:tasks.workunit.client.0.smithi002.stdout:1/922: creat d4/d11/d55/d7a/f140 x:0 0 0 2024-09-17T01:02:05.855 INFO:tasks.workunit.client.0.smithi002.stdout:3/852: rmdir d0/d3/d17/d9a 39 2024-09-17T01:02:05.856 INFO:tasks.workunit.client.1.smithi099.stdout:3/950: dwrite d9/d15/d38/fc8 [0,4194304] 0 2024-09-17T01:02:05.856 INFO:tasks.workunit.client.1.smithi099.stdout:3/951: getdents d9/d15/d18/d1a/d23/d5c/d99/dd8/ded/d12e 0 2024-09-17T01:02:05.858 INFO:tasks.workunit.client.0.smithi002.stdout:5/912: truncate d2/d2d/d10/d9b/fdd 1275301 0 2024-09-17T01:02:05.859 INFO:tasks.workunit.client.0.smithi002.stdout:7/946: mknod d1/d14/d1d/d28/d6b/d9e/d50/d137/dcd/d45/c139 0 2024-09-17T01:02:05.861 INFO:tasks.workunit.client.0.smithi002.stdout:1/923: rmdir d4/d11/d12/d30/d134 0 2024-09-17T01:02:05.861 INFO:tasks.workunit.client.0.smithi002.stdout:1/924: chown d4/d11/d55/f65 2517662 1 2024-09-17T01:02:05.862 INFO:tasks.workunit.client.0.smithi002.stdout:3/853: dread d0/d31/f94 [0,4194304] 0 2024-09-17T01:02:05.863 INFO:tasks.workunit.client.0.smithi002.stdout:5/913: mkdir d2/d2d/d10/d20/d115/d124 0 2024-09-17T01:02:05.863 INFO:tasks.workunit.client.1.smithi099.stdout:7/806: rename d1/d37/d78/fd0 to d1/d8f/ffd 0 2024-09-17T01:02:05.863 INFO:tasks.workunit.client.0.smithi002.stdout:7/947: symlink d1/d14/l13a 0 2024-09-17T01:02:05.864 INFO:tasks.workunit.client.0.smithi002.stdout:5/914: truncate d2/d2d/d10/d20/f7e 1061564 0 2024-09-17T01:02:05.865 INFO:tasks.workunit.client.0.smithi002.stdout:5/915: dread - d2/d2d/d10/d14/d19/d39/fe1 zero size 2024-09-17T01:02:05.865 INFO:tasks.workunit.client.1.smithi099.stdout:3/952: rename d9/d2b/d6b/de7/d134/db2/daf to d9/d15/d18/d1a/d23/d5c/d99/dda/d136 0 2024-09-17T01:02:05.865 INFO:tasks.workunit.client.1.smithi099.stdout:3/953: fdatasync d9/f25 0 2024-09-17T01:02:05.865 INFO:tasks.workunit.client.0.smithi002.stdout:7/948: mknod d1/d14/d1d/d28/d40/c13b 0 2024-09-17T01:02:05.866 INFO:tasks.workunit.client.1.smithi099.stdout:7/807: unlink d1/d37/c67 0 2024-09-17T01:02:05.867 INFO:tasks.workunit.client.1.smithi099.stdout:7/808: fsync d1/d36/f45 0 2024-09-17T01:02:05.867 INFO:tasks.workunit.client.0.smithi002.stdout:7/949: rename d1/d14/d1d/d29/d57/cee to d1/d14/d67/c13c 0 2024-09-17T01:02:05.867 INFO:tasks.workunit.client.0.smithi002.stdout:7/950: creat d1/d24/f13d x:0 0 0 2024-09-17T01:02:05.867 INFO:tasks.workunit.client.0.smithi002.stdout:7/951: chown d1/d24 64322 1 2024-09-17T01:02:05.868 INFO:tasks.workunit.client.1.smithi099.stdout:7/809: mknod d1/d2c/d5c/d1c/d5a/d6f/cfe 0 2024-09-17T01:02:05.872 INFO:tasks.workunit.client.0.smithi002.stdout:7/952: getdents d1/d14/d1d/d28/d6b/d9e 0 2024-09-17T01:02:05.874 INFO:tasks.workunit.client.0.smithi002.stdout:7/953: link d1/d14/d1d/d28/d6b/d9e/d54/fbe d1/d14/d1d/d28/d86/f13e 0 2024-09-17T01:02:05.875 INFO:tasks.workunit.client.0.smithi002.stdout:1/925: read d4/d11/d12/d30/fb6 [1128327,43167] 0 2024-09-17T01:02:05.880 INFO:tasks.workunit.client.1.smithi099.stdout:3/954: dread d9/d15/d18/d1a/d23/d5c/d99/dda/f75 [0,4194304] 0 2024-09-17T01:02:05.881 INFO:tasks.workunit.client.1.smithi099.stdout:3/955: truncate d9/d15/d18/f106 4513226 0 2024-09-17T01:02:05.881 INFO:tasks.workunit.client.1.smithi099.stdout:3/956: creat d9/d15/d18/f137 x:0 0 0 2024-09-17T01:02:05.886 INFO:tasks.workunit.client.0.smithi002.stdout:7/954: read d1/d14/fa5 [561525,124922] 0 2024-09-17T01:02:05.886 INFO:tasks.workunit.client.0.smithi002.stdout:7/955: fdatasync d1/d14/d1d/d28/d6b/d9e/d5e/fb3 0 2024-09-17T01:02:05.893 INFO:tasks.workunit.client.0.smithi002.stdout:9/813: sync 2024-09-17T01:02:05.894 INFO:tasks.workunit.client.0.smithi002.stdout:9/814: creat d5/dc/d26/d5c/d6b/d75/d57/d7a/da2/ff9 x:0 0 0 2024-09-17T01:02:05.895 INFO:tasks.workunit.client.0.smithi002.stdout:0/784: sync 2024-09-17T01:02:05.899 INFO:tasks.workunit.client.0.smithi002.stdout:7/956: dread d1/d14/d1d/d28/d86/f97 [0,4194304] 0 2024-09-17T01:02:05.899 INFO:tasks.workunit.client.0.smithi002.stdout:7/957: readlink d1/d14/d1d/d28/d6b/d9e/lc3 0 2024-09-17T01:02:05.899 INFO:tasks.workunit.client.0.smithi002.stdout:7/958: dread - d1/d14/d1d/f88 zero size 2024-09-17T01:02:05.900 INFO:tasks.workunit.client.0.smithi002.stdout:7/959: mkdir d1/d14/d1d/d29/d98/d13f 0 2024-09-17T01:02:05.902 INFO:tasks.workunit.client.0.smithi002.stdout:3/854: dwrite d0/f97 [0,4194304] 0 2024-09-17T01:02:05.902 INFO:tasks.workunit.client.0.smithi002.stdout:3/855: chown d0/d3/df3 2820 1 2024-09-17T01:02:05.902 INFO:tasks.workunit.client.0.smithi002.stdout:3/856: creat d0/d31/d8b/d9d/f110 x:0 0 0 2024-09-17T01:02:05.902 INFO:tasks.workunit.client.0.smithi002.stdout:3/857: truncate d0/d3/d17/d9a/f5d 1017822 0 2024-09-17T01:02:05.904 INFO:tasks.workunit.client.0.smithi002.stdout:5/916: dwrite d2/d2d/d10/d3b/fe3 [4194304,4194304] 0 2024-09-17T01:02:05.904 INFO:tasks.workunit.client.0.smithi002.stdout:3/858: unlink d0/d31/d32/c67 0 2024-09-17T01:02:05.906 INFO:tasks.workunit.client.1.smithi099.stdout:7/810: dwrite d1/d2c/d5c/d12/f7f [4194304,4194304] 0 2024-09-17T01:02:05.906 INFO:tasks.workunit.client.1.smithi099.stdout:7/811: chown d1/d36/l81 5935 1 2024-09-17T01:02:05.906 INFO:tasks.workunit.client.1.smithi099.stdout:7/812: write d1/d2c/f66 [2646324,129540] 0 2024-09-17T01:02:05.907 INFO:tasks.workunit.client.1.smithi099.stdout:7/813: fsync d1/d2c/fc9 0 2024-09-17T01:02:05.907 INFO:tasks.workunit.client.0.smithi002.stdout:5/917: mkdir d2/d2d/d10/d14/d19/d39/dc4/d125 0 2024-09-17T01:02:05.907 INFO:tasks.workunit.client.0.smithi002.stdout:1/926: dwrite d4/d11/d12/d23/d32/d86/f8b [0,4194304] 0 2024-09-17T01:02:05.908 INFO:tasks.workunit.client.1.smithi099.stdout:3/957: dwrite d9/d15/d18/d1a/d23/d4c/de4/f109 [4194304,4194304] 0 2024-09-17T01:02:05.908 INFO:tasks.workunit.client.0.smithi002.stdout:5/918: symlink d2/d2d/d10/d14/d19/d39/d48/def/l126 0 2024-09-17T01:02:05.911 INFO:tasks.workunit.client.1.smithi099.stdout:3/958: symlink d9/d2b/d6b/dae/l138 0 2024-09-17T01:02:05.912 INFO:tasks.workunit.client.0.smithi002.stdout:1/927: mkdir d4/d11/d1a/daa/dee/d141 0 2024-09-17T01:02:05.912 INFO:tasks.workunit.client.1.smithi099.stdout:3/959: creat d9/d2b/d6b/de7/d134/d44/f139 x:0 0 0 2024-09-17T01:02:05.913 INFO:tasks.workunit.client.0.smithi002.stdout:0/785: dread dd/d19/d1a/d29/d55/f95 [0,4194304] 0 2024-09-17T01:02:05.913 INFO:tasks.workunit.client.0.smithi002.stdout:5/919: truncate d2/de/f1f 618856 0 2024-09-17T01:02:05.914 INFO:tasks.workunit.client.1.smithi099.stdout:3/960: link d9/d15/d18/dc2/ffa d9/d15/d8f/de3/d108/f13a 0 2024-09-17T01:02:05.914 INFO:tasks.workunit.client.1.smithi099.stdout:3/961: write d9/d15/d18/d1a/d23/d5c/d99/fba [148227,47363] 0 2024-09-17T01:02:05.914 INFO:tasks.workunit.client.0.smithi002.stdout:1/928: symlink d4/d11/d12/d14/d17/d51/d88/da3/d131/l142 0 2024-09-17T01:02:05.914 INFO:tasks.workunit.client.0.smithi002.stdout:1/929: chown d4/d11/d12/d30/dc4/f13c 14 1 2024-09-17T01:02:05.915 INFO:tasks.workunit.client.1.smithi099.stdout:3/962: mkdir d9/d15/d18/d1a/d23/d5c/d6e/d7e/d93/d13b 0 2024-09-17T01:02:05.915 INFO:tasks.workunit.client.1.smithi099.stdout:3/963: rename d9/d15/d18/d1a/d23/d5c to d9/d15/d18/d1a/d23/d5c/d6e/d7e/d13c 22 2024-09-17T01:02:05.916 INFO:tasks.workunit.client.1.smithi099.stdout:7/814: write d1/d8f/feb [5136395,117349] 0 2024-09-17T01:02:05.916 INFO:tasks.workunit.client.0.smithi002.stdout:9/815: dwrite d5/dc/d26/d63/fe5 [0,4194304] 0 2024-09-17T01:02:05.917 INFO:tasks.workunit.client.0.smithi002.stdout:5/920: creat d2/d2d/d10/d95/d96/f127 x:0 0 0 2024-09-17T01:02:05.917 INFO:tasks.workunit.client.1.smithi099.stdout:3/964: symlink d9/d2b/l13d 0 2024-09-17T01:02:05.917 INFO:tasks.workunit.client.1.smithi099.stdout:3/965: write d9/d15/d18/d1a/d23/d5c/fa1 [1605972,98483] 0 2024-09-17T01:02:05.917 INFO:tasks.workunit.client.1.smithi099.stdout:7/815: rmdir d1/d2c/d5c/d1c/d5a/db3/dcd 39 2024-09-17T01:02:05.921 INFO:tasks.workunit.client.1.smithi099.stdout:7/816: unlink d1/d8f/fc1 0 2024-09-17T01:02:05.924 INFO:tasks.workunit.client.0.smithi002.stdout:9/816: symlink d5/dc/d26/d63/d66/lfa 0 2024-09-17T01:02:05.925 INFO:tasks.workunit.client.1.smithi099.stdout:6/858: sync 2024-09-17T01:02:05.925 INFO:tasks.workunit.client.1.smithi099.stdout:8/939: sync 2024-09-17T01:02:05.926 INFO:tasks.workunit.client.1.smithi099.stdout:9/843: sync 2024-09-17T01:02:05.926 INFO:tasks.workunit.client.0.smithi002.stdout:1/930: dread d4/d11/d12/d14/d17/d51/f74 [0,4194304] 0 2024-09-17T01:02:05.926 INFO:tasks.workunit.client.0.smithi002.stdout:1/931: fsync d4/d11/d55/dbc/fde 0 2024-09-17T01:02:05.928 INFO:tasks.workunit.client.0.smithi002.stdout:9/817: creat d5/dc/ffb x:0 0 0 2024-09-17T01:02:05.928 INFO:tasks.workunit.client.0.smithi002.stdout:9/818: write d5/dc/d26/d5c/d6b/d75/d57/d8d/faa [886728,15640] 0 2024-09-17T01:02:05.928 INFO:tasks.workunit.client.0.smithi002.stdout:9/819: write d5/dc/d26/d46/d47/da1/fc7 [597781,7597] 0 2024-09-17T01:02:05.928 INFO:tasks.workunit.client.0.smithi002.stdout:9/820: fsync d5/dc/d26/d63/d66/fc4 0 2024-09-17T01:02:05.930 INFO:tasks.workunit.client.0.smithi002.stdout:9/821: rename d5/dc/d26/d63/d66/fae to d5/d8a/d9d/da7/ffc 0 2024-09-17T01:02:05.931 INFO:tasks.workunit.client.1.smithi099.stdout:3/966: write d9/d2b/fb0 [807788,54541] 0 2024-09-17T01:02:05.931 INFO:tasks.workunit.client.1.smithi099.stdout:3/967: read - d9/d15/d18/d1a/d23/d5c/d6e/fce zero size 2024-09-17T01:02:05.937 INFO:tasks.workunit.client.1.smithi099.stdout:6/859: rename dc/d1a/l107 to dc/d5d/d66/dbb/d10c/d74/l122 0 2024-09-17T01:02:05.937 INFO:tasks.workunit.client.0.smithi002.stdout:7/960: dwrite d1/dac/f133 [0,4194304] 0 2024-09-17T01:02:05.937 INFO:tasks.workunit.client.0.smithi002.stdout:7/961: dread - d1/d14/d1d/d28/d6b/d9e/d50/d137/dcd/d45/f106 zero size 2024-09-17T01:02:05.939 INFO:tasks.workunit.client.1.smithi099.stdout:9/844: mknod da/d18/d5e/c110 0 2024-09-17T01:02:05.941 INFO:tasks.workunit.client.0.smithi002.stdout:7/962: rmdir d1/d14/d1d/d28/d86/d10b 39 2024-09-17T01:02:05.941 INFO:tasks.workunit.client.0.smithi002.stdout:7/963: readlink d1/d14/d1d/d28/d6b/l8d 0 2024-09-17T01:02:05.942 INFO:tasks.workunit.client.1.smithi099.stdout:8/940: dread d0/d53/f83 [0,4194304] 0 2024-09-17T01:02:05.942 INFO:tasks.workunit.client.1.smithi099.stdout:8/941: write d0/d1f/d90/db8/dde/fba [222482,98677] 0 2024-09-17T01:02:05.943 INFO:tasks.workunit.client.1.smithi099.stdout:2/733: sync 2024-09-17T01:02:05.944 INFO:tasks.workunit.client.1.smithi099.stdout:6/860: creat dc/d1a/d49/da8/d110/f123 x:0 0 0 2024-09-17T01:02:05.944 INFO:tasks.workunit.client.1.smithi099.stdout:6/861: readlink dc/d27/d7e/dad/lb4 0 2024-09-17T01:02:05.947 INFO:tasks.workunit.client.0.smithi002.stdout:1/932: write d4/d11/d1a/f29 [8084190,36170] 0 2024-09-17T01:02:05.948 INFO:tasks.workunit.client.1.smithi099.stdout:4/843: sync 2024-09-17T01:02:05.948 INFO:tasks.workunit.client.1.smithi099.stdout:3/968: rename d9/d15/d18/d1a/d23/d5c/d99/dd8/ded/f117 to d9/d2b/d6b/de7/f13e 0 2024-09-17T01:02:05.948 INFO:tasks.workunit.client.1.smithi099.stdout:3/969: creat d9/d15/d18/dc2/f13f x:0 0 0 2024-09-17T01:02:05.948 INFO:tasks.workunit.client.1.smithi099.stdout:5/910: sync 2024-09-17T01:02:05.948 INFO:tasks.workunit.client.1.smithi099.stdout:0/929: sync 2024-09-17T01:02:05.949 INFO:tasks.workunit.client.0.smithi002.stdout:1/933: rmdir d4/d11/d1a/daa/dee 39 2024-09-17T01:02:05.949 INFO:tasks.workunit.client.0.smithi002.stdout:1/934: read - d4/d11/d55/fb2 zero size 2024-09-17T01:02:05.950 INFO:tasks.workunit.client.1.smithi099.stdout:8/942: creat d0/d1f/d90/db8/dde/d29/d4b/dff/f132 x:0 0 0 2024-09-17T01:02:05.950 INFO:tasks.workunit.client.1.smithi099.stdout:8/943: chown d0/d1f/d90/db8/dde/d29/d4b/db3/fd5 3 1 2024-09-17T01:02:05.950 INFO:tasks.workunit.client.0.smithi002.stdout:7/964: dread d1/d14/d1d/d29/f2f [0,4194304] 0 2024-09-17T01:02:05.951 INFO:tasks.workunit.client.1.smithi099.stdout:2/734: symlink d2/d9/d25/d26/d1b/d61/d7d/d85/d98/d9a/led 0 2024-09-17T01:02:05.951 INFO:tasks.workunit.client.1.smithi099.stdout:6/862: symlink dc/d27/dd7/l124 0 2024-09-17T01:02:05.952 INFO:tasks.workunit.client.0.smithi002.stdout:7/965: dread d1/d24/fc8 [0,4194304] 0 2024-09-17T01:02:05.952 INFO:tasks.workunit.client.0.smithi002.stdout:7/966: write d1/d14/d1d/d28/d6b/d9e/d54/fbe [16059,52866] 0 2024-09-17T01:02:05.952 INFO:tasks.workunit.client.0.smithi002.stdout:1/935: rename d4/d11/d12/d14/d17/c97 to d4/d11/d1a/d95/c143 0 2024-09-17T01:02:05.952 INFO:tasks.workunit.client.0.smithi002.stdout:7/967: write d1/d14/d1d/d28/d6b/d9e/d10a/f135 [930733,107054] 0 2024-09-17T01:02:05.953 INFO:tasks.workunit.client.1.smithi099.stdout:2/735: creat d2/d9/d25/d26/d1b/d61/d7d/fee x:0 0 0 2024-09-17T01:02:05.953 INFO:tasks.workunit.client.1.smithi099.stdout:2/736: stat d2/d9/fa0 0 2024-09-17T01:02:05.953 INFO:tasks.workunit.client.1.smithi099.stdout:2/737: chown d2 681 1 2024-09-17T01:02:05.953 INFO:tasks.workunit.client.1.smithi099.stdout:6/863: mknod dc/d27/dd7/dde/c125 0 2024-09-17T01:02:05.954 INFO:tasks.workunit.client.0.smithi002.stdout:1/936: mkdir d4/d22/d144 0 2024-09-17T01:02:05.954 INFO:tasks.workunit.client.1.smithi099.stdout:8/944: dread d0/d1f/fb4 [0,4194304] 0 2024-09-17T01:02:05.955 INFO:tasks.workunit.client.1.smithi099.stdout:8/945: read d0/d1f/d90/db8/dde/d29/d4b/fa6 [2553459,28614] 0 2024-09-17T01:02:05.955 INFO:tasks.workunit.client.1.smithi099.stdout:2/738: mknod d2/d9/d25/d26/d1b/d61/d7d/d85/d98/cef 0 2024-09-17T01:02:05.956 INFO:tasks.workunit.client.0.smithi002.stdout:0/786: dwrite dd/d19/f97 [0,4194304] 0 2024-09-17T01:02:05.956 INFO:tasks.workunit.client.0.smithi002.stdout:0/787: dread - dd/d19/d1c/d33/fd9 zero size 2024-09-17T01:02:05.956 INFO:tasks.workunit.client.0.smithi002.stdout:0/788: dread - dd/d19/d1c/d33/f106 zero size 2024-09-17T01:02:05.957 INFO:tasks.workunit.client.1.smithi099.stdout:6/864: mkdir dc/d5d/d66/dbb/d126 0 2024-09-17T01:02:05.957 INFO:tasks.workunit.client.1.smithi099.stdout:6/865: truncate dc/d1a/f92 4649459 0 2024-09-17T01:02:05.957 INFO:tasks.workunit.client.0.smithi002.stdout:1/937: creat d4/d11/d12/d23/d32/de3/d129/f145 x:0 0 0 2024-09-17T01:02:05.958 INFO:tasks.workunit.client.0.smithi002.stdout:3/859: dwrite d0/d3/d33/d40/f63 [0,4194304] 0 2024-09-17T01:02:05.958 INFO:tasks.workunit.client.1.smithi099.stdout:2/739: creat d2/d9/d25/d26/d1b/dad/ff0 x:0 0 0 2024-09-17T01:02:05.961 INFO:tasks.workunit.client.0.smithi002.stdout:3/860: mkdir d0/d31/d8b/d9d/d111 0 2024-09-17T01:02:05.961 INFO:tasks.workunit.client.0.smithi002.stdout:3/861: readlink d0/d31/d32/l10 0 2024-09-17T01:02:05.962 INFO:tasks.workunit.client.0.smithi002.stdout:3/862: mkdir d0/d3/d17/d87/d112 0 2024-09-17T01:02:05.962 INFO:tasks.workunit.client.0.smithi002.stdout:3/863: write d0/d3/d17/f6f [769312,84757] 0 2024-09-17T01:02:05.963 INFO:tasks.workunit.client.0.smithi002.stdout:3/864: dread - d0/d3/d17/d9a/daa/fdf zero size 2024-09-17T01:02:05.963 INFO:tasks.workunit.client.0.smithi002.stdout:5/921: dwrite d2/d2d/d10/d23/d6e/f6b [0,4194304] 0 2024-09-17T01:02:05.965 INFO:tasks.workunit.client.0.smithi002.stdout:3/865: truncate d0/d31/d32/db8/fdb 9617128 0 2024-09-17T01:02:05.965 INFO:tasks.workunit.client.0.smithi002.stdout:3/866: chown d0/d31/d32/d92 18697 1 2024-09-17T01:02:05.967 INFO:tasks.workunit.client.0.smithi002.stdout:0/789: dread dd/d19/d1c/d1f/d22/f6b [0,4194304] 0 2024-09-17T01:02:05.967 INFO:tasks.workunit.client.0.smithi002.stdout:0/790: chown dd/d19/d1a/d29/d55/d61 6921 1 2024-09-17T01:02:05.967 INFO:tasks.workunit.client.0.smithi002.stdout:1/938: dread d4/d11/d12/d23/f64 [0,4194304] 0 2024-09-17T01:02:05.968 INFO:tasks.workunit.client.1.smithi099.stdout:5/911: dread d2/dc/d14/d89/fd5 [0,4194304] 0 2024-09-17T01:02:05.968 INFO:tasks.workunit.client.1.smithi099.stdout:5/912: dread - d2/dc/d17/d3c/dc6/dfb/f106 zero size 2024-09-17T01:02:05.968 INFO:tasks.workunit.client.1.smithi099.stdout:5/913: readlink d2/dc4/d99/dd0/dc3/dfc/l103 0 2024-09-17T01:02:05.968 INFO:tasks.workunit.client.1.smithi099.stdout:5/914: chown d2/d26/d64/de2/f10d 544266404 1 2024-09-17T01:02:05.968 INFO:tasks.workunit.client.1.smithi099.stdout:5/915: write d2/d26/d64/df8/ffa [955203,104782] 0 2024-09-17T01:02:05.970 INFO:tasks.workunit.client.0.smithi002.stdout:3/867: symlink d0/d3/d37/de3/l113 0 2024-09-17T01:02:05.970 INFO:tasks.workunit.client.0.smithi002.stdout:3/868: readlink d0/d3/d8d/lc1 0 2024-09-17T01:02:05.970 INFO:tasks.workunit.client.0.smithi002.stdout:9/822: dwrite d5/dc/d26/d63/d66/f88 [0,4194304] 0 2024-09-17T01:02:05.970 INFO:tasks.workunit.client.0.smithi002.stdout:0/791: symlink dd/d19/d1c/d33/l10a 0 2024-09-17T01:02:05.971 INFO:tasks.workunit.client.1.smithi099.stdout:5/916: mknod d2/dc/d17/d3c/db3/dde/c131 0 2024-09-17T01:02:05.971 INFO:tasks.workunit.client.1.smithi099.stdout:5/917: stat d2/dc/d14/d36/da6 0 2024-09-17T01:02:05.971 INFO:tasks.workunit.client.1.smithi099.stdout:5/918: chown d2/dc/d17/d3c/da8/fc7 0 1 2024-09-17T01:02:05.971 INFO:tasks.workunit.client.0.smithi002.stdout:1/939: unlink d4/d11/d1a/f29 0 2024-09-17T01:02:05.976 INFO:tasks.workunit.client.1.smithi099.stdout:5/919: link d2/dc/d14/d89/ld4 d2/dc/d17/d3c/dca/l132 0 2024-09-17T01:02:05.980 INFO:tasks.workunit.client.0.smithi002.stdout:9/823: dread d5/dc/d26/d5c/d6b/d75/d57/d7a/fb5 [0,4194304] 0 2024-09-17T01:02:05.981 INFO:tasks.workunit.client.1.smithi099.stdout:6/866: dread dc/d1a/d49/d4c/f5f [0,4194304] 0 2024-09-17T01:02:05.982 INFO:tasks.workunit.client.1.smithi099.stdout:2/740: dread d2/d9/d17/f51 [0,4194304] 0 2024-09-17T01:02:05.982 INFO:tasks.workunit.client.1.smithi099.stdout:2/741: truncate d2/d9/d17/d83/dca/fde 582771 0 2024-09-17T01:02:05.986 INFO:tasks.workunit.client.1.smithi099.stdout:9/845: dwrite da/d56/d84/f9c [4194304,4194304] 0 2024-09-17T01:02:05.988 INFO:tasks.workunit.client.0.smithi002.stdout:0/792: mknod dd/d19/da9/de5/c10b 0 2024-09-17T01:02:05.988 INFO:tasks.workunit.client.0.smithi002.stdout:0/793: stat dd/d3d/f3f 0 2024-09-17T01:02:05.988 INFO:tasks.workunit.client.0.smithi002.stdout:0/794: chown dd/d19/da9/de5/d68/d9d/ffd 114425176 1 2024-09-17T01:02:05.988 INFO:tasks.workunit.client.0.smithi002.stdout:0/795: stat dd/d19/da9/de5/c10b 0 2024-09-17T01:02:05.988 INFO:tasks.workunit.client.1.smithi099.stdout:5/920: write d2/dc/d14/d36/f7e [1819154,12426] 0 2024-09-17T01:02:05.988 INFO:tasks.workunit.client.0.smithi002.stdout:3/869: truncate d0/d3/d37/f47 4049079 0 2024-09-17T01:02:05.989 INFO:tasks.workunit.client.1.smithi099.stdout:2/742: truncate d2/d9/d17/d83/f99 303361 0 2024-09-17T01:02:05.990 INFO:tasks.workunit.client.1.smithi099.stdout:4/844: dwrite d7/dd/d21/d26/d3f/d5b/f2c [0,4194304] 0 2024-09-17T01:02:05.990 INFO:tasks.workunit.client.1.smithi099.stdout:4/845: stat d7/dd/de/d17/fec 0 2024-09-17T01:02:05.991 INFO:tasks.workunit.client.0.smithi002.stdout:0/796: mknod dd/d3d/c10c 0 2024-09-17T01:02:05.992 INFO:tasks.workunit.client.1.smithi099.stdout:9/846: dread da/d14/d40/f97 [4194304,4194304] 0 2024-09-17T01:02:05.992 INFO:tasks.workunit.client.1.smithi099.stdout:5/921: creat d2/dc4/d99/dd0/dc3/dfc/f133 x:0 0 0 2024-09-17T01:02:05.993 INFO:tasks.workunit.client.1.smithi099.stdout:2/743: mkdir d2/d9/df1 0 2024-09-17T01:02:05.993 INFO:tasks.workunit.client.0.smithi002.stdout:0/797: unlink dd/d19/da9/de5/f66 0 2024-09-17T01:02:05.994 INFO:tasks.workunit.client.0.smithi002.stdout:0/798: mknod dd/d19/da9/de5/d68/d9d/dbe/c10d 0 2024-09-17T01:02:05.995 INFO:tasks.workunit.client.0.smithi002.stdout:0/799: truncate dd/d19/d1c/d1f/d76/fa2 4789837 0 2024-09-17T01:02:05.995 INFO:tasks.workunit.client.0.smithi002.stdout:0/800: write dd/d19/d1a/d29/d55/d56/fc1 [4471104,98230] 0 2024-09-17T01:02:05.995 INFO:tasks.workunit.client.0.smithi002.stdout:0/801: symlink dd/d19/d1c/d1f/l10e 0 2024-09-17T01:02:05.996 INFO:tasks.workunit.client.0.smithi002.stdout:0/802: mknod dd/d19/d1c/d78/c10f 0 2024-09-17T01:02:05.997 INFO:tasks.workunit.client.1.smithi099.stdout:3/970: dwrite d9/d15/d8f/d97/fbd [0,4194304] 0 2024-09-17T01:02:05.997 INFO:tasks.workunit.client.1.smithi099.stdout:6/867: dread dc/d1a/d49/da8/fd6 [0,4194304] 0 2024-09-17T01:02:05.998 INFO:tasks.workunit.client.1.smithi099.stdout:4/846: link d7/dd/d21/d7b/d74/f111 d7/dd/de/d10/d6b/d82/d8a/de0/f11d 0 2024-09-17T01:02:05.998 INFO:tasks.workunit.client.1.smithi099.stdout:4/847: write d7/dd/de/f3c [1204856,9373] 0 2024-09-17T01:02:05.999 INFO:tasks.workunit.client.1.smithi099.stdout:9/847: symlink da/d9a/d3a/l111 0 2024-09-17T01:02:05.999 INFO:tasks.workunit.client.1.smithi099.stdout:9/848: readlink da/d14/d40/lf1 0 2024-09-17T01:02:05.999 INFO:tasks.workunit.client.1.smithi099.stdout:9/849: fsync da/d8e/dbf/fe2 0 2024-09-17T01:02:06.000 INFO:tasks.workunit.client.0.smithi002.stdout:6/920: sync 2024-09-17T01:02:06.000 INFO:tasks.workunit.client.0.smithi002.stdout:6/921: fdatasync d2/d1d/d26/d49/d7d/d8c/faf 0 2024-09-17T01:02:06.004 INFO:tasks.workunit.client.1.smithi099.stdout:8/946: dwrite d0/d1f/d90/db8/dde/dc3/ffd [0,4194304] 0 2024-09-17T01:02:06.004 INFO:tasks.workunit.client.1.smithi099.stdout:4/848: creat d7/dd/de/d10/d6b/d82/f11e x:0 0 0 2024-09-17T01:02:06.004 INFO:tasks.workunit.client.1.smithi099.stdout:4/849: fdatasync d7/dd/de/d10/f5e 0 2024-09-17T01:02:06.005 INFO:tasks.workunit.client.1.smithi099.stdout:9/850: creat da/d50/d104/d105/d10a/f112 x:0 0 0 2024-09-17T01:02:06.005 INFO:tasks.workunit.client.1.smithi099.stdout:9/851: write da/d21/deb/ff6 [1363070,72541] 0 2024-09-17T01:02:06.012 INFO:tasks.workunit.client.1.smithi099.stdout:8/947: link d0/lc6 d0/d1f/d90/db8/dde/d29/d4b/df2/d129/dbe/l133 0 2024-09-17T01:02:06.013 INFO:tasks.workunit.client.1.smithi099.stdout:4/850: mknod d7/dd/de/d10/d6b/d82/d8a/d9a/da6/c11f 0 2024-09-17T01:02:06.013 INFO:tasks.workunit.client.1.smithi099.stdout:6/868: dread dc/d1a/f26 [0,4194304] 0 2024-09-17T01:02:06.013 INFO:tasks.workunit.client.1.smithi099.stdout:9/852: mkdir da/d14/d6d/d113 0 2024-09-17T01:02:06.013 INFO:tasks.workunit.client.1.smithi099.stdout:8/948: stat d0/lc6 0 2024-09-17T01:02:06.016 INFO:tasks.workunit.client.0.smithi002.stdout:5/922: dwrite d2/d2d/d10/d14/d19/d39/dae/fc9 [0,4194304] 0 2024-09-17T01:02:06.016 INFO:tasks.workunit.client.0.smithi002.stdout:5/923: write d2/d2d/d10/d23/d6e/ff7 [4818926,65117] 0 2024-09-17T01:02:06.017 INFO:tasks.workunit.client.1.smithi099.stdout:6/869: symlink dc/d5d/dae/d96/dfd/l127 0 2024-09-17T01:02:06.017 INFO:tasks.workunit.client.1.smithi099.stdout:6/870: creat dc/d27/f128 x:0 0 0 2024-09-17T01:02:06.018 INFO:tasks.workunit.client.0.smithi002.stdout:5/924: rmdir d2/d2d/d10/d14/d19/d39/dc4 39 2024-09-17T01:02:06.018 INFO:tasks.workunit.client.0.smithi002.stdout:5/925: readlink d2/d2d/l2f 0 2024-09-17T01:02:06.018 INFO:tasks.workunit.client.1.smithi099.stdout:3/971: dread d9/d15/d18/d1a/d23/d5c/d99/dd8/ded/f101 [0,4194304] 0 2024-09-17T01:02:06.020 INFO:tasks.workunit.client.0.smithi002.stdout:5/926: mknod d2/d2d/d10/d95/c128 0 2024-09-17T01:02:06.020 INFO:tasks.workunit.client.0.smithi002.stdout:5/927: chown d2/f54 35086 1 2024-09-17T01:02:06.022 INFO:tasks.workunit.client.0.smithi002.stdout:5/928: unlink d2/d2d/d10/d14/d19/da5/fd2 0 2024-09-17T01:02:06.023 INFO:tasks.workunit.client.0.smithi002.stdout:7/968: dwrite d1/d14/d1d/d28/d86/d10b/d110/f12a [0,4194304] 0 2024-09-17T01:02:06.024 INFO:tasks.workunit.client.0.smithi002.stdout:7/969: chown d1/d14/lf8 54961564 1 2024-09-17T01:02:06.027 INFO:tasks.workunit.client.1.smithi099.stdout:9/853: dread da/d8e/fd9 [0,4194304] 0 2024-09-17T01:02:06.034 INFO:tasks.workunit.client.0.smithi002.stdout:6/922: dread d2/d1d/d2d/d35/d6d/fa1 [0,4194304] 0 2024-09-17T01:02:06.035 INFO:tasks.workunit.client.0.smithi002.stdout:6/923: fdatasync d2/d1d/d2d/d35/d6d/f10c 0 2024-09-17T01:02:06.038 INFO:tasks.workunit.client.0.smithi002.stdout:1/940: dwrite d4/d11/d1a/daa/fe7 [0,4194304] 0 2024-09-17T01:02:06.042 INFO:tasks.workunit.client.0.smithi002.stdout:5/929: write d2/d2d/d10/d14/d19/d39/d48/d120/f8e [309435,31034] 0 2024-09-17T01:02:06.044 INFO:tasks.workunit.client.0.smithi002.stdout:1/941: chown d4/d11/d12/d30/d43/d67/l10a 0 1 2024-09-17T01:02:06.047 INFO:tasks.workunit.client.0.smithi002.stdout:2/864: sync 2024-09-17T01:02:06.048 INFO:tasks.workunit.client.1.smithi099.stdout:9/854: write da/d56/d84/db9/fcb [2044879,25742] 0 2024-09-17T01:02:06.049 INFO:tasks.workunit.client.0.smithi002.stdout:2/865: mknod d1b/d74/c138 0 2024-09-17T01:02:06.050 INFO:tasks.workunit.client.1.smithi099.stdout:9/855: rename da/d8e/ca8 to da/d50/d104/d105/d10a/c114 0 2024-09-17T01:02:06.052 INFO:tasks.workunit.client.0.smithi002.stdout:2/866: rename d1b/d37/d48/d4e/f70 to d1b/d37/d48/d52/f139 0 2024-09-17T01:02:06.052 INFO:tasks.workunit.client.0.smithi002.stdout:2/867: stat d1b/d37/d48/d52/de6/fca 0 2024-09-17T01:02:06.053 INFO:tasks.workunit.client.0.smithi002.stdout:2/868: mkdir d1b/d13a 0 2024-09-17T01:02:06.054 INFO:tasks.workunit.client.0.smithi002.stdout:1/942: dread d4/d11/d12/f7b [0,4194304] 0 2024-09-17T01:02:06.059 INFO:tasks.workunit.client.1.smithi099.stdout:9/856: read da/d18/f7e [2249040,67316] 0 2024-09-17T01:02:06.061 INFO:tasks.workunit.client.0.smithi002.stdout:3/870: dwrite d0/d3/d33/d40/fc3 [0,4194304] 0 2024-09-17T01:02:06.061 INFO:tasks.workunit.client.0.smithi002.stdout:2/869: read d1b/d3f/d59/d7f/dc9/f46 [4002342,126260] 0 2024-09-17T01:02:06.061 INFO:tasks.workunit.client.0.smithi002.stdout:2/870: fsync d1b/d37/d48/fba 0 2024-09-17T01:02:06.061 INFO:tasks.workunit.client.0.smithi002.stdout:2/871: stat d1b/d37/d48/c55 0 2024-09-17T01:02:06.062 INFO:tasks.workunit.client.0.smithi002.stdout:3/871: mkdir d0/d31/d8b/d9d/d114 0 2024-09-17T01:02:06.062 INFO:tasks.workunit.client.1.smithi099.stdout:9/857: rename da/d18/d5e/c110 to da/d18/d49/c115 0 2024-09-17T01:02:06.064 INFO:tasks.workunit.client.0.smithi002.stdout:2/872: mkdir d1b/d3f/d59/d7f/dc9/d13b 0 2024-09-17T01:02:06.070 INFO:tasks.workunit.client.0.smithi002.stdout:1/943: dread d4/d11/d12/d30/d5e/f60 [0,4194304] 0 2024-09-17T01:02:06.072 INFO:tasks.workunit.client.0.smithi002.stdout:1/944: symlink d4/d11/d1a/l146 0 2024-09-17T01:02:06.073 INFO:tasks.workunit.client.0.smithi002.stdout:1/945: truncate d4/d11/d12/d14/d17/d51/fbd 3078981 0 2024-09-17T01:02:06.075 INFO:tasks.workunit.client.1.smithi099.stdout:9/858: dread da/d9a/f3d [0,4194304] 0 2024-09-17T01:02:06.078 INFO:tasks.workunit.client.1.smithi099.stdout:9/859: rename da/cd1 to da/d21/deb/c116 0 2024-09-17T01:02:06.078 INFO:tasks.workunit.client.1.smithi099.stdout:9/860: creat da/d56/da5/f117 x:0 0 0 2024-09-17T01:02:06.078 INFO:tasks.workunit.client.1.smithi099.stdout:9/861: write da/d14/d40/d6f/f71 [1551648,105496] 0 2024-09-17T01:02:06.078 INFO:tasks.workunit.client.1.smithi099.stdout:9/862: readlink da/d9a/l10c 0 2024-09-17T01:02:06.079 INFO:tasks.workunit.client.1.smithi099.stdout:9/863: write da/d50/d104/d105/dad/ddc/fdf [344630,76378] 0 2024-09-17T01:02:06.083 INFO:tasks.workunit.client.1.smithi099.stdout:5/922: dwrite d2/d26/f83 [0,4194304] 0 2024-09-17T01:02:06.084 INFO:tasks.workunit.client.1.smithi099.stdout:5/923: write d2/f1b [4018198,60175] 0 2024-09-17T01:02:06.084 INFO:tasks.workunit.client.1.smithi099.stdout:5/924: creat d2/dc/d17/d3c/db3/dde/f134 x:0 0 0 2024-09-17T01:02:06.084 INFO:tasks.workunit.client.1.smithi099.stdout:5/925: readlink d2/l58 0 2024-09-17T01:02:06.084 INFO:tasks.workunit.client.1.smithi099.stdout:4/851: dwrite d7/dd/de/f14 [0,4194304] 0 2024-09-17T01:02:06.084 INFO:tasks.workunit.client.1.smithi099.stdout:6/871: dwrite dc/d27/d7e/f89 [0,4194304] 0 2024-09-17T01:02:06.085 INFO:tasks.workunit.client.0.smithi002.stdout:0/803: dwrite dd/d19/d1c/d1f/d39/ff2 [0,4194304] 0 2024-09-17T01:02:06.085 INFO:tasks.workunit.client.0.smithi002.stdout:0/804: mkdir dd/d19/d1a/d29/d55/d56/d110 0 2024-09-17T01:02:06.085 INFO:tasks.workunit.client.1.smithi099.stdout:2/744: dwrite d2/d9/d25/d26/f29 [0,4194304] 0 2024-09-17T01:02:06.085 INFO:tasks.workunit.client.1.smithi099.stdout:9/864: rmdir da/d9a/d3a/d4b 39 2024-09-17T01:02:06.086 INFO:tasks.workunit.client.0.smithi002.stdout:0/805: rename dd/d19/da9/de5/d68/cb5 to dd/d19/d1c/d1f/d39/c111 0 2024-09-17T01:02:06.086 INFO:tasks.workunit.client.0.smithi002.stdout:0/806: write dd/d19/d9f/fb0 [904648,57308] 0 2024-09-17T01:02:06.086 INFO:tasks.workunit.client.0.smithi002.stdout:0/807: write dd/d19/d1c/d1f/f77 [4511057,124709] 0 2024-09-17T01:02:06.089 INFO:tasks.workunit.client.1.smithi099.stdout:5/926: mkdir d2/dc/d14/d36/d9a/daa/d135 0 2024-09-17T01:02:06.089 INFO:tasks.workunit.client.1.smithi099.stdout:5/927: fdatasync d2/dc/d17/f3a 0 2024-09-17T01:02:06.091 INFO:tasks.workunit.client.0.smithi002.stdout:0/808: getdents dd/d19/d1c/d1f/d39 0 2024-09-17T01:02:06.092 INFO:tasks.workunit.client.1.smithi099.stdout:8/949: dwrite d0/d1f/d90/db8/dde/d29/d9c/faa [0,4194304] 0 2024-09-17T01:02:06.092 INFO:tasks.workunit.client.1.smithi099.stdout:4/852: unlink d7/l46 0 2024-09-17T01:02:06.093 INFO:tasks.workunit.client.1.smithi099.stdout:4/853: dread - d7/dd/de/d10/d6b/d82/d8a/de0/f11d zero size 2024-09-17T01:02:06.094 INFO:tasks.workunit.client.1.smithi099.stdout:3/972: dwrite d9/d15/d38/fc8 [0,4194304] 0 2024-09-17T01:02:06.095 INFO:tasks.workunit.client.0.smithi002.stdout:0/809: creat dd/d19/d1c/d78/f112 x:0 0 0 2024-09-17T01:02:06.095 INFO:tasks.workunit.client.0.smithi002.stdout:0/810: readlink dd/d19/d1c/d1f/l101 0 2024-09-17T01:02:06.095 INFO:tasks.workunit.client.0.smithi002.stdout:0/811: stat dd/d3d/l4b 0 2024-09-17T01:02:06.095 INFO:tasks.workunit.client.0.smithi002.stdout:6/924: dwrite d2/dc/fb6 [4194304,4194304] 0 2024-09-17T01:02:06.095 INFO:tasks.workunit.client.0.smithi002.stdout:6/925: readlink d2/d1d/d27/d80/l120 0 2024-09-17T01:02:06.095 INFO:tasks.workunit.client.0.smithi002.stdout:6/926: chown d2/d1d/d26/d49/d51/f76 28652824 1 2024-09-17T01:02:06.096 INFO:tasks.workunit.client.0.smithi002.stdout:7/970: dwrite d1/d14/d1d/d28/d6b/d9e/d50/d137/dcd/d45/fce [0,4194304] 0 2024-09-17T01:02:06.096 INFO:tasks.workunit.client.0.smithi002.stdout:0/812: mkdir dd/d19/da9/de5/d68/d9d/dbe/d113 0 2024-09-17T01:02:06.096 INFO:tasks.workunit.client.0.smithi002.stdout:0/813: fdatasync dd/fae 0 2024-09-17T01:02:06.096 INFO:tasks.workunit.client.1.smithi099.stdout:6/872: unlink dc/d1a/d49/da8/db3/fe5 0 2024-09-17T01:02:06.096 INFO:tasks.workunit.client.1.smithi099.stdout:9/865: dread da/d9a/d3a/f26 [0,4194304] 0 2024-09-17T01:02:06.096 INFO:tasks.workunit.client.1.smithi099.stdout:2/745: symlink d2/d9/d25/d26/d1b/d61/d7d/lf2 0 2024-09-17T01:02:06.097 INFO:tasks.workunit.client.0.smithi002.stdout:6/927: mkdir d2/d1d/d27/d87/d138 0 2024-09-17T01:02:06.099 INFO:tasks.workunit.client.1.smithi099.stdout:8/950: creat d0/d1f/d90/db8/dde/d29/d4b/df2/d129/dbe/f134 x:0 0 0 2024-09-17T01:02:06.100 INFO:tasks.workunit.client.0.smithi002.stdout:0/814: creat dd/d19/d1c/d1f/dc4/f114 x:0 0 0 2024-09-17T01:02:06.101 INFO:tasks.workunit.client.0.smithi002.stdout:6/928: truncate d2/d1d/d2d/d35/d6d/fa1 2734524 0 2024-09-17T01:02:06.101 INFO:tasks.workunit.client.1.smithi099.stdout:3/973: creat d9/d15/d18/d1a/d23/d5c/d99/dda/db5/d125/f140 x:0 0 0 2024-09-17T01:02:06.102 INFO:tasks.workunit.client.0.smithi002.stdout:5/930: dwrite d2/d2d/d10/d14/d19/da5/db0/d33/fd7 [0,4194304] 0 2024-09-17T01:02:06.102 INFO:tasks.workunit.client.0.smithi002.stdout:6/929: symlink d2/d1d/d99/l139 0 2024-09-17T01:02:06.102 INFO:tasks.workunit.client.1.smithi099.stdout:6/873: symlink dc/d5d/d66/l129 0 2024-09-17T01:02:06.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/946: dwrite d4/d11/d12/d30/d5e/d8c/faf [0,4194304] 0 2024-09-17T01:02:06.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/947: write d4/d11/d55/dbc/dff/f12d [1001957,9529] 0 2024-09-17T01:02:06.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/948: write d4/f118 [328057,109664] 0 2024-09-17T01:02:06.104 INFO:tasks.workunit.client.0.smithi002.stdout:3/872: dwrite d0/d3/d17/d84/ff5 [0,4194304] 0 2024-09-17T01:02:06.105 INFO:tasks.workunit.client.1.smithi099.stdout:8/951: creat d0/d1f/d90/db8/dde/d29/d4b/dff/d11f/f135 x:0 0 0 2024-09-17T01:02:06.106 INFO:tasks.workunit.client.0.smithi002.stdout:5/931: unlink d2/d2d/d10/d14/d19/da5/db0/c98 0 2024-09-17T01:02:06.106 INFO:tasks.workunit.client.0.smithi002.stdout:5/932: creat d2/d2d/d10/d23/d6e/f129 x:0 0 0 2024-09-17T01:02:06.106 INFO:tasks.workunit.client.0.smithi002.stdout:5/933: chown d2/d2d/d10/d14/d19/d39/f35 7566580 1 2024-09-17T01:02:06.106 INFO:tasks.workunit.client.0.smithi002.stdout:5/934: read d2/d2d/d10/d9b/fdd [958279,6249] 0 2024-09-17T01:02:06.108 INFO:tasks.workunit.client.1.smithi099.stdout:6/874: symlink dc/d5d/dae/l12a 0 2024-09-17T01:02:06.108 INFO:tasks.workunit.client.1.smithi099.stdout:6/875: chown dc/d2b/d11e/fdd 3349074 1 2024-09-17T01:02:06.108 INFO:tasks.workunit.client.0.smithi002.stdout:6/930: mknod d2/d1d/d26/c13a 0 2024-09-17T01:02:06.108 INFO:tasks.workunit.client.0.smithi002.stdout:2/873: dwrite d1b/d1d/d79/fd9 [0,4194304] 0 2024-09-17T01:02:06.109 INFO:tasks.workunit.client.1.smithi099.stdout:4/854: write d7/dd/d21/d26/d3f/d5b/f37 [3081,128344] 0 2024-09-17T01:02:06.109 INFO:tasks.workunit.client.1.smithi099.stdout:4/855: write d7/fc [109528,89184] 0 2024-09-17T01:02:06.109 INFO:tasks.workunit.client.1.smithi099.stdout:4/856: fsync d7/dd/de/d10/d6b/f11c 0 2024-09-17T01:02:06.109 INFO:tasks.workunit.client.1.smithi099.stdout:4/857: chown d7/dd/de/d10 8771 1 2024-09-17T01:02:06.110 INFO:tasks.workunit.client.1.smithi099.stdout:6/876: mkdir dc/d27/dd7/d12b 0 2024-09-17T01:02:06.113 INFO:tasks.workunit.client.0.smithi002.stdout:1/949: creat d4/d11/d12/d23/f147 x:0 0 0 2024-09-17T01:02:06.114 INFO:tasks.workunit.client.0.smithi002.stdout:5/935: symlink d2/d2d/d10/d14/d19/d39/dc4/l12a 0 2024-09-17T01:02:06.116 INFO:tasks.workunit.client.1.smithi099.stdout:4/858: rename d7/dd/d92/lfe to d7/dd/d21/d7b/l120 0 2024-09-17T01:02:06.118 INFO:tasks.workunit.client.1.smithi099.stdout:8/952: write d0/d1f/d31/f115 [1628833,125144] 0 2024-09-17T01:02:06.118 INFO:tasks.workunit.client.1.smithi099.stdout:8/953: chown d0/d1f/d31/d4c/d8c 14 1 2024-09-17T01:02:06.118 INFO:tasks.workunit.client.1.smithi099.stdout:8/954: dread - d0/d1f/d90/db8/dde/d29/d4b/df2/d129/dcf/f118 zero size 2024-09-17T01:02:06.119 INFO:tasks.workunit.client.1.smithi099.stdout:4/859: mkdir d7/dd/de/d10/d6b/d82/d121 0 2024-09-17T01:02:06.119 INFO:tasks.workunit.client.1.smithi099.stdout:4/860: truncate d7/fb 9438797 0 2024-09-17T01:02:06.119 INFO:tasks.workunit.client.0.smithi002.stdout:3/873: write d0/d31/d32/fb9 [3704835,90921] 0 2024-09-17T01:02:06.120 INFO:tasks.workunit.client.0.smithi002.stdout:5/936: mkdir d2/d2d/d10/d95/d96/d12b 0 2024-09-17T01:02:06.121 INFO:tasks.workunit.client.1.smithi099.stdout:8/955: truncate d0/d1f/d90/fec 2619493 0 2024-09-17T01:02:06.122 INFO:tasks.workunit.client.0.smithi002.stdout:6/931: getdents d2/dc/d24/d53/d83/da9/d4c 0 2024-09-17T01:02:06.123 INFO:tasks.workunit.client.1.smithi099.stdout:4/861: link d7/dd/d21/d26/d3f/d5b/da4/f53 d7/dd/de/d10/d85/f122 0 2024-09-17T01:02:06.123 INFO:tasks.workunit.client.0.smithi002.stdout:3/874: mkdir d0/d3/d33/d99/dab/ded/d115 0 2024-09-17T01:02:06.124 INFO:tasks.workunit.client.0.smithi002.stdout:3/875: fsync d0/d3/d17/d9a/f66 0 2024-09-17T01:02:06.124 INFO:tasks.workunit.client.0.smithi002.stdout:6/932: dread d2/d1d/d27/d30/f77 [0,4194304] 0 2024-09-17T01:02:06.124 INFO:tasks.workunit.client.0.smithi002.stdout:6/933: stat d2/d1d/d26/d49/f6e 0 2024-09-17T01:02:06.125 INFO:tasks.workunit.client.1.smithi099.stdout:8/956: mkdir d0/d41/d5a/dcd/d136 0 2024-09-17T01:02:06.126 INFO:tasks.workunit.client.0.smithi002.stdout:3/876: link d0/d31/d32/fd5 d0/d3/d17/d87/d9e/dd4/f116 0 2024-09-17T01:02:06.126 INFO:tasks.workunit.client.0.smithi002.stdout:3/877: chown d0/d3/d17/d35/l50 268764297 1 2024-09-17T01:02:06.126 INFO:tasks.workunit.client.0.smithi002.stdout:7/971: dwrite d1/d24/fc8 [0,4194304] 0 2024-09-17T01:02:06.127 INFO:tasks.workunit.client.0.smithi002.stdout:7/972: chown d1/d14/d1d/d28/d40 0 1 2024-09-17T01:02:06.127 INFO:tasks.workunit.client.0.smithi002.stdout:6/934: mknod d2/dc/d24/d53/d83/da9/c13b 0 2024-09-17T01:02:06.127 INFO:tasks.workunit.client.1.smithi099.stdout:6/877: dread dc/d2b/fa6 [0,4194304] 0 2024-09-17T01:02:06.128 INFO:tasks.workunit.client.1.smithi099.stdout:6/878: truncate dc/d5d/dae/d96/dfd/d101/f10f 193904 0 2024-09-17T01:02:06.130 INFO:tasks.workunit.client.0.smithi002.stdout:3/878: readlink d0/l95 0 2024-09-17T01:02:06.134 INFO:tasks.workunit.client.1.smithi099.stdout:3/974: dwrite d9/d15/d18/dc2/ff5 [0,4194304] 0 2024-09-17T01:02:06.136 INFO:tasks.workunit.client.1.smithi099.stdout:9/866: dwrite da/d56/d84/f9c [4194304,4194304] 0 2024-09-17T01:02:06.137 INFO:tasks.workunit.client.0.smithi002.stdout:7/973: rename d1/f27 to d1/d14/d1d/d28/d6b/d9e/d54/f140 0 2024-09-17T01:02:06.140 INFO:tasks.workunit.client.0.smithi002.stdout:6/935: creat d2/d1d/d2d/d35/d79/da8/d10d/f13c x:0 0 0 2024-09-17T01:02:06.140 INFO:tasks.workunit.client.0.smithi002.stdout:0/815: dwrite dd/d19/f3b [0,4194304] 0 2024-09-17T01:02:06.143 INFO:tasks.workunit.client.0.smithi002.stdout:6/936: creat d2/d1d/d2d/f13d x:0 0 0 2024-09-17T01:02:06.146 INFO:tasks.workunit.client.0.smithi002.stdout:0/816: link dd/d19/d9f/fb0 dd/d19/d9f/f115 0 2024-09-17T01:02:06.147 INFO:tasks.workunit.client.1.smithi099.stdout:9/867: rename da/d50/d104/d105/dad/cdd to da/d18/db3/def/c118 0 2024-09-17T01:02:06.148 INFO:tasks.workunit.client.0.smithi002.stdout:2/874: read d1b/d1d/f7c [3819401,122735] 0 2024-09-17T01:02:06.148 INFO:tasks.workunit.client.0.smithi002.stdout:2/875: chown d1b/d74/d93/d94/de2 11863 1 2024-09-17T01:02:06.150 INFO:tasks.workunit.client.0.smithi002.stdout:0/817: creat dd/d19/da9/de5/d68/d9d/dbe/df5/f116 x:0 0 0 2024-09-17T01:02:06.151 INFO:tasks.workunit.client.0.smithi002.stdout:2/876: creat d1b/d74/d93/d94/d133/f13c x:0 0 0 2024-09-17T01:02:06.155 INFO:tasks.workunit.client.0.smithi002.stdout:2/877: creat d1b/d3f/d59/d7f/dc9/dac/dbd/dc3/f13d x:0 0 0 2024-09-17T01:02:06.157 INFO:tasks.workunit.client.0.smithi002.stdout:1/950: dwrite d4/fe [0,4194304] 0 2024-09-17T01:02:06.157 INFO:tasks.workunit.client.0.smithi002.stdout:2/878: truncate d1b/f1c 4447079 0 2024-09-17T01:02:06.161 INFO:tasks.workunit.client.0.smithi002.stdout:0/818: write dd/d19/d1a/f92 [2328160,98256] 0 2024-09-17T01:02:06.164 INFO:tasks.workunit.client.0.smithi002.stdout:1/951: unlink d4/d11/d12/d23/f89 0 2024-09-17T01:02:06.169 INFO:tasks.workunit.client.0.smithi002.stdout:1/952: dwrite - open d4/d11/d12/d30/d43/d67/f12b failed 14 2024-09-17T01:02:06.169 INFO:tasks.workunit.client.0.smithi002.stdout:5/937: dwrite d2/d2d/f13 [0,4194304] 0 2024-09-17T01:02:06.170 INFO:tasks.workunit.client.1.smithi099.stdout:4/862: dwrite d7/dd/d21/d7b/d74/f111 [0,4194304] 0 2024-09-17T01:02:06.170 INFO:tasks.workunit.client.0.smithi002.stdout:1/953: link d4/d11/d12/d14/d17/ddb/c104 d4/d11/d1a/d95/c148 0 2024-09-17T01:02:06.171 INFO:tasks.workunit.client.1.smithi099.stdout:8/957: dwrite d0/d41/f9b [4194304,4194304] 0 2024-09-17T01:02:06.172 INFO:tasks.workunit.client.0.smithi002.stdout:5/938: mknod d2/d2d/d10/d14/d19/d39/d48/d120/c12c 0 2024-09-17T01:02:06.172 INFO:tasks.workunit.client.0.smithi002.stdout:5/939: write d2/d2d/d10/d9b/de8/ff0 [601433,32532] 0 2024-09-17T01:02:06.172 INFO:tasks.workunit.client.0.smithi002.stdout:5/940: stat d2/de/d1d/ce7 0 2024-09-17T01:02:06.172 INFO:tasks.workunit.client.0.smithi002.stdout:5/941: creat d2/d2d/d10/d14/d19/da5/db0/f12d x:0 0 0 2024-09-17T01:02:06.173 INFO:tasks.workunit.client.0.smithi002.stdout:5/942: read d2/d2d/d10/d20/d24/f77 [343624,65384] 0 2024-09-17T01:02:06.173 INFO:tasks.workunit.client.0.smithi002.stdout:5/943: fdatasync d2/d2d/d10/d14/d19/d39/d48/d120/f8e 0 2024-09-17T01:02:06.173 INFO:tasks.workunit.client.0.smithi002.stdout:5/944: truncate d2/d2d/d10/d14/d19/d39/d25/fd8 683075 0 2024-09-17T01:02:06.173 INFO:tasks.workunit.client.0.smithi002.stdout:5/945: fsync d2/d2d/d10/d14/d19/f1c 0 2024-09-17T01:02:06.173 INFO:tasks.workunit.client.0.smithi002.stdout:1/954: symlink d4/d11/d12/d30/d5e/l149 0 2024-09-17T01:02:06.173 INFO:tasks.workunit.client.0.smithi002.stdout:0/819: truncate dd/d19/d1c/d1f/f77 3141298 0 2024-09-17T01:02:06.173 INFO:tasks.workunit.client.0.smithi002.stdout:0/820: fsync dd/d19/d1c/d1f/d76/f7c 0 2024-09-17T01:02:06.174 INFO:tasks.workunit.client.1.smithi099.stdout:9/868: truncate da/d56/d84/f9c 1660858 0 2024-09-17T01:02:06.174 INFO:tasks.workunit.client.1.smithi099.stdout:9/869: fdatasync da/d14/d6d/f87 0 2024-09-17T01:02:06.175 INFO:tasks.workunit.client.1.smithi099.stdout:4/863: write d7/dd/de/d10/d6b/d82/d8a/d9a/da6/f105 [430528,116884] 0 2024-09-17T01:02:06.175 INFO:tasks.workunit.client.1.smithi099.stdout:6/879: dwrite dc/d27/dd7/f120 [0,4194304] 0 2024-09-17T01:02:06.175 INFO:tasks.workunit.client.0.smithi002.stdout:1/955: mkdir d4/d11/d1c/d130/d14a 0 2024-09-17T01:02:06.177 INFO:tasks.workunit.client.1.smithi099.stdout:8/958: creat d0/d41/d5a/dcd/d136/f137 x:0 0 0 2024-09-17T01:02:06.177 INFO:tasks.workunit.client.0.smithi002.stdout:1/956: creat d4/d11/d12/d14/d17/d40/deb/d136/f14b x:0 0 0 2024-09-17T01:02:06.177 INFO:tasks.workunit.client.0.smithi002.stdout:1/957: readlink d4/d11/d12/d23/d32/de3/lf3 0 2024-09-17T01:02:06.178 INFO:tasks.workunit.client.0.smithi002.stdout:0/821: mknod dd/d19/d1c/db7/c117 0 2024-09-17T01:02:06.178 INFO:tasks.workunit.client.1.smithi099.stdout:9/870: creat da/d21/d5b/f119 x:0 0 0 2024-09-17T01:02:06.178 INFO:tasks.workunit.client.1.smithi099.stdout:4/864: creat d7/dd/d92/f123 x:0 0 0 2024-09-17T01:02:06.179 INFO:tasks.workunit.client.0.smithi002.stdout:7/974: dwrite d1/d14/d1d/d29/d98/dcf/f12c [0,4194304] 0 2024-09-17T01:02:06.180 INFO:tasks.workunit.client.0.smithi002.stdout:3/879: dwrite d0/f97 [0,4194304] 0 2024-09-17T01:02:06.181 INFO:tasks.workunit.client.1.smithi099.stdout:8/959: mknod d0/d1f/d90/c138 0 2024-09-17T01:02:06.183 INFO:tasks.workunit.client.1.smithi099.stdout:9/871: creat da/d50/d104/f11a x:0 0 0 2024-09-17T01:02:06.184 INFO:tasks.workunit.client.0.smithi002.stdout:7/975: rename d1/d14/d1d/d28/d6b/l81 to d1/d14/d1d/d28/d6b/d9e/d50/l141 0 2024-09-17T01:02:06.186 INFO:tasks.workunit.client.0.smithi002.stdout:6/937: dwrite d2/dc/fb6 [4194304,4194304] 0 2024-09-17T01:02:06.187 INFO:tasks.workunit.client.0.smithi002.stdout:7/976: rename d1/d14/c1a to d1/d14/d1d/d29/d57/c142 0 2024-09-17T01:02:06.187 INFO:tasks.workunit.client.0.smithi002.stdout:7/977: fsync d1/d14/d1d/d28/d8f/ff2 0 2024-09-17T01:02:06.187 INFO:tasks.workunit.client.0.smithi002.stdout:3/880: getdents d0/d3/d37/dac/de2 0 2024-09-17T01:02:06.190 INFO:tasks.workunit.client.1.smithi099.stdout:8/960: truncate d0/d1f/d90/db8/dde/d29/d9c/faa 2333601 0 2024-09-17T01:02:06.191 INFO:tasks.workunit.client.0.smithi002.stdout:6/938: link d2/d1d/d27/d80/d93/dd5/d5c/c108 d2/d1d/d26/d49/d51/c13e 0 2024-09-17T01:02:06.200 INFO:tasks.workunit.client.0.smithi002.stdout:9/824: sync 2024-09-17T01:02:06.201 INFO:tasks.workunit.client.0.smithi002.stdout:9/825: truncate d5/f20 4300512 0 2024-09-17T01:02:06.202 INFO:tasks.workunit.client.0.smithi002.stdout:9/826: fdatasync d5/dc/d26/f86 0 2024-09-17T01:02:06.204 INFO:tasks.workunit.client.1.smithi099.stdout:3/975: dwrite d9/d2b/f58 [0,4194304] 0 2024-09-17T01:02:06.204 INFO:tasks.workunit.client.1.smithi099.stdout:3/976: chown d9/ce 5 1 2024-09-17T01:02:06.204 INFO:tasks.workunit.client.1.smithi099.stdout:3/977: creat d9/d2b/d6b/f141 x:0 0 0 2024-09-17T01:02:06.204 INFO:tasks.workunit.client.0.smithi002.stdout:9/827: write d5/dc/d26/d5c/d6b/d75/d36/f97 [1355388,42767] 0 2024-09-17T01:02:06.204 INFO:tasks.workunit.client.0.smithi002.stdout:9/828: stat d5/dc/d26/c4a 0 2024-09-17T01:02:06.210 INFO:tasks.workunit.client.0.smithi002.stdout:7/978: dread d1/d14/d1d/d28/d6b/d9e/d50/d137/dcd/d45/d113/f62 [0,4194304] 0 2024-09-17T01:02:06.210 INFO:tasks.workunit.client.0.smithi002.stdout:7/979: chown d1/l1e 26 1 2024-09-17T01:02:06.218 INFO:tasks.workunit.client.1.smithi099.stdout:3/978: dread d9/d2b/d6b/de7/d134/fe2 [0,4194304] 0 2024-09-17T01:02:06.218 INFO:tasks.workunit.client.1.smithi099.stdout:3/979: stat d9/d15/d18/d1a/d23/d5c/d6e/d7e/fde 0 2024-09-17T01:02:06.218 INFO:tasks.workunit.client.0.smithi002.stdout:9/829: write d5/dc/f32 [1448787,53626] 0 2024-09-17T01:02:06.220 INFO:tasks.workunit.client.0.smithi002.stdout:9/830: link d5/dc/d26/d5c/d6b/cd9 d5/dc/d26/d5c/d6b/d75/cfd 0 2024-09-17T01:02:06.220 INFO:tasks.workunit.client.0.smithi002.stdout:9/831: fdatasync d5/dc/d26/d63/d66/f88 0 2024-09-17T01:02:06.222 INFO:tasks.workunit.client.0.smithi002.stdout:9/832: write d5/dc/d26/d5c/d6b/d75/d36/f67 [606518,10387] 0 2024-09-17T01:02:06.224 INFO:tasks.workunit.client.1.smithi099.stdout:3/980: dread d9/d15/d18/fc7 [0,4194304] 0 2024-09-17T01:02:06.224 INFO:tasks.workunit.client.1.smithi099.stdout:3/981: mkdir d9/d15/d18/d1a/d23/d5c/d99/dbb/dcb/d142 0 2024-09-17T01:02:06.225 INFO:tasks.workunit.client.0.smithi002.stdout:7/980: dwrite d1/d14/d1d/fe2 [4194304,4194304] 0 2024-09-17T01:02:06.225 INFO:tasks.workunit.client.0.smithi002.stdout:1/958: dwrite d4/d11/d12/d30/d5e/fd0 [0,4194304] 0 2024-09-17T01:02:06.225 INFO:tasks.workunit.client.0.smithi002.stdout:1/959: write d4/d11/f5c [2083765,54694] 0 2024-09-17T01:02:06.226 INFO:tasks.workunit.client.1.smithi099.stdout:3/982: symlink d9/d2b/d6b/de7/d134/db2/l143 0 2024-09-17T01:02:06.226 INFO:tasks.workunit.client.1.smithi099.stdout:3/983: stat d9/d15/d8f/de3/d108 0 2024-09-17T01:02:06.226 INFO:tasks.workunit.client.1.smithi099.stdout:3/984: chown d9/d2b/d6b/de7/d134/d44/c45 726 1 2024-09-17T01:02:06.229 INFO:tasks.workunit.client.0.smithi002.stdout:7/981: rename d1/d14/d67/c13c to d1/d14/d1d/d29/c143 0 2024-09-17T01:02:06.229 INFO:tasks.workunit.client.0.smithi002.stdout:7/982: creat d1/d14/d1d/d29/d98/dcf/f144 x:0 0 0 2024-09-17T01:02:06.229 INFO:tasks.workunit.client.1.smithi099.stdout:3/985: mkdir d9/d15/d18/d1a/d23/d102/d144 0 2024-09-17T01:02:06.230 INFO:tasks.workunit.client.0.smithi002.stdout:9/833: dread d5/dc/d26/d46/d47/da1/fb3 [0,4194304] 0 2024-09-17T01:02:06.230 INFO:tasks.workunit.client.0.smithi002.stdout:9/834: stat d5/dc/d26/c7f 0 2024-09-17T01:02:06.233 INFO:tasks.workunit.client.0.smithi002.stdout:9/835: rmdir d5/dc/d26/d5c/de4/df2 0 2024-09-17T01:02:06.233 INFO:tasks.workunit.client.1.smithi099.stdout:8/961: dwrite d0/d1f/d55/f7e [0,4194304] 0 2024-09-17T01:02:06.234 INFO:tasks.workunit.client.0.smithi002.stdout:6/939: dwrite d2/dc/fdb [0,4194304] 0 2024-09-17T01:02:06.235 INFO:tasks.workunit.client.1.smithi099.stdout:9/872: dwrite da/d21/f8f [0,4194304] 0 2024-09-17T01:02:06.235 INFO:tasks.workunit.client.1.smithi099.stdout:6/880: dwrite dc/d5d/dae/fa2 [4194304,4194304] 0 2024-09-17T01:02:06.238 INFO:tasks.workunit.client.0.smithi002.stdout:6/940: creat d2/d1d/d27/d87/d94/f13f x:0 0 0 2024-09-17T01:02:06.238 INFO:tasks.workunit.client.0.smithi002.stdout:6/941: fdatasync d2/d1d/d99/fee 0 2024-09-17T01:02:06.238 INFO:tasks.workunit.client.0.smithi002.stdout:6/942: write d2/d1d/fa3 [1527117,129091] 0 2024-09-17T01:02:06.239 INFO:tasks.workunit.client.0.smithi002.stdout:6/943: dread - d2/dc/d24/fec zero size 2024-09-17T01:02:06.239 INFO:tasks.workunit.client.0.smithi002.stdout:6/944: creat d2/d1d/d27/d87/d94/f140 x:0 0 0 2024-09-17T01:02:06.239 INFO:tasks.workunit.client.0.smithi002.stdout:1/960: read d4/d11/d1a/d95/fbe [3523579,41678] 0 2024-09-17T01:02:06.240 INFO:tasks.workunit.client.0.smithi002.stdout:1/961: chown d4/d11/d12/d23/d32/f84 2 1 2024-09-17T01:02:06.240 INFO:tasks.workunit.client.1.smithi099.stdout:8/962: rename d0/d41/f9b to d0/d41/d5a/dcd/d136/f139 0 2024-09-17T01:02:06.241 INFO:tasks.workunit.client.1.smithi099.stdout:4/865: dwrite d7/dd/d21/fd8 [0,4194304] 0 2024-09-17T01:02:06.244 INFO:tasks.workunit.client.0.smithi002.stdout:6/945: rename d2/d1d/d2d/d35/d6d/d106/d109 to d2/d1d/d27/d80/d93/d141 0 2024-09-17T01:02:06.244 INFO:tasks.workunit.client.1.smithi099.stdout:9/873: mknod da/d50/d104/d105/dad/ddc/de6/c11b 0 2024-09-17T01:02:06.244 INFO:tasks.workunit.client.1.smithi099.stdout:9/874: chown da/d18/db3/cff 0 1 2024-09-17T01:02:06.245 INFO:tasks.workunit.client.1.smithi099.stdout:9/875: fsync da/d21/f3b 0 2024-09-17T01:02:06.245 INFO:tasks.workunit.client.0.smithi002.stdout:1/962: mknod d4/d11/d55/d7a/c14c 0 2024-09-17T01:02:06.246 INFO:tasks.workunit.client.0.smithi002.stdout:6/946: symlink d2/d1d/d27/d87/l142 0 2024-09-17T01:02:06.246 INFO:tasks.workunit.client.1.smithi099.stdout:6/881: mknod dc/d5d/d66/dc3/c12c 0 2024-09-17T01:02:06.247 INFO:tasks.workunit.client.0.smithi002.stdout:1/963: symlink d4/d11/d1a/d95/l14d 0 2024-09-17T01:02:06.247 INFO:tasks.workunit.client.0.smithi002.stdout:1/964: write d4/d11/d12/d14/d17/d56/f137 [776517,107559] 0 2024-09-17T01:02:06.248 INFO:tasks.workunit.client.0.smithi002.stdout:1/965: mkdir d4/d22/d8d/d14e 0 2024-09-17T01:02:06.249 INFO:tasks.workunit.client.0.smithi002.stdout:1/966: truncate d4/d11/d12/d30/d43/d67/ff0 856539 0 2024-09-17T01:02:06.249 INFO:tasks.workunit.client.1.smithi099.stdout:9/876: mkdir da/d18/db3/d11c 0 2024-09-17T01:02:06.250 INFO:tasks.workunit.client.1.smithi099.stdout:8/963: getdents d0/d41/d5a 0 2024-09-17T01:02:06.250 INFO:tasks.workunit.client.1.smithi099.stdout:6/882: rmdir dc/d5d/dae/d96 39 2024-09-17T01:02:06.250 INFO:tasks.workunit.client.1.smithi099.stdout:9/877: creat da/d21/d2a/f11d x:0 0 0 2024-09-17T01:02:06.250 INFO:tasks.workunit.client.0.smithi002.stdout:1/967: mkdir d4/d11/d1a/d14f 0 2024-09-17T01:02:06.250 INFO:tasks.workunit.client.0.smithi002.stdout:7/983: dwrite d1/d14/d1d/d28/d6b/d9e/d54/fbe [0,4194304] 0 2024-09-17T01:02:06.251 INFO:tasks.workunit.client.1.smithi099.stdout:4/866: getdents d7/dd/d21/d7b 0 2024-09-17T01:02:06.251 INFO:tasks.workunit.client.0.smithi002.stdout:1/968: mknod d4/d11/d1a/d14f/c150 0 2024-09-17T01:02:06.253 INFO:tasks.workunit.client.1.smithi099.stdout:8/964: mkdir d0/d1f/d90/db8/dde/d29/d4b/df2/d129/dcf/d13a 0 2024-09-17T01:02:06.255 INFO:tasks.workunit.client.0.smithi002.stdout:1/969: symlink d4/d11/d1a/daa/l151 0 2024-09-17T01:02:06.255 INFO:tasks.workunit.client.0.smithi002.stdout:1/970: chown d4/d11/d1c/c123 129570335 1 2024-09-17T01:02:06.255 INFO:tasks.workunit.client.1.smithi099.stdout:6/883: creat dc/d5d/d66/dbb/d10c/d74/f12d x:0 0 0 2024-09-17T01:02:06.255 INFO:tasks.workunit.client.0.smithi002.stdout:7/984: getdents d1/dac 0 2024-09-17T01:02:06.256 INFO:tasks.workunit.client.1.smithi099.stdout:9/878: rename da/d14/d40/l6a to da/d14/d48/d69/d6c/l11e 0 2024-09-17T01:02:06.257 INFO:tasks.workunit.client.1.smithi099.stdout:3/986: dwrite d9/d2b/d6b/de7/d134/d44/f48 [4194304,4194304] 0 2024-09-17T01:02:06.257 INFO:tasks.workunit.client.1.smithi099.stdout:4/867: getdents d7/dd/de 0 2024-09-17T01:02:06.260 INFO:tasks.workunit.client.1.smithi099.stdout:6/884: creat dc/d5d/f12e x:0 0 0 2024-09-17T01:02:06.264 INFO:tasks.workunit.client.0.smithi002.stdout:1/971: dread d4/d11/d12/d14/d17/d3b/f62 [0,4194304] 0 2024-09-17T01:02:06.265 INFO:tasks.workunit.client.0.smithi002.stdout:6/947: read d2/d1d/d2d/d35/d79/da8/f69 [1330289,100294] 0 2024-09-17T01:02:06.265 INFO:tasks.workunit.client.0.smithi002.stdout:7/985: read d1/d14/d1d/d28/d86/f13e [719910,65935] 0 2024-09-17T01:02:06.266 INFO:tasks.workunit.client.1.smithi099.stdout:3/987: symlink d9/d15/d18/d1a/d23/d5c/d99/l145 0 2024-09-17T01:02:06.268 INFO:tasks.workunit.client.1.smithi099.stdout:4/868: creat d7/dd/d21/d26/f124 x:0 0 0 2024-09-17T01:02:06.269 INFO:tasks.workunit.client.1.smithi099.stdout:6/885: rename dc/d27/dd7/d87/fb5 to dc/d1a/d49/f12f 0 2024-09-17T01:02:06.272 INFO:tasks.workunit.client.1.smithi099.stdout:6/886: mknod dc/d5d/dae/d96/c130 0 2024-09-17T01:02:06.272 INFO:tasks.workunit.client.0.smithi002.stdout:1/972: dread d4/d11/d1c/fe0 [0,4194304] 0 2024-09-17T01:02:06.274 INFO:tasks.workunit.client.1.smithi099.stdout:6/887: mkdir dc/d27/dd7/d87/d131 0 2024-09-17T01:02:06.275 INFO:tasks.workunit.client.0.smithi002.stdout:1/973: mkdir d4/d11/d12/d14/d17/d20/de9/d152 0 2024-09-17T01:02:06.276 INFO:tasks.workunit.client.1.smithi099.stdout:8/965: dwrite d0/d1f/d90/db8/dde/d29/d4b/df2/d129/f12d [0,4194304] 0 2024-09-17T01:02:06.280 INFO:tasks.workunit.client.1.smithi099.stdout:3/988: dread d9/d2b/d6b/de7/d134/d44/f48 [0,4194304] 0 2024-09-17T01:02:06.280 INFO:tasks.workunit.client.0.smithi002.stdout:6/948: write d2/d1d/d27/d30/f36 [123825,68643] 0 2024-09-17T01:02:06.280 INFO:tasks.workunit.client.0.smithi002.stdout:7/986: dread d1/d14/d1d/d28/d40/f7b [0,4194304] 0 2024-09-17T01:02:06.281 INFO:tasks.workunit.client.0.smithi002.stdout:6/949: write d2/d1d/d27/d30/f36 [3604418,66921] 0 2024-09-17T01:02:06.281 INFO:tasks.workunit.client.0.smithi002.stdout:6/950: write d2/d1d/d27/d30/ff6 [506217,90487] 0 2024-09-17T01:02:06.281 INFO:tasks.workunit.client.0.smithi002.stdout:6/951: chown d2/d1d/d27/d30/lb4 2 1 2024-09-17T01:02:06.281 INFO:tasks.workunit.client.1.smithi099.stdout:9/879: rmdir da/d14/d40 39 2024-09-17T01:02:06.281 INFO:tasks.workunit.client.1.smithi099.stdout:9/880: readlink da/d21/d2a/l31 0 2024-09-17T01:02:06.283 INFO:tasks.workunit.client.1.smithi099.stdout:3/989: creat d9/d15/d18/d1a/d23/d5c/d99/dda/db5/f146 x:0 0 0 2024-09-17T01:02:06.284 INFO:tasks.workunit.client.0.smithi002.stdout:7/987: creat d1/d14/d1d/d28/f145 x:0 0 0 2024-09-17T01:02:06.287 INFO:tasks.workunit.client.1.smithi099.stdout:6/888: dread dc/d27/dd7/dde/ddf/f88 [4194304,4194304] 0 2024-09-17T01:02:06.287 INFO:tasks.workunit.client.1.smithi099.stdout:6/889: read dc/d27/dd7/d87/fb9 [1676464,32253] 0 2024-09-17T01:02:06.288 INFO:tasks.workunit.client.1.smithi099.stdout:7/817: sync 2024-09-17T01:02:06.288 INFO:tasks.workunit.client.1.smithi099.stdout:7/818: creat d1/d2c/d47/d48/d60/fff x:0 0 0 2024-09-17T01:02:06.292 INFO:tasks.workunit.client.1.smithi099.stdout:4/869: dwrite d7/dd/d21/f38 [4194304,4194304] 0 2024-09-17T01:02:06.293 INFO:tasks.workunit.client.1.smithi099.stdout:8/966: read d0/d1f/d90/fb7 [3429266,64006] 0 2024-09-17T01:02:06.293 INFO:tasks.workunit.client.1.smithi099.stdout:8/967: chown d0/c22 21841196 1 2024-09-17T01:02:06.297 INFO:tasks.workunit.client.1.smithi099.stdout:3/990: dread d9/d15/d18/d1a/d23/d5c/d6e/d7e/fd4 [0,4194304] 0 2024-09-17T01:02:06.297 INFO:tasks.workunit.client.0.smithi002.stdout:1/974: dwrite d4/d11/d12/d14/d17/d51/fbd [0,4194304] 0 2024-09-17T01:02:06.299 INFO:tasks.workunit.client.0.smithi002.stdout:6/952: fsync d2/d1d/d27/d30/f36 0 2024-09-17T01:02:06.299 INFO:tasks.workunit.client.0.smithi002.stdout:6/953: chown d2/d1d/d26/cae 5229790 1 2024-09-17T01:02:06.299 INFO:tasks.workunit.client.0.smithi002.stdout:1/975: rename d4/d11/d12/d14/d17/ddb/c104 to d4/d11/d12/d23/c153 0 2024-09-17T01:02:06.301 INFO:tasks.workunit.client.0.smithi002.stdout:6/954: symlink d2/d1d/d2d/d35/d37/l143 0 2024-09-17T01:02:06.303 INFO:tasks.workunit.client.0.smithi002.stdout:1/976: unlink d4/d11/d55/fb2 0 2024-09-17T01:02:06.303 INFO:tasks.workunit.client.0.smithi002.stdout:6/955: dread d2/d1d/d27/d30/f77 [0,4194304] 0 2024-09-17T01:02:06.303 INFO:tasks.workunit.client.0.smithi002.stdout:6/956: chown d2/d1d/d2d/f13d 143706623 1 2024-09-17T01:02:06.304 INFO:tasks.workunit.client.1.smithi099.stdout:5/928: sync 2024-09-17T01:02:06.304 INFO:tasks.workunit.client.1.smithi099.stdout:5/929: write d2/dc/d17/f70 [1341807,81674] 0 2024-09-17T01:02:06.304 INFO:tasks.workunit.client.1.smithi099.stdout:0/930: sync 2024-09-17T01:02:06.304 INFO:tasks.workunit.client.1.smithi099.stdout:0/931: stat da/d3b/f110 0 2024-09-17T01:02:06.305 INFO:tasks.workunit.client.0.smithi002.stdout:6/957: mknod d2/d1d/d26/d49/d51/c144 0 2024-09-17T01:02:06.306 INFO:tasks.workunit.client.0.smithi002.stdout:6/958: symlink d2/d1d/d26/d49/d7d/d8c/l145 0 2024-09-17T01:02:06.307 INFO:tasks.workunit.client.1.smithi099.stdout:3/991: creat d9/d15/d8f/d97/f147 x:0 0 0 2024-09-17T01:02:06.307 INFO:tasks.workunit.client.1.smithi099.stdout:3/992: stat d9/d15/d18/d1a/d23/d5c/d99/dda/db5 0 2024-09-17T01:02:06.307 INFO:tasks.workunit.client.1.smithi099.stdout:3/993: creat d9/d15/d18/d1a/d23/d5c/d99/dda/f148 x:0 0 0 2024-09-17T01:02:06.307 INFO:tasks.workunit.client.1.smithi099.stdout:3/994: readlink d9/d15/d7d/lf0 0 2024-09-17T01:02:06.307 INFO:tasks.workunit.client.1.smithi099.stdout:3/995: creat d9/d15/d18/d1a/d23/d5c/d99/dda/f149 x:0 0 0 2024-09-17T01:02:06.307 INFO:tasks.workunit.client.0.smithi002.stdout:6/959: symlink d2/dc/dcd/l146 0 2024-09-17T01:02:06.308 INFO:tasks.workunit.client.0.smithi002.stdout:6/960: chown d2/d1d/d27/dfa/c127 83 1 2024-09-17T01:02:06.308 INFO:tasks.workunit.client.0.smithi002.stdout:6/961: mkdir d2/dc/d24/d53/d83/da9/d147 0 2024-09-17T01:02:06.308 INFO:tasks.workunit.client.1.smithi099.stdout:6/890: rename dc/d27/dd7 to dc/d5d/dae/d132 0 2024-09-17T01:02:06.310 INFO:tasks.workunit.client.1.smithi099.stdout:5/930: mknod d2/dc/d14/d36/da6/c136 0 2024-09-17T01:02:06.310 INFO:tasks.workunit.client.1.smithi099.stdout:0/932: symlink da/df/d1a/d56/d72/d11e/l135 0 2024-09-17T01:02:06.313 INFO:tasks.workunit.client.1.smithi099.stdout:6/891: mkdir dc/d5d/dae/d96/dfd/d101/d133 0 2024-09-17T01:02:06.313 INFO:tasks.workunit.client.1.smithi099.stdout:6/892: creat dc/d27/f134 x:0 0 0 2024-09-17T01:02:06.314 INFO:tasks.workunit.client.1.smithi099.stdout:5/931: symlink d2/dc4/d90/da4/d8e/l137 0 2024-09-17T01:02:06.314 INFO:tasks.workunit.client.1.smithi099.stdout:5/932: chown d2/dc4/d90/da4/c71 42479 1 2024-09-17T01:02:06.314 INFO:tasks.workunit.client.1.smithi099.stdout:0/933: creat da/d12/d22/d120/f136 x:0 0 0 2024-09-17T01:02:06.317 INFO:tasks.workunit.client.0.smithi002.stdout:1/977: write d4/d11/d12/d30/d5e/fd0 [186848,23671] 0 2024-09-17T01:02:06.318 INFO:tasks.workunit.client.1.smithi099.stdout:2/746: sync 2024-09-17T01:02:06.320 INFO:tasks.workunit.client.1.smithi099.stdout:6/893: dread dc/d5d/dae/f5a [0,4194304] 0 2024-09-17T01:02:06.320 INFO:tasks.workunit.client.1.smithi099.stdout:6/894: write dc/d2b/d11e/fdd [480560,6425] 0 2024-09-17T01:02:06.324 INFO:tasks.workunit.client.1.smithi099.stdout:2/747: rename d2/d9/d25/d26/d1b/d2c/f36 to d2/d9/d25/d97/ff3 0 2024-09-17T01:02:06.324 INFO:tasks.workunit.client.1.smithi099.stdout:2/748: creat d2/d9/d17/d58/ff4 x:0 0 0 2024-09-17T01:02:06.324 INFO:tasks.workunit.client.1.smithi099.stdout:3/996: dread d9/d15/f34 [4194304,4194304] 0 2024-09-17T01:02:06.326 INFO:tasks.workunit.client.1.smithi099.stdout:6/895: creat dc/d5d/d66/dbb/d126/f135 x:0 0 0 2024-09-17T01:02:06.326 INFO:tasks.workunit.client.0.smithi002.stdout:1/978: dread d4/d11/d1a/d95/f9b [0,4194304] 0 2024-09-17T01:02:06.326 INFO:tasks.workunit.client.0.smithi002.stdout:6/962: dread d2/d1d/d2d/d35/d79/fba [0,4194304] 0 2024-09-17T01:02:06.326 INFO:tasks.workunit.client.0.smithi002.stdout:1/979: write d4/d11/d12/d14/d17/d51/f5d [226063,112552] 0 2024-09-17T01:02:06.327 INFO:tasks.workunit.client.1.smithi099.stdout:7/819: dwrite d1/d2c/fc9 [0,4194304] 0 2024-09-17T01:02:06.328 INFO:tasks.workunit.client.1.smithi099.stdout:5/933: write d2/dc4/d99/ff4 [771168,68404] 0 2024-09-17T01:02:06.329 INFO:tasks.workunit.client.0.smithi002.stdout:7/988: dwrite d1/d14/d1d/d28/d8f/ff2 [0,4194304] 0 2024-09-17T01:02:06.329 INFO:tasks.workunit.client.1.smithi099.stdout:4/870: dwrite d7/dd/d21/f41 [0,4194304] 0 2024-09-17T01:02:06.329 INFO:tasks.workunit.client.1.smithi099.stdout:4/871: chown d7/dd/d21/d26/d3f/d5b/da4/dde 50540935 1 2024-09-17T01:02:06.331 INFO:tasks.workunit.client.1.smithi099.stdout:2/749: rename d2/d9/d17/f93 to d2/ff5 0 2024-09-17T01:02:06.333 INFO:tasks.workunit.client.0.smithi002.stdout:7/989: creat d1/d14/d1d/d28/d111/d120/f146 x:0 0 0 2024-09-17T01:02:06.333 INFO:tasks.workunit.client.0.smithi002.stdout:7/990: dread - d1/d14/d1d/d28/d40/ddd/f129 zero size 2024-09-17T01:02:06.335 INFO:tasks.workunit.client.1.smithi099.stdout:3/997: unlink d9/d15/d18/d1a/d23/d5c/d6e/fce 0 2024-09-17T01:02:06.335 INFO:tasks.workunit.client.1.smithi099.stdout:3/998: chown d9/d15/d18/d1a/d23/f4a 3405 1 2024-09-17T01:02:06.337 INFO:tasks.workunit.client.1.smithi099.stdout:7/820: truncate d1/d2c/d5c/d12/f32 7129318 0 2024-09-17T01:02:06.337 INFO:tasks.workunit.client.1.smithi099.stdout:5/934: creat d2/dc4/d99/dd0/dc3/f138 x:0 0 0 2024-09-17T01:02:06.337 INFO:tasks.workunit.client.1.smithi099.stdout:5/935: creat d2/dc4/dad/f139 x:0 0 0 2024-09-17T01:02:06.340 INFO:tasks.workunit.client.1.smithi099.stdout:3/999: truncate d9/d15/d18/d1a/d23/d5c/d99/dbb/dcb/f9b 1622496 0 2024-09-17T01:02:06.342 INFO:tasks.workunit.client.1.smithi099.stdout:5/936: rmdir d2/d45 39 2024-09-17T01:02:06.342 INFO:tasks.workunit.client.0.smithi002.stdout:6/963: dread d2/d1d/d27/d80/d93/dd5/d5c/f128 [0,4194304] 0 2024-09-17T01:02:06.342 INFO:tasks.workunit.client.0.smithi002.stdout:6/964: chown d2/dc/d24/c58 113668 1 2024-09-17T01:02:06.342 INFO:tasks.workunit.client.0.smithi002.stdout:6/965: readlink d2/dc/d24/d53/l6f 0 2024-09-17T01:02:06.345 INFO:tasks.workunit.client.1.smithi099.stdout:6/896: write dc/d1a/d49/f7f [341497,106520] 0 2024-09-17T01:02:06.346 INFO:tasks.workunit.client.0.smithi002.stdout:6/966: mknod d2/d1d/d2d/d5a/d71/c148 0 2024-09-17T01:02:06.348 INFO:tasks.workunit.client.1.smithi099.stdout:6/897: symlink dc/d1a/d49/l136 0 2024-09-17T01:02:06.348 INFO:tasks.workunit.client.1.smithi099.stdout:6/898: write dc/d2b/d11e/d106/f116 [298294,29509] 0 2024-09-17T01:02:06.348 INFO:tasks.workunit.client.1.smithi099.stdout:6/899: truncate dc/d1a/d49/f62 5104259 0 2024-09-17T01:02:06.348 INFO:tasks.workunit.client.1.smithi099.stdout:6/900: fsync dc/d5d/dae/d132/dde/ddf/fef 0 2024-09-17T01:02:06.349 INFO:tasks.workunit.client.0.smithi002.stdout:6/967: truncate d2/d1d/d2d/d5a/d71/d7e/f86 3576747 0 2024-09-17T01:02:06.351 INFO:tasks.workunit.client.0.smithi002.stdout:6/968: creat d2/d1d/d27/d87/d138/f149 x:0 0 0 2024-09-17T01:02:06.357 INFO:tasks.workunit.client.0.smithi002.stdout:7/991: dread d1/d14/d1d/d28/f6e [0,4194304] 0 2024-09-17T01:02:06.357 INFO:tasks.workunit.client.0.smithi002.stdout:7/992: dread - d1/d14/d1d/fbd zero size 2024-09-17T01:02:06.357 INFO:tasks.workunit.client.0.smithi002.stdout:1/980: dwrite d4/d11/d12/d14/d17/d51/d88/da3/f122 [0,4194304] 0 2024-09-17T01:02:06.357 INFO:tasks.workunit.client.0.smithi002.stdout:1/981: read - d4/d11/d55/dbc/dff/f11e zero size 2024-09-17T01:02:06.358 INFO:tasks.workunit.client.0.smithi002.stdout:7/993: mkdir d1/d14/d1d/d28/d86/d147 0 2024-09-17T01:02:06.359 INFO:tasks.workunit.client.1.smithi099.stdout:4/872: dwrite d7/dd/d21/d26/d3f/f94 [0,4194304] 0 2024-09-17T01:02:06.361 INFO:tasks.workunit.client.1.smithi099.stdout:8/968: dwrite d0/d53/fb9 [0,4194304] 0 2024-09-17T01:02:06.364 INFO:tasks.workunit.client.0.smithi002.stdout:1/982: rename d4/d11/d12/d14/d17/d40/f69 to d4/d11/d12/d14/d17/d20/de9/f154 0 2024-09-17T01:02:06.365 INFO:tasks.workunit.client.1.smithi099.stdout:0/934: dwrite da/df/ff5 [0,4194304] 0 2024-09-17T01:02:06.365 INFO:tasks.workunit.client.1.smithi099.stdout:0/935: write da/df/d1a/d56/d72/fdf [718631,35142] 0 2024-09-17T01:02:06.365 INFO:tasks.workunit.client.1.smithi099.stdout:7/821: dread d1/d2c/d47/d48/d60/f91 [0,4194304] 0 2024-09-17T01:02:06.369 INFO:tasks.workunit.client.1.smithi099.stdout:4/873: dread d7/dd/d21/fe8 [0,4194304] 0 2024-09-17T01:02:06.369 INFO:tasks.workunit.client.1.smithi099.stdout:4/874: creat d7/dd/de/d10/d6b/d82/d8a/d9a/da6/f125 x:0 0 0 2024-09-17T01:02:06.370 INFO:tasks.workunit.client.1.smithi099.stdout:4/875: dread - d7/dd/d21/d26/d3f/d5b/da4/dde/f118 zero size 2024-09-17T01:02:06.370 INFO:tasks.workunit.client.1.smithi099.stdout:8/969: chown d0/d1f/l13 54834 1 2024-09-17T01:02:06.370 INFO:tasks.workunit.client.1.smithi099.stdout:8/970: truncate d0/d1f/fb4 1800855 0 2024-09-17T01:02:06.370 INFO:tasks.workunit.client.1.smithi099.stdout:8/971: write d0/d1f/d90/fb7 [2046724,27317] 0 2024-09-17T01:02:06.371 INFO:tasks.workunit.client.1.smithi099.stdout:8/972: fsync d0/d1f/d90/db8/dde/d29/f2e 0 2024-09-17T01:02:06.376 INFO:tasks.workunit.client.0.smithi002.stdout:7/994: write f0 [177728,9023] 0 2024-09-17T01:02:06.377 INFO:tasks.workunit.client.0.smithi002.stdout:1/983: dread d4/d11/d1a/daa/dbb/ff8 [0,4194304] 0 2024-09-17T01:02:06.377 INFO:tasks.workunit.client.0.smithi002.stdout:1/984: read d4/d11/d12/d14/d17/d3b/f62 [3421992,45332] 0 2024-09-17T01:02:06.378 INFO:tasks.workunit.client.0.smithi002.stdout:1/985: creat d4/d11/d12/d23/d32/de3/d129/f155 x:0 0 0 2024-09-17T01:02:06.378 INFO:tasks.workunit.client.0.smithi002.stdout:1/986: truncate d4/d11/f112 1945443 0 2024-09-17T01:02:06.378 INFO:tasks.workunit.client.1.smithi099.stdout:5/937: dwrite d2/dc/f66 [0,4194304] 0 2024-09-17T01:02:06.378 INFO:tasks.workunit.client.0.smithi002.stdout:7/995: mknod d1/d14/d1d/c148 0 2024-09-17T01:02:06.381 INFO:tasks.workunit.client.1.smithi099.stdout:0/936: mknod da/d12/d22/d66/c137 0 2024-09-17T01:02:06.383 INFO:tasks.workunit.client.1.smithi099.stdout:8/973: write d0/d1f/f68 [1538662,76070] 0 2024-09-17T01:02:06.383 INFO:tasks.workunit.client.1.smithi099.stdout:8/974: readlink d0/d1f/d90/db8/dde/l71 0 2024-09-17T01:02:06.383 INFO:tasks.workunit.client.1.smithi099.stdout:8/975: write d0/f18 [6711510,106269] 0 2024-09-17T01:02:06.384 INFO:tasks.workunit.client.1.smithi099.stdout:4/876: rename d7/dd/d21/d7b/d4b/l23 to d7/dd/d21/d7b/de2/l126 0 2024-09-17T01:02:06.386 INFO:tasks.workunit.client.1.smithi099.stdout:8/976: mkdir d0/d1f/d31/d13b 0 2024-09-17T01:02:06.386 INFO:tasks.workunit.client.1.smithi099.stdout:8/977: creat d0/d53/f13c x:0 0 0 2024-09-17T01:02:06.386 INFO:tasks.workunit.client.1.smithi099.stdout:4/877: stat d7/dd/de/d10/d85/cb6 0 2024-09-17T01:02:06.387 INFO:tasks.workunit.client.1.smithi099.stdout:4/878: write d7/dd/d21/d7b/d4b/fee [207597,129534] 0 2024-09-17T01:02:06.387 INFO:tasks.workunit.client.1.smithi099.stdout:4/879: getdents d7/dd/d21/d7b/d4b/dcb 0 2024-09-17T01:02:06.387 INFO:tasks.workunit.client.1.smithi099.stdout:4/880: chown d7/dd/d21/d26/d3f/fd5 168382948 1 2024-09-17T01:02:06.387 INFO:tasks.workunit.client.1.smithi099.stdout:4/881: write d7/dd/de/d10/d6b/d82/d8a/d9a/da6/fd3 [681291,72670] 0 2024-09-17T01:02:06.387 INFO:tasks.workunit.client.1.smithi099.stdout:2/750: dwrite d2/d9/d17/d83/d8d/dd9/fa6 [0,4194304] 0 2024-09-17T01:02:06.387 INFO:tasks.workunit.client.1.smithi099.stdout:2/751: fdatasync d2/d9/d25/d26/d1b/dad/f3a 0 2024-09-17T01:02:06.388 INFO:tasks.workunit.client.0.smithi002.stdout:7/996: dread d1/d14/d1d/d28/d6b/d9e/d50/d137/dcd/fdc [0,4194304] 0 2024-09-17T01:02:06.390 INFO:tasks.workunit.client.0.smithi002.stdout:7/997: stat d1/d14/d1d/d28/d8f/l101 0 2024-09-17T01:02:06.392 INFO:tasks.workunit.client.0.smithi002.stdout:7/998: rename d1/d14/l47 to d1/d14/d1d/d28/d6b/d9e/d10a/l149 0 2024-09-17T01:02:06.394 INFO:tasks.workunit.client.0.smithi002.stdout:7/999: creat d1/d14/d1d/d28/d40/ddd/f14a x:0 0 0 2024-09-17T01:02:06.395 INFO:tasks.workunit.client.1.smithi099.stdout:8/978: rename d0/d1f/d31/d4c/d8c/f116 to d0/d1f/db5/f13d 0 2024-09-17T01:02:06.400 INFO:tasks.workunit.client.1.smithi099.stdout:4/882: link d7/dd/de/f3c d7/dd/de/f127 0 2024-09-17T01:02:06.400 INFO:tasks.workunit.client.1.smithi099.stdout:4/883: truncate d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/d83/ff1 4652375 0 2024-09-17T01:02:06.401 INFO:tasks.workunit.client.0.smithi002.stdout:6/969: dwrite d2/f13 [4194304,4194304] 0 2024-09-17T01:02:06.402 INFO:tasks.workunit.client.1.smithi099.stdout:7/822: dwrite d1/d2c/d47/d48/fc7 [0,4194304] 0 2024-09-17T01:02:06.421 INFO:tasks.workunit.client.1.smithi099.stdout:0/937: dwrite da/df/d4d/d6f/f116 [0,4194304] 0 2024-09-17T01:02:06.421 INFO:tasks.workunit.client.1.smithi099.stdout:0/938: stat da/df/d1a/d56/d72/d11e 0 2024-09-17T01:02:06.422 INFO:tasks.workunit.client.1.smithi099.stdout:0/939: mknod da/df/d1a/c138 0 2024-09-17T01:02:06.423 INFO:tasks.workunit.client.1.smithi099.stdout:0/940: write da/df/d1a/f5f [151434,87414] 0 2024-09-17T01:02:06.425 INFO:tasks.workunit.client.0.smithi002.stdout:1/987: dwrite d4/d11/d12/d14/f1b [4194304,4194304] 0 2024-09-17T01:02:06.427 INFO:tasks.workunit.client.0.smithi002.stdout:5/946: sync 2024-09-17T01:02:06.427 INFO:tasks.workunit.client.0.smithi002.stdout:2/879: sync 2024-09-17T01:02:06.427 INFO:tasks.workunit.client.0.smithi002.stdout:2/880: fdatasync d1b/d37/d48/d4e/f54 0 2024-09-17T01:02:06.428 INFO:tasks.workunit.client.0.smithi002.stdout:0/822: sync 2024-09-17T01:02:06.428 INFO:tasks.workunit.client.0.smithi002.stdout:9/836: sync 2024-09-17T01:02:06.428 INFO:tasks.workunit.client.0.smithi002.stdout:9/837: creat d5/dc/d26/d5c/d6b/d75/d57/d7a/da2/ffe x:0 0 0 2024-09-17T01:02:06.430 INFO:tasks.workunit.client.1.smithi099.stdout:5/938: dwrite d2/dc/d14/d36/d9a/f121 [0,4194304] 0 2024-09-17T01:02:06.432 INFO:tasks.workunit.client.0.smithi002.stdout:5/947: truncate d2/d2d/f17 509297 0 2024-09-17T01:02:06.432 INFO:tasks.workunit.client.0.smithi002.stdout:5/948: fdatasync d2/d2d/d10/d14/fda 0 2024-09-17T01:02:06.432 INFO:tasks.workunit.client.0.smithi002.stdout:2/881: symlink d1b/d3f/d59/d7f/dc9/d72/dda/l13e 0 2024-09-17T01:02:06.434 INFO:tasks.workunit.client.0.smithi002.stdout:9/838: creat d5/dc/d26/d46/d47/d89/dec/fff x:0 0 0 2024-09-17T01:02:06.435 INFO:tasks.workunit.client.1.smithi099.stdout:5/939: mknod d2/dc4/d99/dd0/c13a 0 2024-09-17T01:02:06.436 INFO:tasks.workunit.client.0.smithi002.stdout:0/823: dread dd/f36 [0,4194304] 0 2024-09-17T01:02:06.437 INFO:tasks.workunit.client.1.smithi099.stdout:5/940: rmdir d2/d45/dc5 39 2024-09-17T01:02:06.437 INFO:tasks.workunit.client.0.smithi002.stdout:9/839: rename d5/dc/d26/d46/c80 to d5/dc/d26/d46/d47/da1/de7/c100 0 2024-09-17T01:02:06.437 INFO:tasks.workunit.client.0.smithi002.stdout:9/840: fsync d5/dc/d26/d5c/f7b 0 2024-09-17T01:02:06.437 INFO:tasks.workunit.client.0.smithi002.stdout:9/841: chown d5/dc/d26/d46/f50 33 1 2024-09-17T01:02:06.437 INFO:tasks.workunit.client.0.smithi002.stdout:9/842: chown d5/dc/d26/d46/lf8 8365688 1 2024-09-17T01:02:06.437 INFO:tasks.workunit.client.0.smithi002.stdout:6/970: dwrite d2/d1d/d26/d49/f72 [0,4194304] 0 2024-09-17T01:02:06.438 INFO:tasks.workunit.client.1.smithi099.stdout:5/941: mkdir d2/d26/d13b 0 2024-09-17T01:02:06.440 INFO:tasks.workunit.client.0.smithi002.stdout:9/843: getdents d5/dc/d26/d46/db4 0 2024-09-17T01:02:06.441 INFO:tasks.workunit.client.0.smithi002.stdout:6/971: dread d2/d1d/d27/d30/ff6 [0,4194304] 0 2024-09-17T01:02:06.441 INFO:tasks.workunit.client.1.smithi099.stdout:2/752: dwrite d2/d9/d25/d26/d1b/d2c/f3d [0,4194304] 0 2024-09-17T01:02:06.443 INFO:tasks.workunit.client.0.smithi002.stdout:0/824: rename f1 to dd/d19/d1a/d29/d55/d61/f118 0 2024-09-17T01:02:06.444 INFO:tasks.workunit.client.0.smithi002.stdout:0/825: fsync dd/f5a 0 2024-09-17T01:02:06.444 INFO:tasks.workunit.client.1.smithi099.stdout:2/753: creat d2/d9/d25/d26/d1b/d61/ff6 x:0 0 0 2024-09-17T01:02:06.444 INFO:tasks.workunit.client.1.smithi099.stdout:2/754: chown d2/d9/d25/d26/d1b/d2c 34253 1 2024-09-17T01:02:06.445 INFO:tasks.workunit.client.0.smithi002.stdout:9/844: rmdir d5/dc/d26/d46/d47/da1/dab 0 2024-09-17T01:02:06.445 INFO:tasks.workunit.client.0.smithi002.stdout:9/845: write d5/dc/d26/d63/d66/dd7/ff5 [583014,26961] 0 2024-09-17T01:02:06.445 INFO:tasks.workunit.client.0.smithi002.stdout:9/846: fdatasync d5/dc/d26/d46/d47/da1/fc7 0 2024-09-17T01:02:06.445 INFO:tasks.workunit.client.0.smithi002.stdout:9/847: creat d5/dc/d26/d63/d66/f101 x:0 0 0 2024-09-17T01:02:06.446 INFO:tasks.workunit.client.1.smithi099.stdout:8/979: dwrite d0/d53/fab [0,4194304] 0 2024-09-17T01:02:06.447 INFO:tasks.workunit.client.1.smithi099.stdout:8/980: write d0/d1f/d90/db8/dde/d29/d4b/df2/d129/dcf/f118 [338201,102197] 0 2024-09-17T01:02:06.447 INFO:tasks.workunit.client.0.smithi002.stdout:6/972: creat d2/d1d/d2d/d35/d37/d12f/f14a x:0 0 0 2024-09-17T01:02:06.447 INFO:tasks.workunit.client.0.smithi002.stdout:6/973: write d2/d1d/d27/d80/d93/dd5/d5c/dc9/fc7 [4767735,84304] 0 2024-09-17T01:02:06.447 INFO:tasks.workunit.client.0.smithi002.stdout:6/974: write d2/d1d/d27/d30/fdf [4945110,92405] 0 2024-09-17T01:02:06.447 INFO:tasks.workunit.client.0.smithi002.stdout:6/975: chown d2/d1d/d27/d80/d93/dd5/d5c/f128 900337 1 2024-09-17T01:02:06.448 INFO:tasks.workunit.client.1.smithi099.stdout:8/981: mkdir d0/d53/de0/d13e 0 2024-09-17T01:02:06.448 INFO:tasks.workunit.client.0.smithi002.stdout:0/826: creat dd/d19/d1c/db7/f119 x:0 0 0 2024-09-17T01:02:06.450 INFO:tasks.workunit.client.0.smithi002.stdout:2/882: dread d1b/d3f/d59/d7f/dc9/fa6 [0,4194304] 0 2024-09-17T01:02:06.451 INFO:tasks.workunit.client.1.smithi099.stdout:7/823: dwrite d1/d2c/d5c/d12/f32 [0,4194304] 0 2024-09-17T01:02:06.451 INFO:tasks.workunit.client.1.smithi099.stdout:4/884: dwrite d7/dd/d21/d7b/fcc [0,4194304] 0 2024-09-17T01:02:06.451 INFO:tasks.workunit.client.1.smithi099.stdout:4/885: chown d7/dd/d21/d7b/d74/f75 97755519 1 2024-09-17T01:02:06.451 INFO:tasks.workunit.client.1.smithi099.stdout:4/886: truncate d7/dd/d21/d7b/d74/f111 4292921 0 2024-09-17T01:02:06.451 INFO:tasks.workunit.client.0.smithi002.stdout:9/848: rmdir d5/dc/d26/d5c/d6b/d75/d57/d8d/dd6 0 2024-09-17T01:02:06.451 INFO:tasks.workunit.client.0.smithi002.stdout:9/849: chown d5 9 1 2024-09-17T01:02:06.451 INFO:tasks.workunit.client.0.smithi002.stdout:1/988: dwrite d4/d11/d1c/fe0 [0,4194304] 0 2024-09-17T01:02:06.452 INFO:tasks.workunit.client.1.smithi099.stdout:7/824: symlink d1/d37/d4f/l100 0 2024-09-17T01:02:06.452 INFO:tasks.workunit.client.0.smithi002.stdout:3/881: sync 2024-09-17T01:02:06.452 INFO:tasks.workunit.client.0.smithi002.stdout:3/882: chown d0 32652708 1 2024-09-17T01:02:06.452 INFO:tasks.workunit.client.0.smithi002.stdout:3/883: creat d0/d31/f117 x:0 0 0 2024-09-17T01:02:06.453 INFO:tasks.workunit.client.1.smithi099.stdout:4/887: chown d7/dd/de/d10/d6b/l93 770637 1 2024-09-17T01:02:06.454 INFO:tasks.workunit.client.1.smithi099.stdout:4/888: dread d7/dd/d21/d26/d3f/fd5 [0,4194304] 0 2024-09-17T01:02:06.454 INFO:tasks.workunit.client.1.smithi099.stdout:7/825: mknod d1/d2c/c101 0 2024-09-17T01:02:06.454 INFO:tasks.workunit.client.1.smithi099.stdout:7/826: rename d1/d37 to d1/d37/d102 22 2024-09-17T01:02:06.454 INFO:tasks.workunit.client.1.smithi099.stdout:7/827: chown d1/d2c/d5c/d1c/d5a/d6f/l87 2134177 1 2024-09-17T01:02:06.454 INFO:tasks.workunit.client.1.smithi099.stdout:7/828: fsync d1/d37/f56 0 2024-09-17T01:02:06.455 INFO:tasks.workunit.client.1.smithi099.stdout:7/829: mknod d1/d2c/d47/d48/d60/c103 0 2024-09-17T01:02:06.456 INFO:tasks.workunit.client.1.smithi099.stdout:7/830: chown d1/d37/d4f/faf 869 1 2024-09-17T01:02:06.457 INFO:tasks.workunit.client.0.smithi002.stdout:0/827: unlink dd/d19/d1a/f92 0 2024-09-17T01:02:06.457 INFO:tasks.workunit.client.0.smithi002.stdout:0/828: chown dd/f32 182126133 1 2024-09-17T01:02:06.457 INFO:tasks.workunit.client.0.smithi002.stdout:0/829: dread - dd/d19/da9/de5/d68/fc9 zero size 2024-09-17T01:02:06.457 INFO:tasks.workunit.client.0.smithi002.stdout:2/883: truncate d1b/d37/d48/d4e/dc5/ff7 4047765 0 2024-09-17T01:02:06.457 INFO:tasks.workunit.client.0.smithi002.stdout:2/884: dread - d1b/d3f/d59/d7f/dc9/dac/ff8 zero size 2024-09-17T01:02:06.457 INFO:tasks.workunit.client.0.smithi002.stdout:2/885: readlink d1b/d1d/l36 0 2024-09-17T01:02:06.458 INFO:tasks.workunit.client.1.smithi099.stdout:7/831: mkdir d1/d36/d8d/d104 0 2024-09-17T01:02:06.459 INFO:tasks.workunit.client.1.smithi099.stdout:7/832: creat d1/d2c/d5c/d3f/f105 x:0 0 0 2024-09-17T01:02:06.459 INFO:tasks.workunit.client.0.smithi002.stdout:1/989: creat d4/d22/d8d/de8/f156 x:0 0 0 2024-09-17T01:02:06.459 INFO:tasks.workunit.client.0.smithi002.stdout:5/949: dwrite d2/de/ff3 [0,4194304] 0 2024-09-17T01:02:06.461 INFO:tasks.workunit.client.0.smithi002.stdout:3/884: mkdir d0/d3/d37/dac/da1/d118 0 2024-09-17T01:02:06.461 INFO:tasks.workunit.client.0.smithi002.stdout:3/885: read d0/d3/d33/d40/f45 [1606080,66388] 0 2024-09-17T01:02:06.462 INFO:tasks.workunit.client.0.smithi002.stdout:2/886: truncate d1b/d37/f60 45010 0 2024-09-17T01:02:06.463 INFO:tasks.workunit.client.1.smithi099.stdout:8/982: dread d0/d1f/d90/db8/dde/d29/d4b/df2/d129/f8d [0,4194304] 0 2024-09-17T01:02:06.463 INFO:tasks.workunit.client.1.smithi099.stdout:7/833: symlink d1/d2c/d5c/d1c/d5a/db3/dcd/l106 0 2024-09-17T01:02:06.463 INFO:tasks.workunit.client.1.smithi099.stdout:7/834: chown d1/d2c/d5c/c3c 7157298 1 2024-09-17T01:02:06.465 INFO:tasks.workunit.client.0.smithi002.stdout:5/950: truncate d2/d2d/d10/d14/d19/d39/d64/fb8 390965 0 2024-09-17T01:02:06.465 INFO:tasks.workunit.client.0.smithi002.stdout:5/951: truncate d2/d2d/d10/d14/d19/d39/d48/d120/f102 653304 0 2024-09-17T01:02:06.465 INFO:tasks.workunit.client.0.smithi002.stdout:5/952: write d2/d2d/d10/d14/d19/d39/d48/def/f81 [117642,128460] 0 2024-09-17T01:02:06.466 INFO:tasks.workunit.client.0.smithi002.stdout:6/976: dread d2/f16 [0,4194304] 0 2024-09-17T01:02:06.468 INFO:tasks.workunit.client.0.smithi002.stdout:3/886: creat d0/d3/d33/d4f/f119 x:0 0 0 2024-09-17T01:02:06.470 INFO:tasks.workunit.client.0.smithi002.stdout:2/887: mknod d1b/d37/d48/d78/c13f 0 2024-09-17T01:02:06.470 INFO:tasks.workunit.client.0.smithi002.stdout:2/888: read d1b/d37/d48/d4e/f69 [1881335,57081] 0 2024-09-17T01:02:06.472 INFO:tasks.workunit.client.0.smithi002.stdout:5/953: truncate d2/d2d/d10/d23/d6a/fc6 2058522 0 2024-09-17T01:02:06.473 INFO:tasks.workunit.client.0.smithi002.stdout:6/977: stat d2/d1d/d27/lc2 0 2024-09-17T01:02:06.476 INFO:tasks.workunit.client.0.smithi002.stdout:3/887: mkdir d0/d3/d37/dac/d11a 0 2024-09-17T01:02:06.476 INFO:tasks.workunit.client.0.smithi002.stdout:2/889: truncate d1b/f5f 207699 0 2024-09-17T01:02:06.477 INFO:tasks.workunit.client.0.smithi002.stdout:9/850: rmdir d5/dc/d26/d63/d66 39 2024-09-17T01:02:06.477 INFO:tasks.workunit.client.0.smithi002.stdout:0/830: dread dd/d19/d1c/d1f/dc4/ff4 [0,4194304] 0 2024-09-17T01:02:06.483 INFO:tasks.workunit.client.0.smithi002.stdout:5/954: unlink d2/d2d/d10/d14/d19/d39/d43/f16 0 2024-09-17T01:02:06.483 INFO:tasks.workunit.client.0.smithi002.stdout:5/955: truncate d2/d2d/d10/d14/d19/d39/d48/def/dfa/fff 1223754 0 2024-09-17T01:02:06.483 INFO:tasks.workunit.client.0.smithi002.stdout:5/956: write d2/d2d/d10/d23/d6e/fc1 [775951,119800] 0 2024-09-17T01:02:06.486 INFO:tasks.workunit.client.0.smithi002.stdout:3/888: truncate d0/d3/d33/d4a/f78 804608 0 2024-09-17T01:02:06.489 INFO:tasks.workunit.client.0.smithi002.stdout:2/890: symlink d1b/d1d/dc8/l140 0 2024-09-17T01:02:06.489 INFO:tasks.workunit.client.0.smithi002.stdout:2/891: chown d1b/d8a/d92/f96 3734 1 2024-09-17T01:02:06.490 INFO:tasks.workunit.client.0.smithi002.stdout:0/831: mknod dd/d19/c11a 0 2024-09-17T01:02:06.491 INFO:tasks.workunit.client.0.smithi002.stdout:2/892: dread d1b/d8a/d92/f96 [0,4194304] 0 2024-09-17T01:02:06.492 INFO:tasks.workunit.client.1.smithi099.stdout:5/942: dwrite d2/dc/d14/f4f [0,4194304] 0 2024-09-17T01:02:06.492 INFO:tasks.workunit.client.1.smithi099.stdout:5/943: stat d2/dc/d17/d3c/da8/fc7 0 2024-09-17T01:02:06.493 INFO:tasks.workunit.client.1.smithi099.stdout:5/944: creat d2/dc/d17/d3c/d72/f13c x:0 0 0 2024-09-17T01:02:06.493 INFO:tasks.workunit.client.1.smithi099.stdout:5/945: write d2/dc4/d99/dd0/dc3/dfc/f133 [730504,124859] 0 2024-09-17T01:02:06.493 INFO:tasks.workunit.client.1.smithi099.stdout:5/946: creat d2/dc/d17/d3c/dc6/dfb/f13d x:0 0 0 2024-09-17T01:02:06.493 INFO:tasks.workunit.client.1.smithi099.stdout:5/947: readlink d2/l2c 0 2024-09-17T01:02:06.493 INFO:tasks.workunit.client.0.smithi002.stdout:5/957: mknod d2/d2d/d10/d14/d19/d39/d48/d9d/c12e 0 2024-09-17T01:02:06.494 INFO:tasks.workunit.client.0.smithi002.stdout:6/978: rmdir d2/d1d/d2d/d35/d6d 39 2024-09-17T01:02:06.496 INFO:tasks.workunit.client.0.smithi002.stdout:3/889: creat d0/d3/d33/f11b x:0 0 0 2024-09-17T01:02:06.496 INFO:tasks.workunit.client.0.smithi002.stdout:3/890: truncate d0/d31/da7/f105 374359 0 2024-09-17T01:02:06.500 INFO:tasks.workunit.client.0.smithi002.stdout:0/832: creat dd/d19/d1c/f11b x:0 0 0 2024-09-17T01:02:06.503 INFO:tasks.workunit.client.0.smithi002.stdout:5/958: rename d2/l50 to d2/de/d57/d123/l12f 0 2024-09-17T01:02:06.503 INFO:tasks.workunit.client.0.smithi002.stdout:5/959: fsync d2/d2d/d10/d23/d6e/ff7 0 2024-09-17T01:02:06.504 INFO:tasks.workunit.client.0.smithi002.stdout:5/960: fdatasync d2/d2d/d10/d14/d19/d39/d48/d120/f8e 0 2024-09-17T01:02:06.506 INFO:tasks.workunit.client.0.smithi002.stdout:6/979: mknod d2/d1d/d2d/d35/d37/c14b 0 2024-09-17T01:02:06.506 INFO:tasks.workunit.client.0.smithi002.stdout:6/980: chown d2/d1d/d27/d30/lb4 86 1 2024-09-17T01:02:06.506 INFO:tasks.workunit.client.0.smithi002.stdout:6/981: fsync d2/d1d/f3d 0 2024-09-17T01:02:06.506 INFO:tasks.workunit.client.0.smithi002.stdout:2/893: dread f19 [4194304,4194304] 0 2024-09-17T01:02:06.507 INFO:tasks.workunit.client.0.smithi002.stdout:2/894: chown d1b/d37/d48/d52/db5 502089632 1 2024-09-17T01:02:06.507 INFO:tasks.workunit.client.1.smithi099.stdout:2/755: dwrite d2/d9/d25/d26/d1b/d2c/f77 [0,4194304] 0 2024-09-17T01:02:06.508 INFO:tasks.workunit.client.0.smithi002.stdout:3/891: creat d0/d31/d32/dcb/f11c x:0 0 0 2024-09-17T01:02:06.512 INFO:tasks.workunit.client.0.smithi002.stdout:0/833: link dd/d19/da9/fcd dd/d19/d1a/d29/f11c 0 2024-09-17T01:02:06.513 INFO:tasks.workunit.client.0.smithi002.stdout:6/982: truncate d2/d1d/d2d/d35/d79/fba 3559876 0 2024-09-17T01:02:06.513 INFO:tasks.workunit.client.0.smithi002.stdout:6/983: dread - d2/d1d/d2d/d35/d6d/f10c zero size 2024-09-17T01:02:06.514 INFO:tasks.workunit.client.0.smithi002.stdout:5/961: dread d2/d2d/d10/d14/d19/d39/d25/fe6 [0,4194304] 0 2024-09-17T01:02:06.515 INFO:tasks.workunit.client.0.smithi002.stdout:3/892: unlink d0/d3/l7 0 2024-09-17T01:02:06.516 INFO:tasks.workunit.client.0.smithi002.stdout:6/984: mknod d2/d1d/d2d/d35/d6d/d106/c14c 0 2024-09-17T01:02:06.517 INFO:tasks.workunit.client.0.smithi002.stdout:5/962: symlink d2/d2d/d10/d14/d19/d39/d48/d120/l130 0 2024-09-17T01:02:06.517 INFO:tasks.workunit.client.0.smithi002.stdout:5/963: creat d2/de/f131 x:0 0 0 2024-09-17T01:02:06.517 INFO:tasks.workunit.client.0.smithi002.stdout:5/964: getdents d2/d2d/d10/d20/d115/d124 0 2024-09-17T01:02:06.518 INFO:tasks.workunit.client.0.smithi002.stdout:3/893: creat d0/d3/d33/d4a/f11d x:0 0 0 2024-09-17T01:02:06.519 INFO:tasks.workunit.client.1.smithi099.stdout:4/889: dwrite d7/dd/de/f62 [0,4194304] 0 2024-09-17T01:02:06.520 INFO:tasks.workunit.client.0.smithi002.stdout:6/985: unlink d2/d1d/d2d/d35/dc1/f12c 0 2024-09-17T01:02:06.521 INFO:tasks.workunit.client.1.smithi099.stdout:8/983: dwrite d0/d1f/db5/fd2 [4194304,4194304] 0 2024-09-17T01:02:06.521 INFO:tasks.workunit.client.1.smithi099.stdout:8/984: chown d0/d1f/d90/c138 132 1 2024-09-17T01:02:06.522 INFO:tasks.workunit.client.1.smithi099.stdout:5/948: dwrite d2/f40 [0,4194304] 0 2024-09-17T01:02:06.524 INFO:tasks.workunit.client.1.smithi099.stdout:8/985: truncate d0/d1f/d90/db8/dde/d29/d4b/df2/d129/f93 1108816 0 2024-09-17T01:02:06.525 INFO:tasks.workunit.client.0.smithi002.stdout:1/990: dwrite d4/d11/d12/d23/d32/de3/d129/f145 [0,4194304] 0 2024-09-17T01:02:06.525 INFO:tasks.workunit.client.0.smithi002.stdout:0/834: write dd/d19/da9/de5/db9/fd2 [827750,81131] 0 2024-09-17T01:02:06.525 INFO:tasks.workunit.client.0.smithi002.stdout:5/965: rename d2/d2d/d10/d95/d96/ffb to d2/d2d/d10/d14/d19/da5/f132 0 2024-09-17T01:02:06.525 INFO:tasks.workunit.client.0.smithi002.stdout:2/895: dwrite d1b/d3f/d59/d7f/dc9/d72/dda/f128 [0,4194304] 0 2024-09-17T01:02:06.526 INFO:tasks.workunit.client.0.smithi002.stdout:3/894: truncate d0/d3/d17/d9a/f89 4180917 0 2024-09-17T01:02:06.528 INFO:tasks.workunit.client.0.smithi002.stdout:6/986: mknod d2/dc/d24/d53/d83/da9/d4c/c14d 0 2024-09-17T01:02:06.529 INFO:tasks.workunit.client.0.smithi002.stdout:6/987: write d2/d1d/d2d/d35/d79/da8/f69 [2035810,122570] 0 2024-09-17T01:02:06.529 INFO:tasks.workunit.client.1.smithi099.stdout:4/890: read d7/d35/f78 [489171,52270] 0 2024-09-17T01:02:06.529 INFO:tasks.workunit.client.1.smithi099.stdout:4/891: chown d7/dd/d21/d26/d3f/d5b/f2c 11 1 2024-09-17T01:02:06.529 INFO:tasks.workunit.client.1.smithi099.stdout:5/949: symlink d2/dc/d14/d36/d9a/d12c/l13e 0 2024-09-17T01:02:06.530 INFO:tasks.workunit.client.1.smithi099.stdout:8/986: symlink d0/d53/de0/d124/l13f 0 2024-09-17T01:02:06.531 INFO:tasks.workunit.client.1.smithi099.stdout:4/892: rmdir d7/d35/d98 39 2024-09-17T01:02:06.533 INFO:tasks.workunit.client.0.smithi002.stdout:1/991: rmdir d4/d11/d12/d14/d17/d51/d88/da3/d131 39 2024-09-17T01:02:06.533 INFO:tasks.workunit.client.0.smithi002.stdout:1/992: write d4/d11/d1a/d95/f9b [2339569,21921] 0 2024-09-17T01:02:06.533 INFO:tasks.workunit.client.0.smithi002.stdout:1/993: dread - d4/d11/d12/d14/d17/d40/f10e zero size 2024-09-17T01:02:06.534 INFO:tasks.workunit.client.1.smithi099.stdout:8/987: symlink d0/d1f/d31/d13b/l140 0 2024-09-17T01:02:06.534 INFO:tasks.workunit.client.1.smithi099.stdout:8/988: stat d0/d1f/d90/db8 0 2024-09-17T01:02:06.535 INFO:tasks.workunit.client.0.smithi002.stdout:0/835: mkdir dd/d19/da9/de5/d68/d9d/dbe/d113/d11d 0 2024-09-17T01:02:06.535 INFO:tasks.workunit.client.0.smithi002.stdout:0/836: creat dd/d19/d1a/d29/d55/d56/f11e x:0 0 0 2024-09-17T01:02:06.536 INFO:tasks.workunit.client.1.smithi099.stdout:5/950: rmdir d2/dc/d17/d3c/da8 39 2024-09-17T01:02:06.538 INFO:tasks.workunit.client.0.smithi002.stdout:1/994: dread d4/ff [4194304,4194304] 0 2024-09-17T01:02:06.539 INFO:tasks.workunit.client.0.smithi002.stdout:5/966: mkdir d2/d2d/d10/d14/d19/d39/d51/d133 0 2024-09-17T01:02:06.539 INFO:tasks.workunit.client.1.smithi099.stdout:5/951: mknod d2/dc/d14/d36/d9a/c13f 0 2024-09-17T01:02:06.539 INFO:tasks.workunit.client.1.smithi099.stdout:5/952: write d2/dc/d97/fe1 [4021525,9422] 0 2024-09-17T01:02:06.539 INFO:tasks.workunit.client.1.smithi099.stdout:5/953: fdatasync d2/dc/d17/d3c/db3/fbd 0 2024-09-17T01:02:06.544 INFO:tasks.workunit.client.0.smithi002.stdout:2/896: creat d1b/d74/d93/d94/de2/f141 x:0 0 0 2024-09-17T01:02:06.546 INFO:tasks.workunit.client.0.smithi002.stdout:3/895: creat d0/d3/d37/dac/da1/de4/f11e x:0 0 0 2024-09-17T01:02:06.548 INFO:tasks.workunit.client.0.smithi002.stdout:6/988: mknod d2/d1d/d27/d87/d138/c14e 0 2024-09-17T01:02:06.552 INFO:tasks.workunit.client.0.smithi002.stdout:6/989: read d2/d1d/d27/d30/fb7 [235797,89300] 0 2024-09-17T01:02:06.552 INFO:tasks.workunit.client.0.smithi002.stdout:6/990: readlink d2/l4e 0 2024-09-17T01:02:06.555 INFO:tasks.workunit.client.0.smithi002.stdout:3/896: write d0/d3/d17/d87/d9e/dd4/f10b [1710071,13874] 0 2024-09-17T01:02:06.556 INFO:tasks.workunit.client.0.smithi002.stdout:5/967: symlink d2/d2d/d10/d14/d19/d39/d51/dfe/l134 0 2024-09-17T01:02:06.557 INFO:tasks.workunit.client.0.smithi002.stdout:5/968: fsync d2/d2d/d10/d20/f7e 0 2024-09-17T01:02:06.557 INFO:tasks.workunit.client.0.smithi002.stdout:3/897: dread d0/d31/d32/fd5 [0,4194304] 0 2024-09-17T01:02:06.558 INFO:tasks.workunit.client.0.smithi002.stdout:0/837: creat dd/d19/d1c/deb/f11f x:0 0 0 2024-09-17T01:02:06.560 INFO:tasks.workunit.client.0.smithi002.stdout:6/991: write d2/d1d/d26/d49/fa0 [1719931,48867] 0 2024-09-17T01:02:06.561 INFO:tasks.workunit.client.0.smithi002.stdout:5/969: rmdir d2/d2d/d10/d23/d6a 39 2024-09-17T01:02:06.561 INFO:tasks.workunit.client.0.smithi002.stdout:5/970: write d2/d2d/d10/d14/d19/d39/d48/d120/f8e [470573,45172] 0 2024-09-17T01:02:06.561 INFO:tasks.workunit.client.0.smithi002.stdout:5/971: readlink d2/d99/la6 0 2024-09-17T01:02:06.562 INFO:tasks.workunit.client.0.smithi002.stdout:5/972: dread d2/ff1 [0,4194304] 0 2024-09-17T01:02:06.565 INFO:tasks.workunit.client.0.smithi002.stdout:6/992: creat d2/dc/d24/d53/d83/da9/f14f x:0 0 0 2024-09-17T01:02:06.565 INFO:tasks.workunit.client.0.smithi002.stdout:3/898: rmdir d0/d3/d17/d6a 39 2024-09-17T01:02:06.565 INFO:tasks.workunit.client.0.smithi002.stdout:3/899: chown d0/d3/d17/d9a/c71 371048 1 2024-09-17T01:02:06.567 INFO:tasks.workunit.client.0.smithi002.stdout:5/973: symlink d2/d2d/d10/d14/d19/d39/dc4/d125/l135 0 2024-09-17T01:02:06.567 INFO:tasks.workunit.client.0.smithi002.stdout:5/974: write d2/d2d/d10/d14/d19/d39/d48/def/f8d [3606271,105849] 0 2024-09-17T01:02:06.569 INFO:tasks.workunit.client.0.smithi002.stdout:0/838: rename dd/d19/da9/de5/d68/d9d to dd/d120 0 2024-09-17T01:02:06.570 INFO:tasks.workunit.client.0.smithi002.stdout:0/839: chown dd/d19/d1c/d1f/d22/f6b 139956 1 2024-09-17T01:02:06.571 INFO:tasks.workunit.client.0.smithi002.stdout:6/993: mkdir d2/d150 0 2024-09-17T01:02:06.571 INFO:tasks.workunit.client.0.smithi002.stdout:6/994: stat d2/dc/d24/d53/d9e/fc8 0 2024-09-17T01:02:06.572 INFO:tasks.workunit.client.0.smithi002.stdout:3/900: mkdir d0/d3/d37/dac/d11f 0 2024-09-17T01:02:06.572 INFO:tasks.workunit.client.0.smithi002.stdout:3/901: write d0/d31/da7/ddd/f107 [392393,24068] 0 2024-09-17T01:02:06.575 INFO:tasks.workunit.client.0.smithi002.stdout:5/975: rename d2/d2d/d10/d23/d6e/fd1 to d2/d2d/d10/d14/d19/da5/f136 0 2024-09-17T01:02:06.575 INFO:tasks.workunit.client.0.smithi002.stdout:5/976: write d2/d2d/d10/d14/d19/da5/fb5 [1583411,17330] 0 2024-09-17T01:02:06.575 INFO:tasks.workunit.client.0.smithi002.stdout:5/977: creat d2/d2d/d10/d9b/de8/f137 x:0 0 0 2024-09-17T01:02:06.575 INFO:tasks.workunit.client.0.smithi002.stdout:5/978: chown d2/d2d/d10/d14/d19/d39/d51/d133 1648 1 2024-09-17T01:02:06.578 INFO:tasks.workunit.client.0.smithi002.stdout:5/979: truncate d2/d2d/d10/f8a 106523 0 2024-09-17T01:02:06.578 INFO:tasks.workunit.client.0.smithi002.stdout:5/980: creat d2/d2d/d10/d20/d24/f138 x:0 0 0 2024-09-17T01:02:06.578 INFO:tasks.workunit.client.0.smithi002.stdout:5/981: fdatasync d2/d2d/d10/d14/d59/f8f 0 2024-09-17T01:02:06.578 INFO:tasks.workunit.client.0.smithi002.stdout:5/982: getdents d2/d2d/d10/d14/d19/d39/d51/d133 0 2024-09-17T01:02:06.578 INFO:tasks.workunit.client.0.smithi002.stdout:6/995: write d2/d1d/d99/fee [717784,14433] 0 2024-09-17T01:02:06.578 INFO:tasks.workunit.client.0.smithi002.stdout:6/996: stat d2/d1d/d27/d80/d93/dd5/d5c/dc9/fc7 0 2024-09-17T01:02:06.581 INFO:tasks.workunit.client.0.smithi002.stdout:0/840: dread dd/d19/d1a/f1d [0,4194304] 0 2024-09-17T01:02:06.581 INFO:tasks.workunit.client.0.smithi002.stdout:0/841: readlink dd/d19/d1c/deb/lfe 0 2024-09-17T01:02:06.585 INFO:tasks.workunit.client.0.smithi002.stdout:3/902: dread d0/d31/d8b/d9d/fde [0,4194304] 0 2024-09-17T01:02:06.586 INFO:tasks.workunit.client.0.smithi002.stdout:6/997: rename d2/d1d/d26/d49/f6e to d2/d150/f151 0 2024-09-17T01:02:06.586 INFO:tasks.workunit.client.0.smithi002.stdout:6/998: dread - d2/d1d/d2d/d35/d6d/f10c zero size 2024-09-17T01:02:06.586 INFO:tasks.workunit.client.0.smithi002.stdout:6/999: creat d2/d1d/d27/d87/d138/f152 x:0 0 0 2024-09-17T01:02:06.589 INFO:tasks.workunit.client.0.smithi002.stdout:0/842: unlink dd/d120/dbe/cdf 0 2024-09-17T01:02:06.590 INFO:tasks.workunit.client.0.smithi002.stdout:3/903: fsync d0/d3/d17/d87/d9e/dd4/f10b 0 2024-09-17T01:02:06.595 INFO:tasks.workunit.client.0.smithi002.stdout:0/843: dread dd/d19/d1c/d1f/d22/f6b [0,4194304] 0 2024-09-17T01:02:06.597 INFO:tasks.workunit.client.0.smithi002.stdout:0/844: mknod dd/d19/d1a/d29/d55/d61/c121 0 2024-09-17T01:02:06.598 INFO:tasks.workunit.client.0.smithi002.stdout:0/845: readlink dd/d19/d1c/l62 0 2024-09-17T01:02:06.598 INFO:tasks.workunit.client.0.smithi002.stdout:0/846: readlink dd/d19/d1a/d29/d55/d61/ld7 0 2024-09-17T01:02:06.598 INFO:tasks.workunit.client.0.smithi002.stdout:0/847: chown dd/d19/d1a/d29/ce2 30479 1 2024-09-17T01:02:06.599 INFO:tasks.workunit.client.0.smithi002.stdout:0/848: mknod dd/d120/c122 0 2024-09-17T01:02:06.599 INFO:tasks.workunit.client.0.smithi002.stdout:3/904: write d0/d3/d33/f55 [1621875,80962] 0 2024-09-17T01:02:06.599 INFO:tasks.workunit.client.0.smithi002.stdout:5/983: dwrite d2/d2d/d10/d14/d19/d39/f3c [0,4194304] 0 2024-09-17T01:02:06.600 INFO:tasks.workunit.client.0.smithi002.stdout:5/984: fdatasync d2/f4d 0 2024-09-17T01:02:06.601 INFO:tasks.workunit.client.0.smithi002.stdout:0/849: link dd/d19/d1c/d1f/d76/fa2 dd/d19/d9f/f123 0 2024-09-17T01:02:06.601 INFO:tasks.workunit.client.1.smithi099.stdout:7/835: rename d1/d2c to d1/d37/d4f/d107 0 2024-09-17T01:02:06.601 INFO:tasks.workunit.client.1.smithi099.stdout:7/836: write d1/d37/d4f/d107/f2d [5963394,66152] 0 2024-09-17T01:02:06.602 INFO:tasks.workunit.client.1.smithi099.stdout:7/837: write d1/d37/d4f/d107/d5c/fbb [4084852,16214] 0 2024-09-17T01:02:06.602 INFO:tasks.workunit.client.1.smithi099.stdout:8/989: mknod d0/d1f/d90/db8/dde/d29/d4b/c141 0 2024-09-17T01:02:06.602 INFO:tasks.workunit.client.0.smithi002.stdout:3/905: rename d0/d3/d17/d9a/f7c to d0/d3/d17/d87/d10c/f120 0 2024-09-17T01:02:06.603 INFO:tasks.workunit.client.1.smithi099.stdout:5/954: creat d2/dc4/d90/f140 x:0 0 0 2024-09-17T01:02:06.603 INFO:tasks.workunit.client.1.smithi099.stdout:8/990: read d0/d1f/d31/d4c/f76 [575682,7729] 0 2024-09-17T01:02:06.604 INFO:tasks.workunit.client.0.smithi002.stdout:5/985: symlink d2/d2d/d10/d14/d59/l139 0 2024-09-17T01:02:06.604 INFO:tasks.workunit.client.0.smithi002.stdout:5/986: getdents d2/d2d/d10/d14/dce/d10b 0 2024-09-17T01:02:06.605 INFO:tasks.workunit.client.0.smithi002.stdout:0/850: creat dd/d120/dbe/d113/d11d/f124 x:0 0 0 2024-09-17T01:02:06.606 INFO:tasks.workunit.client.0.smithi002.stdout:0/851: write dd/d19/d1c/d1f/f77 [3464830,113381] 0 2024-09-17T01:02:06.606 INFO:tasks.workunit.client.1.smithi099.stdout:7/838: mknod d1/d37/d4f/d107/d5c/d1c/d5a/d6f/c108 0 2024-09-17T01:02:06.606 INFO:tasks.workunit.client.1.smithi099.stdout:7/839: chown d1/d37/d4f/fc8 127 1 2024-09-17T01:02:06.608 INFO:tasks.workunit.client.0.smithi002.stdout:5/987: mknod d2/d2d/d10/d14/d19/d39/d51/c13a 0 2024-09-17T01:02:06.609 INFO:tasks.workunit.client.0.smithi002.stdout:0/852: rmdir dd/d19/da9 39 2024-09-17T01:02:06.609 INFO:tasks.workunit.client.0.smithi002.stdout:0/853: creat dd/d19/d1a/d29/d55/d56/f125 x:0 0 0 2024-09-17T01:02:06.609 INFO:tasks.workunit.client.0.smithi002.stdout:5/988: read d2/d2d/d10/d9b/fdd [501128,34526] 0 2024-09-17T01:02:06.609 INFO:tasks.workunit.client.0.smithi002.stdout:5/989: fdatasync d2/d2d/d10/d95/fe2 0 2024-09-17T01:02:06.609 INFO:tasks.workunit.client.0.smithi002.stdout:5/990: creat d2/d2d/d10/d9b/f13b x:0 0 0 2024-09-17T01:02:06.610 INFO:tasks.workunit.client.1.smithi099.stdout:7/840: symlink d1/d36/l109 0 2024-09-17T01:02:06.610 INFO:tasks.workunit.client.1.smithi099.stdout:7/841: write d1/d8f/feb [4477184,111009] 0 2024-09-17T01:02:06.613 INFO:tasks.workunit.client.0.smithi002.stdout:5/991: mkdir d2/d2d/d10/d20/d24/d11c/d13c 0 2024-09-17T01:02:06.613 INFO:tasks.workunit.client.0.smithi002.stdout:5/992: fdatasync d2/de/ff3 0 2024-09-17T01:02:06.613 INFO:tasks.workunit.client.0.smithi002.stdout:5/993: truncate d2/de/d57/d80/fbb 765203 0 2024-09-17T01:02:06.614 INFO:tasks.workunit.client.0.smithi002.stdout:5/994: rename d2/d99/cc3 to d2/de/dfc/dd5/c13d 0 2024-09-17T01:02:06.614 INFO:tasks.workunit.client.0.smithi002.stdout:5/995: write d2/d2d/d10/d23/d6e/f6b [2175588,31092] 0 2024-09-17T01:02:06.616 INFO:tasks.workunit.client.0.smithi002.stdout:5/996: getdents d2/d2d/d10/d20/d24 0 2024-09-17T01:02:06.616 INFO:tasks.workunit.client.0.smithi002.stdout:5/997: write d2/de/d57/f112 [389865,96396] 0 2024-09-17T01:02:06.618 INFO:tasks.workunit.client.1.smithi099.stdout:5/955: dread d2/dc/f93 [0,4194304] 0 2024-09-17T01:02:06.619 INFO:tasks.workunit.client.1.smithi099.stdout:5/956: dread d2/f1b [4194304,4194304] 0 2024-09-17T01:02:06.619 INFO:tasks.workunit.client.1.smithi099.stdout:5/957: chown d2/dc4/d90/f140 2531 1 2024-09-17T01:02:06.625 INFO:tasks.workunit.client.1.smithi099.stdout:8/991: rmdir d0/d1f 39 2024-09-17T01:02:06.625 INFO:tasks.workunit.client.1.smithi099.stdout:8/992: read - d0/d53/f13c zero size 2024-09-17T01:02:06.625 INFO:tasks.workunit.client.0.smithi002.stdout:5/998: dread d2/d2d/d10/d14/d19/d39/f3c [8388608,4194304] 0 2024-09-17T01:02:06.625 INFO:tasks.workunit.client.0.smithi002.stdout:5/999: rmdir d2/d2d/d10/d14/d19/da5/db0/dcd/d10e/d118 0 2024-09-17T01:02:06.625 INFO:tasks.workunit.client.1.smithi099.stdout:5/958: symlink d2/d45/dc5/l141 0 2024-09-17T01:02:06.626 INFO:tasks.workunit.client.1.smithi099.stdout:5/959: chown d2/dc4/d90/da4/d9c 30186 1 2024-09-17T01:02:06.627 INFO:tasks.workunit.client.1.smithi099.stdout:5/960: getdents d2/d26/d64/de2 0 2024-09-17T01:02:06.629 INFO:tasks.workunit.client.1.smithi099.stdout:5/961: rename d2/dc4/d90/da4/c30 to d2/dc/d17/d3c/dca/c142 0 2024-09-17T01:02:06.631 INFO:tasks.workunit.client.1.smithi099.stdout:5/962: unlink d2/d26/d64/df8/l11a 0 2024-09-17T01:02:06.631 INFO:tasks.workunit.client.1.smithi099.stdout:5/963: creat d2/f143 x:0 0 0 2024-09-17T01:02:06.631 INFO:tasks.workunit.client.1.smithi099.stdout:5/964: creat d2/dc/d17/d3c/dca/f144 x:0 0 0 2024-09-17T01:02:06.631 INFO:tasks.workunit.client.1.smithi099.stdout:5/965: fdatasync d2/dc/d17/d3c/d72/f113 0 2024-09-17T01:02:06.631 INFO:tasks.workunit.client.1.smithi099.stdout:5/966: truncate d2/dc4/d99/dd0/dc3/dc8/fd7 1130495 0 2024-09-17T01:02:06.633 INFO:tasks.workunit.client.0.smithi002.stdout:0/854: dwrite dd/d19/d1c/d78/f112 [0,4194304] 0 2024-09-17T01:02:06.637 INFO:tasks.workunit.client.0.smithi002.stdout:0/855: rename dd/d19/d1a/d29/f11c to dd/d3d/d94/f126 0 2024-09-17T01:02:06.637 INFO:tasks.workunit.client.0.smithi002.stdout:0/856: read dd/d3d/d94/dd1/fe1 [4077715,82066] 0 2024-09-17T01:02:06.638 INFO:tasks.workunit.client.1.smithi099.stdout:7/842: truncate d1/d37/d4f/d107/d5c/fbb 639328 0 2024-09-17T01:02:06.639 INFO:tasks.workunit.client.0.smithi002.stdout:0/857: truncate dd/d19/d1c/d1f/d39/ff2 2633379 0 2024-09-17T01:02:06.639 INFO:tasks.workunit.client.1.smithi099.stdout:8/993: write d0/d41/d5a/fd4 [1861888,7861] 0 2024-09-17T01:02:06.641 INFO:tasks.workunit.client.0.smithi002.stdout:0/858: mknod dd/d19/d1a/d29/d55/d56/d110/c127 0 2024-09-17T01:02:06.654 INFO:tasks.workunit.client.1.smithi099.stdout:9/881: sync 2024-09-17T01:02:06.656 INFO:tasks.workunit.client.1.smithi099.stdout:5/967: dwrite d2/d8/f7a [0,4194304] 0 2024-09-17T01:02:06.656 INFO:tasks.workunit.client.1.smithi099.stdout:5/968: chown d2/dc/d14/d89 1444798 1 2024-09-17T01:02:06.657 INFO:tasks.workunit.client.1.smithi099.stdout:8/994: write d0/d1f/d55/d95/de2/ffb [1018070,39751] 0 2024-09-17T01:02:06.657 INFO:tasks.workunit.client.1.smithi099.stdout:8/995: dread - d0/d1f/d31/d4c/d8c/fd0 zero size 2024-09-17T01:02:06.659 INFO:tasks.workunit.client.1.smithi099.stdout:5/969: creat d2/dc/d17/d3c/da8/f145 x:0 0 0 2024-09-17T01:02:06.659 INFO:tasks.workunit.client.1.smithi099.stdout:5/970: chown d2/d8/f29 26084 1 2024-09-17T01:02:06.660 INFO:tasks.workunit.client.1.smithi099.stdout:8/996: rmdir d0/d1f/d90/db8/dde 39 2024-09-17T01:02:06.662 INFO:tasks.workunit.client.1.smithi099.stdout:7/843: dwrite d1/d37/d78/db2/ffa [0,4194304] 0 2024-09-17T01:02:06.662 INFO:tasks.workunit.client.1.smithi099.stdout:7/844: chown d1/d36/l5b 5571799 1 2024-09-17T01:02:06.663 INFO:tasks.workunit.client.1.smithi099.stdout:5/971: rename d2/dc/d17/d3c/d81/l85 to d2/dc/d17/d3c/db3/l146 0 2024-09-17T01:02:06.665 INFO:tasks.workunit.client.1.smithi099.stdout:8/997: rename d0/d41/l117 to d0/d1f/d55/d95/l142 0 2024-09-17T01:02:06.666 INFO:tasks.workunit.client.1.smithi099.stdout:5/972: symlink d2/dc4/d99/dd0/dc3/dc8/l147 0 2024-09-17T01:02:06.666 INFO:tasks.workunit.client.0.smithi002.stdout:0/859: dwrite dd/d19/da9/fcd [0,4194304] 0 2024-09-17T01:02:06.667 INFO:tasks.workunit.client.1.smithi099.stdout:5/973: write d2/dc/d14/d89/f104 [171095,85547] 0 2024-09-17T01:02:06.667 INFO:tasks.workunit.client.1.smithi099.stdout:8/998: creat d0/d1f/f143 x:0 0 0 2024-09-17T01:02:06.669 INFO:tasks.workunit.client.1.smithi099.stdout:8/999: dread d0/f74 [0,4194304] 0 2024-09-17T01:02:06.669 INFO:tasks.workunit.client.1.smithi099.stdout:5/974: unlink d2/dc/d17/d3c/f46 0 2024-09-17T01:02:06.669 INFO:tasks.workunit.client.1.smithi099.stdout:5/975: write d2/dc4/d99/dd0/dc3/dc8/fd7 [329968,127241] 0 2024-09-17T01:02:06.669 INFO:tasks.workunit.client.1.smithi099.stdout:5/976: write d2/f40 [4995178,100798] 0 2024-09-17T01:02:06.670 INFO:tasks.workunit.client.0.smithi002.stdout:0/860: creat dd/d3d/f128 x:0 0 0 2024-09-17T01:02:06.670 INFO:tasks.workunit.client.0.smithi002.stdout:0/861: rmdir dd/d19/d1a/d29/d55/d56/d110 39 2024-09-17T01:02:06.674 INFO:tasks.workunit.client.1.smithi099.stdout:9/882: dwrite da/d50/f83 [0,4194304] 0 2024-09-17T01:02:06.676 INFO:tasks.workunit.client.1.smithi099.stdout:9/883: write da/d14/d48/d69/ff3 [830764,80385] 0 2024-09-17T01:02:06.676 INFO:tasks.workunit.client.1.smithi099.stdout:9/884: fsync da/d8e/fd9 0 2024-09-17T01:02:06.676 INFO:tasks.workunit.client.1.smithi099.stdout:9/885: chown da/d18/db3/def/c118 13256 1 2024-09-17T01:02:06.686 INFO:tasks.workunit.client.1.smithi099.stdout:7/845: dwrite d1/d37/d4f/d107/f6b [0,4194304] 0 2024-09-17T01:02:06.687 INFO:tasks.workunit.client.1.smithi099.stdout:7/846: dread - d1/d37/d4f/d107/d5c/d1c/d5a/db3/dcd/fd2 zero size 2024-09-17T01:02:06.687 INFO:tasks.workunit.client.1.smithi099.stdout:7/847: write d1/f10 [1395389,78175] 0 2024-09-17T01:02:06.687 INFO:tasks.workunit.client.1.smithi099.stdout:7/848: getdents d1/d36/d8d/d104 0 2024-09-17T01:02:06.689 INFO:tasks.workunit.client.1.smithi099.stdout:7/849: symlink d1/d37/d4f/d107/d5c/d1c/d5a/db3/l10a 0 2024-09-17T01:02:06.690 INFO:tasks.workunit.client.1.smithi099.stdout:7/850: creat d1/d36/d8d/dd6/f10b x:0 0 0 2024-09-17T01:02:06.691 INFO:tasks.workunit.client.1.smithi099.stdout:7/851: chown d1/d37/d4f/d107/d5c/d3f/lbd 82178 1 2024-09-17T01:02:06.691 INFO:tasks.workunit.client.1.smithi099.stdout:7/852: chown d1/d37/d78 0 1 2024-09-17T01:02:06.693 INFO:tasks.workunit.client.1.smithi099.stdout:7/853: creat d1/d37/d4f/d107/d5c/d1c/d5a/db3/f10c x:0 0 0 2024-09-17T01:02:06.693 INFO:tasks.workunit.client.1.smithi099.stdout:7/854: getdents d1/d37/d4f/d107/d5c/d1c/d5a/d76 0 2024-09-17T01:02:06.694 INFO:tasks.workunit.client.1.smithi099.stdout:7/855: unlink d1/d37/d4f/d107/d5c/d3f/lbc 0 2024-09-17T01:02:06.694 INFO:tasks.workunit.client.1.smithi099.stdout:7/856: readlink d1/d37/d4f/l75 0 2024-09-17T01:02:06.695 INFO:tasks.workunit.client.0.smithi002.stdout:9/851: sync 2024-09-17T01:02:06.696 INFO:tasks.workunit.client.1.smithi099.stdout:7/857: unlink d1/d37/d4f/d107/d5c/d12/l44 0 2024-09-17T01:02:06.696 INFO:tasks.workunit.client.0.smithi002.stdout:9/852: truncate d5/dc/d26/d5c/d6b/d75/f62 936362 0 2024-09-17T01:02:06.697 INFO:tasks.workunit.client.0.smithi002.stdout:9/853: creat d5/dc/d26/d46/db4/f102 x:0 0 0 2024-09-17T01:02:06.697 INFO:tasks.workunit.client.1.smithi099.stdout:7/858: mknod d1/d37/d4f/d107/c10d 0 2024-09-17T01:02:06.698 INFO:tasks.workunit.client.1.smithi099.stdout:9/886: dwrite f6 [0,4194304] 0 2024-09-17T01:02:06.698 INFO:tasks.workunit.client.1.smithi099.stdout:5/977: dwrite d2/dc/d17/f52 [0,4194304] 0 2024-09-17T01:02:06.698 INFO:tasks.workunit.client.0.smithi002.stdout:9/854: unlink d5/l52 0 2024-09-17T01:02:06.698 INFO:tasks.workunit.client.1.smithi099.stdout:7/859: symlink d1/d37/d4f/d107/d5c/d1c/d5a/d6f/l10e 0 2024-09-17T01:02:06.701 INFO:tasks.workunit.client.1.smithi099.stdout:5/978: rename d2/dc/d14/d89/l92 to d2/dc4/d90/da4/d8e/l148 0 2024-09-17T01:02:06.701 INFO:tasks.workunit.client.1.smithi099.stdout:5/979: chown d2/dc/d17/d3c/da8/fc7 0 1 2024-09-17T01:02:06.704 INFO:tasks.workunit.client.1.smithi099.stdout:7/860: symlink d1/d37/d4f/d107/d47/l10f 0 2024-09-17T01:02:06.705 INFO:tasks.workunit.client.1.smithi099.stdout:7/861: mknod d1/d36/d8d/dd6/c110 0 2024-09-17T01:02:06.723 INFO:tasks.workunit.client.0.smithi002.stdout:9/855: dwrite d5/dc/d26/d63/d66/f101 [0,4194304] 0 2024-09-17T01:02:06.724 INFO:tasks.workunit.client.1.smithi099.stdout:9/887: dwrite da/d14/d48/d69/ff3 [0,4194304] 0 2024-09-17T01:02:06.725 INFO:tasks.workunit.client.0.smithi002.stdout:9/856: symlink d5/dc/d26/d46/d47/da1/de7/l103 0 2024-09-17T01:02:06.726 INFO:tasks.workunit.client.0.smithi002.stdout:9/857: fdatasync d5/f14 0 2024-09-17T01:02:06.726 INFO:tasks.workunit.client.1.smithi099.stdout:9/888: read da/d14/d40/f65 [513380,78060] 0 2024-09-17T01:02:06.726 INFO:tasks.workunit.client.1.smithi099.stdout:9/889: truncate da/d14/d48/d69/ff3 4796144 0 2024-09-17T01:02:06.727 INFO:tasks.workunit.client.0.smithi002.stdout:9/858: link d5/d8a/d9d/da7/ffc d5/dc/d26/d46/d47/da1/f104 0 2024-09-17T01:02:06.728 INFO:tasks.workunit.client.1.smithi099.stdout:9/890: link da/d14/ff8 da/d8e/f11f 0 2024-09-17T01:02:06.729 INFO:tasks.workunit.client.0.smithi002.stdout:9/859: dread d5/dc/d26/d46/d47/da1/fb3 [0,4194304] 0 2024-09-17T01:02:06.730 INFO:tasks.workunit.client.0.smithi002.stdout:9/860: symlink d5/dc/d26/d5c/de4/l105 0 2024-09-17T01:02:06.731 INFO:tasks.workunit.client.0.smithi002.stdout:9/861: mknod d5/d8a/d9d/c106 0 2024-09-17T01:02:06.734 INFO:tasks.workunit.client.0.smithi002.stdout:9/862: dread d5/f4f [0,4194304] 0 2024-09-17T01:02:06.736 INFO:tasks.workunit.client.0.smithi002.stdout:9/863: creat d5/dc/d26/d63/d66/dd7/f107 x:0 0 0 2024-09-17T01:02:06.738 INFO:tasks.workunit.client.0.smithi002.stdout:9/864: mkdir d5/dc/d26/d63/d108 0 2024-09-17T01:02:06.740 INFO:tasks.workunit.client.0.smithi002.stdout:9/865: rename d5/dc/d26/d5c/de4/l105 to d5/dc/d26/d5c/l109 0 2024-09-17T01:02:06.742 INFO:tasks.workunit.client.0.smithi002.stdout:9/866: dread d5/dc/d26/d46/d47/d89/dec/ff6 [0,4194304] 0 2024-09-17T01:02:06.744 INFO:tasks.workunit.client.0.smithi002.stdout:9/867: symlink d5/dc/d26/d46/db4/l10a 0 2024-09-17T01:02:06.744 INFO:tasks.workunit.client.0.smithi002.stdout:9/868: creat d5/dc/d26/d46/d47/da1/f10b x:0 0 0 2024-09-17T01:02:06.745 INFO:tasks.workunit.client.1.smithi099.stdout:9/891: dwrite da/d14/d6d/f8a [0,4194304] 0 2024-09-17T01:02:06.747 INFO:tasks.workunit.client.0.smithi002.stdout:9/869: rename d5/f1d to d5/dc/d26/d5c/d6b/f10c 0 2024-09-17T01:02:06.747 INFO:tasks.workunit.client.1.smithi099.stdout:9/892: link da/d14/ca3 da/d18/c120 0 2024-09-17T01:02:06.747 INFO:tasks.workunit.client.1.smithi099.stdout:9/893: fsync da/d56/da5/fa6 0 2024-09-17T01:02:06.749 INFO:tasks.workunit.client.1.smithi099.stdout:9/894: link da/d9a/f3d da/d14/d48/f121 0 2024-09-17T01:02:06.749 INFO:tasks.workunit.client.1.smithi099.stdout:9/895: chown da/d14/d40/d6f/c9d 1382846155 1 2024-09-17T01:02:06.749 INFO:tasks.workunit.client.1.smithi099.stdout:9/896: fsync da/d21/d2a/f11d 0 2024-09-17T01:02:06.750 INFO:tasks.workunit.client.1.smithi099.stdout:9/897: rename da/d50/d104/d105/d10a/f112 to da/d14/d48/f122 0 2024-09-17T01:02:06.752 INFO:tasks.workunit.client.1.smithi099.stdout:9/898: symlink da/d8e/d96/dfb/l123 0 2024-09-17T01:02:06.753 INFO:tasks.workunit.client.1.smithi099.stdout:9/899: mknod da/d50/d104/d105/dad/ddc/c124 0 2024-09-17T01:02:06.774 INFO:tasks.workunit.client.0.smithi002.stdout:9/870: dwrite d5/dc/d26/d5c/d6b/d75/d36/f97 [0,4194304] 0 2024-09-17T01:02:06.774 INFO:tasks.workunit.client.1.smithi099.stdout:9/900: dwrite da/d14/d48/d69/d6c/fa2 [0,4194304] 0 2024-09-17T01:02:06.774 INFO:tasks.workunit.client.1.smithi099.stdout:9/901: readlink da/d9a/d3a/l7a 0 2024-09-17T01:02:06.777 INFO:tasks.workunit.client.0.smithi002.stdout:9/871: rename d5/dc/d26/c4a to d5/dc/d26/d63/c10d 0 2024-09-17T01:02:06.777 INFO:tasks.workunit.client.0.smithi002.stdout:9/872: readlink d5/dc/d26/d5c/d6b/d75/d57/d8d/l82 0 2024-09-17T01:02:06.777 INFO:tasks.workunit.client.0.smithi002.stdout:9/873: write d5/dc/f68 [1237830,15470] 0 2024-09-17T01:02:06.785 INFO:tasks.workunit.client.1.smithi099.stdout:9/902: dread da/d21/d2a/f54 [4194304,4194304] 0 2024-09-17T01:02:06.786 INFO:tasks.workunit.client.1.smithi099.stdout:9/903: chown da/d14/d48/d69/d6c/f100 1 1 2024-09-17T01:02:06.786 INFO:tasks.workunit.client.1.smithi099.stdout:9/904: read - da/d21/d5b/f119 zero size 2024-09-17T01:02:06.787 INFO:tasks.workunit.client.1.smithi099.stdout:9/905: truncate da/d9b/fa1 3206199 0 2024-09-17T01:02:06.790 INFO:tasks.workunit.client.1.smithi099.stdout:0/941: sync 2024-09-17T01:02:06.790 INFO:tasks.workunit.client.1.smithi099.stdout:6/901: sync 2024-09-17T01:02:06.790 INFO:tasks.workunit.client.1.smithi099.stdout:6/902: dread - dc/d5d/f12e zero size 2024-09-17T01:02:06.791 INFO:tasks.workunit.client.1.smithi099.stdout:6/903: creat dc/d5d/dae/d96/dfd/d101/f137 x:0 0 0 2024-09-17T01:02:06.791 INFO:tasks.workunit.client.1.smithi099.stdout:6/904: read - dc/d5d/dae/d96/dfd/d101/f137 zero size 2024-09-17T01:02:06.791 INFO:tasks.workunit.client.1.smithi099.stdout:6/905: readlink dc/d5d/d66/dbb/d10c/l64 0 2024-09-17T01:02:06.791 INFO:tasks.workunit.client.1.smithi099.stdout:6/906: chown dc/d2b/fa6 237489 1 2024-09-17T01:02:06.796 INFO:tasks.workunit.client.1.smithi099.stdout:9/906: write da/d50/f83 [2812865,112260] 0 2024-09-17T01:02:06.799 INFO:tasks.workunit.client.0.smithi002.stdout:9/874: dwrite d5/f19 [0,4194304] 0 2024-09-17T01:02:06.800 INFO:tasks.workunit.client.0.smithi002.stdout:9/875: symlink d5/dc/d26/d63/d66/dd7/l10e 0 2024-09-17T01:02:06.801 INFO:tasks.workunit.client.1.smithi099.stdout:0/942: dread da/d12/d2b/dab/f105 [0,4194304] 0 2024-09-17T01:02:06.802 INFO:tasks.workunit.client.0.smithi002.stdout:9/876: mkdir d5/dc/d26/d5c/d6b/d75/d57/dba/d10f 0 2024-09-17T01:02:06.803 INFO:tasks.workunit.client.1.smithi099.stdout:6/907: write dc/d1a/d49/d4c/f9d [279644,28760] 0 2024-09-17T01:02:06.805 INFO:tasks.workunit.client.1.smithi099.stdout:6/908: dread dc/d5d/dae/f5a [0,4194304] 0 2024-09-17T01:02:06.806 INFO:tasks.workunit.client.1.smithi099.stdout:6/909: rmdir dc/d5d/dae/dd0 39 2024-09-17T01:02:06.809 INFO:tasks.workunit.client.0.smithi002.stdout:9/877: dread d5/dc/d26/f2d [0,4194304] 0 2024-09-17T01:02:06.809 INFO:tasks.workunit.client.1.smithi099.stdout:6/910: rename dc/d5d/dae/d132/dde to dc/d2b/d11e/d106/d138 0 2024-09-17T01:02:06.811 INFO:tasks.workunit.client.0.smithi002.stdout:9/878: dread d5/dc/d26/d5c/d6b/d75/f3f [0,4194304] 0 2024-09-17T01:02:06.811 INFO:tasks.workunit.client.0.smithi002.stdout:9/879: creat d5/dc/d26/d5c/d6b/d75/f110 x:0 0 0 2024-09-17T01:02:06.811 INFO:tasks.workunit.client.0.smithi002.stdout:9/880: truncate d5/d8a/d9d/da7/fc2 466429 0 2024-09-17T01:02:06.811 INFO:tasks.workunit.client.0.smithi002.stdout:9/881: creat d5/dc/d26/d9c/f111 x:0 0 0 2024-09-17T01:02:06.811 INFO:tasks.workunit.client.0.smithi002.stdout:9/882: truncate d5/dc/d26/d5c/d6b/d75/f62 1609661 0 2024-09-17T01:02:06.813 INFO:tasks.workunit.client.1.smithi099.stdout:0/943: write da/f82 [3303094,89521] 0 2024-09-17T01:02:06.816 INFO:tasks.workunit.client.1.smithi099.stdout:0/944: rename da/df/d1a/d56/fbd to da/df/d1a/d49/d71/dcd/f139 0 2024-09-17T01:02:06.819 INFO:tasks.workunit.client.1.smithi099.stdout:9/907: dwrite da/d9a/d3a/f26 [0,4194304] 0 2024-09-17T01:02:06.822 INFO:tasks.workunit.client.1.smithi099.stdout:9/908: unlink da/d21/d5b/c4f 0 2024-09-17T01:02:06.824 INFO:tasks.workunit.client.1.smithi099.stdout:9/909: rename da/d18/d5e/f9e to da/d50/d104/d105/dad/ddc/de6/f125 0 2024-09-17T01:02:06.824 INFO:tasks.workunit.client.1.smithi099.stdout:9/910: creat da/d50/d104/f126 x:0 0 0 2024-09-17T01:02:06.824 INFO:tasks.workunit.client.1.smithi099.stdout:0/945: dread da/d12/f16 [4194304,4194304] 0 2024-09-17T01:02:06.824 INFO:tasks.workunit.client.1.smithi099.stdout:0/946: fsync da/df/d20/dbf/f112 0 2024-09-17T01:02:06.828 INFO:tasks.workunit.client.1.smithi099.stdout:9/911: getdents da/d14/d48/d69 0 2024-09-17T01:02:06.829 INFO:tasks.workunit.client.0.smithi002.stdout:9/883: dread d5/f20 [0,4194304] 0 2024-09-17T01:02:06.858 INFO:tasks.workunit.client.0.smithi002.stdout:9/884: dwrite d5/dc/d26/d46/fb6 [0,4194304] 0 2024-09-17T01:02:06.858 INFO:tasks.workunit.client.0.smithi002.stdout:9/885: chown d5/f10 30 1 2024-09-17T01:02:06.858 INFO:tasks.workunit.client.0.smithi002.stdout:9/886: creat d5/dc/d26/d9c/f112 x:0 0 0 2024-09-17T01:02:06.858 INFO:tasks.workunit.client.0.smithi002.stdout:9/887: creat d5/dc/d26/d46/d47/d89/f113 x:0 0 0 2024-09-17T01:02:06.859 INFO:tasks.workunit.client.0.smithi002.stdout:9/888: creat d5/dc/d26/f114 x:0 0 0 2024-09-17T01:02:06.859 INFO:tasks.workunit.client.1.smithi099.stdout:9/912: dwrite da/d56/d84/db9/f10f [0,4194304] 0 2024-09-17T01:02:06.862 INFO:tasks.workunit.client.0.smithi002.stdout:9/889: symlink d5/dc/d26/d46/db4/l115 0 2024-09-17T01:02:06.863 INFO:tasks.workunit.client.0.smithi002.stdout:9/890: symlink d5/dc/d26/d5c/d6b/d75/d57/d7a/da2/l116 0 2024-09-17T01:02:06.863 INFO:tasks.workunit.client.0.smithi002.stdout:9/891: dread - d5/dc/d26/d63/d66/dd7/f107 zero size 2024-09-17T01:02:06.863 INFO:tasks.workunit.client.0.smithi002.stdout:9/892: write d5/dc/d26/d5c/d6b/d75/d36/f97 [4558794,56511] 0 2024-09-17T01:02:06.865 INFO:tasks.workunit.client.0.smithi002.stdout:9/893: truncate d5/dc/d26/d5c/d6b/d75/f3f 534132 0 2024-09-17T01:02:06.874 INFO:tasks.workunit.client.1.smithi099.stdout:9/913: dwrite da/fd4 [0,4194304] 0 2024-09-17T01:02:06.874 INFO:tasks.workunit.client.0.smithi002.stdout:9/894: rmdir d5/dc/d26 39 2024-09-17T01:02:06.876 INFO:tasks.workunit.client.0.smithi002.stdout:9/895: mkdir d5/dc/d26/d46/d47/d89/d117 0 2024-09-17T01:02:06.881 INFO:tasks.workunit.client.0.smithi002.stdout:1/995: sync 2024-09-17T01:02:06.881 INFO:tasks.workunit.client.1.smithi099.stdout:4/893: sync 2024-09-17T01:02:06.881 INFO:tasks.workunit.client.1.smithi099.stdout:2/756: sync 2024-09-17T01:02:06.881 INFO:tasks.workunit.client.0.smithi002.stdout:1/996: write d4/d11/d55/d7a/fa5 [259978,105809] 0 2024-09-17T01:02:06.882 INFO:tasks.workunit.client.0.smithi002.stdout:1/997: write d4/d11/d12/d30/fb1 [535879,97021] 0 2024-09-17T01:02:06.882 INFO:tasks.workunit.client.0.smithi002.stdout:1/998: readlink d4/d11/d12/d14/l108 0 2024-09-17T01:02:06.887 INFO:tasks.workunit.client.1.smithi099.stdout:4/894: rmdir d7/dd/de/d10/d6b/d82 39 2024-09-17T01:02:06.887 INFO:tasks.workunit.client.1.smithi099.stdout:4/895: dread - d7/d35/d98/fed zero size 2024-09-17T01:02:06.889 INFO:tasks.workunit.client.1.smithi099.stdout:4/896: rename d7/dd/d21/d7b/l66 to d7/dd/de/l128 0 2024-09-17T01:02:06.890 INFO:tasks.workunit.client.1.smithi099.stdout:4/897: truncate d7/dd/d21/d7b/fb1 1381203 0 2024-09-17T01:02:06.890 INFO:tasks.workunit.client.1.smithi099.stdout:4/898: fdatasync d7/d35/f78 0 2024-09-17T01:02:06.890 INFO:tasks.workunit.client.1.smithi099.stdout:4/899: chown d7/dd/d21/d7b/d74/f75 16654653 1 2024-09-17T01:02:06.891 INFO:tasks.workunit.client.1.smithi099.stdout:4/900: link d7/dd/d21/d26/d3f/d5b/c31 d7/dd/d21/d7b/d74/c129 0 2024-09-17T01:02:06.892 INFO:tasks.workunit.client.1.smithi099.stdout:4/901: mknod d7/dd/d21/d26/ddb/c12a 0 2024-09-17T01:02:06.893 INFO:tasks.workunit.client.1.smithi099.stdout:4/902: dread - d7/dd/de/d10/d6b/f11c zero size 2024-09-17T01:02:06.899 INFO:tasks.workunit.client.0.smithi002.stdout:9/896: dwrite d5/dc/d26/d5c/d6b/d75/d57/d8d/ff3 [0,4194304] 0 2024-09-17T01:02:06.899 INFO:tasks.workunit.client.0.smithi002.stdout:9/897: readlink d5/dc/d26/d5c/d6b/d75/d57/d8d/l82 0 2024-09-17T01:02:06.903 INFO:tasks.workunit.client.1.smithi099.stdout:2/757: dwrite d2/d9/d17/f78 [0,4194304] 0 2024-09-17T01:02:06.905 INFO:tasks.workunit.client.1.smithi099.stdout:2/758: rename d2/d9/d17/d83/d8d/dd4 to d2/d9/d25/d26/d1b/d2c/d9b/df7 0 2024-09-17T01:02:06.909 INFO:tasks.workunit.client.1.smithi099.stdout:4/903: write d7/dd/de/f4e [723745,63975] 0 2024-09-17T01:02:06.923 INFO:tasks.workunit.client.0.smithi002.stdout:9/898: dwrite d5/dc/d26/d5c/d6b/d75/d57/d7a/f8b [4194304,4194304] 0 2024-09-17T01:02:06.923 INFO:tasks.workunit.client.0.smithi002.stdout:9/899: chown d5/dc/d26/d5c/d6b/d75/d57/f85 38963558 1 2024-09-17T01:02:06.925 INFO:tasks.workunit.client.0.smithi002.stdout:9/900: symlink d5/l118 0 2024-09-17T01:02:06.926 INFO:tasks.workunit.client.0.smithi002.stdout:9/901: rmdir d5/dc/d26/d5c/d6b/d75/d57 39 2024-09-17T01:02:06.926 INFO:tasks.workunit.client.0.smithi002.stdout:9/902: write d5/dc/d26/fbd [206088,124723] 0 2024-09-17T01:02:06.926 INFO:tasks.workunit.client.0.smithi002.stdout:9/903: getdents d5/dc/d26/d63/d108 0 2024-09-17T01:02:06.926 INFO:tasks.workunit.client.0.smithi002.stdout:9/904: chown d5/dc/d26/d63/d66/dd7/ff5 213164 1 2024-09-17T01:02:06.927 INFO:tasks.workunit.client.0.smithi002.stdout:9/905: creat d5/dc/d26/f119 x:0 0 0 2024-09-17T01:02:06.928 INFO:tasks.workunit.client.1.smithi099.stdout:4/904: write d7/dd/de/d17/f25 [2002199,29378] 0 2024-09-17T01:02:06.930 INFO:tasks.workunit.client.1.smithi099.stdout:4/905: link d7/dd/f79 d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/f12b 0 2024-09-17T01:02:06.932 INFO:tasks.workunit.client.1.smithi099.stdout:4/906: mkdir d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/d12c 0 2024-09-17T01:02:06.932 INFO:tasks.workunit.client.1.smithi099.stdout:4/907: dread - d7/dd/de/d10/f61 zero size 2024-09-17T01:02:06.932 INFO:tasks.workunit.client.1.smithi099.stdout:4/908: write d7/dd/de/d10/d85/f122 [1249817,6828] 0 2024-09-17T01:02:06.932 INFO:tasks.workunit.client.1.smithi099.stdout:4/909: creat d7/dd/d21/f12d x:0 0 0 2024-09-17T01:02:06.933 INFO:tasks.workunit.client.1.smithi099.stdout:4/910: read d7/dd/de/d10/d6b/f8b [74802,88392] 0 2024-09-17T01:02:06.934 INFO:tasks.workunit.client.1.smithi099.stdout:4/911: write f6 [3138434,71232] 0 2024-09-17T01:02:06.935 INFO:tasks.workunit.client.1.smithi099.stdout:2/759: dwrite d2/d9/d25/d26/d1b/f74 [0,4194304] 0 2024-09-17T01:02:06.937 INFO:tasks.workunit.client.1.smithi099.stdout:2/760: mkdir d2/d9/d25/df8 0 2024-09-17T01:02:06.937 INFO:tasks.workunit.client.1.smithi099.stdout:2/761: chown d2/d9/d17/d83/f99 2265 1 2024-09-17T01:02:06.937 INFO:tasks.workunit.client.1.smithi099.stdout:2/762: stat d2/d9/d25/c7e 0 2024-09-17T01:02:06.937 INFO:tasks.workunit.client.1.smithi099.stdout:2/763: stat d2/d9/c90 0 2024-09-17T01:02:06.938 INFO:tasks.workunit.client.1.smithi099.stdout:2/764: mknod d2/d9/cf9 0 2024-09-17T01:02:06.939 INFO:tasks.workunit.client.0.smithi002.stdout:9/906: dwrite d5/d8a/d9d/da7/ffc [0,4194304] 0 2024-09-17T01:02:06.939 INFO:tasks.workunit.client.1.smithi099.stdout:2/765: getdents d2/d9/d17/d83/d8d/dd9 0 2024-09-17T01:02:06.941 INFO:tasks.workunit.client.1.smithi099.stdout:2/766: truncate d2/d9/d17/f51 4055822 0 2024-09-17T01:02:06.942 INFO:tasks.workunit.client.1.smithi099.stdout:2/767: mkdir d2/d9/d17/d83/dca/dfa 0 2024-09-17T01:02:06.943 INFO:tasks.workunit.client.1.smithi099.stdout:2/768: mkdir d2/d9/d25/d26/d1b/d2c/d9b/de6/dfb 0 2024-09-17T01:02:06.945 INFO:tasks.workunit.client.1.smithi099.stdout:2/769: mkdir d2/d9/dfc 0 2024-09-17T01:02:06.947 INFO:tasks.workunit.client.1.smithi099.stdout:2/770: mkdir d2/d9/d25/d26/d1b/d61/d7d/d85/d98/dfd 0 2024-09-17T01:02:06.948 INFO:tasks.workunit.client.1.smithi099.stdout:4/912: dwrite d7/dd/d21/d7b/f89 [0,4194304] 0 2024-09-17T01:02:06.948 INFO:tasks.workunit.client.1.smithi099.stdout:4/913: write f1 [5036809,89468] 0 2024-09-17T01:02:06.948 INFO:tasks.workunit.client.1.smithi099.stdout:2/771: mkdir d2/d9/d17/d83/dca/dfa/dfe 0 2024-09-17T01:02:06.949 INFO:tasks.workunit.client.1.smithi099.stdout:2/772: fdatasync d2/d9/d25/d26/d1b/d2c/d9b/db1/fbd 0 2024-09-17T01:02:06.952 INFO:tasks.workunit.client.1.smithi099.stdout:4/914: symlink d7/dd/d21/d26/d3f/dff/l12e 0 2024-09-17T01:02:06.966 INFO:tasks.workunit.client.1.smithi099.stdout:2/773: dwrite d2/ff5 [0,4194304] 0 2024-09-17T01:02:06.971 INFO:tasks.workunit.client.1.smithi099.stdout:4/915: dread d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/fc1 [0,4194304] 0 2024-09-17T01:02:06.971 INFO:tasks.workunit.client.1.smithi099.stdout:4/916: write d7/dd/d21/fbd [264887,3149] 0 2024-09-17T01:02:06.971 INFO:tasks.workunit.client.1.smithi099.stdout:2/774: mkdir d2/d9/d25/d26/d1b/dff 0 2024-09-17T01:02:06.972 INFO:tasks.workunit.client.0.smithi002.stdout:3/906: sync 2024-09-17T01:02:06.972 INFO:tasks.workunit.client.0.smithi002.stdout:2/897: sync 2024-09-17T01:02:06.972 INFO:tasks.workunit.client.0.smithi002.stdout:2/898: stat d1b/d3f/d12a/f100 0 2024-09-17T01:02:06.973 INFO:tasks.workunit.client.0.smithi002.stdout:3/907: chown d0/c5 955 1 2024-09-17T01:02:06.973 INFO:tasks.workunit.client.0.smithi002.stdout:3/908: chown d0/d3/d17/f20 125 1 2024-09-17T01:02:06.974 INFO:tasks.workunit.client.0.smithi002.stdout:2/899: dread d1b/d1d/dd4/ff5 [0,4194304] 0 2024-09-17T01:02:06.974 INFO:tasks.workunit.client.0.smithi002.stdout:3/909: creat d0/d3/d33/d99/dab/ded/f121 x:0 0 0 2024-09-17T01:02:06.976 INFO:tasks.workunit.client.0.smithi002.stdout:2/900: rmdir d1b/d3f/d59/d7f/dc9/d13b 0 2024-09-17T01:02:06.979 INFO:tasks.workunit.client.0.smithi002.stdout:2/901: symlink d1b/l142 0 2024-09-17T01:02:06.981 INFO:tasks.workunit.client.1.smithi099.stdout:4/917: write d7/dd/d21/d26/d3f/d5b/f2d [103565,60016] 0 2024-09-17T01:02:06.981 INFO:tasks.workunit.client.1.smithi099.stdout:7/862: sync 2024-09-17T01:02:06.981 INFO:tasks.workunit.client.1.smithi099.stdout:7/863: readlink d1/d37/d4f/d107/d5c/l2f 0 2024-09-17T01:02:06.981 INFO:tasks.workunit.client.1.smithi099.stdout:5/980: sync 2024-09-17T01:02:06.982 INFO:tasks.workunit.client.0.smithi002.stdout:3/910: dread d0/d3/d33/d40/f45 [0,4194304] 0 2024-09-17T01:02:06.984 INFO:tasks.workunit.client.1.smithi099.stdout:7/864: rename d1/d37/d4f/d107/d7a/dac/fc5 to d1/d37/d4f/d107/d5c/d1c/d5a/d76/f111 0 2024-09-17T01:02:06.984 INFO:tasks.workunit.client.1.smithi099.stdout:7/865: stat d1/d37/d4f/d107/f40 0 2024-09-17T01:02:06.984 INFO:tasks.workunit.client.0.smithi002.stdout:3/911: dread d0/d3/d33/d99/fd2 [0,4194304] 0 2024-09-17T01:02:06.986 INFO:tasks.workunit.client.0.smithi002.stdout:3/912: mknod d0/d3/d17/d87/d9e/dd4/c122 0 2024-09-17T01:02:06.986 INFO:tasks.workunit.client.0.smithi002.stdout:3/913: dread - d0/d3/d8d/fee zero size 2024-09-17T01:02:06.987 INFO:tasks.workunit.client.1.smithi099.stdout:7/866: creat d1/d37/d4f/d107/d47/d48/f112 x:0 0 0 2024-09-17T01:02:06.987 INFO:tasks.workunit.client.0.smithi002.stdout:3/914: creat d0/d3/d37/dac/f123 x:0 0 0 2024-09-17T01:02:06.987 INFO:tasks.workunit.client.0.smithi002.stdout:3/915: fsync d0/d3/d37/dac/fe1 0 2024-09-17T01:02:06.988 INFO:tasks.workunit.client.0.smithi002.stdout:3/916: symlink d0/d3/d17/d84/dd9/d106/l124 0 2024-09-17T01:02:06.988 INFO:tasks.workunit.client.1.smithi099.stdout:5/981: getdents d2/dc4/d99/dd0/db2 0 2024-09-17T01:02:06.988 INFO:tasks.workunit.client.1.smithi099.stdout:5/982: chown d2/d26/d64/l7b 5782 1 2024-09-17T01:02:06.988 INFO:tasks.workunit.client.1.smithi099.stdout:5/983: chown d2/dc4/c8c 814419339 1 2024-09-17T01:02:06.988 INFO:tasks.workunit.client.1.smithi099.stdout:5/984: write d2/dc4/d99/dd0/ff7 [845236,3210] 0 2024-09-17T01:02:06.989 INFO:tasks.workunit.client.0.smithi002.stdout:3/917: symlink d0/d3/d33/d40/l125 0 2024-09-17T01:02:06.989 INFO:tasks.workunit.client.0.smithi002.stdout:3/918: truncate d0/d3/d37/dac/da1/fb6 3573877 0 2024-09-17T01:02:06.990 INFO:tasks.workunit.client.1.smithi099.stdout:7/867: creat d1/d37/d4f/d107/d5c/d12/dc2/f113 x:0 0 0 2024-09-17T01:02:06.990 INFO:tasks.workunit.client.1.smithi099.stdout:5/985: mkdir d2/dc4/d99/dd0/dc3/d149 0 2024-09-17T01:02:06.991 INFO:tasks.workunit.client.0.smithi002.stdout:3/919: creat d0/d3/d17/d87/d9e/dd4/f126 x:0 0 0 2024-09-17T01:02:06.991 INFO:tasks.workunit.client.0.smithi002.stdout:3/920: chown d0/d31/d8b/ce5 1989 1 2024-09-17T01:02:06.991 INFO:tasks.workunit.client.1.smithi099.stdout:7/868: mkdir d1/d37/d78/db2/d114 0 2024-09-17T01:02:06.992 INFO:tasks.workunit.client.1.smithi099.stdout:7/869: mkdir d1/d37/d4f/d107/d5c/d1c/d5a/d76/d115 0 2024-09-17T01:02:06.992 INFO:tasks.workunit.client.0.smithi002.stdout:3/921: mkdir d0/d31/d8b/d127 0 2024-09-17T01:02:06.994 INFO:tasks.workunit.client.1.smithi099.stdout:5/986: dread d2/d26/d64/df8/ffa [0,4194304] 0 2024-09-17T01:02:06.994 INFO:tasks.workunit.client.1.smithi099.stdout:2/775: dwrite d2/d9/d17/d83/f8a [0,4194304] 0 2024-09-17T01:02:06.995 INFO:tasks.workunit.client.0.smithi002.stdout:3/922: creat d0/f128 x:0 0 0 2024-09-17T01:02:06.996 INFO:tasks.workunit.client.0.smithi002.stdout:3/923: mknod d0/d31/d32/dcb/dd7/c129 0 2024-09-17T01:02:06.996 INFO:tasks.workunit.client.0.smithi002.stdout:2/902: write d1b/d74/d93/fa4 [2309739,54007] 0 2024-09-17T01:02:06.997 INFO:tasks.workunit.client.1.smithi099.stdout:7/870: dread d1/d37/d4f/d107/d5c/d12/f4b [0,4194304] 0 2024-09-17T01:02:06.997 INFO:tasks.workunit.client.1.smithi099.stdout:7/871: readlink d1/d37/d4f/d107/d5c/d3f/l68 0 2024-09-17T01:02:06.997 INFO:tasks.workunit.client.1.smithi099.stdout:2/776: rename d2/d9/d25/d26/d1b/d61/d7d/d85/d98/d9a/c9d to d2/d9/d25/d26/d1b/d61/d7d/d85/d98/dfd/c100 0 2024-09-17T01:02:06.999 INFO:tasks.workunit.client.1.smithi099.stdout:7/872: link d1/d37/d4f/d107/d5c/f13 d1/d37/d4f/d107/d47/d48/f116 0 2024-09-17T01:02:07.001 INFO:tasks.workunit.client.0.smithi002.stdout:2/903: dread d1b/d37/d48/d78/f117 [0,4194304] 0 2024-09-17T01:02:07.001 INFO:tasks.workunit.client.0.smithi002.stdout:3/924: rmdir d0/d3/d37/dac/da1/de4 39 2024-09-17T01:02:07.001 INFO:tasks.workunit.client.0.smithi002.stdout:3/925: fdatasync d0/d3/d17/d6a/f6c 0 2024-09-17T01:02:07.001 INFO:tasks.workunit.client.0.smithi002.stdout:3/926: truncate d0/d31/ffa 601576 0 2024-09-17T01:02:07.001 INFO:tasks.workunit.client.0.smithi002.stdout:3/927: write d0/d3/d17/f20 [1811218,38483] 0 2024-09-17T01:02:07.001 INFO:tasks.workunit.client.0.smithi002.stdout:3/928: write d0/f128 [240083,94008] 0 2024-09-17T01:02:07.002 INFO:tasks.workunit.client.1.smithi099.stdout:2/777: dread d2/d9/d25/d26/d1b/dad/fc3 [0,4194304] 0 2024-09-17T01:02:07.002 INFO:tasks.workunit.client.1.smithi099.stdout:2/778: readlink d2/d9/d25/d26/d1b/l59 0 2024-09-17T01:02:07.003 INFO:tasks.workunit.client.0.smithi002.stdout:3/929: truncate d0/d3/d17/d87/d9e/dd4/f10b 60349 0 2024-09-17T01:02:07.003 INFO:tasks.workunit.client.1.smithi099.stdout:4/918: dwrite d7/dd/d21/d26/d3f/f8f [0,4194304] 0 2024-09-17T01:02:07.003 INFO:tasks.workunit.client.1.smithi099.stdout:4/919: chown d7/dd/de/d10/d6b/l93 5836 1 2024-09-17T01:02:07.003 INFO:tasks.workunit.client.1.smithi099.stdout:4/920: chown d7/dd/d92 1430 1 2024-09-17T01:02:07.004 INFO:tasks.workunit.client.0.smithi002.stdout:3/930: mknod d0/d3/d37/dac/d11f/c12a 0 2024-09-17T01:02:07.006 INFO:tasks.workunit.client.0.smithi002.stdout:3/931: mknod d0/d31/d8b/c12b 0 2024-09-17T01:02:07.006 INFO:tasks.workunit.client.0.smithi002.stdout:3/932: truncate d0/d3/d33/d4a/f11d 129968 0 2024-09-17T01:02:07.006 INFO:tasks.workunit.client.0.smithi002.stdout:3/933: readlink d0/d3/d17/l54 0 2024-09-17T01:02:07.009 INFO:tasks.workunit.client.1.smithi099.stdout:4/921: mkdir d7/dd/d21/d7b/d4b/d12f 0 2024-09-17T01:02:07.009 INFO:tasks.workunit.client.1.smithi099.stdout:5/987: read d2/dc4/d99/dd0/db2/fb5 [468316,86736] 0 2024-09-17T01:02:07.009 INFO:tasks.workunit.client.1.smithi099.stdout:2/779: write d2/d9/d25/d26/d1b/d2c/f9c [247211,55581] 0 2024-09-17T01:02:07.010 INFO:tasks.workunit.client.1.smithi099.stdout:4/922: creat d7/dd/de/d10/d6b/d82/d8a/d9a/da6/f130 x:0 0 0 2024-09-17T01:02:07.010 INFO:tasks.workunit.client.1.smithi099.stdout:4/923: truncate d7/f8 1745427 0 2024-09-17T01:02:07.011 INFO:tasks.workunit.client.0.smithi002.stdout:2/904: write d1b/d74/f9f [867957,10491] 0 2024-09-17T01:02:07.012 INFO:tasks.workunit.client.1.smithi099.stdout:5/988: rmdir d2/dc/d14/d36 39 2024-09-17T01:02:07.012 INFO:tasks.workunit.client.1.smithi099.stdout:5/989: write d2/d26/f2a [1266973,53354] 0 2024-09-17T01:02:07.015 INFO:tasks.workunit.client.0.smithi002.stdout:3/934: rename d0/d3/d37 to d0/d31/d32/d12c 0 2024-09-17T01:02:07.016 INFO:tasks.workunit.client.1.smithi099.stdout:2/780: link d2/d9/d25/l39 d2/d9/d17/de0/l101 0 2024-09-17T01:02:07.018 INFO:tasks.workunit.client.1.smithi099.stdout:4/924: rename d7/dd/de/ff to d7/dd/d21/d26/d3f/d5b/da4/f131 0 2024-09-17T01:02:07.020 INFO:tasks.workunit.client.1.smithi099.stdout:5/990: mkdir d2/d26/d64/de2/d107/d14a 0 2024-09-17T01:02:07.021 INFO:tasks.workunit.client.1.smithi099.stdout:2/781: creat d2/d9/d25/d26/d1b/d2c/d9b/db1/f102 x:0 0 0 2024-09-17T01:02:07.022 INFO:tasks.workunit.client.0.smithi002.stdout:3/935: dread d0/d31/d32/f25 [0,4194304] 0 2024-09-17T01:02:07.023 INFO:tasks.workunit.client.1.smithi099.stdout:7/873: dwrite d1/d37/d4f/faf [0,4194304] 0 2024-09-17T01:02:07.023 INFO:tasks.workunit.client.1.smithi099.stdout:5/991: rename d2/dc4/d99/dd0/db2/fb5 to d2/dc/f14b 0 2024-09-17T01:02:07.024 INFO:tasks.workunit.client.1.smithi099.stdout:4/925: write d7/dd/de/d10/d6b/f95 [26133,50719] 0 2024-09-17T01:02:07.030 INFO:tasks.workunit.client.1.smithi099.stdout:7/874: rename d1/d37/d4f/d107/d47/d48/fc4 to d1/d37/d4f/d107/d5c/d1c/d5a/d76/f117 0 2024-09-17T01:02:07.031 INFO:tasks.workunit.client.1.smithi099.stdout:7/875: chown d1/d37/d4f/cfc 466 1 2024-09-17T01:02:07.032 INFO:tasks.workunit.client.1.smithi099.stdout:5/992: mknod d2/d26/c14c 0 2024-09-17T01:02:07.032 INFO:tasks.workunit.client.1.smithi099.stdout:5/993: fsync d2/dc/d97/fe1 0 2024-09-17T01:02:07.034 INFO:tasks.workunit.client.1.smithi099.stdout:4/926: creat d7/dd/de/d10/d6b/d82/f132 x:0 0 0 2024-09-17T01:02:07.034 INFO:tasks.workunit.client.1.smithi099.stdout:4/927: truncate d7/dd/d21/f12d 123230 0 2024-09-17T01:02:07.034 INFO:tasks.workunit.client.1.smithi099.stdout:4/928: fdatasync d7/d35/d98/fed 0 2024-09-17T01:02:07.034 INFO:tasks.workunit.client.1.smithi099.stdout:5/994: truncate d2/dc/d6c/f125 352138 0 2024-09-17T01:02:07.034 INFO:tasks.workunit.client.1.smithi099.stdout:5/995: chown d2/dc/d17/d3c/d72/f79 14154 1 2024-09-17T01:02:07.036 INFO:tasks.workunit.client.1.smithi099.stdout:5/996: rmdir d2/dc/d14/d36/d9a/daa 39 2024-09-17T01:02:07.041 INFO:tasks.workunit.client.1.smithi099.stdout:5/997: mknod d2/dc4/d99/dd0/c14d 0 2024-09-17T01:02:07.041 INFO:tasks.workunit.client.1.smithi099.stdout:5/998: write d2/dc/d17/d3c/d72/f79 [1173363,57619] 0 2024-09-17T01:02:07.044 INFO:tasks.workunit.client.1.smithi099.stdout:2/782: dwrite d2/d9/d17/d58/faa [0,4194304] 0 2024-09-17T01:02:07.064 INFO:tasks.workunit.client.1.smithi099.stdout:2/783: write d2/d9/d25/d26/d1b/f7c [4079614,1152] 0 2024-09-17T01:02:07.066 INFO:tasks.workunit.client.1.smithi099.stdout:6/911: sync 2024-09-17T01:02:07.067 INFO:tasks.workunit.client.1.smithi099.stdout:4/929: dwrite d7/dd/de/d10/d6b/f8b [0,4194304] 0 2024-09-17T01:02:07.067 INFO:tasks.workunit.client.1.smithi099.stdout:4/930: fdatasync d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/f12b 0 2024-09-17T01:02:07.068 INFO:tasks.workunit.client.1.smithi099.stdout:4/931: truncate d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/d83/ff1 4865832 0 2024-09-17T01:02:07.068 INFO:tasks.workunit.client.1.smithi099.stdout:6/912: mkdir dc/d5d/dae/d96/dfd/d101/d139 0 2024-09-17T01:02:07.069 INFO:tasks.workunit.client.1.smithi099.stdout:4/932: creat d7/dd/de/d10/d6b/d10c/f133 x:0 0 0 2024-09-17T01:02:07.070 INFO:tasks.workunit.client.1.smithi099.stdout:4/933: rename d7/dd/de/lf9 to d7/dd/de/d10/d6b/d10c/l134 0 2024-09-17T01:02:07.071 INFO:tasks.workunit.client.1.smithi099.stdout:4/934: creat d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/d83/f135 x:0 0 0 2024-09-17T01:02:07.072 INFO:tasks.workunit.client.1.smithi099.stdout:7/876: dwrite d1/d37/d4f/d107/d47/d48/f69 [0,4194304] 0 2024-09-17T01:02:07.074 INFO:tasks.workunit.client.0.smithi002.stdout:3/936: dwrite d0/d3/d17/d9a/f89 [0,4194304] 0 2024-09-17T01:02:07.074 INFO:tasks.workunit.client.0.smithi002.stdout:3/937: chown d0/d3/d33/d77/l8c 180657 1 2024-09-17T01:02:07.074 INFO:tasks.workunit.client.0.smithi002.stdout:3/938: creat d0/d31/da7/ddd/f12d x:0 0 0 2024-09-17T01:02:07.074 INFO:tasks.workunit.client.0.smithi002.stdout:3/939: readlink d0/d3/d17/l64 0 2024-09-17T01:02:07.074 INFO:tasks.workunit.client.1.smithi099.stdout:5/999: dwrite d2/dc/d17/d3c/d81/f123 [0,4194304] 0 2024-09-17T01:02:07.076 INFO:tasks.workunit.client.1.smithi099.stdout:2/784: dread d2/d9/d17/f76 [0,4194304] 0 2024-09-17T01:02:07.078 INFO:tasks.workunit.client.1.smithi099.stdout:6/913: write dc/d27/d7e/f94 [2324857,100628] 0 2024-09-17T01:02:07.080 INFO:tasks.workunit.client.0.smithi002.stdout:3/940: dread d0/d3/d33/d40/f45 [0,4194304] 0 2024-09-17T01:02:07.080 INFO:tasks.workunit.client.0.smithi002.stdout:3/941: getdents d0/d31/d8b/d127 0 2024-09-17T01:02:07.083 INFO:tasks.workunit.client.1.smithi099.stdout:6/914: rename dc/d5d/dae/d132/d87/lc4 to dc/d1a/d49/da8/d110/d119/l13a 0 2024-09-17T01:02:07.083 INFO:tasks.workunit.client.0.smithi002.stdout:0/862: sync 2024-09-17T01:02:07.084 INFO:tasks.workunit.client.1.smithi099.stdout:2/785: dread d2/d9/d25/d26/d1b/dad/f3a [0,4194304] 0 2024-09-17T01:02:07.084 INFO:tasks.workunit.client.0.smithi002.stdout:0/863: write dd/d19/d9f/fb0 [763403,41435] 0 2024-09-17T01:02:07.085 INFO:tasks.workunit.client.0.smithi002.stdout:0/864: truncate dd/d19/d1c/deb/f11f 1017732 0 2024-09-17T01:02:07.085 INFO:tasks.workunit.client.0.smithi002.stdout:0/865: chown dd/l10 18402177 1 2024-09-17T01:02:07.085 INFO:tasks.workunit.client.0.smithi002.stdout:0/866: write dd/d19/d1c/d1f/dc4/ff4 [3321903,79153] 0 2024-09-17T01:02:07.086 INFO:tasks.workunit.client.1.smithi099.stdout:6/915: getdents dc/d2b 0 2024-09-17T01:02:07.086 INFO:tasks.workunit.client.1.smithi099.stdout:6/916: fdatasync dc/d2b/d11e/d106/f116 0 2024-09-17T01:02:07.093 INFO:tasks.workunit.client.0.smithi002.stdout:3/942: write d0/f23 [2901441,87670] 0 2024-09-17T01:02:07.097 INFO:tasks.workunit.client.1.smithi099.stdout:4/935: dwrite d7/fc [0,4194304] 0 2024-09-17T01:02:07.097 INFO:tasks.workunit.client.1.smithi099.stdout:4/936: fdatasync d7/dd/d21/d7b/d4b/f27 0 2024-09-17T01:02:07.097 INFO:tasks.workunit.client.1.smithi099.stdout:4/937: read - d7/dd/de/d10/d85/f119 zero size 2024-09-17T01:02:07.104 INFO:tasks.workunit.client.1.smithi099.stdout:2/786: dwrite d2/d9/d25/d26/d1b/d2c/f52 [0,4194304] 0 2024-09-17T01:02:07.106 INFO:tasks.workunit.client.1.smithi099.stdout:2/787: creat d2/d9/d17/de0/f103 x:0 0 0 2024-09-17T01:02:07.112 INFO:tasks.workunit.client.0.smithi002.stdout:3/943: dwrite d0/d31/d32/d92/fda [0,4194304] 0 2024-09-17T01:02:07.116 INFO:tasks.workunit.client.1.smithi099.stdout:2/788: dread d2/d9/d25/d97/ff3 [4194304,4194304] 0 2024-09-17T01:02:07.116 INFO:tasks.workunit.client.1.smithi099.stdout:2/789: creat d2/d9/d25/d26/d1b/d61/d7d/d85/d98/f104 x:0 0 0 2024-09-17T01:02:07.118 INFO:tasks.workunit.client.1.smithi099.stdout:2/790: mknod d2/d9/d25/d26/d1b/d2c/d9b/c105 0 2024-09-17T01:02:07.119 INFO:tasks.workunit.client.1.smithi099.stdout:2/791: creat d2/d9/d17/d83/d8d/d8f/f106 x:0 0 0 2024-09-17T01:02:07.136 INFO:tasks.workunit.client.1.smithi099.stdout:9/914: sync 2024-09-17T01:02:07.136 INFO:tasks.workunit.client.1.smithi099.stdout:0/947: sync 2024-09-17T01:02:07.137 INFO:tasks.workunit.client.1.smithi099.stdout:0/948: mkdir da/d12/d2b/d13a 0 2024-09-17T01:02:07.138 INFO:tasks.workunit.client.1.smithi099.stdout:0/949: mknod da/df/d1a/d49/d68/d9f/dd7/c13b 0 2024-09-17T01:02:07.159 INFO:tasks.workunit.client.1.smithi099.stdout:9/915: dwrite da/d50/ffa [0,4194304] 0 2024-09-17T01:02:07.162 INFO:tasks.workunit.client.1.smithi099.stdout:9/916: truncate da/f64 2031243 0 2024-09-17T01:02:07.181 INFO:tasks.workunit.client.1.smithi099.stdout:9/917: dwrite da/d50/d104/d105/fd0 [0,4194304] 0 2024-09-17T01:02:07.181 INFO:tasks.workunit.client.1.smithi099.stdout:9/918: creat da/d8e/dbf/f127 x:0 0 0 2024-09-17T01:02:07.181 INFO:tasks.workunit.client.1.smithi099.stdout:9/919: chown da/d8e/fd9 21880 1 2024-09-17T01:02:07.181 INFO:tasks.workunit.client.1.smithi099.stdout:9/920: fsync da/d14/f29 0 2024-09-17T01:02:07.184 INFO:tasks.workunit.client.1.smithi099.stdout:9/921: rmdir da/d14/d6d 39 2024-09-17T01:02:07.184 INFO:tasks.workunit.client.1.smithi099.stdout:9/922: truncate da/d18/d5e/fe7 894348 0 2024-09-17T01:02:07.184 INFO:tasks.workunit.client.1.smithi099.stdout:9/923: fdatasync da/d21/f3b 0 2024-09-17T01:02:07.185 INFO:tasks.workunit.client.1.smithi099.stdout:9/924: symlink da/l128 0 2024-09-17T01:02:07.199 INFO:tasks.workunit.client.1.smithi099.stdout:9/925: dwrite da/d18/d5e/f67 [0,4194304] 0 2024-09-17T01:02:07.202 INFO:tasks.workunit.client.1.smithi099.stdout:9/926: symlink da/d9a/d3a/l129 0 2024-09-17T01:02:07.207 INFO:tasks.workunit.client.0.smithi002.stdout:9/907: sync 2024-09-17T01:02:07.207 INFO:tasks.workunit.client.0.smithi002.stdout:1/999: sync 2024-09-17T01:02:07.208 INFO:tasks.workunit.client.0.smithi002.stdout:9/908: link d5/dc/d26/d9c/fdb d5/dc/d26/d9c/f11a 0 2024-09-17T01:02:07.208 INFO:tasks.workunit.client.0.smithi002.stdout:9/909: chown d5/le6 3 1 2024-09-17T01:02:07.208 INFO:tasks.workunit.client.0.smithi002.stdout:9/910: readlink d5/dc/d26/d5c/d6b/d75/d57/d7a/da2/l116 0 2024-09-17T01:02:07.209 INFO:tasks.workunit.client.0.smithi002.stdout:0/867: sync 2024-09-17T01:02:07.209 INFO:tasks.workunit.client.0.smithi002.stdout:3/944: rmdir d0/d31 39 2024-09-17T01:02:07.210 INFO:tasks.workunit.client.0.smithi002.stdout:2/905: sync 2024-09-17T01:02:07.210 INFO:tasks.workunit.client.1.smithi099.stdout:9/927: dread da/f44 [0,4194304] 0 2024-09-17T01:02:07.210 INFO:tasks.workunit.client.0.smithi002.stdout:3/945: fdatasync d0/d31/d32/d12c/f74 0 2024-09-17T01:02:07.210 INFO:tasks.workunit.client.0.smithi002.stdout:3/946: write d0/d3/f3c [1564827,9598] 0 2024-09-17T01:02:07.211 INFO:tasks.workunit.client.0.smithi002.stdout:9/911: dread d5/dc/f3d [4194304,4194304] 0 2024-09-17T01:02:07.211 INFO:tasks.workunit.client.1.smithi099.stdout:9/928: getdents da/d8e/dbf 0 2024-09-17T01:02:07.211 INFO:tasks.workunit.client.0.smithi002.stdout:2/906: symlink d1b/d8a/d92/dae/dec/l143 0 2024-09-17T01:02:07.211 INFO:tasks.workunit.client.0.smithi002.stdout:2/907: chown d1b/d37/d48/d52/f126 226 1 2024-09-17T01:02:07.213 INFO:tasks.workunit.client.1.smithi099.stdout:9/929: symlink da/d56/l12a 0 2024-09-17T01:02:07.213 INFO:tasks.workunit.client.1.smithi099.stdout:9/930: creat da/d50/d104/f12b x:0 0 0 2024-09-17T01:02:07.213 INFO:tasks.workunit.client.1.smithi099.stdout:9/931: truncate da/d14/ff8 816550 0 2024-09-17T01:02:07.213 INFO:tasks.workunit.client.0.smithi002.stdout:3/947: symlink d0/d31/d32/d12c/dac/d11f/l12e 0 2024-09-17T01:02:07.213 INFO:tasks.workunit.client.0.smithi002.stdout:3/948: fsync d0/d31/d32/fd5 0 2024-09-17T01:02:07.213 INFO:tasks.workunit.client.0.smithi002.stdout:9/912: chown d5/dc/c12 32 1 2024-09-17T01:02:07.215 INFO:tasks.workunit.client.0.smithi002.stdout:9/913: symlink d5/dc/d26/d5c/d6b/d75/d36/l11b 0 2024-09-17T01:02:07.215 INFO:tasks.workunit.client.1.smithi099.stdout:9/932: link da/d21/l35 da/d56/d84/db9/l12c 0 2024-09-17T01:02:07.216 INFO:tasks.workunit.client.0.smithi002.stdout:9/914: creat d5/dc/d26/d46/d47/d89/d117/f11c x:0 0 0 2024-09-17T01:02:07.217 INFO:tasks.workunit.client.0.smithi002.stdout:9/915: creat d5/dc/d26/d5c/de4/f11d x:0 0 0 2024-09-17T01:02:07.217 INFO:tasks.workunit.client.0.smithi002.stdout:9/916: stat d5/dc/d26/c7f 0 2024-09-17T01:02:07.217 INFO:tasks.workunit.client.1.smithi099.stdout:9/933: rmdir da/d56/da5 39 2024-09-17T01:02:07.218 INFO:tasks.workunit.client.0.smithi002.stdout:9/917: readlink d5/dc/l59 0 2024-09-17T01:02:07.218 INFO:tasks.workunit.client.0.smithi002.stdout:9/918: read - d5/dc/d26/f114 zero size 2024-09-17T01:02:07.220 INFO:tasks.workunit.client.1.smithi099.stdout:9/934: rename da/d18/d49/f63 to da/d9b/dac/d106/f12d 0 2024-09-17T01:02:07.220 INFO:tasks.workunit.client.1.smithi099.stdout:9/935: stat da/d50/d104/d105/fd0 0 2024-09-17T01:02:07.221 INFO:tasks.workunit.client.0.smithi002.stdout:0/868: write dd/d19/d1a/d29/d55/f95 [2512945,125940] 0 2024-09-17T01:02:07.221 INFO:tasks.workunit.client.0.smithi002.stdout:3/949: dread d0/d3/d17/d84/ff5 [0,4194304] 0 2024-09-17T01:02:07.222 INFO:tasks.workunit.client.1.smithi099.stdout:9/936: mkdir da/d50/d104/d105/dad/ddc/d12e 0 2024-09-17T01:02:07.225 INFO:tasks.workunit.client.0.smithi002.stdout:0/869: rename dd/d19/d9f/f123 to dd/d19/da9/f129 0 2024-09-17T01:02:07.226 INFO:tasks.workunit.client.0.smithi002.stdout:3/950: link d0/d3/d17/d6a/f6c d0/d31/d32/d12c/f12f 0 2024-09-17T01:02:07.228 INFO:tasks.workunit.client.0.smithi002.stdout:3/951: dread d0/d3/d33/d99/fd2 [0,4194304] 0 2024-09-17T01:02:07.234 INFO:tasks.workunit.client.0.smithi002.stdout:2/908: dwrite d1b/d37/f80 [0,4194304] 0 2024-09-17T01:02:07.235 INFO:tasks.workunit.client.0.smithi002.stdout:9/919: dwrite d5/dc/d26/d5c/d6b/d75/f3f [0,4194304] 0 2024-09-17T01:02:07.235 INFO:tasks.workunit.client.0.smithi002.stdout:9/920: fdatasync d5/d8a/fd2 0 2024-09-17T01:02:07.237 INFO:tasks.workunit.client.0.smithi002.stdout:2/909: rmdir d1b/d3f/d59/d7f/dc9/d72/dda/d136 0 2024-09-17T01:02:07.237 INFO:tasks.workunit.client.1.smithi099.stdout:9/937: dread da/d56/d84/db9/f10f [0,4194304] 0 2024-09-17T01:02:07.241 INFO:tasks.workunit.client.0.smithi002.stdout:0/870: dread dd/d3d/d94/dd1/fd6 [0,4194304] 0 2024-09-17T01:02:07.241 INFO:tasks.workunit.client.0.smithi002.stdout:9/921: creat d5/dc/d26/d5c/d6b/d75/d36/f11e x:0 0 0 2024-09-17T01:02:07.241 INFO:tasks.workunit.client.0.smithi002.stdout:9/922: fsync d5/f19 0 2024-09-17T01:02:07.242 INFO:tasks.workunit.client.1.smithi099.stdout:9/938: dread da/d18/d49/fb7 [0,4194304] 0 2024-09-17T01:02:07.244 INFO:tasks.workunit.client.1.smithi099.stdout:9/939: getdents da/d50/d104/d105/d10a 0 2024-09-17T01:02:07.244 INFO:tasks.workunit.client.0.smithi002.stdout:2/910: creat d1b/d37/d48/d4e/dc5/f144 x:0 0 0 2024-09-17T01:02:07.244 INFO:tasks.workunit.client.1.smithi099.stdout:9/940: mknod da/d21/d2a/c12f 0 2024-09-17T01:02:07.245 INFO:tasks.workunit.client.1.smithi099.stdout:9/941: mknod da/d8e/c130 0 2024-09-17T01:02:07.246 INFO:tasks.workunit.client.1.smithi099.stdout:9/942: creat da/d8e/dbf/f131 x:0 0 0 2024-09-17T01:02:07.250 INFO:tasks.workunit.client.0.smithi002.stdout:9/923: write d5/dc/d26/d5c/d6b/d75/f42 [1009235,87018] 0 2024-09-17T01:02:07.250 INFO:tasks.workunit.client.0.smithi002.stdout:9/924: chown d5/dc/d26/d46/d47/da1/f10b 169 1 2024-09-17T01:02:07.251 INFO:tasks.workunit.client.0.smithi002.stdout:9/925: creat d5/dc/d26/d5c/d6b/f11f x:0 0 0 2024-09-17T01:02:07.252 INFO:tasks.workunit.client.0.smithi002.stdout:9/926: chown d5/dc/d26/fbd 77385 1 2024-09-17T01:02:07.252 INFO:tasks.workunit.client.0.smithi002.stdout:9/927: stat d5/dc/d26/d46/d47/d89/dec/ff6 0 2024-09-17T01:02:07.252 INFO:tasks.workunit.client.0.smithi002.stdout:9/928: truncate d5/dc/d26/d46/db4/f102 133951 0 2024-09-17T01:02:07.252 INFO:tasks.workunit.client.0.smithi002.stdout:3/952: dwrite d0/d3/d33/d4f/f53 [4194304,4194304] 0 2024-09-17T01:02:07.252 INFO:tasks.workunit.client.0.smithi002.stdout:3/953: chown d0/d3/d17/d84/dd9/cfc 104789 1 2024-09-17T01:02:07.253 INFO:tasks.workunit.client.0.smithi002.stdout:9/929: rename d5/d8a/d9d/da7 to d5/dc/d26/d5c/d120 0 2024-09-17T01:02:07.253 INFO:tasks.workunit.client.0.smithi002.stdout:3/954: mknod d0/d3/d17/d87/d9e/c130 0 2024-09-17T01:02:07.254 INFO:tasks.workunit.client.0.smithi002.stdout:9/930: link d5/dc/d26/c96 d5/dc/c121 0 2024-09-17T01:02:07.258 INFO:tasks.workunit.client.1.smithi099.stdout:9/943: dread da/fd4 [0,4194304] 0 2024-09-17T01:02:07.258 INFO:tasks.workunit.client.1.smithi099.stdout:9/944: write da/d50/d104/d105/dad/ddc/de6/f125 [1059719,127810] 0 2024-09-17T01:02:07.267 INFO:tasks.workunit.client.0.smithi002.stdout:3/955: write d0/d3/d17/f29 [6853169,60859] 0 2024-09-17T01:02:07.267 INFO:tasks.workunit.client.0.smithi002.stdout:3/956: stat d0/d3/d17/d87/d112 0 2024-09-17T01:02:07.268 INFO:tasks.workunit.client.0.smithi002.stdout:3/957: chown d0/d3/d33/d4f/f119 3253 1 2024-09-17T01:02:07.268 INFO:tasks.workunit.client.0.smithi002.stdout:3/958: chown d0/d31/d32/c5e 1 1 2024-09-17T01:02:07.272 INFO:tasks.workunit.client.0.smithi002.stdout:0/871: dwrite dd/d19/d9f/f115 [0,4194304] 0 2024-09-17T01:02:07.274 INFO:tasks.workunit.client.0.smithi002.stdout:0/872: getdents dd/d120/dbe/d113 0 2024-09-17T01:02:07.275 INFO:tasks.workunit.client.0.smithi002.stdout:9/931: dwrite d5/dc/d26/d46/fb6 [4194304,4194304] 0 2024-09-17T01:02:07.276 INFO:tasks.workunit.client.0.smithi002.stdout:0/873: getdents dd/d19/d1c/d1f/dc4 0 2024-09-17T01:02:07.276 INFO:tasks.workunit.client.0.smithi002.stdout:0/874: stat dd/d19/da9/de5/f74 0 2024-09-17T01:02:07.279 INFO:tasks.workunit.client.1.smithi099.stdout:9/945: dwrite da/d8e/dbf/f127 [0,4194304] 0 2024-09-17T01:02:07.279 INFO:tasks.workunit.client.1.smithi099.stdout:9/946: write da/d56/da5/f108 [914503,121770] 0 2024-09-17T01:02:07.279 INFO:tasks.workunit.client.1.smithi099.stdout:9/947: truncate da/d21/f8f 4290833 0 2024-09-17T01:02:07.279 INFO:tasks.workunit.client.0.smithi002.stdout:2/911: dwrite d1b/d37/f91 [0,4194304] 0 2024-09-17T01:02:07.279 INFO:tasks.workunit.client.0.smithi002.stdout:2/912: fsync d1b/d3f/d12a/f12d 0 2024-09-17T01:02:07.281 INFO:tasks.workunit.client.0.smithi002.stdout:2/913: rmdir d1b/d3f/d59/d7f/dc9/dac 39 2024-09-17T01:02:07.281 INFO:tasks.workunit.client.1.smithi099.stdout:9/948: creat da/d21/f132 x:0 0 0 2024-09-17T01:02:07.295 INFO:tasks.workunit.client.0.smithi002.stdout:2/914: write d1b/d1d/f1f [1758067,117618] 0 2024-09-17T01:02:07.297 INFO:tasks.workunit.client.0.smithi002.stdout:2/915: creat d1b/d37/d48/db1/dbb/f145 x:0 0 0 2024-09-17T01:02:07.298 INFO:tasks.workunit.client.0.smithi002.stdout:0/875: dread dd/d19/d1a/d29/d55/f95 [0,4194304] 0 2024-09-17T01:02:07.298 INFO:tasks.workunit.client.0.smithi002.stdout:3/959: dwrite d0/d3/d17/d9a/f89 [0,4194304] 0 2024-09-17T01:02:07.298 INFO:tasks.workunit.client.0.smithi002.stdout:0/876: truncate dd/d19/d1a/f5f 616912 0 2024-09-17T01:02:07.300 INFO:tasks.workunit.client.0.smithi002.stdout:0/877: symlink dd/d120/dbe/l12a 0 2024-09-17T01:02:07.300 INFO:tasks.workunit.client.0.smithi002.stdout:0/878: creat dd/d19/d1c/d78/f12b x:0 0 0 2024-09-17T01:02:07.302 INFO:tasks.workunit.client.0.smithi002.stdout:0/879: chown dd/d19/d1c/f79 0 1 2024-09-17T01:02:07.302 INFO:tasks.workunit.client.0.smithi002.stdout:0/880: write dd/d3d/f3f [8669659,126933] 0 2024-09-17T01:02:07.303 INFO:tasks.workunit.client.0.smithi002.stdout:9/932: dwrite d5/dc/d26/d5c/d6b/d75/d36/f11e [0,4194304] 0 2024-09-17T01:02:07.304 INFO:tasks.workunit.client.0.smithi002.stdout:0/881: mkdir dd/d19/d1c/d1f/dc4/d12c 0 2024-09-17T01:02:07.304 INFO:tasks.workunit.client.0.smithi002.stdout:0/882: write dd/d19/f1e [718565,55678] 0 2024-09-17T01:02:07.304 INFO:tasks.workunit.client.0.smithi002.stdout:9/933: mknod d5/dc/dbc/c122 0 2024-09-17T01:02:07.305 INFO:tasks.workunit.client.0.smithi002.stdout:9/934: fsync d5/dc/d26/f3b 0 2024-09-17T01:02:07.306 INFO:tasks.workunit.client.0.smithi002.stdout:0/883: rename dd/d19/d1c/db7/db4/lf3 to dd/d19/d1a/d29/d55/d56/l12d 0 2024-09-17T01:02:07.307 INFO:tasks.workunit.client.0.smithi002.stdout:9/935: link d5/d8a/fd2 d5/dc/d26/d5c/d6b/f123 0 2024-09-17T01:02:07.308 INFO:tasks.workunit.client.0.smithi002.stdout:0/884: rmdir dd/d19/d1c/d1f/dc4/d12c 0 2024-09-17T01:02:07.308 INFO:tasks.workunit.client.0.smithi002.stdout:0/885: write dd/d19/d1a/d29/d55/d56/f125 [236952,36928] 0 2024-09-17T01:02:07.308 INFO:tasks.workunit.client.0.smithi002.stdout:0/886: chown dd/d19/d1a/d29/d55/d56/f125 448 1 2024-09-17T01:02:07.309 INFO:tasks.workunit.client.0.smithi002.stdout:0/887: truncate dd/d19/d1c/d33/f106 158093 0 2024-09-17T01:02:07.310 INFO:tasks.workunit.client.0.smithi002.stdout:0/888: creat dd/d19/f12e x:0 0 0 2024-09-17T01:02:07.310 INFO:tasks.workunit.client.0.smithi002.stdout:0/889: write dd/f32 [2928264,90828] 0 2024-09-17T01:02:07.311 INFO:tasks.workunit.client.0.smithi002.stdout:0/890: creat dd/d19/d9f/f12f x:0 0 0 2024-09-17T01:02:07.311 INFO:tasks.workunit.client.0.smithi002.stdout:0/891: write dd/d19/d1a/d29/d55/d56/f11e [1034017,50256] 0 2024-09-17T01:02:07.313 INFO:tasks.workunit.client.1.smithi099.stdout:9/949: dwrite da/d9a/d3a/f26 [0,4194304] 0 2024-09-17T01:02:07.313 INFO:tasks.workunit.client.1.smithi099.stdout:9/950: fdatasync da/d18/d49/ffd 0 2024-09-17T01:02:07.314 INFO:tasks.workunit.client.1.smithi099.stdout:9/951: rename da/d21/d2a/f7f to da/d21/d5b/f133 0 2024-09-17T01:02:07.315 INFO:tasks.workunit.client.1.smithi099.stdout:9/952: dread - da/d56/d84/db9/ff7 zero size 2024-09-17T01:02:07.316 INFO:tasks.workunit.client.0.smithi002.stdout:3/960: dread d0/d3/d17/d9a/daa/fb1 [0,4194304] 0 2024-09-17T01:02:07.316 INFO:tasks.workunit.client.0.smithi002.stdout:3/961: readlink d0/d3/da8/lf0 0 2024-09-17T01:02:07.316 INFO:tasks.workunit.client.0.smithi002.stdout:3/962: chown d0/d3/d33/d40/fc9 532387191 1 2024-09-17T01:02:07.316 INFO:tasks.workunit.client.0.smithi002.stdout:3/963: chown d0/d31/d32/dcb/dd7/c129 10662145 1 2024-09-17T01:02:07.317 INFO:tasks.workunit.client.0.smithi002.stdout:3/964: mkdir d0/d31/d32/d12c/dac/da1/d118/d131 0 2024-09-17T01:02:07.317 INFO:tasks.workunit.client.0.smithi002.stdout:3/965: stat d0/d31/faf 0 2024-09-17T01:02:07.317 INFO:tasks.workunit.client.0.smithi002.stdout:3/966: creat d0/d31/d32/d12c/dac/da1/d118/f132 x:0 0 0 2024-09-17T01:02:07.317 INFO:tasks.workunit.client.0.smithi002.stdout:3/967: dread - d0/d3/d8d/ff1 zero size 2024-09-17T01:02:07.321 INFO:tasks.workunit.client.0.smithi002.stdout:9/936: dread d5/f10 [0,4194304] 0 2024-09-17T01:02:07.321 INFO:tasks.workunit.client.0.smithi002.stdout:9/937: chown d5/f3e 98771 1 2024-09-17T01:02:07.322 INFO:tasks.workunit.client.0.smithi002.stdout:9/938: symlink d5/dc/d26/d5c/d120/l124 0 2024-09-17T01:02:07.323 INFO:tasks.workunit.client.0.smithi002.stdout:2/916: dwrite d1b/d1d/d79/fd9 [4194304,4194304] 0 2024-09-17T01:02:07.325 INFO:tasks.workunit.client.0.smithi002.stdout:2/917: mkdir d1b/d37/dc1/d146 0 2024-09-17T01:02:07.326 INFO:tasks.workunit.client.0.smithi002.stdout:2/918: truncate d1b/d37/d48/d4e/f35 1855280 0 2024-09-17T01:02:07.329 INFO:tasks.workunit.client.0.smithi002.stdout:2/919: rename d1b/d3f/d59/d7f/dc9/d72/l107 to d1b/l147 0 2024-09-17T01:02:07.335 INFO:tasks.workunit.client.0.smithi002.stdout:0/892: dwrite dd/f18 [0,4194304] 0 2024-09-17T01:02:07.335 INFO:tasks.workunit.client.0.smithi002.stdout:0/893: write dd/f14 [1001202,17117] 0 2024-09-17T01:02:07.335 INFO:tasks.workunit.client.0.smithi002.stdout:0/894: read dd/d19/da9/de5/db9/fd2 [3797192,60462] 0 2024-09-17T01:02:07.336 INFO:tasks.workunit.client.0.smithi002.stdout:9/939: dread d5/dc/d26/d46/faf [0,4194304] 0 2024-09-17T01:02:07.337 INFO:tasks.workunit.client.0.smithi002.stdout:3/968: dwrite d0/d3/f19 [0,4194304] 0 2024-09-17T01:02:07.337 INFO:tasks.workunit.client.0.smithi002.stdout:9/940: dread d5/d8a/d9d/fa3 [0,4194304] 0 2024-09-17T01:02:07.339 INFO:tasks.workunit.client.0.smithi002.stdout:3/969: symlink d0/d3/d17/d87/d112/l133 0 2024-09-17T01:02:07.341 INFO:tasks.workunit.client.0.smithi002.stdout:9/941: creat d5/dc/d26/d5c/d6b/d75/d57/dba/d10f/f125 x:0 0 0 2024-09-17T01:02:07.341 INFO:tasks.workunit.client.0.smithi002.stdout:9/942: write d5/dc/d26/fbd [751735,74014] 0 2024-09-17T01:02:07.341 INFO:tasks.workunit.client.0.smithi002.stdout:2/920: dread d1b/d3f/d59/d7f/dc9/f51 [0,4194304] 0 2024-09-17T01:02:07.341 INFO:tasks.workunit.client.0.smithi002.stdout:2/921: fdatasync d1b/d1d/d79/fb2 0 2024-09-17T01:02:07.341 INFO:tasks.workunit.client.0.smithi002.stdout:2/922: creat d1b/d37/d48/db1/dbb/f148 x:0 0 0 2024-09-17T01:02:07.341 INFO:tasks.workunit.client.0.smithi002.stdout:9/943: stat d5/dc/d26/d5c/d6b/d75/d57/d7a/ld8 0 2024-09-17T01:02:07.342 INFO:tasks.workunit.client.0.smithi002.stdout:9/944: chown d5/dc/d26/d5c/d6b/d75/fcf 80 1 2024-09-17T01:02:07.342 INFO:tasks.workunit.client.0.smithi002.stdout:3/970: symlink d0/d3/l134 0 2024-09-17T01:02:07.342 INFO:tasks.workunit.client.0.smithi002.stdout:3/971: chown d0/d3/d17/d6a/fb7 266 1 2024-09-17T01:02:07.344 INFO:tasks.workunit.client.0.smithi002.stdout:2/923: mkdir d1b/d37/d48/db1/d149 0 2024-09-17T01:02:07.344 INFO:tasks.workunit.client.0.smithi002.stdout:2/924: creat d1b/d1d/dc8/f14a x:0 0 0 2024-09-17T01:02:07.344 INFO:tasks.workunit.client.0.smithi002.stdout:2/925: creat d1b/d3f/d59/d7f/dc9/d72/dda/f14b x:0 0 0 2024-09-17T01:02:07.344 INFO:tasks.workunit.client.0.smithi002.stdout:2/926: fsync d1b/f5f 0 2024-09-17T01:02:07.346 INFO:tasks.workunit.client.0.smithi002.stdout:9/945: creat d5/dc/d26/d46/d47/d89/dec/f126 x:0 0 0 2024-09-17T01:02:07.346 INFO:tasks.workunit.client.0.smithi002.stdout:9/946: truncate d5/dc/d26/f86 505967 0 2024-09-17T01:02:07.346 INFO:tasks.workunit.client.0.smithi002.stdout:9/947: creat d5/dc/d26/d5c/d6b/f127 x:0 0 0 2024-09-17T01:02:07.346 INFO:tasks.workunit.client.0.smithi002.stdout:9/948: dread - d5/dc/ffb zero size 2024-09-17T01:02:07.346 INFO:tasks.workunit.client.0.smithi002.stdout:3/972: symlink d0/d3/d17/d35/l135 0 2024-09-17T01:02:07.346 INFO:tasks.workunit.client.0.smithi002.stdout:3/973: chown d0/d31/d32/d92/fda 9421426 1 2024-09-17T01:02:07.352 INFO:tasks.workunit.client.0.smithi002.stdout:9/949: getdents d5/dc/d26/d5c/d6b/d75/d57/dba 0 2024-09-17T01:02:07.354 INFO:tasks.workunit.client.0.smithi002.stdout:3/974: rename d0/d3/d33/d40/fc9 to d0/d31/d32/f136 0 2024-09-17T01:02:07.354 INFO:tasks.workunit.client.0.smithi002.stdout:3/975: fdatasync d0/d3/d17/d84/ff5 0 2024-09-17T01:02:07.354 INFO:tasks.workunit.client.0.smithi002.stdout:3/976: stat d0/d3/d33/d77 0 2024-09-17T01:02:07.354 INFO:tasks.workunit.client.0.smithi002.stdout:3/977: stat d0/d31/d32/c5e 0 2024-09-17T01:02:07.354 INFO:tasks.workunit.client.0.smithi002.stdout:3/978: chown d0/d3/d17/d84/dd9/d106/l124 61130826 1 2024-09-17T01:02:07.356 INFO:tasks.workunit.client.0.smithi002.stdout:3/979: getdents d0/d31/d32/d12c/dac/da1/d118 0 2024-09-17T01:02:07.357 INFO:tasks.workunit.client.0.smithi002.stdout:0/895: dwrite dd/d19/d1a/d29/d55/f103 [0,4194304] 0 2024-09-17T01:02:07.357 INFO:tasks.workunit.client.0.smithi002.stdout:9/950: dread d5/dc/d26/d46/faf [0,4194304] 0 2024-09-17T01:02:07.357 INFO:tasks.workunit.client.0.smithi002.stdout:0/896: write dd/d19/d1a/d29/ff9 [719111,74189] 0 2024-09-17T01:02:07.358 INFO:tasks.workunit.client.0.smithi002.stdout:0/897: getdents dd/d19/d1c/d1f/d22/dc3 0 2024-09-17T01:02:07.358 INFO:tasks.workunit.client.0.smithi002.stdout:3/980: dread d0/d3/d33/f86 [4194304,4194304] 0 2024-09-17T01:02:07.363 INFO:tasks.workunit.client.0.smithi002.stdout:2/927: dwrite d1b/d37/d48/d4e/f81 [0,4194304] 0 2024-09-17T01:02:07.363 INFO:tasks.workunit.client.0.smithi002.stdout:2/928: chown d1b/d74/f99 80420263 1 2024-09-17T01:02:07.365 INFO:tasks.workunit.client.0.smithi002.stdout:3/981: mknod d0/d3/df3/c137 0 2024-09-17T01:02:07.370 INFO:tasks.workunit.client.0.smithi002.stdout:0/898: rename dd/d120/dbe/d113 to dd/d3d/d130 0 2024-09-17T01:02:07.376 INFO:tasks.workunit.client.0.smithi002.stdout:0/899: rename dd/f5a to dd/d19/d1a/d29/d55/f131 0 2024-09-17T01:02:07.376 INFO:tasks.workunit.client.0.smithi002.stdout:0/900: fdatasync dd/d19/f4e 0 2024-09-17T01:02:07.377 INFO:tasks.workunit.client.0.smithi002.stdout:0/901: creat dd/d19/d1c/d33/f132 x:0 0 0 2024-09-17T01:02:07.379 INFO:tasks.workunit.client.0.smithi002.stdout:2/929: dwrite d1b/d3f/d59/d7f/dc9/d72/dda/f125 [0,4194304] 0 2024-09-17T01:02:07.379 INFO:tasks.workunit.client.0.smithi002.stdout:0/902: creat dd/d19/d1c/d1f/d39/f133 x:0 0 0 2024-09-17T01:02:07.381 INFO:tasks.workunit.client.0.smithi002.stdout:2/930: creat d1b/d3f/d59/d7f/dc9/f14c x:0 0 0 2024-09-17T01:02:07.382 INFO:tasks.workunit.client.0.smithi002.stdout:2/931: link d1b/d3f/d59/d7f/dc9/dac/dbd/de8/f108 d1b/d37/d48/d52/db5/f14d 0 2024-09-17T01:02:07.384 INFO:tasks.workunit.client.0.smithi002.stdout:2/932: mknod d1b/d74/d93/d118/d120/c14e 0 2024-09-17T01:02:07.384 INFO:tasks.workunit.client.0.smithi002.stdout:2/933: read - d1b/d3f/d59/d7f/dc9/f11e zero size 2024-09-17T01:02:07.397 INFO:tasks.workunit.client.1.smithi099.stdout:0/950: sync 2024-09-17T01:02:07.397 INFO:tasks.workunit.client.1.smithi099.stdout:7/877: sync 2024-09-17T01:02:07.397 INFO:tasks.workunit.client.1.smithi099.stdout:2/792: sync 2024-09-17T01:02:07.397 INFO:tasks.workunit.client.1.smithi099.stdout:4/938: sync 2024-09-17T01:02:07.397 INFO:tasks.workunit.client.1.smithi099.stdout:6/917: sync 2024-09-17T01:02:07.397 INFO:tasks.workunit.client.1.smithi099.stdout:0/951: readlink da/d3b/l88 0 2024-09-17T01:02:07.397 INFO:tasks.workunit.client.1.smithi099.stdout:6/918: write dc/d27/ff8 [711741,109358] 0 2024-09-17T01:02:07.397 INFO:tasks.workunit.client.1.smithi099.stdout:6/919: creat dc/d1a/d49/da8/db3/f13b x:0 0 0 2024-09-17T01:02:07.397 INFO:tasks.workunit.client.1.smithi099.stdout:6/920: chown dc/d2b 2429382 1 2024-09-17T01:02:07.398 INFO:tasks.workunit.client.1.smithi099.stdout:7/878: dread d1/d37/d4f/d107/d47/fca [0,4194304] 0 2024-09-17T01:02:07.399 INFO:tasks.workunit.client.1.smithi099.stdout:4/939: symlink d7/dd/d21/d7b/d74/l136 0 2024-09-17T01:02:07.399 INFO:tasks.workunit.client.1.smithi099.stdout:4/940: readlink d7/dd/d21/d26/d3f/d5b/da4/l10f 0 2024-09-17T01:02:07.400 INFO:tasks.workunit.client.1.smithi099.stdout:7/879: mkdir d1/d37/d4f/d107/d7a/dac/db4/d118 0 2024-09-17T01:02:07.400 INFO:tasks.workunit.client.1.smithi099.stdout:7/880: chown d1/d37/d4f/d107/d5c/f98 118 1 2024-09-17T01:02:07.401 INFO:tasks.workunit.client.1.smithi099.stdout:4/941: truncate d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/f12b 569442 0 2024-09-17T01:02:07.402 INFO:tasks.workunit.client.1.smithi099.stdout:7/881: mkdir d1/d37/d4f/d107/d47/d48/d119 0 2024-09-17T01:02:07.402 INFO:tasks.workunit.client.1.smithi099.stdout:7/882: chown d1/d37/d4f/d107/d5c/d1c/d5a/db3/dcd/fd2 4 1 2024-09-17T01:02:07.405 INFO:tasks.workunit.client.0.smithi002.stdout:2/934: dwrite d1b/d74/d93/d94/f110 [0,4194304] 0 2024-09-17T01:02:07.406 INFO:tasks.workunit.client.1.smithi099.stdout:7/883: creat d1/d37/d4f/d107/d47/d48/d60/f11a x:0 0 0 2024-09-17T01:02:07.406 INFO:tasks.workunit.client.1.smithi099.stdout:4/942: mkdir d7/dd/d21/d7b/d4b/d137 0 2024-09-17T01:02:07.408 INFO:tasks.workunit.client.1.smithi099.stdout:7/884: truncate d1/d37/d4f/d107/fc9 3459686 0 2024-09-17T01:02:07.411 INFO:tasks.workunit.client.1.smithi099.stdout:4/943: unlink d7/dd/de/d10/d85/fa0 0 2024-09-17T01:02:07.411 INFO:tasks.workunit.client.1.smithi099.stdout:4/944: chown d7/dd/d21/d7b/d74/l136 30221 1 2024-09-17T01:02:07.413 INFO:tasks.workunit.client.1.smithi099.stdout:4/945: creat d7/dd/de/d10/d6b/d82/d121/f138 x:0 0 0 2024-09-17T01:02:07.413 INFO:tasks.workunit.client.1.smithi099.stdout:4/946: creat d7/dd/d21/d26/d3f/d5b/da4/f139 x:0 0 0 2024-09-17T01:02:07.414 INFO:tasks.workunit.client.1.smithi099.stdout:4/947: mknod d7/dd/d21/d7b/d74/c13a 0 2024-09-17T01:02:07.414 INFO:tasks.workunit.client.1.smithi099.stdout:4/948: write d7/dd/de/f4e [3118071,78649] 0 2024-09-17T01:02:07.414 INFO:tasks.workunit.client.1.smithi099.stdout:4/949: chown d7/dd/d21/d7b/d74/l136 277 1 2024-09-17T01:02:07.426 INFO:tasks.workunit.client.1.smithi099.stdout:4/950: dread d7/dd/d92/f9e [0,4194304] 0 2024-09-17T01:02:07.433 INFO:tasks.workunit.client.1.smithi099.stdout:2/793: dwrite d2/d9/d17/d83/dca/fe2 [0,4194304] 0 2024-09-17T01:02:07.433 INFO:tasks.workunit.client.1.smithi099.stdout:2/794: chown d2/d9/d25/d26/d1b/d61/l96 963 1 2024-09-17T01:02:07.434 INFO:tasks.workunit.client.1.smithi099.stdout:6/921: dwrite dc/d2b/d11e/fcf [0,4194304] 0 2024-09-17T01:02:07.434 INFO:tasks.workunit.client.1.smithi099.stdout:6/922: write dc/d27/d7e/ff7 [1597860,2860] 0 2024-09-17T01:02:07.434 INFO:tasks.workunit.client.1.smithi099.stdout:0/952: dwrite da/d12/d22/d120/f136 [0,4194304] 0 2024-09-17T01:02:07.435 INFO:tasks.workunit.client.1.smithi099.stdout:7/885: dwrite d1/ff [0,4194304] 0 2024-09-17T01:02:07.436 INFO:tasks.workunit.client.0.smithi002.stdout:2/935: dwrite d1b/d3f/d59/d7f/dc9/f14c [0,4194304] 0 2024-09-17T01:02:07.436 INFO:tasks.workunit.client.0.smithi002.stdout:2/936: chown d1b/d3f/d59/d7f/dc9/dac 0 1 2024-09-17T01:02:07.436 INFO:tasks.workunit.client.0.smithi002.stdout:2/937: stat d1b/d37/ldf 0 2024-09-17T01:02:07.436 INFO:tasks.workunit.client.0.smithi002.stdout:2/938: dread - d1b/d37/d48/d52/f126 zero size 2024-09-17T01:02:07.436 INFO:tasks.workunit.client.0.smithi002.stdout:2/939: read - d1b/d3f/d59/d7f/dc9/dac/ff8 zero size 2024-09-17T01:02:07.436 INFO:tasks.workunit.client.0.smithi002.stdout:2/940: chown f13 25 1 2024-09-17T01:02:07.437 INFO:tasks.workunit.client.1.smithi099.stdout:6/923: dread dc/d2b/f9e [0,4194304] 0 2024-09-17T01:02:07.442 INFO:tasks.workunit.client.1.smithi099.stdout:0/953: mkdir da/df/d20/d13c 0 2024-09-17T01:02:07.447 INFO:tasks.workunit.client.1.smithi099.stdout:7/886: creat d1/d37/d4f/d107/d5c/d1c/d5a/d6f/f11b x:0 0 0 2024-09-17T01:02:07.447 INFO:tasks.workunit.client.1.smithi099.stdout:7/887: fdatasync d1/d37/d4f/d107/d5c/d12/f29 0 2024-09-17T01:02:07.449 INFO:tasks.workunit.client.1.smithi099.stdout:6/924: truncate dc/d1a/d49/f73 3284346 0 2024-09-17T01:02:07.449 INFO:tasks.workunit.client.1.smithi099.stdout:6/925: fsync dc/d5d/dae/d132/ffb 0 2024-09-17T01:02:07.450 INFO:tasks.workunit.client.1.smithi099.stdout:0/954: mknod da/df/d1a/d49/d68/d9f/dd7/de0/c13d 0 2024-09-17T01:02:07.451 INFO:tasks.workunit.client.1.smithi099.stdout:0/955: fsync da/df/ff5 0 2024-09-17T01:02:07.451 INFO:tasks.workunit.client.1.smithi099.stdout:0/956: chown da/df/d1a/d49/dac/c129 2554 1 2024-09-17T01:02:07.451 INFO:tasks.workunit.client.1.smithi099.stdout:0/957: read da/df/d1a/d49/d68/f7f [65214,4578] 0 2024-09-17T01:02:07.451 INFO:tasks.workunit.client.1.smithi099.stdout:0/958: chown da/df/d1a/cd3 52736 1 2024-09-17T01:02:07.451 INFO:tasks.workunit.client.1.smithi099.stdout:7/888: symlink d1/d37/d4f/d107/d47/l11c 0 2024-09-17T01:02:07.452 INFO:tasks.workunit.client.1.smithi099.stdout:7/889: fsync d1/f11 0 2024-09-17T01:02:07.452 INFO:tasks.workunit.client.1.smithi099.stdout:2/795: dwrite d2/d9/d17/d58/faa [0,4194304] 0 2024-09-17T01:02:07.456 INFO:tasks.workunit.client.1.smithi099.stdout:7/890: link d1/cfb d1/d37/d4f/d107/d47/c11d 0 2024-09-17T01:02:07.456 INFO:tasks.workunit.client.1.smithi099.stdout:7/891: write d1/d37/d4f/fc8 [387802,115931] 0 2024-09-17T01:02:07.457 INFO:tasks.workunit.client.0.smithi002.stdout:2/941: dwrite d1b/d1d/d79/f6d [0,4194304] 0 2024-09-17T01:02:07.459 INFO:tasks.workunit.client.1.smithi099.stdout:7/892: mknod d1/d37/d4f/d107/d5c/d1c/d5a/db3/df4/c11e 0 2024-09-17T01:02:07.459 INFO:tasks.workunit.client.1.smithi099.stdout:7/893: write d1/d37/d4f/d107/f66 [2712786,5840] 0 2024-09-17T01:02:07.460 INFO:tasks.workunit.client.0.smithi002.stdout:2/942: unlink d1b/d3f/d59/d7f/dc9/dac/fe0 0 2024-09-17T01:02:07.461 INFO:tasks.workunit.client.1.smithi099.stdout:7/894: truncate d1/f25 3618565 0 2024-09-17T01:02:07.462 INFO:tasks.workunit.client.1.smithi099.stdout:0/959: dread da/df/f94 [0,4194304] 0 2024-09-17T01:02:07.462 INFO:tasks.workunit.client.1.smithi099.stdout:0/960: stat da/df/d31/fd5 0 2024-09-17T01:02:07.463 INFO:tasks.workunit.client.1.smithi099.stdout:7/895: mkdir d1/d37/d4f/d107/d47/d48/d11f 0 2024-09-17T01:02:07.464 INFO:tasks.workunit.client.1.smithi099.stdout:7/896: write d1/d37/d4f/d107/d5c/d12/fd9 [1041944,18146] 0 2024-09-17T01:02:07.465 INFO:tasks.workunit.client.1.smithi099.stdout:7/897: truncate d1/d37/d4f/d107/d47/d48/fc7 2642234 0 2024-09-17T01:02:07.470 INFO:tasks.workunit.client.1.smithi099.stdout:0/961: write da/df/d1a/d49/d71/dcd/f139 [3227468,100815] 0 2024-09-17T01:02:07.470 INFO:tasks.workunit.client.1.smithi099.stdout:6/926: dwrite dc/d1a/d49/da8/fd6 [0,4194304] 0 2024-09-17T01:02:07.470 INFO:tasks.workunit.client.1.smithi099.stdout:6/927: chown dc/f34 62840721 1 2024-09-17T01:02:07.470 INFO:tasks.workunit.client.1.smithi099.stdout:0/962: truncate da/df/d1a/d49/d71/faf 910358 0 2024-09-17T01:02:07.470 INFO:tasks.workunit.client.1.smithi099.stdout:0/963: truncate da/df/d1a/d49/d68/d9f/fe3 437420 0 2024-09-17T01:02:07.472 INFO:tasks.workunit.client.0.smithi002.stdout:2/943: dread f13 [0,4194304] 0 2024-09-17T01:02:07.472 INFO:tasks.workunit.client.1.smithi099.stdout:0/964: read da/d12/d22/fc7 [295378,105914] 0 2024-09-17T01:02:07.478 INFO:tasks.workunit.client.0.smithi002.stdout:2/944: truncate d1b/d1d/d79/fd9 5235602 0 2024-09-17T01:02:07.498 INFO:tasks.workunit.client.1.smithi099.stdout:7/898: dwrite d1/d37/d4f/d107/d5c/d1c/d5a/d6f/fa5 [0,4194304] 0 2024-09-17T01:02:07.509 INFO:tasks.workunit.client.0.smithi002.stdout:2/945: dwrite d1b/d37/d48/d52/f5e [0,4194304] 0 2024-09-17T01:02:07.510 INFO:tasks.workunit.client.1.smithi099.stdout:0/965: dwrite da/df/d31/fd5 [0,4194304] 0 2024-09-17T01:02:07.510 INFO:tasks.workunit.client.1.smithi099.stdout:6/928: dwrite dc/d2b/d11e/d106/d138/ddf/fef [0,4194304] 0 2024-09-17T01:02:07.513 INFO:tasks.workunit.client.0.smithi002.stdout:2/946: creat d1b/d37/d48/d78/f14f x:0 0 0 2024-09-17T01:02:07.513 INFO:tasks.workunit.client.0.smithi002.stdout:2/947: stat d1b/d37/d48/d78 0 2024-09-17T01:02:07.513 INFO:tasks.workunit.client.0.smithi002.stdout:2/948: write d1b/d37/d48/d4e/f90 [5320989,39052] 0 2024-09-17T01:02:07.513 INFO:tasks.workunit.client.1.smithi099.stdout:7/899: dread d1/d37/d4f/d107/d5c/f98 [0,4194304] 0 2024-09-17T01:02:07.513 INFO:tasks.workunit.client.1.smithi099.stdout:7/900: chown d1/d37/d4f/d107/d47/f6c 5412876 1 2024-09-17T01:02:07.514 INFO:tasks.workunit.client.1.smithi099.stdout:0/966: truncate da/d59/f75 323395 0 2024-09-17T01:02:07.515 INFO:tasks.workunit.client.0.smithi002.stdout:2/949: symlink d1b/d3f/l150 0 2024-09-17T01:02:07.517 INFO:tasks.workunit.client.1.smithi099.stdout:6/929: creat dc/d5d/dae/dd0/f13c x:0 0 0 2024-09-17T01:02:07.517 INFO:tasks.workunit.client.1.smithi099.stdout:6/930: write dc/d27/fe2 [175766,58622] 0 2024-09-17T01:02:07.517 INFO:tasks.workunit.client.1.smithi099.stdout:6/931: dread - dc/d5d/dae/d96/dfd/d101/f137 zero size 2024-09-17T01:02:07.520 INFO:tasks.workunit.client.1.smithi099.stdout:7/901: mknod d1/d37/d4f/d107/d5c/d1c/d72/c120 0 2024-09-17T01:02:07.520 INFO:tasks.workunit.client.1.smithi099.stdout:7/902: fsync d1/d37/d4f/d107/d47/d48/d60/f11a 0 2024-09-17T01:02:07.521 INFO:tasks.workunit.client.1.smithi099.stdout:0/967: mknod da/d12/d22/d53/c13e 0 2024-09-17T01:02:07.521 INFO:tasks.workunit.client.1.smithi099.stdout:0/968: fdatasync da/df/d31/f131 0 2024-09-17T01:02:07.524 INFO:tasks.workunit.client.1.smithi099.stdout:7/903: symlink d1/d8f/l121 0 2024-09-17T01:02:07.524 INFO:tasks.workunit.client.1.smithi099.stdout:7/904: creat d1/d36/d8d/dd6/f122 x:0 0 0 2024-09-17T01:02:07.526 INFO:tasks.workunit.client.1.smithi099.stdout:0/969: mkdir da/d59/d80/d8c/dcc/d13f 0 2024-09-17T01:02:07.529 INFO:tasks.workunit.client.1.smithi099.stdout:7/905: mkdir d1/d37/d4f/d107/d5c/d1c/d72/d123 0 2024-09-17T01:02:07.530 INFO:tasks.workunit.client.1.smithi099.stdout:0/970: mkdir da/d12/d22/d120/d140 0 2024-09-17T01:02:07.531 INFO:tasks.workunit.client.1.smithi099.stdout:7/906: creat d1/d37/d4f/d107/d47/d48/d119/f124 x:0 0 0 2024-09-17T01:02:07.532 INFO:tasks.workunit.client.1.smithi099.stdout:0/971: truncate da/df/f4f 2372481 0 2024-09-17T01:02:07.533 INFO:tasks.workunit.client.1.smithi099.stdout:0/972: dread - da/d12/d22/dfd/f122 zero size 2024-09-17T01:02:07.533 INFO:tasks.workunit.client.1.smithi099.stdout:0/973: truncate da/d12/d22/d53/f124 439425 0 2024-09-17T01:02:07.533 INFO:tasks.workunit.client.1.smithi099.stdout:0/974: readlink da/d12/d22/d66/l107 0 2024-09-17T01:02:07.533 INFO:tasks.workunit.client.1.smithi099.stdout:0/975: truncate da/df/d1a/d56/fc5 695492 0 2024-09-17T01:02:07.533 INFO:tasks.workunit.client.1.smithi099.stdout:0/976: truncate da/df/d1a/d49/f108 754677 0 2024-09-17T01:02:07.534 INFO:tasks.workunit.client.1.smithi099.stdout:7/907: rename d1/d37/d4f/d107/d5c/d1c/d5a/db3/df4/c11e to d1/d37/d78/db2/d114/c125 0 2024-09-17T01:02:07.534 INFO:tasks.workunit.client.1.smithi099.stdout:0/977: rename da/d12/d22 to da/d12/d22/d120/d12e/d141 22 2024-09-17T01:02:07.534 INFO:tasks.workunit.client.1.smithi099.stdout:0/978: dread - da/df/d1a/d56/f111 zero size 2024-09-17T01:02:07.535 INFO:tasks.workunit.client.1.smithi099.stdout:9/953: sync 2024-09-17T01:02:07.536 INFO:tasks.workunit.client.0.smithi002.stdout:2/950: dwrite d1b/d37/d48/db1/f137 [0,4194304] 0 2024-09-17T01:02:07.537 INFO:tasks.workunit.client.1.smithi099.stdout:0/979: link da/c4e da/d59/d80/d8c/d97/c142 0 2024-09-17T01:02:07.538 INFO:tasks.workunit.client.1.smithi099.stdout:0/980: mknod da/d59/d80/c143 0 2024-09-17T01:02:07.538 INFO:tasks.workunit.client.1.smithi099.stdout:0/981: write da/df/d20/dbf/fc1 [849570,25484] 0 2024-09-17T01:02:07.544 INFO:tasks.workunit.client.1.smithi099.stdout:0/982: rmdir da/d12/d2b 39 2024-09-17T01:02:07.546 INFO:tasks.workunit.client.1.smithi099.stdout:0/983: link da/df/d1a/f5f da/df/f144 0 2024-09-17T01:02:07.546 INFO:tasks.workunit.client.1.smithi099.stdout:0/984: readlink da/df/d1a/d56/l10b 0 2024-09-17T01:02:07.555 INFO:tasks.workunit.client.1.smithi099.stdout:9/954: dwrite da/d56/d84/db9/de8/f107 [0,4194304] 0 2024-09-17T01:02:07.557 INFO:tasks.workunit.client.1.smithi099.stdout:9/955: rename da/d56/d84/l88 to da/d56/d84/l134 0 2024-09-17T01:02:07.558 INFO:tasks.workunit.client.1.smithi099.stdout:9/956: truncate da/d9b/dac/d106/f12d 962581 0 2024-09-17T01:02:07.558 INFO:tasks.workunit.client.1.smithi099.stdout:9/957: mkdir da/d9b/d135 0 2024-09-17T01:02:07.559 INFO:tasks.workunit.client.1.smithi099.stdout:9/958: rename da/d14/d48/d69/f79 to da/d14/d48/f136 0 2024-09-17T01:02:07.560 INFO:tasks.workunit.client.1.smithi099.stdout:9/959: symlink da/d9b/dac/l137 0 2024-09-17T01:02:07.560 INFO:tasks.workunit.client.1.smithi099.stdout:9/960: write da/d18/d49/ffd [534525,22583] 0 2024-09-17T01:02:07.562 INFO:tasks.workunit.client.1.smithi099.stdout:9/961: unlink da/d14/f77 0 2024-09-17T01:02:07.562 INFO:tasks.workunit.client.1.smithi099.stdout:9/962: write da/d56/d84/db9/fcb [3157316,119467] 0 2024-09-17T01:02:07.562 INFO:tasks.workunit.client.1.smithi099.stdout:9/963: readlink da/l28 0 2024-09-17T01:02:07.562 INFO:tasks.workunit.client.1.smithi099.stdout:9/964: creat da/d21/f138 x:0 0 0 2024-09-17T01:02:07.564 INFO:tasks.workunit.client.1.smithi099.stdout:9/965: rename da/d56/d84/f10d to da/d56/d84/f139 0 2024-09-17T01:02:07.565 INFO:tasks.workunit.client.1.smithi099.stdout:9/966: link da/d50/d104/d105/dad/ddc/lea da/d56/d84/db9/de8/l13a 0 2024-09-17T01:02:07.565 INFO:tasks.workunit.client.1.smithi099.stdout:9/967: truncate da/d18/d5e/fb6 592526 0 2024-09-17T01:02:07.567 INFO:tasks.workunit.client.1.smithi099.stdout:9/968: unlink da/d18/c92 0 2024-09-17T01:02:07.568 INFO:tasks.workunit.client.0.smithi002.stdout:2/951: dwrite d1b/d1d/f105 [0,4194304] 0 2024-09-17T01:02:07.568 INFO:tasks.workunit.client.1.smithi099.stdout:7/908: dwrite d1/d37/d4f/d107/d5c/d1c/d5a/db3/fd5 [0,4194304] 0 2024-09-17T01:02:07.570 INFO:tasks.workunit.client.1.smithi099.stdout:0/985: dwrite da/d3b/f5b [0,4194304] 0 2024-09-17T01:02:07.579 INFO:tasks.workunit.client.1.smithi099.stdout:7/909: dread d1/d37/d4f/d107/d5c/d1c/d72/fdb [0,4194304] 0 2024-09-17T01:02:07.582 INFO:tasks.workunit.client.1.smithi099.stdout:7/910: link d1/d37/d4f/d107/d5c/fe d1/d37/d78/db2/d114/f126 0 2024-09-17T01:02:07.583 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:07 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:07.583 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:07 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:07.584 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:07 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:07.584 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:07 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:07.584 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:07 smithi099 ceph-mon[34357]: pgmap v257: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 415 MiB/s rd, 505 MiB/s wr, 688 op/s 2024-09-17T01:02:07.594 INFO:tasks.workunit.client.1.smithi099.stdout:7/911: dread d1/d36/f46 [0,4194304] 0 2024-09-17T01:02:07.594 INFO:tasks.workunit.client.1.smithi099.stdout:9/969: dwrite da/d18/f7e [0,4194304] 0 2024-09-17T01:02:07.595 INFO:tasks.workunit.client.1.smithi099.stdout:9/970: write da/d56/d84/db9/ff7 [113706,65862] 0 2024-09-17T01:02:07.595 INFO:tasks.workunit.client.1.smithi099.stdout:7/912: symlink d1/d37/d4f/d107/l127 0 2024-09-17T01:02:07.596 INFO:tasks.workunit.client.1.smithi099.stdout:9/971: mkdir da/d14/d40/d13b 0 2024-09-17T01:02:07.598 INFO:tasks.workunit.client.1.smithi099.stdout:9/972: symlink da/d21/l13c 0 2024-09-17T01:02:07.598 INFO:tasks.workunit.client.0.smithi002.stdout:2/952: dwrite d1b/d8a/d92/dae/df3/f109 [0,4194304] 0 2024-09-17T01:02:07.599 INFO:tasks.workunit.client.1.smithi099.stdout:0/986: dwrite da/d12/d2b/df0/d10d/f3d [0,4194304] 0 2024-09-17T01:02:07.599 INFO:tasks.workunit.client.1.smithi099.stdout:0/987: chown da/d12/fe8 193665483 1 2024-09-17T01:02:07.606 INFO:tasks.workunit.client.0.smithi002.stdout:9/951: sync 2024-09-17T01:02:07.606 INFO:tasks.workunit.client.0.smithi002.stdout:9/952: fdatasync d5/dc/d26/d5c/d6b/d75/d36/fb8 0 2024-09-17T01:02:07.607 INFO:tasks.workunit.client.0.smithi002.stdout:9/953: mknod d5/dc/d26/d5c/d6b/d75/d57/dba/d10f/c128 0 2024-09-17T01:02:07.614 INFO:tasks.workunit.client.1.smithi099.stdout:0/988: write da/d12/d22/d53/fe2 [305023,33958] 0 2024-09-17T01:02:07.614 INFO:tasks.workunit.client.1.smithi099.stdout:0/989: rename da to da/d12/d2b/dab/d145 22 2024-09-17T01:02:07.615 INFO:tasks.workunit.client.1.smithi099.stdout:0/990: mknod da/df/d1a/d49/d68/d9f/dd7/de0/d109/c146 0 2024-09-17T01:02:07.637 INFO:tasks.workunit.client.0.smithi002.stdout:2/953: dwrite d1b/d1d/d79/fbf [0,4194304] 0 2024-09-17T01:02:07.637 INFO:tasks.workunit.client.1.smithi099.stdout:9/973: dwrite da/d18/d5e/fb6 [0,4194304] 0 2024-09-17T01:02:07.637 INFO:tasks.workunit.client.1.smithi099.stdout:7/913: dwrite d1/d37/d4f/d107/d5c/f13 [0,4194304] 0 2024-09-17T01:02:07.638 INFO:tasks.workunit.client.1.smithi099.stdout:0/991: dwrite da/d59/f12a [0,4194304] 0 2024-09-17T01:02:07.638 INFO:tasks.workunit.client.1.smithi099.stdout:0/992: creat da/df/d4d/f147 x:0 0 0 2024-09-17T01:02:07.639 INFO:tasks.workunit.client.1.smithi099.stdout:7/914: creat d1/d37/d4f/d107/f128 x:0 0 0 2024-09-17T01:02:07.645 INFO:tasks.workunit.client.0.smithi002.stdout:2/954: dread d1b/d37/f6a [0,4194304] 0 2024-09-17T01:02:07.645 INFO:tasks.workunit.client.0.smithi002.stdout:2/955: write d1b/d3f/d59/d7f/dc9/dac/dbd/de8/f108 [589160,86079] 0 2024-09-17T01:02:07.645 INFO:tasks.workunit.client.0.smithi002.stdout:2/956: creat d1b/d3f/d59/dfa/f151 x:0 0 0 2024-09-17T01:02:07.645 INFO:tasks.workunit.client.0.smithi002.stdout:2/957: mknod d1b/d37/d48/db1/d149/c152 0 2024-09-17T01:02:07.645 INFO:tasks.workunit.client.0.smithi002.stdout:2/958: chown d1b/f68 2 1 2024-09-17T01:02:07.647 INFO:tasks.workunit.client.1.smithi099.stdout:0/993: mkdir da/d12/d2b/dab/db5/d148 0 2024-09-17T01:02:07.647 INFO:tasks.workunit.client.1.smithi099.stdout:0/994: read da/d12/f62 [4577078,30380] 0 2024-09-17T01:02:07.649 INFO:tasks.workunit.client.1.smithi099.stdout:9/974: getdents da/d21/d5b 0 2024-09-17T01:02:07.654 INFO:tasks.workunit.client.1.smithi099.stdout:9/975: symlink da/d50/d104/d105/dad/ddc/l13d 0 2024-09-17T01:02:07.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:07 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:07.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:07 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:07.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:07 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:07.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:07 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:07.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:07 smithi002 ceph-mon[27650]: pgmap v257: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 415 MiB/s rd, 505 MiB/s wr, 688 op/s 2024-09-17T01:02:07.655 INFO:tasks.workunit.client.1.smithi099.stdout:7/915: getdents d1/d37/d4f/d107/d47/d48/d119 0 2024-09-17T01:02:07.655 INFO:tasks.workunit.client.1.smithi099.stdout:0/995: write da/fae [2411967,117967] 0 2024-09-17T01:02:07.656 INFO:tasks.workunit.client.1.smithi099.stdout:9/976: rename da/d56/d84/l134 to da/d18/l13e 0 2024-09-17T01:02:07.658 INFO:tasks.workunit.client.1.smithi099.stdout:0/996: mknod da/df/d1a/d49/dac/c149 0 2024-09-17T01:02:07.658 INFO:tasks.workunit.client.1.smithi099.stdout:0/997: dread - da/d59/d80/f125 zero size 2024-09-17T01:02:07.659 INFO:tasks.workunit.client.1.smithi099.stdout:0/998: mknod da/df/d1a/c14a 0 2024-09-17T01:02:07.660 INFO:tasks.workunit.client.1.smithi099.stdout:0/999: truncate da/d3b/f5e 759105 0 2024-09-17T01:02:07.662 INFO:tasks.workunit.client.1.smithi099.stdout:7/916: rename d1/d37/d4f/d107/d5c/d3f to d1/d37/d4f/d107/d5c/d1c/d129 0 2024-09-17T01:02:07.662 INFO:tasks.workunit.client.1.smithi099.stdout:7/917: readlink d1/d37/d4f/d107/d47/d48/d60/l73 0 2024-09-17T01:02:07.662 INFO:tasks.workunit.client.0.smithi002.stdout:2/959: dwrite f13 [0,4194304] 0 2024-09-17T01:02:07.667 INFO:tasks.workunit.client.1.smithi099.stdout:9/977: dread da/d14/d40/fe0 [0,4194304] 0 2024-09-17T01:02:07.667 INFO:tasks.workunit.client.1.smithi099.stdout:9/978: stat da/d18/db3/d11c 0 2024-09-17T01:02:07.667 INFO:tasks.workunit.client.1.smithi099.stdout:9/979: chown da/d14/d40/d6f/cc4 718066 1 2024-09-17T01:02:07.667 INFO:tasks.workunit.client.1.smithi099.stdout:9/980: creat da/d56/d84/db9/f13f x:0 0 0 2024-09-17T01:02:07.667 INFO:tasks.workunit.client.1.smithi099.stdout:9/981: chown da/d56/d84/f139 54821 1 2024-09-17T01:02:07.671 INFO:tasks.workunit.client.0.smithi002.stdout:3/982: sync 2024-09-17T01:02:07.671 INFO:tasks.workunit.client.0.smithi002.stdout:0/903: sync 2024-09-17T01:02:07.671 INFO:tasks.workunit.client.0.smithi002.stdout:3/983: write d0/d31/d32/d12c/dac/da1/de4/f11e [629742,17514] 0 2024-09-17T01:02:07.675 INFO:tasks.workunit.client.1.smithi099.stdout:4/951: sync 2024-09-17T01:02:07.675 INFO:tasks.workunit.client.1.smithi099.stdout:4/952: stat d7/dd/d92/d110/fc2 0 2024-09-17T01:02:07.675 INFO:tasks.workunit.client.1.smithi099.stdout:4/953: fsync d7/dd/de/d10/d6b/d82/d8a/d9a/da6/f105 0 2024-09-17T01:02:07.677 INFO:tasks.workunit.client.1.smithi099.stdout:7/918: write d1/d37/d78/db2/ffa [650244,108811] 0 2024-09-17T01:02:07.677 INFO:tasks.workunit.client.1.smithi099.stdout:4/954: stat d7/dd/d21/l5a 0 2024-09-17T01:02:07.682 INFO:tasks.workunit.client.1.smithi099.stdout:7/919: dread d1/d36/f46 [0,4194304] 0 2024-09-17T01:02:07.709 INFO:tasks.workunit.client.1.smithi099.stdout:9/982: dwrite da/d21/d2a/f8c [0,4194304] 0 2024-09-17T01:02:07.709 INFO:tasks.workunit.client.1.smithi099.stdout:9/983: dread - da/d18/d5e/ff5 zero size 2024-09-17T01:02:07.709 INFO:tasks.workunit.client.0.smithi002.stdout:2/960: dwrite d1b/d1d/dd4/fff [0,4194304] 0 2024-09-17T01:02:07.709 INFO:tasks.workunit.client.0.smithi002.stdout:3/984: dwrite d0/d31/d32/fb9 [0,4194304] 0 2024-09-17T01:02:07.711 INFO:tasks.workunit.client.1.smithi099.stdout:9/984: symlink da/d14/d40/d6f/l140 0 2024-09-17T01:02:07.711 INFO:tasks.workunit.client.1.smithi099.stdout:9/985: chown da/d9a/fb5 7 1 2024-09-17T01:02:07.711 INFO:tasks.workunit.client.0.smithi002.stdout:2/961: mkdir d1b/d3f/d59/d7f/dc9/d153 0 2024-09-17T01:02:07.711 INFO:tasks.workunit.client.0.smithi002.stdout:2/962: fdatasync d1b/d1d/dd4/fff 0 2024-09-17T01:02:07.712 INFO:tasks.workunit.client.1.smithi099.stdout:9/986: mknod da/d18/db3/def/c141 0 2024-09-17T01:02:07.713 INFO:tasks.workunit.client.1.smithi099.stdout:9/987: symlink da/d14/d48/l142 0 2024-09-17T01:02:07.714 INFO:tasks.workunit.client.1.smithi099.stdout:6/932: sync 2024-09-17T01:02:07.714 INFO:tasks.workunit.client.1.smithi099.stdout:2/796: sync 2024-09-17T01:02:07.714 INFO:tasks.workunit.client.1.smithi099.stdout:2/797: chown d2/d9/d25/l39 6093 1 2024-09-17T01:02:07.715 INFO:tasks.workunit.client.1.smithi099.stdout:4/955: dwrite d7/dd/d92/fe1 [0,4194304] 0 2024-09-17T01:02:07.715 INFO:tasks.workunit.client.1.smithi099.stdout:4/956: chown d7/dd/d21/d26/d3f/d5b/f37 955 1 2024-09-17T01:02:07.715 INFO:tasks.workunit.client.1.smithi099.stdout:2/798: link d2/d9/d17/de0/fba d2/d9/d17/d58/f107 0 2024-09-17T01:02:07.716 INFO:tasks.workunit.client.1.smithi099.stdout:4/957: mknod d7/dd/d21/d26/d3f/d5b/da4/c13b 0 2024-09-17T01:02:07.718 INFO:tasks.workunit.client.1.smithi099.stdout:9/988: dread da/d56/d84/f9c [0,4194304] 0 2024-09-17T01:02:07.718 INFO:tasks.workunit.client.1.smithi099.stdout:9/989: chown da/d14/d40 12 1 2024-09-17T01:02:07.719 INFO:tasks.workunit.client.1.smithi099.stdout:2/799: rename d2/d9/d17/c89 to d2/d9/d25/d26/d1b/d2c/d9b/de6/c108 0 2024-09-17T01:02:07.719 INFO:tasks.workunit.client.1.smithi099.stdout:2/800: fdatasync d2/d9/d25/d26/d1b/d61/f6a 0 2024-09-17T01:02:07.719 INFO:tasks.workunit.client.1.smithi099.stdout:2/801: write d2/d9/d17/f21 [4043832,20091] 0 2024-09-17T01:02:07.719 INFO:tasks.workunit.client.1.smithi099.stdout:2/802: creat d2/d9/d17/d58/f109 x:0 0 0 2024-09-17T01:02:07.719 INFO:tasks.workunit.client.1.smithi099.stdout:2/803: write d2/d9/d25/d97/fa1 [1078200,120418] 0 2024-09-17T01:02:07.720 INFO:tasks.workunit.client.1.smithi099.stdout:9/990: unlink da/d14/d48/d69/d6c/cfc 0 2024-09-17T01:02:07.723 INFO:tasks.workunit.client.1.smithi099.stdout:4/958: mkdir d7/dd/d92/d13c 0 2024-09-17T01:02:07.725 INFO:tasks.workunit.client.1.smithi099.stdout:9/991: truncate da/d9a/fd8 531726 0 2024-09-17T01:02:07.726 INFO:tasks.workunit.client.1.smithi099.stdout:2/804: symlink d2/d9/d25/d26/d1b/l10a 0 2024-09-17T01:02:07.727 INFO:tasks.workunit.client.1.smithi099.stdout:4/959: symlink d7/dd/d92/d110/l13d 0 2024-09-17T01:02:07.728 INFO:tasks.workunit.client.1.smithi099.stdout:9/992: mkdir da/d8e/d143 0 2024-09-17T01:02:07.729 INFO:tasks.workunit.client.1.smithi099.stdout:2/805: mkdir d2/d9/dfc/d10b 0 2024-09-17T01:02:07.731 INFO:tasks.workunit.client.0.smithi002.stdout:3/985: dwrite d0/d31/d32/d92/fa4 [0,4194304] 0 2024-09-17T01:02:07.731 INFO:tasks.workunit.client.1.smithi099.stdout:4/960: rename d7/dd/de/d10/d6b/d82/f132 to d7/dd/f13e 0 2024-09-17T01:02:07.733 INFO:tasks.workunit.client.1.smithi099.stdout:9/993: link da/d21/d5b/f133 da/d9b/dac/f144 0 2024-09-17T01:02:07.734 INFO:tasks.workunit.client.1.smithi099.stdout:4/961: symlink d7/dd/de/l13f 0 2024-09-17T01:02:07.734 INFO:tasks.workunit.client.1.smithi099.stdout:4/962: stat d7/d35/l84 0 2024-09-17T01:02:07.734 INFO:tasks.workunit.client.1.smithi099.stdout:9/994: dread da/d18/d49/fb7 [0,4194304] 0 2024-09-17T01:02:07.738 INFO:tasks.workunit.client.1.smithi099.stdout:6/933: dwrite dc/d1a/d49/da8/fd6 [0,4194304] 0 2024-09-17T01:02:07.738 INFO:tasks.workunit.client.1.smithi099.stdout:2/806: dread d2/d9/d25/d26/d1b/d2c/d3f/db8/fcf [0,4194304] 0 2024-09-17T01:02:07.740 INFO:tasks.workunit.client.1.smithi099.stdout:6/934: rmdir dc/d5d/dae/d132/d87/db6 39 2024-09-17T01:02:07.741 INFO:tasks.workunit.client.1.smithi099.stdout:6/935: creat dc/d5d/dae/d132/d12b/f13d x:0 0 0 2024-09-17T01:02:07.743 INFO:tasks.workunit.client.1.smithi099.stdout:2/807: dread d2/d9/d25/d26/d1b/d2c/d3f/fb9 [0,4194304] 0 2024-09-17T01:02:07.743 INFO:tasks.workunit.client.1.smithi099.stdout:4/963: dread d7/dd/de/f4f [0,4194304] 0 2024-09-17T01:02:07.744 INFO:tasks.workunit.client.1.smithi099.stdout:6/936: mknod dc/d5d/d66/dc3/c13e 0 2024-09-17T01:02:07.745 INFO:tasks.workunit.client.1.smithi099.stdout:2/808: mkdir d2/d9/d25/d26/d1b/d61/d7d/d85/d98/de1/d10c 0 2024-09-17T01:02:07.746 INFO:tasks.workunit.client.1.smithi099.stdout:4/964: creat d7/dd/de/d10/d6b/d82/d116/f140 x:0 0 0 2024-09-17T01:02:07.746 INFO:tasks.workunit.client.1.smithi099.stdout:4/965: creat d7/dd/de/d10/d6b/d82/f141 x:0 0 0 2024-09-17T01:02:07.746 INFO:tasks.workunit.client.1.smithi099.stdout:6/937: symlink dc/d5d/dae/d96/dfd/l13f 0 2024-09-17T01:02:07.747 INFO:tasks.workunit.client.0.smithi002.stdout:3/986: dread d0/d3/d17/f20 [0,4194304] 0 2024-09-17T01:02:07.747 INFO:tasks.workunit.client.0.smithi002.stdout:3/987: chown d0/d3/da8/ce0 8580 1 2024-09-17T01:02:07.747 INFO:tasks.workunit.client.0.smithi002.stdout:3/988: chown d0/d3/d17/d87/d9e/dd4/c122 485 1 2024-09-17T01:02:07.747 INFO:tasks.workunit.client.0.smithi002.stdout:3/989: write d0/d3/d17/d87/d9e/dd4/f10b [50770,60324] 0 2024-09-17T01:02:07.749 INFO:tasks.workunit.client.1.smithi099.stdout:6/938: dread dc/d1a/d49/d4c/f5c [0,4194304] 0 2024-09-17T01:02:07.749 INFO:tasks.workunit.client.1.smithi099.stdout:6/939: fsync dc/d5d/dae/d132/d87/fb9 0 2024-09-17T01:02:07.749 INFO:tasks.workunit.client.1.smithi099.stdout:6/940: read - dc/f111 zero size 2024-09-17T01:02:07.749 INFO:tasks.workunit.client.1.smithi099.stdout:6/941: stat dc/d5d/dae/d132 0 2024-09-17T01:02:07.753 INFO:tasks.workunit.client.1.smithi099.stdout:9/995: dwrite da/d8e/dbf/f127 [0,4194304] 0 2024-09-17T01:02:07.759 INFO:tasks.workunit.client.1.smithi099.stdout:9/996: dread da/d8e/fd9 [0,4194304] 0 2024-09-17T01:02:07.760 INFO:tasks.workunit.client.1.smithi099.stdout:9/997: symlink da/d14/d40/d6f/l145 0 2024-09-17T01:02:07.760 INFO:tasks.workunit.client.1.smithi099.stdout:2/809: dwrite d2/d9/d25/d26/d1b/d2c/f3d [0,4194304] 0 2024-09-17T01:02:07.762 INFO:tasks.workunit.client.1.smithi099.stdout:2/810: truncate d2/d9/d25/d26/d1b/d61/f6a 3521287 0 2024-09-17T01:02:07.762 INFO:tasks.workunit.client.1.smithi099.stdout:2/811: write d2/d9/d25/fd8 [529970,18474] 0 2024-09-17T01:02:07.762 INFO:tasks.workunit.client.1.smithi099.stdout:2/812: stat d2/d9/d25/d26/d1b/d61/ff6 0 2024-09-17T01:02:07.763 INFO:tasks.workunit.client.1.smithi099.stdout:2/813: mkdir d2/d9/d17/d83/dca/d10d 0 2024-09-17T01:02:07.763 INFO:tasks.workunit.client.1.smithi099.stdout:2/814: chown d2/d9/c49 412605 1 2024-09-17T01:02:07.764 INFO:tasks.workunit.client.1.smithi099.stdout:2/815: mknod d2/d9/d17/d83/dca/dfa/dfe/c10e 0 2024-09-17T01:02:07.764 INFO:tasks.workunit.client.1.smithi099.stdout:2/816: read - d2/d9/d25/d26/d1b/d61/d7d/fee zero size 2024-09-17T01:02:07.765 INFO:tasks.workunit.client.1.smithi099.stdout:2/817: creat d2/d9/dfc/f10f x:0 0 0 2024-09-17T01:02:07.766 INFO:tasks.workunit.client.1.smithi099.stdout:2/818: mknod d2/d9/d25/d26/d1b/d2c/d9b/df7/c110 0 2024-09-17T01:02:07.766 INFO:tasks.workunit.client.1.smithi099.stdout:2/819: fdatasync d2/d9/d25/d97/fe3 0 2024-09-17T01:02:07.766 INFO:tasks.workunit.client.1.smithi099.stdout:2/820: fdatasync d2/d9/dfc/f10f 0 2024-09-17T01:02:07.766 INFO:tasks.workunit.client.1.smithi099.stdout:2/821: truncate d2/d9/d25/d26/d1b/dad/f3a 1297225 0 2024-09-17T01:02:07.768 INFO:tasks.workunit.client.1.smithi099.stdout:9/998: dread da/d56/da5/fa6 [0,4194304] 0 2024-09-17T01:02:07.772 INFO:tasks.workunit.client.1.smithi099.stdout:2/822: dread d2/d9/d25/f7b [0,4194304] 0 2024-09-17T01:02:07.772 INFO:tasks.workunit.client.1.smithi099.stdout:2/823: creat d2/d9/d25/d26/d1b/d2c/d9b/db1/f111 x:0 0 0 2024-09-17T01:02:07.773 INFO:tasks.workunit.client.1.smithi099.stdout:2/824: write d2/d9/d25/d26/d1b/d2c/d3f/fb9 [230357,48594] 0 2024-09-17T01:02:07.774 INFO:tasks.workunit.client.1.smithi099.stdout:6/942: write dc/d1a/d49/f73 [1554399,121336] 0 2024-09-17T01:02:07.775 INFO:tasks.workunit.client.1.smithi099.stdout:6/943: dread - dc/d5d/f12e zero size 2024-09-17T01:02:07.775 INFO:tasks.workunit.client.1.smithi099.stdout:6/944: rmdir dc/d2b/d11e/d106/d138/ddf/d108 39 2024-09-17T01:02:07.775 INFO:tasks.workunit.client.1.smithi099.stdout:6/945: fsync dc/d5d/f12e 0 2024-09-17T01:02:07.776 INFO:tasks.workunit.client.1.smithi099.stdout:9/999: write da/d14/d40/f97 [3927213,94324] 0 2024-09-17T01:02:07.779 INFO:tasks.workunit.client.1.smithi099.stdout:6/946: getdents dc/d5d 0 2024-09-17T01:02:07.779 INFO:tasks.workunit.client.1.smithi099.stdout:6/947: truncate dc/d5d/f69 4808638 0 2024-09-17T01:02:07.787 INFO:tasks.workunit.client.1.smithi099.stdout:6/948: write dc/d1a/d49/da8/fd6 [377543,83560] 0 2024-09-17T01:02:07.789 INFO:tasks.workunit.client.1.smithi099.stdout:6/949: creat dc/d5d/d66/dc8/f140 x:0 0 0 2024-09-17T01:02:07.790 INFO:tasks.workunit.client.1.smithi099.stdout:2/825: dwrite d2/d9/d17/d58/f107 [0,4194304] 0 2024-09-17T01:02:07.790 INFO:tasks.workunit.client.1.smithi099.stdout:6/950: rename dc/d5d/f7c to dc/d1a/d49/da8/d110/d119/f141 0 2024-09-17T01:02:07.790 INFO:tasks.workunit.client.1.smithi099.stdout:6/951: write dc/d1a/d49/f73 [3237359,12884] 0 2024-09-17T01:02:07.792 INFO:tasks.workunit.client.1.smithi099.stdout:2/826: rename d2/d9/d17/lbb to d2/d9/d25/d26/d1b/d61/d7d/d85/d98/d9a/l112 0 2024-09-17T01:02:07.792 INFO:tasks.workunit.client.1.smithi099.stdout:2/827: fsync d2/d9/d25/d26/d1b/d2c/fdc 0 2024-09-17T01:02:07.792 INFO:tasks.workunit.client.1.smithi099.stdout:2/828: creat d2/d9/d25/d26/f113 x:0 0 0 2024-09-17T01:02:07.792 INFO:tasks.workunit.client.1.smithi099.stdout:2/829: chown d2/d9/d25/d26/d1b/d61/d7d/d85/d98/d9a/led 23419 1 2024-09-17T01:02:07.793 INFO:tasks.workunit.client.1.smithi099.stdout:2/830: rmdir d2/d9/d17/d83/dca/d10d 0 2024-09-17T01:02:07.793 INFO:tasks.workunit.client.1.smithi099.stdout:2/831: creat d2/d9/d25/f114 x:0 0 0 2024-09-17T01:02:07.794 INFO:tasks.workunit.client.1.smithi099.stdout:2/832: symlink d2/d9/d25/l115 0 2024-09-17T01:02:07.795 INFO:tasks.workunit.client.1.smithi099.stdout:2/833: rmdir d2/d9/d17/d83/dca/dfa/dfe 39 2024-09-17T01:02:07.795 INFO:tasks.workunit.client.1.smithi099.stdout:2/834: readlink d2/d9/d17/de0/l6e 0 2024-09-17T01:02:07.796 INFO:tasks.workunit.client.1.smithi099.stdout:2/835: creat d2/d9/d25/d26/d1b/d2c/d9b/de6/f116 x:0 0 0 2024-09-17T01:02:07.799 INFO:tasks.workunit.client.1.smithi099.stdout:6/952: read dc/d1a/f56 [601566,72394] 0 2024-09-17T01:02:07.799 INFO:tasks.workunit.client.1.smithi099.stdout:6/953: chown dc/d2b/le8 22545 1 2024-09-17T01:02:07.799 INFO:tasks.workunit.client.0.smithi002.stdout:9/954: sync 2024-09-17T01:02:07.800 INFO:tasks.workunit.client.0.smithi002.stdout:9/955: fdatasync d5/dc/d26/d5c/d6b/d75/d57/d7a/f8b 0 2024-09-17T01:02:07.800 INFO:tasks.workunit.client.0.smithi002.stdout:9/956: creat d5/dc/d26/d46/d47/f129 x:0 0 0 2024-09-17T01:02:07.808 INFO:tasks.workunit.client.0.smithi002.stdout:9/957: read d5/dc/d26/d46/fb6 [7151617,75839] 0 2024-09-17T01:02:07.809 INFO:tasks.workunit.client.1.smithi099.stdout:6/954: dread dc/d5d/dae/f6a [0,4194304] 0 2024-09-17T01:02:07.809 INFO:tasks.workunit.client.0.smithi002.stdout:9/958: mknod d5/dc/d26/d63/ddd/c12a 0 2024-09-17T01:02:07.810 INFO:tasks.workunit.client.0.smithi002.stdout:9/959: fsync d5/dc/d26/d5c/d6b/d75/d57/d7a/da2/ff9 0 2024-09-17T01:02:07.814 INFO:tasks.workunit.client.1.smithi099.stdout:2/836: dwrite d2/d9/d25/fd8 [0,4194304] 0 2024-09-17T01:02:07.814 INFO:tasks.workunit.client.1.smithi099.stdout:2/837: creat d2/d9/d17/d83/d8d/d8f/f117 x:0 0 0 2024-09-17T01:02:07.827 INFO:tasks.workunit.client.0.smithi002.stdout:9/960: dwrite d5/dc/d26/d5c/d6b/d75/fcd [0,4194304] 0 2024-09-17T01:02:07.829 INFO:tasks.workunit.client.0.smithi002.stdout:9/961: mknod d5/dc/d26/c12b 0 2024-09-17T01:02:07.830 INFO:tasks.workunit.client.0.smithi002.stdout:9/962: rmdir d5/dc/d26/d5c/d6b/d75/d57/d7a/da2 39 2024-09-17T01:02:07.862 INFO:tasks.workunit.client.1.smithi099.stdout:2/838: link d2/d9/d25/l115 d2/d9/d17/d58/l118 0 2024-09-17T01:02:07.862 INFO:tasks.workunit.client.1.smithi099.stdout:2/839: readlink d2/d9/d25/d26/d1b/d61/d7d/d85/d98/d9a/lc1 0 2024-09-17T01:02:07.862 INFO:tasks.workunit.client.1.smithi099.stdout:2/840: fsync d2/d9/d25/d26/d1b/d2c/d9b/de6/f116 0 2024-09-17T01:02:07.862 INFO:tasks.workunit.client.1.smithi099.stdout:2/841: getdents d2/d9/dfc/d10b 0 2024-09-17T01:02:07.862 INFO:tasks.workunit.client.1.smithi099.stdout:2/842: fdatasync d2/ff5 0 2024-09-17T01:02:07.906 INFO:tasks.workunit.client.0.smithi002.stdout:0/904: sync 2024-09-17T01:02:07.907 INFO:tasks.workunit.client.0.smithi002.stdout:2/963: sync 2024-09-17T01:02:07.907 INFO:tasks.workunit.client.0.smithi002.stdout:0/905: symlink dd/d19/da9/l134 0 2024-09-17T01:02:07.908 INFO:tasks.workunit.client.0.smithi002.stdout:0/906: chown dd/d19/f2c 753982 1 2024-09-17T01:02:07.909 INFO:tasks.workunit.client.0.smithi002.stdout:0/907: creat dd/d19/da9/de5/f135 x:0 0 0 2024-09-17T01:02:07.910 INFO:tasks.workunit.client.0.smithi002.stdout:0/908: symlink dd/d19/d1c/d1f/l136 0 2024-09-17T01:02:07.912 INFO:tasks.workunit.client.0.smithi002.stdout:0/909: mkdir dd/d19/d1c/d33/d137 0 2024-09-17T01:02:07.914 INFO:tasks.workunit.client.1.smithi099.stdout:2/843: rename d2/d9/d25/d26/d1b/f7c to d2/d9/d25/d26/d1b/d61/f119 0 2024-09-17T01:02:07.936 INFO:tasks.workunit.client.0.smithi002.stdout:2/964: dwrite d1b/d3f/d59/d7f/dc9/f3c [0,4194304] 0 2024-09-17T01:02:07.937 INFO:tasks.workunit.client.0.smithi002.stdout:2/965: write d1b/d3f/d59/dfa/f151 [765840,99969] 0 2024-09-17T01:02:07.945 INFO:tasks.workunit.client.0.smithi002.stdout:0/910: dwrite dd/d19/f4e [0,4194304] 0 2024-09-17T01:02:07.946 INFO:tasks.workunit.client.0.smithi002.stdout:0/911: stat dd/d19/da9/de5/f135 0 2024-09-17T01:02:07.946 INFO:tasks.workunit.client.0.smithi002.stdout:0/912: write dd/d19/d1c/d33/fee [925890,118891] 0 2024-09-17T01:02:07.946 INFO:tasks.workunit.client.1.smithi099.stdout:2/844: dwrite d2/d9/d25/d26/faf [0,4194304] 0 2024-09-17T01:02:07.948 INFO:tasks.workunit.client.0.smithi002.stdout:0/913: link dd/d19/d1a/d29/d55/d61/c87 dd/d19/d1c/d1f/d22/c138 0 2024-09-17T01:02:07.948 INFO:tasks.workunit.client.0.smithi002.stdout:0/914: write dd/d3d/f8f [112190,37367] 0 2024-09-17T01:02:07.948 INFO:tasks.workunit.client.1.smithi099.stdout:6/955: dwrite dc/d2b/f9e [0,4194304] 0 2024-09-17T01:02:07.950 INFO:tasks.workunit.client.0.smithi002.stdout:0/915: rename dd/d3d/d130/d11d/f124 to dd/d120/dbe/f139 0 2024-09-17T01:02:07.951 INFO:tasks.workunit.client.1.smithi099.stdout:6/956: truncate dc/d27/ff8 650046 0 2024-09-17T01:02:07.955 INFO:tasks.workunit.client.0.smithi002.stdout:0/916: mknod dd/d19/d1c/d1f/d22/dde/c13a 0 2024-09-17T01:02:07.955 INFO:tasks.workunit.client.0.smithi002.stdout:0/917: write dd/d19/d1a/d29/d55/fcb [736050,1588] 0 2024-09-17T01:02:07.955 INFO:tasks.workunit.client.0.smithi002.stdout:0/918: truncate dd/d19/da9/de5/d68/fc9 151695 0 2024-09-17T01:02:07.956 INFO:tasks.workunit.client.1.smithi099.stdout:2/845: write d2/d9/d17/f51 [3159938,44194] 0 2024-09-17T01:02:07.957 INFO:tasks.workunit.client.1.smithi099.stdout:2/846: symlink d2/d9/d25/d26/d1b/d61/d7d/d85/d98/dfd/l11a 0 2024-09-17T01:02:07.967 INFO:tasks.workunit.client.1.smithi099.stdout:6/957: write dc/d1a/f71 [1637137,85455] 0 2024-09-17T01:02:07.967 INFO:tasks.workunit.client.1.smithi099.stdout:2/847: dread d2/d9/d25/d26/d1b/dad/f3a [0,4194304] 0 2024-09-17T01:02:07.971 INFO:tasks.workunit.client.0.smithi002.stdout:2/966: dwrite d1b/d3f/d59/dfa/f151 [0,4194304] 0 2024-09-17T01:02:07.972 INFO:tasks.workunit.client.1.smithi099.stdout:6/958: rename dc/d2b/d11e/d106/d138/ddf/d108 to dc/d5d/d66/dc3/dd4/d142 0 2024-09-17T01:02:07.973 INFO:tasks.workunit.client.1.smithi099.stdout:6/959: write dc/d5d/dae/d132/d87/db6/fd9 [681601,98372] 0 2024-09-17T01:02:07.973 INFO:tasks.workunit.client.0.smithi002.stdout:0/919: dwrite dd/d19/d1c/d1f/f21 [0,4194304] 0 2024-09-17T01:02:07.973 INFO:tasks.workunit.client.0.smithi002.stdout:0/920: fsync dd/d19/d1c/d78/f112 0 2024-09-17T01:02:07.974 INFO:tasks.workunit.client.1.smithi099.stdout:2/848: rename d2/d9/d17/f69 to d2/d9/d17/d83/dca/f11b 0 2024-09-17T01:02:07.974 INFO:tasks.workunit.client.0.smithi002.stdout:2/967: mknod d1b/d1d/d79/c154 0 2024-09-17T01:02:07.975 INFO:tasks.workunit.client.0.smithi002.stdout:2/968: stat l15 0 2024-09-17T01:02:07.975 INFO:tasks.workunit.client.1.smithi099.stdout:2/849: creat d2/d9/d25/d68/f11c x:0 0 0 2024-09-17T01:02:07.977 INFO:tasks.workunit.client.0.smithi002.stdout:0/921: mknod dd/d3d/d130/d11d/c13b 0 2024-09-17T01:02:07.977 INFO:tasks.workunit.client.0.smithi002.stdout:0/922: creat dd/d19/d1c/d78/f13c x:0 0 0 2024-09-17T01:02:07.978 INFO:tasks.workunit.client.0.smithi002.stdout:2/969: rename d1b/d37/d48/d78/f83 to d1b/d37/d48/db1/f155 0 2024-09-17T01:02:07.978 INFO:tasks.workunit.client.0.smithi002.stdout:2/970: fdatasync d1b/d3f/d59/d7f/ffe 0 2024-09-17T01:02:07.980 INFO:tasks.workunit.client.1.smithi099.stdout:2/850: write d2/d9/d25/f7b [297481,20803] 0 2024-09-17T01:02:07.980 INFO:tasks.workunit.client.1.smithi099.stdout:2/851: fdatasync d2/d9/d25/d26/f6b 0 2024-09-17T01:02:07.981 INFO:tasks.workunit.client.0.smithi002.stdout:0/923: creat dd/d19/d1c/f13d x:0 0 0 2024-09-17T01:02:07.981 INFO:tasks.workunit.client.0.smithi002.stdout:0/924: truncate dd/d19/d1c/d33/f106 952359 0 2024-09-17T01:02:07.981 INFO:tasks.workunit.client.0.smithi002.stdout:0/925: fdatasync dd/d19/d1c/d33/f132 0 2024-09-17T01:02:07.983 INFO:tasks.workunit.client.0.smithi002.stdout:0/926: mknod dd/d3d/d130/d11d/c13e 0 2024-09-17T01:02:07.983 INFO:tasks.workunit.client.1.smithi099.stdout:2/852: unlink d2/d9/d25/d26/d1b/dad/c42 0 2024-09-17T01:02:07.983 INFO:tasks.workunit.client.1.smithi099.stdout:2/853: dread - d2/d9/d17/d83/d8d/fb4 zero size 2024-09-17T01:02:07.983 INFO:tasks.workunit.client.1.smithi099.stdout:2/854: chown d2/f1c 86187022 1 2024-09-17T01:02:07.983 INFO:tasks.workunit.client.1.smithi099.stdout:2/855: fdatasync d2/d9/d25/d26/d1b/d2c/f77 0 2024-09-17T01:02:07.986 INFO:tasks.workunit.client.0.smithi002.stdout:0/927: creat dd/d3d/f13f x:0 0 0 2024-09-17T01:02:07.987 INFO:tasks.workunit.client.0.smithi002.stdout:2/971: dread d1b/d37/d48/d4e/fa0 [0,4194304] 0 2024-09-17T01:02:07.989 INFO:tasks.workunit.client.0.smithi002.stdout:0/928: rename dd/f14 to dd/d19/da9/de5/db9/f140 0 2024-09-17T01:02:07.990 INFO:tasks.workunit.client.0.smithi002.stdout:3/990: sync 2024-09-17T01:02:07.990 INFO:tasks.workunit.client.0.smithi002.stdout:3/991: getdents d0/d31/d32/d12c/dac/da1/d118 0 2024-09-17T01:02:07.990 INFO:tasks.workunit.client.0.smithi002.stdout:3/992: write d0/d31/d32/d12c/dac/da1/dd8/fc8 [3110503,12026] 0 2024-09-17T01:02:07.990 INFO:tasks.workunit.client.0.smithi002.stdout:3/993: fsync d0/f62 0 2024-09-17T01:02:07.990 INFO:tasks.workunit.client.0.smithi002.stdout:3/994: dread - d0/d31/d32/d12c/dac/fe1 zero size 2024-09-17T01:02:07.991 INFO:tasks.workunit.client.0.smithi002.stdout:2/972: creat d1b/d3f/d59/d7f/dc9/dac/dbd/dc3/def/f156 x:0 0 0 2024-09-17T01:02:07.992 INFO:tasks.workunit.client.0.smithi002.stdout:0/929: creat dd/d19/da9/f141 x:0 0 0 2024-09-17T01:02:07.993 INFO:tasks.workunit.client.1.smithi099.stdout:6/960: dwrite dc/d1a/f79 [0,4194304] 0 2024-09-17T01:02:07.994 INFO:tasks.workunit.client.0.smithi002.stdout:9/963: sync 2024-09-17T01:02:07.995 INFO:tasks.workunit.client.0.smithi002.stdout:2/973: creat d1b/d8a/d92/dae/dec/f157 x:0 0 0 2024-09-17T01:02:07.995 INFO:tasks.workunit.client.0.smithi002.stdout:2/974: write d1b/d1d/dd4/ff5 [157103,4955] 0 2024-09-17T01:02:07.996 INFO:tasks.workunit.client.0.smithi002.stdout:2/975: read d1b/d37/d48/d4e/f2f [533421,103469] 0 2024-09-17T01:02:07.996 INFO:tasks.workunit.client.0.smithi002.stdout:2/976: creat d1b/d1d/dd4/f158 x:0 0 0 2024-09-17T01:02:07.996 INFO:tasks.workunit.client.0.smithi002.stdout:2/977: chown d1b/d3f/d59/d7f/c106 651 1 2024-09-17T01:02:07.996 INFO:tasks.workunit.client.0.smithi002.stdout:2/978: chown d1b/d1d/lb3 0 1 2024-09-17T01:02:07.996 INFO:tasks.workunit.client.0.smithi002.stdout:2/979: chown d1b/d37/d48/d52/l57 0 1 2024-09-17T01:02:07.996 INFO:tasks.workunit.client.0.smithi002.stdout:2/980: dread - d1b/d74/d93/d94/de2/f141 zero size 2024-09-17T01:02:07.997 INFO:tasks.workunit.client.0.smithi002.stdout:2/981: stat d1b/d8a/dab 0 2024-09-17T01:02:07.999 INFO:tasks.workunit.client.0.smithi002.stdout:2/982: mkdir d1b/d37/d48/d4e/dc5/d159 0 2024-09-17T01:02:08.001 INFO:tasks.workunit.client.0.smithi002.stdout:2/983: truncate d1b/d1d/f4f 3926607 0 2024-09-17T01:02:08.009 INFO:tasks.workunit.client.1.smithi099.stdout:6/961: write dc/d2b/f4b [2847222,102174] 0 2024-09-17T01:02:08.009 INFO:tasks.workunit.client.1.smithi099.stdout:6/962: write dc/d2b/d11e/f9b [2730923,27341] 0 2024-09-17T01:02:08.010 INFO:tasks.workunit.client.1.smithi099.stdout:6/963: dread - dc/df9/fff zero size 2024-09-17T01:02:08.010 INFO:tasks.workunit.client.1.smithi099.stdout:2/856: dwrite d2/d9/d25/f4f [0,4194304] 0 2024-09-17T01:02:08.012 INFO:tasks.workunit.client.1.smithi099.stdout:2/857: write d2/d9/d17/d83/dca/fd3 [1399594,112384] 0 2024-09-17T01:02:08.012 INFO:tasks.workunit.client.1.smithi099.stdout:2/858: creat d2/d9/d17/d58/f11d x:0 0 0 2024-09-17T01:02:08.013 INFO:tasks.workunit.client.1.smithi099.stdout:2/859: creat d2/d9/dfc/f11e x:0 0 0 2024-09-17T01:02:08.025 INFO:tasks.workunit.client.1.smithi099.stdout:6/964: dread dc/d5d/d66/dbb/d10c/f78 [0,4194304] 0 2024-09-17T01:02:08.031 INFO:tasks.workunit.client.1.smithi099.stdout:2/860: dread d2/d9/d25/f4f [0,4194304] 0 2024-09-17T01:02:08.048 INFO:tasks.workunit.client.0.smithi002.stdout:3/995: dwrite d0/d31/d32/d12c/dac/fe1 [0,4194304] 0 2024-09-17T01:02:08.048 INFO:tasks.workunit.client.0.smithi002.stdout:9/964: dwrite d5/dc/d26/d5c/d6b/d75/fee [0,4194304] 0 2024-09-17T01:02:08.049 INFO:tasks.workunit.client.0.smithi002.stdout:0/930: dwrite dd/d19/d1c/f8a [0,4194304] 0 2024-09-17T01:02:08.049 INFO:tasks.workunit.client.0.smithi002.stdout:2/984: dwrite d1b/d3f/d59/d7f/dc9/dac/dbd/de8/f108 [0,4194304] 0 2024-09-17T01:02:08.049 INFO:tasks.workunit.client.1.smithi099.stdout:2/861: dwrite d2/d9/d17/d83/d8d/d8f/f117 [0,4194304] 0 2024-09-17T01:02:08.052 INFO:tasks.workunit.client.0.smithi002.stdout:3/996: symlink d0/d31/d8b/d9d/d114/l138 0 2024-09-17T01:02:08.052 INFO:tasks.workunit.client.0.smithi002.stdout:9/965: mkdir d5/d8a/d9d/d12c 0 2024-09-17T01:02:08.053 INFO:tasks.workunit.client.0.smithi002.stdout:0/931: getdents dd/d19/d1a/d29/d55/d56/d110 0 2024-09-17T01:02:08.053 INFO:tasks.workunit.client.0.smithi002.stdout:0/932: chown dd/d19/d1a/d29/ce2 5 1 2024-09-17T01:02:08.054 INFO:tasks.workunit.client.1.smithi099.stdout:2/862: creat d2/d9/d25/d26/d1b/dff/f11f x:0 0 0 2024-09-17T01:02:08.055 INFO:tasks.workunit.client.1.smithi099.stdout:2/863: readlink d2/d9/d25/d26/d1b/l3b 0 2024-09-17T01:02:08.056 INFO:tasks.workunit.client.1.smithi099.stdout:2/864: stat d2/d9/d25/d26/d1b/d61/d7d/d85 0 2024-09-17T01:02:08.056 INFO:tasks.workunit.client.1.smithi099.stdout:2/865: write d2/d9/d17/f76 [163661,76213] 0 2024-09-17T01:02:08.057 INFO:tasks.workunit.client.1.smithi099.stdout:2/866: fdatasync d2/d9/d25/d26/d1b/dad/f40 0 2024-09-17T01:02:08.057 INFO:tasks.workunit.client.1.smithi099.stdout:2/867: creat d2/f120 x:0 0 0 2024-09-17T01:02:08.058 INFO:tasks.workunit.client.0.smithi002.stdout:3/997: symlink d0/d3/d33/d99/dab/l139 0 2024-09-17T01:02:08.059 INFO:tasks.workunit.client.1.smithi099.stdout:2/868: mknod d2/d9/d17/de0/c121 0 2024-09-17T01:02:08.059 INFO:tasks.workunit.client.1.smithi099.stdout:2/869: stat d2/d9/d17/d83/d8d/dd9 0 2024-09-17T01:02:08.060 INFO:tasks.workunit.client.0.smithi002.stdout:2/985: link lc d1b/d3f/d59/d7f/dc9/dac/dbd/dc3/l15a 0 2024-09-17T01:02:08.060 INFO:tasks.workunit.client.0.smithi002.stdout:9/966: dread d5/dc/d26/f3b [4194304,4194304] 0 2024-09-17T01:02:08.061 INFO:tasks.workunit.client.0.smithi002.stdout:3/998: truncate d0/d31/d32/f25 6842 0 2024-09-17T01:02:08.063 INFO:tasks.workunit.client.0.smithi002.stdout:3/999: dread d0/d3/d33/d93/fb0 [0,4194304] 0 2024-09-17T01:02:08.063 INFO:tasks.workunit.client.0.smithi002.stdout:2/986: mknod d1b/d3f/d59/d7f/dc9/dac/c15b 0 2024-09-17T01:02:08.063 INFO:tasks.workunit.client.0.smithi002.stdout:2/987: truncate d1b/d37/d48/d52/f126 694670 0 2024-09-17T01:02:08.064 INFO:tasks.workunit.client.0.smithi002.stdout:9/967: mkdir d5/dc/d26/d5c/d6b/d75/d57/d12d 0 2024-09-17T01:02:08.065 INFO:tasks.workunit.client.0.smithi002.stdout:9/968: creat d5/dc/d26/d5c/f12e x:0 0 0 2024-09-17T01:02:08.073 INFO:tasks.workunit.client.0.smithi002.stdout:2/988: dread d1b/d1d/d79/fd2 [0,4194304] 0 2024-09-17T01:02:08.080 INFO:tasks.workunit.client.0.smithi002.stdout:9/969: dwrite d5/dc/d26/d46/d47/da1/f10b [0,4194304] 0 2024-09-17T01:02:08.082 INFO:tasks.workunit.client.0.smithi002.stdout:9/970: creat d5/dc/d26/d5c/d6b/d75/d57/d8d/f12f x:0 0 0 2024-09-17T01:02:08.083 INFO:tasks.workunit.client.0.smithi002.stdout:9/971: rename d5/dc/d26/d5c/d6b/d75/d57/d7a/f8b to d5/dc/d26/d5c/de4/f130 0 2024-09-17T01:02:08.084 INFO:tasks.workunit.client.0.smithi002.stdout:9/972: mkdir d5/d8a/dd3/d131 0 2024-09-17T01:02:08.084 INFO:tasks.workunit.client.0.smithi002.stdout:2/989: read d1b/d1d/dd4/fff [1605712,29494] 0 2024-09-17T01:02:08.085 INFO:tasks.workunit.client.0.smithi002.stdout:9/973: truncate d5/dc/d26/d5c/d6b/f9b 4910657 0 2024-09-17T01:02:08.085 INFO:tasks.workunit.client.0.smithi002.stdout:9/974: write d5/dc/f68 [1527065,90547] 0 2024-09-17T01:02:08.086 INFO:tasks.workunit.client.0.smithi002.stdout:2/990: link d1b/d3f/d59/cb8 d1b/d37/d48/db1/c15c 0 2024-09-17T01:02:08.088 INFO:tasks.workunit.client.0.smithi002.stdout:9/975: creat d5/dc/d26/d5c/d6b/d75/d57/d12d/f132 x:0 0 0 2024-09-17T01:02:08.090 INFO:tasks.workunit.client.0.smithi002.stdout:9/976: rename d5/dc/d26/d46/d47/d89/ff4 to d5/dc/d26/d63/f133 0 2024-09-17T01:02:08.090 INFO:tasks.workunit.client.0.smithi002.stdout:9/977: chown d5/dc/d26/d46/d47/d89/la6 668 1 2024-09-17T01:02:08.109 INFO:tasks.workunit.client.0.smithi002.stdout:9/978: dwrite d5/dc/d26/d5c/d6b/d75/f42 [0,4194304] 0 2024-09-17T01:02:08.110 INFO:tasks.workunit.client.0.smithi002.stdout:2/991: dwrite d1b/d3f/d59/d7f/dc9/f3c [0,4194304] 0 2024-09-17T01:02:08.110 INFO:tasks.workunit.client.0.smithi002.stdout:2/992: fsync d1b/d3f/d59/d7f/dc9/dac/f10e 0 2024-09-17T01:02:08.110 INFO:tasks.workunit.client.0.smithi002.stdout:2/993: stat d1b/d3f/d59/d7f/dc9/dac/fe5 0 2024-09-17T01:02:08.110 INFO:tasks.workunit.client.0.smithi002.stdout:2/994: chown d1b/d74/d93/d94/d133/f13c 56718288 1 2024-09-17T01:02:08.110 INFO:tasks.workunit.client.0.smithi002.stdout:2/995: creat d1b/d1d/dc8/f15d x:0 0 0 2024-09-17T01:02:08.112 INFO:tasks.workunit.client.0.smithi002.stdout:2/996: truncate d1b/d1d/f33 4090473 0 2024-09-17T01:02:08.117 INFO:tasks.workunit.client.0.smithi002.stdout:2/997: write ff [1970016,114188] 0 2024-09-17T01:02:08.118 INFO:tasks.workunit.client.0.smithi002.stdout:2/998: dread d1b/d1d/dd4/ff5 [0,4194304] 0 2024-09-17T01:02:08.119 INFO:tasks.workunit.client.0.smithi002.stdout:2/999: mkdir d1b/d74/d93/d118/d120/d15e 0 2024-09-17T01:02:08.128 INFO:tasks.workunit.client.0.smithi002.stdout:9/979: dwrite d5/dc/d26/d63/d66/f88 [0,4194304] 0 2024-09-17T01:02:08.128 INFO:tasks.workunit.client.0.smithi002.stdout:9/980: stat d5/dc/d26/d5c/d6b/d75/d36/f11e 0 2024-09-17T01:02:08.129 INFO:tasks.workunit.client.0.smithi002.stdout:9/981: creat d5/dc/d26/d5c/d6b/d75/d36/f134 x:0 0 0 2024-09-17T01:02:08.129 INFO:tasks.workunit.client.0.smithi002.stdout:9/982: write d5/d8a/d9d/fa3 [1103583,77018] 0 2024-09-17T01:02:08.129 INFO:tasks.workunit.client.0.smithi002.stdout:9/983: mknod d5/dc/d26/d5c/d6b/d75/d57/d8d/c135 0 2024-09-17T01:02:08.137 INFO:tasks.workunit.client.0.smithi002.stdout:9/984: dread d5/dc/d26/d46/f50 [0,4194304] 0 2024-09-17T01:02:08.138 INFO:tasks.workunit.client.0.smithi002.stdout:9/985: symlink d5/dc/d26/d46/l136 0 2024-09-17T01:02:08.138 INFO:tasks.workunit.client.0.smithi002.stdout:9/986: creat d5/dc/d26/d46/d47/d89/dec/f137 x:0 0 0 2024-09-17T01:02:08.156 INFO:tasks.workunit.client.0.smithi002.stdout:9/987: dwrite d5/dc/d26/d46/d47/d89/d117/f11c [0,4194304] 0 2024-09-17T01:02:08.158 INFO:tasks.workunit.client.0.smithi002.stdout:9/988: rename d5/dc/dbc to d5/d8a/d138 0 2024-09-17T01:02:08.159 INFO:tasks.workunit.client.0.smithi002.stdout:9/989: fsync d5/dc/d26/d9c/f112 0 2024-09-17T01:02:08.167 INFO:tasks.workunit.client.0.smithi002.stdout:9/990: dread d5/f3e [4194304,4194304] 0 2024-09-17T01:02:08.168 INFO:tasks.workunit.client.0.smithi002.stdout:9/991: truncate d5/dc/d26/d46/d47/da1/f10b 2713513 0 2024-09-17T01:02:08.168 INFO:tasks.workunit.client.0.smithi002.stdout:9/992: chown d5/dc/d26/d63/c10d 1588 1 2024-09-17T01:02:08.169 INFO:tasks.workunit.client.0.smithi002.stdout:9/993: creat d5/dc/d26/d5c/d6b/d75/f139 x:0 0 0 2024-09-17T01:02:08.170 INFO:tasks.workunit.client.0.smithi002.stdout:9/994: symlink d5/dc/d26/d46/d47/d89/l13a 0 2024-09-17T01:02:08.170 INFO:tasks.workunit.client.0.smithi002.stdout:9/995: mkdir d5/dc/d26/d46/d13b 0 2024-09-17T01:02:08.171 INFO:tasks.workunit.client.0.smithi002.stdout:9/996: write d5/dc/d26/d63/f133 [201160,67883] 0 2024-09-17T01:02:08.183 INFO:tasks.workunit.client.0.smithi002.stdout:9/997: dwrite d5/dc/f84 [0,4194304] 0 2024-09-17T01:02:08.185 INFO:tasks.workunit.client.0.smithi002.stdout:9/998: rmdir d5 39 2024-09-17T01:02:08.193 INFO:tasks.workunit.client.0.smithi002.stdout:9/999: dread d5/dc/d26/d63/d66/fc4 [0,4194304] 0 2024-09-17T01:02:08.227 INFO:tasks.workunit.client.0.smithi002.stdout:0/933: sync 2024-09-17T01:02:08.227 INFO:tasks.workunit.client.0.smithi002.stdout:0/934: fsync dd/d19/f4e 0 2024-09-17T01:02:08.233 INFO:tasks.workunit.client.0.smithi002.stdout:0/935: dread dd/d19/d1a/d29/d55/f131 [0,4194304] 0 2024-09-17T01:02:08.233 INFO:tasks.workunit.client.0.smithi002.stdout:0/936: stat dd/f36 0 2024-09-17T01:02:08.234 INFO:tasks.workunit.client.0.smithi002.stdout:0/937: getdents dd/d19/d9f 0 2024-09-17T01:02:08.235 INFO:tasks.workunit.client.0.smithi002.stdout:0/938: rmdir dd/d19/d1a/d29/d55/d61 39 2024-09-17T01:02:08.235 INFO:tasks.workunit.client.0.smithi002.stdout:0/939: getdents dd/d19/d1a/d29 0 2024-09-17T01:02:08.238 INFO:tasks.workunit.client.0.smithi002.stdout:0/940: write dd/d19/d1a/f5f [822098,122697] 0 2024-09-17T01:02:08.239 INFO:tasks.workunit.client.0.smithi002.stdout:0/941: link dd/d19/d1c/d1f/d22/l4c dd/d19/da9/de5/d68/l142 0 2024-09-17T01:02:08.240 INFO:tasks.workunit.client.0.smithi002.stdout:0/942: rename dd/d19/l2e to dd/d19/d1c/d1f/d76/l143 0 2024-09-17T01:02:08.241 INFO:tasks.workunit.client.0.smithi002.stdout:0/943: dread dd/d19/f2c [0,4194304] 0 2024-09-17T01:02:08.244 INFO:tasks.workunit.client.0.smithi002.stdout:0/944: dread dd/d19/f1e [0,4194304] 0 2024-09-17T01:02:08.245 INFO:tasks.workunit.client.0.smithi002.stdout:0/945: truncate dd/d19/d1c/d1f/f21 1170345 0 2024-09-17T01:02:08.245 INFO:tasks.workunit.client.0.smithi002.stdout:0/946: stat dd/d19/d1a/l8b 0 2024-09-17T01:02:08.245 INFO:tasks.workunit.client.0.smithi002.stdout:0/947: truncate dd/d19/da9/f129 720946 0 2024-09-17T01:02:08.247 INFO:tasks.workunit.client.0.smithi002.stdout:0/948: symlink dd/d19/d1c/db7/db4/dff/l144 0 2024-09-17T01:02:08.247 INFO:tasks.workunit.client.0.smithi002.stdout:0/949: chown dd/d19/d9f/fb0 1860223519 1 2024-09-17T01:02:08.265 INFO:tasks.workunit.client.1.smithi099.stdout:4/966: sync 2024-09-17T01:02:08.266 INFO:tasks.workunit.client.0.smithi002.stdout:0/950: dwrite dd/d19/d1c/d1f/dc4/f114 [0,4194304] 0 2024-09-17T01:02:08.266 INFO:tasks.workunit.client.0.smithi002.stdout:0/951: chown dd/d120/lbf 195040 1 2024-09-17T01:02:08.266 INFO:tasks.workunit.client.1.smithi099.stdout:7/920: sync 2024-09-17T01:02:08.268 INFO:tasks.workunit.client.0.smithi002.stdout:0/952: symlink dd/d3d/l145 0 2024-09-17T01:02:08.268 INFO:tasks.workunit.client.0.smithi002.stdout:0/953: dread - dd/d19/d1c/deb/fed zero size 2024-09-17T01:02:08.283 INFO:tasks.workunit.client.1.smithi099.stdout:7/921: dread d1/d8f/ffd [0,4194304] 0 2024-09-17T01:02:08.284 INFO:tasks.workunit.client.1.smithi099.stdout:7/922: chown d1/d37/d78/db2/d114/c125 4047443 1 2024-09-17T01:02:08.284 INFO:tasks.workunit.client.1.smithi099.stdout:7/923: creat d1/d37/d4f/d107/d47/d48/d60/f12a x:0 0 0 2024-09-17T01:02:08.286 INFO:tasks.workunit.client.1.smithi099.stdout:7/924: link d1/d37/d4f/d107/d47/fca d1/d37/d4f/d107/d47/d48/f12b 0 2024-09-17T01:02:08.290 INFO:tasks.workunit.client.1.smithi099.stdout:7/925: unlink d1/d8f/ffd 0 2024-09-17T01:02:08.298 INFO:tasks.workunit.client.0.smithi002.stdout:0/954: dwrite dd/d19/d1c/db7/f6e [0,4194304] 0 2024-09-17T01:02:08.300 INFO:tasks.workunit.client.0.smithi002.stdout:0/955: link dd/d19/da9/l134 dd/d19/d1c/d1f/l146 0 2024-09-17T01:02:08.300 INFO:tasks.workunit.client.1.smithi099.stdout:4/967: dwrite d7/dd/d21/d7b/fcc [4194304,4194304] 0 2024-09-17T01:02:08.301 INFO:tasks.workunit.client.0.smithi002.stdout:0/956: truncate dd/d19/d9f/f115 3193795 0 2024-09-17T01:02:08.302 INFO:tasks.workunit.client.1.smithi099.stdout:4/968: getdents d7/dd/de/d10/d6b/d82/d8a/d9a/da6/dcd/d83 0 2024-09-17T01:02:08.302 INFO:tasks.workunit.client.1.smithi099.stdout:7/926: write d1/d37/d4f/d107/d5c/f13 [3603411,74076] 0 2024-09-17T01:02:08.302 INFO:tasks.workunit.client.1.smithi099.stdout:7/927: write d1/d37/d4f/d107/d5c/d1c/d129/f105 [392891,39737] 0 2024-09-17T01:02:08.302 INFO:tasks.workunit.client.1.smithi099.stdout:7/928: stat d1/d37/d4f/d107/d5c/d1c/d5a/d76/dbf/fee 0 2024-09-17T01:02:08.304 INFO:tasks.workunit.client.1.smithi099.stdout:4/969: creat d7/dbc/d108/f142 x:0 0 0 2024-09-17T01:02:08.304 INFO:tasks.workunit.client.1.smithi099.stdout:4/970: write d7/dd/d21/d26/d3f/d5b/da4/f139 [396741,40165] 0 2024-09-17T01:02:08.304 INFO:tasks.workunit.client.1.smithi099.stdout:4/971: truncate d7/dd/f28 719516 0 2024-09-17T01:02:08.306 INFO:tasks.workunit.client.1.smithi099.stdout:7/929: link d1/d37/d4f/d107/d47/f6c d1/d37/d4f/d107/d5c/d1c/d5a/db3/df4/f12c 0 2024-09-17T01:02:08.307 INFO:tasks.workunit.client.1.smithi099.stdout:7/930: fsync d1/d37/d4f/d107/d5c/d1c/d72/fd3 0 2024-09-17T01:02:08.308 INFO:tasks.workunit.client.1.smithi099.stdout:7/931: creat d1/d37/d4f/d107/d5c/d1c/d72/d123/f12d x:0 0 0 2024-09-17T01:02:08.312 INFO:tasks.workunit.client.1.smithi099.stdout:7/932: creat d1/d37/d4f/d107/d5c/d1c/d5a/d76/d115/f12e x:0 0 0 2024-09-17T01:02:08.312 INFO:tasks.workunit.client.1.smithi099.stdout:7/933: mknod d1/d37/d4f/d107/d7a/c12f 0 2024-09-17T01:02:08.319 INFO:tasks.workunit.client.1.smithi099.stdout:7/934: dread d1/d37/d4f/d107/d5c/d1c/d72/f86 [0,4194304] 0 2024-09-17T01:02:08.335 INFO:tasks.workunit.client.1.smithi099.stdout:7/935: dwrite d1/d37/d4f/d107/d47/d48/d60/f11a [0,4194304] 0 2024-09-17T01:02:08.335 INFO:tasks.workunit.client.1.smithi099.stdout:7/936: read - d1/d37/d4f/d107/d5c/d1c/d72/f7e zero size 2024-09-17T01:02:08.337 INFO:tasks.workunit.client.1.smithi099.stdout:7/937: mkdir d1/d8f/d130 0 2024-09-17T01:02:08.337 INFO:tasks.workunit.client.1.smithi099.stdout:7/938: write d1/d37/d4f/d107/d5c/d1c/d5a/d76/f111 [1652815,80189] 0 2024-09-17T01:02:08.337 INFO:tasks.workunit.client.1.smithi099.stdout:7/939: write d1/d37/d4f/d107/d5c/d1c/d5a/d76/f90 [757668,120051] 0 2024-09-17T01:02:08.344 INFO:tasks.workunit.client.1.smithi099.stdout:7/940: dread d1/f25 [0,4194304] 0 2024-09-17T01:02:08.344 INFO:tasks.workunit.client.1.smithi099.stdout:7/941: truncate d1/d37/d4f/d107/d7a/dac/fb9 4425606 0 2024-09-17T01:02:08.345 INFO:tasks.workunit.client.1.smithi099.stdout:7/942: stat d1/d37/d4f/d107/d47/d48/d119 0 2024-09-17T01:02:08.349 INFO:tasks.workunit.client.1.smithi099.stdout:7/943: dread d1/d36/f46 [0,4194304] 0 2024-09-17T01:02:08.349 INFO:tasks.workunit.client.1.smithi099.stdout:7/944: dread - d1/d37/d4f/d107/d47/d48/d60/f12a zero size 2024-09-17T01:02:08.363 INFO:tasks.workunit.client.1.smithi099.stdout:7/945: dwrite d1/d37/d4f/d107/d47/d48/d60/f12a [0,4194304] 0 2024-09-17T01:02:08.365 INFO:tasks.workunit.client.1.smithi099.stdout:7/946: unlink d1/d37/d4f/d107/d5c/d1c/d129/c52 0 2024-09-17T01:02:08.366 INFO:tasks.workunit.client.0.smithi002.stdout:0/957: sync 2024-09-17T01:02:08.367 INFO:tasks.workunit.client.1.smithi099.stdout:7/947: creat d1/d37/d4f/d107/d5c/d1c/d5a/db3/f131 x:0 0 0 2024-09-17T01:02:08.367 INFO:tasks.workunit.client.1.smithi099.stdout:7/948: write d1/d37/d4f/d107/d5c/d1c/d5a/db3/f10c [828722,54660] 0 2024-09-17T01:02:08.367 INFO:tasks.workunit.client.0.smithi002.stdout:0/958: creat dd/f147 x:0 0 0 2024-09-17T01:02:08.368 INFO:tasks.workunit.client.1.smithi099.stdout:7/949: creat d1/d37/d4f/d107/d7a/f132 x:0 0 0 2024-09-17T01:02:08.369 INFO:tasks.workunit.client.1.smithi099.stdout:7/950: fsync d1/d37/d4f/d107/d5c/fe 0 2024-09-17T01:02:08.382 INFO:tasks.workunit.client.0.smithi002.stdout:0/959: dwrite dd/d19/d1c/deb/f100 [0,4194304] 0 2024-09-17T01:02:08.394 INFO:tasks.workunit.client.0.smithi002.stdout:0/960: dwrite dd/d19/d1c/f11b [0,4194304] 0 2024-09-17T01:02:08.396 INFO:tasks.workunit.client.0.smithi002.stdout:0/961: getdents dd/d19/d1c/d1f/d76 0 2024-09-17T01:02:08.397 INFO:tasks.workunit.client.0.smithi002.stdout:0/962: symlink dd/d19/d1c/l148 0 2024-09-17T01:02:08.397 INFO:tasks.workunit.client.0.smithi002.stdout:0/963: chown dd/d19/d1a/d29/d55/d56/d110 75230 1 2024-09-17T01:02:08.398 INFO:tasks.workunit.client.0.smithi002.stdout:0/964: mkdir dd/d19/d149 0 2024-09-17T01:02:08.400 INFO:tasks.workunit.client.0.smithi002.stdout:0/965: symlink dd/d19/d1c/db7/db4/l14a 0 2024-09-17T01:02:08.400 INFO:tasks.workunit.client.0.smithi002.stdout:0/966: creat dd/d19/f14b x:0 0 0 2024-09-17T01:02:08.405 INFO:tasks.workunit.client.0.smithi002.stdout:0/967: dread dd/d19/d1c/d1f/f77 [0,4194304] 0 2024-09-17T01:02:08.406 INFO:tasks.workunit.client.0.smithi002.stdout:0/968: mkdir dd/d120/d14c 0 2024-09-17T01:02:08.407 INFO:tasks.workunit.client.0.smithi002.stdout:0/969: write dd/d19/d1a/d29/d55/d61/f6c [202377,106032] 0 2024-09-17T01:02:08.420 INFO:tasks.workunit.client.0.smithi002.stdout:0/970: dwrite dd/d120/dbe/f139 [0,4194304] 0 2024-09-17T01:02:08.421 INFO:tasks.workunit.client.0.smithi002.stdout:0/971: dread dd/d19/da9/de5/d68/fc9 [0,4194304] 0 2024-09-17T01:02:08.421 INFO:tasks.workunit.client.0.smithi002.stdout:0/972: stat dd/d19/da9/de5/db9/cfa 0 2024-09-17T01:02:08.423 INFO:tasks.workunit.client.0.smithi002.stdout:0/973: link dd/d19/d1a/d29/d55/cd8 dd/d19/d1c/d33/d137/c14d 0 2024-09-17T01:02:08.423 INFO:tasks.workunit.client.0.smithi002.stdout:0/974: fsync dd/d120/dbe/f139 0 2024-09-17T01:02:08.424 INFO:tasks.workunit.client.0.smithi002.stdout:0/975: chown dd/d19/da9/de5/d68/ce8 210670 1 2024-09-17T01:02:08.424 INFO:tasks.workunit.client.0.smithi002.stdout:0/976: rmdir dd/d19/d1c/db7/db4/dff 39 2024-09-17T01:02:08.425 INFO:tasks.workunit.client.0.smithi002.stdout:0/977: link dd/d3d/l4b dd/d19/d1a/d29/d55/l14e 0 2024-09-17T01:02:08.437 INFO:tasks.workunit.client.0.smithi002.stdout:0/978: dwrite dd/fcc [0,4194304] 0 2024-09-17T01:02:08.437 INFO:tasks.workunit.client.0.smithi002.stdout:0/979: dread - dd/d19/d1c/deb/fed zero size 2024-09-17T01:02:08.438 INFO:tasks.workunit.client.0.smithi002.stdout:0/980: readlink dd/d19/d1c/dba/lc6 0 2024-09-17T01:02:08.440 INFO:tasks.workunit.client.0.smithi002.stdout:0/981: read dd/d19/d1c/d1f/d76/f7c [172157,28680] 0 2024-09-17T01:02:08.442 INFO:tasks.workunit.client.0.smithi002.stdout:0/982: mkdir dd/d19/d1c/d14f 0 2024-09-17T01:02:08.442 INFO:tasks.workunit.client.0.smithi002.stdout:0/983: write dd/d19/f97 [4238132,4158] 0 2024-09-17T01:02:08.443 INFO:tasks.workunit.client.0.smithi002.stdout:0/984: unlink dd/d19/d1a/d29/d55/f131 0 2024-09-17T01:02:08.460 INFO:tasks.workunit.client.0.smithi002.stdout:0/985: dwrite dd/d19/d1a/d29/d55/d56/fc1 [0,4194304] 0 2024-09-17T01:02:08.460 INFO:tasks.workunit.client.0.smithi002.stdout:0/986: mkdir dd/d19/d1c/d33/d137/d150 0 2024-09-17T01:02:08.461 INFO:tasks.workunit.client.0.smithi002.stdout:0/987: mkdir dd/d19/d1c/d33/d137/d150/d151 0 2024-09-17T01:02:08.461 INFO:tasks.workunit.client.0.smithi002.stdout:0/988: fsync dd/d19/fe4 0 2024-09-17T01:02:08.462 INFO:tasks.workunit.client.0.smithi002.stdout:0/989: rename dd/d19/d1a/f2b to dd/d3d/d130/f152 0 2024-09-17T01:02:08.463 INFO:tasks.workunit.client.0.smithi002.stdout:0/990: truncate dd/d19/d1a/f4a 130442 0 2024-09-17T01:02:08.463 INFO:tasks.workunit.client.0.smithi002.stdout:0/991: chown dd/l10 3768454 1 2024-09-17T01:02:08.464 INFO:tasks.workunit.client.0.smithi002.stdout:0/992: creat dd/d120/dbe/df5/f153 x:0 0 0 2024-09-17T01:02:08.465 INFO:tasks.workunit.client.0.smithi002.stdout:0/993: mknod dd/c154 0 2024-09-17T01:02:08.470 INFO:tasks.workunit.client.1.smithi099.stdout:6/965: sync 2024-09-17T01:02:08.470 INFO:tasks.workunit.client.1.smithi099.stdout:6/966: chown dc/d1a/d49/da8/f114 0 1 2024-09-17T01:02:08.470 INFO:tasks.workunit.client.1.smithi099.stdout:6/967: chown dc/d27/d7e/l83 4 1 2024-09-17T01:02:08.470 INFO:tasks.workunit.client.1.smithi099.stdout:6/968: write dc/d5d/d66/dbb/d10c/f78 [5488993,60622] 0 2024-09-17T01:02:08.472 INFO:tasks.workunit.client.1.smithi099.stdout:6/969: mknod dc/d2b/d11e/d106/d138/ddf/de9/c143 0 2024-09-17T01:02:08.473 INFO:tasks.workunit.client.1.smithi099.stdout:6/970: mkdir dc/d5d/dae/d144 0 2024-09-17T01:02:08.475 INFO:tasks.workunit.client.1.smithi099.stdout:6/971: rename dc/d27/f134 to dc/d5d/dae/d132/d87/db6/f145 0 2024-09-17T01:02:08.476 INFO:tasks.workunit.client.1.smithi099.stdout:6/972: link dc/d1a/l1c dc/d5d/d66/dc3/dd4/l146 0 2024-09-17T01:02:08.482 INFO:tasks.workunit.client.0.smithi002.stdout:0/994: dwrite dd/d19/d1a/d29/d55/d56/fc1 [0,4194304] 0 2024-09-17T01:02:08.483 INFO:tasks.workunit.client.0.smithi002.stdout:0/995: rename dd/d19/d1a/d29/d55/d56/d110 to dd/d120/dbe/d155 0 2024-09-17T01:02:08.484 INFO:tasks.workunit.client.0.smithi002.stdout:0/996: link dd/f15 dd/d19/d1c/d1f/d22/dc3/f156 0 2024-09-17T01:02:08.485 INFO:tasks.workunit.client.0.smithi002.stdout:0/997: creat dd/d19/d1c/deb/f157 x:0 0 0 2024-09-17T01:02:08.485 INFO:tasks.workunit.client.0.smithi002.stdout:0/998: fsync dd/d3d/f128 0 2024-09-17T01:02:08.502 INFO:tasks.workunit.client.0.smithi002.stdout:0/999: dwrite dd/d19/f97 [4194304,4194304] 0 2024-09-17T01:02:08.505 INFO:tasks.workunit.client.0.smithi002.stderr:+ rm -rf -- ./tmp.mACipHsvjA 2024-09-17T01:02:08.517 INFO:tasks.workunit.client.1.smithi099.stdout:2/870: sync 2024-09-17T01:02:08.518 INFO:tasks.workunit.client.1.smithi099.stdout:2/871: stat d2/d9/d17/f21 0 2024-09-17T01:02:08.519 INFO:tasks.workunit.client.1.smithi099.stdout:2/872: unlink d2/d9/d17/de0/c5e 0 2024-09-17T01:02:08.519 INFO:tasks.workunit.client.1.smithi099.stdout:2/873: chown d2/d9/c43 9016293 1 2024-09-17T01:02:08.520 INFO:tasks.workunit.client.1.smithi099.stdout:2/874: symlink d2/d9/d25/d26/d1b/dff/l122 0 2024-09-17T01:02:08.520 INFO:tasks.workunit.client.1.smithi099.stdout:2/875: dread - d2/d9/d25/d26/d1b/d61/d7d/d85/d98/f104 zero size 2024-09-17T01:02:08.520 INFO:tasks.workunit.client.1.smithi099.stdout:2/876: symlink d2/d9/df1/l123 0 2024-09-17T01:02:08.520 INFO:tasks.workunit.client.1.smithi099.stdout:2/877: stat d2/d9/d25/d26/faf 0 2024-09-17T01:02:08.521 INFO:tasks.workunit.client.1.smithi099.stdout:2/878: rmdir d2/d9/d25/d97 39 2024-09-17T01:02:08.521 INFO:tasks.workunit.client.1.smithi099.stdout:2/879: dread - d2/d9/d25/f114 zero size 2024-09-17T01:02:08.522 INFO:tasks.workunit.client.1.smithi099.stdout:2/880: creat d2/d9/d25/d26/d1b/d61/d7d/d85/d98/de1/d10c/f124 x:0 0 0 2024-09-17T01:02:08.525 INFO:tasks.workunit.client.1.smithi099.stdout:2/881: rename d2/d9/d17/f76 to d2/d9/d25/d26/d1b/d2c/d9b/de6/f125 0 2024-09-17T01:02:08.525 INFO:tasks.workunit.client.1.smithi099.stdout:2/882: fsync d2/d9/d17/d58/f11d 0 2024-09-17T01:02:08.526 INFO:tasks.workunit.client.1.smithi099.stdout:2/883: getdents d2/d9/d25/d26/d1b/d2c/d9b/db1 0 2024-09-17T01:02:08.528 INFO:tasks.workunit.client.1.smithi099.stdout:2/884: write d2/d9/d17/f21 [3030177,8110] 0 2024-09-17T01:02:08.528 INFO:tasks.workunit.client.1.smithi099.stdout:2/885: write d2/d9/d25/d97/fa1 [5084628,122922] 0 2024-09-17T01:02:08.529 INFO:tasks.workunit.client.1.smithi099.stdout:2/886: mkdir d2/d9/d25/d26/d1b/d61/d126 0 2024-09-17T01:02:08.529 INFO:tasks.workunit.client.1.smithi099.stdout:2/887: write d2/d9/d25/d26/d1b/d61/ff6 [326458,104446] 0 2024-09-17T01:02:08.530 INFO:tasks.workunit.client.1.smithi099.stdout:2/888: unlink d2/d9/d17/cc9 0 2024-09-17T01:02:08.530 INFO:tasks.workunit.client.1.smithi099.stdout:2/889: fsync d2/d9/d25/d26/d1b/dff/f11f 0 2024-09-17T01:02:08.531 INFO:tasks.workunit.client.1.smithi099.stdout:2/890: truncate d2/d9/d25/d68/f11c 652969 0 2024-09-17T01:02:08.544 INFO:tasks.workunit.client.1.smithi099.stdout:2/891: dwrite d2/d9/d25/f2d [0,4194304] 0 2024-09-17T01:02:08.545 INFO:tasks.workunit.client.1.smithi099.stdout:2/892: stat d2/d9/d17/d58/cd5 0 2024-09-17T01:02:08.545 INFO:tasks.workunit.client.1.smithi099.stdout:2/893: fdatasync d2/d9/d17/d83/d8d/dd9/fa6 0 2024-09-17T01:02:08.554 INFO:tasks.workunit.client.1.smithi099.stdout:2/894: write d2/d9/d17/d83/d8d/dd9/fa6 [307656,112285] 0 2024-09-17T01:02:08.557 INFO:tasks.workunit.client.1.smithi099.stdout:2/895: rename d2/d9/d25/d26/d1b/d61/d7d to d2/d9/d25/d26/d127 0 2024-09-17T01:02:08.560 INFO:tasks.workunit.client.1.smithi099.stdout:2/896: write d2/d9/d25/f4f [3098586,77534] 0 2024-09-17T01:02:08.698 INFO:tasks.workunit.client.1.smithi099.stdout:4/972: sync 2024-09-17T01:02:08.698 INFO:tasks.workunit.client.1.smithi099.stdout:7/951: sync 2024-09-17T01:02:08.698 INFO:tasks.workunit.client.1.smithi099.stdout:7/952: write d1/d36/fa4 [2168328,71114] 0 2024-09-17T01:02:08.699 INFO:tasks.workunit.client.1.smithi099.stdout:4/973: creat d7/dbc/d108/f143 x:0 0 0 2024-09-17T01:02:08.699 INFO:tasks.workunit.client.1.smithi099.stdout:7/953: chown d1/d37/d4f/d107/d5c/f98 866 1 2024-09-17T01:02:08.699 INFO:tasks.workunit.client.1.smithi099.stdout:4/974: rmdir d7/dd/de/d10/d6b/d82/d8a/d9a 39 2024-09-17T01:02:08.701 INFO:tasks.workunit.client.1.smithi099.stdout:7/954: truncate d1/d37/d4f/d107/d47/f50 3417070 0 2024-09-17T01:02:08.702 INFO:tasks.workunit.client.1.smithi099.stdout:4/975: symlink d7/dd/d21/d26/d3f/l144 0 2024-09-17T01:02:08.703 INFO:tasks.workunit.client.1.smithi099.stdout:7/955: mkdir d1/d37/d4f/d107/d5c/d1c/d72/d123/d133 0 2024-09-17T01:02:08.706 INFO:tasks.workunit.client.1.smithi099.stdout:7/956: rename d1/d37/d4f/d107/d5c/d12/f29 to d1/d37/d4f/d107/d5c/d1c/d5a/d76/dbf/f134 0 2024-09-17T01:02:08.707 INFO:tasks.workunit.client.1.smithi099.stdout:4/976: unlink d7/dd/de/f3c 0 2024-09-17T01:02:08.707 INFO:tasks.workunit.client.1.smithi099.stdout:4/977: truncate d7/d35/f6e 671193 0 2024-09-17T01:02:08.707 INFO:tasks.workunit.client.1.smithi099.stdout:4/978: write d7/dbc/d108/f143 [861903,38050] 0 2024-09-17T01:02:08.708 INFO:tasks.workunit.client.1.smithi099.stdout:7/957: symlink d1/d37/d4f/d107/d47/l135 0 2024-09-17T01:02:08.710 INFO:tasks.workunit.client.1.smithi099.stdout:7/958: rmdir d1/d37/d4f/d107/d47/d48/d11f 0 2024-09-17T01:02:08.710 INFO:tasks.workunit.client.1.smithi099.stdout:7/959: chown d1/d37/d4f/d107/d5c/f4a 3775439 1 2024-09-17T01:02:08.714 INFO:tasks.workunit.client.1.smithi099.stdout:4/979: rmdir d7/dd/de 39 2024-09-17T01:02:08.717 INFO:tasks.workunit.client.1.smithi099.stdout:7/960: write d1/d37/d4f/d107/d5c/d1c/d5a/d6f/fa5 [3209677,63831] 0 2024-09-17T01:02:08.717 INFO:tasks.workunit.client.1.smithi099.stdout:4/980: write d7/dd/d21/d7b/d74/f75 [98258,44189] 0 2024-09-17T01:02:08.717 INFO:tasks.workunit.client.1.smithi099.stdout:4/981: chown d7/dd/d21/d7b/c9f 413 1 2024-09-17T01:02:08.721 INFO:tasks.workunit.client.1.smithi099.stdout:4/982: mkdir d7/dd/d21/d26/d3f/d5b/d145 0 2024-09-17T01:02:08.732 INFO:tasks.workunit.client.1.smithi099.stdout:7/961: dwrite d1/d37/d4f/d107/d5c/d12/f74 [0,4194304] 0 2024-09-17T01:02:08.734 INFO:tasks.workunit.client.1.smithi099.stdout:7/962: mkdir d1/d37/d78/df9/d136 0 2024-09-17T01:02:08.736 INFO:tasks.workunit.client.1.smithi099.stdout:7/963: mknod d1/d36/d8d/c137 0 2024-09-17T01:02:08.737 INFO:tasks.workunit.client.1.smithi099.stdout:7/964: symlink d1/d37/d4f/d107/d5c/d1c/d5a/d6f/l138 0 2024-09-17T01:02:08.740 INFO:tasks.workunit.client.1.smithi099.stdout:7/965: dread d1/d36/fa4 [0,4194304] 0 2024-09-17T01:02:08.740 INFO:tasks.workunit.client.1.smithi099.stdout:7/966: read - d1/d37/d78/fb5 zero size 2024-09-17T01:02:08.751 INFO:tasks.workunit.client.1.smithi099.stdout:7/967: dwrite d1/d37/d4f/d107/d5c/d1c/d72/fdb [4194304,4194304] 0 2024-09-17T01:02:08.752 INFO:tasks.workunit.client.1.smithi099.stdout:7/968: mknod d1/d37/d4f/d107/d5c/d1c/d5a/c139 0 2024-09-17T01:02:08.801 INFO:tasks.workunit.client.1.smithi099.stdout:6/973: sync 2024-09-17T01:02:08.802 INFO:tasks.workunit.client.1.smithi099.stdout:2/897: sync 2024-09-17T01:02:08.802 INFO:tasks.workunit.client.1.smithi099.stdout:6/974: read dc/d1a/fe7 [183488,1357] 0 2024-09-17T01:02:08.802 INFO:tasks.workunit.client.1.smithi099.stdout:2/898: link d2/d9/d17/d58/f8e d2/d9/d25/d26/d1b/d2c/d9b/de6/dfb/f128 0 2024-09-17T01:02:08.804 INFO:tasks.workunit.client.1.smithi099.stdout:6/975: creat dc/d27/f147 x:0 0 0 2024-09-17T01:02:08.804 INFO:tasks.workunit.client.1.smithi099.stdout:6/976: truncate dc/d1a/d49/d4c/f9d 4463305 0 2024-09-17T01:02:08.820 INFO:tasks.workunit.client.1.smithi099.stdout:6/977: dwrite dc/d1a/d49/f45 [0,4194304] 0 2024-09-17T01:02:08.821 INFO:tasks.workunit.client.1.smithi099.stdout:2/899: dwrite d2/d9/d25/d26/d1b/d2c/d9b/de6/f116 [0,4194304] 0 2024-09-17T01:02:08.822 INFO:tasks.workunit.client.1.smithi099.stdout:6/978: rmdir dc/d1a/d49/da8/d110/d119 39 2024-09-17T01:02:08.823 INFO:tasks.workunit.client.1.smithi099.stdout:2/900: creat d2/d9/d25/d26/d127/d85/f129 x:0 0 0 2024-09-17T01:02:08.823 INFO:tasks.workunit.client.1.smithi099.stdout:2/901: chown d2/d9/d25/d26/d1b/d61/ff6 39997 1 2024-09-17T01:02:08.824 INFO:tasks.workunit.client.1.smithi099.stdout:6/979: rmdir dc/d5d/dae/d96 39 2024-09-17T01:02:08.846 INFO:tasks.workunit.client.1.smithi099.stdout:2/902: dwrite d2/d9/d17/d58/f8e [0,4194304] 0 2024-09-17T01:02:08.846 INFO:tasks.workunit.client.1.smithi099.stdout:6/980: dwrite dc/d5d/d66/dbb/d126/f135 [0,4194304] 0 2024-09-17T01:02:08.848 INFO:tasks.workunit.client.1.smithi099.stdout:2/903: creat d2/d9/d25/d26/d1b/d2c/d9b/db1/f12a x:0 0 0 2024-09-17T01:02:08.848 INFO:tasks.workunit.client.1.smithi099.stdout:2/904: fdatasync d2/d9/d25/d26/d1b/dad/f40 0 2024-09-17T01:02:08.850 INFO:tasks.workunit.client.1.smithi099.stdout:2/905: creat d2/d9/d25/f12b x:0 0 0 2024-09-17T01:02:08.851 INFO:tasks.workunit.client.1.smithi099.stdout:6/981: getdents dc/d5d/dae/d96/dfd/d101 0 2024-09-17T01:02:08.851 INFO:tasks.workunit.client.1.smithi099.stdout:6/982: chown dc/d27/d7e/lf0 7088888 1 2024-09-17T01:02:08.851 INFO:tasks.workunit.client.1.smithi099.stdout:6/983: fdatasync dc/d1a/d49/f12f 0 2024-09-17T01:02:08.852 INFO:tasks.workunit.client.1.smithi099.stdout:2/906: creat d2/d9/d17/de0/dc8/f12c x:0 0 0 2024-09-17T01:02:08.854 INFO:tasks.workunit.client.1.smithi099.stdout:6/984: getdents dc/d5d/d66/dbb/d10c/d74 0 2024-09-17T01:02:08.854 INFO:tasks.workunit.client.1.smithi099.stdout:6/985: chown dc/d27/d7e/f9a 427465455 1 2024-09-17T01:02:08.856 INFO:tasks.workunit.client.1.smithi099.stdout:2/907: rmdir d2/d9/d25/df8 0 2024-09-17T01:02:08.856 INFO:tasks.workunit.client.1.smithi099.stdout:6/986: dread dc/d5d/d66/dbb/d10c/f6e [0,4194304] 0 2024-09-17T01:02:08.856 INFO:tasks.workunit.client.1.smithi099.stdout:6/987: chown dc/d2b/d11e/d106/d138/ddf/ca0 32660 1 2024-09-17T01:02:08.857 INFO:tasks.workunit.client.1.smithi099.stdout:6/988: mknod dc/d5d/c148 0 2024-09-17T01:02:08.857 INFO:tasks.workunit.client.1.smithi099.stdout:6/989: getdents dc/d5d/dae/d96/dfd 0 2024-09-17T01:02:08.858 INFO:tasks.workunit.client.1.smithi099.stdout:6/990: symlink dc/d1a/d49/da8/db3/l149 0 2024-09-17T01:02:08.858 INFO:tasks.workunit.client.1.smithi099.stdout:6/991: mkdir dc/d27/d7e/dad/d14a 0 2024-09-17T01:02:08.859 INFO:tasks.workunit.client.1.smithi099.stdout:6/992: creat dc/d5d/dc9/f14b x:0 0 0 2024-09-17T01:02:08.860 INFO:tasks.workunit.client.1.smithi099.stdout:6/993: creat dc/d2b/f14c x:0 0 0 2024-09-17T01:02:08.861 INFO:tasks.workunit.client.1.smithi099.stdout:6/994: mknod dc/d5d/d66/dbb/c14d 0 2024-09-17T01:02:08.863 INFO:tasks.workunit.client.1.smithi099.stdout:2/908: dread d2/d9/d17/de0/fba [0,4194304] 0 2024-09-17T01:02:08.897 INFO:tasks.workunit.client.1.smithi099.stdout:2/909: dwrite d2/d9/d25/d26/d1b/dad/f40 [8388608,4194304] 0 2024-09-17T01:02:08.897 INFO:tasks.workunit.client.1.smithi099.stdout:6/995: dwrite dc/d2b/d11e/d106/d138/ddf/de9/f105 [0,4194304] 0 2024-09-17T01:02:08.900 INFO:tasks.workunit.client.1.smithi099.stdout:2/910: dread d2/d9/d17/d83/f99 [0,4194304] 0 2024-09-17T01:02:08.900 INFO:tasks.workunit.client.1.smithi099.stdout:2/911: readlink d2/d9/d25/d26/d127/d85/d98/d9a/led 0 2024-09-17T01:02:08.908 INFO:tasks.workunit.client.1.smithi099.stdout:6/996: write dc/d2b/d11e/d106/d138/ddf/de9/f105 [422851,92481] 0 2024-09-17T01:02:08.908 INFO:tasks.workunit.client.1.smithi099.stdout:6/997: creat dc/d1a/d49/da8/d110/f14e x:0 0 0 2024-09-17T01:02:08.909 INFO:tasks.workunit.client.1.smithi099.stdout:6/998: link dc/d1a/d49/da8/lcb dc/d27/d7e/l14f 0 2024-09-17T01:02:08.909 INFO:tasks.workunit.client.1.smithi099.stdout:6/999: write dc/d1a/f1e [1669118,73561] 0 2024-09-17T01:02:08.916 INFO:tasks.workunit.client.1.smithi099.stdout:4/983: sync 2024-09-17T01:02:08.916 INFO:tasks.workunit.client.1.smithi099.stdout:7/969: sync 2024-09-17T01:02:08.917 INFO:tasks.workunit.client.1.smithi099.stdout:4/984: chown d7/dd/d21/lb4 5 1 2024-09-17T01:02:08.920 INFO:tasks.workunit.client.1.smithi099.stdout:2/912: dwrite d2/d9/d25/d26/d1b/d2c/fdc [0,4194304] 0 2024-09-17T01:02:08.940 INFO:tasks.workunit.client.1.smithi099.stdout:2/913: dwrite d2/d9/d25/d26/d127/d85/d98/de1/d10c/f124 [0,4194304] 0 2024-09-17T01:02:08.940 INFO:tasks.workunit.client.1.smithi099.stdout:2/914: write d2/d9/d25/d26/d1b/d2c/d3f/fb6 [142688,21404] 0 2024-09-17T01:02:08.940 INFO:tasks.workunit.client.1.smithi099.stdout:2/915: read - d2/d9/d25/d26/d127/d85/d98/f104 zero size 2024-09-17T01:02:08.940 INFO:tasks.workunit.client.1.smithi099.stdout:2/916: getdents d2/d9/dfc/d10b 0 2024-09-17T01:02:08.941 INFO:tasks.workunit.client.1.smithi099.stdout:2/917: symlink d2/d9/d25/d26/d1b/d2c/d9b/de6/l12d 0 2024-09-17T01:02:08.944 INFO:tasks.workunit.client.1.smithi099.stdout:7/970: dwrite d1/d37/d4f/d107/d47/d48/d60/fff [0,4194304] 0 2024-09-17T01:02:08.944 INFO:tasks.workunit.client.1.smithi099.stdout:4/985: dwrite d7/dd/d21/d7b/d74/f7c [0,4194304] 0 2024-09-17T01:02:08.948 INFO:tasks.workunit.client.1.smithi099.stdout:4/986: mkdir d7/dd/de/d10/d6b/d82/d146 0 2024-09-17T01:02:08.948 INFO:tasks.workunit.client.1.smithi099.stdout:4/987: fdatasync d7/dd/d21/d7b/f42 0 2024-09-17T01:02:08.951 INFO:tasks.workunit.client.1.smithi099.stdout:4/988: read d7/dd/d21/d26/f65 [167139,65972] 0 2024-09-17T01:02:08.953 INFO:tasks.workunit.client.1.smithi099.stdout:4/989: link d7/dd/d21/fe8 d7/dd/f147 0 2024-09-17T01:02:08.955 INFO:tasks.workunit.client.1.smithi099.stdout:4/990: rename d7/dd/d21/d26/f6c to d7/dd/de/d10/d6b/d82/d116/f148 0 2024-09-17T01:02:08.960 INFO:tasks.workunit.client.1.smithi099.stdout:2/918: dwrite d2/d9/d17/d58/fe5 [0,4194304] 0 2024-09-17T01:02:08.962 INFO:tasks.workunit.client.1.smithi099.stdout:7/971: dwrite d1/d37/d78/db2/ffa [4194304,4194304] 0 2024-09-17T01:02:08.963 INFO:tasks.workunit.client.1.smithi099.stdout:2/919: symlink d2/d9/d25/d26/d1b/d2c/d3f/db8/l12e 0 2024-09-17T01:02:08.972 INFO:tasks.workunit.client.1.smithi099.stdout:2/920: dread d2/d9/d25/d26/d1b/d2c/d9b/db1/fd7 [0,4194304] 0 2024-09-17T01:02:08.974 INFO:tasks.workunit.client.1.smithi099.stdout:2/921: creat d2/d9/d25/d26/d1b/d2c/f12f x:0 0 0 2024-09-17T01:02:08.976 INFO:tasks.workunit.client.1.smithi099.stdout:2/922: rename d2/d9/d17/d83/f99 to d2/f130 0 2024-09-17T01:02:08.977 INFO:tasks.workunit.client.1.smithi099.stdout:2/923: dread - d2/d9/d17/de0/fd0 zero size 2024-09-17T01:02:08.977 INFO:tasks.workunit.client.1.smithi099.stdout:2/924: write d2/fc7 [300042,41546] 0 2024-09-17T01:02:08.979 INFO:tasks.workunit.client.1.smithi099.stdout:2/925: rmdir d2/d9/d25/d26/d1b/d2c/d3f 39 2024-09-17T01:02:08.979 INFO:tasks.workunit.client.1.smithi099.stdout:4/991: dwrite d7/f8 [0,4194304] 0 2024-09-17T01:02:08.980 INFO:tasks.workunit.client.1.smithi099.stdout:4/992: getdents d7/dd/de/d10/d6b/d82/d146 0 2024-09-17T01:02:08.980 INFO:tasks.workunit.client.1.smithi099.stdout:7/972: dwrite d1/d37/d4f/fc8 [0,4194304] 0 2024-09-17T01:02:08.980 INFO:tasks.workunit.client.1.smithi099.stdout:7/973: stat d1/d37/d4f/d107/d5c/d12/l54 0 2024-09-17T01:02:08.981 INFO:tasks.workunit.client.1.smithi099.stdout:2/926: link d2/d9/d25/d26/f32 d2/d9/d25/d26/d1b/dff/f131 0 2024-09-17T01:02:08.982 INFO:tasks.workunit.client.1.smithi099.stdout:7/974: dread d1/d37/d4f/d107/d5c/fbb [0,4194304] 0 2024-09-17T01:02:08.982 INFO:tasks.workunit.client.1.smithi099.stdout:7/975: creat d1/d37/d4f/d107/d47/d48/f13a x:0 0 0 2024-09-17T01:02:08.982 INFO:tasks.workunit.client.1.smithi099.stdout:2/927: dread d2/d9/d25/d26/f32 [0,4194304] 0 2024-09-17T01:02:08.985 INFO:tasks.workunit.client.1.smithi099.stdout:7/976: symlink d1/d37/d4f/d107/d5c/d12/dc2/l13b 0 2024-09-17T01:02:08.985 INFO:tasks.workunit.client.1.smithi099.stdout:7/977: chown d1/d37/d4f/d107/d47/c11d 920 1 2024-09-17T01:02:08.986 INFO:tasks.workunit.client.1.smithi099.stdout:7/978: symlink d1/d37/d78/db2/d114/l13c 0 2024-09-17T01:02:08.987 INFO:tasks.workunit.client.1.smithi099.stdout:7/979: creat d1/d37/d4f/d107/d5c/d1c/d5a/d76/dbf/f13d x:0 0 0 2024-09-17T01:02:08.988 INFO:tasks.workunit.client.1.smithi099.stdout:7/980: rename d1/d37/d4f/d107/d47/d48/d60/le3 to d1/d37/d4f/d107/d5c/d1c/l13e 0 2024-09-17T01:02:08.993 INFO:tasks.workunit.client.1.smithi099.stdout:2/928: read d2/d9/d25/d26/d1b/d2c/d9b/de6/dfb/f128 [1467102,20630] 0 2024-09-17T01:02:08.993 INFO:tasks.workunit.client.1.smithi099.stdout:2/929: stat d2/d9/d25/d26/d1b/dad/la 0 2024-09-17T01:02:08.994 INFO:tasks.workunit.client.1.smithi099.stdout:2/930: rmdir d2/d9/d25/d26/d127/d85/d98/de1/d10c 39 2024-09-17T01:02:08.994 INFO:tasks.workunit.client.1.smithi099.stdout:2/931: chown d2/d9 8 1 2024-09-17T01:02:08.999 INFO:tasks.workunit.client.1.smithi099.stdout:7/981: dread d1/d37/d4f/d107/d7a/faa [0,4194304] 0 2024-09-17T01:02:09.001 INFO:tasks.workunit.client.1.smithi099.stdout:7/982: link d1/d37/d4f/d107/d7a/dac/db4/ff7 d1/d8f/f13f 0 2024-09-17T01:02:09.001 INFO:tasks.workunit.client.1.smithi099.stdout:7/983: dread - d1/d37/d4f/d107/d5c/d1c/d5a/d76/f117 zero size 2024-09-17T01:02:09.002 INFO:tasks.workunit.client.1.smithi099.stdout:7/984: creat d1/d37/d4f/d107/d5c/d1c/d72/f140 x:0 0 0 2024-09-17T01:02:09.002 INFO:tasks.workunit.client.1.smithi099.stdout:7/985: chown d1/d37/cec 865 1 2024-09-17T01:02:09.003 INFO:tasks.workunit.client.1.smithi099.stdout:4/993: dwrite d7/d35/f78 [0,4194304] 0 2024-09-17T01:02:09.003 INFO:tasks.workunit.client.1.smithi099.stdout:4/994: write d7/dd/de/d10/d6b/d82/f11e [716230,22595] 0 2024-09-17T01:02:09.003 INFO:tasks.workunit.client.1.smithi099.stdout:7/986: mkdir d1/d37/d4f/d107/d5c/d1c/d5a/d76/d115/d141 0 2024-09-17T01:02:09.003 INFO:tasks.workunit.client.1.smithi099.stdout:4/995: mknod d7/dd/d21/d26/d3f/d5b/da4/c149 0 2024-09-17T01:02:09.004 INFO:tasks.workunit.client.1.smithi099.stdout:7/987: symlink d1/d37/d4f/d107/d5c/d1c/d5a/d6f/db6/l142 0 2024-09-17T01:02:09.007 INFO:tasks.workunit.client.1.smithi099.stdout:2/932: dread d2/d9/d17/d58/f71 [0,4194304] 0 2024-09-17T01:02:09.009 INFO:tasks.workunit.client.1.smithi099.stdout:2/933: symlink d2/d9/d25/d26/d1b/d2c/d9b/db1/l132 0 2024-09-17T01:02:09.014 INFO:tasks.workunit.client.1.smithi099.stdout:7/988: dread d1/f10 [0,4194304] 0 2024-09-17T01:02:09.015 INFO:tasks.workunit.client.1.smithi099.stdout:7/989: chown d1/d36/cad 22775507 1 2024-09-17T01:02:09.016 INFO:tasks.workunit.client.1.smithi099.stdout:7/990: getdents d1/d37/d78 0 2024-09-17T01:02:09.016 INFO:tasks.workunit.client.1.smithi099.stdout:7/991: chown d1/d36/d8d/dd6 1 1 2024-09-17T01:02:09.016 INFO:tasks.workunit.client.1.smithi099.stdout:7/992: chown d1/d37/d4f/d107 526963 1 2024-09-17T01:02:09.016 INFO:tasks.workunit.client.1.smithi099.stdout:2/934: dread d2/d9/d25/d26/d1b/d61/f6a [0,4194304] 0 2024-09-17T01:02:09.017 INFO:tasks.workunit.client.1.smithi099.stdout:7/993: mknod d1/d37/d78/db2/c143 0 2024-09-17T01:02:09.017 INFO:tasks.workunit.client.1.smithi099.stdout:7/994: truncate d1/d37/d4f/d107/d47/d48/f13a 857611 0 2024-09-17T01:02:09.017 INFO:tasks.workunit.client.1.smithi099.stdout:4/996: dwrite d7/fc [8388608,4194304] 0 2024-09-17T01:02:09.018 INFO:tasks.workunit.client.1.smithi099.stdout:2/935: creat d2/d9/d25/d26/d127/d85/d98/de1/f133 x:0 0 0 2024-09-17T01:02:09.018 INFO:tasks.workunit.client.1.smithi099.stdout:2/936: creat d2/d9/d17/d83/d8d/f134 x:0 0 0 2024-09-17T01:02:09.020 INFO:tasks.workunit.client.1.smithi099.stdout:4/997: creat d7/dd/d92/d110/f14a x:0 0 0 2024-09-17T01:02:09.023 INFO:tasks.workunit.client.1.smithi099.stdout:4/998: creat d7/dd/d21/d26/d3f/d5b/d145/f14b x:0 0 0 2024-09-17T01:02:09.023 INFO:tasks.workunit.client.1.smithi099.stdout:4/999: chown d7/dd/d92/fe1 55181365 1 2024-09-17T01:02:09.023 INFO:tasks.workunit.client.1.smithi099.stdout:7/995: getdents d1/d37/d4f/d107/d5c/d12/dc2 0 2024-09-17T01:02:09.024 INFO:tasks.workunit.client.1.smithi099.stdout:7/996: creat d1/d37/d4f/d107/d5c/d12/f144 x:0 0 0 2024-09-17T01:02:09.024 INFO:tasks.workunit.client.1.smithi099.stdout:7/997: read - d1/d37/d4f/d107/d5c/d12/dc2/ff0 zero size 2024-09-17T01:02:09.025 INFO:tasks.workunit.client.1.smithi099.stdout:7/998: creat d1/d37/d4f/d107/d5c/d1c/d129/f145 x:0 0 0 2024-09-17T01:02:09.025 INFO:tasks.workunit.client.1.smithi099.stdout:7/999: dread - d1/d37/d4f/d107/d5c/d1c/d5a/d76/dbf/fee zero size 2024-09-17T01:02:09.037 INFO:tasks.workunit.client.1.smithi099.stdout:2/937: dwrite d2/f47 [0,4194304] 0 2024-09-17T01:02:09.040 INFO:tasks.workunit.client.1.smithi099.stdout:2/938: symlink d2/d9/d25/d26/d127/d85/d98/de1/l135 0 2024-09-17T01:02:09.040 INFO:tasks.workunit.client.1.smithi099.stdout:2/939: creat d2/d9/d17/de0/f136 x:0 0 0 2024-09-17T01:02:09.040 INFO:tasks.workunit.client.1.smithi099.stdout:2/940: creat d2/d9/d25/d68/f137 x:0 0 0 2024-09-17T01:02:09.040 INFO:tasks.workunit.client.1.smithi099.stdout:2/941: chown d2/d9/d25/d26/d127/d85/d98/d9a/lc1 7 1 2024-09-17T01:02:09.055 INFO:tasks.workunit.client.1.smithi099.stdout:2/942: dwrite d2/d9/d25/d26/d1b/d61/f6f [0,4194304] 0 2024-09-17T01:02:09.058 INFO:tasks.workunit.client.1.smithi099.stdout:2/943: symlink d2/d9/d17/d83/dae/l138 0 2024-09-17T01:02:09.059 INFO:tasks.workunit.client.1.smithi099.stdout:2/944: rmdir d2/d9/d17/d83/dae 39 2024-09-17T01:02:09.059 INFO:tasks.workunit.client.1.smithi099.stdout:2/945: creat d2/d9/d25/d26/d1b/dad/f139 x:0 0 0 2024-09-17T01:02:09.062 INFO:tasks.workunit.client.1.smithi099.stdout:2/946: mknod d2/d9/d25/d26/d1b/d2c/c13a 0 2024-09-17T01:02:09.062 INFO:tasks.workunit.client.1.smithi099.stdout:2/947: chown d2/d9/d17/de0/f94 959617 1 2024-09-17T01:02:09.062 INFO:tasks.workunit.client.1.smithi099.stdout:2/948: creat d2/d9/d25/d26/d127/d85/f13b x:0 0 0 2024-09-17T01:02:09.065 INFO:tasks.workunit.client.1.smithi099.stdout:2/949: rename d2/d9/d17/de0/l6e to d2/d9/d17/d83/d8d/d8f/l13c 0 2024-09-17T01:02:09.066 INFO:tasks.workunit.client.1.smithi099.stdout:2/950: mknod d2/d9/d25/d97/c13d 0 2024-09-17T01:02:09.080 INFO:tasks.workunit.client.1.smithi099.stdout:2/951: dwrite d2/d9/d25/d26/d1b/dad/fc3 [0,4194304] 0 2024-09-17T01:02:09.083 INFO:tasks.workunit.client.1.smithi099.stdout:2/952: mkdir d2/d9/d17/d83/dca/dfa/d13e 0 2024-09-17T01:02:09.084 INFO:tasks.workunit.client.1.smithi099.stdout:2/953: fsync d2/d9/d17/d83/dca/fd3 0 2024-09-17T01:02:09.085 INFO:tasks.workunit.client.1.smithi099.stdout:2/954: mknod d2/d9/d25/d26/d1b/dad/c13f 0 2024-09-17T01:02:09.088 INFO:tasks.workunit.client.1.smithi099.stdout:2/955: dread d2/d9/d25/d26/d1b/d2c/d9b/de6/dfb/f128 [0,4194304] 0 2024-09-17T01:02:09.089 INFO:tasks.workunit.client.1.smithi099.stdout:2/956: creat d2/d9/d17/d83/dca/dfa/dfe/f140 x:0 0 0 2024-09-17T01:02:09.090 INFO:tasks.workunit.client.1.smithi099.stdout:2/957: symlink d2/d9/l141 0 2024-09-17T01:02:09.105 INFO:tasks.workunit.client.1.smithi099.stdout:2/958: dwrite d2/d9/d17/d58/f109 [0,4194304] 0 2024-09-17T01:02:09.108 INFO:tasks.workunit.client.1.smithi099.stdout:2/959: readlink d2/d9/d25/d26/d1b/l28 0 2024-09-17T01:02:09.108 INFO:tasks.workunit.client.1.smithi099.stdout:2/960: chown d2/d9/d25/d26/f88 145515 1 2024-09-17T01:02:09.109 INFO:tasks.workunit.client.1.smithi099.stdout:2/961: link d2/d9/d25/d97/c13d d2/d9/d25/d26/d127/d85/d98/de1/d10c/c142 0 2024-09-17T01:02:09.111 INFO:tasks.workunit.client.1.smithi099.stdout:2/962: creat d2/d9/d25/d26/d1b/d2c/d9b/de6/dfb/f143 x:0 0 0 2024-09-17T01:02:09.113 INFO:tasks.workunit.client.1.smithi099.stdout:2/963: rename d2/d9/d17/f63 to d2/d9/d25/d26/d127/d85/d98/d9a/f144 0 2024-09-17T01:02:09.114 INFO:tasks.workunit.client.1.smithi099.stdout:2/964: write d2/d9/d17/d58/faa [4470666,11621] 0 2024-09-17T01:02:09.131 INFO:tasks.workunit.client.1.smithi099.stdout:2/965: dwrite d2/d9/d25/d26/d1b/dad/fc3 [0,4194304] 0 2024-09-17T01:02:09.131 INFO:tasks.workunit.client.1.smithi099.stdout:2/966: fdatasync d2/d9/d25/d26/d1b/d2c/d9b/db1/f12a 0 2024-09-17T01:02:09.133 INFO:tasks.workunit.client.1.smithi099.stdout:2/967: rename d2/d9/c46 to d2/d9/dfc/c145 0 2024-09-17T01:02:09.133 INFO:tasks.workunit.client.1.smithi099.stdout:2/968: truncate d2/d9/dfc/f11e 690588 0 2024-09-17T01:02:09.133 INFO:tasks.workunit.client.1.smithi099.stdout:2/969: write d2/d9/d25/f75 [1954775,42948] 0 2024-09-17T01:02:09.134 INFO:tasks.workunit.client.1.smithi099.stdout:2/970: write d2/d9/d25/f4f [759648,58842] 0 2024-09-17T01:02:09.134 INFO:tasks.workunit.client.1.smithi099.stdout:2/971: fsync d2/d9/d17/d58/f71 0 2024-09-17T01:02:09.136 INFO:tasks.workunit.client.1.smithi099.stdout:2/972: dread d2/d9/d17/d58/f8e [0,4194304] 0 2024-09-17T01:02:09.151 INFO:tasks.workunit.client.1.smithi099.stdout:2/973: dwrite d2/d9/d25/d26/d1b/d2c/f77 [4194304,4194304] 0 2024-09-17T01:02:09.153 INFO:tasks.workunit.client.1.smithi099.stdout:2/974: getdents d2/d9/d17/d83/dca/dfa/dfe 0 2024-09-17T01:02:09.155 INFO:tasks.workunit.client.1.smithi099.stdout:2/975: dread d2/d9/d25/d26/f6b [0,4194304] 0 2024-09-17T01:02:09.179 INFO:tasks.workunit.client.1.smithi099.stdout:2/976: dwrite d2/d9/d25/f114 [0,4194304] 0 2024-09-17T01:02:09.196 INFO:tasks.workunit.client.1.smithi099.stdout:2/977: dwrite d2/d9/dfc/f11e [0,4194304] 0 2024-09-17T01:02:09.199 INFO:tasks.workunit.client.1.smithi099.stdout:2/978: mknod d2/d9/d17/d83/d8d/dd9/c146 0 2024-09-17T01:02:09.200 INFO:tasks.workunit.client.1.smithi099.stdout:2/979: mkdir d2/d9/d17/d83/d147 0 2024-09-17T01:02:09.201 INFO:tasks.workunit.client.1.smithi099.stdout:2/980: getdents d2/d9/d25/d97 0 2024-09-17T01:02:09.201 INFO:tasks.workunit.client.1.smithi099.stdout:2/981: write d2/f120 [371259,60940] 0 2024-09-17T01:02:09.210 INFO:tasks.workunit.client.1.smithi099.stdout:2/982: read d2/d9/d25/d26/d1b/f74 [2918861,46244] 0 2024-09-17T01:02:09.211 INFO:tasks.workunit.client.1.smithi099.stdout:2/983: rename d2/d9/d25/d26/d1b/l28 to d2/d9/dfc/l148 0 2024-09-17T01:02:09.213 INFO:tasks.workunit.client.1.smithi099.stdout:2/984: getdents d2/d9/d25/d26 0 2024-09-17T01:02:09.213 INFO:tasks.workunit.client.1.smithi099.stdout:2/985: write d2/d9/d25/d26/d1b/d2c/d9b/db1/fd7 [972126,98374] 0 2024-09-17T01:02:09.214 INFO:tasks.workunit.client.1.smithi099.stdout:2/986: unlink d2/d9/c8c 0 2024-09-17T01:02:09.214 INFO:tasks.workunit.client.1.smithi099.stdout:2/987: fsync d2/d9/d25/d26/d1b/d2c/d3f/fb9 0 2024-09-17T01:02:09.229 INFO:tasks.workunit.client.1.smithi099.stdout:2/988: dwrite d2/d9/d25/d26/d1b/d2c/fa7 [0,4194304] 0 2024-09-17T01:02:09.232 INFO:tasks.workunit.client.1.smithi099.stdout:2/989: creat d2/d9/d17/d83/f149 x:0 0 0 2024-09-17T01:02:09.232 INFO:tasks.workunit.client.1.smithi099.stdout:2/990: stat d2/d9/d25/d26/d1b/d61/l96 0 2024-09-17T01:02:09.234 INFO:tasks.workunit.client.1.smithi099.stdout:2/991: creat d2/d9/d25/d26/d127/d85/d98/de1/d10c/f14a x:0 0 0 2024-09-17T01:02:09.234 INFO:tasks.workunit.client.1.smithi099.stdout:2/992: dread - d2/d9/d17/de0/dc8/f12c zero size 2024-09-17T01:02:09.253 INFO:tasks.workunit.client.1.smithi099.stdout:2/993: dwrite d2/d9/d25/f114 [0,4194304] 0 2024-09-17T01:02:09.254 INFO:tasks.workunit.client.1.smithi099.stdout:2/994: rename d2/d9/d25/d26/d1b/d2c/f52 to d2/d9/d17/d83/d147/f14b 0 2024-09-17T01:02:09.262 INFO:tasks.workunit.client.1.smithi099.stdout:2/995: dread d2/d9/d25/d26/d1b/d2c/f77 [0,4194304] 0 2024-09-17T01:02:09.262 INFO:tasks.workunit.client.1.smithi099.stdout:2/996: truncate d2/d9/d17/d58/f11d 722316 0 2024-09-17T01:02:09.266 INFO:tasks.workunit.client.1.smithi099.stdout:2/997: unlink d2/d9/d25/d26/d1b/dad/fc3 0 2024-09-17T01:02:09.266 INFO:tasks.workunit.client.1.smithi099.stdout:2/998: write d2/d9/d17/de0/fd0 [136949,63181] 0 2024-09-17T01:02:09.266 INFO:tasks.workunit.client.1.smithi099.stdout:2/999: creat d2/d9/d25/d26/d1b/dad/f14c x:0 0 0 2024-09-17T01:02:09.269 INFO:tasks.workunit.client.1.smithi099.stderr:+ rm -rf -- ./tmp.v6Bl8uyJF8 2024-09-17T01:02:09.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:09 smithi002 ceph-mon[27650]: pgmap v258: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 310 MiB/s rd, 372 MiB/s wr, 533 op/s 2024-09-17T01:02:09.701 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:09 smithi099 ceph-mon[34357]: pgmap v258: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 310 MiB/s rd, 372 MiB/s wr, 533 op/s 2024-09-17T01:02:11.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:11 smithi002 ceph-mon[27650]: pgmap v259: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 344 MiB/s rd, 404 MiB/s wr, 607 op/s 2024-09-17T01:02:11.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:11 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:11.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:11 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:11.695 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:11 smithi099 ceph-mon[34357]: pgmap v259: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 344 MiB/s rd, 404 MiB/s wr, 607 op/s 2024-09-17T01:02:11.696 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:11 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:11.696 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:11 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:13.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:13 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:13.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:13 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:13.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:13 smithi099 ceph-mon[34357]: pgmap v260: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 279 MiB/s rd, 331 MiB/s wr, 496 op/s 2024-09-17T01:02:13.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:13 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:13.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:13 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:13.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:13 smithi002 ceph-mon[27650]: pgmap v260: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 279 MiB/s rd, 331 MiB/s wr, 496 op/s 2024-09-17T01:02:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:14 smithi099 ceph-mon[34357]: Standby manager daemon smithi099.vswzrb restarted 2024-09-17T01:02:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:14 smithi099 ceph-mon[34357]: Standby manager daemon smithi099.vswzrb started 2024-09-17T01:02:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:14 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/crt"}]: dispatch 2024-09-17T01:02:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:14 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:02:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:14 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/key"}]: dispatch 2024-09-17T01:02:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:14 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:02:14.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:14 smithi002 ceph-mon[27650]: Standby manager daemon smithi099.vswzrb restarted 2024-09-17T01:02:14.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:14 smithi002 ceph-mon[27650]: Standby manager daemon smithi099.vswzrb started 2024-09-17T01:02:14.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:14 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/crt"}]: dispatch 2024-09-17T01:02:14.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:14 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:02:14.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:14 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/key"}]: dispatch 2024-09-17T01:02:14.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:14 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:02:15.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:15 smithi002 ceph-mon[27650]: mgrmap e20: smithi002.vjeexr(active, since 7m), standbys: smithi099.vswzrb 2024-09-17T01:02:15.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:15 smithi002 ceph-mon[27650]: pgmap v261: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 237 MiB/s rd, 280 MiB/s wr, 462 op/s 2024-09-17T01:02:15.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:15 smithi099 ceph-mon[34357]: mgrmap e20: smithi002.vjeexr(active, since 7m), standbys: smithi099.vswzrb 2024-09-17T01:02:15.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:15 smithi099 ceph-mon[34357]: pgmap v261: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 237 MiB/s rd, 280 MiB/s wr, 462 op/s 2024-09-17T01:02:17.158 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T01:02:17.158 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-17T01:02:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr fail", "who": "smithi002.vjeexr"}]: dispatch 2024-09-17T01:02:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: Activating manager daemon smithi099.vswzrb 2024-09-17T01:02:17.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: osdmap e45: 6 total, 6 up, 6 in 2024-09-17T01:02:17.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "mgr fail", "who": "smithi002.vjeexr"}]': finished 2024-09-17T01:02:17.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: mgrmap e21: smithi099.vswzrb(active, starting, since 0.00705491s) 2024-09-17T01:02:17.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T01:02:17.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T01:02:17.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.fmyyzz"}]: dispatch 2024-09-17T01:02:17.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.hgawhu"}]: dispatch 2024-09-17T01:02:17.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T01:02:17.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T01:02:17.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mgr metadata", "who": "smithi099.vswzrb", "id": "smithi099.vswzrb"}]: dispatch 2024-09-17T01:02:17.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:02:17.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:02:17.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:02:17.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:02:17.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:17.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:02:17.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:02:17.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:02:17.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:02:17.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: Manager daemon smithi099.vswzrb is now available 2024-09-17T01:02:17.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: Checking for cert/key for grafana.smithi002 2024-09-17T01:02:17.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: Migrating grafana.smithi002 cert to cert store 2024-09-17T01:02:17.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:17.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: Migrating grafana.smithi002 key to cert store 2024-09-17T01:02:17.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:17.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:17.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:17.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.vswzrb/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:02:17.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.vswzrb/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:02:17.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:17.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.vswzrb/trash_purge_schedule"}]: dispatch 2024-09-17T01:02:17.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:17 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.vswzrb/trash_purge_schedule"}]: dispatch 2024-09-17T01:02:17.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:17.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:17.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:17.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:17.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' 2024-09-17T01:02:17.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:17.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr fail", "who": "smithi002.vjeexr"}]: dispatch 2024-09-17T01:02:17.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: Activating manager daemon smithi099.vswzrb 2024-09-17T01:02:17.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: osdmap e45: 6 total, 6 up, 6 in 2024-09-17T01:02:17.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14204 172.21.15.2:0/1561797870' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "mgr fail", "who": "smithi002.vjeexr"}]': finished 2024-09-17T01:02:17.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: mgrmap e21: smithi099.vswzrb(active, starting, since 0.00705491s) 2024-09-17T01:02:17.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T01:02:17.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T01:02:17.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.fmyyzz"}]: dispatch 2024-09-17T01:02:17.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.hgawhu"}]: dispatch 2024-09-17T01:02:17.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T01:02:17.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T01:02:17.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mgr metadata", "who": "smithi099.vswzrb", "id": "smithi099.vswzrb"}]: dispatch 2024-09-17T01:02:17.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:02:17.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:02:17.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:02:17.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:02:17.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:02:17.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:02:17.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:02:17.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:02:17.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:02:17.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: Manager daemon smithi099.vswzrb is now available 2024-09-17T01:02:17.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: Checking for cert/key for grafana.smithi002 2024-09-17T01:02:17.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: Migrating grafana.smithi002 cert to cert store 2024-09-17T01:02:17.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:17.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: Migrating grafana.smithi002 key to cert store 2024-09-17T01:02:17.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:17.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:17.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:02:17.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.vswzrb/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:02:17.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.vswzrb/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:02:17.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:17.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.vswzrb/trash_purge_schedule"}]: dispatch 2024-09-17T01:02:17.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:17 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.vswzrb/trash_purge_schedule"}]: dispatch 2024-09-17T01:02:18.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:18 smithi002 ceph-mon[27650]: Deploying cephadm binary to smithi099 2024-09-17T01:02:18.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:18 smithi002 ceph-mon[27650]: mgrmap e22: smithi099.vswzrb(active, since 1.00881s) 2024-09-17T01:02:18.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:18 smithi002 ceph-mon[27650]: pgmap v3: 65 pgs: 65 active+clean; 1.1 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail 2024-09-17T01:02:18.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:18 smithi002 ceph-mon[27650]: Deploying cephadm binary to smithi002 2024-09-17T01:02:18.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:18 smithi099 ceph-mon[34357]: Deploying cephadm binary to smithi099 2024-09-17T01:02:18.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:18 smithi099 ceph-mon[34357]: mgrmap e22: smithi099.vswzrb(active, since 1.00881s) 2024-09-17T01:02:18.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:18 smithi099 ceph-mon[34357]: pgmap v3: 65 pgs: 65 active+clean; 1.1 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail 2024-09-17T01:02:18.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:18 smithi099 ceph-mon[34357]: Deploying cephadm binary to smithi002 2024-09-17T01:02:18.798 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T01:02:18.798 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-17T01:02:19.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:19 smithi099 ceph-mon[34357]: pgmap v4: 65 pgs: 65 active+clean; 1.1 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail 2024-09-17T01:02:19.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:19 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:19.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:19 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:19.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:19 smithi002 ceph-mon[27650]: pgmap v4: 65 pgs: 65 active+clean; 1.1 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail 2024-09-17T01:02:19.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:19 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:19.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:19 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:20.626 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:20 smithi099 ceph-mon[34357]: mgrmap e23: smithi099.vswzrb(active, since 3s) 2024-09-17T01:02:20.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:20 smithi002 ceph-mon[27650]: mgrmap e23: smithi099.vswzrb(active, since 3s) 2024-09-17T01:02:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:21 smithi099 ceph-mon[34357]: pgmap v5: 65 pgs: 65 active+clean; 1.1 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail 2024-09-17T01:02:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:21 smithi099 ceph-mon[34357]: [17/Sep/2024:01:02:20] ENGINE Bus STARTING 2024-09-17T01:02:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:21 smithi099 ceph-mon[34357]: [17/Sep/2024:01:02:20] ENGINE Serving on https://172.21.15.99:7150 2024-09-17T01:02:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:21 smithi099 ceph-mon[34357]: [17/Sep/2024:01:02:20] ENGINE Error in HTTPServer.serve 2024-09-17T01:02:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Traceback (most recent call last): 2024-09-17T01:02:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:02:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:02:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:02:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._run(expiration_interval) 2024-09-17T01:02:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:02:21.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:02:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:02:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:02:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:02:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s = self.context.wrap_socket( 2024-09-17T01:02:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:02:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: return self.sslsocket_class._create( 2024-09-17T01:02:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:02:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self.do_handshake() 2024-09-17T01:02:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:02:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._sslobj.do_handshake() 2024-09-17T01:02:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:02:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:21 smithi099 ceph-mon[34357]: [17/Sep/2024:01:02:20] ENGINE Serving on http://172.21.15.99:8765 2024-09-17T01:02:21.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:21 smithi099 ceph-mon[34357]: [17/Sep/2024:01:02:20] ENGINE Bus STARTED 2024-09-17T01:02:21.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:21 smithi002 ceph-mon[27650]: pgmap v5: 65 pgs: 65 active+clean; 1.1 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail 2024-09-17T01:02:21.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:21 smithi002 ceph-mon[27650]: [17/Sep/2024:01:02:20] ENGINE Bus STARTING 2024-09-17T01:02:21.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:21 smithi002 ceph-mon[27650]: [17/Sep/2024:01:02:20] ENGINE Serving on https://172.21.15.99:7150 2024-09-17T01:02:21.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:21 smithi002 ceph-mon[27650]: [17/Sep/2024:01:02:20] ENGINE Error in HTTPServer.serve 2024-09-17T01:02:21.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Traceback (most recent call last): 2024-09-17T01:02:21.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:02:21.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:02:21.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:02:21.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._run(expiration_interval) 2024-09-17T01:02:21.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:02:21.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:02:21.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:02:21.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:02:21.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:02:21.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s = self.context.wrap_socket( 2024-09-17T01:02:21.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:02:21.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: return self.sslsocket_class._create( 2024-09-17T01:02:21.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:02:21.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self.do_handshake() 2024-09-17T01:02:21.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:02:21.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._sslobj.do_handshake() 2024-09-17T01:02:21.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:02:21.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:21 smithi002 ceph-mon[27650]: [17/Sep/2024:01:02:20] ENGINE Serving on http://172.21.15.99:8765 2024-09-17T01:02:21.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:21 smithi002 ceph-mon[27650]: [17/Sep/2024:01:02:20] ENGINE Bus STARTED 2024-09-17T01:02:23.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:23 smithi002 ceph-mon[27650]: pgmap v6: 65 pgs: 65 active+clean; 847 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 59 KiB/s rd, 59 KiB/s wr, 137 op/s 2024-09-17T01:02:23.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:23 smithi002 ceph-mon[27650]: Standby manager daemon smithi002.vjeexr started 2024-09-17T01:02:23.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:23 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.2:0/898417896' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.vjeexr/crt"}]: dispatch 2024-09-17T01:02:23.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:23 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.2:0/898417896' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:02:23.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:23 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.2:0/898417896' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.vjeexr/key"}]: dispatch 2024-09-17T01:02:23.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:23 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.2:0/898417896' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:02:23.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:23 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:23.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:23 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:23.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:23 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:23.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:23 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:24.031 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:23 smithi099 ceph-mon[34357]: pgmap v6: 65 pgs: 65 active+clean; 847 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 59 KiB/s rd, 59 KiB/s wr, 137 op/s 2024-09-17T01:02:24.031 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:23 smithi099 ceph-mon[34357]: Standby manager daemon smithi002.vjeexr started 2024-09-17T01:02:24.031 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:23 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.2:0/898417896' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.vjeexr/crt"}]: dispatch 2024-09-17T01:02:24.031 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:23 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.2:0/898417896' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:02:24.031 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:23 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.2:0/898417896' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.vjeexr/key"}]: dispatch 2024-09-17T01:02:24.032 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:23 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.2:0/898417896' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:02:24.032 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:23 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:24.032 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:23 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:24.032 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:23 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:24.032 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:23 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:24.612 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:24 smithi099 ceph-mon[34357]: mgrmap e24: smithi099.vswzrb(active, since 7s), standbys: smithi002.vjeexr 2024-09-17T01:02:24.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:24 smithi002 ceph-mon[27650]: mgrmap e24: smithi099.vswzrb(active, since 7s), standbys: smithi002.vjeexr 2024-09-17T01:02:24.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:24 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mgr metadata", "who": "smithi002.vjeexr", "id": "smithi002.vjeexr"}]: dispatch 2024-09-17T01:02:25.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:24 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mgr metadata", "who": "smithi002.vjeexr", "id": "smithi002.vjeexr"}]: dispatch 2024-09-17T01:02:25.770 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:25 smithi099 ceph-mon[34357]: pgmap v7: 65 pgs: 65 active+clean; 324 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 392 op/s 2024-09-17T01:02:25.770 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:25 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:25.770 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:25 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:25.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:25 smithi002 ceph-mon[27650]: pgmap v7: 65 pgs: 65 active+clean; 324 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 392 op/s 2024-09-17T01:02:25.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:25 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:25.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:25 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:27.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:26 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:27.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:26 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:27.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:26 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:27.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:26 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:27.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:26 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:27.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:26 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:27.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:26 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:27.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:26 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:27.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:26 smithi099 ceph-mon[34357]: Adjusting osd_memory_target on smithi002 to 1558M 2024-09-17T01:02:27.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:26 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:27.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:26 smithi099 ceph-mon[34357]: pgmap v8: 65 pgs: 65 active+clean; 324 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 305 op/s 2024-09-17T01:02:27.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:26 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:27.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:26 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:27.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:26 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:27.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:26 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:27.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:26 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:27.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:26 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:27.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:26 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:27.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:26 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:27.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:26 smithi002 ceph-mon[27650]: Adjusting osd_memory_target on smithi002 to 1558M 2024-09-17T01:02:27.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:26 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:27.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:26 smithi002 ceph-mon[27650]: pgmap v8: 65 pgs: 65 active+clean; 324 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 305 op/s 2024-09-17T01:02:29.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:29.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:29.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:29.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:29.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:29.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:29.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:29.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:29.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: Adjusting osd_memory_target on smithi099 to 2581M 2024-09-17T01:02:29.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:29.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:29.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:29.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-17T01:02:29.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-17T01:02:29.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: pgmap v9: 65 pgs: 65 active+clean; 334 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 555 op/s 2024-09-17T01:02:29.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:02:29.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:02:29.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:02:29.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:28 smithi002 ceph-mon[27650]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:02:29.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:29.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:29.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:29.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:29.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:29.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:29.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:29.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:02:29.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: Adjusting osd_memory_target on smithi099 to 2581M 2024-09-17T01:02:29.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:29.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:02:29.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:02:29.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-17T01:02:29.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-17T01:02:29.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: pgmap v9: 65 pgs: 65 active+clean; 334 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 555 op/s 2024-09-17T01:02:29.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:02:29.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:02:29.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:02:29.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:28 smithi099 ceph-mon[34357]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:02:30.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:30 smithi099 ceph-mon[34357]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:02:30.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:30 smithi099 ceph-mon[34357]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:02:30.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:30 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:30 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:30 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:30 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:30 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:30 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:30 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.404 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:30 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.404 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:30 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.404 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:30 smithi099 ceph-mon[34357]: Reconfiguring node-exporter.smithi002 (dependencies changed)... 2024-09-17T01:02:30.404 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:30 smithi099 ceph-mon[34357]: Deploying daemon node-exporter.smithi002 on smithi002 2024-09-17T01:02:30.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:30 smithi002 ceph-mon[27650]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:02:30.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:30 smithi002 ceph-mon[27650]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:02:30.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:30 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:30 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:30 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:30 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:30 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:30 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:30 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:30 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:30 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:30.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:30 smithi002 ceph-mon[27650]: Reconfiguring node-exporter.smithi002 (dependencies changed)... 2024-09-17T01:02:30.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:30 smithi002 ceph-mon[27650]: Deploying daemon node-exporter.smithi002 on smithi002 2024-09-17T01:02:31.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:31 smithi002 ceph-mon[27650]: pgmap v10: 65 pgs: 65 active+clean; 334 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 508 op/s 2024-09-17T01:02:31.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:31 smithi099 ceph-mon[34357]: pgmap v10: 65 pgs: 65 active+clean; 334 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 508 op/s 2024-09-17T01:02:32.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.167+0000 7f7ec4281640 1 -- 172.21.15.2:0/2978702297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ebc0fbad0 msgr2=0x7f7ebc0fbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.167+0000 7f7ec4281640 1 --2- 172.21.15.2:0/2978702297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ebc0fbad0 0x7f7ebc0fbee0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80048d0 tx=0x7f7eb8009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.167+0000 7f7ec4281640 1 -- 172.21.15.2:0/2978702297 shutdown_connections 2024-09-17T01:02:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.167+0000 7f7ec4281640 1 --2- 172.21.15.2:0/2978702297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ebc0fc420 0x7f7ebc0fc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.167+0000 7f7ec4281640 1 --2- 172.21.15.2:0/2978702297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ebc0fbad0 0x7f7ebc0fbee0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.167+0000 7f7ec4281640 1 -- 172.21.15.2:0/2978702297 >> 172.21.15.2:0/2978702297 conn(0x7f7ebc0f63a0 msgr2=0x7f7ebc0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.167+0000 7f7ec4281640 1 -- 172.21.15.2:0/2978702297 shutdown_connections 2024-09-17T01:02:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.167+0000 7f7ec4281640 1 -- 172.21.15.2:0/2978702297 wait complete. 2024-09-17T01:02:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.168+0000 7f7ec4281640 1 Processor -- start 2024-09-17T01:02:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.168+0000 7f7ec4281640 1 -- start start 2024-09-17T01:02:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.168+0000 7f7ec4281640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ebc0fbad0 0x7f7ebc10fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.168+0000 7f7ec4281640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ebc0fc420 0x7f7ebc112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.168+0000 7f7ec4281640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc0fb470 con 0x7f7ebc0fbad0 2024-09-17T01:02:32.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.168+0000 7f7ec4281640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ebc0fb5e0 con 0x7f7ebc0fc420 2024-09-17T01:02:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.168+0000 7f7ec201d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ebc0fbad0 0x7f7ebc10fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.168+0000 7f7ec181c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ebc0fc420 0x7f7ebc112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.168+0000 7f7ec201d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ebc0fbad0 0x7f7ebc10fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54844/0 (socket says 172.21.15.2:54844) 2024-09-17T01:02:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.168+0000 7f7ec201d640 1 -- 172.21.15.2:0/3775459659 learned_addr learned my addr 172.21.15.2:0/3775459659 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:02:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.169+0000 7f7ec201d640 1 -- 172.21.15.2:0/3775459659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ebc0fc420 msgr2=0x7f7ebc112310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.169+0000 7f7ec201d640 1 --2- 172.21.15.2:0/3775459659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ebc0fc420 0x7f7ebc112310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.169+0000 7f7ec201d640 1 -- 172.21.15.2:0/3775459659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb8005040 con 0x7f7ebc0fbad0 2024-09-17T01:02:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.169+0000 7f7ec181c640 1 --2- 172.21.15.2:0/3775459659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ebc0fc420 0x7f7ebc112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:02:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.169+0000 7f7ec201d640 1 --2- 172.21.15.2:0/3775459659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ebc0fbad0 0x7f7ebc10fdc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009ac0 tx=0x7f7eb8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.169+0000 7f7eb2ffd640 1 -- 172.21.15.2:0/3775459659 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eb8038070 con 0x7f7ebc0fbad0 2024-09-17T01:02:32.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.169+0000 7f7eb2ffd640 1 -- 172.21.15.2:0/3775459659 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7eb8032d30 con 0x7f7ebc0fbad0 2024-09-17T01:02:32.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.169+0000 7f7ec4281640 1 -- 172.21.15.2:0/3775459659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ebc112850 con 0x7f7ebc0fbad0 2024-09-17T01:02:32.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.169+0000 7f7eb2ffd640 1 -- 172.21.15.2:0/3775459659 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7eb803db50 con 0x7f7ebc0fbad0 2024-09-17T01:02:32.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.169+0000 7f7ec4281640 1 -- 172.21.15.2:0/3775459659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ebc112d60 con 0x7f7ebc0fbad0 2024-09-17T01:02:32.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.170+0000 7f7ec4281640 1 -- 172.21.15.2:0/3775459659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ebc0fa040 con 0x7f7ebc0fbad0 2024-09-17T01:02:32.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.171+0000 7f7eb2ffd640 1 -- 172.21.15.2:0/3775459659 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91660+0+0 (secure 0 0 0) 0x7f7eb8030020 con 0x7f7ebc0fbad0 2024-09-17T01:02:32.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.171+0000 7f7eb2ffd640 1 --2- 172.21.15.2:0/3775459659 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f7ea806e6e0 0x7f7ea8070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:32.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.172+0000 7f7eb2ffd640 1 -- 172.21.15.2:0/3775459659 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7eb80ae930 con 0x7f7ebc0fbad0 2024-09-17T01:02:32.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.172+0000 7f7ec181c640 1 --2- 172.21.15.2:0/3775459659 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f7ea806e6e0 0x7f7ea8070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:32.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.172+0000 7f7ec181c640 1 --2- 172.21.15.2:0/3775459659 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f7ea806e6e0 0x7f7ea8070b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7eac010400 tx=0x7f7eac00b040 comp rx=0 tx=0).ready entity=mgr.14580 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:32.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.178+0000 7f7eb2ffd640 1 -- 172.21.15.2:0/3775459659 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f7eb80782c0 con 0x7f7ebc0fbad0 2024-09-17T01:02:32.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.489+0000 7f7ec4281640 1 -- 172.21.15.2:0/3775459659 --> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ebc100cb0 con 0x7f7ea806e6e0 2024-09-17T01:02:32.486 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:32 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:32.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.490+0000 7f7eb2ffd640 1 -- 172.21.15.2:0/3775459659 <== mgr.14580 v2:172.21.15.99:6828/3228590963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f7ebc100cb0 con 0x7f7ea806e6e0 2024-09-17T01:02:32.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.492+0000 7f7ec4281640 1 -- 172.21.15.2:0/3775459659 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f7ea806e6e0 msgr2=0x7f7ea8070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:32.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.492+0000 7f7ec4281640 1 --2- 172.21.15.2:0/3775459659 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f7ea806e6e0 0x7f7ea8070b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7eac010400 tx=0x7f7eac00b040 comp rx=0 tx=0).stop 2024-09-17T01:02:32.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.492+0000 7f7ec4281640 1 -- 172.21.15.2:0/3775459659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ebc0fbad0 msgr2=0x7f7ebc10fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:32.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.492+0000 7f7ec4281640 1 --2- 172.21.15.2:0/3775459659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ebc0fbad0 0x7f7ebc10fdc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009ac0 tx=0x7f7eb8009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.492+0000 7f7ec4281640 1 -- 172.21.15.2:0/3775459659 shutdown_connections 2024-09-17T01:02:32.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.492+0000 7f7ec4281640 1 --2- 172.21.15.2:0/3775459659 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f7ea806e6e0 0x7f7ea8070b90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.492+0000 7f7ec4281640 1 --2- 172.21.15.2:0/3775459659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ebc0fc420 0x7f7ebc112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.492+0000 7f7ec4281640 1 --2- 172.21.15.2:0/3775459659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7ebc0fbad0 0x7f7ebc10fdc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.492+0000 7f7ec4281640 1 -- 172.21.15.2:0/3775459659 >> 172.21.15.2:0/3775459659 conn(0x7f7ebc0f63a0 msgr2=0x7f7ebc0f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:32.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.492+0000 7f7ec4281640 1 -- 172.21.15.2:0/3775459659 shutdown_connections 2024-09-17T01:02:32.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.492+0000 7f7ec4281640 1 -- 172.21.15.2:0/3775459659 wait complete. 2024-09-17T01:02:32.497 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:02:32.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.582+0000 7fab02ec4640 1 -- 172.21.15.2:0/2853041302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faafc06dbf0 msgr2=0x7faafc06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:32.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.582+0000 7fab02ec4640 1 --2- 172.21.15.2:0/2853041302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faafc06dbf0 0x7faafc06e000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faaf00048d0 tx=0x7faaf0009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.582+0000 7fab02ec4640 1 -- 172.21.15.2:0/2853041302 shutdown_connections 2024-09-17T01:02:32.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.582+0000 7fab02ec4640 1 --2- 172.21.15.2:0/2853041302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc06e540 0x7faafc10a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.582+0000 7fab02ec4640 1 --2- 172.21.15.2:0/2853041302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faafc06dbf0 0x7faafc06e000 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.582+0000 7fab02ec4640 1 -- 172.21.15.2:0/2853041302 >> 172.21.15.2:0/2853041302 conn(0x7faafc069560 msgr2=0x7faafc06b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:32.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.583+0000 7fab02ec4640 1 -- 172.21.15.2:0/2853041302 shutdown_connections 2024-09-17T01:02:32.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.583+0000 7fab02ec4640 1 -- 172.21.15.2:0/2853041302 wait complete. 2024-09-17T01:02:32.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.584+0000 7fab02ec4640 1 Processor -- start 2024-09-17T01:02:32.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.584+0000 7fab02ec4640 1 -- start start 2024-09-17T01:02:32.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.584+0000 7fab02ec4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faafc06dbf0 0x7faafc106340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:32.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.584+0000 7fab02ec4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc06e540 0x7faafc104830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:32.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.584+0000 7fab02ec4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc1195e0 con 0x7faafc06dbf0 2024-09-17T01:02:32.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.584+0000 7fab02ec4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc119720 con 0x7faafc06e540 2024-09-17T01:02:32.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.585+0000 7fab00c60640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faafc06dbf0 0x7faafc106340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:32.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.585+0000 7fab00c60640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faafc06dbf0 0x7faafc106340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54856/0 (socket says 172.21.15.2:54856) 2024-09-17T01:02:32.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.585+0000 7fab00c60640 1 -- 172.21.15.2:0/1979525844 learned_addr learned my addr 172.21.15.2:0/1979525844 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:02:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.585+0000 7fab00c60640 1 -- 172.21.15.2:0/1979525844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc06e540 msgr2=0x7faafc104830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:02:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.585+0000 7fab00c60640 1 --2- 172.21.15.2:0/1979525844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc06e540 0x7faafc104830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.585+0000 7fab00c60640 1 -- 172.21.15.2:0/1979525844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf0005040 con 0x7faafc06dbf0 2024-09-17T01:02:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.585+0000 7fab00c60640 1 --2- 172.21.15.2:0/1979525844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faafc06dbf0 0x7faafc106340 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faaf0003080 tx=0x7faaf0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.586+0000 7faaf97fa640 1 -- 172.21.15.2:0/1979525844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaf0038070 con 0x7faafc06dbf0 2024-09-17T01:02:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.586+0000 7fab02ec4640 1 -- 172.21.15.2:0/1979525844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc1199a0 con 0x7faafc06dbf0 2024-09-17T01:02:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.586+0000 7fab02ec4640 1 -- 172.21.15.2:0/1979525844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faafc119e60 con 0x7faafc06dbf0 2024-09-17T01:02:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.586+0000 7faaf97fa640 1 -- 172.21.15.2:0/1979525844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faaf0009800 con 0x7faafc06dbf0 2024-09-17T01:02:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.586+0000 7faaf97fa640 1 -- 172.21.15.2:0/1979525844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaf0033660 con 0x7faafc06dbf0 2024-09-17T01:02:32.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.587+0000 7fab02ec4640 1 -- 172.21.15.2:0/1979525844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faafc06d1b0 con 0x7faafc06dbf0 2024-09-17T01:02:32.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.588+0000 7faaf97fa640 1 -- 172.21.15.2:0/1979525844 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91660+0+0 (secure 0 0 0) 0x7faaf0030020 con 0x7faafc06dbf0 2024-09-17T01:02:32.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.589+0000 7faaf97fa640 1 --2- 172.21.15.2:0/1979525844 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7faae406e7b0 0x7faae4070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:32.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.589+0000 7faaf97fa640 1 -- 172.21.15.2:0/1979525844 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7faaf00adf50 con 0x7faafc06dbf0 2024-09-17T01:02:32.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.590+0000 7faafbfff640 1 --2- 172.21.15.2:0/1979525844 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7faae406e7b0 0x7faae4070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:32.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.591+0000 7faafbfff640 1 --2- 172.21.15.2:0/1979525844 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7faae406e7b0 0x7faae4070c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faaec00acf0 tx=0x7faaec009370 comp rx=0 tx=0).ready entity=mgr.14580 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:32.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.596+0000 7faaf97fa640 1 -- 172.21.15.2:0/1979525844 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7faaf00778e0 con 0x7faafc06dbf0 2024-09-17T01:02:32.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:32 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.883+0000 7fab02ec4640 1 -- 172.21.15.2:0/1979525844 --> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faafc10a1f0 con 0x7faae406e7b0 2024-09-17T01:02:32.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.884+0000 7faaf97fa640 1 -- 172.21.15.2:0/1979525844 <== mgr.14580 v2:172.21.15.99:6828/3228590963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7faafc10a1f0 con 0x7faae406e7b0 2024-09-17T01:02:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.887+0000 7fab02ec4640 1 -- 172.21.15.2:0/1979525844 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7faae406e7b0 msgr2=0x7faae4070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.887+0000 7fab02ec4640 1 --2- 172.21.15.2:0/1979525844 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7faae406e7b0 0x7faae4070c60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faaec00acf0 tx=0x7faaec009370 comp rx=0 tx=0).stop 2024-09-17T01:02:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.887+0000 7fab02ec4640 1 -- 172.21.15.2:0/1979525844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faafc06dbf0 msgr2=0x7faafc106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.887+0000 7fab02ec4640 1 --2- 172.21.15.2:0/1979525844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faafc06dbf0 0x7faafc106340 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faaf0003080 tx=0x7faaf0009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.887+0000 7fab02ec4640 1 -- 172.21.15.2:0/1979525844 shutdown_connections 2024-09-17T01:02:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.887+0000 7fab02ec4640 1 --2- 172.21.15.2:0/1979525844 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7faae406e7b0 0x7faae4070c60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.887+0000 7fab02ec4640 1 --2- 172.21.15.2:0/1979525844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faafc06e540 0x7faafc104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.887+0000 7fab02ec4640 1 --2- 172.21.15.2:0/1979525844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faafc06dbf0 0x7faafc106340 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.887+0000 7fab02ec4640 1 -- 172.21.15.2:0/1979525844 >> 172.21.15.2:0/1979525844 conn(0x7faafc069560 msgr2=0x7faafc108ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:32.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.887+0000 7fab02ec4640 1 -- 172.21.15.2:0/1979525844 shutdown_connections 2024-09-17T01:02:32.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.887+0000 7fab02ec4640 1 -- 172.21.15.2:0/1979525844 wait complete. 2024-09-17T01:02:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.974+0000 7f1500bee640 1 -- 172.21.15.2:0/2141605676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14fc0fc740 msgr2=0x7f14fc0fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.974+0000 7f1500bee640 1 --2- 172.21.15.2:0/2141605676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14fc0fc740 0x7f14fc0fcbb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0048d0 tx=0x7f14ec009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.974+0000 7f1500bee640 1 -- 172.21.15.2:0/2141605676 shutdown_connections 2024-09-17T01:02:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.974+0000 7f1500bee640 1 --2- 172.21.15.2:0/2141605676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14fc0fc740 0x7f14fc0fcbb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.974+0000 7f1500bee640 1 --2- 172.21.15.2:0/2141605676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14fc0fb470 0x7f14fc0fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.974+0000 7f1500bee640 1 -- 172.21.15.2:0/2141605676 >> 172.21.15.2:0/2141605676 conn(0x7f14fc0f6c10 msgr2=0x7f14fc0f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.974+0000 7f1500bee640 1 -- 172.21.15.2:0/2141605676 shutdown_connections 2024-09-17T01:02:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.974+0000 7f1500bee640 1 -- 172.21.15.2:0/2141605676 wait complete. 2024-09-17T01:02:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.975+0000 7f1500bee640 1 Processor -- start 2024-09-17T01:02:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.975+0000 7f1500bee640 1 -- start start 2024-09-17T01:02:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.975+0000 7f1500bee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14fc0fb470 0x7f14fc10fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.975+0000 7f1500bee640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14fc0fc740 0x7f14fc112340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.975+0000 7f1500bee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc066730 con 0x7f14fc0fb470 2024-09-17T01:02:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.975+0000 7f1500bee640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc0668a0 con 0x7f14fc0fc740 2024-09-17T01:02:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.975+0000 7f14fa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14fc0fb470 0x7f14fc10fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.975+0000 7f14fa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14fc0fb470 0x7f14fc10fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54876/0 (socket says 172.21.15.2:54876) 2024-09-17T01:02:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.975+0000 7f14fa59c640 1 -- 172.21.15.2:0/585487187 learned_addr learned my addr 172.21.15.2:0/585487187 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:02:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.975+0000 7f14f9d9b640 1 --2- 172.21.15.2:0/585487187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14fc0fc740 0x7f14fc112340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.976+0000 7f14fa59c640 1 -- 172.21.15.2:0/585487187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14fc0fc740 msgr2=0x7f14fc112340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.976+0000 7f14fa59c640 1 --2- 172.21.15.2:0/585487187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14fc0fc740 0x7f14fc112340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.976+0000 7f14fa59c640 1 -- 172.21.15.2:0/585487187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec005040 con 0x7f14fc0fb470 2024-09-17T01:02:32.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.976+0000 7f14fa59c640 1 --2- 172.21.15.2:0/585487187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14fc0fb470 0x7f14fc10fdf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f14e400eb70 tx=0x7f14e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:32.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.976+0000 7f14f2ffd640 1 -- 172.21.15.2:0/585487187 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14e4007c30 con 0x7f14fc0fb470 2024-09-17T01:02:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.976+0000 7f14f2ffd640 1 -- 172.21.15.2:0/585487187 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f14e400f040 con 0x7f14fc0fb470 2024-09-17T01:02:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.976+0000 7f1500bee640 1 -- 172.21.15.2:0/585487187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14fc112880 con 0x7f14fc0fb470 2024-09-17T01:02:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.976+0000 7f14f2ffd640 1 -- 172.21.15.2:0/585487187 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14e400ca60 con 0x7f14fc0fb470 2024-09-17T01:02:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.976+0000 7f1500bee640 1 -- 172.21.15.2:0/585487187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14fc112df0 con 0x7f14fc0fb470 2024-09-17T01:02:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.977+0000 7f1500bee640 1 -- 172.21.15.2:0/585487187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14fc0fa8d0 con 0x7f14fc0fb470 2024-09-17T01:02:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.978+0000 7f14f2ffd640 1 -- 172.21.15.2:0/585487187 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91660+0+0 (secure 0 0 0) 0x7f14e400cbc0 con 0x7f14fc0fb470 2024-09-17T01:02:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.978+0000 7f14f2ffd640 1 --2- 172.21.15.2:0/585487187 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f14e806e6e0 0x7f14e8070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.978+0000 7f14f2ffd640 1 -- 172.21.15.2:0/585487187 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f14e408db20 con 0x7f14fc0fb470 2024-09-17T01:02:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.978+0000 7f14f9d9b640 1 --2- 172.21.15.2:0/585487187 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f14e806e6e0 0x7f14e8070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:32.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.979+0000 7f14f9d9b640 1 --2- 172.21.15.2:0/585487187 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f14e806e6e0 0x7f14e8070b90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f14ec004540 tx=0x7f14ec035040 comp rx=0 tx=0).ready entity=mgr.14580 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:32.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:32.983+0000 7f14f2ffd640 1 -- 172.21.15.2:0/585487187 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f14e4057590 con 0x7f14fc0fb470 2024-09-17T01:02:33.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.223+0000 7f1500bee640 1 -- 172.21.15.2:0/585487187 --> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f14fc100af0 con 0x7f14e806e6e0 2024-09-17T01:02:33.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.234+0000 7f14f2ffd640 1 -- 172.21.15.2:0/585487187 <== mgr.14580 v2:172.21.15.99:6828/3228590963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f14fc100af0 con 0x7f14e806e6e0 2024-09-17T01:02:33.232 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:02:33.232 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (7m) 8s ago 8m 26.4M - 0.25.0 c8568f914cd2 225a4094fd9c 2024-09-17T01:02:33.232 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (8m) 8s ago 8m 6903k - 17.2.7-1635-g4a704134 f22ead590bad 53b003b1ad6f 2024-09-17T01:02:33.232 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (7m) 10s ago 7m 6891k - 17.2.7-1635-g4a704134 f22ead590bad 6ec40439e9b5 2024-09-17T01:02:33.232 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (7m) 8s ago 8m 84.4M - 9.4.7 954c08fa6188 68fde0ccaa6c 2024-09-17T01:02:33.232 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (3m) 8s ago 3m 170M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:02:33.232 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (3m) 8s ago 3m 90.5M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:02:33.232 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (2m) 10s ago 2m 107M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:02:33.232 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (3m) 10s ago 3m 171M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:02:33.233 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:9283,8765,8443 running (9m) 8s ago 9m 244M - 17.2.7-1635-g4a704134 f22ead590bad 6f10e41396cd 2024-09-17T01:02:33.233 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283 running (29s) 10s ago 7m 477M - 19.1.1-330-gc2ddf972 ebb0615149de 8ad174f204d2 2024-09-17T01:02:33.233 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (9m) 8s ago 9m 48.6M 2048M 17.2.7-1635-g4a704134 f22ead590bad 08b932b41bfa 2024-09-17T01:02:33.233 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (7m) 10s ago 7m 39.9M 2048M 17.2.7-1635-g4a704134 f22ead590bad 1c9583d52c94 2024-09-17T01:02:33.233 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (8m) 8s ago 8m 16.0M - 1.5.0 0da6a335fe13 175a7378d3e6 2024-09-17T01:02:33.233 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (7m) 10s ago 7m 17.0M - 1.5.0 0da6a335fe13 7c4fe7150f28 2024-09-17T01:02:33.233 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (6m) 8s ago 6m 204M 1558M 17.2.7-1635-g4a704134 f22ead590bad 720f74f40752 2024-09-17T01:02:33.233 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (6m) 8s ago 6m 218M 1558M 17.2.7-1635-g4a704134 f22ead590bad 629defddb38c 2024-09-17T01:02:33.233 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (5m) 8s ago 5m 174M 1558M 17.2.7-1635-g4a704134 f22ead590bad 5dff1cf9fc56 2024-09-17T01:02:33.233 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (5m) 10s ago 5m 237M 2581M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:02:33.233 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (5m) 10s ago 5m 212M 2581M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:02:33.233 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (4m) 10s ago 4m 200M 2581M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:02:33.233 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (6m) 8s ago 8m 56.9M - 2.43.0 a07b618ecd1d 4c4de4cca2fc 2024-09-17T01:02:33.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.237+0000 7f1500bee640 1 -- 172.21.15.2:0/585487187 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f14e806e6e0 msgr2=0x7f14e8070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:33.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.237+0000 7f1500bee640 1 --2- 172.21.15.2:0/585487187 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f14e806e6e0 0x7f14e8070b90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f14ec004540 tx=0x7f14ec035040 comp rx=0 tx=0).stop 2024-09-17T01:02:33.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.237+0000 7f1500bee640 1 -- 172.21.15.2:0/585487187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14fc0fb470 msgr2=0x7f14fc10fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:33.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.237+0000 7f1500bee640 1 --2- 172.21.15.2:0/585487187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14fc0fb470 0x7f14fc10fdf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f14e400eb70 tx=0x7f14e400b040 comp rx=0 tx=0).stop 2024-09-17T01:02:33.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.237+0000 7f1500bee640 1 -- 172.21.15.2:0/585487187 shutdown_connections 2024-09-17T01:02:33.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.237+0000 7f1500bee640 1 --2- 172.21.15.2:0/585487187 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f14e806e6e0 0x7f14e8070b90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.237+0000 7f1500bee640 1 --2- 172.21.15.2:0/585487187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14fc0fc740 0x7f14fc112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.237+0000 7f1500bee640 1 --2- 172.21.15.2:0/585487187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14fc0fb470 0x7f14fc10fdf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.237+0000 7f1500bee640 1 -- 172.21.15.2:0/585487187 >> 172.21.15.2:0/585487187 conn(0x7f14fc0f6c10 msgr2=0x7f14fc0f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:33.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.237+0000 7f1500bee640 1 -- 172.21.15.2:0/585487187 shutdown_connections 2024-09-17T01:02:33.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.237+0000 7f1500bee640 1 -- 172.21.15.2:0/585487187 wait complete. 2024-09-17T01:02:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.337+0000 7f4aecdd8640 1 -- 172.21.15.2:0/2245462797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ae80ff680 msgr2=0x7f4ae8101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.337+0000 7f4aecdd8640 1 --2- 172.21.15.2:0/2245462797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ae80ff680 0x7f4ae8101a60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0048d0 tx=0x7f4adc009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.338+0000 7f4aecdd8640 1 -- 172.21.15.2:0/2245462797 shutdown_connections 2024-09-17T01:02:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.338+0000 7f4aecdd8640 1 --2- 172.21.15.2:0/2245462797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ae80ff680 0x7f4ae8101a60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.338+0000 7f4aecdd8640 1 --2- 172.21.15.2:0/2245462797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ae8065c40 0x7f4ae80ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.338+0000 7f4aecdd8640 1 -- 172.21.15.2:0/2245462797 >> 172.21.15.2:0/2245462797 conn(0x7f4ae80f6c10 msgr2=0x7f4ae80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:33.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.338+0000 7f4aecdd8640 1 -- 172.21.15.2:0/2245462797 shutdown_connections 2024-09-17T01:02:33.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.338+0000 7f4aecdd8640 1 -- 172.21.15.2:0/2245462797 wait complete. 2024-09-17T01:02:33.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.338+0000 7f4aecdd8640 1 Processor -- start 2024-09-17T01:02:33.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.338+0000 7f4aecdd8640 1 -- start start 2024-09-17T01:02:33.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.339+0000 7f4aecdd8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ae8065c40 0x7f4ae810d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:33.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.339+0000 7f4aecdd8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ae80ff680 0x7f4ae810d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:33.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.339+0000 7f4aecdd8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae810dc80 con 0x7f4ae8065c40 2024-09-17T01:02:33.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.339+0000 7f4aecdd8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae810e400 con 0x7f4ae80ff680 2024-09-17T01:02:33.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.339+0000 7f4ae659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ae8065c40 0x7f4ae810d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:33.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.339+0000 7f4ae659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ae8065c40 0x7f4ae810d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54886/0 (socket says 172.21.15.2:54886) 2024-09-17T01:02:33.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.339+0000 7f4ae659c640 1 -- 172.21.15.2:0/4064084776 learned_addr learned my addr 172.21.15.2:0/4064084776 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:02:33.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.339+0000 7f4ae5d9b640 1 --2- 172.21.15.2:0/4064084776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ae80ff680 0x7f4ae810d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:33.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.339+0000 7f4ae659c640 1 -- 172.21.15.2:0/4064084776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ae80ff680 msgr2=0x7f4ae810d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:33.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.339+0000 7f4ae659c640 1 --2- 172.21.15.2:0/4064084776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ae80ff680 0x7f4ae810d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.339+0000 7f4ae659c640 1 -- 172.21.15.2:0/4064084776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad8005040 con 0x7f4ae8065c40 2024-09-17T01:02:33.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.339+0000 7f4ae659c640 1 --2- 172.21.15.2:0/4064084776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ae8065c40 0x7f4ae810d0f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80096d0 tx=0x7f4ad8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:33.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.340+0000 7f4ad6ffd640 1 -- 172.21.15.2:0/4064084776 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ad800e8b0 con 0x7f4ae8065c40 2024-09-17T01:02:33.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.340+0000 7f4aecdd8640 1 -- 172.21.15.2:0/4064084776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4adc005040 con 0x7f4ae8065c40 2024-09-17T01:02:33.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.340+0000 7f4ad6ffd640 1 -- 172.21.15.2:0/4064084776 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4ad800f040 con 0x7f4ae8065c40 2024-09-17T01:02:33.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.340+0000 7f4ad6ffd640 1 -- 172.21.15.2:0/4064084776 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ad8013e00 con 0x7f4ae8065c40 2024-09-17T01:02:33.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.340+0000 7f4aecdd8640 1 -- 172.21.15.2:0/4064084776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae810ea40 con 0x7f4ae8065c40 2024-09-17T01:02:33.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.341+0000 7f4aecdd8640 1 -- 172.21.15.2:0/4064084776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae8105740 con 0x7f4ae8065c40 2024-09-17T01:02:33.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.342+0000 7f4ad6ffd640 1 -- 172.21.15.2:0/4064084776 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91660+0+0 (secure 0 0 0) 0x7f4ad800ea10 con 0x7f4ae8065c40 2024-09-17T01:02:33.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.342+0000 7f4ad6ffd640 1 --2- 172.21.15.2:0/4064084776 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4ad006e6e0 0x7f4ad0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:33.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.342+0000 7f4ad6ffd640 1 -- 172.21.15.2:0/4064084776 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4ad808ddc0 con 0x7f4ae8065c40 2024-09-17T01:02:33.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.342+0000 7f4ae5d9b640 1 --2- 172.21.15.2:0/4064084776 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4ad006e6e0 0x7f4ad0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:33.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.343+0000 7f4ae5d9b640 1 --2- 172.21.15.2:0/4064084776 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4ad006e6e0 0x7f4ad0070b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4ae810cea0 tx=0x7f4adc035040 comp rx=0 tx=0).ready entity=mgr.14580 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:33.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.347+0000 7f4ad6ffd640 1 -- 172.21.15.2:0/4064084776 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f4ad8057640 con 0x7f4ae8065c40 2024-09-17T01:02:33.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:33 smithi002 ceph-mon[27650]: pgmap v11: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 540 op/s 2024-09-17T01:02:33.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:33 smithi002 ceph-mon[27650]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.666+0000 7f4aecdd8640 1 -- 172.21.15.2:0/4064084776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4ae804b750 con 0x7f4ae8065c40 2024-09-17T01:02:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.668+0000 7f4ad6ffd640 1 -- 172.21.15.2:0/4064084776 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f4ad805ad00 con 0x7f4ae8065c40 2024-09-17T01:02:33.666 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:02:33.666 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:02:33.666 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T01:02:33.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:02:33.666 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:02:33.666 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 1, 2024-09-17T01:02:33.666 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:02:33.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:02:33.666 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:02:33.666 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T01:02:33.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:02:33.667 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:02:33.667 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:02:33.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:02:33.667 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:02:33.667 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 13, 2024-09-17T01:02:33.667 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:02:33.667 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:02:33.667 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:02:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.672+0000 7f4aecdd8640 1 -- 172.21.15.2:0/4064084776 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4ad006e6e0 msgr2=0x7f4ad0070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.672+0000 7f4aecdd8640 1 --2- 172.21.15.2:0/4064084776 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4ad006e6e0 0x7f4ad0070b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4ae810cea0 tx=0x7f4adc035040 comp rx=0 tx=0).stop 2024-09-17T01:02:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.672+0000 7f4aecdd8640 1 -- 172.21.15.2:0/4064084776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ae8065c40 msgr2=0x7f4ae810d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.672+0000 7f4aecdd8640 1 --2- 172.21.15.2:0/4064084776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ae8065c40 0x7f4ae810d0f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80096d0 tx=0x7f4ad8009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.672+0000 7f4aecdd8640 1 -- 172.21.15.2:0/4064084776 shutdown_connections 2024-09-17T01:02:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.672+0000 7f4aecdd8640 1 --2- 172.21.15.2:0/4064084776 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4ad006e6e0 0x7f4ad0070b90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.672+0000 7f4aecdd8640 1 --2- 172.21.15.2:0/4064084776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ae80ff680 0x7f4ae810d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.672+0000 7f4aecdd8640 1 --2- 172.21.15.2:0/4064084776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ae8065c40 0x7f4ae810d0f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.672+0000 7f4aecdd8640 1 -- 172.21.15.2:0/4064084776 >> 172.21.15.2:0/4064084776 conn(0x7f4ae80f6c10 msgr2=0x7f4ae80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.672+0000 7f4aecdd8640 1 -- 172.21.15.2:0/4064084776 shutdown_connections 2024-09-17T01:02:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.672+0000 7f4aecdd8640 1 -- 172.21.15.2:0/4064084776 wait complete. 2024-09-17T01:02:33.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:33 smithi099 ceph-mon[34357]: pgmap v11: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 540 op/s 2024-09-17T01:02:33.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:33 smithi099 ceph-mon[34357]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.800+0000 7f446f74f640 1 -- 172.21.15.2:0/2549116451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44680fc3a0 msgr2=0x7f44680fc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.800+0000 7f446f74f640 1 --2- 172.21.15.2:0/2549116451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44680fc3a0 0x7f44680fc810 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f44580048d0 tx=0x7f4458009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.800+0000 7f446f74f640 1 -- 172.21.15.2:0/2549116451 shutdown_connections 2024-09-17T01:02:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.800+0000 7f446f74f640 1 --2- 172.21.15.2:0/2549116451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44680fc3a0 0x7f44680fc810 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.800+0000 7f446f74f640 1 --2- 172.21.15.2:0/2549116451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44680fba50 0x7f44680fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.800+0000 7f446f74f640 1 -- 172.21.15.2:0/2549116451 >> 172.21.15.2:0/2549116451 conn(0x7f44680f6380 msgr2=0x7f44680f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.801+0000 7f446f74f640 1 -- 172.21.15.2:0/2549116451 shutdown_connections 2024-09-17T01:02:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.801+0000 7f446f74f640 1 -- 172.21.15.2:0/2549116451 wait complete. 2024-09-17T01:02:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.801+0000 7f446f74f640 1 Processor -- start 2024-09-17T01:02:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.801+0000 7f446f74f640 1 -- start start 2024-09-17T01:02:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.801+0000 7f446f74f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44680fba50 0x7f446810f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.801+0000 7f446f74f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44680fc3a0 0x7f446810f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.801+0000 7f446f74f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446810fed0 con 0x7f44680fc3a0 2024-09-17T01:02:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.801+0000 7f446f74f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4468110650 con 0x7f44680fba50 2024-09-17T01:02:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.801+0000 7f446ccea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44680fc3a0 0x7f446810f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.802+0000 7f446d4eb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44680fba50 0x7f446810f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.802+0000 7f446d4eb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44680fba50 0x7f446810f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.2:38798/0 (socket says 172.21.15.2:38798) 2024-09-17T01:02:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.802+0000 7f446ccea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44680fc3a0 0x7f446810f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54898/0 (socket says 172.21.15.2:54898) 2024-09-17T01:02:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.802+0000 7f446d4eb640 1 -- 172.21.15.2:0/4206611415 learned_addr learned my addr 172.21.15.2:0/4206611415 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:02:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.802+0000 7f446ccea640 1 -- 172.21.15.2:0/4206611415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44680fba50 msgr2=0x7f446810f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.802+0000 7f446ccea640 1 --2- 172.21.15.2:0/4206611415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44680fba50 0x7f446810f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.802+0000 7f446ccea640 1 -- 172.21.15.2:0/4206611415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4458005040 con 0x7f44680fc3a0 2024-09-17T01:02:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.802+0000 7f446ccea640 1 --2- 172.21.15.2:0/4206611415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44680fc3a0 0x7f446810f880 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f445802a530 tx=0x7f4458009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.802+0000 7f445dffb640 1 -- 172.21.15.2:0/4206611415 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4458038070 con 0x7f44680fc3a0 2024-09-17T01:02:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.802+0000 7f446f74f640 1 -- 172.21.15.2:0/4206611415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4468110880 con 0x7f44680fc3a0 2024-09-17T01:02:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.802+0000 7f445dffb640 1 -- 172.21.15.2:0/4206611415 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f445802ae90 con 0x7f44680fc3a0 2024-09-17T01:02:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.802+0000 7f445dffb640 1 -- 172.21.15.2:0/4206611415 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f445803e670 con 0x7f44680fc3a0 2024-09-17T01:02:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.802+0000 7f446f74f640 1 -- 172.21.15.2:0/4206611415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4468110e20 con 0x7f44680fc3a0 2024-09-17T01:02:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.803+0000 7f446f74f640 1 -- 172.21.15.2:0/4206611415 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44680fa040 con 0x7f44680fc3a0 2024-09-17T01:02:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.804+0000 7f445dffb640 1 -- 172.21.15.2:0/4206611415 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91660+0+0 (secure 0 0 0) 0x7f4458030020 con 0x7f44680fc3a0 2024-09-17T01:02:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.805+0000 7f445dffb640 1 --2- 172.21.15.2:0/4206611415 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f445406e6e0 0x7f4454070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:02:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.805+0000 7f445dffb640 1 -- 172.21.15.2:0/4206611415 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f44580addf0 con 0x7f44680fc3a0 2024-09-17T01:02:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.805+0000 7f446d4eb640 1 --2- 172.21.15.2:0/4206611415 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f445406e6e0 0x7f4454070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:02:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.805+0000 7f446d4eb640 1 --2- 172.21.15.2:0/4206611415 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f445406e6e0 0x7f4454070b90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4464004ae0 tx=0x7f446400b040 comp rx=0 tx=0).ready entity=mgr.14580 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:02:33.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:33.809+0000 7f445dffb640 1 -- 172.21.15.2:0/4206611415 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f44580778b0 con 0x7f44680fc3a0 2024-09-17T01:02:34.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:34.067+0000 7f446f74f640 1 -- 172.21.15.2:0/4206611415 --> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4468103f80 con 0x7f445406e6e0 2024-09-17T01:02:34.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:34.069+0000 7f445dffb640 1 -- 172.21.15.2:0/4206611415 <== mgr.14580 v2:172.21.15.99:6828/3228590963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f4468103f80 con 0x7f445406e6e0 2024-09-17T01:02:34.066 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:02:34.067 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:02:34.067 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:02:34.067 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-17T01:02:34.067 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2024-09-17T01:02:34.067 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "1/2 daemons upgraded", 2024-09-17T01:02:34.067 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "", 2024-09-17T01:02:34.067 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:02:34.067 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:02:34.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:34.071+0000 7f446f74f640 1 -- 172.21.15.2:0/4206611415 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f445406e6e0 msgr2=0x7f4454070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:34.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:34.071+0000 7f446f74f640 1 --2- 172.21.15.2:0/4206611415 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f445406e6e0 0x7f4454070b90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4464004ae0 tx=0x7f446400b040 comp rx=0 tx=0).stop 2024-09-17T01:02:34.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:34.071+0000 7f446f74f640 1 -- 172.21.15.2:0/4206611415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44680fc3a0 msgr2=0x7f446810f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:02:34.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:34.071+0000 7f446f74f640 1 --2- 172.21.15.2:0/4206611415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44680fc3a0 0x7f446810f880 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f445802a530 tx=0x7f4458009da0 comp rx=0 tx=0).stop 2024-09-17T01:02:34.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:34.071+0000 7f446f74f640 1 -- 172.21.15.2:0/4206611415 shutdown_connections 2024-09-17T01:02:34.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:34.071+0000 7f446f74f640 1 --2- 172.21.15.2:0/4206611415 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f445406e6e0 0x7f4454070b90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:34.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:34.071+0000 7f446f74f640 1 --2- 172.21.15.2:0/4206611415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44680fc3a0 0x7f446810f880 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:34.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:34.071+0000 7f446f74f640 1 --2- 172.21.15.2:0/4206611415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44680fba50 0x7f446810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:02:34.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:34.071+0000 7f446f74f640 1 -- 172.21.15.2:0/4206611415 >> 172.21.15.2:0/4206611415 conn(0x7f44680f6380 msgr2=0x7f44680fae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:02:34.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:34.071+0000 7f446f74f640 1 -- 172.21.15.2:0/4206611415 shutdown_connections 2024-09-17T01:02:34.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:02:34.071+0000 7f446f74f640 1 -- 172.21.15.2:0/4206611415 wait complete. 2024-09-17T01:02:34.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:34 smithi002 ceph-mon[27650]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:34.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:34 smithi002 ceph-mon[27650]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:34.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:34 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/4064084776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:02:34.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:34 smithi099 ceph-mon[34357]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:34.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:34 smithi099 ceph-mon[34357]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:34.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:34 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/4064084776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:02:35.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:35 smithi002 ceph-mon[27650]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:35.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:35 smithi002 ceph-mon[27650]: pgmap v12: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 744 op/s 2024-09-17T01:02:35.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:35 smithi099 ceph-mon[34357]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:02:35.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:35 smithi099 ceph-mon[34357]: pgmap v12: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 744 op/s 2024-09-17T01:02:37.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:37 smithi002 ceph-mon[27650]: pgmap v13: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 573 op/s 2024-09-17T01:02:37.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:37 smithi099 ceph-mon[34357]: pgmap v13: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 573 op/s 2024-09-17T01:02:39.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:39 smithi002 ceph-mon[27650]: pgmap v14: 65 pgs: 65 active+clean; 302 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 894 op/s 2024-09-17T01:02:39.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:39 smithi002 ceph-mon[27650]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T01:02:39.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:39 smithi099 ceph-mon[34357]: pgmap v14: 65 pgs: 65 active+clean; 302 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 894 op/s 2024-09-17T01:02:39.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:39 smithi099 ceph-mon[34357]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T01:02:41.587 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:41 smithi002 ceph-mon[27650]: pgmap v15: 65 pgs: 65 active+clean; 302 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 614 op/s 2024-09-17T01:02:41.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:41 smithi099 ceph-mon[34357]: pgmap v15: 65 pgs: 65 active+clean; 302 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 614 op/s 2024-09-17T01:02:43.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:43 smithi002 ceph-mon[27650]: pgmap v16: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 660 op/s 2024-09-17T01:02:43.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:43 smithi099 ceph-mon[34357]: pgmap v16: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 660 op/s 2024-09-17T01:02:45.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:45 smithi002 ceph-mon[27650]: pgmap v17: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 4.2 MiB/s rd, 3.9 MiB/s wr, 843 op/s 2024-09-17T01:02:45.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:45 smithi099 ceph-mon[34357]: pgmap v17: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 4.2 MiB/s rd, 3.9 MiB/s wr, 843 op/s 2024-09-17T01:02:47.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:46 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:47.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:46 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:47.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:46 smithi002 ceph-mon[27650]: Reconfiguring alertmanager.smithi002 (dependencies changed)... 2024-09-17T01:02:47.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:46 smithi002 ceph-mon[27650]: Deploying daemon alertmanager.smithi002 on smithi002 2024-09-17T01:02:47.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:46 smithi002 ceph-mon[27650]: pgmap v18: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 581 op/s 2024-09-17T01:02:47.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:46 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:47.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:46 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:47.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:46 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:47.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:46 smithi099 ceph-mon[34357]: Reconfiguring alertmanager.smithi002 (dependencies changed)... 2024-09-17T01:02:47.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:46 smithi099 ceph-mon[34357]: Deploying daemon alertmanager.smithi002 on smithi002 2024-09-17T01:02:47.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:46 smithi099 ceph-mon[34357]: pgmap v18: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 581 op/s 2024-09-17T01:02:47.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:46 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:02:49.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:49 smithi099 ceph-mon[34357]: pgmap v19: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 833 op/s 2024-09-17T01:02:49.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:49 smithi002 ceph-mon[27650]: pgmap v19: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 833 op/s 2024-09-17T01:02:51.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:51 smithi099 ceph-mon[34357]: pgmap v20: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 513 op/s 2024-09-17T01:02:51.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:51 smithi002 ceph-mon[27650]: pgmap v20: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 513 op/s 2024-09-17T01:02:53.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:53 smithi002 ceph-mon[27650]: pgmap v21: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 553 op/s 2024-09-17T01:02:53.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:53 smithi099 ceph-mon[34357]: pgmap v21: 65 pgs: 65 active+clean; 315 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 553 op/s 2024-09-17T01:02:55.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:55 smithi099 ceph-mon[34357]: pgmap v22: 65 pgs: 65 active+clean; 308 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 719 op/s 2024-09-17T01:02:55.634 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:55 smithi002 ceph-mon[27650]: pgmap v22: 65 pgs: 65 active+clean; 308 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 719 op/s 2024-09-17T01:02:56.227 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-17T01:02:56.227 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-17T01:02:56.590 DEBUG:teuthology.parallel:result is None 2024-09-17T01:02:57.461 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:57 smithi002 ceph-mon[27650]: pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 505 op/s 2024-09-17T01:02:57.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:57 smithi099 ceph-mon[34357]: pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 505 op/s 2024-09-17T01:02:57.911 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-17T01:02:57.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-17T01:02:58.296 DEBUG:teuthology.parallel:result is None 2024-09-17T01:02:58.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T01:02:58.352 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T01:02:58.352 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-17T01:02:58.390 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-17T01:02:58.391 DEBUG:teuthology.parallel:result is None 2024-09-17T01:02:59.458 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:59 smithi002 ceph-mon[27650]: pgmap v24: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 757 op/s 2024-09-17T01:02:59.458 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:59 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:59.458 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:02:59 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:59.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:59 smithi099 ceph-mon[34357]: pgmap v24: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 757 op/s 2024-09-17T01:02:59.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:59 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:02:59.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:02:59 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:00.469 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:00 smithi002 ceph-mon[27650]: Reconfiguring grafana.smithi002 (dependencies changed)... 2024-09-17T01:03:00.470 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:00 smithi002 ceph-mon[27650]: Reconfiguring daemon grafana.smithi002 on smithi002 2024-09-17T01:03:00.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:00 smithi099 ceph-mon[34357]: Reconfiguring grafana.smithi002 (dependencies changed)... 2024-09-17T01:03:00.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:00 smithi099 ceph-mon[34357]: Reconfiguring daemon grafana.smithi002 on smithi002 2024-09-17T01:03:01.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:01 smithi002 ceph-mon[27650]: pgmap v25: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 505 op/s 2024-09-17T01:03:01.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:01 smithi099 ceph-mon[34357]: pgmap v25: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 505 op/s 2024-09-17T01:03:02.387 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:02 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:02.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:02 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:03.490 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:03 smithi002 ceph-mon[27650]: pgmap v26: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 519 op/s 2024-09-17T01:03:03.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:03 smithi099 ceph-mon[34357]: pgmap v26: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 519 op/s 2024-09-17T01:03:04.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.161+0000 7f04db6c7640 1 -- 172.21.15.2:0/1838411674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04d40fcad0 msgr2=0x7f04d40fcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:04.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.161+0000 7f04db6c7640 1 --2- 172.21.15.2:0/1838411674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04d40fcad0 0x7f04d40fcee0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f04d00048d0 tx=0x7f04d0009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.161+0000 7f04db6c7640 1 -- 172.21.15.2:0/1838411674 shutdown_connections 2024-09-17T01:03:04.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.161+0000 7f04db6c7640 1 --2- 172.21.15.2:0/1838411674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04d40fd420 0x7f04d4103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.161+0000 7f04db6c7640 1 --2- 172.21.15.2:0/1838411674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04d40fcad0 0x7f04d40fcee0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.161+0000 7f04db6c7640 1 -- 172.21.15.2:0/1838411674 >> 172.21.15.2:0/1838411674 conn(0x7f04d40f63a0 msgr2=0x7f04d40f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:04.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.161+0000 7f04db6c7640 1 -- 172.21.15.2:0/1838411674 shutdown_connections 2024-09-17T01:03:04.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.161+0000 7f04db6c7640 1 -- 172.21.15.2:0/1838411674 wait complete. 2024-09-17T01:03:04.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.162+0000 7f04db6c7640 1 Processor -- start 2024-09-17T01:03:04.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.162+0000 7f04db6c7640 1 -- start start 2024-09-17T01:03:04.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.162+0000 7f04db6c7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04d40fcad0 0x7f04d410f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:04.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.162+0000 7f04db6c7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04d40fd420 0x7f04d410f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:04.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.162+0000 7f04db6c7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d410fdf0 con 0x7f04d40fd420 2024-09-17T01:03:04.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.162+0000 7f04db6c7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d4110610 con 0x7f04d40fcad0 2024-09-17T01:03:04.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.162+0000 7f04d8c62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04d40fd420 0x7f04d410f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:04.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.162+0000 7f04d8c62640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04d40fd420 0x7f04d410f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40698/0 (socket says 172.21.15.2:40698) 2024-09-17T01:03:04.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.162+0000 7f04d9463640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04d40fcad0 0x7f04d410f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:04.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.162+0000 7f04d8c62640 1 -- 172.21.15.2:0/2123724660 learned_addr learned my addr 172.21.15.2:0/2123724660 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:03:04.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.163+0000 7f04d8c62640 1 -- 172.21.15.2:0/2123724660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04d40fcad0 msgr2=0x7f04d410f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:04.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.163+0000 7f04d8c62640 1 --2- 172.21.15.2:0/2123724660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04d40fcad0 0x7f04d410f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.163+0000 7f04d8c62640 1 -- 172.21.15.2:0/2123724660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d0005040 con 0x7f04d40fd420 2024-09-17T01:03:04.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.163+0000 7f04d8c62640 1 --2- 172.21.15.2:0/2123724660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04d40fd420 0x7f04d410f7a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f04c4002a50 tx=0x7f04c4004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:04.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.163+0000 7f04c9ffb640 1 -- 172.21.15.2:0/2123724660 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04c4007c30 con 0x7f04d40fd420 2024-09-17T01:03:04.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.163+0000 7f04c9ffb640 1 -- 172.21.15.2:0/2123724660 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f04c400f040 con 0x7f04d40fd420 2024-09-17T01:03:04.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.163+0000 7f04db6c7640 1 -- 172.21.15.2:0/2123724660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d41108a0 con 0x7f04d40fd420 2024-09-17T01:03:04.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.163+0000 7f04c9ffb640 1 -- 172.21.15.2:0/2123724660 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04c400da30 con 0x7f04d40fd420 2024-09-17T01:03:04.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.163+0000 7f04db6c7640 1 -- 172.21.15.2:0/2123724660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d4110e40 con 0x7f04d40fd420 2024-09-17T01:03:04.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.165+0000 7f04db6c7640 1 -- 172.21.15.2:0/2123724660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d40fa040 con 0x7f04d40fd420 2024-09-17T01:03:04.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.165+0000 7f04c9ffb640 1 -- 172.21.15.2:0/2123724660 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91660+0+0 (secure 0 0 0) 0x7f04c400db90 con 0x7f04d40fd420 2024-09-17T01:03:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.165+0000 7f04c9ffb640 1 --2- 172.21.15.2:0/2123724660 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f04c006e6e0 0x7f04c0070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.165+0000 7f04c9ffb640 1 -- 172.21.15.2:0/2123724660 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f04c408dc50 con 0x7f04d40fd420 2024-09-17T01:03:04.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.166+0000 7f04d9463640 1 --2- 172.21.15.2:0/2123724660 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f04c006e6e0 0x7f04c0070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:04.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.166+0000 7f04d9463640 1 --2- 172.21.15.2:0/2123724660 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f04c006e6e0 0x7f04c0070b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f04d0000c00 tx=0x7f04d0035040 comp rx=0 tx=0).ready entity=mgr.14580 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:04.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.170+0000 7f04c9ffb640 1 -- 172.21.15.2:0/2123724660 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f04c4057610 con 0x7f04d40fd420 2024-09-17T01:03:04.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.371+0000 7f04db6c7640 1 -- 172.21.15.2:0/2123724660 --> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04d4111220 con 0x7f04c006e6e0 2024-09-17T01:03:04.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.373+0000 7f04c9ffb640 1 -- 172.21.15.2:0/2123724660 <== mgr.14580 v2:172.21.15.99:6828/3228590963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f04d4111220 con 0x7f04c006e6e0 2024-09-17T01:03:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.375+0000 7f04db6c7640 1 -- 172.21.15.2:0/2123724660 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f04c006e6e0 msgr2=0x7f04c0070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:04.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.375+0000 7f04db6c7640 1 --2- 172.21.15.2:0/2123724660 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f04c006e6e0 0x7f04c0070b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f04d0000c00 tx=0x7f04d0035040 comp rx=0 tx=0).stop 2024-09-17T01:03:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.375+0000 7f04db6c7640 1 -- 172.21.15.2:0/2123724660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04d40fd420 msgr2=0x7f04d410f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.375+0000 7f04db6c7640 1 --2- 172.21.15.2:0/2123724660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04d40fd420 0x7f04d410f7a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f04c4002a50 tx=0x7f04c4004570 comp rx=0 tx=0).stop 2024-09-17T01:03:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.375+0000 7f04db6c7640 1 -- 172.21.15.2:0/2123724660 shutdown_connections 2024-09-17T01:03:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.375+0000 7f04db6c7640 1 --2- 172.21.15.2:0/2123724660 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f04c006e6e0 0x7f04c0070b90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.375+0000 7f04db6c7640 1 --2- 172.21.15.2:0/2123724660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04d40fd420 0x7f04d410f7a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.375+0000 7f04db6c7640 1 --2- 172.21.15.2:0/2123724660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04d40fcad0 0x7f04d410f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.375+0000 7f04db6c7640 1 -- 172.21.15.2:0/2123724660 >> 172.21.15.2:0/2123724660 conn(0x7f04d40f63a0 msgr2=0x7f04d40f67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.375+0000 7f04db6c7640 1 -- 172.21.15.2:0/2123724660 shutdown_connections 2024-09-17T01:03:04.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.375+0000 7f04db6c7640 1 -- 172.21.15.2:0/2123724660 wait complete. 2024-09-17T01:03:04.382 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:03:04.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.457+0000 7f07a3e6c640 1 -- 172.21.15.2:0/1950490702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c0fd470 msgr2=0x7f079c0ff8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:04.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.457+0000 7f07a3e6c640 1 --2- 172.21.15.2:0/1950490702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c0fd470 0x7f079c0ff8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f078c0048d0 tx=0x7f078c009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.457+0000 7f07a3e6c640 1 -- 172.21.15.2:0/1950490702 shutdown_connections 2024-09-17T01:03:04.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.457+0000 7f07a3e6c640 1 --2- 172.21.15.2:0/1950490702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c0fd470 0x7f079c0ff8f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.458+0000 7f07a3e6c640 1 --2- 172.21.15.2:0/1950490702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f079c065c40 0x7f079c0fcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.458+0000 7f07a3e6c640 1 -- 172.21.15.2:0/1950490702 >> 172.21.15.2:0/1950490702 conn(0x7f079c0f6c10 msgr2=0x7f079c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:04.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.458+0000 7f07a3e6c640 1 -- 172.21.15.2:0/1950490702 shutdown_connections 2024-09-17T01:03:04.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.458+0000 7f07a3e6c640 1 -- 172.21.15.2:0/1950490702 wait complete. 2024-09-17T01:03:04.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.458+0000 7f07a3e6c640 1 Processor -- start 2024-09-17T01:03:04.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.458+0000 7f07a3e6c640 1 -- start start 2024-09-17T01:03:04.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.458+0000 7f07a3e6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c065c40 0x7f079c1136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.458+0000 7f07a3e6c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f079c0fd470 0x7f079c113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.458+0000 7f07a3e6c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c114240 con 0x7f079c065c40 2024-09-17T01:03:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.458+0000 7f07a3e6c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c1149a0 con 0x7f079c0fd470 2024-09-17T01:03:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.459+0000 7f07a1c08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c065c40 0x7f079c1136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.459+0000 7f07a1c08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c065c40 0x7f079c1136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40714/0 (socket says 172.21.15.2:40714) 2024-09-17T01:03:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.459+0000 7f07a1c08640 1 -- 172.21.15.2:0/2172110996 learned_addr learned my addr 172.21.15.2:0/2172110996 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:03:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.459+0000 7f07a1407640 1 --2- 172.21.15.2:0/2172110996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f079c0fd470 0x7f079c113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.459+0000 7f07a1c08640 1 -- 172.21.15.2:0/2172110996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f079c0fd470 msgr2=0x7f079c113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.459+0000 7f07a1c08640 1 --2- 172.21.15.2:0/2172110996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f079c0fd470 0x7f079c113bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.459+0000 7f07a1c08640 1 -- 172.21.15.2:0/2172110996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c005040 con 0x7f079c065c40 2024-09-17T01:03:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.459+0000 7f07a1c08640 1 --2- 172.21.15.2:0/2172110996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c065c40 0x7f079c1136b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f079800c810 tx=0x7f0798004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.459+0000 7f07927fc640 1 -- 172.21.15.2:0/2172110996 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f079800a7d0 con 0x7f079c065c40 2024-09-17T01:03:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.459+0000 7f07927fc640 1 -- 172.21.15.2:0/2172110996 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f079800add0 con 0x7f079c065c40 2024-09-17T01:03:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.459+0000 7f07a3e6c640 1 -- 172.21.15.2:0/2172110996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c114c30 con 0x7f079c065c40 2024-09-17T01:03:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.459+0000 7f07927fc640 1 -- 172.21.15.2:0/2172110996 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07980113a0 con 0x7f079c065c40 2024-09-17T01:03:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.459+0000 7f07a3e6c640 1 -- 172.21.15.2:0/2172110996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c1151d0 con 0x7f079c065c40 2024-09-17T01:03:04.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.460+0000 7f07a3e6c640 1 -- 172.21.15.2:0/2172110996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079c0fa890 con 0x7f079c065c40 2024-09-17T01:03:04.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.461+0000 7f07927fc640 1 -- 172.21.15.2:0/2172110996 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91660+0+0 (secure 0 0 0) 0x7f0798012400 con 0x7f079c065c40 2024-09-17T01:03:04.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.462+0000 7f07927fc640 1 --2- 172.21.15.2:0/2172110996 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f078806e6e0 0x7f0788070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:04.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.462+0000 7f07927fc640 1 -- 172.21.15.2:0/2172110996 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f079808ddb0 con 0x7f079c065c40 2024-09-17T01:03:04.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.462+0000 7f07a1407640 1 --2- 172.21.15.2:0/2172110996 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f078806e6e0 0x7f0788070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:04.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.462+0000 7f07a1407640 1 --2- 172.21.15.2:0/2172110996 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f078806e6e0 0x7f0788070b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f079c113460 tx=0x7f078c035040 comp rx=0 tx=0).ready entity=mgr.14580 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:04.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.466+0000 7f07927fc640 1 -- 172.21.15.2:0/2172110996 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f0798057940 con 0x7f079c065c40 2024-09-17T01:03:04.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.673+0000 7f07a3e6c640 1 -- 172.21.15.2:0/2172110996 --> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f079c115640 con 0x7f078806e6e0 2024-09-17T01:03:04.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.675+0000 7f07927fc640 1 -- 172.21.15.2:0/2172110996 <== mgr.14580 v2:172.21.15.99:6828/3228590963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f079c115640 con 0x7f078806e6e0 2024-09-17T01:03:04.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.677+0000 7f07a3e6c640 1 -- 172.21.15.2:0/2172110996 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f078806e6e0 msgr2=0x7f0788070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:04.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.677+0000 7f07a3e6c640 1 --2- 172.21.15.2:0/2172110996 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f078806e6e0 0x7f0788070b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f079c113460 tx=0x7f078c035040 comp rx=0 tx=0).stop 2024-09-17T01:03:04.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.677+0000 7f07a3e6c640 1 -- 172.21.15.2:0/2172110996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c065c40 msgr2=0x7f079c1136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:04.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.677+0000 7f07a3e6c640 1 --2- 172.21.15.2:0/2172110996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c065c40 0x7f079c1136b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f079800c810 tx=0x7f0798004430 comp rx=0 tx=0).stop 2024-09-17T01:03:04.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.677+0000 7f07a3e6c640 1 -- 172.21.15.2:0/2172110996 shutdown_connections 2024-09-17T01:03:04.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.677+0000 7f07a3e6c640 1 --2- 172.21.15.2:0/2172110996 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f078806e6e0 0x7f0788070b90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.677+0000 7f07a3e6c640 1 --2- 172.21.15.2:0/2172110996 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f079c0fd470 0x7f079c113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.677+0000 7f07a3e6c640 1 --2- 172.21.15.2:0/2172110996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c065c40 0x7f079c1136b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.677+0000 7f07a3e6c640 1 -- 172.21.15.2:0/2172110996 >> 172.21.15.2:0/2172110996 conn(0x7f079c0f6c10 msgr2=0x7f079c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:04.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.677+0000 7f07a3e6c640 1 -- 172.21.15.2:0/2172110996 shutdown_connections 2024-09-17T01:03:04.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.677+0000 7f07a3e6c640 1 -- 172.21.15.2:0/2172110996 wait complete. 2024-09-17T01:03:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.762+0000 7f4c5e829640 1 -- 172.21.15.2:0/1230629056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c580fdba0 msgr2=0x7f4c580fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.762+0000 7f4c5e829640 1 --2- 172.21.15.2:0/1230629056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c580fdba0 0x7f4c580fdfb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4c480048d0 tx=0x7f4c48009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.762+0000 7f4c5e829640 1 -- 172.21.15.2:0/1230629056 shutdown_connections 2024-09-17T01:03:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.762+0000 7f4c5e829640 1 --2- 172.21.15.2:0/1230629056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c580fe4f0 0x7f4c580fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.762+0000 7f4c5e829640 1 --2- 172.21.15.2:0/1230629056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c580fdba0 0x7f4c580fdfb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.762+0000 7f4c5e829640 1 -- 172.21.15.2:0/1230629056 >> 172.21.15.2:0/1230629056 conn(0x7f4c580f63a0 msgr2=0x7f4c580f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.762+0000 7f4c5e829640 1 -- 172.21.15.2:0/1230629056 shutdown_connections 2024-09-17T01:03:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.762+0000 7f4c5e829640 1 -- 172.21.15.2:0/1230629056 wait complete. 2024-09-17T01:03:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.762+0000 7f4c5e829640 1 Processor -- start 2024-09-17T01:03:04.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.763+0000 7f4c5e829640 1 -- start start 2024-09-17T01:03:04.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.763+0000 7f4c5e829640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c580fdba0 0x7f4c580fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:04.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.763+0000 7f4c5e829640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c580fe4f0 0x7f4c580fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:04.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.763+0000 7f4c5e829640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580fbe10 con 0x7f4c580fe4f0 2024-09-17T01:03:04.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.763+0000 7f4c5e829640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580fbf50 con 0x7f4c580fdba0 2024-09-17T01:03:04.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.763+0000 7f4c577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c580fe4f0 0x7f4c580fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:04.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.763+0000 7f4c577fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c580fe4f0 0x7f4c580fb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40732/0 (socket says 172.21.15.2:40732) 2024-09-17T01:03:04.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.763+0000 7f4c577fe640 1 -- 172.21.15.2:0/1156592611 learned_addr learned my addr 172.21.15.2:0/1156592611 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:03:04.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.763+0000 7f4c57fff640 1 --2- 172.21.15.2:0/1156592611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c580fdba0 0x7f4c580fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:04.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.763+0000 7f4c577fe640 1 -- 172.21.15.2:0/1156592611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c580fdba0 msgr2=0x7f4c580fd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:04.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.763+0000 7f4c577fe640 1 --2- 172.21.15.2:0/1156592611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c580fdba0 0x7f4c580fd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.763+0000 7f4c577fe640 1 -- 172.21.15.2:0/1156592611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c48005040 con 0x7f4c580fe4f0 2024-09-17T01:03:04.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.763+0000 7f4c57fff640 1 --2- 172.21.15.2:0/1156592611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c580fdba0 0x7f4c580fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:03:04.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.763+0000 7f4c577fe640 1 --2- 172.21.15.2:0/1156592611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c580fe4f0 0x7f4c580fb880 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c002870 tx=0x7f4c4c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:04.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.764+0000 7f4c54ff9640 1 -- 172.21.15.2:0/1156592611 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c4c007c30 con 0x7f4c580fe4f0 2024-09-17T01:03:04.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.764+0000 7f4c54ff9640 1 -- 172.21.15.2:0/1156592611 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4c4c00f040 con 0x7f4c580fe4f0 2024-09-17T01:03:04.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.764+0000 7f4c5e829640 1 -- 172.21.15.2:0/1156592611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c580fc230 con 0x7f4c580fe4f0 2024-09-17T01:03:04.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.764+0000 7f4c54ff9640 1 -- 172.21.15.2:0/1156592611 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c4c0095b0 con 0x7f4c580fe4f0 2024-09-17T01:03:04.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.764+0000 7f4c5e829640 1 -- 172.21.15.2:0/1156592611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c58115130 con 0x7f4c580fe4f0 2024-09-17T01:03:04.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.765+0000 7f4c5e829640 1 -- 172.21.15.2:0/1156592611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c580fa040 con 0x7f4c580fe4f0 2024-09-17T01:03:04.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.765+0000 7f4c54ff9640 1 -- 172.21.15.2:0/1156592611 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91660+0+0 (secure 0 0 0) 0x7f4c4c009710 con 0x7f4c580fe4f0 2024-09-17T01:03:04.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.766+0000 7f4c54ff9640 1 --2- 172.21.15.2:0/1156592611 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4c4006e6e0 0x7f4c40070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:04.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.766+0000 7f4c54ff9640 1 -- 172.21.15.2:0/1156592611 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4c4c08d730 con 0x7f4c580fe4f0 2024-09-17T01:03:04.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.766+0000 7f4c57fff640 1 --2- 172.21.15.2:0/1156592611 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4c4006e6e0 0x7f4c40070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:04.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.767+0000 7f4c57fff640 1 --2- 172.21.15.2:0/1156592611 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4c4006e6e0 0x7f4c40070b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800b020 tx=0x7f4c48009da0 comp rx=0 tx=0).ready entity=mgr.14580 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:04.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.770+0000 7f4c54ff9640 1 -- 172.21.15.2:0/1156592611 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f4c4c04f670 con 0x7f4c580fe4f0 2024-09-17T01:03:04.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.960+0000 7f4c5e829640 1 -- 172.21.15.2:0/1156592611 --> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c58101d80 con 0x7f4c4006e6e0 2024-09-17T01:03:04.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.970+0000 7f4c54ff9640 1 -- 172.21.15.2:0/1156592611 <== mgr.14580 v2:172.21.15.99:6828/3228590963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4c58101d80 con 0x7f4c4006e6e0 2024-09-17T01:03:04.969 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:03:04.969 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 starting - - - - 2024-09-17T01:03:04.969 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (9m) 39s ago 9m 6903k - 17.2.7-1635-g4a704134 f22ead590bad 53b003b1ad6f 2024-09-17T01:03:04.969 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (8m) 42s ago 8m 6891k - 17.2.7-1635-g4a704134 f22ead590bad 6ec40439e9b5 2024-09-17T01:03:04.969 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (7m) 39s ago 8m 84.4M - 9.4.7 954c08fa6188 68fde0ccaa6c 2024-09-17T01:03:04.969 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (3m) 39s ago 3m 170M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:03:04.969 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (3m) 39s ago 3m 90.5M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:03:04.969 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (3m) 42s ago 3m 107M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:03:04.969 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (3m) 42s ago 3m 171M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:03:04.969 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:9283,8765,8443 running (10m) 39s ago 10m 244M - 17.2.7-1635-g4a704134 f22ead590bad 6f10e41396cd 2024-09-17T01:03:04.969 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283 running (61s) 42s ago 8m 477M - 19.1.1-330-gc2ddf972 ebb0615149de 8ad174f204d2 2024-09-17T01:03:04.969 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (10m) 39s ago 10m 48.6M 2048M 17.2.7-1635-g4a704134 f22ead590bad 08b932b41bfa 2024-09-17T01:03:04.970 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (8m) 42s ago 8m 39.9M 2048M 17.2.7-1635-g4a704134 f22ead590bad 1c9583d52c94 2024-09-17T01:03:04.970 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 starting - - - - 2024-09-17T01:03:04.970 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (8m) 42s ago 8m 17.0M - 1.5.0 0da6a335fe13 7c4fe7150f28 2024-09-17T01:03:04.970 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (7m) 39s ago 7m 204M 1558M 17.2.7-1635-g4a704134 f22ead590bad 720f74f40752 2024-09-17T01:03:04.970 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (6m) 39s ago 6m 218M 1558M 17.2.7-1635-g4a704134 f22ead590bad 629defddb38c 2024-09-17T01:03:04.970 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (6m) 39s ago 6m 174M 1558M 17.2.7-1635-g4a704134 f22ead590bad 5dff1cf9fc56 2024-09-17T01:03:04.970 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (6m) 42s ago 6m 237M 2581M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:03:04.970 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (5m) 42s ago 5m 212M 2581M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:03:04.970 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (5m) 42s ago 5m 200M 2581M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:03:04.970 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (7m) 39s ago 8m 56.9M - 2.43.0 a07b618ecd1d 4c4de4cca2fc 2024-09-17T01:03:04.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.973+0000 7f4c5e829640 1 -- 172.21.15.2:0/1156592611 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4c4006e6e0 msgr2=0x7f4c40070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:04.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.973+0000 7f4c5e829640 1 --2- 172.21.15.2:0/1156592611 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4c4006e6e0 0x7f4c40070b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800b020 tx=0x7f4c48009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.973+0000 7f4c5e829640 1 -- 172.21.15.2:0/1156592611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c580fe4f0 msgr2=0x7f4c580fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:04.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.973+0000 7f4c5e829640 1 --2- 172.21.15.2:0/1156592611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c580fe4f0 0x7f4c580fb880 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c002870 tx=0x7f4c4c004600 comp rx=0 tx=0).stop 2024-09-17T01:03:04.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.973+0000 7f4c5e829640 1 -- 172.21.15.2:0/1156592611 shutdown_connections 2024-09-17T01:03:04.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.973+0000 7f4c5e829640 1 --2- 172.21.15.2:0/1156592611 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4c4006e6e0 0x7f4c40070b90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.973+0000 7f4c5e829640 1 --2- 172.21.15.2:0/1156592611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c580fe4f0 0x7f4c580fb880 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.973+0000 7f4c5e829640 1 --2- 172.21.15.2:0/1156592611 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c580fdba0 0x7f4c580fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:04.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.973+0000 7f4c5e829640 1 -- 172.21.15.2:0/1156592611 >> 172.21.15.2:0/1156592611 conn(0x7f4c580f63a0 msgr2=0x7f4c580f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:04.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.973+0000 7f4c5e829640 1 -- 172.21.15.2:0/1156592611 shutdown_connections 2024-09-17T01:03:04.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:04.973+0000 7f4c5e829640 1 -- 172.21.15.2:0/1156592611 wait complete. 2024-09-17T01:03:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.054+0000 7f4e17fe6640 1 -- 172.21.15.2:0/1047786134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e10065c40 msgr2=0x7f4e10101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.054+0000 7f4e17fe6640 1 --2- 172.21.15.2:0/1047786134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e10065c40 0x7f4e10101540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0048d0 tx=0x7f4e0c009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.054+0000 7f4e17fe6640 1 -- 172.21.15.2:0/1047786134 shutdown_connections 2024-09-17T01:03:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.054+0000 7f4e17fe6640 1 --2- 172.21.15.2:0/1047786134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e10101a80 0x7f4e10103e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.054+0000 7f4e17fe6640 1 --2- 172.21.15.2:0/1047786134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e10065c40 0x7f4e10101540 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.054+0000 7f4e17fe6640 1 -- 172.21.15.2:0/1047786134 >> 172.21.15.2:0/1047786134 conn(0x7f4e100f6c10 msgr2=0x7f4e100f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.054+0000 7f4e17fe6640 1 -- 172.21.15.2:0/1047786134 shutdown_connections 2024-09-17T01:03:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.054+0000 7f4e17fe6640 1 -- 172.21.15.2:0/1047786134 wait complete. 2024-09-17T01:03:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.055+0000 7f4e17fe6640 1 Processor -- start 2024-09-17T01:03:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.055+0000 7f4e17fe6640 1 -- start start 2024-09-17T01:03:05.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.055+0000 7f4e17fe6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e10065c40 0x7f4e1010f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.055+0000 7f4e17fe6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e10101a80 0x7f4e1010f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.055+0000 7f4e17fe6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1010fe90 con 0x7f4e10065c40 2024-09-17T01:03:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.055+0000 7f4e17fe6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e10110660 con 0x7f4e10101a80 2024-09-17T01:03:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.055+0000 7f4e15d82640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e10065c40 0x7f4e1010f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.055+0000 7f4e15d82640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e10065c40 0x7f4e1010f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40742/0 (socket says 172.21.15.2:40742) 2024-09-17T01:03:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.055+0000 7f4e15d82640 1 -- 172.21.15.2:0/227079845 learned_addr learned my addr 172.21.15.2:0/227079845 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:03:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.055+0000 7f4e15581640 1 --2- 172.21.15.2:0/227079845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e10101a80 0x7f4e1010f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.055+0000 7f4e15d82640 1 -- 172.21.15.2:0/227079845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e10101a80 msgr2=0x7f4e1010f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.055+0000 7f4e15d82640 1 --2- 172.21.15.2:0/227079845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e10101a80 0x7f4e1010f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.055+0000 7f4e15d82640 1 -- 172.21.15.2:0/227079845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c005040 con 0x7f4e10065c40 2024-09-17T01:03:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.056+0000 7f4e15581640 1 --2- 172.21.15.2:0/227079845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e10101a80 0x7f4e1010f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:03:05.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.056+0000 7f4e15d82640 1 --2- 172.21.15.2:0/227079845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e10065c40 0x7f4e1010f300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0048a0 tx=0x7f4e0c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:05.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.056+0000 7f4e067fc640 1 -- 172.21.15.2:0/227079845 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e0c038070 con 0x7f4e10065c40 2024-09-17T01:03:05.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.056+0000 7f4e17fe6640 1 -- 172.21.15.2:0/227079845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e10110890 con 0x7f4e10065c40 2024-09-17T01:03:05.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.056+0000 7f4e067fc640 1 -- 172.21.15.2:0/227079845 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4e0c02abd0 con 0x7f4e10065c40 2024-09-17T01:03:05.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.056+0000 7f4e067fc640 1 -- 172.21.15.2:0/227079845 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e0c033640 con 0x7f4e10065c40 2024-09-17T01:03:05.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.056+0000 7f4e17fe6640 1 -- 172.21.15.2:0/227079845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e10110e30 con 0x7f4e10065c40 2024-09-17T01:03:05.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.057+0000 7f4e17fe6640 1 -- 172.21.15.2:0/227079845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e100fa890 con 0x7f4e10065c40 2024-09-17T01:03:05.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.058+0000 7f4e067fc640 1 -- 172.21.15.2:0/227079845 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91660+0+0 (secure 0 0 0) 0x7f4e0c030020 con 0x7f4e10065c40 2024-09-17T01:03:05.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.058+0000 7f4e067fc640 1 --2- 172.21.15.2:0/227079845 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4dfc06e6e0 0x7f4dfc070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:05.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.058+0000 7f4e067fc640 1 -- 172.21.15.2:0/227079845 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4e0c0ae1a0 con 0x7f4e10065c40 2024-09-17T01:03:05.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.059+0000 7f4e15581640 1 --2- 172.21.15.2:0/227079845 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4dfc06e6e0 0x7f4dfc070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:05.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.059+0000 7f4e15581640 1 --2- 172.21.15.2:0/227079845 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4dfc06e6e0 0x7f4dfc070b90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4e1010f0b0 tx=0x7f4e00009040 comp rx=0 tx=0).ready entity=mgr.14580 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:05.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.063+0000 7f4e067fc640 1 -- 172.21.15.2:0/227079845 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f4e0c077b30 con 0x7f4e10065c40 2024-09-17T01:03:05.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.319+0000 7f4e17fe6640 1 -- 172.21.15.2:0/227079845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4e10107140 con 0x7f4e10065c40 2024-09-17T01:03:05.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.320+0000 7f4e067fc640 1 -- 172.21.15.2:0/227079845 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f4e0c07b1f0 con 0x7f4e10065c40 2024-09-17T01:03:05.319 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:03:05.319 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:03:05.319 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T01:03:05.319 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:03:05.319 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:03:05.319 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 1, 2024-09-17T01:03:05.319 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:03:05.319 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:03:05.319 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:03:05.319 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T01:03:05.319 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:03:05.319 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:03:05.320 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:03:05.320 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:03:05.320 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:03:05.320 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 13, 2024-09-17T01:03:05.320 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:03:05.320 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:03:05.320 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:03:05.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.322+0000 7f4e17fe6640 1 -- 172.21.15.2:0/227079845 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4dfc06e6e0 msgr2=0x7f4dfc070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:05.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.322+0000 7f4e17fe6640 1 --2- 172.21.15.2:0/227079845 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4dfc06e6e0 0x7f4dfc070b90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4e1010f0b0 tx=0x7f4e00009040 comp rx=0 tx=0).stop 2024-09-17T01:03:05.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.322+0000 7f4e17fe6640 1 -- 172.21.15.2:0/227079845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e10065c40 msgr2=0x7f4e1010f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:05.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.322+0000 7f4e17fe6640 1 --2- 172.21.15.2:0/227079845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e10065c40 0x7f4e1010f300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0048a0 tx=0x7f4e0c009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.322+0000 7f4e17fe6640 1 -- 172.21.15.2:0/227079845 shutdown_connections 2024-09-17T01:03:05.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.322+0000 7f4e17fe6640 1 --2- 172.21.15.2:0/227079845 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7f4dfc06e6e0 0x7f4dfc070b90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.322+0000 7f4e17fe6640 1 --2- 172.21.15.2:0/227079845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e10101a80 0x7f4e1010f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.322+0000 7f4e17fe6640 1 --2- 172.21.15.2:0/227079845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e10065c40 0x7f4e1010f300 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.322+0000 7f4e17fe6640 1 -- 172.21.15.2:0/227079845 >> 172.21.15.2:0/227079845 conn(0x7f4e100f6c10 msgr2=0x7f4e100f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:05.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.322+0000 7f4e17fe6640 1 -- 172.21.15.2:0/227079845 shutdown_connections 2024-09-17T01:03:05.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.322+0000 7f4e17fe6640 1 -- 172.21.15.2:0/227079845 wait complete. 2024-09-17T01:03:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.406+0000 7fdedccc7640 1 -- 172.21.15.2:0/219831420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fded80ff6e0 msgr2=0x7fded8101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.406+0000 7fdedccc7640 1 --2- 172.21.15.2:0/219831420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fded80ff6e0 0x7fded8101ac0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdec00048d0 tx=0x7fdec0009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.406+0000 7fdedccc7640 1 -- 172.21.15.2:0/219831420 shutdown_connections 2024-09-17T01:03:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.406+0000 7fdedccc7640 1 --2- 172.21.15.2:0/219831420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fded80ff6e0 0x7fded8101ac0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.406+0000 7fdedccc7640 1 --2- 172.21.15.2:0/219831420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fded8065be0 0x7fded80ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.406+0000 7fdedccc7640 1 -- 172.21.15.2:0/219831420 >> 172.21.15.2:0/219831420 conn(0x7fded80f6c10 msgr2=0x7fded80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.407+0000 7fdedccc7640 1 -- 172.21.15.2:0/219831420 shutdown_connections 2024-09-17T01:03:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.407+0000 7fdedccc7640 1 -- 172.21.15.2:0/219831420 wait complete. 2024-09-17T01:03:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.407+0000 7fdedccc7640 1 Processor -- start 2024-09-17T01:03:05.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.407+0000 7fdedccc7640 1 -- start start 2024-09-17T01:03:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.407+0000 7fdedccc7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fded8065be0 0x7fded80fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.407+0000 7fdedccc7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fded80ff6e0 0x7fded80fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.407+0000 7fdedccc7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded80fb630 con 0x7fded8065be0 2024-09-17T01:03:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.407+0000 7fdedccc7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded80fb770 con 0x7fded80ff6e0 2024-09-17T01:03:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.407+0000 7fded659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fded8065be0 0x7fded80fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.407+0000 7fded659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fded8065be0 0x7fded80fcbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40750/0 (socket says 172.21.15.2:40750) 2024-09-17T01:03:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.407+0000 7fded659c640 1 -- 172.21.15.2:0/1870571993 learned_addr learned my addr 172.21.15.2:0/1870571993 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:03:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.408+0000 7fded5d9b640 1 --2- 172.21.15.2:0/1870571993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fded80ff6e0 0x7fded80fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.408+0000 7fded659c640 1 -- 172.21.15.2:0/1870571993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fded80ff6e0 msgr2=0x7fded80fb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.408+0000 7fded659c640 1 --2- 172.21.15.2:0/1870571993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fded80ff6e0 0x7fded80fb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.408+0000 7fded659c640 1 -- 172.21.15.2:0/1870571993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec0005040 con 0x7fded8065be0 2024-09-17T01:03:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.408+0000 7fded659c640 1 --2- 172.21.15.2:0/1870571993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fded8065be0 0x7fded80fcbb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fded000eb70 tx=0x7fded000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.408+0000 7fdeceffd640 1 -- 172.21.15.2:0/1870571993 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fded0007c30 con 0x7fded8065be0 2024-09-17T01:03:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.408+0000 7fdedccc7640 1 -- 172.21.15.2:0/1870571993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded80fba50 con 0x7fded8065be0 2024-09-17T01:03:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.408+0000 7fdeceffd640 1 -- 172.21.15.2:0/1870571993 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fded000f040 con 0x7fded8065be0 2024-09-17T01:03:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.408+0000 7fdeceffd640 1 -- 172.21.15.2:0/1870571993 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fded000caa0 con 0x7fded8065be0 2024-09-17T01:03:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.408+0000 7fdedccc7640 1 -- 172.21.15.2:0/1870571993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded81150a0 con 0x7fded8065be0 2024-09-17T01:03:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.409+0000 7fdedccc7640 1 -- 172.21.15.2:0/1870571993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded80fa890 con 0x7fded8065be0 2024-09-17T01:03:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.410+0000 7fdeceffd640 1 -- 172.21.15.2:0/1870571993 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 24) v1 ==== 91660+0+0 (secure 0 0 0) 0x7fded0009110 con 0x7fded8065be0 2024-09-17T01:03:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.410+0000 7fdeceffd640 1 --2- 172.21.15.2:0/1870571993 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7fdec406e6e0 0x7fdec4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.410+0000 7fdeceffd640 1 -- 172.21.15.2:0/1870571993 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fded008e150 con 0x7fded8065be0 2024-09-17T01:03:05.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.410+0000 7fded5d9b640 1 --2- 172.21.15.2:0/1870571993 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7fdec406e6e0 0x7fdec4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:05.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.411+0000 7fded5d9b640 1 --2- 172.21.15.2:0/1870571993 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7fdec406e6e0 0x7fdec4070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009ac0 tx=0x7fdec0035040 comp rx=0 tx=0).ready entity=mgr.14580 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:05.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.415+0000 7fdeceffd640 1 -- 172.21.15.2:0/1870571993 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fded00579d0 con 0x7fded8065be0 2024-09-17T01:03:05.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:05 smithi099 ceph-mon[34357]: pgmap v27: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 530 op/s 2024-09-17T01:03:05.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:05 smithi099 ceph-mon[34357]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:05.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:05 smithi099 ceph-mon[34357]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:05.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:05 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:05.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.633+0000 7fdedccc7640 1 -- 172.21.15.2:0/1870571993 --> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fded80f8700 con 0x7fdec406e6e0 2024-09-17T01:03:05.632 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:05 smithi002 ceph-mon[27650]: pgmap v27: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 530 op/s 2024-09-17T01:03:05.632 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:05 smithi002 ceph-mon[27650]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:05.632 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:05 smithi002 ceph-mon[27650]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:05.632 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:05 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:05.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.634+0000 7fdeceffd640 1 -- 172.21.15.2:0/1870571993 <== mgr.14580 v2:172.21.15.99:6828/3228590963 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fded80f8700 con 0x7fdec406e6e0 2024-09-17T01:03:05.633 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:03:05.633 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:03:05.633 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:03:05.633 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-17T01:03:05.633 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2024-09-17T01:03:05.633 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "1/2 daemons upgraded", 2024-09-17T01:03:05.633 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "", 2024-09-17T01:03:05.633 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:03:05.634 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:03:05.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.637+0000 7fdedccc7640 1 -- 172.21.15.2:0/1870571993 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7fdec406e6e0 msgr2=0x7fdec4070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:05.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.637+0000 7fdedccc7640 1 --2- 172.21.15.2:0/1870571993 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7fdec406e6e0 0x7fdec4070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009ac0 tx=0x7fdec0035040 comp rx=0 tx=0).stop 2024-09-17T01:03:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.637+0000 7fdedccc7640 1 -- 172.21.15.2:0/1870571993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fded8065be0 msgr2=0x7fded80fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.637+0000 7fdedccc7640 1 --2- 172.21.15.2:0/1870571993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fded8065be0 0x7fded80fcbb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fded000eb70 tx=0x7fded000b040 comp rx=0 tx=0).stop 2024-09-17T01:03:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.637+0000 7fdedccc7640 1 -- 172.21.15.2:0/1870571993 shutdown_connections 2024-09-17T01:03:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.637+0000 7fdedccc7640 1 --2- 172.21.15.2:0/1870571993 >> [v2:172.21.15.99:6828/3228590963,v1:172.21.15.99:6829/3228590963] conn(0x7fdec406e6e0 0x7fdec4070b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.637+0000 7fdedccc7640 1 --2- 172.21.15.2:0/1870571993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fded80ff6e0 0x7fded80fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.637+0000 7fdedccc7640 1 --2- 172.21.15.2:0/1870571993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fded8065be0 0x7fded80fcbb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.637+0000 7fdedccc7640 1 -- 172.21.15.2:0/1870571993 >> 172.21.15.2:0/1870571993 conn(0x7fded80f6c10 msgr2=0x7fded80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.637+0000 7fdedccc7640 1 -- 172.21.15.2:0/1870571993 shutdown_connections 2024-09-17T01:03:05.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:05.637+0000 7fdedccc7640 1 -- 172.21.15.2:0/1870571993 wait complete. 2024-09-17T01:03:06.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:06 smithi099 ceph-mon[34357]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:06.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:06 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:06.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:06 smithi099 ceph-mon[34357]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2024-09-17T01:03:06.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:06 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/227079845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:06.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:06 smithi099 ceph-mon[34357]: Deploying daemon prometheus.smithi002 on smithi002 2024-09-17T01:03:06.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:06 smithi099 ceph-mon[34357]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:06.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:06 smithi002 ceph-mon[27650]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:06.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:06 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:06.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:06 smithi002 ceph-mon[27650]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2024-09-17T01:03:06.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:06 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/227079845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:06.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:06 smithi002 ceph-mon[27650]: Deploying daemon prometheus.smithi002 on smithi002 2024-09-17T01:03:06.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:06 smithi002 ceph-mon[27650]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:07.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:07 smithi002 ceph-mon[27650]: pgmap v28: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 317 op/s 2024-09-17T01:03:07.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:07 smithi099 ceph-mon[34357]: pgmap v28: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 317 op/s 2024-09-17T01:03:09.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:09 smithi002 ceph-mon[27650]: pgmap v29: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 321 op/s 2024-09-17T01:03:09.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:09 smithi099 ceph-mon[34357]: pgmap v29: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 321 op/s 2024-09-17T01:03:11.533 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:11 smithi002 ceph-mon[27650]: pgmap v30: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 240 KiB/s rd, 161 KiB/s wr, 68 op/s 2024-09-17T01:03:11.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:11 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:11.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:11 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:11.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:11 smithi099 ceph-mon[34357]: pgmap v30: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 240 KiB/s rd, 161 KiB/s wr, 68 op/s 2024-09-17T01:03:11.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:11 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:11.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:11 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:12.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:12 smithi099 ceph-mon[34357]: Reconfiguring node-exporter.smithi099 (dependencies changed)... 2024-09-17T01:03:12.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:12 smithi099 ceph-mon[34357]: Deploying daemon node-exporter.smithi099 on smithi099 2024-09-17T01:03:12.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:12 smithi002 ceph-mon[27650]: Reconfiguring node-exporter.smithi099 (dependencies changed)... 2024-09-17T01:03:12.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:12 smithi002 ceph-mon[27650]: Deploying daemon node-exporter.smithi099 on smithi099 2024-09-17T01:03:13.412 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:13 smithi099 ceph-mon[34357]: pgmap v31: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 240 KiB/s rd, 161 KiB/s wr, 69 op/s 2024-09-17T01:03:13.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:13 smithi002 ceph-mon[27650]: pgmap v31: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 240 KiB/s rd, 161 KiB/s wr, 69 op/s 2024-09-17T01:03:15.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:14 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:15.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:14 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:15.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:14 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:03:15.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:14 smithi099 ceph-mon[34357]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:03:15.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:14 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:03:15.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:14 smithi099 ceph-mon[34357]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:03:15.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:14 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:03:15.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:14 smithi099 ceph-mon[34357]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:03:15.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:14 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:15.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:14 smithi099 ceph-mon[34357]: Upgrade: Need to upgrade myself (mgr.smithi099.vswzrb) 2024-09-17T01:03:15.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:14 smithi099 ceph-mon[34357]: Upgrade: Need to upgrade myself (mgr.smithi099.vswzrb) 2024-09-17T01:03:15.080 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:14 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:15.080 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:14 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:15.080 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:14 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:03:15.080 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:14 smithi002 ceph-mon[27650]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:03:15.080 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:14 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:03:15.080 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:14 smithi002 ceph-mon[27650]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:03:15.080 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:14 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:03:15.080 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:14 smithi002 ceph-mon[27650]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:03:15.081 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:14 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:15.081 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:14 smithi002 ceph-mon[27650]: Upgrade: Need to upgrade myself (mgr.smithi099.vswzrb) 2024-09-17T01:03:15.081 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:14 smithi002 ceph-mon[27650]: Upgrade: Need to upgrade myself (mgr.smithi099.vswzrb) 2024-09-17T01:03:15.758 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:15 smithi002 ceph-mon[27650]: pgmap v32: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 226 KiB/s rd, 145 KiB/s wr, 57 op/s 2024-09-17T01:03:15.758 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:15 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:15.758 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:15 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.vjeexr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:03:15.758 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:15 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.vjeexr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:03:15.758 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:15 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:03:15.758 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:15 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:16.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:15 smithi099 ceph-mon[34357]: pgmap v32: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 226 KiB/s rd, 145 KiB/s wr, 57 op/s 2024-09-17T01:03:16.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:15 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:16.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:15 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.vjeexr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:03:16.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:15 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.vjeexr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:03:16.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:15 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:03:16.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:15 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:16.955 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:16 smithi002 ceph-mon[27650]: Upgrade: Updating mgr.smithi002.vjeexr 2024-09-17T01:03:16.955 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:16 smithi002 ceph-mon[27650]: Deploying daemon mgr.smithi002.vjeexr on smithi002 2024-09-17T01:03:16.955 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:16 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:17.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:16 smithi099 ceph-mon[34357]: Upgrade: Updating mgr.smithi002.vjeexr 2024-09-17T01:03:17.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:16 smithi099 ceph-mon[34357]: Deploying daemon mgr.smithi002.vjeexr on smithi002 2024-09-17T01:03:17.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:16 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:17.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:17 smithi002 ceph-mon[27650]: pgmap v33: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-09-17T01:03:18.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:17 smithi099 ceph-mon[34357]: pgmap v33: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-09-17T01:03:19.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:19 smithi002 ceph-mon[27650]: pgmap v34: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2024-09-17T01:03:19.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:19 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:19.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:19 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:19.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:19 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:19.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:19 smithi099 ceph-mon[34357]: pgmap v34: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s rd, 5.3 KiB/s wr, 9 op/s 2024-09-17T01:03:19.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:19 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:19.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:19 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:19.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:19 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:21.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:21 smithi099 ceph-mon[34357]: pgmap v35: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-17T01:03:22.097 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:21 smithi002 ceph-mon[27650]: pgmap v35: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.9 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-17T01:03:23.395 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:23 smithi002 ceph-mon[27650]: pgmap v36: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-17T01:03:23.395 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:23 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:23.395 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:23 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:23.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:23 smithi099 ceph-mon[34357]: pgmap v36: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-17T01:03:23.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:23 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:23.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:23 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:25 smithi099 ceph-mon[34357]: pgmap v37: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-17T01:03:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:25 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:25 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:25 smithi099 ceph-mon[34357]: Standby manager daemon smithi002.vjeexr restarted 2024-09-17T01:03:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:25 smithi099 ceph-mon[34357]: Standby manager daemon smithi002.vjeexr started 2024-09-17T01:03:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:25 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.vjeexr/crt"}]: dispatch 2024-09-17T01:03:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:25 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:03:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:25 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.vjeexr/key"}]: dispatch 2024-09-17T01:03:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:25 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:03:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:25 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:25 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:25.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:25 smithi002 ceph-mon[27650]: pgmap v37: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-17T01:03:25.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:25 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:25.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:25 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:25.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:25 smithi002 ceph-mon[27650]: Standby manager daemon smithi002.vjeexr restarted 2024-09-17T01:03:25.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:25 smithi002 ceph-mon[27650]: Standby manager daemon smithi002.vjeexr started 2024-09-17T01:03:25.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:25 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.vjeexr/crt"}]: dispatch 2024-09-17T01:03:25.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:25 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:03:25.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:25 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.vjeexr/key"}]: dispatch 2024-09-17T01:03:25.653 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:25 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:03:25.653 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:25 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:25.653 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:25 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:26.556 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:26 smithi002 ceph-mon[27650]: mgrmap e25: smithi099.vswzrb(active, since 69s), standbys: smithi002.vjeexr 2024-09-17T01:03:26.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:26 smithi099 ceph-mon[34357]: mgrmap e25: smithi099.vswzrb(active, since 69s), standbys: smithi002.vjeexr 2024-09-17T01:03:27.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:27 smithi002 ceph-mon[27650]: pgmap v38: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-17T01:03:27.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:27 smithi099 ceph-mon[34357]: pgmap v38: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-17T01:03:29.525 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:29.526 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:29.526 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:29.526 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:03:29.526 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:29.526 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:29.526 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mgr fail", "who": "smithi099.vswzrb"}]: dispatch 2024-09-17T01:03:29.526 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mgr fail", "who": "smithi099.vswzrb"}]: dispatch 2024-09-17T01:03:29.526 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: Activating manager daemon smithi002.vjeexr 2024-09-17T01:03:29.526 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T01:03:29.526 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd='[{"prefix": "mgr fail", "who": "smithi099.vswzrb"}]': finished 2024-09-17T01:03:29.526 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: mgrmap e26: smithi002.vjeexr(active, starting, since 0.00786098s) 2024-09-17T01:03:29.526 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.fmyyzz"}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.hgawhu"}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr metadata", "who": "smithi002.vjeexr", "id": "smithi002.vjeexr"}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:03:29.527 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:03:29.528 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: Manager daemon smithi002.vjeexr is now available 2024-09-17T01:03:29.528 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:29.528 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:29.528 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:03:29.528 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/trash_purge_schedule"}]: dispatch 2024-09-17T01:03:29.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:29.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:29.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:29.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:03:29.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' 2024-09-17T01:03:29.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:29.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14580 172.21.15.99:0/877838583' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mgr fail", "who": "smithi099.vswzrb"}]: dispatch 2024-09-17T01:03:29.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "mgr fail", "who": "smithi099.vswzrb"}]: dispatch 2024-09-17T01:03:29.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: Activating manager daemon smithi002.vjeexr 2024-09-17T01:03:29.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T01:03:29.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14580 ' entity='mgr.smithi099.vswzrb' cmd='[{"prefix": "mgr fail", "who": "smithi099.vswzrb"}]': finished 2024-09-17T01:03:29.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: mgrmap e26: smithi002.vjeexr(active, starting, since 0.00786098s) 2024-09-17T01:03:29.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T01:03:29.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T01:03:29.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.fmyyzz"}]: dispatch 2024-09-17T01:03:29.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.hgawhu"}]: dispatch 2024-09-17T01:03:29.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T01:03:29.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T01:03:29.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr metadata", "who": "smithi002.vjeexr", "id": "smithi002.vjeexr"}]: dispatch 2024-09-17T01:03:29.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:03:29.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:03:29.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:03:29.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:03:29.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:03:29.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:03:29.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:03:29.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:03:29.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:03:29.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: Manager daemon smithi002.vjeexr is now available 2024-09-17T01:03:29.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:29.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:29.658 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:03:29.658 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/trash_purge_schedule"}]: dispatch 2024-09-17T01:03:30.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:30 smithi002 ceph-mon[27650]: mgrmap e27: smithi002.vjeexr(active, since 1.0095s) 2024-09-17T01:03:30.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:30 smithi002 ceph-mon[27650]: pgmap v3: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:03:30.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:30 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:30.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:30 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:30.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:30 smithi099 ceph-mon[34357]: mgrmap e27: smithi002.vjeexr(active, since 1.0095s) 2024-09-17T01:03:30.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:30 smithi099 ceph-mon[34357]: pgmap v3: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:03:30.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:30 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:30.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:30 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:31.884 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:31 smithi002 ceph-mon[27650]: pgmap v4: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:03:31.884 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:31 smithi002 ceph-mon[27650]: mgrmap e28: smithi002.vjeexr(active, since 2s) 2024-09-17T01:03:32.106 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:31 smithi099 ceph-mon[34357]: pgmap v4: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:03:32.106 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:31 smithi099 ceph-mon[34357]: mgrmap e28: smithi002.vjeexr(active, since 2s) 2024-09-17T01:03:32.863 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:32 smithi002 ceph-mon[27650]: [17/Sep/2024:01:03:31] ENGINE Bus STARTING 2024-09-17T01:03:32.863 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:32 smithi002 ceph-mon[27650]: [17/Sep/2024:01:03:31] ENGINE Serving on http://172.21.15.2:8765 2024-09-17T01:03:32.863 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:32 smithi002 ceph-mon[27650]: [17/Sep/2024:01:03:31] ENGINE Serving on https://172.21.15.2:7150 2024-09-17T01:03:32.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:32 smithi002 ceph-mon[27650]: [17/Sep/2024:01:03:31] ENGINE Bus STARTED 2024-09-17T01:03:32.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:32 smithi002 ceph-mon[27650]: [17/Sep/2024:01:03:31] ENGINE Error in HTTPServer.serve 2024-09-17T01:03:32.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Traceback (most recent call last): 2024-09-17T01:03:32.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:03:32.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:03:32.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:03:32.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._run(expiration_interval) 2024-09-17T01:03:32.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:03:32.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:03:32.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:03:32.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:03:32.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:03:32.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s = self.context.wrap_socket( 2024-09-17T01:03:32.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:03:32.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: return self.sslsocket_class._create( 2024-09-17T01:03:32.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:03:32.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self.do_handshake() 2024-09-17T01:03:32.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:03:32.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._sslobj.do_handshake() 2024-09-17T01:03:32.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:03:32.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:32 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:32.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:32 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:33.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:32 smithi099 ceph-mon[34357]: [17/Sep/2024:01:03:31] ENGINE Bus STARTING 2024-09-17T01:03:33.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:32 smithi099 ceph-mon[34357]: [17/Sep/2024:01:03:31] ENGINE Serving on http://172.21.15.2:8765 2024-09-17T01:03:33.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:32 smithi099 ceph-mon[34357]: [17/Sep/2024:01:03:31] ENGINE Serving on https://172.21.15.2:7150 2024-09-17T01:03:33.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:32 smithi099 ceph-mon[34357]: [17/Sep/2024:01:03:31] ENGINE Bus STARTED 2024-09-17T01:03:33.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:32 smithi099 ceph-mon[34357]: [17/Sep/2024:01:03:31] ENGINE Error in HTTPServer.serve 2024-09-17T01:03:33.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Traceback (most recent call last): 2024-09-17T01:03:33.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:03:33.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:03:33.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:03:33.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._run(expiration_interval) 2024-09-17T01:03:33.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:03:33.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:03:33.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:03:33.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:03:33.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:03:33.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s = self.context.wrap_socket( 2024-09-17T01:03:33.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:03:33.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: return self.sslsocket_class._create( 2024-09-17T01:03:33.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:03:33.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self.do_handshake() 2024-09-17T01:03:33.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:03:33.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._sslobj.do_handshake() 2024-09-17T01:03:33.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:03:33.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:32 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:33.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:32 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:34.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:33 smithi002 ceph-mon[27650]: pgmap v5: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:03:34.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:33 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:34.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:33 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:34.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:33 smithi002 ceph-mon[27650]: mgrmap e29: smithi002.vjeexr(active, since 4s) 2024-09-17T01:03:34.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:33 smithi002 ceph-mon[27650]: Standby manager daemon smithi099.vswzrb started 2024-09-17T01:03:34.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:33 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/460085561' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/crt"}]: dispatch 2024-09-17T01:03:34.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:33 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/460085561' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:03:34.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:33 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/460085561' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/key"}]: dispatch 2024-09-17T01:03:34.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:33 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/460085561' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:03:34.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:33 smithi099 ceph-mon[34357]: pgmap v5: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:03:34.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:33 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:34.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:33 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:34.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:33 smithi099 ceph-mon[34357]: mgrmap e29: smithi002.vjeexr(active, since 4s) 2024-09-17T01:03:34.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:33 smithi099 ceph-mon[34357]: Standby manager daemon smithi099.vswzrb started 2024-09-17T01:03:34.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:33 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/460085561' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/crt"}]: dispatch 2024-09-17T01:03:34.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:33 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/460085561' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:03:34.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:33 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/460085561' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/key"}]: dispatch 2024-09-17T01:03:34.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:33 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/460085561' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:03:35.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:35 smithi002 ceph-mon[27650]: mgrmap e30: smithi002.vjeexr(active, since 5s), standbys: smithi099.vswzrb 2024-09-17T01:03:35.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:35 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr metadata", "who": "smithi099.vswzrb", "id": "smithi099.vswzrb"}]: dispatch 2024-09-17T01:03:35.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:35 smithi002 ceph-mon[27650]: pgmap v6: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:03:35.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:35 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:35.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:35 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:35.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.726+0000 7f326edf7640 1 -- 172.21.15.2:0/1300476583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32680ff680 msgr2=0x7f3268101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.726+0000 7f326edf7640 1 --2- 172.21.15.2:0/1300476583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32680ff680 0x7f3268101a60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f32540048d0 tx=0x7f3254009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.726+0000 7f326edf7640 1 -- 172.21.15.2:0/1300476583 shutdown_connections 2024-09-17T01:03:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.726+0000 7f326edf7640 1 --2- 172.21.15.2:0/1300476583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32680ff680 0x7f3268101a60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.726+0000 7f326edf7640 1 --2- 172.21.15.2:0/1300476583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3268065c40 0x7f32680ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.726+0000 7f326edf7640 1 -- 172.21.15.2:0/1300476583 >> 172.21.15.2:0/1300476583 conn(0x7f32680f6c10 msgr2=0x7f32680f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:35.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.726+0000 7f326edf7640 1 -- 172.21.15.2:0/1300476583 shutdown_connections 2024-09-17T01:03:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.726+0000 7f326edf7640 1 -- 172.21.15.2:0/1300476583 wait complete. 2024-09-17T01:03:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.727+0000 7f326edf7640 1 Processor -- start 2024-09-17T01:03:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.727+0000 7f326edf7640 1 -- start start 2024-09-17T01:03:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.727+0000 7f326edf7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3268065c40 0x7f32680fcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.727+0000 7f326edf7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32680ff680 0x7f32680fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:35.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.727+0000 7f326edf7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32680fb5d0 con 0x7f3268065c40 2024-09-17T01:03:35.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.727+0000 7f326edf7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32680fb710 con 0x7f32680ff680 2024-09-17T01:03:35.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.728+0000 7f326cb93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3268065c40 0x7f32680fcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:35.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.728+0000 7f326cb93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3268065c40 0x7f32680fcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44018/0 (socket says 172.21.15.2:44018) 2024-09-17T01:03:35.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.728+0000 7f326cb93640 1 -- 172.21.15.2:0/1464458621 learned_addr learned my addr 172.21.15.2:0/1464458621 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:03:35.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.728+0000 7f3267fff640 1 --2- 172.21.15.2:0/1464458621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32680ff680 0x7f32680fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:35.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.728+0000 7f326cb93640 1 -- 172.21.15.2:0/1464458621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32680ff680 msgr2=0x7f32680fb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:35.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.728+0000 7f326cb93640 1 --2- 172.21.15.2:0/1464458621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32680ff680 0x7f32680fb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.728+0000 7f326cb93640 1 -- 172.21.15.2:0/1464458621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3254005040 con 0x7f3268065c40 2024-09-17T01:03:35.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.728+0000 7f326cb93640 1 --2- 172.21.15.2:0/1464458621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3268065c40 0x7f32680fcb50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f325c002840 tx=0x7f325c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:35.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.728+0000 7f32657fa640 1 -- 172.21.15.2:0/1464458621 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f325c007c30 con 0x7f3268065c40 2024-09-17T01:03:35.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.728+0000 7f32657fa640 1 -- 172.21.15.2:0/1464458621 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f325c00f040 con 0x7f3268065c40 2024-09-17T01:03:35.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.728+0000 7f326edf7640 1 -- 172.21.15.2:0/1464458621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32680fb9f0 con 0x7f3268065c40 2024-09-17T01:03:35.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.728+0000 7f32657fa640 1 -- 172.21.15.2:0/1464458621 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f325c009410 con 0x7f3268065c40 2024-09-17T01:03:35.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.728+0000 7f326edf7640 1 -- 172.21.15.2:0/1464458621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32681150c0 con 0x7f3268065c40 2024-09-17T01:03:35.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.730+0000 7f326edf7640 1 -- 172.21.15.2:0/1464458621 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32680fa890 con 0x7f3268065c40 2024-09-17T01:03:35.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.730+0000 7f32657fa640 1 -- 172.21.15.2:0/1464458621 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 30) v1 ==== 92373+0+0 (secure 0 0 0) 0x7f325c0096d0 con 0x7f3268065c40 2024-09-17T01:03:35.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.730+0000 7f32657fa640 1 --2- 172.21.15.2:0/1464458621 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f325806df60 0x7f3258070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:35.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.731+0000 7f32657fa640 1 -- 172.21.15.2:0/1464458621 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f325c08dab0 con 0x7f3268065c40 2024-09-17T01:03:35.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.731+0000 7f3267fff640 1 --2- 172.21.15.2:0/1464458621 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f325806df60 0x7f3258070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:35.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.731+0000 7f3267fff640 1 --2- 172.21.15.2:0/1464458621 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f325806df60 0x7f3258070410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3254007ac0 tx=0x7f3254035040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:35.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.735+0000 7f32657fa640 1 -- 172.21.15.2:0/1464458621 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f325c0571d0 con 0x7f3268065c40 2024-09-17T01:03:35.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:35 smithi099 ceph-mon[34357]: mgrmap e30: smithi002.vjeexr(active, since 5s), standbys: smithi099.vswzrb 2024-09-17T01:03:35.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:35 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr metadata", "who": "smithi099.vswzrb", "id": "smithi099.vswzrb"}]: dispatch 2024-09-17T01:03:35.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:35 smithi099 ceph-mon[34357]: pgmap v6: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:03:35.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:35 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:35.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:35 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.938+0000 7f326edf7640 1 -- 172.21.15.2:0/1464458621 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32680f8700 con 0x7f325806df60 2024-09-17T01:03:35.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.939+0000 7f32657fa640 1 -- 172.21.15.2:0/1464458621 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f32680f8700 con 0x7f325806df60 2024-09-17T01:03:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.941+0000 7f326edf7640 1 -- 172.21.15.2:0/1464458621 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f325806df60 msgr2=0x7f3258070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.941+0000 7f326edf7640 1 --2- 172.21.15.2:0/1464458621 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f325806df60 0x7f3258070410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3254007ac0 tx=0x7f3254035040 comp rx=0 tx=0).stop 2024-09-17T01:03:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.941+0000 7f326edf7640 1 -- 172.21.15.2:0/1464458621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3268065c40 msgr2=0x7f32680fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.941+0000 7f326edf7640 1 --2- 172.21.15.2:0/1464458621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3268065c40 0x7f32680fcb50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f325c002840 tx=0x7f325c004570 comp rx=0 tx=0).stop 2024-09-17T01:03:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.941+0000 7f326edf7640 1 -- 172.21.15.2:0/1464458621 shutdown_connections 2024-09-17T01:03:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.941+0000 7f326edf7640 1 --2- 172.21.15.2:0/1464458621 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f325806df60 0x7f3258070410 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.941+0000 7f326edf7640 1 --2- 172.21.15.2:0/1464458621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32680ff680 0x7f32680fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.941+0000 7f326edf7640 1 --2- 172.21.15.2:0/1464458621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3268065c40 0x7f32680fcb50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.941+0000 7f326edf7640 1 -- 172.21.15.2:0/1464458621 >> 172.21.15.2:0/1464458621 conn(0x7f32680f6c10 msgr2=0x7f32680f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.942+0000 7f326edf7640 1 -- 172.21.15.2:0/1464458621 shutdown_connections 2024-09-17T01:03:35.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:35.942+0000 7f326edf7640 1 -- 172.21.15.2:0/1464458621 wait complete. 2024-09-17T01:03:35.948 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:03:36.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.025+0000 7fdb7396c640 1 -- 172.21.15.2:0/1287519989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c0fe4c0 msgr2=0x7fdb6c0fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:36.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.025+0000 7fdb7396c640 1 --2- 172.21.15.2:0/1287519989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c0fe4c0 0x7fdb6c0fa620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0048d0 tx=0x7fdb5c009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.025+0000 7fdb7396c640 1 -- 172.21.15.2:0/1287519989 shutdown_connections 2024-09-17T01:03:36.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.025+0000 7fdb7396c640 1 --2- 172.21.15.2:0/1287519989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c0fe4c0 0x7fdb6c0fa620 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.025+0000 7fdb7396c640 1 --2- 172.21.15.2:0/1287519989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb6c0fdb70 0x7fdb6c0fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.025+0000 7fdb7396c640 1 -- 172.21.15.2:0/1287519989 >> 172.21.15.2:0/1287519989 conn(0x7fdb6c0f6390 msgr2=0x7fdb6c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:36.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.025+0000 7fdb7396c640 1 -- 172.21.15.2:0/1287519989 shutdown_connections 2024-09-17T01:03:36.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.025+0000 7fdb7396c640 1 -- 172.21.15.2:0/1287519989 wait complete. 2024-09-17T01:03:36.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.026+0000 7fdb7396c640 1 Processor -- start 2024-09-17T01:03:36.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.026+0000 7fdb7396c640 1 -- start start 2024-09-17T01:03:36.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.026+0000 7fdb7396c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c0fdb70 0x7fdb6c0fd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:36.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.026+0000 7fdb7396c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb6c0fe4c0 0x7fdb6c0fb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:36.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.026+0000 7fdb7396c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0fbde0 con 0x7fdb6c0fdb70 2024-09-17T01:03:36.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.026+0000 7fdb7396c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0fbf20 con 0x7fdb6c0fe4c0 2024-09-17T01:03:36.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.027+0000 7fdb71708640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c0fdb70 0x7fdb6c0fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:36.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.027+0000 7fdb71708640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c0fdb70 0x7fdb6c0fd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44026/0 (socket says 172.21.15.2:44026) 2024-09-17T01:03:36.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.027+0000 7fdb71708640 1 -- 172.21.15.2:0/1834111394 learned_addr learned my addr 172.21.15.2:0/1834111394 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:03:36.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.027+0000 7fdb70f07640 1 --2- 172.21.15.2:0/1834111394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb6c0fe4c0 0x7fdb6c0fb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:36.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.027+0000 7fdb71708640 1 -- 172.21.15.2:0/1834111394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb6c0fe4c0 msgr2=0x7fdb6c0fb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:36.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.027+0000 7fdb71708640 1 --2- 172.21.15.2:0/1834111394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb6c0fe4c0 0x7fdb6c0fb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.027+0000 7fdb71708640 1 -- 172.21.15.2:0/1834111394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c005040 con 0x7fdb6c0fdb70 2024-09-17T01:03:36.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.027+0000 7fdb70f07640 1 --2- 172.21.15.2:0/1834111394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb6c0fe4c0 0x7fdb6c0fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:03:36.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.027+0000 7fdb71708640 1 --2- 172.21.15.2:0/1834111394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c0fdb70 0x7fdb6c0fd360 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdb68002a80 tx=0x7fdb68004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:36.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.027+0000 7fdb61ffb640 1 -- 172.21.15.2:0/1834111394 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb68007c30 con 0x7fdb6c0fdb70 2024-09-17T01:03:36.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.028+0000 7fdb7396c640 1 -- 172.21.15.2:0/1834111394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c0fc200 con 0x7fdb6c0fdb70 2024-09-17T01:03:36.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.028+0000 7fdb61ffb640 1 -- 172.21.15.2:0/1834111394 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdb6800f040 con 0x7fdb6c0fdb70 2024-09-17T01:03:36.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.028+0000 7fdb61ffb640 1 -- 172.21.15.2:0/1834111394 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb68009530 con 0x7fdb6c0fdb70 2024-09-17T01:03:36.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.028+0000 7fdb7396c640 1 -- 172.21.15.2:0/1834111394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c115100 con 0x7fdb6c0fdb70 2024-09-17T01:03:36.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.029+0000 7fdb61ffb640 1 -- 172.21.15.2:0/1834111394 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 30) v1 ==== 92373+0+0 (secure 0 0 0) 0x7fdb68009690 con 0x7fdb6c0fdb70 2024-09-17T01:03:36.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.029+0000 7fdb7396c640 1 -- 172.21.15.2:0/1834111394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c0fa010 con 0x7fdb6c0fdb70 2024-09-17T01:03:36.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.030+0000 7fdb61ffb640 1 --2- 172.21.15.2:0/1834111394 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fdb5806df60 0x7fdb58070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:36.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.030+0000 7fdb61ffb640 1 -- 172.21.15.2:0/1834111394 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fdb6808d3b0 con 0x7fdb6c0fdb70 2024-09-17T01:03:36.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.030+0000 7fdb70f07640 1 --2- 172.21.15.2:0/1834111394 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fdb5806df60 0x7fdb58070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:36.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.030+0000 7fdb70f07640 1 --2- 172.21.15.2:0/1834111394 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fdb5806df60 0x7fdb58070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c007ac0 tx=0x7fdb5c035040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:36.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.034+0000 7fdb61ffb640 1 -- 172.21.15.2:0/1834111394 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fdb68056b50 con 0x7fdb6c0fdb70 2024-09-17T01:03:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.235+0000 7fdb7396c640 1 -- 172.21.15.2:0/1834111394 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb6c101d60 con 0x7fdb5806df60 2024-09-17T01:03:36.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.236+0000 7fdb61ffb640 1 -- 172.21.15.2:0/1834111394 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fdb6c101d60 con 0x7fdb5806df60 2024-09-17T01:03:36.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.238+0000 7fdb7396c640 1 -- 172.21.15.2:0/1834111394 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fdb5806df60 msgr2=0x7fdb58070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:36.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.238+0000 7fdb7396c640 1 --2- 172.21.15.2:0/1834111394 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fdb5806df60 0x7fdb58070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c007ac0 tx=0x7fdb5c035040 comp rx=0 tx=0).stop 2024-09-17T01:03:36.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.238+0000 7fdb7396c640 1 -- 172.21.15.2:0/1834111394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c0fdb70 msgr2=0x7fdb6c0fd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:36.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.238+0000 7fdb7396c640 1 --2- 172.21.15.2:0/1834111394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c0fdb70 0x7fdb6c0fd360 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdb68002a80 tx=0x7fdb68004600 comp rx=0 tx=0).stop 2024-09-17T01:03:36.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.238+0000 7fdb7396c640 1 -- 172.21.15.2:0/1834111394 shutdown_connections 2024-09-17T01:03:36.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.238+0000 7fdb7396c640 1 --2- 172.21.15.2:0/1834111394 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fdb5806df60 0x7fdb58070410 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.238+0000 7fdb7396c640 1 --2- 172.21.15.2:0/1834111394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb6c0fe4c0 0x7fdb6c0fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.238+0000 7fdb7396c640 1 --2- 172.21.15.2:0/1834111394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb6c0fdb70 0x7fdb6c0fd360 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.238+0000 7fdb7396c640 1 -- 172.21.15.2:0/1834111394 >> 172.21.15.2:0/1834111394 conn(0x7fdb6c0f6390 msgr2=0x7fdb6c0f7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:36.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.238+0000 7fdb7396c640 1 -- 172.21.15.2:0/1834111394 shutdown_connections 2024-09-17T01:03:36.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.239+0000 7fdb7396c640 1 -- 172.21.15.2:0/1834111394 wait complete. 2024-09-17T01:03:36.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.319+0000 7f4cfc104640 1 -- 172.21.15.2:0/4020889905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf40fc560 msgr2=0x7f4cf40fc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:36.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.319+0000 7f4cfc104640 1 --2- 172.21.15.2:0/4020889905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf40fc560 0x7f4cf40fc970 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00048d0 tx=0x7f4cf0009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.319+0000 7f4cfc104640 1 -- 172.21.15.2:0/4020889905 shutdown_connections 2024-09-17T01:03:36.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.319+0000 7f4cfc104640 1 --2- 172.21.15.2:0/4020889905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf40fd830 0x7f4cf40fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.319+0000 7f4cfc104640 1 --2- 172.21.15.2:0/4020889905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf40fc560 0x7f4cf40fc970 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.319+0000 7f4cfc104640 1 -- 172.21.15.2:0/4020889905 >> 172.21.15.2:0/4020889905 conn(0x7f4cf40f7d40 msgr2=0x7f4cf40fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:36.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.320+0000 7f4cfc104640 1 -- 172.21.15.2:0/4020889905 shutdown_connections 2024-09-17T01:03:36.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.320+0000 7f4cfc104640 1 -- 172.21.15.2:0/4020889905 wait complete. 2024-09-17T01:03:36.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.320+0000 7f4cfc104640 1 Processor -- start 2024-09-17T01:03:36.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.320+0000 7f4cfc104640 1 -- start start 2024-09-17T01:03:36.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cfc104640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf40fc560 0x7f4cf4071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:36.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cfc104640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf40fd830 0x7f4cf406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:36.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cfc104640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf4070080 con 0x7f4cf40fc560 2024-09-17T01:03:36.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cfc104640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40701c0 con 0x7f4cf40fd830 2024-09-17T01:03:36.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cf9ea0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf40fc560 0x7f4cf4071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:36.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cf9ea0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf40fc560 0x7f4cf4071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44044/0 (socket says 172.21.15.2:44044) 2024-09-17T01:03:36.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cf9ea0640 1 -- 172.21.15.2:0/2337742950 learned_addr learned my addr 172.21.15.2:0/2337742950 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:03:36.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cf969f640 1 --2- 172.21.15.2:0/2337742950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf40fd830 0x7f4cf406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:36.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cf9ea0640 1 -- 172.21.15.2:0/2337742950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf40fd830 msgr2=0x7f4cf406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:36.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cf9ea0640 1 --2- 172.21.15.2:0/2337742950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf40fd830 0x7f4cf406fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cf9ea0640 1 -- 172.21.15.2:0/2337742950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf0005040 con 0x7f4cf40fc560 2024-09-17T01:03:36.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cf9ea0640 1 --2- 172.21.15.2:0/2337742950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf40fc560 0x7f4cf4071570 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0003080 tx=0x7f4cf0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:36.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cea7fc640 1 -- 172.21.15.2:0/2337742950 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cf0038070 con 0x7f4cf40fc560 2024-09-17T01:03:36.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cea7fc640 1 -- 172.21.15.2:0/2337742950 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4cf002abd0 con 0x7f4cf40fc560 2024-09-17T01:03:36.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cfc104640 1 -- 172.21.15.2:0/2337742950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf4070440 con 0x7f4cf40fc560 2024-09-17T01:03:36.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.321+0000 7f4cea7fc640 1 -- 172.21.15.2:0/2337742950 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cf003e670 con 0x7f4cf40fc560 2024-09-17T01:03:36.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.322+0000 7f4cfc104640 1 -- 172.21.15.2:0/2337742950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf4115110 con 0x7f4cf40fc560 2024-09-17T01:03:36.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.322+0000 7f4cfc104640 1 -- 172.21.15.2:0/2337742950 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf40fb9c0 con 0x7f4cf40fc560 2024-09-17T01:03:36.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.323+0000 7f4cea7fc640 1 -- 172.21.15.2:0/2337742950 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 30) v1 ==== 92373+0+0 (secure 0 0 0) 0x7f4cf0030020 con 0x7f4cf40fc560 2024-09-17T01:03:36.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.324+0000 7f4cea7fc640 1 --2- 172.21.15.2:0/2337742950 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f4ce006df60 0x7f4ce0070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:36.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.324+0000 7f4cea7fc640 1 -- 172.21.15.2:0/2337742950 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f4cf00add10 con 0x7f4cf40fc560 2024-09-17T01:03:36.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.324+0000 7f4cf969f640 1 --2- 172.21.15.2:0/2337742950 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f4ce006df60 0x7f4ce0070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:36.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.324+0000 7f4cf969f640 1 --2- 172.21.15.2:0/2337742950 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f4ce006df60 0x7f4ce0070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4009b50 tx=0x7f4ce4009120 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:36.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.328+0000 7f4cea7fc640 1 -- 172.21.15.2:0/2337742950 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f4cf00775f0 con 0x7f4cf40fc560 2024-09-17T01:03:36.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.513+0000 7f4cfc104640 1 -- 172.21.15.2:0/2337742950 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cf4101c00 con 0x7f4ce006df60 2024-09-17T01:03:36.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.523+0000 7f4cea7fc640 1 -- 172.21.15.2:0/2337742950 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4cf4101c00 con 0x7f4ce006df60 2024-09-17T01:03:36.521 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:03:36.521 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (38s) 1s ago 9m 17.7M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:03:36.521 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (9m) 1s ago 9m 6903k - 17.2.7-1635-g4a704134 f22ead590bad 53b003b1ad6f 2024-09-17T01:03:36.521 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (8m) 4s ago 8m 6891k - 17.2.7-1635-g4a704134 f22ead590bad 6ec40439e9b5 2024-09-17T01:03:36.521 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (31s) 1s ago 9m 77.7M - 9.4.7 954c08fa6188 7044e03a743b 2024-09-17T01:03:36.521 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (4m) 1s ago 4m 125M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:03:36.522 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (4m) 1s ago 4m 65.4M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:03:36.522 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (4m) 4s ago 4m 64.7M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:03:36.522 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (4m) 4s ago 4m 115M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:03:36.522 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (17s) 1s ago 10m 474M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:03:36.522 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283 running (93s) 4s ago 8m 126M - 19.1.1-330-gc2ddf972 ebb0615149de 8ad174f204d2 2024-09-17T01:03:36.522 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (10m) 1s ago 10m 53.6M 2048M 17.2.7-1635-g4a704134 f22ead590bad 08b932b41bfa 2024-09-17T01:03:36.522 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (8m) 4s ago 8m 44.7M 2048M 17.2.7-1635-g4a704134 f22ead590bad 1c9583d52c94 2024-09-17T01:03:36.522 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (55s) 1s ago 9m 8182k - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:03:36.522 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (23s) 4s ago 8m 8010k - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:03:36.522 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (7m) 1s ago 7m 224M 1558M 17.2.7-1635-g4a704134 f22ead590bad 720f74f40752 2024-09-17T01:03:36.522 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (7m) 1s ago 7m 243M 1558M 17.2.7-1635-g4a704134 f22ead590bad 629defddb38c 2024-09-17T01:03:36.522 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (6m) 1s ago 6m 196M 1558M 17.2.7-1635-g4a704134 f22ead590bad 5dff1cf9fc56 2024-09-17T01:03:36.523 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (6m) 4s ago 6m 269M 2581M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:03:36.523 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (6m) 4s ago 6m 238M 2581M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:03:36.523 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (5m) 4s ago 5m 220M 2581M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:03:36.523 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (25s) 1s ago 9m 41.9M - 2.43.0 a07b618ecd1d 530ed3903cfa 2024-09-17T01:03:36.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.525+0000 7f4cfc104640 1 -- 172.21.15.2:0/2337742950 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f4ce006df60 msgr2=0x7f4ce0070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.525+0000 7f4cfc104640 1 --2- 172.21.15.2:0/2337742950 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f4ce006df60 0x7f4ce0070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4009b50 tx=0x7f4ce4009120 comp rx=0 tx=0).stop 2024-09-17T01:03:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.525+0000 7f4cfc104640 1 -- 172.21.15.2:0/2337742950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf40fc560 msgr2=0x7f4cf4071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.525+0000 7f4cfc104640 1 --2- 172.21.15.2:0/2337742950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf40fc560 0x7f4cf4071570 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0003080 tx=0x7f4cf0009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.525+0000 7f4cfc104640 1 -- 172.21.15.2:0/2337742950 shutdown_connections 2024-09-17T01:03:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.525+0000 7f4cfc104640 1 --2- 172.21.15.2:0/2337742950 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f4ce006df60 0x7f4ce0070410 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.525+0000 7f4cfc104640 1 --2- 172.21.15.2:0/2337742950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cf40fd830 0x7f4cf406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.525+0000 7f4cfc104640 1 --2- 172.21.15.2:0/2337742950 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf40fc560 0x7f4cf4071570 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.525+0000 7f4cfc104640 1 -- 172.21.15.2:0/2337742950 >> 172.21.15.2:0/2337742950 conn(0x7f4cf40f7d40 msgr2=0x7f4cf40f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.525+0000 7f4cfc104640 1 -- 172.21.15.2:0/2337742950 shutdown_connections 2024-09-17T01:03:36.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.525+0000 7f4cfc104640 1 -- 172.21.15.2:0/2337742950 wait complete. 2024-09-17T01:03:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.606+0000 7fe0845d9640 1 -- 172.21.15.2:0/1526758226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe07c0fc700 msgr2=0x7fe07c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.606+0000 7fe0845d9640 1 --2- 172.21.15.2:0/1526758226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe07c0fc700 0x7fe07c0fcb70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0048d0 tx=0x7fe06c009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.604 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:36 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:36.604 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:36 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:36.604 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:36 smithi002 ceph-mon[27650]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.606+0000 7fe0845d9640 1 -- 172.21.15.2:0/1526758226 shutdown_connections 2024-09-17T01:03:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.606+0000 7fe0845d9640 1 --2- 172.21.15.2:0/1526758226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe07c0fc700 0x7fe07c0fcb70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.606+0000 7fe0845d9640 1 --2- 172.21.15.2:0/1526758226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe07c0fb430 0x7fe07c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.606+0000 7fe0845d9640 1 -- 172.21.15.2:0/1526758226 >> 172.21.15.2:0/1526758226 conn(0x7fe07c0f6c10 msgr2=0x7fe07c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.606+0000 7fe0845d9640 1 -- 172.21.15.2:0/1526758226 shutdown_connections 2024-09-17T01:03:36.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.606+0000 7fe0845d9640 1 -- 172.21.15.2:0/1526758226 wait complete. 2024-09-17T01:03:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.606+0000 7fe0845d9640 1 Processor -- start 2024-09-17T01:03:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.606+0000 7fe0845d9640 1 -- start start 2024-09-17T01:03:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.607+0000 7fe0845d9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe07c0fb430 0x7fe07c10fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.607+0000 7fe0845d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe07c0fc700 0x7fe07c1122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.607+0000 7fe0845d9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c065c80 con 0x7fe07c0fc700 2024-09-17T01:03:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.607+0000 7fe0845d9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c065df0 con 0x7fe07c0fb430 2024-09-17T01:03:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.607+0000 7fe081b74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe07c0fc700 0x7fe07c1122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.607+0000 7fe081b74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe07c0fc700 0x7fe07c1122b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44068/0 (socket says 172.21.15.2:44068) 2024-09-17T01:03:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.607+0000 7fe081b74640 1 -- 172.21.15.2:0/4255045797 learned_addr learned my addr 172.21.15.2:0/4255045797 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:03:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.607+0000 7fe082375640 1 --2- 172.21.15.2:0/4255045797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe07c0fb430 0x7fe07c10fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.607+0000 7fe081b74640 1 -- 172.21.15.2:0/4255045797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe07c0fb430 msgr2=0x7fe07c10fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.607+0000 7fe081b74640 1 --2- 172.21.15.2:0/4255045797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe07c0fb430 0x7fe07c10fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.607+0000 7fe081b74640 1 -- 172.21.15.2:0/4255045797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c005040 con 0x7fe07c0fc700 2024-09-17T01:03:36.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.607+0000 7fe081b74640 1 --2- 172.21.15.2:0/4255045797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe07c0fc700 0x7fe07c1122b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe06c003080 tx=0x7fe06c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:36.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.608+0000 7fe072ffd640 1 -- 172.21.15.2:0/4255045797 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06c038070 con 0x7fe07c0fc700 2024-09-17T01:03:36.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.608+0000 7fe072ffd640 1 -- 172.21.15.2:0/4255045797 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe06c02abd0 con 0x7fe07c0fc700 2024-09-17T01:03:36.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.608+0000 7fe0845d9640 1 -- 172.21.15.2:0/4255045797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c1127f0 con 0x7fe07c0fc700 2024-09-17T01:03:36.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.608+0000 7fe072ffd640 1 -- 172.21.15.2:0/4255045797 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06c03e670 con 0x7fe07c0fc700 2024-09-17T01:03:36.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.608+0000 7fe0845d9640 1 -- 172.21.15.2:0/4255045797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c112d90 con 0x7fe07c0fc700 2024-09-17T01:03:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.609+0000 7fe0845d9640 1 -- 172.21.15.2:0/4255045797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07c0fa890 con 0x7fe07c0fc700 2024-09-17T01:03:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.609+0000 7fe072ffd640 1 -- 172.21.15.2:0/4255045797 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 30) v1 ==== 92373+0+0 (secure 0 0 0) 0x7fe06c030020 con 0x7fe07c0fc700 2024-09-17T01:03:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.610+0000 7fe072ffd640 1 --2- 172.21.15.2:0/4255045797 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fe06806df60 0x7fe068070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.610+0000 7fe072ffd640 1 -- 172.21.15.2:0/4255045797 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fe06c0adc80 con 0x7fe07c0fc700 2024-09-17T01:03:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.610+0000 7fe082375640 1 --2- 172.21.15.2:0/4255045797 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fe06806df60 0x7fe068070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:36.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.610+0000 7fe082375640 1 --2- 172.21.15.2:0/4255045797 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fe06806df60 0x7fe068070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe0780041d0 tx=0x7fe078004330 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:36.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.615+0000 7fe072ffd640 1 -- 172.21.15.2:0/4255045797 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe06c0775e0 con 0x7fe07c0fc700 2024-09-17T01:03:36.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:36 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:36.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:36 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:36.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:36 smithi099 ceph-mon[34357]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:36.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.857+0000 7fe0845d9640 1 -- 172.21.15.2:0/4255045797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe07c103e30 con 0x7fe07c0fc700 2024-09-17T01:03:36.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.857+0000 7fe072ffd640 1 -- 172.21.15.2:0/4255045797 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fe06c07aca0 con 0x7fe07c0fc700 2024-09-17T01:03:36.856 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:03:36.856 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:03:36.856 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T01:03:36.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:03:36.856 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:03:36.856 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:03:36.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:03:36.857 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:03:36.857 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T01:03:36.857 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:03:36.857 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:03:36.857 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:03:36.857 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:03:36.857 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:03:36.857 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 12, 2024-09-17T01:03:36.857 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:03:36.857 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:03:36.857 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:03:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.859+0000 7fe0845d9640 1 -- 172.21.15.2:0/4255045797 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fe06806df60 msgr2=0x7fe068070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.859+0000 7fe0845d9640 1 --2- 172.21.15.2:0/4255045797 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fe06806df60 0x7fe068070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe0780041d0 tx=0x7fe078004330 comp rx=0 tx=0).stop 2024-09-17T01:03:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.859+0000 7fe0845d9640 1 -- 172.21.15.2:0/4255045797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe07c0fc700 msgr2=0x7fe07c1122b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.859+0000 7fe0845d9640 1 --2- 172.21.15.2:0/4255045797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe07c0fc700 0x7fe07c1122b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe06c003080 tx=0x7fe06c009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.859+0000 7fe0845d9640 1 -- 172.21.15.2:0/4255045797 shutdown_connections 2024-09-17T01:03:36.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.859+0000 7fe0845d9640 1 --2- 172.21.15.2:0/4255045797 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fe06806df60 0x7fe068070410 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.859+0000 7fe0845d9640 1 --2- 172.21.15.2:0/4255045797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe07c0fc700 0x7fe07c1122b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.859+0000 7fe0845d9640 1 --2- 172.21.15.2:0/4255045797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe07c0fb430 0x7fe07c10fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.859+0000 7fe0845d9640 1 -- 172.21.15.2:0/4255045797 >> 172.21.15.2:0/4255045797 conn(0x7fe07c0f6c10 msgr2=0x7fe07c0f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.860+0000 7fe0845d9640 1 -- 172.21.15.2:0/4255045797 shutdown_connections 2024-09-17T01:03:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.860+0000 7fe0845d9640 1 -- 172.21.15.2:0/4255045797 wait complete. 2024-09-17T01:03:36.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.941+0000 7f362735f640 1 -- 172.21.15.2:0/1308261224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36200fc550 msgr2=0x7f36200fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.941+0000 7f362735f640 1 --2- 172.21.15.2:0/1308261224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36200fc550 0x7f36200fc960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f361c0048d0 tx=0x7f361c009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.941+0000 7f362735f640 1 -- 172.21.15.2:0/1308261224 shutdown_connections 2024-09-17T01:03:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.941+0000 7f362735f640 1 --2- 172.21.15.2:0/1308261224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36200fd820 0x7f36200fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.941+0000 7f362735f640 1 --2- 172.21.15.2:0/1308261224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36200fc550 0x7f36200fc960 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.941+0000 7f362735f640 1 -- 172.21.15.2:0/1308261224 >> 172.21.15.2:0/1308261224 conn(0x7f36200f7d30 msgr2=0x7f36200fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.941+0000 7f362735f640 1 -- 172.21.15.2:0/1308261224 shutdown_connections 2024-09-17T01:03:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.941+0000 7f362735f640 1 -- 172.21.15.2:0/1308261224 wait complete. 2024-09-17T01:03:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.942+0000 7f362735f640 1 Processor -- start 2024-09-17T01:03:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.942+0000 7f362735f640 1 -- start start 2024-09-17T01:03:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.942+0000 7f362735f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36200fc550 0x7f3620071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.942+0000 7f362735f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36200fd820 0x7f362006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.942+0000 7f362735f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3620070080 con 0x7f36200fc550 2024-09-17T01:03:36.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.942+0000 7f362735f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36200701c0 con 0x7f36200fd820 2024-09-17T01:03:36.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.942+0000 7f36250fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36200fc550 0x7f3620071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:36.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.942+0000 7f36250fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36200fc550 0x7f3620071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44096/0 (socket says 172.21.15.2:44096) 2024-09-17T01:03:36.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.942+0000 7f36250fb640 1 -- 172.21.15.2:0/2500911989 learned_addr learned my addr 172.21.15.2:0/2500911989 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:03:36.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.942+0000 7f36250fb640 1 -- 172.21.15.2:0/2500911989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36200fd820 msgr2=0x7f362006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:36.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.942+0000 7f36250fb640 1 --2- 172.21.15.2:0/2500911989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36200fd820 0x7f362006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:36.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.942+0000 7f36250fb640 1 -- 172.21.15.2:0/2500911989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c005040 con 0x7f36200fc550 2024-09-17T01:03:36.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.943+0000 7f36250fb640 1 --2- 172.21.15.2:0/2500911989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36200fc550 0x7f3620071570 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f361c003080 tx=0x7f361c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:36.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.943+0000 7f3615ffb640 1 -- 172.21.15.2:0/2500911989 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361c038070 con 0x7f36200fc550 2024-09-17T01:03:36.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.943+0000 7f3615ffb640 1 -- 172.21.15.2:0/2500911989 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f361c02abd0 con 0x7f36200fc550 2024-09-17T01:03:36.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.943+0000 7f362735f640 1 -- 172.21.15.2:0/2500911989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3620070440 con 0x7f36200fc550 2024-09-17T01:03:36.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.943+0000 7f3615ffb640 1 -- 172.21.15.2:0/2500911989 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f361c03e670 con 0x7f36200fc550 2024-09-17T01:03:36.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.943+0000 7f362735f640 1 -- 172.21.15.2:0/2500911989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3620115180 con 0x7f36200fc550 2024-09-17T01:03:36.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.944+0000 7f362735f640 1 -- 172.21.15.2:0/2500911989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36200fb9b0 con 0x7f36200fc550 2024-09-17T01:03:36.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.944+0000 7f3615ffb640 1 -- 172.21.15.2:0/2500911989 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 30) v1 ==== 92373+0+0 (secure 0 0 0) 0x7f361c030020 con 0x7f36200fc550 2024-09-17T01:03:36.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.945+0000 7f3615ffb640 1 --2- 172.21.15.2:0/2500911989 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f360c06df60 0x7f360c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:03:36.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.945+0000 7f3615ffb640 1 -- 172.21.15.2:0/2500911989 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f361c0add90 con 0x7f36200fc550 2024-09-17T01:03:36.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.945+0000 7f36248fa640 1 --2- 172.21.15.2:0/2500911989 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f360c06df60 0x7f360c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:03:36.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.945+0000 7f36248fa640 1 --2- 172.21.15.2:0/2500911989 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f360c06df60 0x7f360c070410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f36100097e0 tx=0x7f3610006d20 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:03:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:36.949+0000 7f3615ffb640 1 -- 172.21.15.2:0/2500911989 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f361c0775e0 con 0x7f36200fc550 2024-09-17T01:03:37.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:37.142+0000 7f362735f640 1 -- 172.21.15.2:0/2500911989 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3620101c80 con 0x7f360c06df60 2024-09-17T01:03:37.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:37.144+0000 7f3615ffb640 1 -- 172.21.15.2:0/2500911989 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f3620101c80 con 0x7f360c06df60 2024-09-17T01:03:37.142 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:03:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:03:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:03:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-17T01:03:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-17T01:03:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr" 2024-09-17T01:03:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-17T01:03:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "2/2 daemons upgraded", 2024-09-17T01:03:37.142 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "", 2024-09-17T01:03:37.143 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:03:37.143 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:03:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:37.146+0000 7f362735f640 1 -- 172.21.15.2:0/2500911989 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f360c06df60 msgr2=0x7f360c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:37.146+0000 7f362735f640 1 --2- 172.21.15.2:0/2500911989 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f360c06df60 0x7f360c070410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f36100097e0 tx=0x7f3610006d20 comp rx=0 tx=0).stop 2024-09-17T01:03:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:37.146+0000 7f362735f640 1 -- 172.21.15.2:0/2500911989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36200fc550 msgr2=0x7f3620071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:03:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:37.146+0000 7f362735f640 1 --2- 172.21.15.2:0/2500911989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36200fc550 0x7f3620071570 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f361c003080 tx=0x7f361c009da0 comp rx=0 tx=0).stop 2024-09-17T01:03:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:37.146+0000 7f362735f640 1 -- 172.21.15.2:0/2500911989 shutdown_connections 2024-09-17T01:03:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:37.146+0000 7f362735f640 1 --2- 172.21.15.2:0/2500911989 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f360c06df60 0x7f360c070410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:37.146+0000 7f362735f640 1 --2- 172.21.15.2:0/2500911989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36200fd820 0x7f362006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:37.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:37.146+0000 7f362735f640 1 --2- 172.21.15.2:0/2500911989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36200fc550 0x7f3620071570 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:03:37.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:37.146+0000 7f362735f640 1 -- 172.21.15.2:0/2500911989 >> 172.21.15.2:0/2500911989 conn(0x7f36200f7d30 msgr2=0x7f36200f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:03:37.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:37.146+0000 7f362735f640 1 -- 172.21.15.2:0/2500911989 shutdown_connections 2024-09-17T01:03:37.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:03:37.146+0000 7f362735f640 1 -- 172.21.15.2:0/2500911989 wait complete. 2024-09-17T01:03:37.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:37 smithi099 ceph-mon[34357]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:37.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:37 smithi099 ceph-mon[34357]: pgmap v7: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-17T01:03:37.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:37 smithi099 ceph-mon[34357]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:37.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:37 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/4255045797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:37 smithi002 ceph-mon[27650]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:37 smithi002 ceph-mon[27650]: pgmap v7: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-17T01:03:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:37 smithi002 ceph-mon[27650]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:37 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/4255045797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:38.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:38 smithi099 ceph-mon[34357]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:38.899 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:38 smithi002 ceph-mon[27650]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:03:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:39 smithi099 ceph-mon[34357]: pgmap v8: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-17T01:03:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:39 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:39 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:39 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:39 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:03:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:39 smithi099 ceph-mon[34357]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-17T01:03:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:39 smithi099 ceph-mon[34357]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-17T01:03:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:39 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:40.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:39 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:40.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:39 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:40.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:39 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:40.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:39 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:40.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:39 smithi002 ceph-mon[27650]: pgmap v8: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-17T01:03:40.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:39 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:40.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:39 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:40.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:39 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:40.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:39 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:03:40.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:39 smithi002 ceph-mon[27650]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-17T01:03:40.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:39 smithi002 ceph-mon[27650]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-17T01:03:40.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:39 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:40.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:39 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:40.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:39 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:40.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:39 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:40.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:39 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:41.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:40 smithi099 ceph-mon[34357]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:03:41.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:40 smithi099 ceph-mon[34357]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:03:41.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:40 smithi099 ceph-mon[34357]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:03:41.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:40 smithi099 ceph-mon[34357]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:03:41.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:40 smithi099 ceph-mon[34357]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:03:41.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:40 smithi099 ceph-mon[34357]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:03:41.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:40 smithi099 ceph-mon[34357]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2024-09-17T01:03:41.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:40 smithi002 ceph-mon[27650]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:03:41.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:40 smithi002 ceph-mon[27650]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:03:41.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:40 smithi002 ceph-mon[27650]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:03:41.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:40 smithi002 ceph-mon[27650]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:03:41.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:40 smithi002 ceph-mon[27650]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:03:41.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:40 smithi002 ceph-mon[27650]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:03:41.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:40 smithi002 ceph-mon[27650]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2024-09-17T01:03:42.011 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:41 smithi002 ceph-mon[27650]: Reconfiguring daemon prometheus.smithi002 on smithi002 2024-09-17T01:03:42.011 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:41 smithi002 ceph-mon[27650]: pgmap v9: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-17T01:03:42.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:41 smithi099 ceph-mon[34357]: Reconfiguring daemon prometheus.smithi002 on smithi002 2024-09-17T01:03:42.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:41 smithi099 ceph-mon[34357]: pgmap v9: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-17T01:03:44.132 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:43 smithi002 ceph-mon[27650]: pgmap v10: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T01:03:44.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:43 smithi099 ceph-mon[34357]: pgmap v10: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T01:03:45.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:44 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:45.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:44 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:46.076 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:45 smithi099 ceph-mon[34357]: pgmap v11: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T01:03:46.076 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:45 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:46.076 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:45 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:46.076 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:45 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:03:46.076 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:45 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:46.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:45 smithi002 ceph-mon[27650]: pgmap v11: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-17T01:03:46.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:45 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:46.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:45 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:46.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:45 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:03:46.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:45 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:47.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:46 smithi099 ceph-mon[34357]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:03:47.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:46 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.vswzrb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:03:47.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:46 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:03:47.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:46 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:47.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:46 smithi002 ceph-mon[27650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:03:47.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:46 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.vswzrb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:03:47.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:46 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:03:47.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:46 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:48.261 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:47 smithi099 ceph-mon[34357]: pgmap v12: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-17T01:03:48.261 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:47 smithi099 ceph-mon[34357]: Upgrade: Updating mgr.smithi099.vswzrb 2024-09-17T01:03:48.261 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:47 smithi099 ceph-mon[34357]: Deploying daemon mgr.smithi099.vswzrb on smithi099 2024-09-17T01:03:48.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:47 smithi002 ceph-mon[27650]: pgmap v12: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-17T01:03:48.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:47 smithi002 ceph-mon[27650]: Upgrade: Updating mgr.smithi099.vswzrb 2024-09-17T01:03:48.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:47 smithi002 ceph-mon[27650]: Deploying daemon mgr.smithi099.vswzrb on smithi099 2024-09-17T01:03:50.092 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:49 smithi099 ceph-mon[34357]: pgmap v13: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:03:50.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:49 smithi002 ceph-mon[27650]: pgmap v13: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:03:51.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:51 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:51.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:51 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:51.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:51 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:51.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:51 smithi099 ceph-mon[34357]: pgmap v14: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:03:51.794 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:51 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:51.794 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:51 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:51.794 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:51 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:51.794 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:51 smithi002 ceph-mon[27650]: pgmap v14: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:03:53.686 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:53 smithi099 ceph-mon[34357]: pgmap v15: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:03:53.686 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:53 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:53.686 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:53 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:53.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:53 smithi002 ceph-mon[27650]: pgmap v15: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:03:53.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:53 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:53.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:53 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:55.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:55 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:55.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:55 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:55.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:55 smithi002 ceph-mon[27650]: pgmap v16: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:03:55.229 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:55 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:55.229 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:55 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:55.229 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:55 smithi099 ceph-mon[34357]: pgmap v16: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:03:56.592 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:56 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:56.592 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:56 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:56.593 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:56 smithi002 ceph-mon[27650]: Standby manager daemon smithi099.vswzrb restarted 2024-09-17T01:03:56.593 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:56 smithi002 ceph-mon[27650]: Standby manager daemon smithi099.vswzrb started 2024-09-17T01:03:56.593 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:56 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/841288434' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/crt"}]: dispatch 2024-09-17T01:03:56.593 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:56 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/841288434' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:03:56.593 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:56 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/841288434' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/key"}]: dispatch 2024-09-17T01:03:56.593 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:56 smithi002 ceph-mon[27650]: from='mgr.? 172.21.15.99:0/841288434' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:03:56.597 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:56 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:56.598 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:56 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:56.598 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:56 smithi099 ceph-mon[34357]: Standby manager daemon smithi099.vswzrb restarted 2024-09-17T01:03:56.598 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:56 smithi099 ceph-mon[34357]: Standby manager daemon smithi099.vswzrb started 2024-09-17T01:03:56.598 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:56 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/841288434' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/crt"}]: dispatch 2024-09-17T01:03:56.598 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:56 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/841288434' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:03:56.598 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:56 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/841288434' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/key"}]: dispatch 2024-09-17T01:03:56.598 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:56 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/841288434' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:03:57.545 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:57 smithi099 ceph-mon[34357]: mgrmap e31: smithi002.vjeexr(active, since 27s), standbys: smithi099.vswzrb 2024-09-17T01:03:57.545 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:57 smithi099 ceph-mon[34357]: pgmap v17: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:03:57.545 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:57 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:57.545 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:57 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:57.545 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:57 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:57.546 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:57 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:03:57.546 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:57 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:57.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:57 smithi002 ceph-mon[27650]: mgrmap e31: smithi002.vjeexr(active, since 27s), standbys: smithi099.vswzrb 2024-09-17T01:03:57.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:57 smithi002 ceph-mon[27650]: pgmap v17: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:03:57.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:57 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:57.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:57 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:57.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:57 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:03:57.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:57 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:03:57.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:57 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:58.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: Upgrade: Setting container_image for all mgr 2024-09-17T01:03:58.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi002.vjeexr"}]: dispatch 2024-09-17T01:03:58.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi002.vjeexr"}]': finished 2024-09-17T01:03:58.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi099.vswzrb"}]: dispatch 2024-09-17T01:03:58.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi099.vswzrb"}]': finished 2024-09-17T01:03:58.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: Upgrade: Setting container_image for all rgw 2024-09-17T01:03:58.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T01:03:58.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-17T01:03:58.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T01:03:58.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: Upgrade: Setting container_image for all iscsi 2024-09-17T01:03:58.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: Upgrade: Setting container_image for all nfs 2024-09-17T01:03:58.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.408 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.408 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: Upgrade: Setting container_image for all nvmeof 2024-09-17T01:03:58.408 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.408 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.408 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: Upgrade: Setting container_image for all node-exporter 2024-09-17T01:03:58.408 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.408 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: Upgrade: Setting container_image for all prometheus 2024-09-17T01:03:58.408 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.408 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:58 smithi002 ceph-mon[27650]: Upgrade: Setting container_image for all alertmanager 2024-09-17T01:03:58.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:03:58.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: Upgrade: Setting container_image for all mgr 2024-09-17T01:03:58.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi002.vjeexr"}]: dispatch 2024-09-17T01:03:58.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi002.vjeexr"}]': finished 2024-09-17T01:03:58.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi099.vswzrb"}]: dispatch 2024-09-17T01:03:58.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi099.vswzrb"}]': finished 2024-09-17T01:03:58.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: Upgrade: Setting container_image for all rgw 2024-09-17T01:03:58.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T01:03:58.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-17T01:03:58.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T01:03:58.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: Upgrade: Setting container_image for all iscsi 2024-09-17T01:03:58.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: Upgrade: Setting container_image for all nfs 2024-09-17T01:03:58.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: Upgrade: Setting container_image for all nvmeof 2024-09-17T01:03:58.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:03:58.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: Upgrade: Setting container_image for all node-exporter 2024-09-17T01:03:58.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: Upgrade: Setting container_image for all prometheus 2024-09-17T01:03:58.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:03:58.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:58 smithi099 ceph-mon[34357]: Upgrade: Setting container_image for all alertmanager 2024-09-17T01:03:59.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:59 smithi002 ceph-mon[27650]: pgmap v18: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:03:59.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:59 smithi002 ceph-mon[27650]: Upgrade: Updating grafana.smithi002 2024-09-17T01:03:59.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:59 smithi002 ceph-mon[27650]: Deploying daemon grafana.smithi002 on smithi002 2024-09-17T01:03:59.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:03:59 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:03:59.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:59 smithi099 ceph-mon[34357]: pgmap v18: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:03:59.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:59 smithi099 ceph-mon[34357]: Upgrade: Updating grafana.smithi002 2024-09-17T01:03:59.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:59 smithi099 ceph-mon[34357]: Deploying daemon grafana.smithi002 on smithi002 2024-09-17T01:03:59.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:03:59 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:01.895 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:01 smithi002 ceph-mon[27650]: pgmap v19: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:04:02.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:01 smithi099 ceph-mon[34357]: pgmap v19: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:04:03.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:03 smithi002 ceph-mon[27650]: pgmap v20: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:04:04.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:03 smithi099 ceph-mon[34357]: pgmap v20: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:04:05.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:05 smithi002 ceph-mon[27650]: pgmap v21: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:04:06.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:05 smithi099 ceph-mon[34357]: pgmap v21: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:04:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.238+0000 7f6c0ae82640 1 -- 172.21.15.2:0/3529885575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fb470 msgr2=0x7f6c040fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:07.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.238+0000 7f6c0ae82640 1 --2- 172.21.15.2:0/3529885575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fb470 0x7f6c040fb880 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0048d0 tx=0x7f6bec009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.238+0000 7f6c0ae82640 1 -- 172.21.15.2:0/3529885575 shutdown_connections 2024-09-17T01:04:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.238+0000 7f6c0ae82640 1 --2- 172.21.15.2:0/3529885575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c040fc740 0x7f6c040fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.238+0000 7f6c0ae82640 1 --2- 172.21.15.2:0/3529885575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fb470 0x7f6c040fb880 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.238+0000 7f6c0ae82640 1 -- 172.21.15.2:0/3529885575 >> 172.21.15.2:0/3529885575 conn(0x7f6c040f6c10 msgr2=0x7f6c040f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.238+0000 7f6c0ae82640 1 -- 172.21.15.2:0/3529885575 shutdown_connections 2024-09-17T01:04:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.238+0000 7f6c0ae82640 1 -- 172.21.15.2:0/3529885575 wait complete. 2024-09-17T01:04:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.239+0000 7f6c0ae82640 1 Processor -- start 2024-09-17T01:04:07.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.239+0000 7f6c0ae82640 1 -- start start 2024-09-17T01:04:07.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.239+0000 7f6c0ae82640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c040fb470 0x7f6c04066620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.239+0000 7f6c0ae82640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc740 0x7f6c04111e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.239+0000 7f6c0ae82640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c04112540 con 0x7f6c040fc740 2024-09-17T01:04:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.239+0000 7f6c0ae82640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c04112680 con 0x7f6c040fb470 2024-09-17T01:04:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.240+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc740 0x7f6c04111e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.240+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc740 0x7f6c04111e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35910/0 (socket says 172.21.15.2:35910) 2024-09-17T01:04:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.240+0000 7f6c03fff640 1 -- 172.21.15.2:0/4123679439 learned_addr learned my addr 172.21.15.2:0/4123679439 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:04:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.240+0000 7f6c08c1e640 1 --2- 172.21.15.2:0/4123679439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c040fb470 0x7f6c04066620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.240+0000 7f6c03fff640 1 -- 172.21.15.2:0/4123679439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c040fb470 msgr2=0x7f6c04066620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.240+0000 7f6c03fff640 1 --2- 172.21.15.2:0/4123679439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c040fb470 0x7f6c04066620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.240+0000 7f6c03fff640 1 -- 172.21.15.2:0/4123679439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec005040 con 0x7f6c040fc740 2024-09-17T01:04:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.240+0000 7f6c03fff640 1 --2- 172.21.15.2:0/4123679439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc740 0x7f6c04111e80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400b790 tx=0x7f6bf40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.240+0000 7f6c017fa640 1 -- 172.21.15.2:0/4123679439 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf400c700 con 0x7f6c040fc740 2024-09-17T01:04:07.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.240+0000 7f6c017fa640 1 -- 172.21.15.2:0/4123679439 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6bf400cd00 con 0x7f6c040fc740 2024-09-17T01:04:07.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.240+0000 7f6c0ae82640 1 -- 172.21.15.2:0/4123679439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c04112960 con 0x7f6c040fc740 2024-09-17T01:04:07.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.240+0000 7f6c017fa640 1 -- 172.21.15.2:0/4123679439 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bf4015e80 con 0x7f6c040fc740 2024-09-17T01:04:07.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.240+0000 7f6c0ae82640 1 -- 172.21.15.2:0/4123679439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c04112e80 con 0x7f6c040fc740 2024-09-17T01:04:07.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.242+0000 7f6c0ae82640 1 -- 172.21.15.2:0/4123679439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c040fa8d0 con 0x7f6c040fc740 2024-09-17T01:04:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.242+0000 7f6c017fa640 1 -- 172.21.15.2:0/4123679439 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92373+0+0 (secure 0 0 0) 0x7f6bf4012070 con 0x7f6c040fc740 2024-09-17T01:04:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.243+0000 7f6c017fa640 1 --2- 172.21.15.2:0/4123679439 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f6bf006df60 0x7f6bf0070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.243+0000 7f6c017fa640 1 -- 172.21.15.2:0/4123679439 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f6bf408d2a0 con 0x7f6c040fc740 2024-09-17T01:04:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.243+0000 7f6c08c1e640 1 --2- 172.21.15.2:0/4123679439 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f6bf006df60 0x7f6bf0070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.243+0000 7f6c08c1e640 1 --2- 172.21.15.2:0/4123679439 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f6bf006df60 0x7f6bf0070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6bec000c00 tx=0x7f6bec035040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:07.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.247+0000 7f6c017fa640 1 -- 172.21.15.2:0/4123679439 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f6bf4056ad0 con 0x7f6c040fc740 2024-09-17T01:04:07.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.438+0000 7f6c0ae82640 1 -- 172.21.15.2:0/4123679439 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c04100b50 con 0x7f6bf006df60 2024-09-17T01:04:07.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.439+0000 7f6c017fa640 1 -- 172.21.15.2:0/4123679439 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f6c04100b50 con 0x7f6bf006df60 2024-09-17T01:04:07.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.441+0000 7f6c0ae82640 1 -- 172.21.15.2:0/4123679439 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f6bf006df60 msgr2=0x7f6bf0070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:07.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.441+0000 7f6c0ae82640 1 --2- 172.21.15.2:0/4123679439 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f6bf006df60 0x7f6bf0070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6bec000c00 tx=0x7f6bec035040 comp rx=0 tx=0).stop 2024-09-17T01:04:07.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.441+0000 7f6c0ae82640 1 -- 172.21.15.2:0/4123679439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc740 msgr2=0x7f6c04111e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:07.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.441+0000 7f6c0ae82640 1 --2- 172.21.15.2:0/4123679439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc740 0x7f6c04111e80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400b790 tx=0x7f6bf40091d0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.441+0000 7f6c0ae82640 1 -- 172.21.15.2:0/4123679439 shutdown_connections 2024-09-17T01:04:07.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.441+0000 7f6c0ae82640 1 --2- 172.21.15.2:0/4123679439 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f6bf006df60 0x7f6bf0070410 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.442+0000 7f6c0ae82640 1 --2- 172.21.15.2:0/4123679439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc740 0x7f6c04111e80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.442+0000 7f6c0ae82640 1 --2- 172.21.15.2:0/4123679439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c040fb470 0x7f6c04066620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.442+0000 7f6c0ae82640 1 -- 172.21.15.2:0/4123679439 >> 172.21.15.2:0/4123679439 conn(0x7f6c040f6c10 msgr2=0x7f6c040f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:07.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.442+0000 7f6c0ae82640 1 -- 172.21.15.2:0/4123679439 shutdown_connections 2024-09-17T01:04:07.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.442+0000 7f6c0ae82640 1 -- 172.21.15.2:0/4123679439 wait complete. 2024-09-17T01:04:07.448 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:04:07.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.523+0000 7f8205793640 1 -- 172.21.15.2:0/1894959666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82000fdba0 msgr2=0x7f82000fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:07.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.523+0000 7f8205793640 1 --2- 172.21.15.2:0/1894959666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82000fdba0 0x7f82000fdfb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f81f00048d0 tx=0x7f81f0009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.523+0000 7f8205793640 1 -- 172.21.15.2:0/1894959666 shutdown_connections 2024-09-17T01:04:07.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.523+0000 7f8205793640 1 --2- 172.21.15.2:0/1894959666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82000fe4f0 0x7f82000fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.523+0000 7f8205793640 1 --2- 172.21.15.2:0/1894959666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82000fdba0 0x7f82000fdfb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.523+0000 7f8205793640 1 -- 172.21.15.2:0/1894959666 >> 172.21.15.2:0/1894959666 conn(0x7f82000f63a0 msgr2=0x7f82000f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:07.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.523+0000 7f8205793640 1 -- 172.21.15.2:0/1894959666 shutdown_connections 2024-09-17T01:04:07.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.523+0000 7f8205793640 1 -- 172.21.15.2:0/1894959666 wait complete. 2024-09-17T01:04:07.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.524+0000 7f8205793640 1 Processor -- start 2024-09-17T01:04:07.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.524+0000 7f8205793640 1 -- start start 2024-09-17T01:04:07.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.524+0000 7f8205793640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82000fdba0 0x7f82000fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:07.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.524+0000 7f8205793640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82000fe4f0 0x7f82000fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:07.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.524+0000 7f8205793640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000fbe10 con 0x7f82000fe4f0 2024-09-17T01:04:07.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.524+0000 7f8205793640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000fbf50 con 0x7f82000fdba0 2024-09-17T01:04:07.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.524+0000 7f81fe7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82000fe4f0 0x7f82000fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:07.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.524+0000 7f81fe7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82000fe4f0 0x7f82000fb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35926/0 (socket says 172.21.15.2:35926) 2024-09-17T01:04:07.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.524+0000 7f81fe7fc640 1 -- 172.21.15.2:0/898656047 learned_addr learned my addr 172.21.15.2:0/898656047 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:04:07.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.524+0000 7f81feffd640 1 --2- 172.21.15.2:0/898656047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82000fdba0 0x7f82000fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:07.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.525+0000 7f81fe7fc640 1 -- 172.21.15.2:0/898656047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82000fdba0 msgr2=0x7f82000fd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:07.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.525+0000 7f81fe7fc640 1 --2- 172.21.15.2:0/898656047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82000fdba0 0x7f82000fd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.525+0000 7f81fe7fc640 1 -- 172.21.15.2:0/898656047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f0005040 con 0x7f82000fe4f0 2024-09-17T01:04:07.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.525+0000 7f81fe7fc640 1 --2- 172.21.15.2:0/898656047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82000fe4f0 0x7f82000fb880 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f81f4002870 tx=0x7f81f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:07.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.525+0000 7f81e77fe640 1 -- 172.21.15.2:0/898656047 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81f4007c30 con 0x7f82000fe4f0 2024-09-17T01:04:07.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.525+0000 7f8205793640 1 -- 172.21.15.2:0/898656047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82000fc230 con 0x7f82000fe4f0 2024-09-17T01:04:07.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.525+0000 7f81e77fe640 1 -- 172.21.15.2:0/898656047 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f81f400f040 con 0x7f82000fe4f0 2024-09-17T01:04:07.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.525+0000 7f81e77fe640 1 -- 172.21.15.2:0/898656047 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81f400da70 con 0x7f82000fe4f0 2024-09-17T01:04:07.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.525+0000 7f8205793640 1 -- 172.21.15.2:0/898656047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82001150e0 con 0x7f82000fe4f0 2024-09-17T01:04:07.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.526+0000 7f8205793640 1 -- 172.21.15.2:0/898656047 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82000fa040 con 0x7f82000fe4f0 2024-09-17T01:04:07.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.526+0000 7f81e77fe640 1 -- 172.21.15.2:0/898656047 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92373+0+0 (secure 0 0 0) 0x7f81f400dbd0 con 0x7f82000fe4f0 2024-09-17T01:04:07.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.527+0000 7f81e77fe640 1 --2- 172.21.15.2:0/898656047 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f81e806df60 0x7f81e8070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:07.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.527+0000 7f81e77fe640 1 -- 172.21.15.2:0/898656047 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f81f408d1b0 con 0x7f82000fe4f0 2024-09-17T01:04:07.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.527+0000 7f81feffd640 1 --2- 172.21.15.2:0/898656047 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f81e806df60 0x7f81e8070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:07.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.527+0000 7f81feffd640 1 --2- 172.21.15.2:0/898656047 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f81e806df60 0x7f81e8070410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f81f0000c00 tx=0x7f81f0035040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:07.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.531+0000 7f81e77fe640 1 -- 172.21.15.2:0/898656047 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f81f4056980 con 0x7f82000fe4f0 2024-09-17T01:04:07.704 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:07 smithi002 ceph-mon[27650]: pgmap v22: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:04:07.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.738+0000 7f8205793640 1 -- 172.21.15.2:0/898656047 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8200101d80 con 0x7f81e806df60 2024-09-17T01:04:07.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.739+0000 7f81e77fe640 1 -- 172.21.15.2:0/898656047 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f8200101d80 con 0x7f81e806df60 2024-09-17T01:04:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.741+0000 7f8205793640 1 -- 172.21.15.2:0/898656047 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f81e806df60 msgr2=0x7f81e8070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.741+0000 7f8205793640 1 --2- 172.21.15.2:0/898656047 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f81e806df60 0x7f81e8070410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f81f0000c00 tx=0x7f81f0035040 comp rx=0 tx=0).stop 2024-09-17T01:04:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.741+0000 7f8205793640 1 -- 172.21.15.2:0/898656047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82000fe4f0 msgr2=0x7f82000fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.741+0000 7f8205793640 1 --2- 172.21.15.2:0/898656047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82000fe4f0 0x7f82000fb880 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f81f4002870 tx=0x7f81f4004600 comp rx=0 tx=0).stop 2024-09-17T01:04:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.741+0000 7f8205793640 1 -- 172.21.15.2:0/898656047 shutdown_connections 2024-09-17T01:04:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.742+0000 7f8205793640 1 --2- 172.21.15.2:0/898656047 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f81e806df60 0x7f81e8070410 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.742+0000 7f8205793640 1 --2- 172.21.15.2:0/898656047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82000fe4f0 0x7f82000fb880 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.742+0000 7f8205793640 1 --2- 172.21.15.2:0/898656047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82000fdba0 0x7f82000fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.742+0000 7f8205793640 1 -- 172.21.15.2:0/898656047 >> 172.21.15.2:0/898656047 conn(0x7f82000f63a0 msgr2=0x7f82000f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:07.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.742+0000 7f8205793640 1 -- 172.21.15.2:0/898656047 shutdown_connections 2024-09-17T01:04:07.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.742+0000 7f8205793640 1 -- 172.21.15.2:0/898656047 wait complete. 2024-09-17T01:04:07.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.823+0000 7f435383e640 1 -- 172.21.15.2:0/1951925721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0ff720 msgr2=0x7f434c101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:07.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.823+0000 7f435383e640 1 --2- 172.21.15.2:0/1951925721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0ff720 0x7f434c101b00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f433c0048d0 tx=0x7f433c009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.823+0000 7f435383e640 1 -- 172.21.15.2:0/1951925721 shutdown_connections 2024-09-17T01:04:07.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.823+0000 7f435383e640 1 --2- 172.21.15.2:0/1951925721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0ff720 0x7f434c101b00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.823+0000 7f435383e640 1 --2- 172.21.15.2:0/1951925721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f434c065ba0 0x7f434c0ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.823+0000 7f435383e640 1 -- 172.21.15.2:0/1951925721 >> 172.21.15.2:0/1951925721 conn(0x7f434c0f6c10 msgr2=0x7f434c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:07.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.824+0000 7f435383e640 1 -- 172.21.15.2:0/1951925721 shutdown_connections 2024-09-17T01:04:07.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.824+0000 7f435383e640 1 -- 172.21.15.2:0/1951925721 wait complete. 2024-09-17T01:04:07.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.824+0000 7f435383e640 1 Processor -- start 2024-09-17T01:04:07.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.824+0000 7f435383e640 1 -- start start 2024-09-17T01:04:07.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.824+0000 7f435383e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f434c065ba0 0x7f434c10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:07.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.824+0000 7f435383e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0ff720 0x7f434c10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:07.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.824+0000 7f435383e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c10dc30 con 0x7f434c0ff720 2024-09-17T01:04:07.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.824+0000 7f435383e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c10e450 con 0x7f434c065ba0 2024-09-17T01:04:07.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.824+0000 7f4350dd9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0ff720 0x7f434c10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:07.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.825+0000 7f4350dd9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0ff720 0x7f434c10d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35942/0 (socket says 172.21.15.2:35942) 2024-09-17T01:04:07.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.825+0000 7f4350dd9640 1 -- 172.21.15.2:0/3304871952 learned_addr learned my addr 172.21.15.2:0/3304871952 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:04:07.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.825+0000 7f43515da640 1 --2- 172.21.15.2:0/3304871952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f434c065ba0 0x7f434c10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:07.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.825+0000 7f4350dd9640 1 -- 172.21.15.2:0/3304871952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f434c065ba0 msgr2=0x7f434c10d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:07.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.825+0000 7f4350dd9640 1 --2- 172.21.15.2:0/3304871952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f434c065ba0 0x7f434c10d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:07.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.825+0000 7f4350dd9640 1 -- 172.21.15.2:0/3304871952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c005040 con 0x7f434c0ff720 2024-09-17T01:04:07.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.825+0000 7f4350dd9640 1 --2- 172.21.15.2:0/3304871952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0ff720 0x7f434c10d5e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f433c0043d0 tx=0x7f433c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:07.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.825+0000 7f4341ffb640 1 -- 172.21.15.2:0/3304871952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f433c038070 con 0x7f434c0ff720 2024-09-17T01:04:07.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.825+0000 7f435383e640 1 -- 172.21.15.2:0/3304871952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434c10e680 con 0x7f434c0ff720 2024-09-17T01:04:07.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.825+0000 7f4341ffb640 1 -- 172.21.15.2:0/3304871952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f433c02ae90 con 0x7f434c0ff720 2024-09-17T01:04:07.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.825+0000 7f4341ffb640 1 -- 172.21.15.2:0/3304871952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f433c03e670 con 0x7f434c0ff720 2024-09-17T01:04:07.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.825+0000 7f435383e640 1 -- 172.21.15.2:0/3304871952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434c10ec20 con 0x7f434c0ff720 2024-09-17T01:04:07.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.827+0000 7f435383e640 1 -- 172.21.15.2:0/3304871952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434c0fa890 con 0x7f434c0ff720 2024-09-17T01:04:07.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.827+0000 7f4341ffb640 1 -- 172.21.15.2:0/3304871952 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92373+0+0 (secure 0 0 0) 0x7f433c030020 con 0x7f434c0ff720 2024-09-17T01:04:07.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.827+0000 7f4341ffb640 1 --2- 172.21.15.2:0/3304871952 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f433806df60 0x7f4338070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:07.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.828+0000 7f4341ffb640 1 -- 172.21.15.2:0/3304871952 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f433c0adab0 con 0x7f434c0ff720 2024-09-17T01:04:07.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.828+0000 7f43515da640 1 --2- 172.21.15.2:0/3304871952 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f433806df60 0x7f4338070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:07.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.828+0000 7f43515da640 1 --2- 172.21.15.2:0/3304871952 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f433806df60 0x7f4338070410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f434c065900 tx=0x7f434800b040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:07.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:07.832+0000 7f4341ffb640 1 -- 172.21.15.2:0/3304871952 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f433c0afe60 con 0x7f434c0ff720 2024-09-17T01:04:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.017+0000 7f435383e640 1 -- 172.21.15.2:0/3304871952 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f434c10efa0 con 0x7f433806df60 2024-09-17T01:04:08.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.026+0000 7f4341ffb640 1 -- 172.21.15.2:0/3304871952 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f434c10efa0 con 0x7f433806df60 2024-09-17T01:04:08.025 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:04:08.025 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (69s) 12s ago 9m 17.7M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:04:08.025 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (10m) 12s ago 10m 6903k - 17.2.7-1635-g4a704134 f22ead590bad 53b003b1ad6f 2024-09-17T01:04:08.026 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (9m) 14s ago 9m 6891k - 17.2.7-1635-g4a704134 f22ead590bad 6ec40439e9b5 2024-09-17T01:04:08.026 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (63s) 12s ago 9m 77.8M - 9.4.7 954c08fa6188 7044e03a743b 2024-09-17T01:04:08.026 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (4m) 12s ago 4m 125M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:04:08.026 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (4m) 12s ago 4m 65.3M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:04:08.026 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (4m) 14s ago 4m 64.7M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:04:08.026 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (4m) 14s ago 4m 115M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:04:08.026 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (49s) 12s ago 11m 493M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:04:08.026 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (18s) 14s ago 9m 70.9M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:04:08.026 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (11m) 12s ago 11m 53.9M 2048M 17.2.7-1635-g4a704134 f22ead590bad 08b932b41bfa 2024-09-17T01:04:08.026 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (9m) 14s ago 9m 43.7M 2048M 17.2.7-1635-g4a704134 f22ead590bad 1c9583d52c94 2024-09-17T01:04:08.026 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (86s) 12s ago 10m 7977k - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:04:08.026 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (54s) 14s ago 9m 8258k - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:04:08.027 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (8m) 12s ago 8m 224M 1558M 17.2.7-1635-g4a704134 f22ead590bad 720f74f40752 2024-09-17T01:04:08.027 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (7m) 12s ago 7m 243M 1558M 17.2.7-1635-g4a704134 f22ead590bad 629defddb38c 2024-09-17T01:04:08.027 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (7m) 12s ago 7m 196M 1558M 17.2.7-1635-g4a704134 f22ead590bad 5dff1cf9fc56 2024-09-17T01:04:08.027 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (7m) 14s ago 7m 270M 2581M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:04:08.027 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (6m) 14s ago 6m 238M 2581M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:04:08.027 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (6m) 14s ago 6m 220M 2581M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:04:08.027 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (23s) 12s ago 9m 43.2M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:04:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.028+0000 7f435383e640 1 -- 172.21.15.2:0/3304871952 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f433806df60 msgr2=0x7f4338070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.028+0000 7f435383e640 1 --2- 172.21.15.2:0/3304871952 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f433806df60 0x7f4338070410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f434c065900 tx=0x7f434800b040 comp rx=0 tx=0).stop 2024-09-17T01:04:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.028+0000 7f435383e640 1 -- 172.21.15.2:0/3304871952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0ff720 msgr2=0x7f434c10d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.028+0000 7f435383e640 1 --2- 172.21.15.2:0/3304871952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0ff720 0x7f434c10d5e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f433c0043d0 tx=0x7f433c009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.028+0000 7f435383e640 1 -- 172.21.15.2:0/3304871952 shutdown_connections 2024-09-17T01:04:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.028+0000 7f435383e640 1 --2- 172.21.15.2:0/3304871952 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f433806df60 0x7f4338070410 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.028+0000 7f435383e640 1 --2- 172.21.15.2:0/3304871952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0ff720 0x7f434c10d5e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.028+0000 7f435383e640 1 --2- 172.21.15.2:0/3304871952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f434c065ba0 0x7f434c10d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.028+0000 7f435383e640 1 -- 172.21.15.2:0/3304871952 >> 172.21.15.2:0/3304871952 conn(0x7f434c0f6c10 msgr2=0x7f434c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.029+0000 7f435383e640 1 -- 172.21.15.2:0/3304871952 shutdown_connections 2024-09-17T01:04:08.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.029+0000 7f435383e640 1 -- 172.21.15.2:0/3304871952 wait complete. 2024-09-17T01:04:08.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:07 smithi099 ceph-mon[34357]: pgmap v22: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:04:08.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.108+0000 7f1f4416e640 1 -- 172.21.15.2:0/4055183342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f3c0fc520 msgr2=0x7f1f3c0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:08.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.108+0000 7f1f4416e640 1 --2- 172.21.15.2:0/4055183342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f3c0fc520 0x7f1f3c0fc930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1f380048d0 tx=0x7f1f38009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.109+0000 7f1f4416e640 1 -- 172.21.15.2:0/4055183342 shutdown_connections 2024-09-17T01:04:08.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.109+0000 7f1f4416e640 1 --2- 172.21.15.2:0/4055183342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f3c0fd7f0 0x7f1f3c0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.109+0000 7f1f4416e640 1 --2- 172.21.15.2:0/4055183342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f3c0fc520 0x7f1f3c0fc930 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.109+0000 7f1f4416e640 1 -- 172.21.15.2:0/4055183342 >> 172.21.15.2:0/4055183342 conn(0x7f1f3c0f7ce0 msgr2=0x7f1f3c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:08.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.109+0000 7f1f4416e640 1 -- 172.21.15.2:0/4055183342 shutdown_connections 2024-09-17T01:04:08.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.109+0000 7f1f4416e640 1 -- 172.21.15.2:0/4055183342 wait complete. 2024-09-17T01:04:08.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.109+0000 7f1f4416e640 1 Processor -- start 2024-09-17T01:04:08.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.109+0000 7f1f4416e640 1 -- start start 2024-09-17T01:04:08.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.109+0000 7f1f4416e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f3c0fc520 0x7f1f3c10f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:08.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.109+0000 7f1f4416e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f3c0fd7f0 0x7f1f3c10f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:08.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.109+0000 7f1f4416e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c10fe40 con 0x7f1f3c0fc520 2024-09-17T01:04:08.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.109+0000 7f1f4416e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c110660 con 0x7f1f3c0fd7f0 2024-09-17T01:04:08.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.110+0000 7f1f41f0a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f3c0fc520 0x7f1f3c10f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:08.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.110+0000 7f1f41f0a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f3c0fc520 0x7f1f3c10f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35964/0 (socket says 172.21.15.2:35964) 2024-09-17T01:04:08.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.110+0000 7f1f41f0a640 1 -- 172.21.15.2:0/3012069935 learned_addr learned my addr 172.21.15.2:0/3012069935 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:04:08.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.110+0000 7f1f41709640 1 --2- 172.21.15.2:0/3012069935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f3c0fd7f0 0x7f1f3c10f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:08.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.110+0000 7f1f41f0a640 1 -- 172.21.15.2:0/3012069935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f3c0fd7f0 msgr2=0x7f1f3c10f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:08.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.110+0000 7f1f41f0a640 1 --2- 172.21.15.2:0/3012069935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f3c0fd7f0 0x7f1f3c10f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.110+0000 7f1f41f0a640 1 -- 172.21.15.2:0/3012069935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f38005040 con 0x7f1f3c0fc520 2024-09-17T01:04:08.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.110+0000 7f1f41f0a640 1 --2- 172.21.15.2:0/3012069935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f3c0fc520 0x7f1f3c10f2b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1f380043d0 tx=0x7f1f38009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:08.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.110+0000 7f1f327fc640 1 -- 172.21.15.2:0/3012069935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f38038070 con 0x7f1f3c0fc520 2024-09-17T01:04:08.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.110+0000 7f1f4416e640 1 -- 172.21.15.2:0/3012069935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3c110890 con 0x7f1f3c0fc520 2024-09-17T01:04:08.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.110+0000 7f1f327fc640 1 -- 172.21.15.2:0/3012069935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1f3802ae90 con 0x7f1f3c0fc520 2024-09-17T01:04:08.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.110+0000 7f1f327fc640 1 -- 172.21.15.2:0/3012069935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f3803e670 con 0x7f1f3c0fc520 2024-09-17T01:04:08.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.110+0000 7f1f4416e640 1 -- 172.21.15.2:0/3012069935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c110e30 con 0x7f1f3c0fc520 2024-09-17T01:04:08.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.111+0000 7f1f4416e640 1 -- 172.21.15.2:0/3012069935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c0fb980 con 0x7f1f3c0fc520 2024-09-17T01:04:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.112+0000 7f1f327fc640 1 -- 172.21.15.2:0/3012069935 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92373+0+0 (secure 0 0 0) 0x7f1f38030020 con 0x7f1f3c0fc520 2024-09-17T01:04:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.112+0000 7f1f327fc640 1 --2- 172.21.15.2:0/3012069935 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f1f2806df60 0x7f1f28070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.113+0000 7f1f327fc640 1 -- 172.21.15.2:0/3012069935 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f1f380adb50 con 0x7f1f3c0fc520 2024-09-17T01:04:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.113+0000 7f1f41709640 1 --2- 172.21.15.2:0/3012069935 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f1f2806df60 0x7f1f28070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:08.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.113+0000 7f1f41709640 1 --2- 172.21.15.2:0/3012069935 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f1f2806df60 0x7f1f28070410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c10f060 tx=0x7f1f2c00b040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:08.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.117+0000 7f1f327fc640 1 -- 172.21.15.2:0/3012069935 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f1f38077430 con 0x7f1f3c0fc520 2024-09-17T01:04:08.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.364+0000 7f1f4416e640 1 -- 172.21.15.2:0/3012069935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1f3c111110 con 0x7f1f3c0fc520 2024-09-17T01:04:08.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.365+0000 7f1f327fc640 1 -- 172.21.15.2:0/3012069935 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f1f3807aaf0 con 0x7f1f3c0fc520 2024-09-17T01:04:08.363 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:04:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:04:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T01:04:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:04:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:04:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:04:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:04:08.363 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:04:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T01:04:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:04:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:04:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:04:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:04:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:04:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 12, 2024-09-17T01:04:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:04:08.364 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:04:08.364 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:04:08.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.367+0000 7f1f4416e640 1 -- 172.21.15.2:0/3012069935 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f1f2806df60 msgr2=0x7f1f28070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:08.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.367+0000 7f1f4416e640 1 --2- 172.21.15.2:0/3012069935 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f1f2806df60 0x7f1f28070410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c10f060 tx=0x7f1f2c00b040 comp rx=0 tx=0).stop 2024-09-17T01:04:08.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.367+0000 7f1f4416e640 1 -- 172.21.15.2:0/3012069935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f3c0fc520 msgr2=0x7f1f3c10f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:08.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.367+0000 7f1f4416e640 1 --2- 172.21.15.2:0/3012069935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f3c0fc520 0x7f1f3c10f2b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1f380043d0 tx=0x7f1f38009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.367+0000 7f1f4416e640 1 -- 172.21.15.2:0/3012069935 shutdown_connections 2024-09-17T01:04:08.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.367+0000 7f1f4416e640 1 --2- 172.21.15.2:0/3012069935 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f1f2806df60 0x7f1f28070410 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.367+0000 7f1f4416e640 1 --2- 172.21.15.2:0/3012069935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f3c0fd7f0 0x7f1f3c10f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.367+0000 7f1f4416e640 1 --2- 172.21.15.2:0/3012069935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f3c0fc520 0x7f1f3c10f2b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.367+0000 7f1f4416e640 1 -- 172.21.15.2:0/3012069935 >> 172.21.15.2:0/3012069935 conn(0x7f1f3c0f7ce0 msgr2=0x7f1f3c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:08.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.367+0000 7f1f4416e640 1 -- 172.21.15.2:0/3012069935 shutdown_connections 2024-09-17T01:04:08.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.368+0000 7f1f4416e640 1 -- 172.21.15.2:0/3012069935 wait complete. 2024-09-17T01:04:08.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.449+0000 7fcf92b30640 1 -- 172.21.15.2:0/2288199115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf8c0fb480 msgr2=0x7fcf8c0fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:08.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.449+0000 7fcf92b30640 1 --2- 172.21.15.2:0/2288199115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf8c0fb480 0x7fcf8c0fb890 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0048d0 tx=0x7fcf7c009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.449+0000 7fcf92b30640 1 -- 172.21.15.2:0/2288199115 shutdown_connections 2024-09-17T01:04:08.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.449+0000 7fcf92b30640 1 --2- 172.21.15.2:0/2288199115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf8c0fc750 0x7fcf8c0fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.449+0000 7fcf92b30640 1 --2- 172.21.15.2:0/2288199115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf8c0fb480 0x7fcf8c0fb890 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.449+0000 7fcf92b30640 1 -- 172.21.15.2:0/2288199115 >> 172.21.15.2:0/2288199115 conn(0x7fcf8c0f6c40 msgr2=0x7fcf8c0f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:08.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.449+0000 7fcf92b30640 1 -- 172.21.15.2:0/2288199115 shutdown_connections 2024-09-17T01:04:08.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.449+0000 7fcf92b30640 1 -- 172.21.15.2:0/2288199115 wait complete. 2024-09-17T01:04:08.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.449+0000 7fcf92b30640 1 Processor -- start 2024-09-17T01:04:08.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.449+0000 7fcf92b30640 1 -- start start 2024-09-17T01:04:08.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.450+0000 7fcf92b30640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf8c0fb480 0x7fcf8c10fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.450+0000 7fcf92b30640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf8c0fc750 0x7fcf8c1123f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.450+0000 7fcf92b30640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c0667c0 con 0x7fcf8c0fc750 2024-09-17T01:04:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.450+0000 7fcf92b30640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c066930 con 0x7fcf8c0fb480 2024-09-17T01:04:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.450+0000 7fcf8bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf8c0fc750 0x7fcf8c1123f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.450+0000 7fcf8bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf8c0fc750 0x7fcf8c1123f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35988/0 (socket says 172.21.15.2:35988) 2024-09-17T01:04:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.450+0000 7fcf8bfff640 1 -- 172.21.15.2:0/4251827936 learned_addr learned my addr 172.21.15.2:0/4251827936 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:04:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.450+0000 7fcf8bfff640 1 -- 172.21.15.2:0/4251827936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf8c0fb480 msgr2=0x7fcf8c10fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.450+0000 7fcf908cc640 1 --2- 172.21.15.2:0/4251827936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf8c0fb480 0x7fcf8c10fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.450+0000 7fcf8bfff640 1 --2- 172.21.15.2:0/4251827936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf8c0fb480 0x7fcf8c10fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.450+0000 7fcf8bfff640 1 -- 172.21.15.2:0/4251827936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c005040 con 0x7fcf8c0fc750 2024-09-17T01:04:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.450+0000 7fcf8bfff640 1 --2- 172.21.15.2:0/4251827936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf8c0fc750 0x7fcf8c1123f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400b790 tx=0x7fcf740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.451+0000 7fcf897fa640 1 -- 172.21.15.2:0/4251827936 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf7400c700 con 0x7fcf8c0fc750 2024-09-17T01:04:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.451+0000 7fcf897fa640 1 -- 172.21.15.2:0/4251827936 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf7400cd00 con 0x7fcf8c0fc750 2024-09-17T01:04:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.451+0000 7fcf92b30640 1 -- 172.21.15.2:0/4251827936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8c1129f0 con 0x7fcf8c0fc750 2024-09-17T01:04:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.451+0000 7fcf897fa640 1 -- 172.21.15.2:0/4251827936 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf74015e80 con 0x7fcf8c0fc750 2024-09-17T01:04:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.451+0000 7fcf92b30640 1 -- 172.21.15.2:0/4251827936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8c112f10 con 0x7fcf8c0fc750 2024-09-17T01:04:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.452+0000 7fcf92b30640 1 -- 172.21.15.2:0/4251827936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8c0fa8e0 con 0x7fcf8c0fc750 2024-09-17T01:04:08.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.452+0000 7fcf897fa640 1 -- 172.21.15.2:0/4251827936 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92373+0+0 (secure 0 0 0) 0x7fcf74012070 con 0x7fcf8c0fc750 2024-09-17T01:04:08.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.453+0000 7fcf897fa640 1 --2- 172.21.15.2:0/4251827936 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fcf7806df60 0x7fcf78070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:08.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.453+0000 7fcf897fa640 1 -- 172.21.15.2:0/4251827936 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fcf7408d350 con 0x7fcf8c0fc750 2024-09-17T01:04:08.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.453+0000 7fcf908cc640 1 --2- 172.21.15.2:0/4251827936 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fcf7806df60 0x7fcf78070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:08.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.453+0000 7fcf908cc640 1 --2- 172.21.15.2:0/4251827936 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fcf7806df60 0x7fcf78070410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00b020 tx=0x7fcf7c009da0 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:08.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.457+0000 7fcf897fa640 1 -- 172.21.15.2:0/4251827936 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fcf74056b80 con 0x7fcf8c0fc750 2024-09-17T01:04:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.651+0000 7fcf92b30640 1 -- 172.21.15.2:0/4251827936 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf8c100b40 con 0x7fcf7806df60 2024-09-17T01:04:08.650 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:08 smithi002 ceph-mon[27650]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:08.650 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:08 smithi002 ceph-mon[27650]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:08.650 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:08 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3012069935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.652+0000 7fcf897fa640 1 -- 172.21.15.2:0/4251827936 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fcf8c100b40 con 0x7fcf7806df60 2024-09-17T01:04:08.651 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:04:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:04:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:04:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-17T01:04:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-17T01:04:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr" 2024-09-17T01:04:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-17T01:04:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "2/2 daemons upgraded", 2024-09-17T01:04:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading grafana daemons", 2024-09-17T01:04:08.651 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:04:08.651 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:04:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.655+0000 7fcf92b30640 1 -- 172.21.15.2:0/4251827936 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fcf7806df60 msgr2=0x7fcf78070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.655+0000 7fcf92b30640 1 --2- 172.21.15.2:0/4251827936 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fcf7806df60 0x7fcf78070410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00b020 tx=0x7fcf7c009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.655+0000 7fcf92b30640 1 -- 172.21.15.2:0/4251827936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf8c0fc750 msgr2=0x7fcf8c1123f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.655+0000 7fcf92b30640 1 --2- 172.21.15.2:0/4251827936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf8c0fc750 0x7fcf8c1123f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400b790 tx=0x7fcf740091d0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.655+0000 7fcf92b30640 1 -- 172.21.15.2:0/4251827936 shutdown_connections 2024-09-17T01:04:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.655+0000 7fcf92b30640 1 --2- 172.21.15.2:0/4251827936 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fcf7806df60 0x7fcf78070410 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.655+0000 7fcf92b30640 1 --2- 172.21.15.2:0/4251827936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcf8c0fc750 0x7fcf8c1123f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.655+0000 7fcf92b30640 1 --2- 172.21.15.2:0/4251827936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf8c0fb480 0x7fcf8c10fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.655+0000 7fcf92b30640 1 -- 172.21.15.2:0/4251827936 >> 172.21.15.2:0/4251827936 conn(0x7fcf8c0f6c40 msgr2=0x7fcf8c0f8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.655+0000 7fcf92b30640 1 -- 172.21.15.2:0/4251827936 shutdown_connections 2024-09-17T01:04:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:08.655+0000 7fcf92b30640 1 -- 172.21.15.2:0/4251827936 wait complete. 2024-09-17T01:04:09.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:08 smithi099 ceph-mon[34357]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:09.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:08 smithi099 ceph-mon[34357]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:09.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:08 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3012069935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:09.644 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:09 smithi002 ceph-mon[27650]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:09.644 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:09 smithi002 ceph-mon[27650]: pgmap v23: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:09.644 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:09 smithi002 ceph-mon[27650]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:10.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:09 smithi099 ceph-mon[34357]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:10.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:09 smithi099 ceph-mon[34357]: pgmap v23: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:10.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:09 smithi099 ceph-mon[34357]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:11.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:11 smithi002 ceph-mon[27650]: pgmap v24: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:11.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:11 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:11.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:11 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:11.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:11 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:12.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:11 smithi099 ceph-mon[34357]: pgmap v24: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:12.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:11 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:12.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:11 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:12.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:11 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:13.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:13 smithi002 ceph-mon[27650]: pgmap v25: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:14.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:13 smithi099 ceph-mon[34357]: pgmap v25: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:14.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:14 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:15.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:14 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:15.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:15 smithi002 ceph-mon[27650]: pgmap v26: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:16.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:15 smithi099 ceph-mon[34357]: pgmap v26: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:17.336 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:17 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:17.336 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:17 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:17.337 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:17 smithi002 ceph-mon[27650]: pgmap v27: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:17.337 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:17 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:17.337 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:17 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:17.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:17 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:17.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:17 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:17.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:17 smithi099 ceph-mon[34357]: pgmap v27: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:17.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:17 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:17.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:17 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:19.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:19 smithi002 ceph-mon[27650]: pgmap v28: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:20.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:19 smithi099 ceph-mon[34357]: pgmap v28: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:21.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:21.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:21.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:21.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:21.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:21.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:04:21.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:04:21.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:21.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: Upgrade: Finalizing container_image settings 2024-09-17T01:04:21.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:21.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-17T01:04:21.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-17T01:04:21.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-17T01:04:21.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-17T01:04:21.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-17T01:04:21.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-17T01:04:21.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-17T01:04:21.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-17T01:04:21.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-17T01:04:21.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-17T01:04:21.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-17T01:04:21.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-17T01:04:21.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-17T01:04:21.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-17T01:04:21.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-17T01:04:21.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-17T01:04:21.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-17T01:04:21.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-17T01:04:21.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-17T01:04:21.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-17T01:04:21.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:21.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:21.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:21.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:21.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:21.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:21.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:21.160 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:20 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:21.249 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:21.249 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:21.249 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:21.249 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:21.249 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:21.249 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:04:21.249 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:04:21.249 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:21.250 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.250 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.250 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.250 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.250 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.250 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.250 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.250 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.250 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.250 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.250 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.250 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.250 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.250 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:21.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: Upgrade: Finalizing container_image settings 2024-09-17T01:04:21.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:21.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-17T01:04:21.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-17T01:04:21.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-17T01:04:21.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-17T01:04:21.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-17T01:04:21.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-17T01:04:21.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-17T01:04:21.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-17T01:04:21.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-17T01:04:21.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-17T01:04:21.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.252 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-17T01:04:21.252 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-17T01:04:21.252 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-17T01:04:21.252 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-17T01:04:21.252 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-17T01:04:21.252 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-17T01:04:21.252 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-17T01:04:21.252 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-17T01:04:21.252 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.252 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.252 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.252 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.252 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.253 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:04:21.253 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-17T01:04:21.253 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-17T01:04:21.253 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:21.253 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:21.253 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:21.253 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:21.253 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:21.253 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:21.253 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:21.253 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:20 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:22.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:21 smithi002 ceph-mon[27650]: Upgrade: Complete! 2024-09-17T01:04:22.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:21 smithi002 ceph-mon[27650]: pgmap v29: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:22.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:21 smithi099 ceph-mon[34357]: Upgrade: Complete! 2024-09-17T01:04:22.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:21 smithi099 ceph-mon[34357]: pgmap v29: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:24.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:23 smithi002 ceph-mon[27650]: pgmap v30: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:24.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:23 smithi099 ceph-mon[34357]: pgmap v30: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:25.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:25 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:25.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:25 smithi002 ceph-mon[27650]: pgmap v31: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:25 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:25 smithi099 ceph-mon[34357]: pgmap v31: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:27.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:27 smithi002 ceph-mon[27650]: pgmap v32: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:28.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:27 smithi099 ceph-mon[34357]: pgmap v32: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:29.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:29 smithi002 ceph-mon[27650]: pgmap v33: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:29.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:29 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:30.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:29 smithi099 ceph-mon[34357]: pgmap v33: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:30.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:29 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:31.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:31 smithi002 ceph-mon[27650]: pgmap v34: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:32.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:31 smithi099 ceph-mon[34357]: pgmap v34: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:33.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:33 smithi002 ceph-mon[27650]: pgmap v35: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:34.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:33 smithi099 ceph-mon[34357]: pgmap v35: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:35.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:35 smithi002 ceph-mon[27650]: pgmap v36: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:36.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:35 smithi099 ceph-mon[34357]: pgmap v36: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:37 smithi002 ceph-mon[27650]: pgmap v37: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:38.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:37 smithi099 ceph-mon[34357]: pgmap v37: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:38.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.751+0000 7fa33c1da640 1 -- 172.21.15.2:0/1063828009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3340fb460 msgr2=0x7fa3340fb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:38.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.751+0000 7fa33c1da640 1 --2- 172.21.15.2:0/1063828009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3340fb460 0x7fa3340fb870 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa3300048d0 tx=0x7fa330009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:38.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.751+0000 7fa33c1da640 1 -- 172.21.15.2:0/1063828009 shutdown_connections 2024-09-17T01:04:38.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.751+0000 7fa33c1da640 1 --2- 172.21.15.2:0/1063828009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3340fc730 0x7fa3340fcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:38.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.751+0000 7fa33c1da640 1 --2- 172.21.15.2:0/1063828009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3340fb460 0x7fa3340fb870 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:38.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.751+0000 7fa33c1da640 1 -- 172.21.15.2:0/1063828009 >> 172.21.15.2:0/1063828009 conn(0x7fa3340f6c40 msgr2=0x7fa3340f9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:38.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.752+0000 7fa33c1da640 1 -- 172.21.15.2:0/1063828009 shutdown_connections 2024-09-17T01:04:38.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.752+0000 7fa33c1da640 1 -- 172.21.15.2:0/1063828009 wait complete. 2024-09-17T01:04:38.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.752+0000 7fa33c1da640 1 Processor -- start 2024-09-17T01:04:38.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.752+0000 7fa33c1da640 1 -- start start 2024-09-17T01:04:38.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.753+0000 7fa33c1da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3340fb460 0x7fa33410bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:38.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.753+0000 7fa33c1da640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3340fc730 0x7fa33410c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:38.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.753+0000 7fa33c1da640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33410cb20 con 0x7fa3340fb460 2024-09-17T01:04:38.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.753+0000 7fa33c1da640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33410d340 con 0x7fa3340fc730 2024-09-17T01:04:38.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.753+0000 7fa339f76640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3340fb460 0x7fa33410bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:38.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.753+0000 7fa339f76640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3340fb460 0x7fa33410bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57118/0 (socket says 172.21.15.2:57118) 2024-09-17T01:04:38.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.753+0000 7fa339f76640 1 -- 172.21.15.2:0/1551597956 learned_addr learned my addr 172.21.15.2:0/1551597956 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:04:38.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.753+0000 7fa339775640 1 --2- 172.21.15.2:0/1551597956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3340fc730 0x7fa33410c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:38.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.753+0000 7fa339f76640 1 -- 172.21.15.2:0/1551597956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3340fc730 msgr2=0x7fa33410c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:38.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.753+0000 7fa339f76640 1 --2- 172.21.15.2:0/1551597956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3340fc730 0x7fa33410c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:38.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.753+0000 7fa339f76640 1 -- 172.21.15.2:0/1551597956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330005040 con 0x7fa3340fb460 2024-09-17T01:04:38.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.753+0000 7fa339f76640 1 --2- 172.21.15.2:0/1551597956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3340fb460 0x7fa33410bf90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa330003080 tx=0x7fa330009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:38.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.754+0000 7fa32a7fc640 1 -- 172.21.15.2:0/1551597956 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa330038070 con 0x7fa3340fb460 2024-09-17T01:04:38.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.754+0000 7fa33c1da640 1 -- 172.21.15.2:0/1551597956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33410d570 con 0x7fa3340fb460 2024-09-17T01:04:38.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.754+0000 7fa32a7fc640 1 -- 172.21.15.2:0/1551597956 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa33002abd0 con 0x7fa3340fb460 2024-09-17T01:04:38.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.754+0000 7fa32a7fc640 1 -- 172.21.15.2:0/1551597956 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa33003e670 con 0x7fa3340fb460 2024-09-17T01:04:38.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.754+0000 7fa33c1da640 1 -- 172.21.15.2:0/1551597956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33410db10 con 0x7fa3340fb460 2024-09-17T01:04:38.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.755+0000 7fa33c1da640 1 -- 172.21.15.2:0/1551597956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3340fa8c0 con 0x7fa3340fb460 2024-09-17T01:04:38.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.755+0000 7fa32a7fc640 1 -- 172.21.15.2:0/1551597956 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92373+0+0 (secure 0 0 0) 0x7fa330030020 con 0x7fa3340fb460 2024-09-17T01:04:38.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.756+0000 7fa32a7fc640 1 --2- 172.21.15.2:0/1551597956 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fa32006df60 0x7fa320070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:38.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.756+0000 7fa32a7fc640 1 -- 172.21.15.2:0/1551597956 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa3300add90 con 0x7fa3340fb460 2024-09-17T01:04:38.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.756+0000 7fa339775640 1 --2- 172.21.15.2:0/1551597956 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fa32006df60 0x7fa320070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:38.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.757+0000 7fa339775640 1 --2- 172.21.15.2:0/1551597956 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fa32006df60 0x7fa320070410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa324007fd0 tx=0x7fa324009040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:38.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.761+0000 7fa32a7fc640 1 -- 172.21.15.2:0/1551597956 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa3300775c0 con 0x7fa3340fb460 2024-09-17T01:04:38.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.954+0000 7fa33c1da640 1 -- 172.21.15.2:0/1551597956 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa33410de60 con 0x7fa32006df60 2024-09-17T01:04:38.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.955+0000 7fa32a7fc640 1 -- 172.21.15.2:0/1551597956 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fa33410de60 con 0x7fa32006df60 2024-09-17T01:04:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.957+0000 7fa33c1da640 1 -- 172.21.15.2:0/1551597956 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fa32006df60 msgr2=0x7fa320070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.957+0000 7fa33c1da640 1 --2- 172.21.15.2:0/1551597956 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fa32006df60 0x7fa320070410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa324007fd0 tx=0x7fa324009040 comp rx=0 tx=0).stop 2024-09-17T01:04:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.957+0000 7fa33c1da640 1 -- 172.21.15.2:0/1551597956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3340fb460 msgr2=0x7fa33410bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.957+0000 7fa33c1da640 1 --2- 172.21.15.2:0/1551597956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3340fb460 0x7fa33410bf90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa330003080 tx=0x7fa330009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.957+0000 7fa33c1da640 1 -- 172.21.15.2:0/1551597956 shutdown_connections 2024-09-17T01:04:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.957+0000 7fa33c1da640 1 --2- 172.21.15.2:0/1551597956 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fa32006df60 0x7fa320070410 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.957+0000 7fa33c1da640 1 --2- 172.21.15.2:0/1551597956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3340fc730 0x7fa33410c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.957+0000 7fa33c1da640 1 --2- 172.21.15.2:0/1551597956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3340fb460 0x7fa33410bf90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.957+0000 7fa33c1da640 1 -- 172.21.15.2:0/1551597956 >> 172.21.15.2:0/1551597956 conn(0x7fa3340f6c40 msgr2=0x7fa3340f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.957+0000 7fa33c1da640 1 -- 172.21.15.2:0/1551597956 shutdown_connections 2024-09-17T01:04:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:38.957+0000 7fa33c1da640 1 -- 172.21.15.2:0/1551597956 wait complete. 2024-09-17T01:04:39.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-17T01:04:39.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:39 smithi002 ceph-mon[27650]: pgmap v38: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:39.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:39 smithi002 ceph-mon[27650]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:39.927 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:04:40.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:39 smithi099 ceph-mon[34357]: pgmap v38: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:40.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:39 smithi099 ceph-mon[34357]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:41.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.571+0000 7fac4147e640 1 -- 172.21.15.2:0/2323928908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac3c1014c0 msgr2=0x7fac3c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:41.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.571+0000 7fac4147e640 1 --2- 172.21.15.2:0/2323928908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac3c1014c0 0x7fac3c101890 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0048d0 tx=0x7fac2c009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.571+0000 7fac4147e640 1 -- 172.21.15.2:0/2323928908 shutdown_connections 2024-09-17T01:04:41.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.571+0000 7fac4147e640 1 --2- 172.21.15.2:0/2323928908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac3c0fb480 0x7fac3c0fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.571+0000 7fac4147e640 1 --2- 172.21.15.2:0/2323928908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac3c1014c0 0x7fac3c101890 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.571+0000 7fac4147e640 1 -- 172.21.15.2:0/2323928908 >> 172.21.15.2:0/2323928908 conn(0x7fac3c0f7040 msgr2=0x7fac3c0f9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:41.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.571+0000 7fac4147e640 1 -- 172.21.15.2:0/2323928908 shutdown_connections 2024-09-17T01:04:41.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.571+0000 7fac4147e640 1 -- 172.21.15.2:0/2323928908 wait complete. 2024-09-17T01:04:41.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.571+0000 7fac4147e640 1 Processor -- start 2024-09-17T01:04:41.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.571+0000 7fac4147e640 1 -- start start 2024-09-17T01:04:41.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac4147e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac3c0fb480 0x7fac3c10e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:41.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac4147e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac3c1014c0 0x7fac3c10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:41.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac4147e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c10ed60 con 0x7fac3c1014c0 2024-09-17T01:04:41.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac4147e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c10eed0 con 0x7fac3c0fb480 2024-09-17T01:04:41.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac3a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac3c1014c0 0x7fac3c10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:41.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac3a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac3c1014c0 0x7fac3c10e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43214/0 (socket says 172.21.15.2:43214) 2024-09-17T01:04:41.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac3a7fc640 1 -- 172.21.15.2:0/3814964090 learned_addr learned my addr 172.21.15.2:0/3814964090 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:04:41.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac3affd640 1 --2- 172.21.15.2:0/3814964090 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac3c0fb480 0x7fac3c10e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:41.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac3a7fc640 1 -- 172.21.15.2:0/3814964090 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac3c0fb480 msgr2=0x7fac3c10e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac3a7fc640 1 --2- 172.21.15.2:0/3814964090 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac3c0fb480 0x7fac3c10e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac3a7fc640 1 -- 172.21.15.2:0/3814964090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c005040 con 0x7fac3c1014c0 2024-09-17T01:04:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac3a7fc640 1 --2- 172.21.15.2:0/3814964090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac3c1014c0 0x7fac3c10e6d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fac3000b790 tx=0x7fac300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac237fe640 1 -- 172.21.15.2:0/3814964090 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac3000c700 con 0x7fac3c1014c0 2024-09-17T01:04:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac237fe640 1 -- 172.21.15.2:0/3814964090 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fac3000cd00 con 0x7fac3c1014c0 2024-09-17T01:04:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac4147e640 1 -- 172.21.15.2:0/3814964090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3c117260 con 0x7fac3c1014c0 2024-09-17T01:04:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.572+0000 7fac237fe640 1 -- 172.21.15.2:0/3814964090 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac30015e70 con 0x7fac3c1014c0 2024-09-17T01:04:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.573+0000 7fac4147e640 1 -- 172.21.15.2:0/3814964090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3c117730 con 0x7fac3c1014c0 2024-09-17T01:04:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.574+0000 7fac4147e640 1 -- 172.21.15.2:0/3814964090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3c0fcbc0 con 0x7fac3c1014c0 2024-09-17T01:04:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.574+0000 7fac237fe640 1 -- 172.21.15.2:0/3814964090 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92373+0+0 (secure 0 0 0) 0x7fac30012070 con 0x7fac3c1014c0 2024-09-17T01:04:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.574+0000 7fac237fe640 1 --2- 172.21.15.2:0/3814964090 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fac2406df60 0x7fac24070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.575+0000 7fac237fe640 1 -- 172.21.15.2:0/3814964090 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fac3008d590 con 0x7fac3c1014c0 2024-09-17T01:04:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.575+0000 7fac3affd640 1 --2- 172.21.15.2:0/3814964090 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fac2406df60 0x7fac24070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:41.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.575+0000 7fac3affd640 1 --2- 172.21.15.2:0/3814964090 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fac2406df60 0x7fac24070410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fac2c004540 tx=0x7fac2c009da0 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:41.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.579+0000 7fac237fe640 1 -- 172.21.15.2:0/3814964090 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fac30056dc0 con 0x7fac3c1014c0 2024-09-17T01:04:41.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:41 smithi002 ceph-mon[27650]: pgmap v39: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:41.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.822+0000 7fac4147e640 1 -- 172.21.15.2:0/3814964090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fac3c108520 con 0x7fac3c1014c0 2024-09-17T01:04:41.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.823+0000 7fac237fe640 1 -- 172.21.15.2:0/3814964090 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fac3005a480 con 0x7fac3c1014c0 2024-09-17T01:04:41.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.825+0000 7fac4147e640 1 -- 172.21.15.2:0/3814964090 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fac2406df60 msgr2=0x7fac24070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.825+0000 7fac4147e640 1 --2- 172.21.15.2:0/3814964090 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fac2406df60 0x7fac24070410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fac2c004540 tx=0x7fac2c009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.825+0000 7fac4147e640 1 -- 172.21.15.2:0/3814964090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac3c1014c0 msgr2=0x7fac3c10e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.825+0000 7fac4147e640 1 --2- 172.21.15.2:0/3814964090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac3c1014c0 0x7fac3c10e6d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fac3000b790 tx=0x7fac300091d0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.825+0000 7fac4147e640 1 -- 172.21.15.2:0/3814964090 shutdown_connections 2024-09-17T01:04:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.825+0000 7fac4147e640 1 --2- 172.21.15.2:0/3814964090 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fac2406df60 0x7fac24070410 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.825+0000 7fac4147e640 1 --2- 172.21.15.2:0/3814964090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac3c1014c0 0x7fac3c10e6d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.825+0000 7fac4147e640 1 --2- 172.21.15.2:0/3814964090 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac3c0fb480 0x7fac3c10e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.825+0000 7fac4147e640 1 -- 172.21.15.2:0/3814964090 >> 172.21.15.2:0/3814964090 conn(0x7fac3c0f7040 msgr2=0x7fac3c0f8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.825+0000 7fac4147e640 1 -- 172.21.15.2:0/3814964090 shutdown_connections 2024-09-17T01:04:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:41.825+0000 7fac4147e640 1 -- 172.21.15.2:0/3814964090 wait complete. 2024-09-17T01:04:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:04:42.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:41 smithi099 ceph-mon[34357]: pgmap v39: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:42.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-17T01:04:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:04:42.850 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:42 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3814964090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:43.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:42 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3814964090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:43.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:43 smithi002 ceph-mon[27650]: pgmap v40: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:44.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:43 smithi099 ceph-mon[34357]: pgmap v40: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.395+0000 7f6ba88f5640 1 -- 172.21.15.2:0/2080576056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba4101510 msgr2=0x7f6ba41018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.395+0000 7f6ba88f5640 1 --2- 172.21.15.2:0/2080576056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba4101510 0x7f6ba41018e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6b940048d0 tx=0x7f6b94009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.395+0000 7f6ba88f5640 1 -- 172.21.15.2:0/2080576056 shutdown_connections 2024-09-17T01:04:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.395+0000 7f6ba88f5640 1 --2- 172.21.15.2:0/2080576056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ba40fb4d0 0x7f6ba40fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.395+0000 7f6ba88f5640 1 --2- 172.21.15.2:0/2080576056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba4101510 0x7f6ba41018e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.395+0000 7f6ba88f5640 1 -- 172.21.15.2:0/2080576056 >> 172.21.15.2:0/2080576056 conn(0x7f6ba40f7090 msgr2=0x7f6ba40f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.395+0000 7f6ba88f5640 1 -- 172.21.15.2:0/2080576056 shutdown_connections 2024-09-17T01:04:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.395+0000 7f6ba88f5640 1 -- 172.21.15.2:0/2080576056 wait complete. 2024-09-17T01:04:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.395+0000 7f6ba88f5640 1 Processor -- start 2024-09-17T01:04:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.395+0000 7f6ba88f5640 1 -- start start 2024-09-17T01:04:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6ba88f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba40fb4d0 0x7f6ba4115340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6ba88f5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ba4101510 0x7f6ba4115880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6ba88f5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba4115e80 con 0x7f6ba40fb4d0 2024-09-17T01:04:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6ba88f5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba4115ff0 con 0x7f6ba4101510 2024-09-17T01:04:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6ba259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba40fb4d0 0x7f6ba4115340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6ba259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba40fb4d0 0x7f6ba4115340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43230/0 (socket says 172.21.15.2:43230) 2024-09-17T01:04:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6ba259c640 1 -- 172.21.15.2:0/3364413217 learned_addr learned my addr 172.21.15.2:0/3364413217 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:04:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6ba1d9b640 1 --2- 172.21.15.2:0/3364413217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ba4101510 0x7f6ba4115880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6ba259c640 1 -- 172.21.15.2:0/3364413217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ba4101510 msgr2=0x7f6ba4115880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6ba259c640 1 --2- 172.21.15.2:0/3364413217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ba4101510 0x7f6ba4115880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6ba259c640 1 -- 172.21.15.2:0/3364413217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b94005040 con 0x7f6ba40fb4d0 2024-09-17T01:04:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6ba259c640 1 --2- 172.21.15.2:0/3364413217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba40fb4d0 0x7f6ba4115340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6b94003080 tx=0x7f6b94009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6b92ffd640 1 -- 172.21.15.2:0/3364413217 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b94038070 con 0x7f6ba40fb4d0 2024-09-17T01:04:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6b92ffd640 1 -- 172.21.15.2:0/3364413217 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6b940097e0 con 0x7f6ba40fb4d0 2024-09-17T01:04:44.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6ba88f5640 1 -- 172.21.15.2:0/3364413217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba410f410 con 0x7f6ba40fb4d0 2024-09-17T01:04:44.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6b92ffd640 1 -- 172.21.15.2:0/3364413217 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b9403d420 con 0x7f6ba40fb4d0 2024-09-17T01:04:44.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.396+0000 7f6ba88f5640 1 -- 172.21.15.2:0/3364413217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba410f950 con 0x7f6ba40fb4d0 2024-09-17T01:04:44.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.397+0000 7f6ba88f5640 1 -- 172.21.15.2:0/3364413217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba40fcc10 con 0x7f6ba40fb4d0 2024-09-17T01:04:44.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.398+0000 7f6b92ffd640 1 -- 172.21.15.2:0/3364413217 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92373+0+0 (secure 0 0 0) 0x7f6b94030020 con 0x7f6ba40fb4d0 2024-09-17T01:04:44.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.398+0000 7f6b92ffd640 1 --2- 172.21.15.2:0/3364413217 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f6b8c06df60 0x7f6b8c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:44.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.398+0000 7f6b92ffd640 1 -- 172.21.15.2:0/3364413217 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f6b940ade80 con 0x7f6ba40fb4d0 2024-09-17T01:04:44.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.399+0000 7f6ba1d9b640 1 --2- 172.21.15.2:0/3364413217 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f6b8c06df60 0x7f6b8c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:44.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.399+0000 7f6ba1d9b640 1 --2- 172.21.15.2:0/3364413217 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f6b8c06df60 0x7f6b8c070410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4110c40 tx=0x7f6b98009040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:44.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.403+0000 7f6b92ffd640 1 -- 172.21.15.2:0/3364413217 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f6b940776b0 con 0x7f6ba40fb4d0 2024-09-17T01:04:44.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.652+0000 7f6ba88f5640 1 -- 172.21.15.2:0/3364413217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6ba40fac90 con 0x7f6ba40fb4d0 2024-09-17T01:04:44.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.653+0000 7f6b92ffd640 1 -- 172.21.15.2:0/3364413217 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f6b9407ad70 con 0x7f6ba40fb4d0 2024-09-17T01:04:44.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.655+0000 7f6ba88f5640 1 -- 172.21.15.2:0/3364413217 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f6b8c06df60 msgr2=0x7f6b8c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.655+0000 7f6ba88f5640 1 --2- 172.21.15.2:0/3364413217 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f6b8c06df60 0x7f6b8c070410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4110c40 tx=0x7f6b98009040 comp rx=0 tx=0).stop 2024-09-17T01:04:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.655+0000 7f6ba88f5640 1 -- 172.21.15.2:0/3364413217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba40fb4d0 msgr2=0x7f6ba4115340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.655+0000 7f6ba88f5640 1 --2- 172.21.15.2:0/3364413217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba40fb4d0 0x7f6ba4115340 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6b94003080 tx=0x7f6b94009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.655+0000 7f6ba88f5640 1 -- 172.21.15.2:0/3364413217 shutdown_connections 2024-09-17T01:04:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.655+0000 7f6ba88f5640 1 --2- 172.21.15.2:0/3364413217 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f6b8c06df60 0x7f6b8c070410 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.655+0000 7f6ba88f5640 1 --2- 172.21.15.2:0/3364413217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ba4101510 0x7f6ba4115880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.655+0000 7f6ba88f5640 1 --2- 172.21.15.2:0/3364413217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ba40fb4d0 0x7f6ba4115340 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.655+0000 7f6ba88f5640 1 -- 172.21.15.2:0/3364413217 >> 172.21.15.2:0/3364413217 conn(0x7f6ba40f7090 msgr2=0x7f6ba40659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.655+0000 7f6ba88f5640 1 -- 172.21.15.2:0/3364413217 shutdown_connections 2024-09-17T01:04:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:44.655+0000 7f6ba88f5640 1 -- 172.21.15.2:0/3364413217 wait complete. 2024-09-17T01:04:44.661 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)" 2024-09-17T01:04:44.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:44 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:45.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:44 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:04:45.251 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-17T01:04:45.512 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:04:45.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:45 smithi002 ceph-mon[27650]: pgmap v41: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:45.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:45 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/3364413217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:46.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:45 smithi099 ceph-mon[34357]: pgmap v41: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:46.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:45 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/3364413217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:47.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.036+0000 7fe9f0922640 1 -- 172.21.15.2:0/4071807789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ec102580 msgr2=0x7fe9ec102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.036+0000 7fe9f0922640 1 --2- 172.21.15.2:0/4071807789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ec102580 0x7fe9ec102950 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0048d0 tx=0x7fe9dc009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.036+0000 7fe9f0922640 1 -- 172.21.15.2:0/4071807789 shutdown_connections 2024-09-17T01:04:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.036+0000 7fe9f0922640 1 --2- 172.21.15.2:0/4071807789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ec102f20 0x7fe9ec0fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.036+0000 7fe9f0922640 1 --2- 172.21.15.2:0/4071807789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ec102580 0x7fe9ec102950 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.036+0000 7fe9f0922640 1 -- 172.21.15.2:0/4071807789 >> 172.21.15.2:0/4071807789 conn(0x7fe9ec0f81a0 msgr2=0x7fe9ec0fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.036+0000 7fe9f0922640 1 -- 172.21.15.2:0/4071807789 shutdown_connections 2024-09-17T01:04:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.036+0000 7fe9f0922640 1 -- 172.21.15.2:0/4071807789 wait complete. 2024-09-17T01:04:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.037+0000 7fe9f0922640 1 Processor -- start 2024-09-17T01:04:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.037+0000 7fe9f0922640 1 -- start start 2024-09-17T01:04:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.037+0000 7fe9f0922640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ec102580 0x7fe9ec06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:47.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.037+0000 7fe9f0922640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ec102f20 0x7fe9ec06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.037+0000 7fe9f0922640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec070570 con 0x7fe9ec102580 2024-09-17T01:04:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.037+0000 7fe9f0922640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0706e0 con 0x7fe9ec102f20 2024-09-17T01:04:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.037+0000 7fe9ea59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ec102580 0x7fe9ec06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.037+0000 7fe9ea59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ec102580 0x7fe9ec06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43258/0 (socket says 172.21.15.2:43258) 2024-09-17T01:04:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.037+0000 7fe9ea59c640 1 -- 172.21.15.2:0/2173108132 learned_addr learned my addr 172.21.15.2:0/2173108132 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:04:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.037+0000 7fe9e9d9b640 1 --2- 172.21.15.2:0/2173108132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ec102f20 0x7fe9ec06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.037+0000 7fe9ea59c640 1 -- 172.21.15.2:0/2173108132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ec102f20 msgr2=0x7fe9ec06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.037+0000 7fe9ea59c640 1 --2- 172.21.15.2:0/2173108132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ec102f20 0x7fe9ec06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.037+0000 7fe9ea59c640 1 -- 172.21.15.2:0/2173108132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc005040 con 0x7fe9ec102580 2024-09-17T01:04:47.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.037+0000 7fe9e9d9b640 1 --2- 172.21.15.2:0/2173108132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ec102f20 0x7fe9ec06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:04:47.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.038+0000 7fe9ea59c640 1 --2- 172.21.15.2:0/2173108132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ec102580 0x7fe9ec06fa10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc000c00 tx=0x7fe9dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.038+0000 7fe9daffd640 1 -- 172.21.15.2:0/2173108132 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9dc038070 con 0x7fe9ec102580 2024-09-17T01:04:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.038+0000 7fe9daffd640 1 -- 172.21.15.2:0/2173108132 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe9dc03daf0 con 0x7fe9ec102580 2024-09-17T01:04:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.038+0000 7fe9f0922640 1 -- 172.21.15.2:0/2173108132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec1195a0 con 0x7fe9ec102580 2024-09-17T01:04:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.038+0000 7fe9daffd640 1 -- 172.21.15.2:0/2173108132 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9dc033b20 con 0x7fe9ec102580 2024-09-17T01:04:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.038+0000 7fe9f0922640 1 -- 172.21.15.2:0/2173108132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec119a10 con 0x7fe9ec102580 2024-09-17T01:04:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.039+0000 7fe9f0922640 1 -- 172.21.15.2:0/2173108132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec0fdd00 con 0x7fe9ec102580 2024-09-17T01:04:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.039+0000 7fe9daffd640 1 -- 172.21.15.2:0/2173108132 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92373+0+0 (secure 0 0 0) 0x7fe9dc030020 con 0x7fe9ec102580 2024-09-17T01:04:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.040+0000 7fe9daffd640 1 --2- 172.21.15.2:0/2173108132 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fe9d406df60 0x7fe9d4070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.040+0000 7fe9daffd640 1 -- 172.21.15.2:0/2173108132 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fe9dc0adac0 con 0x7fe9ec102580 2024-09-17T01:04:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.040+0000 7fe9e9d9b640 1 --2- 172.21.15.2:0/2173108132 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fe9d406df60 0x7fe9d4070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:47.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.040+0000 7fe9e9d9b640 1 --2- 172.21.15.2:0/2173108132 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fe9d406df60 0x7fe9d4070410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0006fd0 tx=0x7fe9e0008040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:47.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.044+0000 7fe9daffd640 1 -- 172.21.15.2:0/2173108132 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe9dc0772f0 con 0x7fe9ec102580 2024-09-17T01:04:47.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.289+0000 7fe9f0922640 1 -- 172.21.15.2:0/2173108132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe9ec071100 con 0x7fe9ec102580 2024-09-17T01:04:47.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.289+0000 7fe9daffd640 1 -- 172.21.15.2:0/2173108132 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fe9dc07a9b0 con 0x7fe9ec102580 2024-09-17T01:04:47.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.291+0000 7fe9f0922640 1 -- 172.21.15.2:0/2173108132 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fe9d406df60 msgr2=0x7fe9d4070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:47.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.291+0000 7fe9f0922640 1 --2- 172.21.15.2:0/2173108132 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fe9d406df60 0x7fe9d4070410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0006fd0 tx=0x7fe9e0008040 comp rx=0 tx=0).stop 2024-09-17T01:04:47.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.291+0000 7fe9f0922640 1 -- 172.21.15.2:0/2173108132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ec102580 msgr2=0x7fe9ec06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:47.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.291+0000 7fe9f0922640 1 --2- 172.21.15.2:0/2173108132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ec102580 0x7fe9ec06fa10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc000c00 tx=0x7fe9dc009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:47.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.291+0000 7fe9f0922640 1 -- 172.21.15.2:0/2173108132 shutdown_connections 2024-09-17T01:04:47.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.291+0000 7fe9f0922640 1 --2- 172.21.15.2:0/2173108132 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fe9d406df60 0x7fe9d4070410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:47.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.291+0000 7fe9f0922640 1 --2- 172.21.15.2:0/2173108132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ec102f20 0x7fe9ec06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:47.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.291+0000 7fe9f0922640 1 --2- 172.21.15.2:0/2173108132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ec102580 0x7fe9ec06fa10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:47.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.291+0000 7fe9f0922640 1 -- 172.21.15.2:0/2173108132 >> 172.21.15.2:0/2173108132 conn(0x7fe9ec0f81a0 msgr2=0x7fe9ec0f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:47.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.291+0000 7fe9f0922640 1 -- 172.21.15.2:0/2173108132 shutdown_connections 2024-09-17T01:04:47.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:47.292+0000 7fe9f0922640 1 -- 172.21.15.2:0/2173108132 wait complete. 2024-09-17T01:04:47.298 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:04:47.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:47 smithi002 ceph-mon[27650]: pgmap v42: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:47.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:47 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2173108132' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:48.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:47 smithi099 ceph-mon[34357]: pgmap v42: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:48.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:47 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/2173108132' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:04:48.069 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-17T01:04:48.331 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:04:49.797 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:49 smithi002 ceph-mon[27650]: pgmap v43: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:50.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.007+0000 7fcc4952e640 1 -- 172.21.15.2:0/272390995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc44102620 msgr2=0x7fcc441029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:50.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.007+0000 7fcc4952e640 1 --2- 172.21.15.2:0/272390995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc44102620 0x7fcc441029f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcc340048d0 tx=0x7fcc34009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.007+0000 7fcc4952e640 1 -- 172.21.15.2:0/272390995 shutdown_connections 2024-09-17T01:04:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.007+0000 7fcc4952e640 1 --2- 172.21.15.2:0/272390995 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc440fac80 0x7fcc440fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.007+0000 7fcc4952e640 1 --2- 172.21.15.2:0/272390995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc44102620 0x7fcc441029f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.007+0000 7fcc4952e640 1 -- 172.21.15.2:0/272390995 >> 172.21.15.2:0/272390995 conn(0x7fcc44070ce0 msgr2=0x7fcc440710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.007+0000 7fcc4952e640 1 -- 172.21.15.2:0/272390995 shutdown_connections 2024-09-17T01:04:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.007+0000 7fcc4952e640 1 -- 172.21.15.2:0/272390995 wait complete. 2024-09-17T01:04:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.008+0000 7fcc4952e640 1 Processor -- start 2024-09-17T01:04:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.008+0000 7fcc4952e640 1 -- start start 2024-09-17T01:04:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.008+0000 7fcc4952e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc440fac80 0x7fcc441131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.008+0000 7fcc4952e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc44102620 0x7fcc44113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.008+0000 7fcc4952e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc44113d00 con 0x7fcc44102620 2024-09-17T01:04:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.008+0000 7fcc4952e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4410d140 con 0x7fcc440fac80 2024-09-17T01:04:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.008+0000 7fcc427fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc44102620 0x7fcc44113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.008+0000 7fcc427fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc44102620 0x7fcc44113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43270/0 (socket says 172.21.15.2:43270) 2024-09-17T01:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.008+0000 7fcc427fc640 1 -- 172.21.15.2:0/61826154 learned_addr learned my addr 172.21.15.2:0/61826154 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.008+0000 7fcc42ffd640 1 --2- 172.21.15.2:0/61826154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc440fac80 0x7fcc441131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.008+0000 7fcc427fc640 1 -- 172.21.15.2:0/61826154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc440fac80 msgr2=0x7fcc441131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.008+0000 7fcc427fc640 1 --2- 172.21.15.2:0/61826154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc440fac80 0x7fcc441131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.009+0000 7fcc427fc640 1 -- 172.21.15.2:0/61826154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc34005040 con 0x7fcc44102620 2024-09-17T01:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.009+0000 7fcc427fc640 1 --2- 172.21.15.2:0/61826154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc44102620 0x7fcc44113700 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00c790 tx=0x7fcc2c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.009+0000 7fcc3b7fe640 1 -- 172.21.15.2:0/61826154 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc2c00a7a0 con 0x7fcc44102620 2024-09-17T01:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.009+0000 7fcc3b7fe640 1 -- 172.21.15.2:0/61826154 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcc2c00ada0 con 0x7fcc44102620 2024-09-17T01:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.009+0000 7fcc4952e640 1 -- 172.21.15.2:0/61826154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4410d420 con 0x7fcc44102620 2024-09-17T01:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.009+0000 7fcc3b7fe640 1 -- 172.21.15.2:0/61826154 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc2c0113a0 con 0x7fcc44102620 2024-09-17T01:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.009+0000 7fcc4952e640 1 -- 172.21.15.2:0/61826154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4410d9c0 con 0x7fcc44102620 2024-09-17T01:04:50.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.010+0000 7fcc4952e640 1 -- 172.21.15.2:0/61826154 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc440657b0 con 0x7fcc44102620 2024-09-17T01:04:50.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.011+0000 7fcc3b7fe640 1 -- 172.21.15.2:0/61826154 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92373+0+0 (secure 0 0 0) 0x7fcc2c00a900 con 0x7fcc44102620 2024-09-17T01:04:50.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.011+0000 7fcc3b7fe640 1 --2- 172.21.15.2:0/61826154 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fcc3006df60 0x7fcc30070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:50.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.011+0000 7fcc3b7fe640 1 -- 172.21.15.2:0/61826154 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fcc2c08da90 con 0x7fcc44102620 2024-09-17T01:04:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.011+0000 7fcc42ffd640 1 --2- 172.21.15.2:0/61826154 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fcc3006df60 0x7fcc30070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.012+0000 7fcc42ffd640 1 --2- 172.21.15.2:0/61826154 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fcc3006df60 0x7fcc30070410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009ac0 tx=0x7fcc34035040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:50.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.016+0000 7fcc3b7fe640 1 -- 172.21.15.2:0/61826154 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fcc2c057340 con 0x7fcc44102620 2024-09-17T01:04:50.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:49 smithi099 ceph-mon[34357]: pgmap v43: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:50.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:50.212+0000 7fcc4952e640 1 -- 172.21.15.2:0/61826154 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc44109590 con 0x7fcc3006df60 2024-09-17T01:04:51.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:51 smithi002 ceph-mon[27650]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:51.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:51 smithi002 ceph-mon[27650]: pgmap v44: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:52.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:51 smithi099 ceph-mon[34357]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:52.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:51 smithi099 ceph-mon[34357]: pgmap v44: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:52.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:52.130+0000 7fcc3b7fe640 1 -- 172.21.15.2:0/61826154 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5108 (secure 0 0 0) 0x7fcc44109590 con 0x7fcc3006df60 2024-09-17T01:04:52.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:52.132+0000 7fcc4952e640 1 -- 172.21.15.2:0/61826154 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fcc3006df60 msgr2=0x7fcc30070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:52.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:52.132+0000 7fcc4952e640 1 --2- 172.21.15.2:0/61826154 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fcc3006df60 0x7fcc30070410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009ac0 tx=0x7fcc34035040 comp rx=0 tx=0).stop 2024-09-17T01:04:52.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:52.133+0000 7fcc4952e640 1 -- 172.21.15.2:0/61826154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc44102620 msgr2=0x7fcc44113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:52.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:52.133+0000 7fcc4952e640 1 --2- 172.21.15.2:0/61826154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc44102620 0x7fcc44113700 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00c790 tx=0x7fcc2c0043c0 comp rx=0 tx=0).stop 2024-09-17T01:04:52.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:52.133+0000 7fcc4952e640 1 -- 172.21.15.2:0/61826154 shutdown_connections 2024-09-17T01:04:52.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:52.133+0000 7fcc4952e640 1 --2- 172.21.15.2:0/61826154 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fcc3006df60 0x7fcc30070410 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:52.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:52.133+0000 7fcc4952e640 1 --2- 172.21.15.2:0/61826154 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc44102620 0x7fcc44113700 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:52.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:52.133+0000 7fcc4952e640 1 --2- 172.21.15.2:0/61826154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc440fac80 0x7fcc441131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:52.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:52.133+0000 7fcc4952e640 1 -- 172.21.15.2:0/61826154 >> 172.21.15.2:0/61826154 conn(0x7fcc44070ce0 msgr2=0x7fcc44105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:52.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:52.133+0000 7fcc4952e640 1 -- 172.21.15.2:0/61826154 shutdown_connections 2024-09-17T01:04:52.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:52.133+0000 7fcc4952e640 1 -- 172.21.15.2:0/61826154 wait complete. 2024-09-17T01:04:52.141 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:04:52.848 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch ps' 2024-09-17T01:04:53.114 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:04:53.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:53 smithi002 ceph-mon[27650]: pgmap v45: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:54.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:53 smithi099 ceph-mon[34357]: pgmap v45: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:54.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.818+0000 7f6066282640 1 -- 172.21.15.2:0/205838715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6060102ef0 msgr2=0x7f60600fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:54.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.818+0000 7f6066282640 1 --2- 172.21.15.2:0/205838715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6060102ef0 0x7f60600fc5b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f60540048d0 tx=0x7f6054009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:54.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.818+0000 7f6066282640 1 -- 172.21.15.2:0/205838715 shutdown_connections 2024-09-17T01:04:54.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.818+0000 7f6066282640 1 --2- 172.21.15.2:0/205838715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6060102ef0 0x7f60600fc5b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:54.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.818+0000 7f6066282640 1 --2- 172.21.15.2:0/205838715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6060102550 0x7f6060102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:54.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.818+0000 7f6066282640 1 -- 172.21.15.2:0/205838715 >> 172.21.15.2:0/205838715 conn(0x7f60600f80f0 msgr2=0x7f60600fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:54.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.818+0000 7f6066282640 1 -- 172.21.15.2:0/205838715 shutdown_connections 2024-09-17T01:04:54.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.818+0000 7f6066282640 1 -- 172.21.15.2:0/205838715 wait complete. 2024-09-17T01:04:54.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.818+0000 7f6066282640 1 Processor -- start 2024-09-17T01:04:54.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.818+0000 7f6066282640 1 -- start start 2024-09-17T01:04:54.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.819+0000 7f6066282640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6060102550 0x7f60601135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:54.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.819+0000 7f6066282640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6060102ef0 0x7f6060113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:54.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.819+0000 7f6066282640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60601141d0 con 0x7f6060102ef0 2024-09-17T01:04:54.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.819+0000 7f6066282640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606010d550 con 0x7f6060102550 2024-09-17T01:04:54.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.819+0000 7f605f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6060102ef0 0x7f6060113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:54.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.819+0000 7f605f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6060102ef0 0x7f6060113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56964/0 (socket says 172.21.15.2:56964) 2024-09-17T01:04:54.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.819+0000 7f605f7fe640 1 -- 172.21.15.2:0/3747181663 learned_addr learned my addr 172.21.15.2:0/3747181663 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:04:54.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.819+0000 7f605ffff640 1 --2- 172.21.15.2:0/3747181663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6060102550 0x7f60601135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:54.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.819+0000 7f605f7fe640 1 -- 172.21.15.2:0/3747181663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6060102550 msgr2=0x7f60601135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:54.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.819+0000 7f605f7fe640 1 --2- 172.21.15.2:0/3747181663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6060102550 0x7f60601135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:54.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.819+0000 7f605f7fe640 1 -- 172.21.15.2:0/3747181663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6054005040 con 0x7f6060102ef0 2024-09-17T01:04:54.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.819+0000 7f605f7fe640 1 --2- 172.21.15.2:0/3747181663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6060102ef0 0x7f6060113af0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6054003080 tx=0x7f6054009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:54.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.820+0000 7f605cff9640 1 -- 172.21.15.2:0/3747181663 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6054038070 con 0x7f6060102ef0 2024-09-17T01:04:54.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.820+0000 7f6066282640 1 -- 172.21.15.2:0/3747181663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606010d780 con 0x7f6060102ef0 2024-09-17T01:04:54.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.820+0000 7f605cff9640 1 -- 172.21.15.2:0/3747181663 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6054009760 con 0x7f6060102ef0 2024-09-17T01:04:54.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.820+0000 7f605cff9640 1 -- 172.21.15.2:0/3747181663 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f605403d420 con 0x7f6060102ef0 2024-09-17T01:04:54.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.820+0000 7f6066282640 1 -- 172.21.15.2:0/3747181663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606010dc40 con 0x7f6060102ef0 2024-09-17T01:04:54.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.821+0000 7f6066282640 1 -- 172.21.15.2:0/3747181663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60600fdcd0 con 0x7f6060102ef0 2024-09-17T01:04:54.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.821+0000 7f605cff9640 1 -- 172.21.15.2:0/3747181663 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92373+0+0 (secure 0 0 0) 0x7f6054030020 con 0x7f6060102ef0 2024-09-17T01:04:54.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.822+0000 7f605cff9640 1 --2- 172.21.15.2:0/3747181663 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f604806df60 0x7f6048070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:54.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.822+0000 7f605cff9640 1 -- 172.21.15.2:0/3747181663 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f60540adea0 con 0x7f6060102ef0 2024-09-17T01:04:54.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.822+0000 7f605ffff640 1 --2- 172.21.15.2:0/3747181663 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f604806df60 0x7f6048070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:54.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.822+0000 7f605ffff640 1 --2- 172.21.15.2:0/3747181663 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f604806df60 0x7f6048070410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6050006fd0 tx=0x7f6050008040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:54.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:54.826+0000 7f605cff9640 1 -- 172.21.15.2:0/3747181663 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f60540776d0 con 0x7f6060102ef0 2024-09-17T01:04:55.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:55.009+0000 7f6066282640 1 -- 172.21.15.2:0/3747181663 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6060109650 con 0x7f604806df60 2024-09-17T01:04:55.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:55.017+0000 7f605cff9640 1 -- 172.21.15.2:0/3747181663 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f6060109650 con 0x7f604806df60 2024-09-17T01:04:55.016 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:04:55.016 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (116s) 38s ago 10m 17.7M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:04:55.016 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (11m) 38s ago 11m 6903k - 17.2.7-1635-g4a704134 f22ead590bad 53b003b1ad6f 2024-09-17T01:04:55.016 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (10m) 61s ago 10m 6891k - 17.2.7-1635-g4a704134 f22ead590bad 6ec40439e9b5 2024-09-17T01:04:55.016 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (44s) 38s ago 10m 45.9M - 9.4.12 2bacad6d85d8 5fe408c103d6 2024-09-17T01:04:55.016 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (5m) 38s ago 5m 125M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:04:55.017 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (5m) 38s ago 5m 65.4M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:04:55.017 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (5m) 61s ago 5m 64.7M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:04:55.017 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (5m) 61s ago 5m 115M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:04:55.017 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (96s) 38s ago 12m 501M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:04:55.017 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (65s) 61s ago 9m 70.9M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:04:55.017 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (12m) 38s ago 12m 54.1M 2048M 17.2.7-1635-g4a704134 f22ead590bad 08b932b41bfa 2024-09-17T01:04:55.017 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (9m) 61s ago 9m 43.7M 2048M 17.2.7-1635-g4a704134 f22ead590bad 1c9583d52c94 2024-09-17T01:04:55.017 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (2m) 38s ago 10m 8380k - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:04:55.017 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (101s) 61s ago 10m 8258k - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:04:55.017 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (9m) 38s ago 9m 225M 1558M 17.2.7-1635-g4a704134 f22ead590bad 720f74f40752 2024-09-17T01:04:55.017 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (8m) 38s ago 8m 242M 1558M 17.2.7-1635-g4a704134 f22ead590bad 629defddb38c 2024-09-17T01:04:55.017 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (8m) 38s ago 8m 196M 1558M 17.2.7-1635-g4a704134 f22ead590bad 5dff1cf9fc56 2024-09-17T01:04:55.018 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (7m) 61s ago 7m 270M 2581M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:04:55.018 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (7m) 61s ago 7m 238M 2581M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:04:55.018 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (7m) 61s ago 7m 220M 2581M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:04:55.018 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (70s) 38s ago 10m 46.1M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:04:55.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:55.019+0000 7f6066282640 1 -- 172.21.15.2:0/3747181663 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f604806df60 msgr2=0x7f6048070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:55.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:55.019+0000 7f6066282640 1 --2- 172.21.15.2:0/3747181663 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f604806df60 0x7f6048070410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6050006fd0 tx=0x7f6050008040 comp rx=0 tx=0).stop 2024-09-17T01:04:55.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:55.019+0000 7f6066282640 1 -- 172.21.15.2:0/3747181663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6060102ef0 msgr2=0x7f6060113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:55.019+0000 7f6066282640 1 --2- 172.21.15.2:0/3747181663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6060102ef0 0x7f6060113af0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6054003080 tx=0x7f6054009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:55.019+0000 7f6066282640 1 -- 172.21.15.2:0/3747181663 shutdown_connections 2024-09-17T01:04:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:55.019+0000 7f6066282640 1 --2- 172.21.15.2:0/3747181663 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f604806df60 0x7f6048070410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:55.019+0000 7f6066282640 1 --2- 172.21.15.2:0/3747181663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6060102ef0 0x7f6060113af0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:55.019+0000 7f6066282640 1 --2- 172.21.15.2:0/3747181663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6060102550 0x7f60601135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:55.020+0000 7f6066282640 1 -- 172.21.15.2:0/3747181663 >> 172.21.15.2:0/3747181663 conn(0x7f60600f80f0 msgr2=0x7f60600f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:55.020+0000 7f6066282640 1 -- 172.21.15.2:0/3747181663 shutdown_connections 2024-09-17T01:04:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:55.020+0000 7f6066282640 1 -- 172.21.15.2:0/3747181663 wait complete. 2024-09-17T01:04:55.786 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T01:04:55.787 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T01:04:55.787 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-17T01:04:55.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:55 smithi002 ceph-mon[27650]: pgmap v46: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:55.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:55 smithi002 ceph-mon[27650]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:56.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:55 smithi099 ceph-mon[34357]: pgmap v46: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:04:56.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:55 smithi099 ceph-mon[34357]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:04:56.052 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:04:57.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.614+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2053481029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c80fdf50 msgr2=0x7ff4c8106620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:57.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.614+0000 7ff4d01dc640 1 --2- 172.21.15.2:0/2053481029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c80fdf50 0x7ff4c8106620 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8004900 tx=0x7ff4b8009da0 comp rx=0 tx=0).stop 2024-09-17T01:04:57.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.614+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2053481029 shutdown_connections 2024-09-17T01:04:57.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.614+0000 7ff4d01dc640 1 --2- 172.21.15.2:0/2053481029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c80fdf50 0x7ff4c8106620 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:57.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.614+0000 7ff4d01dc640 1 --2- 172.21.15.2:0/2053481029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c80fd5b0 0x7ff4c80fd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:57.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.614+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2053481029 >> 172.21.15.2:0/2053481029 conn(0x7ff4c80f7090 msgr2=0x7ff4c80f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:57.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.614+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2053481029 shutdown_connections 2024-09-17T01:04:57.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.614+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2053481029 wait complete. 2024-09-17T01:04:57.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.615+0000 7ff4d01dc640 1 Processor -- start 2024-09-17T01:04:57.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.615+0000 7ff4d01dc640 1 -- start start 2024-09-17T01:04:57.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.615+0000 7ff4d01dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c80fd5b0 0x7ff4c81132e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:57.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.615+0000 7ff4d01dc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c80fdf50 0x7ff4c8113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:57.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.615+0000 7ff4d01dc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c8113eb0 con 0x7ff4c80fd5b0 2024-09-17T01:04:57.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.615+0000 7ff4d01dc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c810d260 con 0x7ff4c80fdf50 2024-09-17T01:04:57.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.615+0000 7ff4cdf78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c80fd5b0 0x7ff4c81132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:57.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.615+0000 7ff4cdf78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c80fd5b0 0x7ff4c81132e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56978/0 (socket says 172.21.15.2:56978) 2024-09-17T01:04:57.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.615+0000 7ff4cdf78640 1 -- 172.21.15.2:0/2158868410 learned_addr learned my addr 172.21.15.2:0/2158868410 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:04:57.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.615+0000 7ff4cd777640 1 --2- 172.21.15.2:0/2158868410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c80fdf50 0x7ff4c8113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:57.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.616+0000 7ff4cdf78640 1 -- 172.21.15.2:0/2158868410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c80fdf50 msgr2=0x7ff4c8113820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:57.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.616+0000 7ff4cdf78640 1 --2- 172.21.15.2:0/2158868410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c80fdf50 0x7ff4c8113820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:57.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.616+0000 7ff4cdf78640 1 -- 172.21.15.2:0/2158868410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b8005040 con 0x7ff4c80fd5b0 2024-09-17T01:04:57.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.616+0000 7ff4cdf78640 1 --2- 172.21.15.2:0/2158868410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c80fd5b0 0x7ff4c81132e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400b790 tx=0x7ff4c40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:57.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.616+0000 7ff4be7fc640 1 -- 172.21.15.2:0/2158868410 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4c400c700 con 0x7ff4c80fd5b0 2024-09-17T01:04:57.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.616+0000 7ff4be7fc640 1 -- 172.21.15.2:0/2158868410 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff4c400cd00 con 0x7ff4c80fd5b0 2024-09-17T01:04:57.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.616+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2158868410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c810d540 con 0x7ff4c80fd5b0 2024-09-17T01:04:57.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.616+0000 7ff4be7fc640 1 -- 172.21.15.2:0/2158868410 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4c4015e80 con 0x7ff4c80fd5b0 2024-09-17T01:04:57.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.616+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2158868410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c810da60 con 0x7ff4c80fd5b0 2024-09-17T01:04:57.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.617+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2158868410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c80662b0 con 0x7ff4c80fd5b0 2024-09-17T01:04:57.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.618+0000 7ff4be7fc640 1 -- 172.21.15.2:0/2158868410 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92373+0+0 (secure 0 0 0) 0x7ff4c4012070 con 0x7ff4c80fd5b0 2024-09-17T01:04:57.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.618+0000 7ff4be7fc640 1 --2- 172.21.15.2:0/2158868410 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7ff4b406df60 0x7ff4b4070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:04:57.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.618+0000 7ff4be7fc640 1 -- 172.21.15.2:0/2158868410 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7ff4c408d190 con 0x7ff4c80fd5b0 2024-09-17T01:04:57.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.618+0000 7ff4cd777640 1 --2- 172.21.15.2:0/2158868410 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7ff4b406df60 0x7ff4b4070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:04:57.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.619+0000 7ff4cd777640 1 --2- 172.21.15.2:0/2158868410 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7ff4b406df60 0x7ff4b4070410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8004540 tx=0x7ff4b8035040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:04:57.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.623+0000 7ff4be7fc640 1 -- 172.21.15.2:0/2158868410 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ff4c4056a40 con 0x7ff4c80fd5b0 2024-09-17T01:04:57.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.800+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2158868410 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7ff4c804b750 con 0x7ff4c80fd5b0 2024-09-17T01:04:57.799 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:57 smithi002 ceph-mon[27650]: pgmap v47: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:57.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.805+0000 7ff4be7fc640 1 -- 172.21.15.2:0/2158868410 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7ff4c405a100 con 0x7ff4c80fd5b0 2024-09-17T01:04:57.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.807+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2158868410 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7ff4b406df60 msgr2=0x7ff4b4070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:57.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.807+0000 7ff4d01dc640 1 --2- 172.21.15.2:0/2158868410 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7ff4b406df60 0x7ff4b4070410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8004540 tx=0x7ff4b8035040 comp rx=0 tx=0).stop 2024-09-17T01:04:57.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.807+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2158868410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c80fd5b0 msgr2=0x7ff4c81132e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:04:57.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.807+0000 7ff4d01dc640 1 --2- 172.21.15.2:0/2158868410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c80fd5b0 0x7ff4c81132e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400b790 tx=0x7ff4c40091d0 comp rx=0 tx=0).stop 2024-09-17T01:04:57.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.807+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2158868410 shutdown_connections 2024-09-17T01:04:57.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.807+0000 7ff4d01dc640 1 --2- 172.21.15.2:0/2158868410 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7ff4b406df60 0x7ff4b4070410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:57.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.807+0000 7ff4d01dc640 1 --2- 172.21.15.2:0/2158868410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c80fdf50 0x7ff4c8113820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:57.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.807+0000 7ff4d01dc640 1 --2- 172.21.15.2:0/2158868410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4c80fd5b0 0x7ff4c81132e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:04:57.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.807+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2158868410 >> 172.21.15.2:0/2158868410 conn(0x7ff4c80f7090 msgr2=0x7ff4c80f85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:04:57.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.807+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2158868410 shutdown_connections 2024-09-17T01:04:57.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:04:57.807+0000 7ff4d01dc640 1 -- 172.21.15.2:0/2158868410 wait complete. 2024-09-17T01:04:58.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:57 smithi099 ceph-mon[34357]: pgmap v47: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:04:58.549 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T01:04:58.549 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T01:04:58.549 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-17T01:04:58.808 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:04:59.054 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:58 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2158868410' entity='client.admin' 2024-09-17T01:04:59.054 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.054 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:59.054 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:59.054 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.054 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.054 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:58 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:58 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/2158868410' entity='client.admin' 2024-09-17T01:04:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:04:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:04:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:04:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:04:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:58 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:00.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:59 smithi002 ceph-mon[27650]: pgmap v48: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:05:00.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:04:59 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:59 smithi099 ceph-mon[34357]: pgmap v48: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:05:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:04:59 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:00.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.548+0000 7f0b43a44640 1 -- 172.21.15.2:0/1253743933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b3c0fb480 msgr2=0x7f0b3c0fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.548+0000 7f0b43a44640 1 --2- 172.21.15.2:0/1253743933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b3c0fb480 0x7f0b3c0fb8f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0048d0 tx=0x7f0b2c009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.548+0000 7f0b43a44640 1 -- 172.21.15.2:0/1253743933 shutdown_connections 2024-09-17T01:05:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.548+0000 7f0b43a44640 1 --2- 172.21.15.2:0/1253743933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b3c0fb480 0x7f0b3c0fb8f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.548+0000 7f0b43a44640 1 --2- 172.21.15.2:0/1253743933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b3c1014c0 0x7f0b3c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.548+0000 7f0b43a44640 1 -- 172.21.15.2:0/1253743933 >> 172.21.15.2:0/1253743933 conn(0x7f0b3c0f7000 msgr2=0x7f0b3c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.549+0000 7f0b43a44640 1 -- 172.21.15.2:0/1253743933 shutdown_connections 2024-09-17T01:05:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.549+0000 7f0b43a44640 1 -- 172.21.15.2:0/1253743933 wait complete. 2024-09-17T01:05:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.549+0000 7f0b43a44640 1 Processor -- start 2024-09-17T01:05:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.549+0000 7f0b43a44640 1 -- start start 2024-09-17T01:05:00.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.549+0000 7f0b43a44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b3c0fb480 0x7f0b3c0f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.549+0000 7f0b43a44640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b3c1014c0 0x7f0b3c0f79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.549+0000 7f0b43a44640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c0f7fb0 con 0x7f0b3c0fb480 2024-09-17T01:05:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.549+0000 7f0b43a44640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c0f8120 con 0x7f0b3c1014c0 2024-09-17T01:05:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.549+0000 7f0b417e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b3c0fb480 0x7f0b3c0f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.549+0000 7f0b417e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b3c0fb480 0x7f0b3c0f74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36188/0 (socket says 172.21.15.2:36188) 2024-09-17T01:05:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.549+0000 7f0b417e0640 1 -- 172.21.15.2:0/4055479778 learned_addr learned my addr 172.21.15.2:0/4055479778 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.550+0000 7f0b40fdf640 1 --2- 172.21.15.2:0/4055479778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b3c1014c0 0x7f0b3c0f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.550+0000 7f0b417e0640 1 -- 172.21.15.2:0/4055479778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b3c1014c0 msgr2=0x7f0b3c0f79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.550+0000 7f0b417e0640 1 --2- 172.21.15.2:0/4055479778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b3c1014c0 0x7f0b3c0f79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.550+0000 7f0b417e0640 1 -- 172.21.15.2:0/4055479778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c005040 con 0x7f0b3c0fb480 2024-09-17T01:05:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.550+0000 7f0b417e0640 1 --2- 172.21.15.2:0/4055479778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b3c0fb480 0x7f0b3c0f74a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800b790 tx=0x7f0b380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.550+0000 7f0b31ffb640 1 -- 172.21.15.2:0/4055479778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b3800c700 con 0x7f0b3c0fb480 2024-09-17T01:05:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.550+0000 7f0b31ffb640 1 -- 172.21.15.2:0/4055479778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0b3800cd00 con 0x7f0b3c0fb480 2024-09-17T01:05:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.550+0000 7f0b43a44640 1 -- 172.21.15.2:0/4055479778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3c119550 con 0x7f0b3c0fb480 2024-09-17T01:05:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.550+0000 7f0b31ffb640 1 -- 172.21.15.2:0/4055479778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b38015e70 con 0x7f0b3c0fb480 2024-09-17T01:05:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.550+0000 7f0b43a44640 1 -- 172.21.15.2:0/4055479778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3c119990 con 0x7f0b3c0fb480 2024-09-17T01:05:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.551+0000 7f0b43a44640 1 -- 172.21.15.2:0/4055479778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3c0fcbc0 con 0x7f0b3c0fb480 2024-09-17T01:05:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.552+0000 7f0b31ffb640 1 -- 172.21.15.2:0/4055479778 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 92373+0+0 (secure 0 0 0) 0x7f0b38012070 con 0x7f0b3c0fb480 2024-09-17T01:05:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.552+0000 7f0b31ffb640 1 --2- 172.21.15.2:0/4055479778 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f0b2806df60 0x7f0b28070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.552+0000 7f0b31ffb640 1 -- 172.21.15.2:0/4055479778 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f0b3808d590 con 0x7f0b3c0fb480 2024-09-17T01:05:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.552+0000 7f0b40fdf640 1 --2- 172.21.15.2:0/4055479778 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f0b2806df60 0x7f0b28070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.553+0000 7f0b40fdf640 1 --2- 172.21.15.2:0/4055479778 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f0b2806df60 0x7f0b28070410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0f8de0 tx=0x7f0b2c035040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.557+0000 7f0b31ffb640 1 -- 172.21.15.2:0/4055479778 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f0b38056dc0 con 0x7f0b3c0fb480 2024-09-17T01:05:00.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.730+0000 7f0b43a44640 1 -- 172.21.15.2:0/4055479778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f0b3c0fac40 con 0x7f0b3c0fb480 2024-09-17T01:05:00.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.730+0000 7f0b31ffb640 1 -- 172.21.15.2:0/4055479778 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7f0b3c0fac40 con 0x7f0b3c0fb480 2024-09-17T01:05:00.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.732+0000 7f0b43a44640 1 -- 172.21.15.2:0/4055479778 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f0b2806df60 msgr2=0x7f0b28070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:00.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.732+0000 7f0b43a44640 1 --2- 172.21.15.2:0/4055479778 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f0b2806df60 0x7f0b28070410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0f8de0 tx=0x7f0b2c035040 comp rx=0 tx=0).stop 2024-09-17T01:05:00.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.732+0000 7f0b43a44640 1 -- 172.21.15.2:0/4055479778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b3c0fb480 msgr2=0x7f0b3c0f74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.732+0000 7f0b43a44640 1 --2- 172.21.15.2:0/4055479778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b3c0fb480 0x7f0b3c0f74a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800b790 tx=0x7f0b380091d0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.733+0000 7f0b43a44640 1 -- 172.21.15.2:0/4055479778 shutdown_connections 2024-09-17T01:05:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.733+0000 7f0b43a44640 1 --2- 172.21.15.2:0/4055479778 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f0b2806df60 0x7f0b28070410 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.733+0000 7f0b43a44640 1 --2- 172.21.15.2:0/4055479778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b3c1014c0 0x7f0b3c0f79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.733+0000 7f0b43a44640 1 --2- 172.21.15.2:0/4055479778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b3c0fb480 0x7f0b3c0f74a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.733+0000 7f0b43a44640 1 -- 172.21.15.2:0/4055479778 >> 172.21.15.2:0/4055479778 conn(0x7f0b3c0f7000 msgr2=0x7f0b3c065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.733+0000 7f0b43a44640 1 -- 172.21.15.2:0/4055479778 shutdown_connections 2024-09-17T01:05:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:00.733+0000 7f0b43a44640 1 -- 172.21.15.2:0/4055479778 wait complete. 2024-09-17T01:05:01.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-17T01:05:01.578 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:05:02.026 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:01 smithi002 ceph-mon[27650]: pgmap v49: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-17T01:05:02.027 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:01 smithi002 ceph-mon[27650]: mgrmap e32: smithi002.vjeexr(active, since 92s), standbys: smithi099.vswzrb 2024-09-17T01:05:02.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:01 smithi099 ceph-mon[34357]: pgmap v49: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-17T01:05:02.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:01 smithi099 ceph-mon[34357]: mgrmap e32: smithi002.vjeexr(active, since 92s), standbys: smithi099.vswzrb 2024-09-17T01:05:03.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.229+0000 7fdebf9d2640 1 -- 172.21.15.2:0/2841767371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdeb8065300 msgr2=0x7fdeb80656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:03.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.229+0000 7fdebf9d2640 1 --2- 172.21.15.2:0/2841767371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdeb8065300 0x7fdeb80656d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40048d0 tx=0x7fdeb4009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.229+0000 7fdebf9d2640 1 -- 172.21.15.2:0/2841767371 shutdown_connections 2024-09-17T01:05:03.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.229+0000 7fdebf9d2640 1 --2- 172.21.15.2:0/2841767371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdeb8065c10 0x7fdeb80fe0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.229+0000 7fdebf9d2640 1 --2- 172.21.15.2:0/2841767371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdeb8065300 0x7fdeb80656d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.229+0000 7fdebf9d2640 1 -- 172.21.15.2:0/2841767371 >> 172.21.15.2:0/2841767371 conn(0x7fdeb80723b0 msgr2=0x7fdeb80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:03.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.229+0000 7fdebf9d2640 1 -- 172.21.15.2:0/2841767371 shutdown_connections 2024-09-17T01:05:03.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.229+0000 7fdebf9d2640 1 -- 172.21.15.2:0/2841767371 wait complete. 2024-09-17T01:05:03.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.230+0000 7fdebf9d2640 1 Processor -- start 2024-09-17T01:05:03.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.230+0000 7fdebf9d2640 1 -- start start 2024-09-17T01:05:03.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.230+0000 7fdebf9d2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdeb8065300 0x7fdeb8113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:03.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.230+0000 7fdebf9d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdeb8065c10 0x7fdeb8113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:03.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.230+0000 7fdebf9d2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb8113e00 con 0x7fdeb8065c10 2024-09-17T01:05:03.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.230+0000 7fdebf9d2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb810d1b0 con 0x7fdeb8065300 2024-09-17T01:05:03.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.230+0000 7fdebcf6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdeb8065c10 0x7fdeb8113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:03.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.230+0000 7fdebcf6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdeb8065c10 0x7fdeb8113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36198/0 (socket says 172.21.15.2:36198) 2024-09-17T01:05:03.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.230+0000 7fdebcf6d640 1 -- 172.21.15.2:0/836043338 learned_addr learned my addr 172.21.15.2:0/836043338 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:03.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.230+0000 7fdebd76e640 1 --2- 172.21.15.2:0/836043338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdeb8065300 0x7fdeb8113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:03.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.230+0000 7fdebcf6d640 1 -- 172.21.15.2:0/836043338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdeb8065300 msgr2=0x7fdeb8113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:03.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.230+0000 7fdebcf6d640 1 --2- 172.21.15.2:0/836043338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdeb8065300 0x7fdeb8113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.230+0000 7fdebcf6d640 1 -- 172.21.15.2:0/836043338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb4005040 con 0x7fdeb8065c10 2024-09-17T01:05:03.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.230+0000 7fdebd76e640 1 --2- 172.21.15.2:0/836043338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdeb8065300 0x7fdeb8113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:05:03.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.231+0000 7fdebcf6d640 1 --2- 172.21.15.2:0/836043338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdeb8065c10 0x7fdeb8113770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdea800b790 tx=0x7fdea80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:03.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.231+0000 7fdeadffb640 1 -- 172.21.15.2:0/836043338 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdea800c700 con 0x7fdeb8065c10 2024-09-17T01:05:03.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.231+0000 7fdeadffb640 1 -- 172.21.15.2:0/836043338 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdea800cd00 con 0x7fdeb8065c10 2024-09-17T01:05:03.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.231+0000 7fdebf9d2640 1 -- 172.21.15.2:0/836043338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb810d490 con 0x7fdeb8065c10 2024-09-17T01:05:03.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.231+0000 7fdeadffb640 1 -- 172.21.15.2:0/836043338 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdea8015e70 con 0x7fdeb8065c10 2024-09-17T01:05:03.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.231+0000 7fdebf9d2640 1 -- 172.21.15.2:0/836043338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb810d9b0 con 0x7fdeb8065c10 2024-09-17T01:05:03.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.232+0000 7fdebf9d2640 1 -- 172.21.15.2:0/836043338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb80fdce0 con 0x7fdeb8065c10 2024-09-17T01:05:03.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.232+0000 7fdeadffb640 1 -- 172.21.15.2:0/836043338 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92271+0+0 (secure 0 0 0) 0x7fdea8012070 con 0x7fdeb8065c10 2024-09-17T01:05:03.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.233+0000 7fdeadffb640 1 --2- 172.21.15.2:0/836043338 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fdea406de30 0x7fdea40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:03.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.233+0000 7fdeadffb640 1 -- 172.21.15.2:0/836043338 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fdea808d310 con 0x7fdeb8065c10 2024-09-17T01:05:03.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.233+0000 7fdebd76e640 1 --2- 172.21.15.2:0/836043338 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fdea406de30 0x7fdea40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:03.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.233+0000 7fdebd76e640 1 --2- 172.21.15.2:0/836043338 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fdea406de30 0x7fdea40702e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4007ac0 tx=0x7fdeb4035040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:03.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.238+0000 7fdeadffb640 1 -- 172.21.15.2:0/836043338 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fdea8056cd0 con 0x7fdeb8065c10 2024-09-17T01:05:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.411+0000 7fdebf9d2640 1 -- 172.21.15.2:0/836043338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fdeb8072ec0 con 0x7fdeb8065c10 2024-09-17T01:05:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.411+0000 7fdeadffb640 1 -- 172.21.15.2:0/836043338 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7fdea805a390 con 0x7fdeb8065c10 2024-09-17T01:05:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.413+0000 7fdebf9d2640 1 -- 172.21.15.2:0/836043338 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fdea406de30 msgr2=0x7fdea40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.413+0000 7fdebf9d2640 1 --2- 172.21.15.2:0/836043338 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fdea406de30 0x7fdea40702e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4007ac0 tx=0x7fdeb4035040 comp rx=0 tx=0).stop 2024-09-17T01:05:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.413+0000 7fdebf9d2640 1 -- 172.21.15.2:0/836043338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdeb8065c10 msgr2=0x7fdeb8113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.413+0000 7fdebf9d2640 1 --2- 172.21.15.2:0/836043338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdeb8065c10 0x7fdeb8113770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdea800b790 tx=0x7fdea80091d0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.413+0000 7fdebf9d2640 1 -- 172.21.15.2:0/836043338 shutdown_connections 2024-09-17T01:05:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.413+0000 7fdebf9d2640 1 --2- 172.21.15.2:0/836043338 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fdea406de30 0x7fdea40702e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.413+0000 7fdebf9d2640 1 --2- 172.21.15.2:0/836043338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdeb8065c10 0x7fdeb8113770 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.413+0000 7fdebf9d2640 1 --2- 172.21.15.2:0/836043338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdeb8065300 0x7fdeb8113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.413+0000 7fdebf9d2640 1 -- 172.21.15.2:0/836043338 >> 172.21.15.2:0/836043338 conn(0x7fdeb80723b0 msgr2=0x7fdeb8105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.414+0000 7fdebf9d2640 1 -- 172.21.15.2:0/836043338 shutdown_connections 2024-09-17T01:05:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:03.414+0000 7fdebf9d2640 1 -- 172.21.15.2:0/836043338 wait complete. 2024-09-17T01:05:04.055 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:03 smithi002 ceph-mon[27650]: pgmap v50: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-17T01:05:04.083 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-17T01:05:04.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:03 smithi099 ceph-mon[34357]: pgmap v50: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-17T01:05:04.341 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:05:06.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.055+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2151771990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c8102550 msgr2=0x7f63c8102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:06.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.055+0000 7f63cd8c2640 1 --2- 172.21.15.2:0/2151771990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c8102550 0x7f63c8102920 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f63b80048d0 tx=0x7f63b8009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:06.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.055+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2151771990 shutdown_connections 2024-09-17T01:05:06.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.055+0000 7f63cd8c2640 1 --2- 172.21.15.2:0/2151771990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63c8102ef0 0x7f63c80fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.055+0000 7f63cd8c2640 1 --2- 172.21.15.2:0/2151771990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c8102550 0x7f63c8102920 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.055+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2151771990 >> 172.21.15.2:0/2151771990 conn(0x7f63c80f80f0 msgr2=0x7f63c80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.055+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2151771990 shutdown_connections 2024-09-17T01:05:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.055+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2151771990 wait complete. 2024-09-17T01:05:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.056+0000 7f63cd8c2640 1 Processor -- start 2024-09-17T01:05:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.056+0000 7f63cd8c2640 1 -- start start 2024-09-17T01:05:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.056+0000 7f63cd8c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c8102550 0x7f63c806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.056+0000 7f63cd8c2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63c8102ef0 0x7f63c806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.056+0000 7f63cd8c2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c8070490 con 0x7f63c8102550 2024-09-17T01:05:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.056+0000 7f63cd8c2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c8070600 con 0x7f63c8102ef0 2024-09-17T01:05:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.056+0000 7f63c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c8102550 0x7f63c806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.056+0000 7f63c6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c8102550 0x7f63c806fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36220/0 (socket says 172.21.15.2:36220) 2024-09-17T01:05:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.056+0000 7f63c6ffd640 1 -- 172.21.15.2:0/2610745924 learned_addr learned my addr 172.21.15.2:0/2610745924 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.056+0000 7f63c67fc640 1 --2- 172.21.15.2:0/2610745924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63c8102ef0 0x7f63c806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.057+0000 7f63c6ffd640 1 -- 172.21.15.2:0/2610745924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63c8102ef0 msgr2=0x7f63c806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.057+0000 7f63c6ffd640 1 --2- 172.21.15.2:0/2610745924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63c8102ef0 0x7f63c806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.057+0000 7f63c6ffd640 1 -- 172.21.15.2:0/2610745924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b8005040 con 0x7f63c8102550 2024-09-17T01:05:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.057+0000 7f63c67fc640 1 --2- 172.21.15.2:0/2610745924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63c8102ef0 0x7f63c806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:05:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.057+0000 7f63c6ffd640 1 --2- 172.21.15.2:0/2610745924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c8102550 0x7f63c806fa10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f63b8003080 tx=0x7f63b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.057+0000 7f63af7fe640 1 -- 172.21.15.2:0/2610745924 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63b8038070 con 0x7f63c8102550 2024-09-17T01:05:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.057+0000 7f63af7fe640 1 -- 172.21.15.2:0/2610745924 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f63b80097e0 con 0x7f63c8102550 2024-09-17T01:05:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.057+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2610745924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c8070830 con 0x7f63c8102550 2024-09-17T01:05:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.057+0000 7f63af7fe640 1 -- 172.21.15.2:0/2610745924 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63b803d420 con 0x7f63c8102550 2024-09-17T01:05:06.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.057+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2610745924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c8119bb0 con 0x7f63c8102550 2024-09-17T01:05:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.058+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2610745924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c80fdcd0 con 0x7f63c8102550 2024-09-17T01:05:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.059+0000 7f63af7fe640 1 -- 172.21.15.2:0/2610745924 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92271+0+0 (secure 0 0 0) 0x7f63b8030020 con 0x7f63c8102550 2024-09-17T01:05:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.059+0000 7f63af7fe640 1 --2- 172.21.15.2:0/2610745924 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f63b006de30 0x7f63b00702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.059+0000 7f63af7fe640 1 -- 172.21.15.2:0/2610745924 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f63b80add20 con 0x7f63c8102550 2024-09-17T01:05:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.059+0000 7f63c67fc640 1 --2- 172.21.15.2:0/2610745924 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f63b006de30 0x7f63b00702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:06.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.060+0000 7f63c67fc640 1 --2- 172.21.15.2:0/2610745924 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f63b006de30 0x7f63b00702e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f63c8071350 tx=0x7f63bc009040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:06.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.064+0000 7f63af7fe640 1 -- 172.21.15.2:0/2610745924 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f63b80776e0 con 0x7f63c8102550 2024-09-17T01:05:06.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:05 smithi002 ceph-mon[27650]: pgmap v51: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-17T01:05:06.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.238+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2610745924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f63c80fbd50 con 0x7f63c8102550 2024-09-17T01:05:06.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.238+0000 7f63af7fe640 1 -- 172.21.15.2:0/2610745924 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7f63b807ada0 con 0x7f63c8102550 2024-09-17T01:05:06.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.241+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2610745924 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f63b006de30 msgr2=0x7f63b00702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:06.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.241+0000 7f63cd8c2640 1 --2- 172.21.15.2:0/2610745924 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f63b006de30 0x7f63b00702e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f63c8071350 tx=0x7f63bc009040 comp rx=0 tx=0).stop 2024-09-17T01:05:06.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.241+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2610745924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c8102550 msgr2=0x7f63c806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:06.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.241+0000 7f63cd8c2640 1 --2- 172.21.15.2:0/2610745924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c8102550 0x7f63c806fa10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f63b8003080 tx=0x7f63b8009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:06.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.241+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2610745924 shutdown_connections 2024-09-17T01:05:06.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.241+0000 7f63cd8c2640 1 --2- 172.21.15.2:0/2610745924 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f63b006de30 0x7f63b00702e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:06.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.241+0000 7f63cd8c2640 1 --2- 172.21.15.2:0/2610745924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63c8102ef0 0x7f63c806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:06.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.241+0000 7f63cd8c2640 1 --2- 172.21.15.2:0/2610745924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63c8102550 0x7f63c806fa10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:06.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.241+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2610745924 >> 172.21.15.2:0/2610745924 conn(0x7f63c80f80f0 msgr2=0x7f63c80f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:06.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.241+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2610745924 shutdown_connections 2024-09-17T01:05:06.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:06.241+0000 7f63cd8c2640 1 -- 172.21.15.2:0/2610745924 wait complete. 2024-09-17T01:05:06.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:05 smithi099 ceph-mon[34357]: pgmap v51: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-17T01:05:06.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-17T01:05:07.199 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:05:08.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:07 smithi002 ceph-mon[27650]: pgmap v52: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-17T01:05:08.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:07 smithi099 ceph-mon[34357]: pgmap v52: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-17T01:05:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.062+0000 7f1860bfb640 1 -- 172.21.15.2:0/2008189638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c102550 msgr2=0x7f185c102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.062+0000 7f1860bfb640 1 --2- 172.21.15.2:0/2008189638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c102550 0x7f185c102920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f184c0048d0 tx=0x7f184c009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.062+0000 7f1860bfb640 1 -- 172.21.15.2:0/2008189638 shutdown_connections 2024-09-17T01:05:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.062+0000 7f1860bfb640 1 --2- 172.21.15.2:0/2008189638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f185c102ef0 0x7f185c0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.062+0000 7f1860bfb640 1 --2- 172.21.15.2:0/2008189638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c102550 0x7f185c102920 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.062+0000 7f1860bfb640 1 -- 172.21.15.2:0/2008189638 >> 172.21.15.2:0/2008189638 conn(0x7f185c0f80f0 msgr2=0x7f185c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.062+0000 7f1860bfb640 1 -- 172.21.15.2:0/2008189638 shutdown_connections 2024-09-17T01:05:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.062+0000 7f1860bfb640 1 -- 172.21.15.2:0/2008189638 wait complete. 2024-09-17T01:05:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.063+0000 7f1860bfb640 1 Processor -- start 2024-09-17T01:05:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.063+0000 7f1860bfb640 1 -- start start 2024-09-17T01:05:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.063+0000 7f1860bfb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c102550 0x7f185c1135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.063+0000 7f1860bfb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f185c102ef0 0x7f185c113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.063+0000 7f1860bfb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c1141d0 con 0x7f185c102550 2024-09-17T01:05:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.063+0000 7f1860bfb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c10d550 con 0x7f185c102ef0 2024-09-17T01:05:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.063+0000 7f185a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c102550 0x7f185c1135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.063+0000 7f185a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c102550 0x7f185c1135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36240/0 (socket says 172.21.15.2:36240) 2024-09-17T01:05:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.063+0000 7f185a59c640 1 -- 172.21.15.2:0/1919128657 learned_addr learned my addr 172.21.15.2:0/1919128657 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.064+0000 7f1851d9b640 1 --2- 172.21.15.2:0/1919128657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f185c102ef0 0x7f185c113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.064+0000 7f185a59c640 1 -- 172.21.15.2:0/1919128657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f185c102ef0 msgr2=0x7f185c113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.064+0000 7f185a59c640 1 --2- 172.21.15.2:0/1919128657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f185c102ef0 0x7f185c113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.064+0000 7f185a59c640 1 -- 172.21.15.2:0/1919128657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c005040 con 0x7f185c102550 2024-09-17T01:05:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.064+0000 7f185a59c640 1 --2- 172.21.15.2:0/1919128657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c102550 0x7f185c1135b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f184c000c00 tx=0x7f184c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:09.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.064+0000 7f18537fe640 1 -- 172.21.15.2:0/1919128657 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f184c038070 con 0x7f185c102550 2024-09-17T01:05:09.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.064+0000 7f18537fe640 1 -- 172.21.15.2:0/1919128657 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f184c03daf0 con 0x7f185c102550 2024-09-17T01:05:09.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.064+0000 7f18537fe640 1 -- 172.21.15.2:0/1919128657 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f184c033b20 con 0x7f185c102550 2024-09-17T01:05:09.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.064+0000 7f1860bfb640 1 -- 172.21.15.2:0/1919128657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c10d780 con 0x7f185c102550 2024-09-17T01:05:09.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.064+0000 7f1860bfb640 1 -- 172.21.15.2:0/1919128657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c10dca0 con 0x7f185c102550 2024-09-17T01:05:09.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.065+0000 7f1860bfb640 1 -- 172.21.15.2:0/1919128657 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c0fdcd0 con 0x7f185c102550 2024-09-17T01:05:09.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.066+0000 7f18537fe640 1 -- 172.21.15.2:0/1919128657 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92271+0+0 (secure 0 0 0) 0x7f184c030020 con 0x7f185c102550 2024-09-17T01:05:09.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.066+0000 7f18537fe640 1 --2- 172.21.15.2:0/1919128657 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f184806de30 0x7f18480702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:09.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.066+0000 7f18537fe640 1 -- 172.21.15.2:0/1919128657 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f184c0adb00 con 0x7f185c102550 2024-09-17T01:05:09.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.066+0000 7f1851d9b640 1 --2- 172.21.15.2:0/1919128657 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f184806de30 0x7f18480702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:09.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.067+0000 7f1851d9b640 1 --2- 172.21.15.2:0/1919128657 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f184806de30 0x7f18480702e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1844006fd0 tx=0x7f1844008040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:09.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.071+0000 7f18537fe640 1 -- 172.21.15.2:0/1919128657 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f184c077450 con 0x7f185c102550 2024-09-17T01:05:09.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.263+0000 7f1860bfb640 1 -- 172.21.15.2:0/1919128657 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}) v1 -- 0x7f185c0fbdf0 con 0x7f184806de30 2024-09-17T01:05:09.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.269+0000 7f18537fe640 1 -- 172.21.15.2:0/1919128657 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f185c0fbdf0 con 0x7f184806de30 2024-09-17T01:05:09.267 INFO:teuthology.orchestra.run.smithi002.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:05:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.271+0000 7f1860bfb640 1 -- 172.21.15.2:0/1919128657 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f184806de30 msgr2=0x7f18480702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.271+0000 7f1860bfb640 1 --2- 172.21.15.2:0/1919128657 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f184806de30 0x7f18480702e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1844006fd0 tx=0x7f1844008040 comp rx=0 tx=0).stop 2024-09-17T01:05:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.271+0000 7f1860bfb640 1 -- 172.21.15.2:0/1919128657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c102550 msgr2=0x7f185c1135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.271+0000 7f1860bfb640 1 --2- 172.21.15.2:0/1919128657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c102550 0x7f185c1135b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f184c000c00 tx=0x7f184c009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.271+0000 7f1860bfb640 1 -- 172.21.15.2:0/1919128657 shutdown_connections 2024-09-17T01:05:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.271+0000 7f1860bfb640 1 --2- 172.21.15.2:0/1919128657 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f184806de30 0x7f18480702e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.271+0000 7f1860bfb640 1 --2- 172.21.15.2:0/1919128657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f185c102ef0 0x7f185c113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.271+0000 7f1860bfb640 1 --2- 172.21.15.2:0/1919128657 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f185c102550 0x7f185c1135b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.271+0000 7f1860bfb640 1 -- 172.21.15.2:0/1919128657 >> 172.21.15.2:0/1919128657 conn(0x7f185c0f80f0 msgr2=0x7f185c0f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.271+0000 7f1860bfb640 1 -- 172.21.15.2:0/1919128657 shutdown_connections 2024-09-17T01:05:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:09.271+0000 7f1860bfb640 1 -- 172.21.15.2:0/1919128657 wait complete. 2024-09-17T01:05:10.031 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:09 smithi002 ceph-mon[27650]: pgmap v53: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-17T01:05:10.031 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:09 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:10.031 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:09 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:10.031 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:09 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:10.031 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:09 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:10.031 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:09 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:10.055 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T01:05:10.056 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T01:05:10.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-17T01:05:10.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:09 smithi099 ceph-mon[34357]: pgmap v53: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-17T01:05:10.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:09 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:10.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:09 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:10.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:09 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:10.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:09 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:10.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:09 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:10.317 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:05:11.108 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:10 smithi002 ceph-mon[27650]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:11.108 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:10 smithi002 ceph-mon[27650]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:05:11.108 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:10 smithi002 ceph-mon[27650]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:05:11.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:10 smithi099 ceph-mon[34357]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:11.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:10 smithi099 ceph-mon[34357]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:05:11.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:10 smithi099 ceph-mon[34357]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T01:05:12.084 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:11 smithi002 ceph-mon[27650]: pgmap v54: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-17T01:05:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.085+0000 7fc9e3471640 1 -- 172.21.15.2:0/9100042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc102ef0 msgr2=0x7fc9dc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.085+0000 7fc9e3471640 1 --2- 172.21.15.2:0/9100042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc102ef0 0x7fc9dc0fc5b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0048d0 tx=0x7fc9cc009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.085+0000 7fc9e3471640 1 -- 172.21.15.2:0/9100042 shutdown_connections 2024-09-17T01:05:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.085+0000 7fc9e3471640 1 --2- 172.21.15.2:0/9100042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc102ef0 0x7fc9dc0fc5b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.085+0000 7fc9e3471640 1 --2- 172.21.15.2:0/9100042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9dc102550 0x7fc9dc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.085+0000 7fc9e3471640 1 -- 172.21.15.2:0/9100042 >> 172.21.15.2:0/9100042 conn(0x7fc9dc0f80f0 msgr2=0x7fc9dc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.086+0000 7fc9e3471640 1 -- 172.21.15.2:0/9100042 shutdown_connections 2024-09-17T01:05:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.086+0000 7fc9e3471640 1 -- 172.21.15.2:0/9100042 wait complete. 2024-09-17T01:05:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.086+0000 7fc9e3471640 1 Processor -- start 2024-09-17T01:05:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.086+0000 7fc9e3471640 1 -- start start 2024-09-17T01:05:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.087+0000 7fc9e3471640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc102550 0x7fc9dc1135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.087+0000 7fc9e3471640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9dc102ef0 0x7fc9dc113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.087+0000 7fc9e3471640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc1141d0 con 0x7fc9dc102550 2024-09-17T01:05:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.087+0000 7fc9e3471640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc10d550 con 0x7fc9dc102ef0 2024-09-17T01:05:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.087+0000 7fc9e120d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc102550 0x7fc9dc1135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.087+0000 7fc9e120d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc102550 0x7fc9dc1135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54728/0 (socket says 172.21.15.2:54728) 2024-09-17T01:05:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.087+0000 7fc9e120d640 1 -- 172.21.15.2:0/3377645013 learned_addr learned my addr 172.21.15.2:0/3377645013 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.087+0000 7fc9e0a0c640 1 --2- 172.21.15.2:0/3377645013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9dc102ef0 0x7fc9dc113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.087+0000 7fc9e120d640 1 -- 172.21.15.2:0/3377645013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9dc102ef0 msgr2=0x7fc9dc113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.087+0000 7fc9e120d640 1 --2- 172.21.15.2:0/3377645013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9dc102ef0 0x7fc9dc113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.087+0000 7fc9e120d640 1 -- 172.21.15.2:0/3377645013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc005040 con 0x7fc9dc102550 2024-09-17T01:05:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.087+0000 7fc9e120d640 1 --2- 172.21.15.2:0/3377645013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc102550 0x7fc9dc1135b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800b790 tx=0x7fc9d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.088+0000 7fc9d1ffb640 1 -- 172.21.15.2:0/3377645013 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9d800c700 con 0x7fc9dc102550 2024-09-17T01:05:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.088+0000 7fc9d1ffb640 1 -- 172.21.15.2:0/3377645013 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc9d800cd00 con 0x7fc9dc102550 2024-09-17T01:05:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.088+0000 7fc9e3471640 1 -- 172.21.15.2:0/3377645013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9dc10d7e0 con 0x7fc9dc102550 2024-09-17T01:05:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.088+0000 7fc9d1ffb640 1 -- 172.21.15.2:0/3377645013 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9d8015e80 con 0x7fc9dc102550 2024-09-17T01:05:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.088+0000 7fc9e3471640 1 -- 172.21.15.2:0/3377645013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9dc10dcd0 con 0x7fc9dc102550 2024-09-17T01:05:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.089+0000 7fc9e3471640 1 -- 172.21.15.2:0/3377645013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9dc0fdcd0 con 0x7fc9dc102550 2024-09-17T01:05:12.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.090+0000 7fc9d1ffb640 1 -- 172.21.15.2:0/3377645013 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92271+0+0 (secure 0 0 0) 0x7fc9d8012070 con 0x7fc9dc102550 2024-09-17T01:05:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.090+0000 7fc9d1ffb640 1 --2- 172.21.15.2:0/3377645013 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fc9c806de30 0x7fc9c80702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.090+0000 7fc9d1ffb640 1 -- 172.21.15.2:0/3377645013 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fc9d808d0f0 con 0x7fc9dc102550 2024-09-17T01:05:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.091+0000 7fc9e0a0c640 1 --2- 172.21.15.2:0/3377645013 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fc9c806de30 0x7fc9c80702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.091+0000 7fc9e0a0c640 1 --2- 172.21.15.2:0/3377645013 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fc9c806de30 0x7fc9c80702e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0048a0 tx=0x7fc9cc035040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:12.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.096+0000 7fc9d1ffb640 1 -- 172.21.15.2:0/3377645013 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fc9d8056a30 con 0x7fc9dc102550 2024-09-17T01:05:12.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:11 smithi099 ceph-mon[34357]: pgmap v54: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-17T01:05:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.305+0000 7fc9e3471640 1 -- 172.21.15.2:0/3377645013 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9dc0fbdf0 con 0x7fc9c806de30 2024-09-17T01:05:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.306+0000 7fc9d1ffb640 1 -- 172.21.15.2:0/3377645013 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fc9dc0fbdf0 con 0x7fc9c806de30 2024-09-17T01:05:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.308+0000 7fc9e3471640 1 -- 172.21.15.2:0/3377645013 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fc9c806de30 msgr2=0x7fc9c80702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.308+0000 7fc9e3471640 1 --2- 172.21.15.2:0/3377645013 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fc9c806de30 0x7fc9c80702e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0048a0 tx=0x7fc9cc035040 comp rx=0 tx=0).stop 2024-09-17T01:05:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.308+0000 7fc9e3471640 1 -- 172.21.15.2:0/3377645013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc102550 msgr2=0x7fc9dc1135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:12.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.308+0000 7fc9e3471640 1 --2- 172.21.15.2:0/3377645013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc102550 0x7fc9dc1135b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800b790 tx=0x7fc9d80091d0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.308+0000 7fc9e3471640 1 -- 172.21.15.2:0/3377645013 shutdown_connections 2024-09-17T01:05:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.308+0000 7fc9e3471640 1 --2- 172.21.15.2:0/3377645013 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fc9c806de30 0x7fc9c80702e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.308+0000 7fc9e3471640 1 --2- 172.21.15.2:0/3377645013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9dc102ef0 0x7fc9dc113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.308+0000 7fc9e3471640 1 --2- 172.21.15.2:0/3377645013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9dc102550 0x7fc9dc1135b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.308+0000 7fc9e3471640 1 -- 172.21.15.2:0/3377645013 >> 172.21.15.2:0/3377645013 conn(0x7fc9dc0f80f0 msgr2=0x7fc9dc0f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.308+0000 7fc9e3471640 1 -- 172.21.15.2:0/3377645013 shutdown_connections 2024-09-17T01:05:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.308+0000 7fc9e3471640 1 -- 172.21.15.2:0/3377645013 wait complete. 2024-09-17T01:05:12.316 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:05:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.393+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2158114354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab80fb810 msgr2=0x7f2ab80fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.393+0000 7f2abf4fb640 1 --2- 172.21.15.2:0/2158114354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab80fb810 0x7f2ab80fbbe0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40048d0 tx=0x7f2ab4009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.393+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2158114354 shutdown_connections 2024-09-17T01:05:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.393+0000 7f2abf4fb640 1 --2- 172.21.15.2:0/2158114354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab80fcf80 0x7f2ab80fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.393+0000 7f2abf4fb640 1 --2- 172.21.15.2:0/2158114354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab80fb810 0x7f2ab80fbbe0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.393+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2158114354 >> 172.21.15.2:0/2158114354 conn(0x7f2ab80723b0 msgr2=0x7f2ab80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.393+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2158114354 shutdown_connections 2024-09-17T01:05:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.393+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2158114354 wait complete. 2024-09-17T01:05:12.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.394+0000 7f2abf4fb640 1 Processor -- start 2024-09-17T01:05:12.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.394+0000 7f2abf4fb640 1 -- start start 2024-09-17T01:05:12.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.394+0000 7f2abf4fb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab80fb810 0x7f2ab810bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:12.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.394+0000 7f2abf4fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab80fcf80 0x7f2ab810c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:12.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.394+0000 7f2abf4fb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab810ca20 con 0x7f2ab80fcf80 2024-09-17T01:05:12.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.394+0000 7f2abf4fb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab810cb60 con 0x7f2ab80fb810 2024-09-17T01:05:12.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.394+0000 7f2abca96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab80fcf80 0x7f2ab810c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:12.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.394+0000 7f2abca96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab80fcf80 0x7f2ab810c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54744/0 (socket says 172.21.15.2:54744) 2024-09-17T01:05:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.394+0000 7f2abca96640 1 -- 172.21.15.2:0/2597212871 learned_addr learned my addr 172.21.15.2:0/2597212871 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.394+0000 7f2abd297640 1 --2- 172.21.15.2:0/2597212871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab80fb810 0x7f2ab810bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.395+0000 7f2abca96640 1 -- 172.21.15.2:0/2597212871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab80fb810 msgr2=0x7f2ab810bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.395+0000 7f2abca96640 1 --2- 172.21.15.2:0/2597212871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab80fb810 0x7f2ab810bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.395+0000 7f2abca96640 1 -- 172.21.15.2:0/2597212871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab4005040 con 0x7f2ab80fcf80 2024-09-17T01:05:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.395+0000 7f2abca96640 1 --2- 172.21.15.2:0/2597212871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab80fcf80 0x7f2ab810c4e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800c790 tx=0x7f2aa80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.395+0000 7f2aadffb640 1 -- 172.21.15.2:0/2597212871 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aa800a7a0 con 0x7f2ab80fcf80 2024-09-17T01:05:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.395+0000 7f2aadffb640 1 -- 172.21.15.2:0/2597212871 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2aa800ada0 con 0x7f2ab80fcf80 2024-09-17T01:05:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.395+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2597212871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab8119610 con 0x7f2ab80fcf80 2024-09-17T01:05:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.395+0000 7f2aadffb640 1 -- 172.21.15.2:0/2597212871 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aa80113a0 con 0x7f2ab80fcf80 2024-09-17T01:05:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.395+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2597212871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab81199c0 con 0x7f2ab80fcf80 2024-09-17T01:05:12.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.397+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2597212871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab80fcbc0 con 0x7f2ab80fcf80 2024-09-17T01:05:12.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.397+0000 7f2aadffb640 1 -- 172.21.15.2:0/2597212871 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92271+0+0 (secure 0 0 0) 0x7f2aa800a900 con 0x7f2ab80fcf80 2024-09-17T01:05:12.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.397+0000 7f2aadffb640 1 --2- 172.21.15.2:0/2597212871 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f2aa406de30 0x7f2aa40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:12.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.397+0000 7f2aadffb640 1 -- 172.21.15.2:0/2597212871 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f2aa808d880 con 0x7f2ab80fcf80 2024-09-17T01:05:12.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.397+0000 7f2abd297640 1 --2- 172.21.15.2:0/2597212871 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f2aa406de30 0x7f2aa40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:12.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.398+0000 7f2abd297640 1 --2- 172.21.15.2:0/2597212871 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f2aa406de30 0x7f2aa40702e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009ac0 tx=0x7f2ab4035040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:12.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.402+0000 7f2aadffb640 1 -- 172.21.15.2:0/2597212871 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f2aa8057240 con 0x7f2ab80fcf80 2024-09-17T01:05:12.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.621+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2597212871 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ab80657d0 con 0x7f2aa406de30 2024-09-17T01:05:12.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.622+0000 7f2aadffb640 1 -- 172.21.15.2:0/2597212871 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f2ab80657d0 con 0x7f2aa406de30 2024-09-17T01:05:12.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.626+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2597212871 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f2aa406de30 msgr2=0x7f2aa40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:12.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.626+0000 7f2abf4fb640 1 --2- 172.21.15.2:0/2597212871 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f2aa406de30 0x7f2aa40702e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009ac0 tx=0x7f2ab4035040 comp rx=0 tx=0).stop 2024-09-17T01:05:12.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.626+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2597212871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab80fcf80 msgr2=0x7f2ab810c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:12.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.626+0000 7f2abf4fb640 1 --2- 172.21.15.2:0/2597212871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab80fcf80 0x7f2ab810c4e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800c790 tx=0x7f2aa80043c0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.626+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2597212871 shutdown_connections 2024-09-17T01:05:12.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.626+0000 7f2abf4fb640 1 --2- 172.21.15.2:0/2597212871 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f2aa406de30 0x7f2aa40702e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.626+0000 7f2abf4fb640 1 --2- 172.21.15.2:0/2597212871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ab80fcf80 0x7f2ab810c4e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.626+0000 7f2abf4fb640 1 --2- 172.21.15.2:0/2597212871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ab80fb810 0x7f2ab810bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.626+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2597212871 >> 172.21.15.2:0/2597212871 conn(0x7f2ab80723b0 msgr2=0x7f2ab80fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:12.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.626+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2597212871 shutdown_connections 2024-09-17T01:05:12.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.626+0000 7f2abf4fb640 1 -- 172.21.15.2:0/2597212871 wait complete. 2024-09-17T01:05:12.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.715+0000 7f8b51afa640 1 -- 172.21.15.2:0/215510222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c102ed0 msgr2=0x7f8b4c0fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:12.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.715+0000 7f8b51afa640 1 --2- 172.21.15.2:0/215510222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c102ed0 0x7f8b4c0fc590 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8b400048d0 tx=0x7f8b40009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.715+0000 7f8b51afa640 1 -- 172.21.15.2:0/215510222 shutdown_connections 2024-09-17T01:05:12.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.715+0000 7f8b51afa640 1 --2- 172.21.15.2:0/215510222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c102ed0 0x7f8b4c0fc590 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.715+0000 7f8b51afa640 1 --2- 172.21.15.2:0/215510222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b4c102530 0x7f8b4c102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.715+0000 7f8b51afa640 1 -- 172.21.15.2:0/215510222 >> 172.21.15.2:0/215510222 conn(0x7f8b4c0f80f0 msgr2=0x7f8b4c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.715+0000 7f8b51afa640 1 -- 172.21.15.2:0/215510222 shutdown_connections 2024-09-17T01:05:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.715+0000 7f8b51afa640 1 -- 172.21.15.2:0/215510222 wait complete. 2024-09-17T01:05:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.716+0000 7f8b51afa640 1 Processor -- start 2024-09-17T01:05:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.716+0000 7f8b51afa640 1 -- start start 2024-09-17T01:05:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.716+0000 7f8b51afa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b4c102530 0x7f8b4c1131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.716+0000 7f8b51afa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c102ed0 0x7f8b4c113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.716+0000 7f8b51afa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c113d10 con 0x7f8b4c102ed0 2024-09-17T01:05:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.716+0000 7f8b51afa640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c10d150 con 0x7f8b4c102530 2024-09-17T01:05:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.717+0000 7f8b4affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c102ed0 0x7f8b4c113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.717+0000 7f8b4affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c102ed0 0x7f8b4c113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54758/0 (socket says 172.21.15.2:54758) 2024-09-17T01:05:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.717+0000 7f8b4affd640 1 -- 172.21.15.2:0/2618689867 learned_addr learned my addr 172.21.15.2:0/2618689867 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.717+0000 7f8b4b7fe640 1 --2- 172.21.15.2:0/2618689867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b4c102530 0x7f8b4c1131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.717+0000 7f8b4affd640 1 -- 172.21.15.2:0/2618689867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b4c102530 msgr2=0x7f8b4c1131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.717+0000 7f8b4affd640 1 --2- 172.21.15.2:0/2618689867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b4c102530 0x7f8b4c1131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.717+0000 7f8b4affd640 1 -- 172.21.15.2:0/2618689867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b40005040 con 0x7f8b4c102ed0 2024-09-17T01:05:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.717+0000 7f8b4affd640 1 --2- 172.21.15.2:0/2618689867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c102ed0 0x7f8b4c113710 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8b40003080 tx=0x7f8b40009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.717+0000 7f8b33fff640 1 -- 172.21.15.2:0/2618689867 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b40038070 con 0x7f8b4c102ed0 2024-09-17T01:05:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.717+0000 7f8b33fff640 1 -- 172.21.15.2:0/2618689867 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8b40009760 con 0x7f8b4c102ed0 2024-09-17T01:05:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.717+0000 7f8b33fff640 1 -- 172.21.15.2:0/2618689867 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b40033420 con 0x7f8b4c102ed0 2024-09-17T01:05:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.718+0000 7f8b51afa640 1 -- 172.21.15.2:0/2618689867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c10d3d0 con 0x7f8b4c102ed0 2024-09-17T01:05:12.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.718+0000 7f8b51afa640 1 -- 172.21.15.2:0/2618689867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c10d850 con 0x7f8b4c102ed0 2024-09-17T01:05:12.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.720+0000 7f8b51afa640 1 -- 172.21.15.2:0/2618689867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c0fdcb0 con 0x7f8b4c102ed0 2024-09-17T01:05:12.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.720+0000 7f8b33fff640 1 -- 172.21.15.2:0/2618689867 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92271+0+0 (secure 0 0 0) 0x7f8b40030020 con 0x7f8b4c102ed0 2024-09-17T01:05:12.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.720+0000 7f8b33fff640 1 --2- 172.21.15.2:0/2618689867 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f8b3406de30 0x7f8b340702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:12.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.720+0000 7f8b33fff640 1 -- 172.21.15.2:0/2618689867 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f8b400ad290 con 0x7f8b4c102ed0 2024-09-17T01:05:12.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.721+0000 7f8b4b7fe640 1 --2- 172.21.15.2:0/2618689867 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f8b3406de30 0x7f8b340702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:12.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.721+0000 7f8b4b7fe640 1 --2- 172.21.15.2:0/2618689867 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f8b3406de30 0x7f8b340702e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c007fd0 tx=0x7f8b3c009040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:12.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.725+0000 7f8b33fff640 1 -- 172.21.15.2:0/2618689867 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8b40076c50 con 0x7f8b4c102ed0 2024-09-17T01:05:12.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.910+0000 7f8b51afa640 1 -- 172.21.15.2:0/2618689867 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b4c113e50 con 0x7f8b3406de30 2024-09-17T01:05:12.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.919+0000 7f8b33fff640 1 -- 172.21.15.2:0/2618689867 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8b3c004a10 con 0x7f8b3406de30 2024-09-17T01:05:12.918 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:05:12.918 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (2m) 56s ago 11m 17.7M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:05:12.918 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (11m) 56s ago 11m 6903k - 17.2.7-1635-g4a704134 f22ead590bad 53b003b1ad6f 2024-09-17T01:05:12.918 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (10m) 79s ago 10m 6891k - 17.2.7-1635-g4a704134 f22ead590bad 6ec40439e9b5 2024-09-17T01:05:12.918 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (62s) 56s ago 10m 45.9M - 9.4.12 2bacad6d85d8 5fe408c103d6 2024-09-17T01:05:12.918 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (5m) 56s ago 5m 125M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:05:12.918 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (5m) 56s ago 5m 65.4M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:05:12.918 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (5m) 79s ago 5m 64.7M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:05:12.918 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (5m) 79s ago 5m 115M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:05:12.918 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (114s) 56s ago 12m 501M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:05:12.918 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (82s) 79s ago 10m 70.9M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:05:12.919 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (12m) 56s ago 12m 54.1M 2048M 17.2.7-1635-g4a704134 f22ead590bad 08b932b41bfa 2024-09-17T01:05:12.919 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (10m) 79s ago 10m 43.7M 2048M 17.2.7-1635-g4a704134 f22ead590bad 1c9583d52c94 2024-09-17T01:05:12.919 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (2m) 56s ago 11m 8380k - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:05:12.919 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (119s) 79s ago 10m 8258k - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:05:12.919 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (9m) 56s ago 9m 225M 1558M 17.2.7-1635-g4a704134 f22ead590bad 720f74f40752 2024-09-17T01:05:12.919 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (9m) 56s ago 9m 242M 1558M 17.2.7-1635-g4a704134 f22ead590bad 629defddb38c 2024-09-17T01:05:12.919 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (8m) 56s ago 8m 196M 1558M 17.2.7-1635-g4a704134 f22ead590bad 5dff1cf9fc56 2024-09-17T01:05:12.919 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (8m) 79s ago 8m 270M 2581M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:05:12.919 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (7m) 79s ago 7m 238M 2581M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:05:12.919 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (7m) 79s ago 7m 220M 2581M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:05:12.919 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (88s) 56s ago 10m 46.1M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:05:12.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.921+0000 7f8b51afa640 1 -- 172.21.15.2:0/2618689867 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f8b3406de30 msgr2=0x7f8b340702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:12.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.921+0000 7f8b51afa640 1 --2- 172.21.15.2:0/2618689867 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f8b3406de30 0x7f8b340702e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c007fd0 tx=0x7f8b3c009040 comp rx=0 tx=0).stop 2024-09-17T01:05:12.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.921+0000 7f8b51afa640 1 -- 172.21.15.2:0/2618689867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c102ed0 msgr2=0x7f8b4c113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:12.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.921+0000 7f8b51afa640 1 --2- 172.21.15.2:0/2618689867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c102ed0 0x7f8b4c113710 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8b40003080 tx=0x7f8b40009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.921+0000 7f8b51afa640 1 -- 172.21.15.2:0/2618689867 shutdown_connections 2024-09-17T01:05:12.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.921+0000 7f8b51afa640 1 --2- 172.21.15.2:0/2618689867 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f8b3406de30 0x7f8b340702e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.921+0000 7f8b51afa640 1 --2- 172.21.15.2:0/2618689867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4c102ed0 0x7f8b4c113710 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.921+0000 7f8b51afa640 1 --2- 172.21.15.2:0/2618689867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b4c102530 0x7f8b4c1131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:12.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.921+0000 7f8b51afa640 1 -- 172.21.15.2:0/2618689867 >> 172.21.15.2:0/2618689867 conn(0x7f8b4c0f80f0 msgr2=0x7f8b4c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:12.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.922+0000 7f8b51afa640 1 -- 172.21.15.2:0/2618689867 shutdown_connections 2024-09-17T01:05:12.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:12.922+0000 7f8b51afa640 1 -- 172.21.15.2:0/2618689867 wait complete. 2024-09-17T01:05:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.003+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/1234717479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8dc0fe450 msgr2=0x7fc8dc0fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.003+0000 7fc8e2b1a640 1 --2- 172.21.15.2:0/1234717479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8dc0fe450 0x7fc8dc0fe820 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00048d0 tx=0x7fc8d0009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.003+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/1234717479 shutdown_connections 2024-09-17T01:05:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.003+0000 7fc8e2b1a640 1 --2- 172.21.15.2:0/1234717479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8dc064fe0 0x7fc8dc065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.003+0000 7fc8e2b1a640 1 --2- 172.21.15.2:0/1234717479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8dc0fe450 0x7fc8dc0fe820 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.003+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/1234717479 >> 172.21.15.2:0/1234717479 conn(0x7fc8dc0723b0 msgr2=0x7fc8dc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:13.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.003+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/1234717479 shutdown_connections 2024-09-17T01:05:13.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.003+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/1234717479 wait complete. 2024-09-17T01:05:13.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.004+0000 7fc8e2b1a640 1 Processor -- start 2024-09-17T01:05:13.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.004+0000 7fc8e2b1a640 1 -- start start 2024-09-17T01:05:13.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.004+0000 7fc8e2b1a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8dc064fe0 0x7fc8dc113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.004+0000 7fc8e2b1a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8dc0fe450 0x7fc8dc113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.004+0000 7fc8e2b1a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc113d50 con 0x7fc8dc0fe450 2024-09-17T01:05:13.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.004+0000 7fc8e2b1a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc10d190 con 0x7fc8dc064fe0 2024-09-17T01:05:13.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.004+0000 7fc8dbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8dc0fe450 0x7fc8dc113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.004+0000 7fc8dbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8dc0fe450 0x7fc8dc113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54772/0 (socket says 172.21.15.2:54772) 2024-09-17T01:05:13.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.004+0000 7fc8dbfff640 1 -- 172.21.15.2:0/4211558319 learned_addr learned my addr 172.21.15.2:0/4211558319 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:13.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.005+0000 7fc8e08b6640 1 --2- 172.21.15.2:0/4211558319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8dc064fe0 0x7fc8dc113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.005+0000 7fc8dbfff640 1 -- 172.21.15.2:0/4211558319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8dc064fe0 msgr2=0x7fc8dc113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.005+0000 7fc8dbfff640 1 --2- 172.21.15.2:0/4211558319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8dc064fe0 0x7fc8dc113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.005+0000 7fc8dbfff640 1 -- 172.21.15.2:0/4211558319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d0005040 con 0x7fc8dc0fe450 2024-09-17T01:05:13.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.005+0000 7fc8dbfff640 1 --2- 172.21.15.2:0/4211558319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8dc0fe450 0x7fc8dc113750 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8002a50 tx=0x7fc8c8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:13.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.005+0000 7fc8d97fa640 1 -- 172.21.15.2:0/4211558319 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8c8007c30 con 0x7fc8dc0fe450 2024-09-17T01:05:13.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.005+0000 7fc8d97fa640 1 -- 172.21.15.2:0/4211558319 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc8c800f040 con 0x7fc8dc0fe450 2024-09-17T01:05:13.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.005+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/4211558319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc10d470 con 0x7fc8dc0fe450 2024-09-17T01:05:13.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.005+0000 7fc8d97fa640 1 -- 172.21.15.2:0/4211558319 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8c800da90 con 0x7fc8dc0fe450 2024-09-17T01:05:13.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.005+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/4211558319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc10d990 con 0x7fc8dc0fe450 2024-09-17T01:05:13.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.006+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/4211558319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc0fdce0 con 0x7fc8dc0fe450 2024-09-17T01:05:13.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.007+0000 7fc8d97fa640 1 -- 172.21.15.2:0/4211558319 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92271+0+0 (secure 0 0 0) 0x7fc8c800dcd0 con 0x7fc8dc0fe450 2024-09-17T01:05:13.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.007+0000 7fc8d97fa640 1 --2- 172.21.15.2:0/4211558319 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fc8cc06de30 0x7fc8cc0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.008+0000 7fc8d97fa640 1 -- 172.21.15.2:0/4211558319 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fc8c808d040 con 0x7fc8dc0fe450 2024-09-17T01:05:13.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.008+0000 7fc8e08b6640 1 --2- 172.21.15.2:0/4211558319 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fc8cc06de30 0x7fc8cc0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.008+0000 7fc8e08b6640 1 --2- 172.21.15.2:0/4211558319 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fc8cc06de30 0x7fc8cc0702e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009ac0 tx=0x7fc8d0035040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:13.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.012+0000 7fc8d97fa640 1 -- 172.21.15.2:0/4211558319 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fc8c8056a00 con 0x7fc8dc0fe450 2024-09-17T01:05:13.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.256+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/4211558319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc8dc10e880 con 0x7fc8dc0fe450 2024-09-17T01:05:13.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.257+0000 7fc8d97fa640 1 -- 172.21.15.2:0/4211558319 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fc8c805a0c0 con 0x7fc8dc0fe450 2024-09-17T01:05:13.255 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:05:13.255 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:05:13.255 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2 2024-09-17T01:05:13.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:05:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:05:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:05:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:05:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:05:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T01:05:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:05:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:05:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:05:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:05:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:05:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 12, 2024-09-17T01:05:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:05:13.256 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:05:13.256 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:05:13.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.259+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/4211558319 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fc8cc06de30 msgr2=0x7fc8cc0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.259+0000 7fc8e2b1a640 1 --2- 172.21.15.2:0/4211558319 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fc8cc06de30 0x7fc8cc0702e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009ac0 tx=0x7fc8d0035040 comp rx=0 tx=0).stop 2024-09-17T01:05:13.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.259+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/4211558319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8dc0fe450 msgr2=0x7fc8dc113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.259+0000 7fc8e2b1a640 1 --2- 172.21.15.2:0/4211558319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8dc0fe450 0x7fc8dc113750 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8002a50 tx=0x7fc8c8004600 comp rx=0 tx=0).stop 2024-09-17T01:05:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.259+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/4211558319 shutdown_connections 2024-09-17T01:05:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.259+0000 7fc8e2b1a640 1 --2- 172.21.15.2:0/4211558319 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fc8cc06de30 0x7fc8cc0702e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.259+0000 7fc8e2b1a640 1 --2- 172.21.15.2:0/4211558319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8dc0fe450 0x7fc8dc113750 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.259+0000 7fc8e2b1a640 1 --2- 172.21.15.2:0/4211558319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8dc064fe0 0x7fc8dc113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.259+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/4211558319 >> 172.21.15.2:0/4211558319 conn(0x7fc8dc0723b0 msgr2=0x7fc8dc0fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.259+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/4211558319 shutdown_connections 2024-09-17T01:05:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.259+0000 7fc8e2b1a640 1 -- 172.21.15.2:0/4211558319 wait complete. 2024-09-17T01:05:13.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.340+0000 7f364a369640 1 -- 172.21.15.2:0/1032306785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3644102530 msgr2=0x7f3644102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.340+0000 7f364a369640 1 --2- 172.21.15.2:0/1032306785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3644102530 0x7f3644102900 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f36340048d0 tx=0x7f3634009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.340+0000 7f364a369640 1 -- 172.21.15.2:0/1032306785 shutdown_connections 2024-09-17T01:05:13.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.340+0000 7f364a369640 1 --2- 172.21.15.2:0/1032306785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3644102ed0 0x7f36440fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.340+0000 7f364a369640 1 --2- 172.21.15.2:0/1032306785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3644102530 0x7f3644102900 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.341+0000 7f364a369640 1 -- 172.21.15.2:0/1032306785 >> 172.21.15.2:0/1032306785 conn(0x7f36440f80f0 msgr2=0x7f36440fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:13.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.341+0000 7f364a369640 1 -- 172.21.15.2:0/1032306785 shutdown_connections 2024-09-17T01:05:13.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.341+0000 7f364a369640 1 -- 172.21.15.2:0/1032306785 wait complete. 2024-09-17T01:05:13.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.341+0000 7f364a369640 1 Processor -- start 2024-09-17T01:05:13.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.341+0000 7f364a369640 1 -- start start 2024-09-17T01:05:13.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.342+0000 7f364a369640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3644102530 0x7f364406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.342+0000 7f364a369640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3644102ed0 0x7f364406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.342+0000 7f364a369640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3644070490 con 0x7f3644102ed0 2024-09-17T01:05:13.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.342+0000 7f364a369640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3644070600 con 0x7f3644102530 2024-09-17T01:05:13.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.342+0000 7f36437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3644102ed0 0x7f364406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.342+0000 7f36437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3644102ed0 0x7f364406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54788/0 (socket says 172.21.15.2:54788) 2024-09-17T01:05:13.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.342+0000 7f36437fe640 1 -- 172.21.15.2:0/2899987605 learned_addr learned my addr 172.21.15.2:0/2899987605 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:13.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.342+0000 7f3643fff640 1 --2- 172.21.15.2:0/2899987605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3644102530 0x7f364406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.342+0000 7f36437fe640 1 -- 172.21.15.2:0/2899987605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3644102530 msgr2=0x7f364406fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.342+0000 7f36437fe640 1 --2- 172.21.15.2:0/2899987605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3644102530 0x7f364406fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.342+0000 7f36437fe640 1 -- 172.21.15.2:0/2899987605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3634005040 con 0x7f3644102ed0 2024-09-17T01:05:13.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.342+0000 7f36437fe640 1 --2- 172.21.15.2:0/2899987605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3644102ed0 0x7f364406ff50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3638002840 tx=0x7f3638004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:13.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.342+0000 7f3640ff9640 1 -- 172.21.15.2:0/2899987605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3638007c30 con 0x7f3644102ed0 2024-09-17T01:05:13.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.343+0000 7f3640ff9640 1 -- 172.21.15.2:0/2899987605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f363800f040 con 0x7f3644102ed0 2024-09-17T01:05:13.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.343+0000 7f364a369640 1 -- 172.21.15.2:0/2899987605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3644070890 con 0x7f3644102ed0 2024-09-17T01:05:13.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.343+0000 7f3640ff9640 1 -- 172.21.15.2:0/2899987605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f363800d990 con 0x7f3644102ed0 2024-09-17T01:05:13.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.343+0000 7f364a369640 1 -- 172.21.15.2:0/2899987605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3644119970 con 0x7f3644102ed0 2024-09-17T01:05:13.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.344+0000 7f364a369640 1 -- 172.21.15.2:0/2899987605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36440fdcb0 con 0x7f3644102ed0 2024-09-17T01:05:13.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.344+0000 7f3640ff9640 1 -- 172.21.15.2:0/2899987605 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92271+0+0 (secure 0 0 0) 0x7f3638009600 con 0x7f3644102ed0 2024-09-17T01:05:13.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.345+0000 7f3640ff9640 1 --2- 172.21.15.2:0/2899987605 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f362c06de30 0x7f362c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.345+0000 7f3640ff9640 1 -- 172.21.15.2:0/2899987605 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f363808cf60 con 0x7f3644102ed0 2024-09-17T01:05:13.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.345+0000 7f3643fff640 1 --2- 172.21.15.2:0/2899987605 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f362c06de30 0x7f362c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.345+0000 7f3643fff640 1 --2- 172.21.15.2:0/2899987605 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f362c06de30 0x7f362c0702e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3634009ac0 tx=0x7f3634035040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:13.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.349+0000 7f3640ff9640 1 -- 172.21.15.2:0/2899987605 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f36380c1670 con 0x7f3644102ed0 2024-09-17T01:05:13.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.580+0000 7f364a369640 1 -- 172.21.15.2:0/2899987605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3644109600 con 0x7f3644102ed0 2024-09-17T01:05:13.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.581+0000 7f3640ff9640 1 -- 172.21.15.2:0/2899987605 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1857 (secure 0 0 0) 0x7f3638056950 con 0x7f3644102ed0 2024-09-17T01:05:13.579 INFO:teuthology.orchestra.run.smithi002.stdout:e23 2024-09-17T01:05:13.579 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:05:13.579 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:05:13.579 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-17T01:05:13.580 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:05:13.580 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:05:13.580 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-17T01:05:13.580 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 23 2024-09-17T01:05:13.580 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:05:13.580 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-17T00:59:20.485696+0000 2024-09-17T01:05:13.580 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-17T01:02:38.321321+0000 2024-09-17T01:05:13.580 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-17T01:05:13.580 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-17T01:05:13.580 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-17T01:05:13.580 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-17T01:05:13.580 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-17T01:05:13.580 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-17T01:05:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-17T01:05:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 44 2024-09-17T01:05:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:05:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2024-09-17T01:05:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2024-09-17T01:05:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=14464,1=24269} 2024-09-17T01:05:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-17T01:05:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-17T01:05:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-17T01:05:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-17T01:05:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-17T01:05:13.581 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-17T01:05:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-17T01:05:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-17T01:05:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.fmyyzz{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.zmrgxd{0:24287} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/2986470392,v1:172.21.15.2:6827/2986470392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.hgawhu{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:13.582 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.heckcd{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:05:13.582 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:05:13.583 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 23 2024-09-17T01:05:13.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.583+0000 7f364a369640 1 -- 172.21.15.2:0/2899987605 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f362c06de30 msgr2=0x7f362c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.583+0000 7f364a369640 1 --2- 172.21.15.2:0/2899987605 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f362c06de30 0x7f362c0702e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3634009ac0 tx=0x7f3634035040 comp rx=0 tx=0).stop 2024-09-17T01:05:13.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.583+0000 7f364a369640 1 -- 172.21.15.2:0/2899987605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3644102ed0 msgr2=0x7f364406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.583+0000 7f364a369640 1 --2- 172.21.15.2:0/2899987605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3644102ed0 0x7f364406ff50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3638002840 tx=0x7f3638004570 comp rx=0 tx=0).stop 2024-09-17T01:05:13.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.583+0000 7f364a369640 1 -- 172.21.15.2:0/2899987605 shutdown_connections 2024-09-17T01:05:13.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.583+0000 7f364a369640 1 --2- 172.21.15.2:0/2899987605 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f362c06de30 0x7f362c0702e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.583+0000 7f364a369640 1 --2- 172.21.15.2:0/2899987605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3644102ed0 0x7f364406ff50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.583+0000 7f364a369640 1 --2- 172.21.15.2:0/2899987605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3644102530 0x7f364406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.583+0000 7f364a369640 1 -- 172.21.15.2:0/2899987605 >> 172.21.15.2:0/2899987605 conn(0x7f36440f80f0 msgr2=0x7f36440f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.583+0000 7f364a369640 1 -- 172.21.15.2:0/2899987605 shutdown_connections 2024-09-17T01:05:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.583+0000 7f364a369640 1 -- 172.21.15.2:0/2899987605 wait complete. 2024-09-17T01:05:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.667+0000 7fecadaf9640 1 -- 172.21.15.2:0/1126767281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca8102530 msgr2=0x7feca8102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.667+0000 7fecadaf9640 1 --2- 172.21.15.2:0/1126767281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca8102530 0x7feca8102900 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fec980048d0 tx=0x7fec98009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.667+0000 7fecadaf9640 1 -- 172.21.15.2:0/1126767281 shutdown_connections 2024-09-17T01:05:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.667+0000 7fecadaf9640 1 --2- 172.21.15.2:0/1126767281 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feca8102ed0 0x7feca80fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.667+0000 7fecadaf9640 1 --2- 172.21.15.2:0/1126767281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca8102530 0x7feca8102900 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.667+0000 7fecadaf9640 1 -- 172.21.15.2:0/1126767281 >> 172.21.15.2:0/1126767281 conn(0x7feca80f80f0 msgr2=0x7feca80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.667+0000 7fecadaf9640 1 -- 172.21.15.2:0/1126767281 shutdown_connections 2024-09-17T01:05:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.667+0000 7fecadaf9640 1 -- 172.21.15.2:0/1126767281 wait complete. 2024-09-17T01:05:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.668+0000 7fecadaf9640 1 Processor -- start 2024-09-17T01:05:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.668+0000 7fecadaf9640 1 -- start start 2024-09-17T01:05:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.668+0000 7fecadaf9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feca8102530 0x7feca8113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.668+0000 7fecadaf9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca8102ed0 0x7feca8113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.668+0000 7fecadaf9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca8113e20 con 0x7feca8102ed0 2024-09-17T01:05:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.668+0000 7fecadaf9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca810d1d0 con 0x7feca8102530 2024-09-17T01:05:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.668+0000 7feca6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca8102ed0 0x7feca8113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.668+0000 7feca6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca8102ed0 0x7feca8113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54814/0 (socket says 172.21.15.2:54814) 2024-09-17T01:05:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.668+0000 7feca6ffd640 1 -- 172.21.15.2:0/283490560 learned_addr learned my addr 172.21.15.2:0/283490560 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.669+0000 7feca77fe640 1 --2- 172.21.15.2:0/283490560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feca8102530 0x7feca8113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.669+0000 7feca6ffd640 1 -- 172.21.15.2:0/283490560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feca8102530 msgr2=0x7feca8113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.669+0000 7feca6ffd640 1 --2- 172.21.15.2:0/283490560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feca8102530 0x7feca8113250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.669+0000 7feca6ffd640 1 -- 172.21.15.2:0/283490560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec98005040 con 0x7feca8102ed0 2024-09-17T01:05:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.669+0000 7feca6ffd640 1 --2- 172.21.15.2:0/283490560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca8102ed0 0x7feca8113790 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00b540 tx=0x7fec9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.669+0000 7fec8ffff640 1 -- 172.21.15.2:0/283490560 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec9c00f6f0 con 0x7feca8102ed0 2024-09-17T01:05:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.669+0000 7fec8ffff640 1 -- 172.21.15.2:0/283490560 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fec9c00fcf0 con 0x7feca8102ed0 2024-09-17T01:05:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.669+0000 7fecadaf9640 1 -- 172.21.15.2:0/283490560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca810d4b0 con 0x7feca8102ed0 2024-09-17T01:05:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.669+0000 7fec8ffff640 1 -- 172.21.15.2:0/283490560 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec9c011e80 con 0x7feca8102ed0 2024-09-17T01:05:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.669+0000 7fecadaf9640 1 -- 172.21.15.2:0/283490560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca810d9d0 con 0x7feca8102ed0 2024-09-17T01:05:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.671+0000 7fecadaf9640 1 -- 172.21.15.2:0/283490560 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca80fdcb0 con 0x7feca8102ed0 2024-09-17T01:05:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.671+0000 7fec8ffff640 1 -- 172.21.15.2:0/283490560 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92271+0+0 (secure 0 0 0) 0x7fec9c0116b0 con 0x7feca8102ed0 2024-09-17T01:05:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.672+0000 7fec8ffff640 1 --2- 172.21.15.2:0/283490560 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fec9006de30 0x7fec900702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.672+0000 7fec8ffff640 1 -- 172.21.15.2:0/283490560 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fec9c08d610 con 0x7feca8102ed0 2024-09-17T01:05:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.672+0000 7feca77fe640 1 --2- 172.21.15.2:0/283490560 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fec9006de30 0x7fec900702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.673+0000 7feca77fe640 1 --2- 172.21.15.2:0/283490560 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fec9006de30 0x7fec900702e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fec980048a0 tx=0x7fec98035040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.677+0000 7fec8ffff640 1 -- 172.21.15.2:0/283490560 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fec9c057070 con 0x7feca8102ed0 2024-09-17T01:05:13.829 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:13 smithi002 ceph-mon[27650]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:13.829 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:13 smithi002 ceph-mon[27650]: pgmap v55: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:05:13.829 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:13 smithi002 ceph-mon[27650]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:13.829 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:13 smithi002 ceph-mon[27650]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:13.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.872+0000 7fecadaf9640 1 -- 172.21.15.2:0/283490560 --> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feca81095e0 con 0x7fec9006de30 2024-09-17T01:05:13.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.873+0000 7fec8ffff640 1 -- 172.21.15.2:0/283490560 <== mgr.14648 v2:172.21.15.2:6800/2519726568 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7feca81095e0 con 0x7fec9006de30 2024-09-17T01:05:13.871 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:05:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:05:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:05:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:05:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-17T01:05:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr" 2024-09-17T01:05:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-17T01:05:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "2/21 daemons upgraded", 2024-09-17T01:05:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mon daemons", 2024-09-17T01:05:13.872 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:05:13.872 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:05:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.875+0000 7fecadaf9640 1 -- 172.21.15.2:0/283490560 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fec9006de30 msgr2=0x7fec900702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.875+0000 7fecadaf9640 1 --2- 172.21.15.2:0/283490560 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fec9006de30 0x7fec900702e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fec980048a0 tx=0x7fec98035040 comp rx=0 tx=0).stop 2024-09-17T01:05:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.875+0000 7fecadaf9640 1 -- 172.21.15.2:0/283490560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca8102ed0 msgr2=0x7feca8113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.875+0000 7fecadaf9640 1 --2- 172.21.15.2:0/283490560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca8102ed0 0x7feca8113790 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00b540 tx=0x7fec9c0091a0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.875+0000 7fecadaf9640 1 -- 172.21.15.2:0/283490560 shutdown_connections 2024-09-17T01:05:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.875+0000 7fecadaf9640 1 --2- 172.21.15.2:0/283490560 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7fec9006de30 0x7fec900702e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.875+0000 7fecadaf9640 1 --2- 172.21.15.2:0/283490560 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feca8102ed0 0x7feca8113790 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.875+0000 7fecadaf9640 1 --2- 172.21.15.2:0/283490560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feca8102530 0x7feca8113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.875+0000 7fecadaf9640 1 -- 172.21.15.2:0/283490560 >> 172.21.15.2:0/283490560 conn(0x7feca80f80f0 msgr2=0x7feca80f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.875+0000 7fecadaf9640 1 -- 172.21.15.2:0/283490560 shutdown_connections 2024-09-17T01:05:13.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.875+0000 7fecadaf9640 1 -- 172.21.15.2:0/283490560 wait complete. 2024-09-17T01:05:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.957+0000 7f33ea8c3640 1 -- 172.21.15.2:0/473160782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e406fff0 msgr2=0x7f33e4070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.957+0000 7f33ea8c3640 1 --2- 172.21.15.2:0/473160782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e406fff0 0x7f33e4070460 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f33d80048d0 tx=0x7f33d8009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.957+0000 7f33ea8c3640 1 -- 172.21.15.2:0/473160782 shutdown_connections 2024-09-17T01:05:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.957+0000 7f33ea8c3640 1 --2- 172.21.15.2:0/473160782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e406fff0 0x7f33e4070460 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.957+0000 7f33ea8c3640 1 --2- 172.21.15.2:0/473160782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e40716e0 0x7f33e406fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.957+0000 7f33ea8c3640 1 -- 172.21.15.2:0/473160782 >> 172.21.15.2:0/473160782 conn(0x7f33e40f81a0 msgr2=0x7f33e40fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.957+0000 7f33ea8c3640 1 -- 172.21.15.2:0/473160782 shutdown_connections 2024-09-17T01:05:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.957+0000 7f33ea8c3640 1 -- 172.21.15.2:0/473160782 wait complete. 2024-09-17T01:05:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.958+0000 7f33ea8c3640 1 Processor -- start 2024-09-17T01:05:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.958+0000 7f33ea8c3640 1 -- start start 2024-09-17T01:05:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.958+0000 7f33ea8c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e406fff0 0x7f33e4119840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.958+0000 7f33ea8c3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e40716e0 0x7f33e4119d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.959+0000 7f33ea8c3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e411a3d0 con 0x7f33e406fff0 2024-09-17T01:05:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.959+0000 7f33ea8c3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e41137e0 con 0x7f33e40716e0 2024-09-17T01:05:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.959+0000 7f33e3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e406fff0 0x7f33e4119840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.959+0000 7f33e3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e406fff0 0x7f33e4119840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54828/0 (socket says 172.21.15.2:54828) 2024-09-17T01:05:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.959+0000 7f33e3fff640 1 -- 172.21.15.2:0/2861985784 learned_addr learned my addr 172.21.15.2:0/2861985784 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:13.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.959+0000 7f33e37fe640 1 --2- 172.21.15.2:0/2861985784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e40716e0 0x7f33e4119d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.959+0000 7f33e3fff640 1 -- 172.21.15.2:0/2861985784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e40716e0 msgr2=0x7f33e4119d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.959+0000 7f33e3fff640 1 --2- 172.21.15.2:0/2861985784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e40716e0 0x7f33e4119d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.959+0000 7f33e3fff640 1 -- 172.21.15.2:0/2861985784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d8005040 con 0x7f33e406fff0 2024-09-17T01:05:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.960+0000 7f33e3fff640 1 --2- 172.21.15.2:0/2861985784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e406fff0 0x7f33e4119840 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f33d4002a50 tx=0x7f33d4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.960+0000 7f33e0ff9640 1 -- 172.21.15.2:0/2861985784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33d4007c30 con 0x7f33e406fff0 2024-09-17T01:05:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.960+0000 7f33ea8c3640 1 -- 172.21.15.2:0/2861985784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e4113ac0 con 0x7f33e406fff0 2024-09-17T01:05:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.960+0000 7f33e0ff9640 1 -- 172.21.15.2:0/2861985784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f33d400f040 con 0x7f33e406fff0 2024-09-17T01:05:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.960+0000 7f33e0ff9640 1 -- 172.21.15.2:0/2861985784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33d400dad0 con 0x7f33e406fff0 2024-09-17T01:05:13.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.960+0000 7f33ea8c3640 1 -- 172.21.15.2:0/2861985784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e4113fb0 con 0x7f33e406fff0 2024-09-17T01:05:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.961+0000 7f33ea8c3640 1 -- 172.21.15.2:0/2861985784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e40711f0 con 0x7f33e406fff0 2024-09-17T01:05:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.962+0000 7f33e0ff9640 1 -- 172.21.15.2:0/2861985784 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 92271+0+0 (secure 0 0 0) 0x7f33d400dc30 con 0x7f33e406fff0 2024-09-17T01:05:13.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.962+0000 7f33e0ff9640 1 --2- 172.21.15.2:0/2861985784 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f33cc06de30 0x7f33cc0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.962+0000 7f33e0ff9640 1 -- 172.21.15.2:0/2861985784 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f33d408d6a0 con 0x7f33e406fff0 2024-09-17T01:05:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.962+0000 7f33e37fe640 1 --2- 172.21.15.2:0/2861985784 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f33cc06de30 0x7f33cc0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:13.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.963+0000 7f33e37fe640 1 --2- 172.21.15.2:0/2861985784 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f33cc06de30 0x7f33cc0702e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f33d80048a0 tx=0x7f33d8035040 comp rx=0 tx=0).ready entity=mgr.14648 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:13.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:13.967+0000 7f33e0ff9640 1 -- 172.21.15.2:0/2861985784 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f33d4056fe0 con 0x7f33e406fff0 2024-09-17T01:05:14.130 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:13 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/4211558319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:13 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:14.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:13 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:13 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:13 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:14.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:13 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:05:14.131 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:13 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2899987605' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:05:14.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:14.210+0000 7f33ea8c3640 1 -- 172.21.15.2:0/2861985784 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f33e410fb80 con 0x7f33e406fff0 2024-09-17T01:05:14.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:14.211+0000 7f33e0ff9640 1 -- 172.21.15.2:0/2861985784 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f33d405a6a0 con 0x7f33e406fff0 2024-09-17T01:05:14.209 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:05:14.210 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:05:14.210 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:05:14.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:14.213+0000 7f33ea8c3640 1 -- 172.21.15.2:0/2861985784 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f33cc06de30 msgr2=0x7f33cc0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:14.213+0000 7f33ea8c3640 1 --2- 172.21.15.2:0/2861985784 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f33cc06de30 0x7f33cc0702e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f33d80048a0 tx=0x7f33d8035040 comp rx=0 tx=0).stop 2024-09-17T01:05:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:14.213+0000 7f33ea8c3640 1 -- 172.21.15.2:0/2861985784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e406fff0 msgr2=0x7f33e4119840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:14.213+0000 7f33ea8c3640 1 --2- 172.21.15.2:0/2861985784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e406fff0 0x7f33e4119840 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f33d4002a50 tx=0x7f33d4004600 comp rx=0 tx=0).stop 2024-09-17T01:05:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:14.213+0000 7f33ea8c3640 1 -- 172.21.15.2:0/2861985784 shutdown_connections 2024-09-17T01:05:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:14.213+0000 7f33ea8c3640 1 --2- 172.21.15.2:0/2861985784 >> [v2:172.21.15.2:6800/2519726568,v1:172.21.15.2:6801/2519726568] conn(0x7f33cc06de30 0x7f33cc0702e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:14.213+0000 7f33ea8c3640 1 --2- 172.21.15.2:0/2861985784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f33e40716e0 0x7f33e4119d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:14.213+0000 7f33ea8c3640 1 --2- 172.21.15.2:0/2861985784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33e406fff0 0x7f33e4119840 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:14.213+0000 7f33ea8c3640 1 -- 172.21.15.2:0/2861985784 >> 172.21.15.2:0/2861985784 conn(0x7f33e40f81a0 msgr2=0x7f33e40f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:14.213+0000 7f33ea8c3640 1 -- 172.21.15.2:0/2861985784 shutdown_connections 2024-09-17T01:05:14.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:14.213+0000 7f33ea8c3640 1 -- 172.21.15.2:0/2861985784 wait complete. 2024-09-17T01:05:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:13 smithi099 ceph-mon[34357]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:13 smithi099 ceph-mon[34357]: pgmap v55: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:05:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:13 smithi099 ceph-mon[34357]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:13 smithi099 ceph-mon[34357]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:13 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/4211558319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:13 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:13 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:13 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:13 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:13 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:05:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:13 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/2899987605' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:05:15.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:14 smithi002 ceph-mon[27650]: Upgrade: Target is version 19.1.1-330-gc2ddf972 (squid) 2024-09-17T01:05:15.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:14 smithi002 ceph-mon[27650]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, digests ['quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3'] 2024-09-17T01:05:15.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:14 smithi002 ceph-mon[27650]: Upgrade: Setting container_image for all mgr 2024-09-17T01:05:15.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:14 smithi002 ceph-mon[27650]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:15.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:14 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:15.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:14 smithi002 ceph-mon[27650]: from='client.? 172.21.15.2:0/2861985784' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:05:15.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:14 smithi099 ceph-mon[34357]: Upgrade: Target is version 19.1.1-330-gc2ddf972 (squid) 2024-09-17T01:05:15.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:14 smithi099 ceph-mon[34357]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, digests ['quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3'] 2024-09-17T01:05:15.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:14 smithi099 ceph-mon[34357]: Upgrade: Setting container_image for all mgr 2024-09-17T01:05:15.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:14 smithi099 ceph-mon[34357]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:15.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:14 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:15.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:14 smithi099 ceph-mon[34357]: from='client.? 172.21.15.2:0/2861985784' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:05:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:15 smithi002 ceph-mon[27650]: pgmap v56: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-17T01:05:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:15 smithi002 ceph-mon[27650]: Upgrade: Updating mon.smithi002 2024-09-17T01:05:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:15 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:15 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:05:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:15 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:05:16.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:15 smithi002 ceph-mon[27650]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:15 smithi002 ceph-mon[27650]: Deploying daemon mon.smithi002 on smithi002 2024-09-17T01:05:16.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:15 smithi099 ceph-mon[34357]: pgmap v56: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-17T01:05:16.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:15 smithi099 ceph-mon[34357]: Upgrade: Updating mon.smithi002 2024-09-17T01:05:16.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:15 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:16.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:15 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:05:16.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:15 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:05:16.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:15 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:16.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:15 smithi099 ceph-mon[34357]: Deploying daemon mon.smithi002 on smithi002 2024-09-17T01:05:16.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:16 smithi002 systemd[1]: Stopping Ceph mon.smithi002 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:05:17.099 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:16 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[27646]: 2024-09-17T01:05:16.793+0000 7fa9d46e4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi002 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:05:17.099 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:16 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[27646]: 2024-09-17T01:05:16.793+0000 7fa9d46e4640 -1 mon.smithi002@0(leader) e2 *** Got Signal Terminated *** 2024-09-17T01:05:17.099 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:16 smithi002 podman[97846]: 2024-09-17 01:05:16.978419451 +0000 UTC m=+0.294133151 container died 08b932b41bfa9090a8319243a47c8fa2a55f2bd4c8a1ebd2ac0d31fc727706dc (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, RELEASE=quincy-4a70413, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-17T01:05:17.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:17 smithi002 podman[97846]: 2024-09-17 01:05:17.369337451 +0000 UTC m=+0.685051150 container cleanup 08b932b41bfa9090a8319243a47c8fa2a55f2bd4c8a1ebd2ac0d31fc727706dc (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=quincy-4a70413, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-09-17T01:05:17.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:17 smithi002 bash[97846]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002 2024-09-17T01:05:17.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:17 smithi002 podman[97859]: 2024-09-17 01:05:17.529013746 +0000 UTC m=+0.543442828 container remove 08b932b41bfa9090a8319243a47c8fa2a55f2bd4c8a1ebd2ac0d31fc727706dc (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, GIT_CLEAN=True, RELEASE=quincy-4a70413, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-17T01:05:18.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:17 smithi002 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi002.service: Deactivated successfully. 2024-09-17T01:05:18.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:17 smithi002 systemd[1]: Stopped Ceph mon.smithi002 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:05:18.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:17 smithi002 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi002.service: Consumed 12.479s CPU time. 2024-09-17T01:05:18.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:17 smithi002 systemd[1]: Starting Ceph mon.smithi002 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:05:18.482 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 podman[97998]: 2024-09-17 01:05:18.118393853 +0000 UTC m=+0.016412605 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:05:18.482 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 podman[97998]: 2024-09-17 01:05:18.239169756 +0000 UTC m=+0.137188496 container create da5247385c2d65f1e126c9457b2c858f1cfe75634e1b8723d029a18da2efdd7e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, ceph=True) 2024-09-17T01:05:18.482 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 podman[97998]: 2024-09-17 01:05:18.459404717 +0000 UTC m=+0.357423465 container init da5247385c2d65f1e126c9457b2c858f1cfe75634e1b8723d029a18da2efdd7e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:05:18.482 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 podman[97998]: 2024-09-17 01:05:18.463212586 +0000 UTC m=+0.361231334 container start da5247385c2d65f1e126c9457b2c858f1cfe75634e1b8723d029a18da2efdd7e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-17T01:05:18.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:05:18.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-17T01:05:18.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: pidfile_write: ignore empty --pid-file 2024-09-17T01:05:18.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: load: jerasure load: lrc 2024-09-17T01:05:18.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:05:18.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Git sha 0 2024-09-17T01:05:18.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-17T01:05:18.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: DB SUMMARY 2024-09-17T01:05:18.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: DB Session ID: S8TYZVCGW3F75ZDYHLGT 2024-09-17T01:05:18.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:05:18.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:05:18.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1180 Bytes 2024-09-17T01:05:18.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi002/store.db dir, Total Num: 1, files: 000033.sst 2024-09-17T01:05:18.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi002/store.db: 000031.log size: 546255 ; 2024-09-17T01:05:18.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:05:18.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:05:18.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:05:18.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:05:18.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:05:18.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:05:18.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.env: 0x5621ba772940 2024-09-17T01:05:18.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:05:18.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.info_log: 0x5621bb4a38c0 2024-09-17T01:05:18.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:05:18.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.statistics: (nil) 2024-09-17T01:05:18.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.use_fsync: 0 2024-09-17T01:05:18.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:05:18.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:05:18.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:05:18.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:05:18.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:05:18.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:05:18.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:05:18.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:05:18.912 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:05:18.912 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:05:18.912 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:05:18.912 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.db_log_dir: 2024-09-17T01:05:18.912 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.wal_dir: 2024-09-17T01:05:18.912 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:05:18.913 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:05:18.913 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:05:18.913 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:05:18.913 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:05:18.913 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:05:18.913 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:05:18.914 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:05:18.914 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.write_buffer_manager: 0x5621bb4b2dc0 2024-09-17T01:05:18.914 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:05:18.914 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:05:18.914 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:05:18.914 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:05:18.914 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:05:18.915 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:05:18.915 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:05:18.915 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:05:18.915 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.unordered_write: 0 2024-09-17T01:05:18.915 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:05:18.915 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:05:18.916 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:05:18.916 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:05:18.916 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.row_cache: None 2024-09-17T01:05:18.916 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.wal_filter: None 2024-09-17T01:05:18.916 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:05:18.916 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:05:18.917 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:05:18.917 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:05:18.917 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.wal_compression: 0 2024-09-17T01:05:18.917 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:05:18.917 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:05:18.917 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:05:18.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:05:18.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:05:18.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:05:18.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:05:18.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:05:18.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:05:18.919 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:05:18.919 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:05:18.921 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:05:18.921 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:05:18.922 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:05:18.922 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:05:18.922 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:05:18.922 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:05:18.922 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:05:18.922 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:05:18.922 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:05:18.923 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:05:18.923 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:05:18.923 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:05:18.923 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_open_files: -1 2024-09-17T01:05:18.923 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:05:18.923 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:05:18.923 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:05:18.924 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:05:18.924 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:05:18.924 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Compression algorithms supported: 2024-09-17T01:05:18.924 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: kZSTD supported: 0 2024-09-17T01:05:18.924 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:05:18.924 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:05:18.924 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:05:18.924 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:05:18.924 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:05:18.924 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:05:18.924 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:05:18.924 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:05:18.925 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:05:18.925 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi002/store.db/MANIFEST-000015 2024-09-17T01:05:18.925 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:05:18.925 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:05:18.925 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.merge_operator: 2024-09-17T01:05:18.925 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compaction_filter: None 2024-09-17T01:05:18.925 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:05:18.925 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:05:18.925 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:05:18.925 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:05:18.925 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5621bb4a3520) 2024-09-17T01:05:18.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:05:18.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:05:18.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:05:18.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:05:18.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_type: 0 2024-09-17T01:05:18.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_block_index_type: 0 2024-09-17T01:05:18.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_shortening: 1 2024-09-17T01:05:18.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:05:18.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: checksum: 4 2024-09-17T01:05:18.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: no_block_cache: 0 2024-09-17T01:05:18.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache: 0x5621bb4971f0 2024-09-17T01:05:18.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:05:18.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_options: 2024-09-17T01:05:18.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: capacity : 536870912 2024-09-17T01:05:18.927 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: num_shard_bits : 4 2024-09-17T01:05:18.927 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: strict_capacity_limit : 0 2024-09-17T01:05:18.927 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:05:18.927 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_compressed: (nil) 2024-09-17T01:05:18.927 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: persistent_cache: (nil) 2024-09-17T01:05:18.927 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_size: 4096 2024-09-17T01:05:18.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_size_deviation: 10 2024-09-17T01:05:18.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_restart_interval: 16 2024-09-17T01:05:18.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_block_restart_interval: 1 2024-09-17T01:05:18.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: metadata_block_size: 4096 2024-09-17T01:05:18.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: partition_filters: 0 2024-09-17T01:05:18.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: use_delta_encoding: 1 2024-09-17T01:05:18.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: filter_policy: bloomfilter 2024-09-17T01:05:18.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: whole_key_filtering: 1 2024-09-17T01:05:18.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: verify_compression: 0 2024-09-17T01:05:18.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:05:18.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: format_version: 5 2024-09-17T01:05:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: enable_index_compression: 1 2024-09-17T01:05:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_align: 0 2024-09-17T01:05:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: max_auto_readahead_size: 262144 2024-09-17T01:05:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: prepopulate_block_cache: 0 2024-09-17T01:05:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:05:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:05:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:05:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:05:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compression: NoCompression 2024-09-17T01:05:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:05:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:05:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:05:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.num_levels: 7 2024-09-17T01:05:18.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:05:18.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:05:18.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:05:18.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:05:18.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:05:18.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:05:18.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:05:18.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:05:18.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:05:18.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:05:18.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:05:18.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:05:18.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:05:18.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:05:18.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:05:18.931 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:05:18.931 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:05:18.931 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:05:18.931 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:05:18.931 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:05:18.931 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:05:18.931 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:05:18.931 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:05:18.931 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:05:18.931 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:05:18.931 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:05:18.931 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:05:18.931 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:05:18.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:05:18.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:05:18.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:05:18.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:05:18.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:05:18.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:05:18.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:05:18.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:05:18.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:05:18.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:05:18.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:05:18.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:05:18.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:05:18.932 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:05:18.933 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:05:18.933 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:05:18.933 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:05:18.933 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:05:18.933 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:05:18.933 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:05:18.933 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:05:18.933 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:05:18.933 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:05:18.933 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:05:18.933 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:05:18.933 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:05:18.933 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:05:18.933 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.ttl: 2592000 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:05:18.934 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:05:18.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:05:18.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:05:18.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:05:18.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:05:18.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:05:18.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:05:18.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:05:18.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:05:18.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-09-17T01:05:18.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:05:18.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi002/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12091, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T01:05:18.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-09-17T01:05:18.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c3a10afe-7c48-40a3-bfa0-72e2997c7948 2024-09-17T01:05:18.935 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535118490757, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-09-17T01:05:18.936 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-09-17T01:05:18.936 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535118495217, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 538488, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12092, "largest_seqno": 12590, "table_properties": {"data_size": 535416, "index_size": 1456, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 5260, "raw_average_key_size": 23, "raw_value_size": 530473, "raw_average_value_size": 2357, "num_data_blocks": 66, "num_entries": 225, "num_filter_entries": 225, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726535118, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c3a10afe-7c48-40a3-bfa0-72e2997c7948", "db_session_id": "S8TYZVCGW3F75ZDYHLGT", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:05:18.936 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535118495361, "job": 1, "event": "recovery_finished"} 2024-09-17T01:05:18.936 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-09-17T01:05:18.936 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:05:18.936 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi002/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:05:18.936 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5621bb4c4e00 2024-09-17T01:05:18.936 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: DB pointer 0x5621bb5c0000 2024-09-17T01:05:18.936 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:05:18.936 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:05:18.936 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** DB Stats ** 2024-09-17T01:05:18.937 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:05:18.937 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:05:18.937 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:05:18.937 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:05:18.937 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:05:18.937 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:05:18.937 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:05:18.937 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T01:05:18.937 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-17T01:05:18.937 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:05:18.937 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:05:18.937 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: L0 1/0 525.87 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 190.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-17T01:05:18.938 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: L6 1/0 6.80 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T01:05:18.938 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Sum 2/0 7.31 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 190.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-17T01:05:18.938 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 190.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-17T01:05:18.938 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T01:05:18.938 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2024-09-17T01:05:18.938 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:05:18.938 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:05:18.938 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 190.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-17T01:05:18.938 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T01:05:18.938 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:05:18.938 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T01:05:18.938 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:05:18.939 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-17T01:05:18.939 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:05:18.939 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:05:18.939 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:05:18.939 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:05:18.939 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative compaction: 0.00 GB write, 65.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:05:18.939 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval compaction: 0.00 GB write, 65.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:05:18.939 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:05:18.939 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Block cache BinnedLRUCache@0x5621bb4971f0#2 capacity: 512.00 MB usage: 2.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-17T01:05:18.939 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.66 KB,0.00012517%) IndexBlock(1,1.58 KB,0.000301003%) Misc(1,0.00 KB,0%) 2024-09-17T01:05:18.940 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T01:05:18.940 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:05:18.940 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: starting mon.smithi002 rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi002 fsid f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T01:05:18.940 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: mon.smithi002@-1(???) e2 preinit fsid f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T01:05:18.940 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: mon.smithi002@-1(???).mds e23 new map 2024-09-17T01:05:18.940 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: mon.smithi002@-1(???).mds e23 print_map 2024-09-17T01:05:18.940 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: e23 2024-09-17T01:05:18.940 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-17T01:05:18.940 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:05:18.940 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:05:18.940 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: legacy client fscid: 1 2024-09-17T01:05:18.940 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T01:05:18.940 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Filesystem 'cephfs' (1) 2024-09-17T01:05:18.940 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: fs_name cephfs 2024-09-17T01:05:18.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: epoch 23 2024-09-17T01:05:18.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:05:18.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: created 2024-09-17T00:59:20.485696+0000 2024-09-17T01:05:18.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: modified 2024-09-17T01:02:38.321321+0000 2024-09-17T01:05:18.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: tableserver 0 2024-09-17T01:05:18.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: root 0 2024-09-17T01:05:18.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: session_timeout 60 2024-09-17T01:05:18.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: session_autoclose 300 2024-09-17T01:05:18.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: max_file_size 1099511627776 2024-09-17T01:05:18.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: max_xattr_size 65536 2024-09-17T01:05:18.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: required_client_features {} 2024-09-17T01:05:18.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: last_failure 0 2024-09-17T01:05:18.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: last_failure_osd_epoch 44 2024-09-17T01:05:18.941 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:05:18.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: max_mds 2 2024-09-17T01:05:18.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: in 0,1 2024-09-17T01:05:18.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: up {0=14464,1=24269} 2024-09-17T01:05:18.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: failed 2024-09-17T01:05:18.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: damaged 2024-09-17T01:05:18.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: stopped 2024-09-17T01:05:18.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_pools [3] 2024-09-17T01:05:18.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: metadata_pool 2 2024-09-17T01:05:18.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: inline_data enabled 2024-09-17T01:05:18.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: balancer 2024-09-17T01:05:18.942 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: bal_rank_mask -1 2024-09-17T01:05:18.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: standby_count_wanted 1 2024-09-17T01:05:18.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: qdb_cluster leader: 0 members: 2024-09-17T01:05:18.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: [mds.cephfs.smithi002.fmyyzz{0:14464} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:18.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: [mds.cephfs.smithi002.zmrgxd{0:24287} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/2986470392,v1:172.21.15.2:6827/2986470392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:18.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: [mds.cephfs.smithi099.hgawhu{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:18.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: [mds.cephfs.smithi099.heckcd{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:18.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T01:05:18.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2024-09-17T01:05:18.943 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: mon.smithi002@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-17T01:05:18.944 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: mon.smithi002@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:05:18.944 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: mon.smithi002@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:05:18.944 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: mon.smithi002@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:05:18.944 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 ceph-mon[98018]: mon.smithi002@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-09-17T01:05:18.944 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 bash[97998]: da5247385c2d65f1e126c9457b2c858f1cfe75634e1b8723d029a18da2efdd7e 2024-09-17T01:05:18.944 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:18 smithi002 systemd[1]: Started Ceph mon.smithi002 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:05:20.276 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T01:05:20.276 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T01:05:20.276 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: pgmap v58: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:05:20.276 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: mon.smithi002 calling monitor election 2024-09-17T01:05:20.276 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: mon.smithi002 is new leader, mons smithi002,smithi099 in quorum (ranks 0,1) 2024-09-17T01:05:20.276 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: monmap epoch 2 2024-09-17T01:05:20.276 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: fsid f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T01:05:20.277 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: last_changed 2024-09-17T00:55:00.889701+0000 2024-09-17T01:05:20.277 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: created 2024-09-17T00:52:33.781919+0000 2024-09-17T01:05:20.277 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: min_mon_release 17 (quincy) 2024-09-17T01:05:20.277 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: election_strategy: 1 2024-09-17T01:05:20.277 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.smithi002 2024-09-17T01:05:20.277 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: 1: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.smithi099 2024-09-17T01:05:20.277 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T01:05:20.277 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T01:05:20.277 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: mgrmap e32: smithi002.vjeexr(active, since 111s), standbys: smithi099.vswzrb 2024-09-17T01:05:20.277 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:05:20.277 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:05:20.277 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:05:20.277 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: from='mgr.14648 ' entity='' 2024-09-17T01:05:20.278 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:19 smithi099 ceph-mon[34357]: mgrmap e33: smithi002.vjeexr(active, since 111s), standbys: smithi099.vswzrb 2024-09-17T01:05:20.304 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T01:05:20.304 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: from='mgr.14648 172.21.15.2:0/1222665585' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T01:05:20.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: pgmap v58: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:05:20.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: mon.smithi002 calling monitor election 2024-09-17T01:05:20.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: mon.smithi002 is new leader, mons smithi002,smithi099 in quorum (ranks 0,1) 2024-09-17T01:05:20.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: monmap epoch 2 2024-09-17T01:05:20.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: fsid f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T01:05:20.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: last_changed 2024-09-17T00:55:00.889701+0000 2024-09-17T01:05:20.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: created 2024-09-17T00:52:33.781919+0000 2024-09-17T01:05:20.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: min_mon_release 17 (quincy) 2024-09-17T01:05:20.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: election_strategy: 1 2024-09-17T01:05:20.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.smithi002 2024-09-17T01:05:20.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: 1: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.smithi099 2024-09-17T01:05:20.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T01:05:20.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T01:05:20.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: mgrmap e32: smithi002.vjeexr(active, since 111s), standbys: smithi099.vswzrb 2024-09-17T01:05:20.306 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:05:20.306 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:05:20.306 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:05:20.306 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: from='mgr.14648 ' entity='' 2024-09-17T01:05:20.306 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:19 smithi002 ceph-mon[98018]: mgrmap e33: smithi002.vjeexr(active, since 111s), standbys: smithi099.vswzrb 2024-09-17T01:05:21.269 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:20 smithi002 ceph-mon[98018]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T01:05:21.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:20 smithi099 ceph-mon[34357]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T01:05:25.025 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:24 smithi002 ceph-mon[98018]: Standby manager daemon smithi099.vswzrb restarted 2024-09-17T01:05:25.025 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:24 smithi002 ceph-mon[98018]: Standby manager daemon smithi099.vswzrb started 2024-09-17T01:05:25.025 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:24 smithi002 ceph-mon[98018]: from='mgr.? 172.21.15.99:0/1840652559' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/crt"}]: dispatch 2024-09-17T01:05:25.025 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:24 smithi002 ceph-mon[98018]: from='mgr.? 172.21.15.99:0/1840652559' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:05:25.025 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:24 smithi002 ceph-mon[98018]: from='mgr.? 172.21.15.99:0/1840652559' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/key"}]: dispatch 2024-09-17T01:05:25.025 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:24 smithi002 ceph-mon[98018]: from='mgr.? 172.21.15.99:0/1840652559' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:05:25.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:24 smithi099 ceph-mon[34357]: Standby manager daemon smithi099.vswzrb restarted 2024-09-17T01:05:25.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:24 smithi099 ceph-mon[34357]: Standby manager daemon smithi099.vswzrb started 2024-09-17T01:05:25.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:24 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/1840652559' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/crt"}]: dispatch 2024-09-17T01:05:25.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:24 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/1840652559' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:05:25.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:24 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/1840652559' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.vswzrb/key"}]: dispatch 2024-09-17T01:05:25.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:24 smithi099 ceph-mon[34357]: from='mgr.? 172.21.15.99:0/1840652559' entity='mgr.smithi099.vswzrb' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:05:26.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: mgrmap e34: smithi002.vjeexr(active, since 116s), standbys: smithi099.vswzrb 2024-09-17T01:05:26.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: Active manager daemon smithi002.vjeexr restarted 2024-09-17T01:05:26.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: Activating manager daemon smithi002.vjeexr 2024-09-17T01:05:26.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:05:26.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: mgrmap e35: smithi002.vjeexr(active, starting, since 0.0055751s), standbys: smithi099.vswzrb 2024-09-17T01:05:26.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T01:05:26.039 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T01:05:26.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.fmyyzz"}]: dispatch 2024-09-17T01:05:26.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.hgawhu"}]: dispatch 2024-09-17T01:05:26.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T01:05:26.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T01:05:26.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr metadata", "who": "smithi002.vjeexr", "id": "smithi002.vjeexr"}]: dispatch 2024-09-17T01:05:26.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr metadata", "who": "smithi099.vswzrb", "id": "smithi099.vswzrb"}]: dispatch 2024-09-17T01:05:26.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:05:26.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:05:26.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:05:26.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:05:26.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:05:26.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:05:26.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:05:26.040 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:05:26.041 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:05:26.041 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: Manager daemon smithi002.vjeexr is now available 2024-09-17T01:05:26.041 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:26.041 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:26.041 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:05:26.041 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/trash_purge_schedule"}]: dispatch 2024-09-17T01:05:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: mgrmap e34: smithi002.vjeexr(active, since 116s), standbys: smithi099.vswzrb 2024-09-17T01:05:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: Active manager daemon smithi002.vjeexr restarted 2024-09-17T01:05:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: Activating manager daemon smithi002.vjeexr 2024-09-17T01:05:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:05:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: mgrmap e35: smithi002.vjeexr(active, starting, since 0.0055751s), standbys: smithi099.vswzrb 2024-09-17T01:05:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T01:05:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T01:05:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.fmyyzz"}]: dispatch 2024-09-17T01:05:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.hgawhu"}]: dispatch 2024-09-17T01:05:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T01:05:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T01:05:26.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr metadata", "who": "smithi002.vjeexr", "id": "smithi002.vjeexr"}]: dispatch 2024-09-17T01:05:26.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr metadata", "who": "smithi099.vswzrb", "id": "smithi099.vswzrb"}]: dispatch 2024-09-17T01:05:26.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:05:26.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:05:26.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:05:26.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:05:26.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:05:26.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:05:26.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:05:26.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:05:26.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:05:26.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: Manager daemon smithi002.vjeexr is now available 2024-09-17T01:05:26.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:26.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:26.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:05:26.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:25 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.vjeexr/trash_purge_schedule"}]: dispatch 2024-09-17T01:05:27.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:27 smithi002 ceph-mon[98018]: mgrmap e36: smithi002.vjeexr(active, since 1.01011s), standbys: smithi099.vswzrb 2024-09-17T01:05:27.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:27 smithi002 ceph-mon[98018]: pgmap v3: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:05:27.157 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:27 smithi099 ceph-mon[34357]: mgrmap e36: smithi002.vjeexr(active, since 1.01011s), standbys: smithi099.vswzrb 2024-09-17T01:05:27.158 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:27 smithi099 ceph-mon[34357]: pgmap v3: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:05:28.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:28 smithi099 ceph-mon[34357]: [17/Sep/2024:01:05:26] ENGINE Bus STARTING 2024-09-17T01:05:28.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:28 smithi099 ceph-mon[34357]: pgmap v4: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:05:28.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:28 smithi099 ceph-mon[34357]: mgrmap e37: smithi002.vjeexr(active, since 2s), standbys: smithi099.vswzrb 2024-09-17T01:05:28.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:28 smithi099 ceph-mon[34357]: [17/Sep/2024:01:05:27] ENGINE Serving on http://172.21.15.2:8765 2024-09-17T01:05:28.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:28 smithi099 ceph-mon[34357]: [17/Sep/2024:01:05:27] ENGINE Serving on https://172.21.15.2:7150 2024-09-17T01:05:28.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:28 smithi099 ceph-mon[34357]: [17/Sep/2024:01:05:27] ENGINE Bus STARTED 2024-09-17T01:05:28.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:28 smithi099 ceph-mon[34357]: [17/Sep/2024:01:05:27] ENGINE Error in HTTPServer.serve 2024-09-17T01:05:28.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Traceback (most recent call last): 2024-09-17T01:05:28.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:05:28.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:05:28.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:05:28.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._run(expiration_interval) 2024-09-17T01:05:28.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:05:28.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:05:28.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:05:28.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:05:28.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:05:28.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s = self.context.wrap_socket( 2024-09-17T01:05:28.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:05:28.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: return self.sslsocket_class._create( 2024-09-17T01:05:28.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:05:28.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self.do_handshake() 2024-09-17T01:05:28.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:05:28.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._sslobj.do_handshake() 2024-09-17T01:05:28.295 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:05:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:28 smithi002 ceph-mon[98018]: [17/Sep/2024:01:05:26] ENGINE Bus STARTING 2024-09-17T01:05:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:28 smithi002 ceph-mon[98018]: pgmap v4: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:05:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:28 smithi002 ceph-mon[98018]: mgrmap e37: smithi002.vjeexr(active, since 2s), standbys: smithi099.vswzrb 2024-09-17T01:05:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:28 smithi002 ceph-mon[98018]: [17/Sep/2024:01:05:27] ENGINE Serving on http://172.21.15.2:8765 2024-09-17T01:05:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:28 smithi002 ceph-mon[98018]: [17/Sep/2024:01:05:27] ENGINE Serving on https://172.21.15.2:7150 2024-09-17T01:05:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:28 smithi002 ceph-mon[98018]: [17/Sep/2024:01:05:27] ENGINE Bus STARTED 2024-09-17T01:05:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:28 smithi002 ceph-mon[98018]: [17/Sep/2024:01:05:27] ENGINE Error in HTTPServer.serve 2024-09-17T01:05:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Traceback (most recent call last): 2024-09-17T01:05:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:05:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:05:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:05:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._run(expiration_interval) 2024-09-17T01:05:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:05:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:05:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:05:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:05:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:05:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: s = self.context.wrap_socket( 2024-09-17T01:05:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:05:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: return self.sslsocket_class._create( 2024-09-17T01:05:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:05:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self.do_handshake() 2024-09-17T01:05:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:05:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: self._sslobj.do_handshake() 2024-09-17T01:05:28.407 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:05:29.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:29 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:29.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:29 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:29.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:29 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:29.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:29 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:29 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:29 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:29 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:29 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:30.658 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:30 smithi002 ceph-mon[98018]: pgmap v5: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:05:30.658 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:30 smithi002 ceph-mon[98018]: mgrmap e38: smithi002.vjeexr(active, since 4s), standbys: smithi099.vswzrb 2024-09-17T01:05:30.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:30 smithi099 ceph-mon[34357]: pgmap v5: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:05:30.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:30 smithi099 ceph-mon[34357]: mgrmap e38: smithi002.vjeexr(active, since 4s), standbys: smithi099.vswzrb 2024-09-17T01:05:31.966 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:31 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:31.966 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:31 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:31.966 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:31 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:31.966 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:31 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:32.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:31 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:32.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:31 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:32.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:31 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:32.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:31 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:33.017 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:32 smithi002 ceph-mon[98018]: pgmap v6: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:05:33.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:32 smithi099 ceph-mon[34357]: pgmap v6: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-09-17T01:05:34.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:34 smithi002 ceph-mon[98018]: pgmap v7: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-17T01:05:34.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:34 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:34.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:34 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:34.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:34 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:34.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:34 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:35.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:34 smithi099 ceph-mon[34357]: pgmap v7: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-17T01:05:35.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:34 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:35.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:34 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:35.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:34 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:35.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:34 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:36.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: Detected new or changed devices on smithi002 2024-09-17T01:05:36.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-17T01:05:36.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-17T01:05:36.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:05:36.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:05:36.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:05:36.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:05:36.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:36.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:36.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:36.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:36.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:36.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:35 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:05:36.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: Detected new or changed devices on smithi002 2024-09-17T01:05:36.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: Updating smithi002:/etc/ceph/ceph.conf 2024-09-17T01:05:36.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-17T01:05:36.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:05:36.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:05:36.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:05:36.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:05:36.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:36.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:35 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:05:36.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:36 smithi099 ceph-mon[34357]: pgmap v8: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-17T01:05:36.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:36 smithi099 ceph-mon[34357]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:05:36.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:36 smithi099 ceph-mon[34357]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:05:36.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:36 smithi002 ceph-mon[98018]: pgmap v8: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-17T01:05:36.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:36 smithi002 ceph-mon[98018]: Updating smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:05:36.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:36 smithi002 ceph-mon[98018]: Updating smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:05:38.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:37 smithi099 ceph-mon[34357]: Upgrade: Updating mon.smithi099 2024-09-17T01:05:38.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:37 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:38.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:37 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:05:38.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:37 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:05:38.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:37 smithi099 ceph-mon[34357]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:37 smithi099 ceph-mon[34357]: Deploying daemon mon.smithi099 on smithi099 2024-09-17T01:05:38.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:37 smithi002 ceph-mon[98018]: Upgrade: Updating mon.smithi099 2024-09-17T01:05:38.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:37 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:38.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:37 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:05:38.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:37 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:05:38.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:37 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:38.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:37 smithi002 ceph-mon[98018]: Deploying daemon mon.smithi099 on smithi099 2024-09-17T01:05:38.922 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:38 smithi099 systemd[1]: Stopping Ceph mon.smithi099 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:05:38.922 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:38 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi099[34353]: 2024-09-17T01:05:38.911+0000 7f309fa5e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi099 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:05:38.922 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:38 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi099[34353]: 2024-09-17T01:05:38.911+0000 7f309fa5e640 -1 mon.smithi099@1(peon) e2 *** Got Signal Terminated *** 2024-09-17T01:05:39.335 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:39 smithi099 podman[77250]: 2024-09-17 01:05:39.046378376 +0000 UTC m=+0.238558688 container died 1c9583d52c944495e3945862e814eb604f5b3ab517f9730aa935edbcefb58a8b (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi099, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=quincy-4a70413, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-17T01:05:39.686 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:39 smithi099 podman[77250]: 2024-09-17 01:05:39.437887402 +0000 UTC m=+0.630067712 container cleanup 1c9583d52c944495e3945862e814eb604f5b3ab517f9730aa935edbcefb58a8b (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi099, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-4a70413, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-17T01:05:39.686 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:39 smithi099 bash[77250]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi099 2024-09-17T01:05:40.015 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:39 smithi099 podman[77262]: 2024-09-17 01:05:39.689240496 +0000 UTC m=+0.637519501 container remove 1c9583d52c944495e3945862e814eb604f5b3ab517f9730aa935edbcefb58a8b (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi099, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=quincy-4a70413, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-17T01:05:40.015 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:39 smithi099 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi099.service: Deactivated successfully. 2024-09-17T01:05:40.015 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:39 smithi099 systemd[1]: Stopped Ceph mon.smithi099 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:05:40.015 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:39 smithi099 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi099.service: Consumed 6.307s CPU time. 2024-09-17T01:05:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 systemd[1]: Starting Ceph mon.smithi099 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:05:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 podman[77393]: 2024-09-17 01:05:40.12677395 +0000 UTC m=+0.015426586 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:05:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 podman[77393]: 2024-09-17 01:05:40.240758206 +0000 UTC m=+0.129410828 container create b92f98b2cab9e8db2193b25b9e4a1b3bc80c90318f7f44b2ff85501677494e66 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi099, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-17T01:05:40.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 podman[77393]: 2024-09-17 01:05:40.510114929 +0000 UTC m=+0.398767552 container init b92f98b2cab9e8db2193b25b9e4a1b3bc80c90318f7f44b2ff85501677494e66 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi099, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:05:40.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 podman[77393]: 2024-09-17 01:05:40.51324542 +0000 UTC m=+0.401898043 container start b92f98b2cab9e8db2193b25b9e4a1b3bc80c90318f7f44b2ff85501677494e66 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi099, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-17T01:05:40.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:05:40.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-17T01:05:40.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: pidfile_write: ignore empty --pid-file 2024-09-17T01:05:40.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: load: jerasure load: lrc 2024-09-17T01:05:40.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:05:40.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Git sha 0 2024-09-17T01:05:40.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-17T01:05:40.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: DB SUMMARY 2024-09-17T01:05:40.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: DB Session ID: I4553YNDPGQ0NS4ZE4VL 2024-09-17T01:05:40.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:05:40.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:05:40.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1104 Bytes 2024-09-17T01:05:40.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi099/store.db dir, Total Num: 1, files: 000027.sst 2024-09-17T01:05:40.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi099/store.db: 000025.log size: 3696841 ; 2024-09-17T01:05:40.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:05:40.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:05:40.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:05:40.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:05:40.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:05:40.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:05:40.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.env: 0x557e3af3b940 2024-09-17T01:05:40.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:05:40.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.info_log: 0x557e3d0b78c0 2024-09-17T01:05:40.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:05:40.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.statistics: (nil) 2024-09-17T01:05:40.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.use_fsync: 0 2024-09-17T01:05:40.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:05:40.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:05:40.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:05:40.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:05:40.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:05:40.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:05:40.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:05:40.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:05:40.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:05:40.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:05:40.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:05:40.798 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.db_log_dir: 2024-09-17T01:05:40.798 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.wal_dir: 2024-09-17T01:05:40.798 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:05:40.798 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:05:40.798 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:05:40.798 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:05:40.798 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:05:40.798 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:05:40.798 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:05:40.798 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:05:40.798 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.write_buffer_manager: 0x557e3d0c6dc0 2024-09-17T01:05:40.798 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:05:40.798 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:05:40.799 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:05:40.799 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:05:40.799 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:05:40.799 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:05:40.799 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:05:40.799 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:05:40.799 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.unordered_write: 0 2024-09-17T01:05:40.799 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:05:40.799 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:05:40.799 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:05:40.799 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:05:40.799 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.row_cache: None 2024-09-17T01:05:40.799 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.wal_filter: None 2024-09-17T01:05:40.801 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:05:40.801 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:05:40.801 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:05:40.801 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:05:40.801 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.wal_compression: 0 2024-09-17T01:05:40.801 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:05:40.801 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:05:40.802 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:05:40.802 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:05:40.802 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:05:40.802 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:05:40.802 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:05:40.802 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:05:40.802 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:05:40.802 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:05:40.802 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:05:40.802 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:05:40.802 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:05:40.802 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:05:40.802 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:05:40.803 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:05:40.803 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:05:40.803 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:05:40.803 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:05:40.803 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:05:40.803 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:05:40.803 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:05:40.803 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:05:40.803 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_open_files: -1 2024-09-17T01:05:40.803 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:05:40.803 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:05:40.803 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:05:40.803 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:05:40.804 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:05:40.804 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Compression algorithms supported: 2024-09-17T01:05:40.804 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: kZSTD supported: 0 2024-09-17T01:05:40.804 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:05:40.804 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:05:40.804 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:05:40.804 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:05:40.804 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:05:40.804 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:05:40.804 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:05:40.804 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:05:40.804 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:05:40.804 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi099/store.db/MANIFEST-000009 2024-09-17T01:05:40.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:05:40.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:05:40.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.merge_operator: 2024-09-17T01:05:40.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compaction_filter: None 2024-09-17T01:05:40.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:05:40.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:05:40.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:05:40.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:05:40.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557e3d0b7520) 2024-09-17T01:05:40.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:05:40.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:05:40.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:05:40.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:05:40.806 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: index_type: 0 2024-09-17T01:05:40.806 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: data_block_index_type: 0 2024-09-17T01:05:40.806 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: index_shortening: 1 2024-09-17T01:05:40.806 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:05:40.806 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: checksum: 4 2024-09-17T01:05:40.806 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: no_block_cache: 0 2024-09-17T01:05:40.806 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_cache: 0x557e3d0ab1f0 2024-09-17T01:05:40.806 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:05:40.806 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_cache_options: 2024-09-17T01:05:40.806 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: capacity : 536870912 2024-09-17T01:05:40.806 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: num_shard_bits : 4 2024-09-17T01:05:40.807 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: strict_capacity_limit : 0 2024-09-17T01:05:40.807 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:05:40.807 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_cache_compressed: (nil) 2024-09-17T01:05:40.807 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: persistent_cache: (nil) 2024-09-17T01:05:40.807 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_size: 4096 2024-09-17T01:05:40.808 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_size_deviation: 10 2024-09-17T01:05:40.808 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_restart_interval: 16 2024-09-17T01:05:40.808 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: index_block_restart_interval: 1 2024-09-17T01:05:40.808 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: metadata_block_size: 4096 2024-09-17T01:05:40.808 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: partition_filters: 0 2024-09-17T01:05:40.809 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: use_delta_encoding: 1 2024-09-17T01:05:40.809 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: filter_policy: bloomfilter 2024-09-17T01:05:40.809 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: whole_key_filtering: 1 2024-09-17T01:05:40.809 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: verify_compression: 0 2024-09-17T01:05:40.809 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:05:40.809 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: format_version: 5 2024-09-17T01:05:40.810 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: enable_index_compression: 1 2024-09-17T01:05:40.810 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_align: 0 2024-09-17T01:05:40.810 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: max_auto_readahead_size: 262144 2024-09-17T01:05:40.810 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: prepopulate_block_cache: 0 2024-09-17T01:05:40.810 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:05:40.810 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:05:40.810 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:05:40.811 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:05:40.811 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compression: NoCompression 2024-09-17T01:05:40.811 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:05:40.811 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:05:40.811 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:05:40.811 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.num_levels: 7 2024-09-17T01:05:40.811 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:05:40.812 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:05:40.812 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:05:40.812 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:05:40.812 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:05:40.812 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:05:40.812 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:05:40.813 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:05:40.813 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:05:40.813 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:05:40.813 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:05:40.813 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:05:40.813 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:05:40.814 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:05:40.814 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:05:40.814 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:05:40.814 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:05:40.814 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:05:40.814 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:05:40.815 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:05:40.815 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:05:40.815 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:05:40.815 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:05:40.815 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:05:40.815 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:05:40.816 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:05:40.816 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:05:40.816 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:05:40.816 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:05:40.816 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:05:40.816 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:05:40.816 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:05:40.816 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:05:40.816 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:05:40.816 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:05:40.817 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:05:40.817 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:05:40.817 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:05:40.817 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:05:40.817 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:05:40.817 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:05:40.818 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:05:40.818 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:05:40.818 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:05:40.818 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:05:40.818 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:05:40.818 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:05:40.818 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:05:40.818 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:05:40.818 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:05:40.819 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:05:40.819 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:05:40.819 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:05:40.819 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:05:40.819 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:05:40.819 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:05:40.819 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:05:40.819 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:05:40.819 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:05:40.819 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:05:40.819 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:05:40.819 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:05:40.819 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:05:40.820 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:05:40.820 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:05:40.820 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.ttl: 2592000 2024-09-17T01:05:40.820 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:05:40.820 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:05:40.820 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:05:40.820 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:05:40.820 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:05:40.820 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:05:40.820 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:05:40.820 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:05:40.821 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:05:40.821 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:05:40.821 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:05:40.821 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:05:40.821 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:05:40.822 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-09-17T01:05:40.822 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:05:40.822 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi099/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12369, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T01:05:40.822 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-17T01:05:40.822 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 48178b62-c9d7-4019-b8fb-d375b08e5c94 2024-09-17T01:05:40.822 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535140539791, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-17T01:05:40.822 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-17T01:05:40.823 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535140548531, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2371874, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12374, "largest_seqno": 13414, "table_properties": {"data_size": 2366717, "index_size": 2960, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1157, "raw_key_size": 10497, "raw_average_key_size": 23, "raw_value_size": 2357045, "raw_average_value_size": 5296, "num_data_blocks": 134, "num_entries": 445, "num_filter_entries": 445, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726535140, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "48178b62-c9d7-4019-b8fb-d375b08e5c94", "db_session_id": "I4553YNDPGQ0NS4ZE4VL", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:05:40.823 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726535140548630, "job": 1, "event": "recovery_finished"} 2024-09-17T01:05:40.823 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-17T01:05:40.823 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:05:40.823 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi099/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:05:40.823 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557e3d0d8e00 2024-09-17T01:05:40.824 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: DB pointer 0x557e3d1d4000 2024-09-17T01:05:40.824 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:05:40.824 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:05:40.824 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** DB Stats ** 2024-09-17T01:05:40.824 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:05:40.824 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:05:40.824 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:05:40.824 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:05:40.824 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:05:40.824 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:05:40.824 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:05:40.824 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-17T01:05:40.825 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** Compaction Stats [default] ** 2024-09-17T01:05:40.825 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:05:40.825 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:05:40.825 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: L0 1/0 2.26 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 630.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:05:40.825 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: L6 1/0 6.80 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T01:05:40.825 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Sum 2/0 9.06 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 630.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:05:40.825 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 630.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:05:40.825 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-17T01:05:40.825 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** Compaction Stats [default] ** 2024-09-17T01:05:40.825 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:05:40.825 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:05:40.825 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 630.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:05:40.825 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-17T01:05:40.826 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:05:40.826 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-17T01:05:40.826 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:05:40.826 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-17T01:05:40.826 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:05:40.826 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:05:40.826 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:05:40.826 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:05:40.826 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Cumulative compaction: 0.00 GB write, 167.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:05:40.826 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Interval compaction: 0.00 GB write, 167.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:05:40.827 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:05:40.827 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Block cache BinnedLRUCache@0x557e3d0ab1f0#2 capacity: 512.00 MB usage: 4.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-17T01:05:40.827 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.28 KB,0.000244379%) IndexBlock(1,3.08 KB,0.000587106%) Misc(1,0.00 KB,0%) 2024-09-17T01:05:40.827 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-17T01:05:40.827 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:05:40.827 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: starting mon.smithi099 rank 1 at public addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] at bind addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi099 fsid f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T01:05:40.827 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: mon.smithi099@-1(???) e2 preinit fsid f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T01:05:40.827 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: mon.smithi099@-1(???).mds e24 new map 2024-09-17T01:05:40.827 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: mon.smithi099@-1(???).mds e24 print_map 2024-09-17T01:05:40.827 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: e24 2024-09-17T01:05:40.828 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: btime 2024-09-17T01:05:19:972157+0000 2024-09-17T01:05:40.828 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:05:40.828 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:05:40.828 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: legacy client fscid: 1 2024-09-17T01:05:40.828 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-17T01:05:40.828 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Filesystem 'cephfs' (1) 2024-09-17T01:05:40.829 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: fs_name cephfs 2024-09-17T01:05:40.829 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: epoch 24 2024-09-17T01:05:40.829 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:05:40.829 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: created 2024-09-17T00:59:20.485696+0000 2024-09-17T01:05:40.829 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: modified 2024-09-17T01:05:19.972153+0000 2024-09-17T01:05:40.829 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: tableserver 0 2024-09-17T01:05:40.830 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: root 0 2024-09-17T01:05:40.830 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: session_timeout 60 2024-09-17T01:05:40.830 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: session_autoclose 300 2024-09-17T01:05:40.830 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: max_file_size 1099511627776 2024-09-17T01:05:40.830 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: max_xattr_size 65536 2024-09-17T01:05:40.830 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: required_client_features {} 2024-09-17T01:05:40.830 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: last_failure 0 2024-09-17T01:05:40.831 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: last_failure_osd_epoch 44 2024-09-17T01:05:40.831 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:05:40.831 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: max_mds 2 2024-09-17T01:05:40.831 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: in 0,1 2024-09-17T01:05:40.831 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: up {0=14464,1=24269} 2024-09-17T01:05:40.831 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: failed 2024-09-17T01:05:40.832 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: damaged 2024-09-17T01:05:40.832 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: stopped 2024-09-17T01:05:40.832 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: data_pools [3] 2024-09-17T01:05:40.832 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: metadata_pool 2 2024-09-17T01:05:40.832 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: inline_data enabled 2024-09-17T01:05:40.832 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: balancer 2024-09-17T01:05:40.833 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: bal_rank_mask -1 2024-09-17T01:05:40.833 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: standby_count_wanted 1 2024-09-17T01:05:40.833 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: qdb_cluster leader: 14464 members: 14464,24269 2024-09-17T01:05:40.833 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: [mds.cephfs.smithi002.fmyyzz{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:40.833 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: [mds.cephfs.smithi002.zmrgxd{0:24287} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/2986470392,v1:172.21.15.2:6827/2986470392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:40.834 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: [mds.cephfs.smithi099.hgawhu{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:40.834 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: [mds.cephfs.smithi099.heckcd{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:40.834 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-17T01:05:40.834 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-17T01:05:40.834 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: mon.smithi099@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-17T01:05:40.834 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: mon.smithi099@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:05:40.835 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: mon.smithi099@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:05:40.835 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: mon.smithi099@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:05:40.835 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 ceph-mon[77412]: mon.smithi099@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-17T01:05:40.835 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 bash[77393]: b92f98b2cab9e8db2193b25b9e4a1b3bc80c90318f7f44b2ff85501677494e66 2024-09-17T01:05:40.835 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:40 smithi099 systemd[1]: Started Ceph mon.smithi099 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:05:42.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:42 smithi099 ceph-mon[77412]: pgmap v9: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-17T01:05:42.311 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:42 smithi002 ceph-mon[98018]: pgmap v9: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-17T01:05:43.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T01:05:43.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T01:05:43.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: mon.smithi002 calling monitor election 2024-09-17T01:05:43.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: mon.smithi099 calling monitor election 2024-09-17T01:05:43.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: mon.smithi002 is new leader, mons smithi002,smithi099 in quorum (ranks 0,1) 2024-09-17T01:05:43.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: monmap epoch 3 2024-09-17T01:05:43.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: fsid f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T01:05:43.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: last_changed 2024-09-17T01:05:42.013834+0000 2024-09-17T01:05:43.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: created 2024-09-17T00:52:33.781919+0000 2024-09-17T01:05:43.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: min_mon_release 19 (squid) 2024-09-17T01:05:43.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: election_strategy: 1 2024-09-17T01:05:43.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.smithi002 2024-09-17T01:05:43.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: 1: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.smithi099 2024-09-17T01:05:43.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T01:05:43.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:05:43.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: mgrmap e38: smithi002.vjeexr(active, since 17s), standbys: smithi099.vswzrb 2024-09-17T01:05:43.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:05:43.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:05:43.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:05:43.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:43.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:43.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2024-09-17T01:05:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-17T01:05:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: mon.smithi002 calling monitor election 2024-09-17T01:05:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: mon.smithi099 calling monitor election 2024-09-17T01:05:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: mon.smithi002 is new leader, mons smithi002,smithi099 in quorum (ranks 0,1) 2024-09-17T01:05:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: monmap epoch 3 2024-09-17T01:05:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: fsid f8e82564-748e-11ef-bceb-c7b262605968 2024-09-17T01:05:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: last_changed 2024-09-17T01:05:42.013834+0000 2024-09-17T01:05:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: created 2024-09-17T00:52:33.781919+0000 2024-09-17T01:05:43.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: min_mon_release 19 (squid) 2024-09-17T01:05:43.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: election_strategy: 1 2024-09-17T01:05:43.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.smithi002 2024-09-17T01:05:43.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: 1: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.smithi099 2024-09-17T01:05:43.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T01:05:43.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:05:43.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: mgrmap e38: smithi002.vjeexr(active, since 17s), standbys: smithi099.vswzrb 2024-09-17T01:05:43.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:05:43.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:05:43.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:05:43.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:43.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:43.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:05:44.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:44 smithi099 ceph-mon[77412]: pgmap v12: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-17T01:05:44.308 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:44 smithi002 ceph-mon[98018]: pgmap v12: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-17T01:05:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.309+0000 7f2b4953e640 1 -- 172.21.15.2:0/2337372006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b441014f0 msgr2=0x7f2b441018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.309+0000 7f2b4953e640 1 --2- 172.21.15.2:0/2337372006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b441014f0 0x7f2b441018c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c0048d0 tx=0x7f2b3c009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.309+0000 7f2b4953e640 1 -- 172.21.15.2:0/2337372006 shutdown_connections 2024-09-17T01:05:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.309+0000 7f2b4953e640 1 --2- 172.21.15.2:0/2337372006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b440fbd90 0x7f2b440fc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.309+0000 7f2b4953e640 1 --2- 172.21.15.2:0/2337372006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b441014f0 0x7f2b441018c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.309+0000 7f2b4953e640 1 -- 172.21.15.2:0/2337372006 >> 172.21.15.2:0/2337372006 conn(0x7f2b44070ce0 msgr2=0x7f2b440710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.309+0000 7f2b4953e640 1 -- 172.21.15.2:0/2337372006 shutdown_connections 2024-09-17T01:05:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.309+0000 7f2b4953e640 1 -- 172.21.15.2:0/2337372006 wait complete. 2024-09-17T01:05:44.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.310+0000 7f2b4953e640 1 Processor -- start 2024-09-17T01:05:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.310+0000 7f2b4953e640 1 -- start start 2024-09-17T01:05:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.310+0000 7f2b4953e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b440fbd90 0x7f2b4410e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b4953e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b441014f0 0x7f2b4410e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b4953e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4410ecd0 con 0x7f2b440fbd90 2024-09-17T01:05:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b4953e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4410ee40 con 0x7f2b441014f0 2024-09-17T01:05:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b42ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b440fbd90 0x7f2b4410e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b42ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b440fbd90 0x7f2b4410e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48362/0 (socket says 172.21.15.2:48362) 2024-09-17T01:05:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b427fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b441014f0 0x7f2b4410e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b42ffd640 1 -- 172.21.15.2:0/894352149 learned_addr learned my addr 172.21.15.2:0/894352149 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b427fc640 1 -- 172.21.15.2:0/894352149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b441014f0 msgr2=0x7f2b4410e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-17T01:05:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b427fc640 1 -- 172.21.15.2:0/894352149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b441014f0 msgr2=0x7f2b4410e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:05:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b427fc640 1 --2- 172.21.15.2:0/894352149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b441014f0 0x7f2b4410e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-17T01:05:44.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b427fc640 1 --2- 172.21.15.2:0/894352149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b441014f0 0x7f2b4410e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:05:44.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b42ffd640 1 -- 172.21.15.2:0/894352149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b441014f0 msgr2=0x7f2b4410e6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:05:44.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b42ffd640 1 --2- 172.21.15.2:0/894352149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b441014f0 0x7f2b4410e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b42ffd640 1 -- 172.21.15.2:0/894352149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c005040 con 0x7f2b440fbd90 2024-09-17T01:05:44.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b42ffd640 1 --2- 172.21.15.2:0/894352149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b440fbd90 0x7f2b4410e190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c0043d0 tx=0x7f2b3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:44.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.311+0000 7f2b3b7fe640 1 -- 172.21.15.2:0/894352149 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b3c038070 con 0x7f2b440fbd90 2024-09-17T01:05:44.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.312+0000 7f2b3b7fe640 1 -- 172.21.15.2:0/894352149 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2b3c0096e0 con 0x7f2b440fbd90 2024-09-17T01:05:44.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.312+0000 7f2b4953e640 1 -- 172.21.15.2:0/894352149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b44117200 con 0x7f2b440fbd90 2024-09-17T01:05:44.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.312+0000 7f2b3b7fe640 1 -- 172.21.15.2:0/894352149 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b3c02c830 con 0x7f2b440fbd90 2024-09-17T01:05:44.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.312+0000 7f2b4953e640 1 -- 172.21.15.2:0/894352149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b44117660 con 0x7f2b440fbd90 2024-09-17T01:05:44.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.313+0000 7f2b4953e640 1 -- 172.21.15.2:0/894352149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b440fcda0 con 0x7f2b440fbd90 2024-09-17T01:05:44.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.313+0000 7f2b3b7fe640 1 -- 172.21.15.2:0/894352149 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f2b3c030020 con 0x7f2b440fbd90 2024-09-17T01:05:44.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.314+0000 7f2b3b7fe640 1 --2- 172.21.15.2:0/894352149 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2b3006e660 0x7f2b30070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:44.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.314+0000 7f2b3b7fe640 1 -- 172.21.15.2:0/894352149 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2b3c0ae090 con 0x7f2b440fbd90 2024-09-17T01:05:44.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.314+0000 7f2b427fc640 1 --2- 172.21.15.2:0/894352149 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2b3006e660 0x7f2b30070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:44.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.314+0000 7f2b427fc640 1 --2- 172.21.15.2:0/894352149 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2b3006e660 0x7f2b30070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009fd0 tx=0x7f2b2c009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:44.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.319+0000 7f2b3b7fe640 1 -- 172.21.15.2:0/894352149 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2b3c0770c0 con 0x7f2b440fbd90 2024-09-17T01:05:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.514+0000 7f2b4953e640 1 -- 172.21.15.2:0/894352149 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b440fb450 con 0x7f2b3006e660 2024-09-17T01:05:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.515+0000 7f2b3b7fe640 1 -- 172.21.15.2:0/894352149 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f2b440fb450 con 0x7f2b3006e660 2024-09-17T01:05:44.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.517+0000 7f2b4953e640 1 -- 172.21.15.2:0/894352149 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2b3006e660 msgr2=0x7f2b30070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:44.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.517+0000 7f2b4953e640 1 --2- 172.21.15.2:0/894352149 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2b3006e660 0x7f2b30070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009fd0 tx=0x7f2b2c009ee0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.517+0000 7f2b4953e640 1 -- 172.21.15.2:0/894352149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b440fbd90 msgr2=0x7f2b4410e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:44.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.517+0000 7f2b4953e640 1 --2- 172.21.15.2:0/894352149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b440fbd90 0x7f2b4410e190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c0043d0 tx=0x7f2b3c009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.518+0000 7f2b4953e640 1 -- 172.21.15.2:0/894352149 shutdown_connections 2024-09-17T01:05:44.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.518+0000 7f2b4953e640 1 --2- 172.21.15.2:0/894352149 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2b3006e660 0x7f2b30070b10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.518+0000 7f2b4953e640 1 --2- 172.21.15.2:0/894352149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b441014f0 0x7f2b4410e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.518+0000 7f2b4953e640 1 --2- 172.21.15.2:0/894352149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b440fbd90 0x7f2b4410e190 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.518+0000 7f2b4953e640 1 -- 172.21.15.2:0/894352149 >> 172.21.15.2:0/894352149 conn(0x7f2b44070ce0 msgr2=0x7f2b44104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:44.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.518+0000 7f2b4953e640 1 -- 172.21.15.2:0/894352149 shutdown_connections 2024-09-17T01:05:44.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.518+0000 7f2b4953e640 1 -- 172.21.15.2:0/894352149 wait complete. 2024-09-17T01:05:44.525 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:05:44.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.601+0000 7f1b474f3640 1 -- 172.21.15.2:0/3406360130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400fb4d0 msgr2=0x7f1b400fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:44.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.601+0000 7f1b474f3640 1 --2- 172.21.15.2:0/3406360130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400fb4d0 0x7f1b400fb940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b340048d0 tx=0x7f1b34009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.601+0000 7f1b474f3640 1 -- 172.21.15.2:0/3406360130 shutdown_connections 2024-09-17T01:05:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.601+0000 7f1b474f3640 1 --2- 172.21.15.2:0/3406360130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400fb4d0 0x7f1b400fb940 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.601+0000 7f1b474f3640 1 --2- 172.21.15.2:0/3406360130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40101510 0x7f1b401018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.601+0000 7f1b474f3640 1 -- 172.21.15.2:0/3406360130 >> 172.21.15.2:0/3406360130 conn(0x7f1b400f7090 msgr2=0x7f1b400f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.602+0000 7f1b474f3640 1 -- 172.21.15.2:0/3406360130 shutdown_connections 2024-09-17T01:05:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.602+0000 7f1b474f3640 1 -- 172.21.15.2:0/3406360130 wait complete. 2024-09-17T01:05:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.602+0000 7f1b474f3640 1 Processor -- start 2024-09-17T01:05:44.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.602+0000 7f1b474f3640 1 -- start start 2024-09-17T01:05:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.602+0000 7f1b474f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400fb4d0 0x7f1b4010e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:44.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.602+0000 7f1b474f3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40101510 0x7f1b4010e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.602+0000 7f1b474f3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4010ec80 con 0x7f1b400fb4d0 2024-09-17T01:05:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.602+0000 7f1b474f3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4010edf0 con 0x7f1b40101510 2024-09-17T01:05:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b4528f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400fb4d0 0x7f1b4010e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b4528f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400fb4d0 0x7f1b4010e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48386/0 (socket says 172.21.15.2:48386) 2024-09-17T01:05:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b4528f640 1 -- 172.21.15.2:0/444283100 learned_addr learned my addr 172.21.15.2:0/444283100 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b44a8e640 1 --2- 172.21.15.2:0/444283100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40101510 0x7f1b4010e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b44a8e640 1 -- 172.21.15.2:0/444283100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40101510 msgr2=0x7f1b4010e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-17T01:05:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b44a8e640 1 -- 172.21.15.2:0/444283100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40101510 msgr2=0x7f1b4010e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:05:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b44a8e640 1 --2- 172.21.15.2:0/444283100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40101510 0x7f1b4010e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-17T01:05:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b44a8e640 1 --2- 172.21.15.2:0/444283100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40101510 0x7f1b4010e680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:05:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b4528f640 1 -- 172.21.15.2:0/444283100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40101510 msgr2=0x7f1b4010e680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:05:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b4528f640 1 --2- 172.21.15.2:0/444283100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40101510 0x7f1b4010e680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b4528f640 1 -- 172.21.15.2:0/444283100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b34005040 con 0x7f1b400fb4d0 2024-09-17T01:05:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b4528f640 1 --2- 172.21.15.2:0/444283100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400fb4d0 0x7f1b4010e140 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0041d0 tx=0x7f1b3c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b31ffb640 1 -- 172.21.15.2:0/444283100 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b3c007c30 con 0x7f1b400fb4d0 2024-09-17T01:05:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b31ffb640 1 -- 172.21.15.2:0/444283100 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1b3c00f040 con 0x7f1b400fb4d0 2024-09-17T01:05:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.603+0000 7f1b474f3640 1 -- 172.21.15.2:0/444283100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b401171b0 con 0x7f1b400fb4d0 2024-09-17T01:05:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.604+0000 7f1b31ffb640 1 -- 172.21.15.2:0/444283100 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b3c0095c0 con 0x7f1b400fb4d0 2024-09-17T01:05:44.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.604+0000 7f1b474f3640 1 -- 172.21.15.2:0/444283100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b401176f0 con 0x7f1b400fb4d0 2024-09-17T01:05:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.605+0000 7f1b474f3640 1 -- 172.21.15.2:0/444283100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b400fcc10 con 0x7f1b400fb4d0 2024-09-17T01:05:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.605+0000 7f1b31ffb640 1 -- 172.21.15.2:0/444283100 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f1b3c009720 con 0x7f1b400fb4d0 2024-09-17T01:05:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.606+0000 7f1b31ffb640 1 --2- 172.21.15.2:0/444283100 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1b2c06e660 0x7f1b2c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.606+0000 7f1b31ffb640 1 -- 172.21.15.2:0/444283100 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1b3c08dc50 con 0x7f1b400fb4d0 2024-09-17T01:05:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.606+0000 7f1b44a8e640 1 --2- 172.21.15.2:0/444283100 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1b2c06e660 0x7f1b2c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:44.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.606+0000 7f1b44a8e640 1 --2- 172.21.15.2:0/444283100 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1b2c06e660 0x7f1b2c070b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1b40066470 tx=0x7f1b34009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:44.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.610+0000 7f1b31ffb640 1 -- 172.21.15.2:0/444283100 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1b3c05a6a0 con 0x7f1b400fb4d0 2024-09-17T01:05:44.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.804+0000 7f1b474f3640 1 -- 172.21.15.2:0/444283100 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b40066220 con 0x7f1b2c06e660 2024-09-17T01:05:44.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.806+0000 7f1b31ffb640 1 -- 172.21.15.2:0/444283100 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f1b40066220 con 0x7f1b2c06e660 2024-09-17T01:05:44.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.807+0000 7f1b474f3640 1 -- 172.21.15.2:0/444283100 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1b2c06e660 msgr2=0x7f1b2c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:44.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.807+0000 7f1b474f3640 1 --2- 172.21.15.2:0/444283100 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1b2c06e660 0x7f1b2c070b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1b40066470 tx=0x7f1b34009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.807+0000 7f1b474f3640 1 -- 172.21.15.2:0/444283100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400fb4d0 msgr2=0x7f1b4010e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:44.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.807+0000 7f1b474f3640 1 --2- 172.21.15.2:0/444283100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400fb4d0 0x7f1b4010e140 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0041d0 tx=0x7f1b3c004600 comp rx=0 tx=0).stop 2024-09-17T01:05:44.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.808+0000 7f1b474f3640 1 -- 172.21.15.2:0/444283100 shutdown_connections 2024-09-17T01:05:44.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.808+0000 7f1b474f3640 1 --2- 172.21.15.2:0/444283100 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1b2c06e660 0x7f1b2c070b10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.808+0000 7f1b474f3640 1 --2- 172.21.15.2:0/444283100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b40101510 0x7f1b4010e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.808+0000 7f1b474f3640 1 --2- 172.21.15.2:0/444283100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400fb4d0 0x7f1b4010e140 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.808+0000 7f1b474f3640 1 -- 172.21.15.2:0/444283100 >> 172.21.15.2:0/444283100 conn(0x7f1b400f7090 msgr2=0x7f1b400f8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:44.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.808+0000 7f1b474f3640 1 -- 172.21.15.2:0/444283100 shutdown_connections 2024-09-17T01:05:44.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.808+0000 7f1b474f3640 1 -- 172.21.15.2:0/444283100 wait complete. 2024-09-17T01:05:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.888+0000 7ff531fd9640 1 -- 172.21.15.2:0/4041637595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff52c0fb4a0 msgr2=0x7ff52c0fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.888+0000 7ff531fd9640 1 --2- 172.21.15.2:0/4041637595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff52c0fb4a0 0x7ff52c0fb910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff5200048d0 tx=0x7ff520009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.888+0000 7ff531fd9640 1 -- 172.21.15.2:0/4041637595 shutdown_connections 2024-09-17T01:05:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.888+0000 7ff531fd9640 1 --2- 172.21.15.2:0/4041637595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff52c0fb4a0 0x7ff52c0fb910 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.888+0000 7ff531fd9640 1 --2- 172.21.15.2:0/4041637595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff52c1014e0 0x7ff52c1018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.888+0000 7ff531fd9640 1 -- 172.21.15.2:0/4041637595 >> 172.21.15.2:0/4041637595 conn(0x7ff52c0f7020 msgr2=0x7ff52c0f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.889+0000 7ff531fd9640 1 -- 172.21.15.2:0/4041637595 shutdown_connections 2024-09-17T01:05:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.889+0000 7ff531fd9640 1 -- 172.21.15.2:0/4041637595 wait complete. 2024-09-17T01:05:44.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.889+0000 7ff531fd9640 1 Processor -- start 2024-09-17T01:05:44.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.889+0000 7ff531fd9640 1 -- start start 2024-09-17T01:05:44.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.889+0000 7ff531fd9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff52c0fb4a0 0x7ff52c1153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:44.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.889+0000 7ff531fd9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff52c1014e0 0x7ff52c115930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff531fd9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c115f30 con 0x7ff52c1014e0 2024-09-17T01:05:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff531fd9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c1160a0 con 0x7ff52c0fb4a0 2024-09-17T01:05:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff52affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff52c1014e0 0x7ff52c115930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff52affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff52c1014e0 0x7ff52c115930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48400/0 (socket says 172.21.15.2:48400) 2024-09-17T01:05:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff52b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff52c0fb4a0 0x7ff52c1153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff52affd640 1 -- 172.21.15.2:0/1929982748 learned_addr learned my addr 172.21.15.2:0/1929982748 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff52b7fe640 1 -- 172.21.15.2:0/1929982748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff52c0fb4a0 msgr2=0x7ff52c1153f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-17T01:05:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff52b7fe640 1 -- 172.21.15.2:0/1929982748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff52c0fb4a0 msgr2=0x7ff52c1153f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:05:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff52b7fe640 1 --2- 172.21.15.2:0/1929982748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff52c0fb4a0 0x7ff52c1153f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-17T01:05:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff52b7fe640 1 --2- 172.21.15.2:0/1929982748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff52c0fb4a0 0x7ff52c1153f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:05:44.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff52affd640 1 -- 172.21.15.2:0/1929982748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff52c0fb4a0 msgr2=0x7ff52c1153f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:05:44.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff52affd640 1 --2- 172.21.15.2:0/1929982748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff52c0fb4a0 0x7ff52c1153f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:44.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff52affd640 1 -- 172.21.15.2:0/1929982748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff520005040 con 0x7ff52c1014e0 2024-09-17T01:05:44.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff52affd640 1 --2- 172.21.15.2:0/1929982748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff52c1014e0 0x7ff52c115930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff520000c00 tx=0x7ff520009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:44.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.890+0000 7ff513fff640 1 -- 172.21.15.2:0/1929982748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff520038070 con 0x7ff52c1014e0 2024-09-17T01:05:44.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.891+0000 7ff513fff640 1 -- 172.21.15.2:0/1929982748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff52002ade0 con 0x7ff52c1014e0 2024-09-17T01:05:44.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.891+0000 7ff531fd9640 1 -- 172.21.15.2:0/1929982748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52c10f4c0 con 0x7ff52c1014e0 2024-09-17T01:05:44.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.891+0000 7ff513fff640 1 -- 172.21.15.2:0/1929982748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff52002c7e0 con 0x7ff52c1014e0 2024-09-17T01:05:44.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.891+0000 7ff531fd9640 1 -- 172.21.15.2:0/1929982748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52c10f980 con 0x7ff52c1014e0 2024-09-17T01:05:44.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.892+0000 7ff531fd9640 1 -- 172.21.15.2:0/1929982748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52c0fcbe0 con 0x7ff52c1014e0 2024-09-17T01:05:44.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.892+0000 7ff513fff640 1 -- 172.21.15.2:0/1929982748 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7ff520030020 con 0x7ff52c1014e0 2024-09-17T01:05:44.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.893+0000 7ff513fff640 1 --2- 172.21.15.2:0/1929982748 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff51406e660 0x7ff514070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:44.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.893+0000 7ff513fff640 1 -- 172.21.15.2:0/1929982748 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff5200adf10 con 0x7ff52c1014e0 2024-09-17T01:05:44.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.893+0000 7ff52b7fe640 1 --2- 172.21.15.2:0/1929982748 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff51406e660 0x7ff514070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:44.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.893+0000 7ff52b7fe640 1 --2- 172.21.15.2:0/1929982748 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff51406e660 0x7ff514070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff51c009dc0 tx=0x7ff51c009e80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:44.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:44.897+0000 7ff513fff640 1 -- 172.21.15.2:0/1929982748 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff520076ff0 con 0x7ff52c1014e0 2024-09-17T01:05:45.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.090+0000 7ff531fd9640 1 -- 172.21.15.2:0/1929982748 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff52c1084c0 con 0x7ff51406e660 2024-09-17T01:05:45.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.105+0000 7ff513fff640 1 -- 172.21.15.2:0/1929982748 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff52c1084c0 con 0x7ff51406e660 2024-09-17T01:05:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:05:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (2m) 14s ago 11m 20.8M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:05:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (11m) 14s ago 11m 6903k - 17.2.7-1635-g4a704134 f22ead590bad 53b003b1ad6f 2024-09-17T01:05:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (10m) 0s ago 10m 6891k - 17.2.7-1635-g4a704134 f22ead590bad 6ec40439e9b5 2024-09-17T01:05:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (94s) 14s ago 11m 76.3M - 9.4.12 2bacad6d85d8 5fe408c103d6 2024-09-17T01:05:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (6m) 14s ago 6m 125M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:05:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (6m) 14s ago 6m 65.4M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:05:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (6m) 0s ago 6m 64.8M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:05:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (6m) 0s ago 6m 115M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:05:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (2m) 14s ago 13m 472M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:05:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (115s) 0s ago 10m 438M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:05:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (26s) 14s ago 13m 27.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de da5247385c2d 2024-09-17T01:05:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (4s) 0s ago 10m 20.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b92f98b2cab9 2024-09-17T01:05:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (3m) 14s ago 11m 15.7M - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:05:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (2m) 0s ago 10m 15.7M - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:05:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (10m) 14s ago 10m 225M 1558M 17.2.7-1635-g4a704134 f22ead590bad 720f74f40752 2024-09-17T01:05:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (9m) 14s ago 9m 244M 1558M 17.2.7-1635-g4a704134 f22ead590bad 629defddb38c 2024-09-17T01:05:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (9m) 14s ago 9m 197M 1558M 17.2.7-1635-g4a704134 f22ead590bad 5dff1cf9fc56 2024-09-17T01:05:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (8m) 0s ago 8m 272M 2581M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:05:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (8m) 0s ago 8m 239M 2581M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:05:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (7m) 0s ago 7m 222M 2581M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:05:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (2m) 14s ago 11m 55.5M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:05:45.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.107+0000 7ff531fd9640 1 -- 172.21.15.2:0/1929982748 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff51406e660 msgr2=0x7ff514070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:45.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.107+0000 7ff531fd9640 1 --2- 172.21.15.2:0/1929982748 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff51406e660 0x7ff514070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff51c009dc0 tx=0x7ff51c009e80 comp rx=0 tx=0).stop 2024-09-17T01:05:45.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.107+0000 7ff531fd9640 1 -- 172.21.15.2:0/1929982748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff52c1014e0 msgr2=0x7ff52c115930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:45.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.107+0000 7ff531fd9640 1 --2- 172.21.15.2:0/1929982748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff52c1014e0 0x7ff52c115930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff520000c00 tx=0x7ff520009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.108+0000 7ff531fd9640 1 -- 172.21.15.2:0/1929982748 shutdown_connections 2024-09-17T01:05:45.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.108+0000 7ff531fd9640 1 --2- 172.21.15.2:0/1929982748 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff51406e660 0x7ff514070b10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.108+0000 7ff531fd9640 1 --2- 172.21.15.2:0/1929982748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff52c1014e0 0x7ff52c115930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.108+0000 7ff531fd9640 1 --2- 172.21.15.2:0/1929982748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff52c0fb4a0 0x7ff52c1153f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.108+0000 7ff531fd9640 1 -- 172.21.15.2:0/1929982748 >> 172.21.15.2:0/1929982748 conn(0x7ff52c0f7020 msgr2=0x7ff52c065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:45.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.108+0000 7ff531fd9640 1 -- 172.21.15.2:0/1929982748 shutdown_connections 2024-09-17T01:05:45.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.108+0000 7ff531fd9640 1 -- 172.21.15.2:0/1929982748 wait complete. 2024-09-17T01:05:45.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.188+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/3655802047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b58102620 msgr2=0x7f0b581029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:45.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.188+0000 7f0b5f3cd640 1 --2- 172.21.15.2:0/3655802047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b58102620 0x7f0b581029f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0b540048d0 tx=0x7f0b54009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.188+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/3655802047 shutdown_connections 2024-09-17T01:05:45.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.188+0000 7f0b5f3cd640 1 --2- 172.21.15.2:0/3655802047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b580fac80 0x7f0b580fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.188+0000 7f0b5f3cd640 1 --2- 172.21.15.2:0/3655802047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b58102620 0x7f0b581029f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.188+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/3655802047 >> 172.21.15.2:0/3655802047 conn(0x7f0b58070ce0 msgr2=0x7f0b580710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:45.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.188+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/3655802047 shutdown_connections 2024-09-17T01:05:45.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.188+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/3655802047 wait complete. 2024-09-17T01:05:45.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.189+0000 7f0b5f3cd640 1 Processor -- start 2024-09-17T01:05:45.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.189+0000 7f0b5f3cd640 1 -- start start 2024-09-17T01:05:45.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.189+0000 7f0b5f3cd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b580fac80 0x7f0b58113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:45.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.189+0000 7f0b5f3cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b58102620 0x7f0b581136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:45.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.189+0000 7f0b5f3cd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b58113cd0 con 0x7f0b58102620 2024-09-17T01:05:45.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.189+0000 7f0b5f3cd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5810d110 con 0x7f0b580fac80 2024-09-17T01:05:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.189+0000 7f0b5c968640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b58102620 0x7f0b581136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.189+0000 7f0b5d169640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b580fac80 0x7f0b58113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.189+0000 7f0b5d169640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b580fac80 0x7f0b58113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.2:50114/0 (socket says 172.21.15.2:50114) 2024-09-17T01:05:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.189+0000 7f0b5c968640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b58102620 0x7f0b581136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48420/0 (socket says 172.21.15.2:48420) 2024-09-17T01:05:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.189+0000 7f0b5d169640 1 -- 172.21.15.2:0/2956167068 learned_addr learned my addr 172.21.15.2:0/2956167068 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.189+0000 7f0b5d169640 1 -- 172.21.15.2:0/2956167068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b580fac80 msgr2=0x7f0b58113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-17T01:05:45.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.190+0000 7f0b5d169640 1 -- 172.21.15.2:0/2956167068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b580fac80 msgr2=0x7f0b58113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:05:45.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.190+0000 7f0b5d169640 1 --2- 172.21.15.2:0/2956167068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b580fac80 0x7f0b58113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-17T01:05:45.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.190+0000 7f0b5d169640 1 --2- 172.21.15.2:0/2956167068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b580fac80 0x7f0b58113190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:05:45.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.190+0000 7f0b5c968640 1 -- 172.21.15.2:0/2956167068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b580fac80 msgr2=0x7f0b58113190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:05:45.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.190+0000 7f0b5c968640 1 --2- 172.21.15.2:0/2956167068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b580fac80 0x7f0b58113190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.190+0000 7f0b5c968640 1 -- 172.21.15.2:0/2956167068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b54005040 con 0x7f0b58102620 2024-09-17T01:05:45.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.190+0000 7f0b5c968640 1 --2- 172.21.15.2:0/2956167068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b58102620 0x7f0b581136d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0027d0 tx=0x7f0b4c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:45.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.190+0000 7f0b49ffb640 1 -- 172.21.15.2:0/2956167068 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b4c002dc0 con 0x7f0b58102620 2024-09-17T01:05:45.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.190+0000 7f0b49ffb640 1 -- 172.21.15.2:0/2956167068 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0b4c00f040 con 0x7f0b58102620 2024-09-17T01:05:45.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.190+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/2956167068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5810d3f0 con 0x7f0b58102620 2024-09-17T01:05:45.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.190+0000 7f0b49ffb640 1 -- 172.21.15.2:0/2956167068 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b4c0095f0 con 0x7f0b58102620 2024-09-17T01:05:45.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.190+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/2956167068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5810d990 con 0x7f0b58102620 2024-09-17T01:05:45.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.191+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/2956167068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b580657b0 con 0x7f0b58102620 2024-09-17T01:05:45.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.192+0000 7f0b49ffb640 1 -- 172.21.15.2:0/2956167068 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f0b4c009750 con 0x7f0b58102620 2024-09-17T01:05:45.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.192+0000 7f0b49ffb640 1 --2- 172.21.15.2:0/2956167068 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f0b4406e660 0x7f0b44070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:45.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.192+0000 7f0b49ffb640 1 -- 172.21.15.2:0/2956167068 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0b4c08da90 con 0x7f0b58102620 2024-09-17T01:05:45.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.192+0000 7f0b5d169640 1 --2- 172.21.15.2:0/2956167068 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f0b4406e660 0x7f0b44070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:45.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.193+0000 7f0b5d169640 1 --2- 172.21.15.2:0/2956167068 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f0b4406e660 0x7f0b44070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0b54007ac0 tx=0x7f0b54009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:45.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.196+0000 7f0b49ffb640 1 -- 172.21.15.2:0/2956167068 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0b4c056a30 con 0x7f0b58102620 2024-09-17T01:05:45.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.446+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/2956167068 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0b58074c00 con 0x7f0b58102620 2024-09-17T01:05:45.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.447+0000 7f0b49ffb640 1 -- 172.21.15.2:0/2956167068 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f0b4c05a0f0 con 0x7f0b58102620 2024-09-17T01:05:45.445 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:05:45.445 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:05:45.445 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:05:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:05:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:05:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:05:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:05:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:05:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T01:05:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:05:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:05:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:05:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:05:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:05:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 10, 2024-09-17T01:05:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:05:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:05:45.447 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:05:45.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.449+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/2956167068 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f0b4406e660 msgr2=0x7f0b44070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:45.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.449+0000 7f0b5f3cd640 1 --2- 172.21.15.2:0/2956167068 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f0b4406e660 0x7f0b44070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0b54007ac0 tx=0x7f0b54009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.449+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/2956167068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b58102620 msgr2=0x7f0b581136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:45.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.449+0000 7f0b5f3cd640 1 --2- 172.21.15.2:0/2956167068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b58102620 0x7f0b581136d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0027d0 tx=0x7f0b4c004570 comp rx=0 tx=0).stop 2024-09-17T01:05:45.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.450+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/2956167068 shutdown_connections 2024-09-17T01:05:45.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.450+0000 7f0b5f3cd640 1 --2- 172.21.15.2:0/2956167068 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f0b4406e660 0x7f0b44070b10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.450+0000 7f0b5f3cd640 1 --2- 172.21.15.2:0/2956167068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b58102620 0x7f0b581136d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.450+0000 7f0b5f3cd640 1 --2- 172.21.15.2:0/2956167068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b580fac80 0x7f0b58113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.450+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/2956167068 >> 172.21.15.2:0/2956167068 conn(0x7f0b58070ce0 msgr2=0x7f0b58105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.450+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/2956167068 shutdown_connections 2024-09-17T01:05:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.450+0000 7f0b5f3cd640 1 -- 172.21.15.2:0/2956167068 wait complete. 2024-09-17T01:05:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.532+0000 7f87b1927640 1 -- 172.21.15.2:0/1806705375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87ac0fd590 msgr2=0x7f87ac0fd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.532+0000 7f87b1927640 1 --2- 172.21.15.2:0/1806705375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87ac0fd590 0x7f87ac0fd960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f879c0048d0 tx=0x7f879c009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.532+0000 7f87b1927640 1 -- 172.21.15.2:0/1806705375 shutdown_connections 2024-09-17T01:05:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.532+0000 7f87b1927640 1 --2- 172.21.15.2:0/1806705375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0fdf30 0x7f87ac106570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.532+0000 7f87b1927640 1 --2- 172.21.15.2:0/1806705375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87ac0fd590 0x7f87ac0fd960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.532+0000 7f87b1927640 1 -- 172.21.15.2:0/1806705375 >> 172.21.15.2:0/1806705375 conn(0x7f87ac0f7060 msgr2=0x7f87ac0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.532+0000 7f87b1927640 1 -- 172.21.15.2:0/1806705375 shutdown_connections 2024-09-17T01:05:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.532+0000 7f87b1927640 1 -- 172.21.15.2:0/1806705375 wait complete. 2024-09-17T01:05:45.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.533+0000 7f87b1927640 1 Processor -- start 2024-09-17T01:05:45.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.533+0000 7f87b1927640 1 -- start start 2024-09-17T01:05:45.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.533+0000 7f87b1927640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0fd590 0x7f87ac113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:45.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.533+0000 7f87b1927640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87ac0fdf30 0x7f87ac113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:45.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.533+0000 7f87b1927640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac113d60 con 0x7f87ac0fdf30 2024-09-17T01:05:45.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.533+0000 7f87b1927640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac10d1a0 con 0x7f87ac0fd590 2024-09-17T01:05:45.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.533+0000 7f87aa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87ac0fdf30 0x7f87ac113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:45.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.533+0000 7f87aa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87ac0fdf30 0x7f87ac113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48432/0 (socket says 172.21.15.2:48432) 2024-09-17T01:05:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.533+0000 7f87aa7fc640 1 -- 172.21.15.2:0/2599199801 learned_addr learned my addr 172.21.15.2:0/2599199801 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.533+0000 7f87aaffd640 1 --2- 172.21.15.2:0/2599199801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0fd590 0x7f87ac113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.533+0000 7f87aaffd640 1 -- 172.21.15.2:0/2599199801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0fd590 msgr2=0x7f87ac113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-17T01:05:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.533+0000 7f87aaffd640 1 -- 172.21.15.2:0/2599199801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0fd590 msgr2=0x7f87ac113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:05:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.534+0000 7f87aaffd640 1 --2- 172.21.15.2:0/2599199801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0fd590 0x7f87ac113220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-17T01:05:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.534+0000 7f87aaffd640 1 --2- 172.21.15.2:0/2599199801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0fd590 0x7f87ac113220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:05:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.534+0000 7f87aa7fc640 1 -- 172.21.15.2:0/2599199801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0fd590 msgr2=0x7f87ac113220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:05:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.534+0000 7f87aa7fc640 1 --2- 172.21.15.2:0/2599199801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0fd590 0x7f87ac113220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.534+0000 7f87aa7fc640 1 -- 172.21.15.2:0/2599199801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c005040 con 0x7f87ac0fdf30 2024-09-17T01:05:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.534+0000 7f87aa7fc640 1 --2- 172.21.15.2:0/2599199801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87ac0fdf30 0x7f87ac113760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87a0002a50 tx=0x7f87a0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.534+0000 7f87937fe640 1 -- 172.21.15.2:0/2599199801 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87a0007c30 con 0x7f87ac0fdf30 2024-09-17T01:05:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.534+0000 7f87b1927640 1 -- 172.21.15.2:0/2599199801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac10d480 con 0x7f87ac0fdf30 2024-09-17T01:05:45.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.534+0000 7f87937fe640 1 -- 172.21.15.2:0/2599199801 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f87a000f040 con 0x7f87ac0fdf30 2024-09-17T01:05:45.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.534+0000 7f87937fe640 1 -- 172.21.15.2:0/2599199801 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87a000da90 con 0x7f87ac0fdf30 2024-09-17T01:05:45.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.534+0000 7f87b1927640 1 -- 172.21.15.2:0/2599199801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac10d9a0 con 0x7f87ac0fdf30 2024-09-17T01:05:45.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.535+0000 7f87b1927640 1 -- 172.21.15.2:0/2599199801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac066350 con 0x7f87ac0fdf30 2024-09-17T01:05:45.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.536+0000 7f87937fe640 1 -- 172.21.15.2:0/2599199801 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f87a000dd00 con 0x7f87ac0fdf30 2024-09-17T01:05:45.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.536+0000 7f87937fe640 1 --2- 172.21.15.2:0/2599199801 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f879406e660 0x7f8794070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:45.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.536+0000 7f87937fe640 1 -- 172.21.15.2:0/2599199801 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f87a008dd40 con 0x7f87ac0fdf30 2024-09-17T01:05:45.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.536+0000 7f87aaffd640 1 --2- 172.21.15.2:0/2599199801 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f879406e660 0x7f8794070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:45.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.537+0000 7f87aaffd640 1 --2- 172.21.15.2:0/2599199801 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f879406e660 0x7f8794070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f879c007ac0 tx=0x7f879c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:45.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.541+0000 7f87937fe640 1 -- 172.21.15.2:0/2599199801 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f87a0056bc0 con 0x7f87ac0fdf30 2024-09-17T01:05:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.758+0000 7f87b1927640 1 -- 172.21.15.2:0/2599199801 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f87ac0fac60 con 0x7f87ac0fdf30 2024-09-17T01:05:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.758+0000 7f87937fe640 1 -- 172.21.15.2:0/2599199801 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1963 (secure 0 0 0) 0x7f87a005fe60 con 0x7f87ac0fdf30 2024-09-17T01:05:45.757 INFO:teuthology.orchestra.run.smithi002.stdout:e24 2024-09-17T01:05:45.757 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-17T01:05:19:972157+0000 2024-09-17T01:05:45.757 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:05:45.757 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:05:45.757 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-17T01:05:45.757 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 24 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-17T00:59:20.485696+0000 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-17T01:05:19.972153+0000 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-17T01:05:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 44 2024-09-17T01:05:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:05:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2024-09-17T01:05:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2024-09-17T01:05:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=14464,1=24269} 2024-09-17T01:05:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-17T01:05:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-17T01:05:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-17T01:05:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-17T01:05:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-17T01:05:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-17T01:05:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-17T01:05:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-17T01:05:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-17T01:05:45.759 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 14464 members: 14464,24269 2024-09-17T01:05:45.760 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.fmyyzz{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:45.760 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.zmrgxd{0:24287} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/2986470392,v1:172.21.15.2:6827/2986470392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:45.760 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.hgawhu{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:45.760 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.heckcd{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:05:45.760 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:05:45.760 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:05:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 24 2024-09-17T01:05:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.760+0000 7f87b1927640 1 -- 172.21.15.2:0/2599199801 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f879406e660 msgr2=0x7f8794070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.760+0000 7f87b1927640 1 --2- 172.21.15.2:0/2599199801 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f879406e660 0x7f8794070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f879c007ac0 tx=0x7f879c009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.760+0000 7f87b1927640 1 -- 172.21.15.2:0/2599199801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87ac0fdf30 msgr2=0x7f87ac113760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.760+0000 7f87b1927640 1 --2- 172.21.15.2:0/2599199801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87ac0fdf30 0x7f87ac113760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87a0002a50 tx=0x7f87a0004600 comp rx=0 tx=0).stop 2024-09-17T01:05:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.760+0000 7f87b1927640 1 -- 172.21.15.2:0/2599199801 shutdown_connections 2024-09-17T01:05:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.760+0000 7f87b1927640 1 --2- 172.21.15.2:0/2599199801 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f879406e660 0x7f8794070b10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.760+0000 7f87b1927640 1 --2- 172.21.15.2:0/2599199801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87ac0fdf30 0x7f87ac113760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.760+0000 7f87b1927640 1 --2- 172.21.15.2:0/2599199801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0fd590 0x7f87ac113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.760+0000 7f87b1927640 1 -- 172.21.15.2:0/2599199801 >> 172.21.15.2:0/2599199801 conn(0x7f87ac0f7060 msgr2=0x7f87ac0f85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.761+0000 7f87b1927640 1 -- 172.21.15.2:0/2599199801 shutdown_connections 2024-09-17T01:05:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.761+0000 7f87b1927640 1 -- 172.21.15.2:0/2599199801 wait complete. 2024-09-17T01:05:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.842+0000 7f04f6cd8640 1 -- 172.21.15.2:0/2139357425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f0102550 msgr2=0x7f04f0102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.842+0000 7f04f6cd8640 1 --2- 172.21.15.2:0/2139357425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f0102550 0x7f04f0102920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f04e00048d0 tx=0x7f04e0009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.842+0000 7f04f6cd8640 1 -- 172.21.15.2:0/2139357425 shutdown_connections 2024-09-17T01:05:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.842+0000 7f04f6cd8640 1 --2- 172.21.15.2:0/2139357425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f0102ef0 0x7f04f00fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.842+0000 7f04f6cd8640 1 --2- 172.21.15.2:0/2139357425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f0102550 0x7f04f0102920 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.842+0000 7f04f6cd8640 1 -- 172.21.15.2:0/2139357425 >> 172.21.15.2:0/2139357425 conn(0x7f04f00f80f0 msgr2=0x7f04f00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.843+0000 7f04f6cd8640 1 -- 172.21.15.2:0/2139357425 shutdown_connections 2024-09-17T01:05:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.843+0000 7f04f6cd8640 1 -- 172.21.15.2:0/2139357425 wait complete. 2024-09-17T01:05:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.843+0000 7f04f6cd8640 1 Processor -- start 2024-09-17T01:05:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.843+0000 7f04f6cd8640 1 -- start start 2024-09-17T01:05:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.843+0000 7f04f6cd8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f0102550 0x7f04f0113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.843+0000 7f04f6cd8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f0102ef0 0x7f04f0113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.843+0000 7f04f6cd8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f0114100 con 0x7f04f0102550 2024-09-17T01:05:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.843+0000 7f04f6cd8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f010d510 con 0x7f04f0102ef0 2024-09-17T01:05:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.844+0000 7f04f4a74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f0102550 0x7f04f0113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.844+0000 7f04f4a74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f0102550 0x7f04f0113570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48452/0 (socket says 172.21.15.2:48452) 2024-09-17T01:05:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.844+0000 7f04f4a74640 1 -- 172.21.15.2:0/157586228 learned_addr learned my addr 172.21.15.2:0/157586228 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.844+0000 7f04effff640 1 --2- 172.21.15.2:0/157586228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f0102ef0 0x7f04f0113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.844+0000 7f04f4a74640 1 -- 172.21.15.2:0/157586228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f0102ef0 msgr2=0x7f04f0113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.844+0000 7f04f4a74640 1 --2- 172.21.15.2:0/157586228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f0102ef0 0x7f04f0113ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.844+0000 7f04f4a74640 1 -- 172.21.15.2:0/157586228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0005040 con 0x7f04f0102550 2024-09-17T01:05:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.844+0000 7f04f4a74640 1 --2- 172.21.15.2:0/157586228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f0102550 0x7f04f0113570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f04e0000c00 tx=0x7f04e0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.844+0000 7f04ed7fa640 1 -- 172.21.15.2:0/157586228 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04e0038070 con 0x7f04f0102550 2024-09-17T01:05:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.844+0000 7f04ed7fa640 1 -- 172.21.15.2:0/157586228 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f04e002ade0 con 0x7f04f0102550 2024-09-17T01:05:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.844+0000 7f04ed7fa640 1 -- 172.21.15.2:0/157586228 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04e002c7e0 con 0x7f04f0102550 2024-09-17T01:05:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.844+0000 7f04f6cd8640 1 -- 172.21.15.2:0/157586228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f010d790 con 0x7f04f0102550 2024-09-17T01:05:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.844+0000 7f04f6cd8640 1 -- 172.21.15.2:0/157586228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f010dc50 con 0x7f04f0102550 2024-09-17T01:05:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.845+0000 7f04f6cd8640 1 -- 172.21.15.2:0/157586228 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f00fdcd0 con 0x7f04f0102550 2024-09-17T01:05:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.846+0000 7f04ed7fa640 1 -- 172.21.15.2:0/157586228 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f04e0030020 con 0x7f04f0102550 2024-09-17T01:05:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.846+0000 7f04ed7fa640 1 --2- 172.21.15.2:0/157586228 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f04d806e660 0x7f04d8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.846+0000 7f04ed7fa640 1 -- 172.21.15.2:0/157586228 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f04e00ade70 con 0x7f04f0102550 2024-09-17T01:05:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.847+0000 7f04effff640 1 --2- 172.21.15.2:0/157586228 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f04d806e660 0x7f04d8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.847+0000 7f04effff640 1 --2- 172.21.15.2:0/157586228 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f04d806e660 0x7f04d8070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f04f010e7f0 tx=0x7f04e400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:45.851+0000 7f04ed7fa640 1 -- 172.21.15.2:0/157586228 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f04e0076fd0 con 0x7f04f0102550 2024-09-17T01:05:46.038 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:45 smithi099 ceph-mon[77412]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:46.038 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:46.038 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:46.038 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:45 smithi099 ceph-mon[77412]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:46.038 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:46.038 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:46.038 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:45 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/2956167068' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:46.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.043+0000 7f04f6cd8640 1 -- 172.21.15.2:0/157586228 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04f004b720 con 0x7f04d806e660 2024-09-17T01:05:46.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:45 smithi002 ceph-mon[98018]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:46.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:46.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:46.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:45 smithi002 ceph-mon[98018]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:46.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:46.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:46.043 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:45 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/2956167068' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:05:46.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.045+0000 7f04ed7fa640 1 -- 172.21.15.2:0/157586228 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f04f004b720 con 0x7f04d806e660 2024-09-17T01:05:46.043 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:05:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:05:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:05:46.043 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:05:46.044 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-17T01:05:46.044 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-17T01:05:46.044 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2024-09-17T01:05:46.044 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-17T01:05:46.044 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "4/21 daemons upgraded", 2024-09-17T01:05:46.044 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mon daemons", 2024-09-17T01:05:46.044 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:05:46.044 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:05:46.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.048+0000 7f04f6cd8640 1 -- 172.21.15.2:0/157586228 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f04d806e660 msgr2=0x7f04d8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.048+0000 7f04f6cd8640 1 --2- 172.21.15.2:0/157586228 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f04d806e660 0x7f04d8070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f04f010e7f0 tx=0x7f04e400b040 comp rx=0 tx=0).stop 2024-09-17T01:05:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.048+0000 7f04f6cd8640 1 -- 172.21.15.2:0/157586228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f0102550 msgr2=0x7f04f0113570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.048+0000 7f04f6cd8640 1 --2- 172.21.15.2:0/157586228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f0102550 0x7f04f0113570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f04e0000c00 tx=0x7f04e0009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.048+0000 7f04f6cd8640 1 -- 172.21.15.2:0/157586228 shutdown_connections 2024-09-17T01:05:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.048+0000 7f04f6cd8640 1 --2- 172.21.15.2:0/157586228 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f04d806e660 0x7f04d8070b10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.048+0000 7f04f6cd8640 1 --2- 172.21.15.2:0/157586228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04f0102ef0 0x7f04f0113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.048+0000 7f04f6cd8640 1 --2- 172.21.15.2:0/157586228 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04f0102550 0x7f04f0113570 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.048+0000 7f04f6cd8640 1 -- 172.21.15.2:0/157586228 >> 172.21.15.2:0/157586228 conn(0x7f04f00f80f0 msgr2=0x7f04f00f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.048+0000 7f04f6cd8640 1 -- 172.21.15.2:0/157586228 shutdown_connections 2024-09-17T01:05:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.048+0000 7f04f6cd8640 1 -- 172.21.15.2:0/157586228 wait complete. 2024-09-17T01:05:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.130+0000 7fd223417640 1 -- 172.21.15.2:0/2662138438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd21c0fb380 msgr2=0x7fd21c0fb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.130+0000 7fd223417640 1 --2- 172.21.15.2:0/2662138438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd21c0fb380 0x7fd21c0fb750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2180048d0 tx=0x7fd218009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.130+0000 7fd223417640 1 -- 172.21.15.2:0/2662138438 shutdown_connections 2024-09-17T01:05:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.130+0000 7fd223417640 1 --2- 172.21.15.2:0/2662138438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd21c0fbc90 0x7fd21c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.130+0000 7fd223417640 1 --2- 172.21.15.2:0/2662138438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd21c0fb380 0x7fd21c0fb750 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.130+0000 7fd223417640 1 -- 172.21.15.2:0/2662138438 >> 172.21.15.2:0/2662138438 conn(0x7fd21c0f7090 msgr2=0x7fd21c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.130+0000 7fd223417640 1 -- 172.21.15.2:0/2662138438 shutdown_connections 2024-09-17T01:05:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.130+0000 7fd223417640 1 -- 172.21.15.2:0/2662138438 wait complete. 2024-09-17T01:05:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.130+0000 7fd223417640 1 Processor -- start 2024-09-17T01:05:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.131+0000 7fd223417640 1 -- start start 2024-09-17T01:05:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.131+0000 7fd223417640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd21c0fb380 0x7fd21c1152a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.131+0000 7fd223417640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd21c0fbc90 0x7fd21c1157e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.131+0000 7fd223417640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c115de0 con 0x7fd21c0fb380 2024-09-17T01:05:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.131+0000 7fd223417640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c10f220 con 0x7fd21c0fbc90 2024-09-17T01:05:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.131+0000 7fd2211b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd21c0fb380 0x7fd21c1152a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.131+0000 7fd2211b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd21c0fb380 0x7fd21c1152a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48462/0 (socket says 172.21.15.2:48462) 2024-09-17T01:05:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.131+0000 7fd2211b3640 1 -- 172.21.15.2:0/2923944423 learned_addr learned my addr 172.21.15.2:0/2923944423 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:05:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.131+0000 7fd2209b2640 1 --2- 172.21.15.2:0/2923944423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd21c0fbc90 0x7fd21c1157e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.131+0000 7fd2211b3640 1 -- 172.21.15.2:0/2923944423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd21c0fbc90 msgr2=0x7fd21c1157e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.131+0000 7fd2211b3640 1 --2- 172.21.15.2:0/2923944423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd21c0fbc90 0x7fd21c1157e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.131+0000 7fd2211b3640 1 -- 172.21.15.2:0/2923944423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd218005040 con 0x7fd21c0fb380 2024-09-17T01:05:46.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.131+0000 7fd2211b3640 1 --2- 172.21.15.2:0/2923944423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd21c0fb380 0x7fd21c1152a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd218009ac0 tx=0x7fd218009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:46.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.132+0000 7fd211ffb640 1 -- 172.21.15.2:0/2923944423 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd218038070 con 0x7fd21c0fb380 2024-09-17T01:05:46.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.132+0000 7fd211ffb640 1 -- 172.21.15.2:0/2923944423 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd21802ae80 con 0x7fd21c0fb380 2024-09-17T01:05:46.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.132+0000 7fd223417640 1 -- 172.21.15.2:0/2923944423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21c10f4a0 con 0x7fd21c0fb380 2024-09-17T01:05:46.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.132+0000 7fd211ffb640 1 -- 172.21.15.2:0/2923944423 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd218032c80 con 0x7fd21c0fb380 2024-09-17T01:05:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.132+0000 7fd223417640 1 -- 172.21.15.2:0/2923944423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21c10fa40 con 0x7fd21c0fb380 2024-09-17T01:05:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.133+0000 7fd223417640 1 -- 172.21.15.2:0/2923944423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21c0662d0 con 0x7fd21c0fb380 2024-09-17T01:05:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.133+0000 7fd211ffb640 1 -- 172.21.15.2:0/2923944423 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7fd218030020 con 0x7fd21c0fb380 2024-09-17T01:05:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.134+0000 7fd211ffb640 1 --2- 172.21.15.2:0/2923944423 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd20806e660 0x7fd208070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:05:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.134+0000 7fd211ffb640 1 -- 172.21.15.2:0/2923944423 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd2180ae7c0 con 0x7fd21c0fb380 2024-09-17T01:05:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.134+0000 7fd2209b2640 1 --2- 172.21.15.2:0/2923944423 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd20806e660 0x7fd208070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:05:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.134+0000 7fd2209b2640 1 --2- 172.21.15.2:0/2923944423 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd20806e660 0x7fd208070b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd21c110b60 tx=0x7fd20c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:05:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.138+0000 7fd211ffb640 1 -- 172.21.15.2:0/2923944423 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd218077870 con 0x7fd21c0fb380 2024-09-17T01:05:46.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.382+0000 7fd223417640 1 -- 172.21.15.2:0/2923944423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd21c04b720 con 0x7fd21c0fb380 2024-09-17T01:05:46.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.383+0000 7fd211ffb640 1 -- 172.21.15.2:0/2923944423 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fd21807af30 con 0x7fd21c0fb380 2024-09-17T01:05:46.382 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:05:46.382 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:05:46.382 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:05:46.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.385+0000 7fd223417640 1 -- 172.21.15.2:0/2923944423 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd20806e660 msgr2=0x7fd208070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:46.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.385+0000 7fd223417640 1 --2- 172.21.15.2:0/2923944423 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd20806e660 0x7fd208070b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd21c110b60 tx=0x7fd20c00b040 comp rx=0 tx=0).stop 2024-09-17T01:05:46.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.385+0000 7fd223417640 1 -- 172.21.15.2:0/2923944423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd21c0fb380 msgr2=0x7fd21c1152a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:05:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.385+0000 7fd223417640 1 --2- 172.21.15.2:0/2923944423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd21c0fb380 0x7fd21c1152a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd218009ac0 tx=0x7fd218009da0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.385+0000 7fd223417640 1 -- 172.21.15.2:0/2923944423 shutdown_connections 2024-09-17T01:05:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.385+0000 7fd223417640 1 --2- 172.21.15.2:0/2923944423 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd20806e660 0x7fd208070b10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.385+0000 7fd223417640 1 --2- 172.21.15.2:0/2923944423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd21c0fbc90 0x7fd21c1157e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.385+0000 7fd223417640 1 --2- 172.21.15.2:0/2923944423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd21c0fb380 0x7fd21c1152a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:05:46.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.385+0000 7fd223417640 1 -- 172.21.15.2:0/2923944423 >> 172.21.15.2:0/2923944423 conn(0x7fd21c0f7090 msgr2=0x7fd21c0f75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:05:46.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.386+0000 7fd223417640 1 -- 172.21.15.2:0/2923944423 shutdown_connections 2024-09-17T01:05:46.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:05:46.386+0000 7fd223417640 1 -- 172.21.15.2:0/2923944423 wait complete. 2024-09-17T01:05:46.993 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:46 smithi099 ceph-mon[77412]: pgmap v13: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:05:46.993 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:46 smithi099 ceph-mon[77412]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:46.993 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:46 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/2599199801' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:05:46.993 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:46 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/2923944423' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:05:47.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:46 smithi002 ceph-mon[98018]: pgmap v13: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:05:47.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:46 smithi002 ceph-mon[98018]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:47.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:46 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/2599199801' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:05:47.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:46 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/2923944423' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:05:48.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:47 smithi099 ceph-mon[77412]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:48.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:47 smithi002 ceph-mon[98018]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:05:48.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:48 smithi099 ceph-mon[77412]: pgmap v14: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:05:48.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:48 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:48.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:48 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:48.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:48 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:48.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:48 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:48.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:48 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:48.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:48 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:05:48.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:48 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:05:48.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:48 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:49.047 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:48 smithi002 ceph-mon[98018]: pgmap v14: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:05:49.047 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:48 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:49.048 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:48 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:49.048 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:48 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:49.048 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:48 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:05:49.048 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:48 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:49.048 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:48 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:05:49.048 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:48 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:05:49.048 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:48 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:50.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:49 smithi099 ceph-mon[77412]: Detected new or changed devices on smithi099 2024-09-17T01:05:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:49 smithi099 ceph-mon[77412]: Reconfiguring mon.smithi002 (monmap changed)... 2024-09-17T01:05:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:49 smithi099 ceph-mon[77412]: Reconfiguring daemon mon.smithi002 on smithi002 2024-09-17T01:05:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:49 smithi099 ceph-mon[77412]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T01:05:50.084 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:49 smithi002 ceph-mon[98018]: Detected new or changed devices on smithi099 2024-09-17T01:05:50.084 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:49 smithi002 ceph-mon[98018]: Reconfiguring mon.smithi002 (monmap changed)... 2024-09-17T01:05:50.084 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:49 smithi002 ceph-mon[98018]: Reconfiguring daemon mon.smithi002 on smithi002 2024-09-17T01:05:50.084 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:49 smithi002 ceph-mon[98018]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2 up:standby-replay 2024-09-17T01:05:50.858 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:50 smithi002 ceph-mon[98018]: pgmap v15: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:05:50.858 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:50 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:50.858 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:50 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:50.858 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:50 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.vjeexr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:50.859 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:50 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:05:50.859 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:50 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:51.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:50 smithi099 ceph-mon[77412]: pgmap v15: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:05:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:50 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:50 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:50 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.vjeexr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:05:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:50 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:05:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:50 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:52.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:51 smithi099 ceph-mon[77412]: Reconfiguring mgr.smithi002.vjeexr (monmap changed)... 2024-09-17T01:05:52.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:51 smithi099 ceph-mon[77412]: Reconfiguring daemon mgr.smithi002.vjeexr on smithi002 2024-09-17T01:05:52.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:51 smithi002 ceph-mon[98018]: Reconfiguring mgr.smithi002.vjeexr (monmap changed)... 2024-09-17T01:05:52.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:51 smithi002 ceph-mon[98018]: Reconfiguring daemon mgr.smithi002.vjeexr on smithi002 2024-09-17T01:05:53.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:52 smithi002 ceph-mon[98018]: pgmap v16: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:05:53.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:53.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:53.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:52 smithi002 ceph-mon[98018]: Reconfiguring crash.smithi002 (monmap changed)... 2024-09-17T01:05:53.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:05:53.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:53.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:52 smithi002 ceph-mon[98018]: Reconfiguring daemon crash.smithi002 on smithi002 2024-09-17T01:05:53.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:52 smithi099 ceph-mon[77412]: pgmap v16: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:05:53.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:53.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:53.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:52 smithi099 ceph-mon[77412]: Reconfiguring crash.smithi002 (monmap changed)... 2024-09-17T01:05:53.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:05:53.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:53.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:52 smithi099 ceph-mon[77412]: Reconfiguring daemon crash.smithi002 on smithi002 2024-09-17T01:05:54.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:54 smithi002 ceph-mon[98018]: pgmap v17: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:05:54.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:54 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:54.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:54 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:54.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:54 smithi002 ceph-mon[98018]: Reconfiguring osd.0 (monmap changed)... 2024-09-17T01:05:54.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:54 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:05:54.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:54 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:54 smithi002 ceph-mon[98018]: Reconfiguring daemon osd.0 on smithi002 2024-09-17T01:05:54.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:54 smithi099 ceph-mon[77412]: pgmap v17: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:05:54.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:54 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:54.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:54 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:54.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:54 smithi099 ceph-mon[77412]: Reconfiguring osd.0 (monmap changed)... 2024-09-17T01:05:54.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:54 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:05:54.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:54 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:54.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:54 smithi099 ceph-mon[77412]: Reconfiguring daemon osd.0 on smithi002 2024-09-17T01:05:56.078 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:56.079 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:56.079 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:55 smithi002 ceph-mon[98018]: Reconfiguring osd.1 (monmap changed)... 2024-09-17T01:05:56.079 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:05:56.079 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.079 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:55 smithi002 ceph-mon[98018]: Reconfiguring daemon osd.1 on smithi002 2024-09-17T01:05:56.079 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:56.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:56.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:56.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:55 smithi099 ceph-mon[77412]: Reconfiguring osd.1 (monmap changed)... 2024-09-17T01:05:56.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:05:56.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:56.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:55 smithi099 ceph-mon[77412]: Reconfiguring daemon osd.1 on smithi002 2024-09-17T01:05:56.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:05:57.059 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:56 smithi002 ceph-mon[98018]: pgmap v18: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:05:57.059 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:56 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:57.059 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:56 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:57.060 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:56 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:05:57.060 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:56 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:57.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:56 smithi099 ceph-mon[77412]: pgmap v18: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:05:57.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:56 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:57.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:56 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:57.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:56 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:05:57.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:56 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:58.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:57 smithi002 ceph-mon[98018]: Reconfiguring osd.2 (monmap changed)... 2024-09-17T01:05:58.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:57 smithi002 ceph-mon[98018]: Reconfiguring daemon osd.2 on smithi002 2024-09-17T01:05:58.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:57 smithi099 ceph-mon[77412]: Reconfiguring osd.2 (monmap changed)... 2024-09-17T01:05:58.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:57 smithi099 ceph-mon[77412]: Reconfiguring daemon osd.2 on smithi002 2024-09-17T01:05:59.026 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:58 smithi002 ceph-mon[98018]: pgmap v19: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:05:59.026 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:58 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:59.026 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:58 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:59.027 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:58 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.zmrgxd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:05:59.027 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:58 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:05:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:58 smithi099 ceph-mon[77412]: pgmap v19: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:05:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:58 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:58 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:05:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:58 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.zmrgxd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:05:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:58 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.022 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:59 smithi002 ceph-mon[98018]: Reconfiguring mds.cephfs.smithi002.zmrgxd (monmap changed)... 2024-09-17T01:06:00.022 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:59 smithi002 ceph-mon[98018]: Reconfiguring daemon mds.cephfs.smithi002.zmrgxd on smithi002 2024-09-17T01:06:00.023 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:59 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:00.023 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:59 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:00.023 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:59 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.fmyyzz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:06:00.023 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:05:59 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:59 smithi099 ceph-mon[77412]: Reconfiguring mds.cephfs.smithi002.zmrgxd (monmap changed)... 2024-09-17T01:06:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:59 smithi099 ceph-mon[77412]: Reconfiguring daemon mds.cephfs.smithi002.zmrgxd on smithi002 2024-09-17T01:06:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:59 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:59 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:59 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.fmyyzz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:06:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:05:59 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:00 smithi002 ceph-mon[98018]: pgmap v20: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:00 smithi002 ceph-mon[98018]: Reconfiguring mds.cephfs.smithi002.fmyyzz (monmap changed)... 2024-09-17T01:06:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:00 smithi002 ceph-mon[98018]: Reconfiguring daemon mds.cephfs.smithi002.fmyyzz on smithi002 2024-09-17T01:06:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:00 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:00 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:00 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:06:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:00 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:01.184 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:00 smithi099 ceph-mon[77412]: pgmap v20: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:01.184 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:00 smithi099 ceph-mon[77412]: Reconfiguring mds.cephfs.smithi002.fmyyzz (monmap changed)... 2024-09-17T01:06:01.184 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:00 smithi099 ceph-mon[77412]: Reconfiguring daemon mds.cephfs.smithi002.fmyyzz on smithi002 2024-09-17T01:06:01.185 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:00 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:01.185 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:00 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:01.185 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:00 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:06:01.185 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:00 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:02.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:01 smithi002 ceph-mon[98018]: Reconfiguring crash.smithi099 (monmap changed)... 2024-09-17T01:06:02.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:01 smithi002 ceph-mon[98018]: Reconfiguring daemon crash.smithi099 on smithi099 2024-09-17T01:06:02.194 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:01 smithi099 ceph-mon[77412]: Reconfiguring crash.smithi099 (monmap changed)... 2024-09-17T01:06:02.236 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:01 smithi099 ceph-mon[77412]: Reconfiguring daemon crash.smithi099 on smithi099 2024-09-17T01:06:02.935 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:02 smithi099 ceph-mon[77412]: pgmap v21: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:06:02.935 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:02 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:02.935 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:02 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:02.935 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:02 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.vswzrb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:06:02.935 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:02 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:06:02.935 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:02 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:03.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:02 smithi002 ceph-mon[98018]: pgmap v21: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:06:03.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:02 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:03.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:02 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:03.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:02 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.vswzrb", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:06:03.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:02 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:06:03.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:02 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:03 smithi002 ceph-mon[98018]: Reconfiguring mgr.smithi099.vswzrb (monmap changed)... 2024-09-17T01:06:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:03 smithi002 ceph-mon[98018]: Reconfiguring daemon mgr.smithi099.vswzrb on smithi099 2024-09-17T01:06:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:06:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:06:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:04.184 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:03 smithi099 ceph-mon[77412]: Reconfiguring mgr.smithi099.vswzrb (monmap changed)... 2024-09-17T01:06:04.184 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:03 smithi099 ceph-mon[77412]: Reconfiguring daemon mgr.smithi099.vswzrb on smithi099 2024-09-17T01:06:04.185 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:04.185 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:04.185 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:06:04.185 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:06:04.185 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:05.121 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:04 smithi099 ceph-mon[77412]: pgmap v22: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:05.121 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:04 smithi099 ceph-mon[77412]: Reconfiguring mon.smithi099 (monmap changed)... 2024-09-17T01:06:05.121 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:04 smithi099 ceph-mon[77412]: Reconfiguring daemon mon.smithi099 on smithi099 2024-09-17T01:06:05.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:04 smithi002 ceph-mon[98018]: pgmap v22: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:05.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:04 smithi002 ceph-mon[98018]: Reconfiguring mon.smithi099 (monmap changed)... 2024-09-17T01:06:05.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:04 smithi002 ceph-mon[98018]: Reconfiguring daemon mon.smithi099 on smithi099 2024-09-17T01:06:06.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:06 smithi099 ceph-mon[77412]: pgmap v23: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:06.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:06 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:06.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:06 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:06.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:06 smithi099 ceph-mon[77412]: Reconfiguring osd.3 (monmap changed)... 2024-09-17T01:06:06.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:06 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:06:06.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:06 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:06.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:06 smithi099 ceph-mon[77412]: Reconfiguring daemon osd.3 on smithi099 2024-09-17T01:06:06.591 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:06 smithi002 ceph-mon[98018]: pgmap v23: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:06.591 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:06 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:06.592 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:06 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:06.592 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:06 smithi002 ceph-mon[98018]: Reconfiguring osd.3 (monmap changed)... 2024-09-17T01:06:06.592 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:06 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:06:06.592 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:06 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:06.592 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:06 smithi002 ceph-mon[98018]: Reconfiguring daemon osd.3 on smithi099 2024-09-17T01:06:07.952 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:07 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:07.952 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:07 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:07.952 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:07 smithi099 ceph-mon[77412]: Reconfiguring osd.4 (monmap changed)... 2024-09-17T01:06:07.953 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:07 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:06:07.953 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:07 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:07.953 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:07 smithi099 ceph-mon[77412]: Reconfiguring daemon osd.4 on smithi099 2024-09-17T01:06:08.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:07 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:08.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:07 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:08.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:07 smithi002 ceph-mon[98018]: Reconfiguring osd.4 (monmap changed)... 2024-09-17T01:06:08.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:07 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:06:08.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:07 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:08.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:07 smithi002 ceph-mon[98018]: Reconfiguring daemon osd.4 on smithi099 2024-09-17T01:06:09.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:08 smithi099 ceph-mon[77412]: pgmap v24: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:06:09.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:08 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:09.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:08 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:09.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:08 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:06:09.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:08 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:09.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:08 smithi002 ceph-mon[98018]: pgmap v24: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:06:09.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:08 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:09.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:08 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:09.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:08 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:06:09.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:08 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:09.939 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:09 smithi099 ceph-mon[77412]: Reconfiguring osd.5 (monmap changed)... 2024-09-17T01:06:09.939 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:09 smithi099 ceph-mon[77412]: Reconfiguring daemon osd.5 on smithi099 2024-09-17T01:06:09.939 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:09 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:09.939 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:09 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:09.939 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:09 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.hgawhu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:06:09.939 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:09 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:10.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:09 smithi002 ceph-mon[98018]: Reconfiguring osd.5 (monmap changed)... 2024-09-17T01:06:10.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:09 smithi002 ceph-mon[98018]: Reconfiguring daemon osd.5 on smithi099 2024-09-17T01:06:10.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:09 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:10.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:09 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:10.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:09 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.hgawhu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:06:10.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:09 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:11.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:10 smithi099 ceph-mon[77412]: pgmap v25: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:11.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:10 smithi099 ceph-mon[77412]: Reconfiguring mds.cephfs.smithi099.hgawhu (monmap changed)... 2024-09-17T01:06:11.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:10 smithi099 ceph-mon[77412]: Reconfiguring daemon mds.cephfs.smithi099.hgawhu on smithi099 2024-09-17T01:06:11.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:10 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:11.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:10 smithi002 ceph-mon[98018]: pgmap v25: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:11.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:10 smithi002 ceph-mon[98018]: Reconfiguring mds.cephfs.smithi099.hgawhu (monmap changed)... 2024-09-17T01:06:11.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:10 smithi002 ceph-mon[98018]: Reconfiguring daemon mds.cephfs.smithi099.hgawhu on smithi099 2024-09-17T01:06:11.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:10 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:12.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:11 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:12.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:11 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:12.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:11 smithi002 ceph-mon[98018]: Reconfiguring mds.cephfs.smithi099.heckcd (monmap changed)... 2024-09-17T01:06:12.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:11 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.heckcd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:06:12.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:11 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:12.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:11 smithi002 ceph-mon[98018]: Reconfiguring daemon mds.cephfs.smithi099.heckcd on smithi099 2024-09-17T01:06:12.234 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:11 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:12.234 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:11 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:12.234 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:11 smithi099 ceph-mon[77412]: Reconfiguring mds.cephfs.smithi099.heckcd (monmap changed)... 2024-09-17T01:06:12.234 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:11 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.heckcd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:06:12.235 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:11 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:12.235 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:11 smithi099 ceph-mon[77412]: Reconfiguring daemon mds.cephfs.smithi099.heckcd on smithi099 2024-09-17T01:06:12.989 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:12 smithi002 ceph-mon[98018]: pgmap v26: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:06:12.989 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:12 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:12.990 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:12 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:12.990 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:12 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:12.990 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:12 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:12.990 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:12 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:12.991 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:12 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:12.991 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:12 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi002"}]: dispatch 2024-09-17T01:06:12.991 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:12 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi002"}]': finished 2024-09-17T01:06:12.991 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:12 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi099"}]: dispatch 2024-09-17T01:06:12.992 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:12 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi099"}]': finished 2024-09-17T01:06:13.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:12 smithi099 ceph-mon[77412]: pgmap v26: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:06:13.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:12 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:13.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:12 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:13.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:12 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:13.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:12 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:13.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:12 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:13.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:12 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:13.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:12 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi002"}]: dispatch 2024-09-17T01:06:13.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:12 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi002"}]': finished 2024-09-17T01:06:13.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:12 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi099"}]: dispatch 2024-09-17T01:06:13.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:12 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi099"}]': finished 2024-09-17T01:06:14.081 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:13 smithi002 ceph-mon[98018]: Upgrade: Setting container_image for all mon 2024-09-17T01:06:14.082 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:13 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:14.082 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:13 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:06:14.082 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:13 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:13 smithi099 ceph-mon[77412]: Upgrade: Setting container_image for all mon 2024-09-17T01:06:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:13 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:13 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:06:14.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:13 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:15.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:14 smithi002 ceph-mon[98018]: pgmap v27: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:15.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:14 smithi002 ceph-mon[98018]: Upgrade: Updating crash.smithi002 (1/2) 2024-09-17T01:06:15.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:14 smithi002 ceph-mon[98018]: Deploying daemon crash.smithi002 on smithi002 2024-09-17T01:06:15.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:14 smithi099 ceph-mon[77412]: pgmap v27: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:15.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:14 smithi099 ceph-mon[77412]: Upgrade: Updating crash.smithi002 (1/2) 2024-09-17T01:06:15.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:14 smithi099 ceph-mon[77412]: Deploying daemon crash.smithi002 on smithi002 2024-09-17T01:06:16.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.473+0000 7fef84aca640 1 -- 172.21.15.2:0/1416791961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef80102f20 msgr2=0x7fef800fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:16.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.473+0000 7fef84aca640 1 --2- 172.21.15.2:0/1416791961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef80102f20 0x7fef800fc5e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fef740048d0 tx=0x7fef74009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:16.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.473+0000 7fef84aca640 1 -- 172.21.15.2:0/1416791961 shutdown_connections 2024-09-17T01:06:16.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.473+0000 7fef84aca640 1 --2- 172.21.15.2:0/1416791961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef80102f20 0x7fef800fc5e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:16.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.473+0000 7fef84aca640 1 --2- 172.21.15.2:0/1416791961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef80102580 0x7fef80102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:16.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.473+0000 7fef84aca640 1 -- 172.21.15.2:0/1416791961 >> 172.21.15.2:0/1416791961 conn(0x7fef800f81a0 msgr2=0x7fef800fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.474+0000 7fef84aca640 1 -- 172.21.15.2:0/1416791961 shutdown_connections 2024-09-17T01:06:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.474+0000 7fef84aca640 1 -- 172.21.15.2:0/1416791961 wait complete. 2024-09-17T01:06:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.474+0000 7fef84aca640 1 Processor -- start 2024-09-17T01:06:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.474+0000 7fef84aca640 1 -- start start 2024-09-17T01:06:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.474+0000 7fef84aca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef80102580 0x7fef80113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.474+0000 7fef84aca640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef80102f20 0x7fef80113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.474+0000 7fef84aca640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef80113d60 con 0x7fef80102580 2024-09-17T01:06:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.474+0000 7fef84aca640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8010d1a0 con 0x7fef80102f20 2024-09-17T01:06:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.475+0000 7fef7e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef80102580 0x7fef80113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.475+0000 7fef7e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef80102580 0x7fef80113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53470/0 (socket says 172.21.15.2:53470) 2024-09-17T01:06:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.475+0000 7fef7e59c640 1 -- 172.21.15.2:0/851931116 learned_addr learned my addr 172.21.15.2:0/851931116 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:06:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.475+0000 7fef7dd9b640 1 --2- 172.21.15.2:0/851931116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef80102f20 0x7fef80113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:16.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.475+0000 7fef7e59c640 1 -- 172.21.15.2:0/851931116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef80102f20 msgr2=0x7fef80113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.475+0000 7fef7e59c640 1 --2- 172.21.15.2:0/851931116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef80102f20 0x7fef80113760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.475+0000 7fef7e59c640 1 -- 172.21.15.2:0/851931116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef74005040 con 0x7fef80102580 2024-09-17T01:06:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.475+0000 7fef7dd9b640 1 --2- 172.21.15.2:0/851931116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef80102f20 0x7fef80113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:06:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.475+0000 7fef7e59c640 1 --2- 172.21.15.2:0/851931116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef80102580 0x7fef80113220 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef70002a50 tx=0x7fef70004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.475+0000 7fef6effd640 1 -- 172.21.15.2:0/851931116 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef70007c30 con 0x7fef80102580 2024-09-17T01:06:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.475+0000 7fef84aca640 1 -- 172.21.15.2:0/851931116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8010d480 con 0x7fef80102580 2024-09-17T01:06:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.475+0000 7fef84aca640 1 -- 172.21.15.2:0/851931116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8010da20 con 0x7fef80102580 2024-09-17T01:06:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.476+0000 7fef6effd640 1 -- 172.21.15.2:0/851931116 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fef7000f040 con 0x7fef80102580 2024-09-17T01:06:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.476+0000 7fef6effd640 1 -- 172.21.15.2:0/851931116 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef7000da10 con 0x7fef80102580 2024-09-17T01:06:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.477+0000 7fef84aca640 1 -- 172.21.15.2:0/851931116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef60005210 con 0x7fef80102580 2024-09-17T01:06:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.477+0000 7fef6effd640 1 -- 172.21.15.2:0/851931116 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7fef7000dc70 con 0x7fef80102580 2024-09-17T01:06:16.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.478+0000 7fef6effd640 1 --2- 172.21.15.2:0/851931116 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fef6806e660 0x7fef68070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:16.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.478+0000 7fef6effd640 1 -- 172.21.15.2:0/851931116 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fef7008dd40 con 0x7fef80102580 2024-09-17T01:06:16.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.478+0000 7fef7dd9b640 1 --2- 172.21.15.2:0/851931116 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fef6806e660 0x7fef68070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:16.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.478+0000 7fef7dd9b640 1 --2- 172.21.15.2:0/851931116 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fef6806e660 0x7fef68070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fef8010eae0 tx=0x7fef74009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:16.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.482+0000 7fef6effd640 1 -- 172.21.15.2:0/851931116 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fef70057a70 con 0x7fef80102580 2024-09-17T01:06:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.705+0000 7fef84aca640 1 -- 172.21.15.2:0/851931116 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef60000bc0 con 0x7fef6806e660 2024-09-17T01:06:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.707+0000 7fef6effd640 1 -- 172.21.15.2:0/851931116 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fef60000bc0 con 0x7fef6806e660 2024-09-17T01:06:16.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.709+0000 7fef84aca640 1 -- 172.21.15.2:0/851931116 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fef6806e660 msgr2=0x7fef68070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.709+0000 7fef84aca640 1 --2- 172.21.15.2:0/851931116 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fef6806e660 0x7fef68070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fef8010eae0 tx=0x7fef74009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.709+0000 7fef84aca640 1 -- 172.21.15.2:0/851931116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef80102580 msgr2=0x7fef80113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.709+0000 7fef84aca640 1 --2- 172.21.15.2:0/851931116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef80102580 0x7fef80113220 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef70002a50 tx=0x7fef70004600 comp rx=0 tx=0).stop 2024-09-17T01:06:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.709+0000 7fef84aca640 1 -- 172.21.15.2:0/851931116 shutdown_connections 2024-09-17T01:06:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.709+0000 7fef84aca640 1 --2- 172.21.15.2:0/851931116 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fef6806e660 0x7fef68070b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.709+0000 7fef84aca640 1 --2- 172.21.15.2:0/851931116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef80102f20 0x7fef80113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.709+0000 7fef84aca640 1 --2- 172.21.15.2:0/851931116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef80102580 0x7fef80113220 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.709+0000 7fef84aca640 1 -- 172.21.15.2:0/851931116 >> 172.21.15.2:0/851931116 conn(0x7fef800f81a0 msgr2=0x7fef800f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.709+0000 7fef84aca640 1 -- 172.21.15.2:0/851931116 shutdown_connections 2024-09-17T01:06:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.709+0000 7fef84aca640 1 -- 172.21.15.2:0/851931116 wait complete. 2024-09-17T01:06:16.715 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:06:16.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.813+0000 7f9c9f925640 1 -- 172.21.15.2:0/3590179712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98101e20 msgr2=0x7f9c980fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:16.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.813+0000 7f9c9f925640 1 --2- 172.21.15.2:0/3590179712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98101e20 0x7f9c980fbd70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0048d0 tx=0x7f9c8c009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:16.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.813+0000 7f9c9f925640 1 -- 172.21.15.2:0/3590179712 shutdown_connections 2024-09-17T01:06:16.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.813+0000 7f9c9f925640 1 --2- 172.21.15.2:0/3590179712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98101e20 0x7f9c980fbd70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:16.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.813+0000 7f9c9f925640 1 --2- 172.21.15.2:0/3590179712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c98101480 0x7f9c98101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:16.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.813+0000 7f9c9f925640 1 -- 172.21.15.2:0/3590179712 >> 172.21.15.2:0/3590179712 conn(0x7f9c98070c80 msgr2=0x7f9c98071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:16.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.813+0000 7f9c9f925640 1 -- 172.21.15.2:0/3590179712 shutdown_connections 2024-09-17T01:06:16.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.813+0000 7f9c9f925640 1 -- 172.21.15.2:0/3590179712 wait complete. 2024-09-17T01:06:16.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.813+0000 7f9c9f925640 1 Processor -- start 2024-09-17T01:06:16.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.813+0000 7f9c9f925640 1 -- start start 2024-09-17T01:06:16.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.814+0000 7f9c9f925640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98101480 0x7f9c9810e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:16.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.814+0000 7f9c9f925640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c98101e20 0x7f9c9810e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:16.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.814+0000 7f9c9f925640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9810ed20 con 0x7f9c98101480 2024-09-17T01:06:16.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.814+0000 7f9c9f925640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9810ee90 con 0x7f9c98101e20 2024-09-17T01:06:16.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.814+0000 7f9c9d6c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98101480 0x7f9c9810e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:16.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.814+0000 7f9c9d6c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98101480 0x7f9c9810e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53478/0 (socket says 172.21.15.2:53478) 2024-09-17T01:06:16.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.814+0000 7f9c9d6c1640 1 -- 172.21.15.2:0/1004546430 learned_addr learned my addr 172.21.15.2:0/1004546430 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:06:16.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.814+0000 7f9c9cec0640 1 --2- 172.21.15.2:0/1004546430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c98101e20 0x7f9c9810e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:16.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.814+0000 7f9c9d6c1640 1 -- 172.21.15.2:0/1004546430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c98101e20 msgr2=0x7f9c9810e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:16.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.814+0000 7f9c9d6c1640 1 --2- 172.21.15.2:0/1004546430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c98101e20 0x7f9c9810e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:16.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.814+0000 7f9c9d6c1640 1 -- 172.21.15.2:0/1004546430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c005040 con 0x7f9c98101480 2024-09-17T01:06:16.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.815+0000 7f9c9d6c1640 1 --2- 172.21.15.2:0/1004546430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98101480 0x7f9c9810e190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c94002a50 tx=0x7f9c94004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:16.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.815+0000 7f9c89ffb640 1 -- 172.21.15.2:0/1004546430 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c94007c30 con 0x7f9c98101480 2024-09-17T01:06:16.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.815+0000 7f9c89ffb640 1 -- 172.21.15.2:0/1004546430 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9c9400f040 con 0x7f9c98101480 2024-09-17T01:06:16.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.815+0000 7f9c9f925640 1 -- 172.21.15.2:0/1004546430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c98117200 con 0x7f9c98101480 2024-09-17T01:06:16.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.815+0000 7f9c89ffb640 1 -- 172.21.15.2:0/1004546430 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c9400dad0 con 0x7f9c98101480 2024-09-17T01:06:16.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.815+0000 7f9c9f925640 1 -- 172.21.15.2:0/1004546430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c98117710 con 0x7f9c98101480 2024-09-17T01:06:16.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.816+0000 7f9c9f925640 1 -- 172.21.15.2:0/1004546430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c980fcd80 con 0x7f9c98101480 2024-09-17T01:06:16.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.817+0000 7f9c89ffb640 1 -- 172.21.15.2:0/1004546430 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f9c9400dc30 con 0x7f9c98101480 2024-09-17T01:06:16.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.818+0000 7f9c89ffb640 1 --2- 172.21.15.2:0/1004546430 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f9c8406e660 0x7f9c84070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:16.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.818+0000 7f9c89ffb640 1 -- 172.21.15.2:0/1004546430 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9c9408e1e0 con 0x7f9c98101480 2024-09-17T01:06:16.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.818+0000 7f9c9cec0640 1 --2- 172.21.15.2:0/1004546430 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f9c8406e660 0x7f9c84070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:16.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.819+0000 7f9c9cec0640 1 --2- 172.21.15.2:0/1004546430 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f9c8406e660 0x7f9c84070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0048a0 tx=0x7f9c8c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:16.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:16.823+0000 7f9c89ffb640 1 -- 172.21.15.2:0/1004546430 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9c94057100 con 0x7f9c98101480 2024-09-17T01:06:17.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.024+0000 7f9c9f925640 1 -- 172.21.15.2:0/1004546430 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c980fb410 con 0x7f9c8406e660 2024-09-17T01:06:17.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.025+0000 7f9c89ffb640 1 -- 172.21.15.2:0/1004546430 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f9c980fb410 con 0x7f9c8406e660 2024-09-17T01:06:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.027+0000 7f9c9f925640 1 -- 172.21.15.2:0/1004546430 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f9c8406e660 msgr2=0x7f9c84070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.027+0000 7f9c9f925640 1 --2- 172.21.15.2:0/1004546430 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f9c8406e660 0x7f9c84070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0048a0 tx=0x7f9c8c035040 comp rx=0 tx=0).stop 2024-09-17T01:06:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.028+0000 7f9c9f925640 1 -- 172.21.15.2:0/1004546430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98101480 msgr2=0x7f9c9810e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.028+0000 7f9c9f925640 1 --2- 172.21.15.2:0/1004546430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98101480 0x7f9c9810e190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c94002a50 tx=0x7f9c94004600 comp rx=0 tx=0).stop 2024-09-17T01:06:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.028+0000 7f9c9f925640 1 -- 172.21.15.2:0/1004546430 shutdown_connections 2024-09-17T01:06:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.028+0000 7f9c9f925640 1 --2- 172.21.15.2:0/1004546430 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f9c8406e660 0x7f9c84070b10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.028+0000 7f9c9f925640 1 --2- 172.21.15.2:0/1004546430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c98101e20 0x7f9c9810e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.028+0000 7f9c9f925640 1 --2- 172.21.15.2:0/1004546430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c98101480 0x7f9c9810e190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.028+0000 7f9c9f925640 1 -- 172.21.15.2:0/1004546430 >> 172.21.15.2:0/1004546430 conn(0x7f9c98070c80 msgr2=0x7f9c980f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.028+0000 7f9c9f925640 1 -- 172.21.15.2:0/1004546430 shutdown_connections 2024-09-17T01:06:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.028+0000 7f9c9f925640 1 -- 172.21.15.2:0/1004546430 wait complete. 2024-09-17T01:06:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.110+0000 7fc10f851640 1 -- 172.21.15.2:0/1173872486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1081014b0 msgr2=0x7fc108101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.110+0000 7fc10f851640 1 --2- 172.21.15.2:0/1173872486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1081014b0 0x7fc108101880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1040048d0 tx=0x7fc104009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.110+0000 7fc10f851640 1 -- 172.21.15.2:0/1173872486 shutdown_connections 2024-09-17T01:06:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.110+0000 7fc10f851640 1 --2- 172.21.15.2:0/1173872486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1080fb470 0x7fc1080fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.110+0000 7fc10f851640 1 --2- 172.21.15.2:0/1173872486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1081014b0 0x7fc108101880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.108 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:16 smithi002 ceph-mon[98018]: pgmap v28: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:17.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.110+0000 7fc10f851640 1 -- 172.21.15.2:0/1173872486 >> 172.21.15.2:0/1173872486 conn(0x7fc1080f7030 msgr2=0x7fc1080f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:17.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.110+0000 7fc10f851640 1 -- 172.21.15.2:0/1173872486 shutdown_connections 2024-09-17T01:06:17.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.110+0000 7fc10f851640 1 -- 172.21.15.2:0/1173872486 wait complete. 2024-09-17T01:06:17.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.111+0000 7fc10f851640 1 Processor -- start 2024-09-17T01:06:17.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.111+0000 7fc10f851640 1 -- start start 2024-09-17T01:06:17.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.111+0000 7fc10f851640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1080fb470 0x7fc1081120c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:17.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.111+0000 7fc10f851640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1081014b0 0x7fc108112600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:17.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.111+0000 7fc10f851640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc108112c00 con 0x7fc1081014b0 2024-09-17T01:06:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.111+0000 7fc10f851640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10810c040 con 0x7fc1080fb470 2024-09-17T01:06:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.111+0000 7fc10cdec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1081014b0 0x7fc108112600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.111+0000 7fc10cdec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1081014b0 0x7fc108112600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53498/0 (socket says 172.21.15.2:53498) 2024-09-17T01:06:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.111+0000 7fc10cdec640 1 -- 172.21.15.2:0/2623984549 learned_addr learned my addr 172.21.15.2:0/2623984549 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:06:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.112+0000 7fc10d5ed640 1 --2- 172.21.15.2:0/2623984549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1080fb470 0x7fc1081120c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.112+0000 7fc10cdec640 1 -- 172.21.15.2:0/2623984549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1080fb470 msgr2=0x7fc1081120c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.112+0000 7fc10cdec640 1 --2- 172.21.15.2:0/2623984549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1080fb470 0x7fc1081120c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.112+0000 7fc10cdec640 1 -- 172.21.15.2:0/2623984549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc104005040 con 0x7fc1081014b0 2024-09-17T01:06:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.112+0000 7fc10cdec640 1 --2- 172.21.15.2:0/2623984549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1081014b0 0x7fc108112600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8002a50 tx=0x7fc0f8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.112+0000 7fc0fdffb640 1 -- 172.21.15.2:0/2623984549 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0f8007c30 con 0x7fc1081014b0 2024-09-17T01:06:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.112+0000 7fc0fdffb640 1 -- 172.21.15.2:0/2623984549 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc0f800f040 con 0x7fc1081014b0 2024-09-17T01:06:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.112+0000 7fc10f851640 1 -- 172.21.15.2:0/2623984549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10810c320 con 0x7fc1081014b0 2024-09-17T01:06:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.112+0000 7fc0fdffb640 1 -- 172.21.15.2:0/2623984549 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0f800da10 con 0x7fc1081014b0 2024-09-17T01:06:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.112+0000 7fc10f851640 1 -- 172.21.15.2:0/2623984549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10810c8c0 con 0x7fc1081014b0 2024-09-17T01:06:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.113+0000 7fc10f851640 1 -- 172.21.15.2:0/2623984549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1080fcbb0 con 0x7fc1081014b0 2024-09-17T01:06:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.114+0000 7fc0fdffb640 1 -- 172.21.15.2:0/2623984549 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7fc0f800dbb0 con 0x7fc1081014b0 2024-09-17T01:06:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.114+0000 7fc0fdffb640 1 --2- 172.21.15.2:0/2623984549 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc0f406e660 0x7fc0f4070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.114+0000 7fc0fdffb640 1 -- 172.21.15.2:0/2623984549 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc0f808db90 con 0x7fc1081014b0 2024-09-17T01:06:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.114+0000 7fc10d5ed640 1 --2- 172.21.15.2:0/2623984549 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc0f406e660 0x7fc0f4070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.115+0000 7fc10d5ed640 1 --2- 172.21.15.2:0/2623984549 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc0f406e660 0x7fc0f4070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc104009ac0 tx=0x7fc104035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:17.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.119+0000 7fc0fdffb640 1 -- 172.21.15.2:0/2623984549 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc0f8056b40 con 0x7fc1081014b0 2024-09-17T01:06:17.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:16 smithi099 ceph-mon[77412]: pgmap v28: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:17.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.307+0000 7fc10f851640 1 -- 172.21.15.2:0/2623984549 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc108108480 con 0x7fc0f406e660 2024-09-17T01:06:17.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.317+0000 7fc0fdffb640 1 -- 172.21.15.2:0/2623984549 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc108108480 con 0x7fc0f406e660 2024-09-17T01:06:17.317 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:06:17.317 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (3m) 46s ago 12m 20.8M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:06:17.317 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (12m) 46s ago 12m 6903k - 17.2.7-1635-g4a704134 f22ead590bad 53b003b1ad6f 2024-09-17T01:06:17.317 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (11m) 32s ago 11m 6891k - 17.2.7-1635-g4a704134 f22ead590bad 6ec40439e9b5 2024-09-17T01:06:17.317 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (2m) 46s ago 11m 76.3M - 9.4.12 2bacad6d85d8 5fe408c103d6 2024-09-17T01:06:17.317 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (6m) 46s ago 6m 125M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:06:17.317 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (6m) 46s ago 6m 65.4M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:06:17.317 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (6m) 32s ago 6m 64.8M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:06:17.317 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (6m) 32s ago 6m 115M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:06:17.317 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (2m) 46s ago 13m 472M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:06:17.317 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (2m) 32s ago 11m 438M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:06:17.317 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (59s) 46s ago 13m 27.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de da5247385c2d 2024-09-17T01:06:17.318 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (37s) 32s ago 11m 20.7M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b92f98b2cab9 2024-09-17T01:06:17.318 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (3m) 46s ago 12m 15.7M - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:06:17.318 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (3m) 32s ago 11m 15.7M - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:06:17.318 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (10m) 46s ago 10m 225M 1558M 17.2.7-1635-g4a704134 f22ead590bad 720f74f40752 2024-09-17T01:06:17.318 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (10m) 46s ago 10m 244M 1558M 17.2.7-1635-g4a704134 f22ead590bad 629defddb38c 2024-09-17T01:06:17.318 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (9m) 46s ago 9m 197M 1558M 17.2.7-1635-g4a704134 f22ead590bad 5dff1cf9fc56 2024-09-17T01:06:17.318 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (9m) 32s ago 9m 272M 2581M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:06:17.318 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (8m) 32s ago 8m 239M 2581M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:06:17.318 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (8m) 32s ago 8m 222M 2581M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:06:17.318 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (2m) 46s ago 11m 55.5M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:06:17.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.319+0000 7fc10f851640 1 -- 172.21.15.2:0/2623984549 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc0f406e660 msgr2=0x7fc0f4070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:17.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.319+0000 7fc10f851640 1 --2- 172.21.15.2:0/2623984549 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc0f406e660 0x7fc0f4070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc104009ac0 tx=0x7fc104035040 comp rx=0 tx=0).stop 2024-09-17T01:06:17.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.319+0000 7fc10f851640 1 -- 172.21.15.2:0/2623984549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1081014b0 msgr2=0x7fc108112600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:17.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.319+0000 7fc10f851640 1 --2- 172.21.15.2:0/2623984549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1081014b0 0x7fc108112600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8002a50 tx=0x7fc0f8004600 comp rx=0 tx=0).stop 2024-09-17T01:06:17.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.319+0000 7fc10f851640 1 -- 172.21.15.2:0/2623984549 shutdown_connections 2024-09-17T01:06:17.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.319+0000 7fc10f851640 1 --2- 172.21.15.2:0/2623984549 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc0f406e660 0x7fc0f4070b10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.319+0000 7fc10f851640 1 --2- 172.21.15.2:0/2623984549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1081014b0 0x7fc108112600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.319+0000 7fc10f851640 1 --2- 172.21.15.2:0/2623984549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1080fb470 0x7fc1081120c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.319+0000 7fc10f851640 1 -- 172.21.15.2:0/2623984549 >> 172.21.15.2:0/2623984549 conn(0x7fc1080f7030 msgr2=0x7fc1080f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:17.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.319+0000 7fc10f851640 1 -- 172.21.15.2:0/2623984549 shutdown_connections 2024-09-17T01:06:17.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.319+0000 7fc10f851640 1 -- 172.21.15.2:0/2623984549 wait complete. 2024-09-17T01:06:17.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.399+0000 7f5534c40640 1 -- 172.21.15.2:0/1912500268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55301047a0 msgr2=0x7f5530104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:17.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.399+0000 7f5534c40640 1 --2- 172.21.15.2:0/1912500268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55301047a0 0x7f5530104b70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f55200048d0 tx=0x7f5520009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.399+0000 7f5534c40640 1 -- 172.21.15.2:0/1912500268 shutdown_connections 2024-09-17T01:06:17.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.399+0000 7f5534c40640 1 --2- 172.21.15.2:0/1912500268 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55300fe780 0x7f55300febf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.399+0000 7f5534c40640 1 --2- 172.21.15.2:0/1912500268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55301047a0 0x7f5530104b70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.399+0000 7f5534c40640 1 -- 172.21.15.2:0/1912500268 >> 172.21.15.2:0/1912500268 conn(0x7f55300fa320 msgr2=0x7f55300fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:17.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.399+0000 7f5534c40640 1 -- 172.21.15.2:0/1912500268 shutdown_connections 2024-09-17T01:06:17.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.399+0000 7f5534c40640 1 -- 172.21.15.2:0/1912500268 wait complete. 2024-09-17T01:06:17.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.400+0000 7f5534c40640 1 Processor -- start 2024-09-17T01:06:17.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.400+0000 7f5534c40640 1 -- start start 2024-09-17T01:06:17.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.400+0000 7f5534c40640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55300fe780 0x7f5530115360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:17.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.400+0000 7f5534c40640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55301047a0 0x7f55301158a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:17.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.400+0000 7f5534c40640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5530115ea0 con 0x7f55300fe780 2024-09-17T01:06:17.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.400+0000 7f5534c40640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553010f2e0 con 0x7f55301047a0 2024-09-17T01:06:17.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.400+0000 7f552e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55300fe780 0x7f5530115360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:17.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.400+0000 7f552e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55300fe780 0x7f5530115360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53520/0 (socket says 172.21.15.2:53520) 2024-09-17T01:06:17.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.400+0000 7f552e59c640 1 -- 172.21.15.2:0/4055670731 learned_addr learned my addr 172.21.15.2:0/4055670731 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:06:17.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.401+0000 7f552dd9b640 1 --2- 172.21.15.2:0/4055670731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55301047a0 0x7f55301158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:17.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.401+0000 7f552e59c640 1 -- 172.21.15.2:0/4055670731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55301047a0 msgr2=0x7f55301158a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:17.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.401+0000 7f552e59c640 1 --2- 172.21.15.2:0/4055670731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55301047a0 0x7f55301158a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.401+0000 7f552e59c640 1 -- 172.21.15.2:0/4055670731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5520005040 con 0x7f55300fe780 2024-09-17T01:06:17.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.401+0000 7f552e59c640 1 --2- 172.21.15.2:0/4055670731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55300fe780 0x7f5530115360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5520000c00 tx=0x7f5520009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:17.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.401+0000 7f551effd640 1 -- 172.21.15.2:0/4055670731 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5520038070 con 0x7f55300fe780 2024-09-17T01:06:17.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.401+0000 7f551effd640 1 -- 172.21.15.2:0/4055670731 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f552002ade0 con 0x7f55300fe780 2024-09-17T01:06:17.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.401+0000 7f5534c40640 1 -- 172.21.15.2:0/4055670731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553010f560 con 0x7f55300fe780 2024-09-17T01:06:17.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.401+0000 7f551effd640 1 -- 172.21.15.2:0/4055670731 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f552002c7e0 con 0x7f55300fe780 2024-09-17T01:06:17.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.401+0000 7f5534c40640 1 -- 172.21.15.2:0/4055670731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553010faa0 con 0x7f55300fe780 2024-09-17T01:06:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.402+0000 7f5534c40640 1 -- 172.21.15.2:0/4055670731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55300ffec0 con 0x7f55300fe780 2024-09-17T01:06:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.403+0000 7f551effd640 1 -- 172.21.15.2:0/4055670731 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f5520030020 con 0x7f55300fe780 2024-09-17T01:06:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.404+0000 7f551effd640 1 --2- 172.21.15.2:0/4055670731 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f551806e660 0x7f5518070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.404+0000 7f551effd640 1 -- 172.21.15.2:0/4055670731 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f55200adf10 con 0x7f55300fe780 2024-09-17T01:06:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.404+0000 7f552dd9b640 1 --2- 172.21.15.2:0/4055670731 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f551806e660 0x7f5518070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:17.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.404+0000 7f552dd9b640 1 --2- 172.21.15.2:0/4055670731 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f551806e660 0x7f5518070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5530110c20 tx=0x7f552400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.408+0000 7f551effd640 1 -- 172.21.15.2:0/4055670731 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5520076ff0 con 0x7f55300fe780 2024-09-17T01:06:17.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.665+0000 7f5534c40640 1 -- 172.21.15.2:0/4055670731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f55300fdf40 con 0x7f55300fe780 2024-09-17T01:06:17.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.666+0000 7f551effd640 1 -- 172.21.15.2:0/4055670731 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f552007a6b0 con 0x7f55300fe780 2024-09-17T01:06:17.663 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:06:17.663 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:06:17.663 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:06:17.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:06:17.664 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:06:17.664 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:06:17.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:06:17.664 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:06:17.664 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6 2024-09-17T01:06:17.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:06:17.664 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:06:17.664 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:06:17.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:06:17.664 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:06:17.664 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 10, 2024-09-17T01:06:17.664 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:06:17.665 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:06:17.665 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:06:17.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.668+0000 7f5534c40640 1 -- 172.21.15.2:0/4055670731 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f551806e660 msgr2=0x7f5518070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:17.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.668+0000 7f5534c40640 1 --2- 172.21.15.2:0/4055670731 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f551806e660 0x7f5518070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5530110c20 tx=0x7f552400b040 comp rx=0 tx=0).stop 2024-09-17T01:06:17.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.668+0000 7f5534c40640 1 -- 172.21.15.2:0/4055670731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55300fe780 msgr2=0x7f5530115360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:17.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.668+0000 7f5534c40640 1 --2- 172.21.15.2:0/4055670731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55300fe780 0x7f5530115360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5520000c00 tx=0x7f5520009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.668+0000 7f5534c40640 1 -- 172.21.15.2:0/4055670731 shutdown_connections 2024-09-17T01:06:17.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.668+0000 7f5534c40640 1 --2- 172.21.15.2:0/4055670731 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f551806e660 0x7f5518070b10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.668+0000 7f5534c40640 1 --2- 172.21.15.2:0/4055670731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55301047a0 0x7f55301158a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.668+0000 7f5534c40640 1 --2- 172.21.15.2:0/4055670731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55300fe780 0x7f5530115360 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.668+0000 7f5534c40640 1 -- 172.21.15.2:0/4055670731 >> 172.21.15.2:0/4055670731 conn(0x7f55300fa320 msgr2=0x7f55300fb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:17.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.668+0000 7f5534c40640 1 -- 172.21.15.2:0/4055670731 shutdown_connections 2024-09-17T01:06:17.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.668+0000 7f5534c40640 1 -- 172.21.15.2:0/4055670731 wait complete. 2024-09-17T01:06:17.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.749+0000 7f3013ae7640 1 -- 172.21.15.2:0/3829039917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c101510 msgr2=0x7f300c1018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:17.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.749+0000 7f3013ae7640 1 --2- 172.21.15.2:0/3829039917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c101510 0x7f300c1018e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f30080048d0 tx=0x7f3008009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.750+0000 7f3013ae7640 1 -- 172.21.15.2:0/3829039917 shutdown_connections 2024-09-17T01:06:17.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.750+0000 7f3013ae7640 1 --2- 172.21.15.2:0/3829039917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f300c0fb4d0 0x7f300c0fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.750+0000 7f3013ae7640 1 --2- 172.21.15.2:0/3829039917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c101510 0x7f300c1018e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.750+0000 7f3013ae7640 1 -- 172.21.15.2:0/3829039917 >> 172.21.15.2:0/3829039917 conn(0x7f300c0f7090 msgr2=0x7f300c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:17.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.750+0000 7f3013ae7640 1 -- 172.21.15.2:0/3829039917 shutdown_connections 2024-09-17T01:06:17.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.750+0000 7f3013ae7640 1 -- 172.21.15.2:0/3829039917 wait complete. 2024-09-17T01:06:17.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.750+0000 7f3013ae7640 1 Processor -- start 2024-09-17T01:06:17.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.750+0000 7f3013ae7640 1 -- start start 2024-09-17T01:06:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.750+0000 7f3013ae7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c0fb4d0 0x7f300c113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.750+0000 7f3013ae7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f300c101510 0x7f300c1136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.750+0000 7f3013ae7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c113cd0 con 0x7f300c0fb4d0 2024-09-17T01:06:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f3013ae7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c113e40 con 0x7f300c101510 2024-09-17T01:06:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f3011883640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c0fb4d0 0x7f300c113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f3011883640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c0fb4d0 0x7f300c113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53544/0 (socket says 172.21.15.2:53544) 2024-09-17T01:06:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f3011883640 1 -- 172.21.15.2:0/555927319 learned_addr learned my addr 172.21.15.2:0/555927319 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:06:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f3011082640 1 --2- 172.21.15.2:0/555927319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f300c101510 0x7f300c1136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f3011883640 1 -- 172.21.15.2:0/555927319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f300c101510 msgr2=0x7f300c1136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f3011883640 1 --2- 172.21.15.2:0/555927319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f300c101510 0x7f300c1136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f3011883640 1 -- 172.21.15.2:0/555927319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3008005040 con 0x7f300c0fb4d0 2024-09-17T01:06:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f3011082640 1 --2- 172.21.15.2:0/555927319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f300c101510 0x7f300c1136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:06:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f3011883640 1 --2- 172.21.15.2:0/555927319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c0fb4d0 0x7f300c113190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3008000c00 tx=0x7f3008009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:17.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f30027fc640 1 -- 172.21.15.2:0/555927319 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3008038070 con 0x7f300c0fb4d0 2024-09-17T01:06:17.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f30027fc640 1 -- 172.21.15.2:0/555927319 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f300802ade0 con 0x7f300c0fb4d0 2024-09-17T01:06:17.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f3013ae7640 1 -- 172.21.15.2:0/555927319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300c10d260 con 0x7f300c0fb4d0 2024-09-17T01:06:17.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f30027fc640 1 -- 172.21.15.2:0/555927319 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f300802c7b0 con 0x7f300c0fb4d0 2024-09-17T01:06:17.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.751+0000 7f3013ae7640 1 -- 172.21.15.2:0/555927319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300c10d720 con 0x7f300c0fb4d0 2024-09-17T01:06:17.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.752+0000 7f3013ae7640 1 -- 172.21.15.2:0/555927319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300c0fcc10 con 0x7f300c0fb4d0 2024-09-17T01:06:17.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.753+0000 7f30027fc640 1 -- 172.21.15.2:0/555927319 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f3008030020 con 0x7f300c0fb4d0 2024-09-17T01:06:17.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.753+0000 7f30027fc640 1 --2- 172.21.15.2:0/555927319 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2ff806e660 0x7f2ff8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:17.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.753+0000 7f30027fc640 1 -- 172.21.15.2:0/555927319 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f30080ae5f0 con 0x7f300c0fb4d0 2024-09-17T01:06:17.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.754+0000 7f3011082640 1 --2- 172.21.15.2:0/555927319 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2ff806e660 0x7f2ff8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:17.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.754+0000 7f3011082640 1 --2- 172.21.15.2:0/555927319 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2ff806e660 0x7f2ff8070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc004fd0 tx=0x7f2ffc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:17.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.758+0000 7f30027fc640 1 -- 172.21.15.2:0/555927319 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f30080776a0 con 0x7f300c0fb4d0 2024-09-17T01:06:17.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.974+0000 7f3013ae7640 1 -- 172.21.15.2:0/555927319 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f300c0fac90 con 0x7f300c0fb4d0 2024-09-17T01:06:17.972 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:17 smithi002 ceph-mon[98018]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:17.973 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:17 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:17.973 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:17 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:17.973 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:17 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/4055670731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:17.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.974+0000 7f30027fc640 1 -- 172.21.15.2:0/555927319 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1946 (secure 0 0 0) 0x7f300807ad60 con 0x7f300c0fb4d0 2024-09-17T01:06:17.973 INFO:teuthology.orchestra.run.smithi002.stdout:e25 2024-09-17T01:06:17.974 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-17T01:05:48:747321+0000 2024-09-17T01:06:17.974 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:06:17.974 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:06:17.974 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-17T01:06:17.974 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:06:17.974 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:06:17.974 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-17T01:06:17.974 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 25 2024-09-17T01:06:17.974 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:06:17.974 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-17T00:59:20.485696+0000 2024-09-17T01:06:17.974 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-17T01:05:47.816861+0000 2024-09-17T01:06:17.974 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-17T01:06:17.974 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 44 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=14464,1=24269} 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-17T01:06:17.975 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-17T01:06:17.976 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-17T01:06:17.976 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-17T01:06:17.976 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-17T01:06:17.976 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-17T01:06:17.976 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-17T01:06:17.976 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 14464 members: 24269,14464 2024-09-17T01:06:17.976 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.fmyyzz{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:17.976 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.zmrgxd{0:24287} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/2986470392,v1:172.21.15.2:6827/2986470392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:17.976 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.hgawhu{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:17.976 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.heckcd{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:17.976 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:06:17.976 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:06:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-17T01:06:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.977+0000 7f3013ae7640 1 -- 172.21.15.2:0/555927319 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2ff806e660 msgr2=0x7f2ff8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.977+0000 7f3013ae7640 1 --2- 172.21.15.2:0/555927319 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2ff806e660 0x7f2ff8070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc004fd0 tx=0x7f2ffc00b040 comp rx=0 tx=0).stop 2024-09-17T01:06:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.977+0000 7f3013ae7640 1 -- 172.21.15.2:0/555927319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c0fb4d0 msgr2=0x7f300c113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.977+0000 7f3013ae7640 1 --2- 172.21.15.2:0/555927319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c0fb4d0 0x7f300c113190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3008000c00 tx=0x7f3008009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.977+0000 7f3013ae7640 1 -- 172.21.15.2:0/555927319 shutdown_connections 2024-09-17T01:06:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.977+0000 7f3013ae7640 1 --2- 172.21.15.2:0/555927319 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2ff806e660 0x7f2ff8070b10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.977+0000 7f3013ae7640 1 --2- 172.21.15.2:0/555927319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f300c101510 0x7f300c1136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.977+0000 7f3013ae7640 1 --2- 172.21.15.2:0/555927319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300c0fb4d0 0x7f300c113190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.977+0000 7f3013ae7640 1 -- 172.21.15.2:0/555927319 >> 172.21.15.2:0/555927319 conn(0x7f300c0f7090 msgr2=0x7f300c0659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.977+0000 7f3013ae7640 1 -- 172.21.15.2:0/555927319 shutdown_connections 2024-09-17T01:06:17.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:17.977+0000 7f3013ae7640 1 -- 172.21.15.2:0/555927319 wait complete. 2024-09-17T01:06:18.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.061+0000 7fb494369640 1 -- 172.21.15.2:0/3853545810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb48c102530 msgr2=0x7fb48c102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:18.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.062+0000 7fb494369640 1 --2- 172.21.15.2:0/3853545810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb48c102530 0x7fb48c102900 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb488004810 tx=0x7fb488009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.065+0000 7fb494369640 1 -- 172.21.15.2:0/3853545810 shutdown_connections 2024-09-17T01:06:18.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.065+0000 7fb494369640 1 --2- 172.21.15.2:0/3853545810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c102ed0 0x7fb48c0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.065+0000 7fb494369640 1 --2- 172.21.15.2:0/3853545810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb48c102530 0x7fb48c102900 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.065+0000 7fb494369640 1 -- 172.21.15.2:0/3853545810 >> 172.21.15.2:0/3853545810 conn(0x7fb48c0f80f0 msgr2=0x7fb48c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:18.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.066+0000 7fb494369640 1 -- 172.21.15.2:0/3853545810 shutdown_connections 2024-09-17T01:06:18.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.066+0000 7fb494369640 1 -- 172.21.15.2:0/3853545810 wait complete. 2024-09-17T01:06:18.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.066+0000 7fb494369640 1 Processor -- start 2024-09-17T01:06:18.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.066+0000 7fb494369640 1 -- start start 2024-09-17T01:06:18.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.067+0000 7fb494369640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb48c102530 0x7fb48c1131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:18.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.067+0000 7fb494369640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c102ed0 0x7fb48c1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:18.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.067+0000 7fb494369640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c113cf0 con 0x7fb48c102ed0 2024-09-17T01:06:18.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.067+0000 7fb494369640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c10d130 con 0x7fb48c102530 2024-09-17T01:06:18.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.067+0000 7fb491904640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c102ed0 0x7fb48c1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:18.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.067+0000 7fb491904640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c102ed0 0x7fb48c1136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53558/0 (socket says 172.21.15.2:53558) 2024-09-17T01:06:18.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.067+0000 7fb491904640 1 -- 172.21.15.2:0/3944150573 learned_addr learned my addr 172.21.15.2:0/3944150573 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:06:18.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.067+0000 7fb492105640 1 --2- 172.21.15.2:0/3944150573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb48c102530 0x7fb48c1131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:18.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.067+0000 7fb492105640 1 -- 172.21.15.2:0/3944150573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c102ed0 msgr2=0x7fb48c1136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:18.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.067+0000 7fb492105640 1 --2- 172.21.15.2:0/3944150573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c102ed0 0x7fb48c1136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.067+0000 7fb492105640 1 -- 172.21.15.2:0/3944150573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb488005040 con 0x7fb48c102530 2024-09-17T01:06:18.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.067+0000 7fb491904640 1 --2- 172.21.15.2:0/3944150573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c102ed0 0x7fb48c1136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:06:18.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.067+0000 7fb492105640 1 --2- 172.21.15.2:0/3944150573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb48c102530 0x7fb48c1131b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb4880047e0 tx=0x7fb488009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:18.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.068+0000 7fb482ffd640 1 -- 172.21.15.2:0/3944150573 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb488038070 con 0x7fb48c102530 2024-09-17T01:06:18.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.068+0000 7fb482ffd640 1 -- 172.21.15.2:0/3944150573 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb48802ae00 con 0x7fb48c102530 2024-09-17T01:06:18.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.068+0000 7fb494369640 1 -- 172.21.15.2:0/3944150573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48c10d3b0 con 0x7fb48c102530 2024-09-17T01:06:18.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.068+0000 7fb482ffd640 1 -- 172.21.15.2:0/3944150573 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48802c770 con 0x7fb48c102530 2024-09-17T01:06:18.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.068+0000 7fb494369640 1 -- 172.21.15.2:0/3944150573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48c10d8f0 con 0x7fb48c102530 2024-09-17T01:06:18.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.069+0000 7fb494369640 1 -- 172.21.15.2:0/3944150573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48c0fdcb0 con 0x7fb48c102530 2024-09-17T01:06:18.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.069+0000 7fb482ffd640 1 -- 172.21.15.2:0/3944150573 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7fb488030020 con 0x7fb48c102530 2024-09-17T01:06:18.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.070+0000 7fb482ffd640 1 --2- 172.21.15.2:0/3944150573 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb47806e660 0x7fb478070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:18.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.070+0000 7fb482ffd640 1 -- 172.21.15.2:0/3944150573 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb4880ae5b0 con 0x7fb48c102530 2024-09-17T01:06:18.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.070+0000 7fb491904640 1 --2- 172.21.15.2:0/3944150573 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb47806e660 0x7fb478070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:18.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.070+0000 7fb491904640 1 --2- 172.21.15.2:0/3944150573 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb47806e660 0x7fb478070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb48c10ea70 tx=0x7fb47c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:18.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.075+0000 7fb482ffd640 1 -- 172.21.15.2:0/3944150573 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb488077680 con 0x7fb48c102530 2024-09-17T01:06:18.178 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:17 smithi099 ceph-mon[77412]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:18.178 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:17 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:18.178 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:17 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:18.178 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:17 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/4055670731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:18.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.267+0000 7fb494369640 1 -- 172.21.15.2:0/3944150573 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb48c04b720 con 0x7fb47806e660 2024-09-17T01:06:18.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.268+0000 7fb482ffd640 1 -- 172.21.15.2:0/3944150573 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fb48c04b720 con 0x7fb47806e660 2024-09-17T01:06:18.266 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:06:18.266 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:06:18.266 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:06:18.266 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:06:18.266 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-17T01:06:18.266 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-17T01:06:18.266 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2024-09-17T01:06:18.266 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-17T01:06:18.266 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "4/21 daemons upgraded", 2024-09-17T01:06:18.266 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading crash daemons", 2024-09-17T01:06:18.267 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:06:18.267 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:06:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.270+0000 7fb494369640 1 -- 172.21.15.2:0/3944150573 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb47806e660 msgr2=0x7fb478070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.270+0000 7fb494369640 1 --2- 172.21.15.2:0/3944150573 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb47806e660 0x7fb478070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb48c10ea70 tx=0x7fb47c00b040 comp rx=0 tx=0).stop 2024-09-17T01:06:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.270+0000 7fb494369640 1 -- 172.21.15.2:0/3944150573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb48c102530 msgr2=0x7fb48c1131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.270+0000 7fb494369640 1 --2- 172.21.15.2:0/3944150573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb48c102530 0x7fb48c1131b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb4880047e0 tx=0x7fb488009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.270+0000 7fb494369640 1 -- 172.21.15.2:0/3944150573 shutdown_connections 2024-09-17T01:06:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.270+0000 7fb494369640 1 --2- 172.21.15.2:0/3944150573 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb47806e660 0x7fb478070b10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.270+0000 7fb494369640 1 --2- 172.21.15.2:0/3944150573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb48c102ed0 0x7fb48c1136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.270+0000 7fb494369640 1 --2- 172.21.15.2:0/3944150573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb48c102530 0x7fb48c1131b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.270+0000 7fb494369640 1 -- 172.21.15.2:0/3944150573 >> 172.21.15.2:0/3944150573 conn(0x7fb48c0f80f0 msgr2=0x7fb48c0f90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.270+0000 7fb494369640 1 -- 172.21.15.2:0/3944150573 shutdown_connections 2024-09-17T01:06:18.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.270+0000 7fb494369640 1 -- 172.21.15.2:0/3944150573 wait complete. 2024-09-17T01:06:18.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.352+0000 7f5ede439640 1 -- 172.21.15.2:0/2404491979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed8102580 msgr2=0x7f5ed8102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:18.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.352+0000 7f5ede439640 1 --2- 172.21.15.2:0/2404491979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed8102580 0x7f5ed8102950 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80048d0 tx=0x7f5ec8009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.352+0000 7f5ede439640 1 -- 172.21.15.2:0/2404491979 shutdown_connections 2024-09-17T01:06:18.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.352+0000 7f5ede439640 1 --2- 172.21.15.2:0/2404491979 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ed8102f20 0x7f5ed80fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.352+0000 7f5ede439640 1 --2- 172.21.15.2:0/2404491979 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed8102580 0x7f5ed8102950 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.352+0000 7f5ede439640 1 -- 172.21.15.2:0/2404491979 >> 172.21.15.2:0/2404491979 conn(0x7f5ed80f81a0 msgr2=0x7f5ed80fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:18.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.352+0000 7f5ede439640 1 -- 172.21.15.2:0/2404491979 shutdown_connections 2024-09-17T01:06:18.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.352+0000 7f5ede439640 1 -- 172.21.15.2:0/2404491979 wait complete. 2024-09-17T01:06:18.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.353+0000 7f5ede439640 1 Processor -- start 2024-09-17T01:06:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.353+0000 7f5ede439640 1 -- start start 2024-09-17T01:06:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.353+0000 7f5ede439640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed8102580 0x7f5ed8113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.353+0000 7f5ede439640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ed8102f20 0x7f5ed8113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.353+0000 7f5ede439640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed8113e10 con 0x7f5ed8102580 2024-09-17T01:06:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.353+0000 7f5ede439640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed810d200 con 0x7f5ed8102f20 2024-09-17T01:06:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.353+0000 7f5ed7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed8102580 0x7f5ed8113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.354+0000 7f5ed7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed8102580 0x7f5ed8113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53572/0 (socket says 172.21.15.2:53572) 2024-09-17T01:06:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.354+0000 7f5ed7fff640 1 -- 172.21.15.2:0/1511564863 learned_addr learned my addr 172.21.15.2:0/1511564863 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:06:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.354+0000 7f5ed77fe640 1 --2- 172.21.15.2:0/1511564863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ed8102f20 0x7f5ed8113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.354+0000 7f5ed7fff640 1 -- 172.21.15.2:0/1511564863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ed8102f20 msgr2=0x7f5ed8113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.354+0000 7f5ed7fff640 1 --2- 172.21.15.2:0/1511564863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ed8102f20 0x7f5ed8113780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.354+0000 7f5ed7fff640 1 -- 172.21.15.2:0/1511564863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec8005040 con 0x7f5ed8102580 2024-09-17T01:06:18.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.354+0000 7f5ed7fff640 1 --2- 172.21.15.2:0/1511564863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed8102580 0x7f5ed8113240 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8000c00 tx=0x7f5ec8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:18.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.354+0000 7f5ed4ff9640 1 -- 172.21.15.2:0/1511564863 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ec8038070 con 0x7f5ed8102580 2024-09-17T01:06:18.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.354+0000 7f5ed4ff9640 1 -- 172.21.15.2:0/1511564863 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5ec8033ad0 con 0x7f5ed8102580 2024-09-17T01:06:18.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.354+0000 7f5ede439640 1 -- 172.21.15.2:0/1511564863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed810d480 con 0x7f5ed8102580 2024-09-17T01:06:18.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.354+0000 7f5ed4ff9640 1 -- 172.21.15.2:0/1511564863 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ec803db70 con 0x7f5ed8102580 2024-09-17T01:06:18.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.354+0000 7f5ede439640 1 -- 172.21.15.2:0/1511564863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed810d9a0 con 0x7f5ed8102580 2024-09-17T01:06:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.355+0000 7f5ede439640 1 -- 172.21.15.2:0/1511564863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed80fdd00 con 0x7f5ed8102580 2024-09-17T01:06:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.356+0000 7f5ed4ff9640 1 -- 172.21.15.2:0/1511564863 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f5ec8030020 con 0x7f5ed8102580 2024-09-17T01:06:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.357+0000 7f5ed4ff9640 1 --2- 172.21.15.2:0/1511564863 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f5ec006e660 0x7f5ec0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.357+0000 7f5ed77fe640 1 --2- 172.21.15.2:0/1511564863 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f5ec006e660 0x7f5ec0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.357+0000 7f5ed4ff9640 1 -- 172.21.15.2:0/1511564863 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f5ec80ae480 con 0x7f5ed8102580 2024-09-17T01:06:18.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.357+0000 7f5ed77fe640 1 --2- 172.21.15.2:0/1511564863 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f5ec006e660 0x7f5ec0070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5ed810eb40 tx=0x7f5ecc009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:18.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.361+0000 7f5ed4ff9640 1 -- 172.21.15.2:0/1511564863 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5ec8077490 con 0x7f5ed8102580 2024-09-17T01:06:18.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.607+0000 7f5ede439640 1 -- 172.21.15.2:0/1511564863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5ed804b720 con 0x7f5ed8102580 2024-09-17T01:06:18.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.608+0000 7f5ed4ff9640 1 -- 172.21.15.2:0/1511564863 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f5ec807ab50 con 0x7f5ed8102580 2024-09-17T01:06:18.606 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:06:18.606 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:06:18.606 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:06:18.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.610+0000 7f5ede439640 1 -- 172.21.15.2:0/1511564863 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f5ec006e660 msgr2=0x7f5ec0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:18.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.610+0000 7f5ede439640 1 --2- 172.21.15.2:0/1511564863 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f5ec006e660 0x7f5ec0070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5ed810eb40 tx=0x7f5ecc009120 comp rx=0 tx=0).stop 2024-09-17T01:06:18.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.610+0000 7f5ede439640 1 -- 172.21.15.2:0/1511564863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed8102580 msgr2=0x7f5ed8113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:18.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.610+0000 7f5ede439640 1 --2- 172.21.15.2:0/1511564863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed8102580 0x7f5ed8113240 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8000c00 tx=0x7f5ec8009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.610+0000 7f5ede439640 1 -- 172.21.15.2:0/1511564863 shutdown_connections 2024-09-17T01:06:18.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.610+0000 7f5ede439640 1 --2- 172.21.15.2:0/1511564863 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f5ec006e660 0x7f5ec0070b10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.610+0000 7f5ede439640 1 --2- 172.21.15.2:0/1511564863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ed8102f20 0x7f5ed8113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.610+0000 7f5ede439640 1 --2- 172.21.15.2:0/1511564863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ed8102580 0x7f5ed8113240 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:18.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.610+0000 7f5ede439640 1 -- 172.21.15.2:0/1511564863 >> 172.21.15.2:0/1511564863 conn(0x7f5ed80f81a0 msgr2=0x7f5ed80f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:18.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.610+0000 7f5ede439640 1 -- 172.21.15.2:0/1511564863 shutdown_connections 2024-09-17T01:06:18.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:18.610+0000 7f5ede439640 1 -- 172.21.15.2:0/1511564863 wait complete. 2024-09-17T01:06:18.894 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:18 smithi099 ceph-mon[77412]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:18.894 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:18 smithi099 ceph-mon[77412]: pgmap v29: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:06:18.894 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:18 smithi099 ceph-mon[77412]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:18.894 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:18 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/555927319' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:06:18.894 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:18 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1511564863' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:06:19.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:18 smithi002 ceph-mon[98018]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:19.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:18 smithi002 ceph-mon[98018]: pgmap v29: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:06:19.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:18 smithi002 ceph-mon[98018]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:19.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:18 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/555927319' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:06:19.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:18 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1511564863' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:06:20.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:19 smithi002 ceph-mon[98018]: from='client.44125 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:20.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:19 smithi002 ceph-mon[98018]: Upgrade: Updating crash.smithi099 (2/2) 2024-09-17T01:06:20.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:19 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:20.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:19 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:06:20.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:19 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:20.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:19 smithi002 ceph-mon[98018]: Deploying daemon crash.smithi099 on smithi099 2024-09-17T01:06:20.230 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:19 smithi099 ceph-mon[77412]: from='client.44125 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:20.231 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:19 smithi099 ceph-mon[77412]: Upgrade: Updating crash.smithi099 (2/2) 2024-09-17T01:06:20.231 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:19 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:20.231 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:19 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:06:20.231 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:19 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:20.231 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:19 smithi099 ceph-mon[77412]: Deploying daemon crash.smithi099 on smithi099 2024-09-17T01:06:21.028 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:20 smithi099 ceph-mon[77412]: pgmap v30: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:21.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:20 smithi002 ceph-mon[98018]: pgmap v30: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:23.172 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:22 smithi002 ceph-mon[98018]: pgmap v31: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:06:23.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:22 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:23.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:22 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:23.173 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:22 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:23.235 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:22 smithi099 ceph-mon[77412]: pgmap v31: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:06:23.236 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:22 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:23.236 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:22 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:23.236 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:22 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:25.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:24 smithi002 ceph-mon[98018]: pgmap v32: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:25.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:24 smithi099 ceph-mon[77412]: pgmap v32: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:26.176 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:26.176 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:26.176 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:26.176 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:26.176 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:26.260 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:26.260 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:26.260 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:26.261 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:26.261 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:27.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:26 smithi002 ceph-mon[98018]: pgmap v33: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:27.226 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:26 smithi099 ceph-mon[77412]: pgmap v33: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:06:28.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:28 smithi099 ceph-mon[77412]: pgmap v34: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:06:28.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:28 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:28.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:28 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:28.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:28 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:28.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:28 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:28.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:28 smithi002 ceph-mon[98018]: pgmap v34: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:06:28.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:28 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:28.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:28 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:28.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:28 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:28.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:28 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:30.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:29 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:30.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:29 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:30.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:29 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:30.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:29 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:31.063 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:30 smithi002 ceph-mon[98018]: pgmap v35: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:06:31.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:30 smithi099 ceph-mon[77412]: pgmap v35: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:06:32.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: pgmap v36: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:06:32.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:32.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:32.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:32.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:32.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:32.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:32.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:32.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:32.157 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:32.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: Upgrade: Setting container_image for all crash 2024-09-17T01:06:32.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:32.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi002"}]: dispatch 2024-09-17T01:06:32.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi002"}]': finished 2024-09-17T01:06:32.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi099"}]: dispatch 2024-09-17T01:06:32.158 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi099"}]': finished 2024-09-17T01:06:32.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:06:32.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:06:32.159 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:32 smithi002 ceph-mon[98018]: Upgrade: osd.0 is safe to restart 2024-09-17T01:06:32.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: pgmap v36: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:06:32.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:32.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:32.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:32.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:32.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:32.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:32.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:32.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:32.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:32.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: Upgrade: Setting container_image for all crash 2024-09-17T01:06:32.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:32.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi002"}]: dispatch 2024-09-17T01:06:32.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi002"}]': finished 2024-09-17T01:06:32.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi099"}]: dispatch 2024-09-17T01:06:32.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi099"}]': finished 2024-09-17T01:06:32.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:06:32.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:06:32.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:32 smithi099 ceph-mon[77412]: Upgrade: osd.0 is safe to restart 2024-09-17T01:06:33.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:33 smithi099 ceph-mon[77412]: Upgrade: Updating osd.0 2024-09-17T01:06:33.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:33 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:33.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:33 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:06:33.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:33 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:33.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:33 smithi099 ceph-mon[77412]: Deploying daemon osd.0 on smithi002 2024-09-17T01:06:34.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:33 smithi002 ceph-mon[98018]: Upgrade: Updating osd.0 2024-09-17T01:06:34.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:33 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:34.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:33 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:06:34.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:33 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:34.003 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:33 smithi002 ceph-mon[98018]: Deploying daemon osd.0 on smithi002 2024-09-17T01:06:34.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:34 smithi002 ceph-mon[98018]: pgmap v37: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:06:35.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:34 smithi099 ceph-mon[77412]: pgmap v37: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:06:35.905 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:35 smithi002 systemd[1]: Stopping Ceph osd.0 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:06:36.405 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:35 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0[45691]: 2024-09-17T01:06:35.926+0000 7fc7ca3b9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:06:36.405 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:35 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0[45691]: 2024-09-17T01:06:35.926+0000 7fc7ca3b9640 -1 osd.0 47 *** Got signal Terminated *** 2024-09-17T01:06:36.405 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:35 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0[45691]: 2024-09-17T01:06:35.926+0000 7fc7ca3b9640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:06:36.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:36 smithi002 ceph-mon[98018]: pgmap v38: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:06:36.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:36 smithi002 ceph-mon[98018]: osd.0 marked itself down and dead 2024-09-17T01:06:37.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:36 smithi099 ceph-mon[77412]: pgmap v38: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:06:37.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:36 smithi099 ceph-mon[77412]: osd.0 marked itself down and dead 2024-09-17T01:06:37.510 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:37 smithi002 podman[108697]: 2024-09-17 01:06:37.218022343 +0000 UTC m=+1.417027836 container died 720f74f40752004f6278d8016284f5af331c1129529f3db3e21565538446b61c (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=quincy-4a70413, org.label-schema.build-date=20240731) 2024-09-17T01:06:37.858 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:37 smithi002 ceph-mon[98018]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:06:37.859 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:37 smithi002 ceph-mon[98018]: osdmap e48: 6 total, 5 up, 6 in 2024-09-17T01:06:37.859 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:37 smithi002 podman[108697]: 2024-09-17 01:06:37.601800241 +0000 UTC m=+1.800805731 container cleanup 720f74f40752004f6278d8016284f5af331c1129529f3db3e21565538446b61c (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0, RELEASE=quincy-4a70413, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:06:37.859 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:37 smithi002 bash[108697]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0 2024-09-17T01:06:38.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:37 smithi099 ceph-mon[77412]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:06:38.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:37 smithi099 ceph-mon[77412]: osdmap e48: 6 total, 5 up, 6 in 2024-09-17T01:06:38.155 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:37 smithi002 podman[108714]: 2024-09-17 01:06:37.861586227 +0000 UTC m=+0.633771520 container remove 720f74f40752004f6278d8016284f5af331c1129529f3db3e21565538446b61c (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, RELEASE=quincy-4a70413, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-17T01:06:38.446 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:38 smithi002 podman[108807]: 2024-09-17 01:06:38.097075445 +0000 UTC m=+0.016358821 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:06:38.446 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:38 smithi002 podman[108807]: 2024-09-17 01:06:38.195883337 +0000 UTC m=+0.115166710 container create 0d94a2065b57a2e92a8f2cffad349a0ed5ca7576db65a82a52513ba536690e05 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2) 2024-09-17T01:06:38.446 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:38 smithi002 podman[108807]: 2024-09-17 01:06:38.448922873 +0000 UTC m=+0.368206250 container init 0d94a2065b57a2e92a8f2cffad349a0ed5ca7576db65a82a52513ba536690e05 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-17T01:06:38.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:38 smithi002 ceph-mon[98018]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:06:38.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:38 smithi002 ceph-mon[98018]: osdmap e49: 6 total, 5 up, 6 in 2024-09-17T01:06:38.905 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:38 smithi002 podman[108807]: 2024-09-17 01:06:38.452874007 +0000 UTC m=+0.372157390 container start 0d94a2065b57a2e92a8f2cffad349a0ed5ca7576db65a82a52513ba536690e05 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-17T01:06:38.905 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:38 smithi002 podman[108807]: 2024-09-17 01:06:38.561411254 +0000 UTC m=+0.480694639 container attach 0d94a2065b57a2e92a8f2cffad349a0ed5ca7576db65a82a52513ba536690e05 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-17T01:06:38.905 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:38 smithi002 podman[108807]: 2024-09-17 01:06:38.648325928 +0000 UTC m=+0.567609302 container died 0d94a2065b57a2e92a8f2cffad349a0ed5ca7576db65a82a52513ba536690e05 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-17T01:06:39.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:38 smithi099 ceph-mon[77412]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:06:39.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:38 smithi099 ceph-mon[77412]: osdmap e49: 6 total, 5 up, 6 in 2024-09-17T01:06:39.657 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:39 smithi002 podman[108830]: 2024-09-17 01:06:39.385449556 +0000 UTC m=+0.731309291 container remove 0d94a2065b57a2e92a8f2cffad349a0ed5ca7576db65a82a52513ba536690e05 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-17T01:06:39.657 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:39 smithi002 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-17T01:06:39.657 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:39 smithi002 systemd[1]: Stopped Ceph osd.0 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:06:39.657 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:39 smithi002 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.0.service: Consumed 57.338s CPU time. 2024-09-17T01:06:39.657 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:39 smithi002 systemd[1]: Starting Ceph osd.0 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:06:40.128 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:39 smithi002 podman[108929]: 2024-09-17 01:06:39.74455753 +0000 UTC m=+0.016405377 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:06:40.128 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:39 smithi002 podman[108929]: 2024-09-17 01:06:39.870039412 +0000 UTC m=+0.141887246 container create 8939550daadd5d7fcb75ece775180228f792a35ed9e15625d3fa177df45bb409 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-17T01:06:40.128 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:40 smithi002 podman[108929]: 2024-09-17 01:06:40.131024654 +0000 UTC m=+0.402872496 container init 8939550daadd5d7fcb75ece775180228f792a35ed9e15625d3fa177df45bb409 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-17T01:06:40.405 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:40 smithi002 podman[108929]: 2024-09-17 01:06:40.134662484 +0000 UTC m=+0.406510318 container start 8939550daadd5d7fcb75ece775180228f792a35ed9e15625d3fa177df45bb409 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-17T01:06:40.405 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:40 smithi002 podman[108929]: 2024-09-17 01:06:40.205882058 +0000 UTC m=+0.477729904 container attach 8939550daadd5d7fcb75ece775180228f792a35ed9e15625d3fa177df45bb409 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731) 2024-09-17T01:06:40.405 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:40 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate[108944]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:06:40.405 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:40 smithi002 bash[108929]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:06:40.405 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:40 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate[108944]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:06:40.405 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:40 smithi002 bash[108929]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:06:41.008 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:40 smithi002 ceph-mon[98018]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:06:41.009 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:40 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:41.009 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:40 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:41.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:40 smithi099 ceph-mon[77412]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:06:41.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:40 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:41.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:40 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:41.293 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate[108944]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:06:41.294 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 bash[108929]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:06:41.294 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate[108944]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:06:41.294 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 bash[108929]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:06:41.655 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate[108944]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:06:41.655 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 bash[108929]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:06:41.655 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate[108944]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:06:41.655 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 bash[108929]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:06:41.655 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate[108944]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T01:06:41.655 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 bash[108929]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T01:06:41.655 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate[108944]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:06:41.656 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 bash[108929]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:06:41.656 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate[108944]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T01:06:41.656 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 bash[108929]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T01:06:41.656 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 podman[108929]: 2024-09-17 01:06:41.324627881 +0000 UTC m=+1.596475724 container died 8939550daadd5d7fcb75ece775180228f792a35ed9e15625d3fa177df45bb409 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-17T01:06:41.966 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:41 smithi002 ceph-mon[98018]: Health check failed: Degraded data redundancy: 69/354 objects degraded (19.492%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T01:06:42.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:41 smithi099 ceph-mon[77412]: Health check failed: Degraded data redundancy: 69/354 objects degraded (19.492%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T01:06:42.289 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:41 smithi002 podman[109080]: 2024-09-17 01:06:41.96871365 +0000 UTC m=+0.638125437 container remove 8939550daadd5d7fcb75ece775180228f792a35ed9e15625d3fa177df45bb409 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-activate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:06:42.289 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:42 smithi002 podman[109140]: 2024-09-17 01:06:42.080168021 +0000 UTC m=+0.017249544 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:06:42.289 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:42 smithi002 podman[109140]: 2024-09-17 01:06:42.186303409 +0000 UTC m=+0.123384915 container create 563188d6089b1115f2aa9caf1809ecdd5384489d347a58e334772b8dc027f31f (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-17T01:06:42.654 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:42 smithi002 podman[109140]: 2024-09-17 01:06:42.422137845 +0000 UTC m=+0.359219360 container init 563188d6089b1115f2aa9caf1809ecdd5384489d347a58e334772b8dc027f31f (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-17T01:06:42.655 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:42 smithi002 podman[109140]: 2024-09-17 01:06:42.42540941 +0000 UTC m=+0.362490917 container start 563188d6089b1115f2aa9caf1809ecdd5384489d347a58e334772b8dc027f31f (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:06:42.655 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:42 smithi002 ceph-osd[109158]: -- 172.21.15.2:0/2310680611 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55837c0aa1e0 con 0x55837c040000 2024-09-17T01:06:42.655 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:42 smithi002 bash[109140]: 563188d6089b1115f2aa9caf1809ecdd5384489d347a58e334772b8dc027f31f 2024-09-17T01:06:42.655 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:42 smithi002 systemd[1]: Started Ceph osd.0 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:06:43.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:42 smithi099 ceph-mon[77412]: pgmap v43: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 69/354 objects degraded (19.492%) 2024-09-17T01:06:43.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:42 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:43.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:42 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:43.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:42 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:43.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:42 smithi002 ceph-mon[98018]: pgmap v43: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 69/354 objects degraded (19.492%) 2024-09-17T01:06:43.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:42 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:43.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:42 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:43.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:42 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:44.596 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:44 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0[109154]: 2024-09-17T01:06:44.316+0000 7f5278079640 -1 Falling back to public interface 2024-09-17T01:06:44.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:44 smithi002 ceph-mon[98018]: pgmap v44: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 69/354 objects degraded (19.492%) 2024-09-17T01:06:45.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:44 smithi099 ceph-mon[77412]: pgmap v44: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 69/354 objects degraded (19.492%) 2024-09-17T01:06:46.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:46 smithi002 ceph-mon[98018]: pgmap v45: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 69/354 objects degraded (19.492%) 2024-09-17T01:06:47.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:46 smithi099 ceph-mon[77412]: pgmap v45: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 69/354 objects degraded (19.492%) 2024-09-17T01:06:48.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:48 smithi002 ceph-mon[98018]: pgmap v46: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 69/354 objects degraded (19.492%) 2024-09-17T01:06:48.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:48 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:48.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:48 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:48.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:48 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:48.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:48 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:48.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.697+0000 7fe1bd204640 1 -- 172.21.15.2:0/1887467951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1b8102620 msgr2=0x7fe1b81029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:48.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.697+0000 7fe1bd204640 1 --2- 172.21.15.2:0/1887467951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1b8102620 0x7fe1b81029f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80048d0 tx=0x7fe1a8009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:48.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.698+0000 7fe1bd204640 1 -- 172.21.15.2:0/1887467951 shutdown_connections 2024-09-17T01:06:48.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.698+0000 7fe1bd204640 1 --2- 172.21.15.2:0/1887467951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1b80fac80 0x7fe1b80fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:48.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.698+0000 7fe1bd204640 1 --2- 172.21.15.2:0/1887467951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1b8102620 0x7fe1b81029f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:48.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.698+0000 7fe1bd204640 1 -- 172.21.15.2:0/1887467951 >> 172.21.15.2:0/1887467951 conn(0x7fe1b8070ce0 msgr2=0x7fe1b80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:48.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.698+0000 7fe1bd204640 1 -- 172.21.15.2:0/1887467951 shutdown_connections 2024-09-17T01:06:48.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.698+0000 7fe1bd204640 1 -- 172.21.15.2:0/1887467951 wait complete. 2024-09-17T01:06:48.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.698+0000 7fe1bd204640 1 Processor -- start 2024-09-17T01:06:48.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.698+0000 7fe1bd204640 1 -- start start 2024-09-17T01:06:48.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.699+0000 7fe1bd204640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1b80fac80 0x7fe1b80fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:48.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.699+0000 7fe1bd204640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1b8102620 0x7fe1b80fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:48.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.699+0000 7fe1bd204640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b80fc970 con 0x7fe1b80fac80 2024-09-17T01:06:48.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.699+0000 7fe1bd204640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b80fcae0 con 0x7fe1b8102620 2024-09-17T01:06:48.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.699+0000 7fe1b6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1b80fac80 0x7fe1b80fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:48.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.699+0000 7fe1b6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1b80fac80 0x7fe1b80fbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45744/0 (socket says 172.21.15.2:45744) 2024-09-17T01:06:48.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.699+0000 7fe1b6d9d640 1 -- 172.21.15.2:0/4254891445 learned_addr learned my addr 172.21.15.2:0/4254891445 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:06:48.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.699+0000 7fe1b659c640 1 --2- 172.21.15.2:0/4254891445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1b8102620 0x7fe1b80fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:48.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.699+0000 7fe1b6d9d640 1 -- 172.21.15.2:0/4254891445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1b8102620 msgr2=0x7fe1b80fc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:48.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.699+0000 7fe1b6d9d640 1 --2- 172.21.15.2:0/4254891445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1b8102620 0x7fe1b80fc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:48.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.699+0000 7fe1b6d9d640 1 -- 172.21.15.2:0/4254891445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a8005040 con 0x7fe1b80fac80 2024-09-17T01:06:48.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.699+0000 7fe1b6d9d640 1 --2- 172.21.15.2:0/4254891445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1b80fac80 0x7fe1b80fbe60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8003080 tx=0x7fe1a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:48.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.700+0000 7fe19f7fe640 1 -- 172.21.15.2:0/4254891445 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1a8038070 con 0x7fe1b80fac80 2024-09-17T01:06:48.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.700+0000 7fe19f7fe640 1 -- 172.21.15.2:0/4254891445 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe1a80097e0 con 0x7fe1b80fac80 2024-09-17T01:06:48.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.700+0000 7fe1bd204640 1 -- 172.21.15.2:0/4254891445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b81194f0 con 0x7fe1b80fac80 2024-09-17T01:06:48.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.700+0000 7fe19f7fe640 1 -- 172.21.15.2:0/4254891445 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1a803d420 con 0x7fe1b80fac80 2024-09-17T01:06:48.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.700+0000 7fe1bd204640 1 -- 172.21.15.2:0/4254891445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b8119870 con 0x7fe1b80fac80 2024-09-17T01:06:48.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.701+0000 7fe1bd204640 1 -- 172.21.15.2:0/4254891445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b80657b0 con 0x7fe1b80fac80 2024-09-17T01:06:48.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.701+0000 7fe19f7fe640 1 -- 172.21.15.2:0/4254891445 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7fe1a8030020 con 0x7fe1b80fac80 2024-09-17T01:06:48.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.702+0000 7fe19f7fe640 1 --2- 172.21.15.2:0/4254891445 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe1a006e660 0x7fe1a0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:48.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.702+0000 7fe19f7fe640 1 -- 172.21.15.2:0/4254891445 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe1a80ae790 con 0x7fe1b80fac80 2024-09-17T01:06:48.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.702+0000 7fe1b659c640 1 --2- 172.21.15.2:0/4254891445 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe1a006e660 0x7fe1a0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:48.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.703+0000 7fe1b659c640 1 --2- 172.21.15.2:0/4254891445 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe1a006e660 0x7fe1a0070b10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80fd7a0 tx=0x7fe1ac009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:48.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.707+0000 7fe19f7fe640 1 -- 172.21.15.2:0/4254891445 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe1a80777c0 con 0x7fe1b80fac80 2024-09-17T01:06:48.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:48 smithi099 ceph-mon[77412]: pgmap v46: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 69/354 objects degraded (19.492%) 2024-09-17T01:06:48.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:48 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:48.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:48 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:48.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:48 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:48.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:48 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.899+0000 7fe1bd204640 1 -- 172.21.15.2:0/4254891445 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1b80fd550 con 0x7fe1a006e660 2024-09-17T01:06:48.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.900+0000 7fe19f7fe640 1 -- 172.21.15.2:0/4254891445 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe1b80fd550 con 0x7fe1a006e660 2024-09-17T01:06:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.902+0000 7fe1bd204640 1 -- 172.21.15.2:0/4254891445 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe1a006e660 msgr2=0x7fe1a0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.902+0000 7fe1bd204640 1 --2- 172.21.15.2:0/4254891445 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe1a006e660 0x7fe1a0070b10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80fd7a0 tx=0x7fe1ac009120 comp rx=0 tx=0).stop 2024-09-17T01:06:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.902+0000 7fe1bd204640 1 -- 172.21.15.2:0/4254891445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1b80fac80 msgr2=0x7fe1b80fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.902+0000 7fe1bd204640 1 --2- 172.21.15.2:0/4254891445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1b80fac80 0x7fe1b80fbe60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8003080 tx=0x7fe1a8009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.902+0000 7fe1bd204640 1 -- 172.21.15.2:0/4254891445 shutdown_connections 2024-09-17T01:06:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.902+0000 7fe1bd204640 1 --2- 172.21.15.2:0/4254891445 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe1a006e660 0x7fe1a0070b10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.902+0000 7fe1bd204640 1 --2- 172.21.15.2:0/4254891445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1b8102620 0x7fe1b80fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.902+0000 7fe1bd204640 1 --2- 172.21.15.2:0/4254891445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1b80fac80 0x7fe1b80fbe60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.902+0000 7fe1bd204640 1 -- 172.21.15.2:0/4254891445 >> 172.21.15.2:0/4254891445 conn(0x7fe1b8070ce0 msgr2=0x7fe1b8105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.903+0000 7fe1bd204640 1 -- 172.21.15.2:0/4254891445 shutdown_connections 2024-09-17T01:06:48.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.903+0000 7fe1bd204640 1 -- 172.21.15.2:0/4254891445 wait complete. 2024-09-17T01:06:48.908 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:06:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.986+0000 7f0138f8d640 1 -- 172.21.15.2:0/4111065862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0134102620 msgr2=0x7f01341029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.986+0000 7f0138f8d640 1 --2- 172.21.15.2:0/4111065862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0134102620 0x7f01341029f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f01240048d0 tx=0x7f0124009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.986+0000 7f0138f8d640 1 -- 172.21.15.2:0/4111065862 shutdown_connections 2024-09-17T01:06:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.986+0000 7f0138f8d640 1 --2- 172.21.15.2:0/4111065862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01340fac80 0x7f01340fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.986+0000 7f0138f8d640 1 --2- 172.21.15.2:0/4111065862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0134102620 0x7f01341029f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.986+0000 7f0138f8d640 1 -- 172.21.15.2:0/4111065862 >> 172.21.15.2:0/4111065862 conn(0x7f0134070ce0 msgr2=0x7f01340710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.986+0000 7f0138f8d640 1 -- 172.21.15.2:0/4111065862 shutdown_connections 2024-09-17T01:06:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.986+0000 7f0138f8d640 1 -- 172.21.15.2:0/4111065862 wait complete. 2024-09-17T01:06:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.987+0000 7f0138f8d640 1 Processor -- start 2024-09-17T01:06:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.987+0000 7f0138f8d640 1 -- start start 2024-09-17T01:06:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.987+0000 7f0138f8d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01340fac80 0x7f01341131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.987+0000 7f0138f8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0134102620 0x7f0134113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.987+0000 7f0138f8d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0134113d10 con 0x7f0134102620 2024-09-17T01:06:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.987+0000 7f0138f8d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013410d150 con 0x7f01340fac80 2024-09-17T01:06:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.987+0000 7f0131d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0134102620 0x7f0134113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.987+0000 7f0131d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0134102620 0x7f0134113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45766/0 (socket says 172.21.15.2:45766) 2024-09-17T01:06:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.987+0000 7f0131d9b640 1 -- 172.21.15.2:0/3983754416 learned_addr learned my addr 172.21.15.2:0/3983754416 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:06:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.987+0000 7f013259c640 1 --2- 172.21.15.2:0/3983754416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01340fac80 0x7f01341131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.987+0000 7f0131d9b640 1 -- 172.21.15.2:0/3983754416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01340fac80 msgr2=0x7f01341131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.987+0000 7f0131d9b640 1 --2- 172.21.15.2:0/3983754416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01340fac80 0x7f01341131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.987+0000 7f0131d9b640 1 -- 172.21.15.2:0/3983754416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0124005040 con 0x7f0134102620 2024-09-17T01:06:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.987+0000 7f0131d9b640 1 --2- 172.21.15.2:0/3983754416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0134102620 0x7f0134113710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f012800c830 tx=0x7f0128004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.988+0000 7f0122ffd640 1 -- 172.21.15.2:0/3983754416 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f012800a7d0 con 0x7f0134102620 2024-09-17T01:06:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.988+0000 7f0122ffd640 1 -- 172.21.15.2:0/3983754416 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f012800add0 con 0x7f0134102620 2024-09-17T01:06:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.988+0000 7f0138f8d640 1 -- 172.21.15.2:0/3983754416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013410d430 con 0x7f0134102620 2024-09-17T01:06:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.988+0000 7f0122ffd640 1 -- 172.21.15.2:0/3983754416 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01280113a0 con 0x7f0134102620 2024-09-17T01:06:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.988+0000 7f0138f8d640 1 -- 172.21.15.2:0/3983754416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013410d9d0 con 0x7f0134102620 2024-09-17T01:06:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.989+0000 7f0138f8d640 1 -- 172.21.15.2:0/3983754416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01340657b0 con 0x7f0134102620 2024-09-17T01:06:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.989+0000 7f0122ffd640 1 -- 172.21.15.2:0/3983754416 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f0128012400 con 0x7f0134102620 2024-09-17T01:06:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.990+0000 7f0122ffd640 1 --2- 172.21.15.2:0/3983754416 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f011c06e660 0x7f011c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.990+0000 7f0122ffd640 1 -- 172.21.15.2:0/3983754416 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f012808e390 con 0x7f0134102620 2024-09-17T01:06:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.990+0000 7f013259c640 1 --2- 172.21.15.2:0/3983754416 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f011c06e660 0x7f011c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.991+0000 7f013259c640 1 --2- 172.21.15.2:0/3983754416 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f011c06e660 0x7f011c070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0124007ac0 tx=0x7f0124035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:48.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:48.994+0000 7f0122ffd640 1 -- 172.21.15.2:0/3983754416 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f01280574e0 con 0x7f0134102620 2024-09-17T01:06:49.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.190+0000 7f0138f8d640 1 -- 172.21.15.2:0/3983754416 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0134109570 con 0x7f011c06e660 2024-09-17T01:06:49.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.192+0000 7f0122ffd640 1 -- 172.21.15.2:0/3983754416 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0134109570 con 0x7f011c06e660 2024-09-17T01:06:49.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.194+0000 7f0138f8d640 1 -- 172.21.15.2:0/3983754416 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f011c06e660 msgr2=0x7f011c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:49.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.194+0000 7f0138f8d640 1 --2- 172.21.15.2:0/3983754416 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f011c06e660 0x7f011c070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0124007ac0 tx=0x7f0124035040 comp rx=0 tx=0).stop 2024-09-17T01:06:49.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.194+0000 7f0138f8d640 1 -- 172.21.15.2:0/3983754416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0134102620 msgr2=0x7f0134113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:49.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.194+0000 7f0138f8d640 1 --2- 172.21.15.2:0/3983754416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0134102620 0x7f0134113710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f012800c830 tx=0x7f0128004430 comp rx=0 tx=0).stop 2024-09-17T01:06:49.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.194+0000 7f0138f8d640 1 -- 172.21.15.2:0/3983754416 shutdown_connections 2024-09-17T01:06:49.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.194+0000 7f0138f8d640 1 --2- 172.21.15.2:0/3983754416 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f011c06e660 0x7f011c070b10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.194+0000 7f0138f8d640 1 --2- 172.21.15.2:0/3983754416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0134102620 0x7f0134113710 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.194+0000 7f0138f8d640 1 --2- 172.21.15.2:0/3983754416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01340fac80 0x7f01341131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.194+0000 7f0138f8d640 1 -- 172.21.15.2:0/3983754416 >> 172.21.15.2:0/3983754416 conn(0x7f0134070ce0 msgr2=0x7f0134105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:49.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.194+0000 7f0138f8d640 1 -- 172.21.15.2:0/3983754416 shutdown_connections 2024-09-17T01:06:49.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.194+0000 7f0138f8d640 1 -- 172.21.15.2:0/3983754416 wait complete. 2024-09-17T01:06:49.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.278+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/185957057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dcc0fd570 msgr2=0x7f7dcc0fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.278+0000 7f7dd2e6d640 1 --2- 172.21.15.2:0/185957057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dcc0fd570 0x7f7dcc0fd940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0004810 tx=0x7f7dc0009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.278+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/185957057 shutdown_connections 2024-09-17T01:06:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.278+0000 7f7dd2e6d640 1 --2- 172.21.15.2:0/185957057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dcc0fdf10 0x7f7dcc106550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.278+0000 7f7dd2e6d640 1 --2- 172.21.15.2:0/185957057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dcc0fd570 0x7f7dcc0fd940 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.278+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/185957057 >> 172.21.15.2:0/185957057 conn(0x7f7dcc0f7000 msgr2=0x7f7dcc0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.278+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/185957057 shutdown_connections 2024-09-17T01:06:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.278+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/185957057 wait complete. 2024-09-17T01:06:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.278+0000 7f7dd2e6d640 1 Processor -- start 2024-09-17T01:06:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.278+0000 7f7dd2e6d640 1 -- start start 2024-09-17T01:06:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.279+0000 7f7dd2e6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dcc0fd570 0x7f7dcc1132d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.279+0000 7f7dd2e6d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dcc0fdf10 0x7f7dcc113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.279+0000 7f7dd2e6d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc113e10 con 0x7f7dcc0fd570 2024-09-17T01:06:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.279+0000 7f7dd2e6d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc10d250 con 0x7f7dcc0fdf10 2024-09-17T01:06:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.279+0000 7f7dd0c09640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dcc0fd570 0x7f7dcc1132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.279+0000 7f7dd0c09640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dcc0fd570 0x7f7dcc1132d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45790/0 (socket says 172.21.15.2:45790) 2024-09-17T01:06:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.279+0000 7f7dd0c09640 1 -- 172.21.15.2:0/2509285817 learned_addr learned my addr 172.21.15.2:0/2509285817 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:06:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.279+0000 7f7dcbfff640 1 --2- 172.21.15.2:0/2509285817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dcc0fdf10 0x7f7dcc113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.279+0000 7f7dd0c09640 1 -- 172.21.15.2:0/2509285817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dcc0fdf10 msgr2=0x7f7dcc113810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.279+0000 7f7dd0c09640 1 --2- 172.21.15.2:0/2509285817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dcc0fdf10 0x7f7dcc113810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.279+0000 7f7dd0c09640 1 -- 172.21.15.2:0/2509285817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc0005040 con 0x7f7dcc0fd570 2024-09-17T01:06:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.279+0000 7f7dcbfff640 1 --2- 172.21.15.2:0/2509285817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dcc0fdf10 0x7f7dcc113810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:06:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.279+0000 7f7dd0c09640 1 --2- 172.21.15.2:0/2509285817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dcc0fd570 0x7f7dcc1132d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0004870 tx=0x7f7dc0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.280+0000 7f7dc97fa640 1 -- 172.21.15.2:0/2509285817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dc0038070 con 0x7f7dcc0fd570 2024-09-17T01:06:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.280+0000 7f7dc97fa640 1 -- 172.21.15.2:0/2509285817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7dc002ad30 con 0x7f7dcc0fd570 2024-09-17T01:06:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.280+0000 7f7dc97fa640 1 -- 172.21.15.2:0/2509285817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dc002c6e0 con 0x7f7dcc0fd570 2024-09-17T01:06:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.280+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/2509285817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dcc10d4d0 con 0x7f7dcc0fd570 2024-09-17T01:06:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.280+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/2509285817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dcc10d990 con 0x7f7dcc0fd570 2024-09-17T01:06:49.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.281+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/2509285817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dcc0662d0 con 0x7f7dcc0fd570 2024-09-17T01:06:49.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.281+0000 7f7dc97fa640 1 -- 172.21.15.2:0/2509285817 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f7dc0030020 con 0x7f7dcc0fd570 2024-09-17T01:06:49.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.282+0000 7f7dc97fa640 1 --2- 172.21.15.2:0/2509285817 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7dbc06e660 0x7f7dbc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:49.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.282+0000 7f7dc97fa640 1 -- 172.21.15.2:0/2509285817 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7dc00adf10 con 0x7f7dcc0fd570 2024-09-17T01:06:49.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.282+0000 7f7dcbfff640 1 --2- 172.21.15.2:0/2509285817 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7dbc06e660 0x7f7dbc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:49.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.282+0000 7f7dcbfff640 1 --2- 172.21.15.2:0/2509285817 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7dbc06e660 0x7f7dbc070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc10eb90 tx=0x7f7db800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.286+0000 7f7dc97fa640 1 -- 172.21.15.2:0/2509285817 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7dc0076fc0 con 0x7f7dcc0fd570 2024-09-17T01:06:49.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.475+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/2509285817 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7dcc04b720 con 0x7f7dbc06e660 2024-09-17T01:06:49.473 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:49 smithi002 ceph-mon[98018]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.487+0000 7f7dc97fa640 1 -- 172.21.15.2:0/2509285817 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7dcc04b720 con 0x7f7dbc06e660 2024-09-17T01:06:49.484 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:06:49.485 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (3m) 2s ago 12m 26.6M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:06:49.485 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (32s) 2s ago 12m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de b7ed6c8d5a92 2024-09-17T01:06:49.485 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (27s) 24s ago 12m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de ae713b940078 2024-09-17T01:06:49.485 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (2m) 2s ago 12m 76.3M - 9.4.12 2bacad6d85d8 5fe408c103d6 2024-09-17T01:06:49.485 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (7m) 2s ago 7m 125M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:06:49.485 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (7m) 2s ago 7m 65.1M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:06:49.485 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (7m) 24s ago 7m 64.8M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:06:49.485 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (7m) 24s ago 7m 115M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:06:49.485 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (3m) 2s ago 14m 494M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:06:49.485 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (2m) 24s ago 11m 439M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:06:49.485 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (91s) 2s ago 14m 41.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de da5247385c2d 2024-09-17T01:06:49.485 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (69s) 24s ago 11m 33.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b92f98b2cab9 2024-09-17T01:06:49.485 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (4m) 2s ago 12m 15.9M - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:06:49.486 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (3m) 24s ago 11m 16.1M - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:06:49.486 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (7s) 2s ago 11m 11.7M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 563188d6089b 2024-09-17T01:06:49.486 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (10m) 2s ago 10m 244M 1558M 17.2.7-1635-g4a704134 f22ead590bad 629defddb38c 2024-09-17T01:06:49.486 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (10m) 2s ago 10m 197M 1558M 17.2.7-1635-g4a704134 f22ead590bad 5dff1cf9fc56 2024-09-17T01:06:49.486 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (9m) 24s ago 9m 273M 2581M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:06:49.486 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (9m) 24s ago 9m 240M 2581M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:06:49.486 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (8m) 24s ago 8m 222M 2581M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:06:49.486 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (3m) 2s ago 12m 63.9M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:06:49.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.490+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/2509285817 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7dbc06e660 msgr2=0x7f7dbc070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:49.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.490+0000 7f7dd2e6d640 1 --2- 172.21.15.2:0/2509285817 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7dbc06e660 0x7f7dbc070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc10eb90 tx=0x7f7db800b040 comp rx=0 tx=0).stop 2024-09-17T01:06:49.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.490+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/2509285817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dcc0fd570 msgr2=0x7f7dcc1132d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:49.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.490+0000 7f7dd2e6d640 1 --2- 172.21.15.2:0/2509285817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dcc0fd570 0x7f7dcc1132d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0004870 tx=0x7f7dc0009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.491+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/2509285817 shutdown_connections 2024-09-17T01:06:49.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.491+0000 7f7dd2e6d640 1 --2- 172.21.15.2:0/2509285817 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7dbc06e660 0x7f7dbc070b10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.491+0000 7f7dd2e6d640 1 --2- 172.21.15.2:0/2509285817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dcc0fdf10 0x7f7dcc113810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.491+0000 7f7dd2e6d640 1 --2- 172.21.15.2:0/2509285817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7dcc0fd570 0x7f7dcc1132d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.491+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/2509285817 >> 172.21.15.2:0/2509285817 conn(0x7f7dcc0f7000 msgr2=0x7f7dcc0f8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.491+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/2509285817 shutdown_connections 2024-09-17T01:06:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.491+0000 7f7dd2e6d640 1 -- 172.21.15.2:0/2509285817 wait complete. 2024-09-17T01:06:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.581+0000 7ff619a72640 1 -- 172.21.15.2:0/80391629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff614100410 msgr2=0x7ff6141007e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.581+0000 7ff619a72640 1 --2- 172.21.15.2:0/80391629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff614100410 0x7ff6141007e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff6040048d0 tx=0x7ff604009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.581+0000 7ff619a72640 1 -- 172.21.15.2:0/80391629 shutdown_connections 2024-09-17T01:06:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.581+0000 7ff619a72640 1 --2- 172.21.15.2:0/80391629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6140fbd90 0x7ff6140fc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.581+0000 7ff619a72640 1 --2- 172.21.15.2:0/80391629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff614100410 0x7ff6141007e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.581+0000 7ff619a72640 1 -- 172.21.15.2:0/80391629 >> 172.21.15.2:0/80391629 conn(0x7ff614070ce0 msgr2=0x7ff6140710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.581+0000 7ff619a72640 1 -- 172.21.15.2:0/80391629 shutdown_connections 2024-09-17T01:06:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.581+0000 7ff619a72640 1 -- 172.21.15.2:0/80391629 wait complete. 2024-09-17T01:06:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.582+0000 7ff619a72640 1 Processor -- start 2024-09-17T01:06:49.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.582+0000 7ff619a72640 1 -- start start 2024-09-17T01:06:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.582+0000 7ff619a72640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6140fbd90 0x7ff6141121b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.582+0000 7ff619a72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff614100410 0x7ff6141126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.582+0000 7ff619a72640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff614112d80 con 0x7ff614100410 2024-09-17T01:06:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.582+0000 7ff619a72640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61410c130 con 0x7ff6140fbd90 2024-09-17T01:06:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.583+0000 7ff612ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff614100410 0x7ff6141126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.583+0000 7ff612ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff614100410 0x7ff6141126f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45796/0 (socket says 172.21.15.2:45796) 2024-09-17T01:06:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.583+0000 7ff612ffd640 1 -- 172.21.15.2:0/999680723 learned_addr learned my addr 172.21.15.2:0/999680723 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:06:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.583+0000 7ff6137fe640 1 --2- 172.21.15.2:0/999680723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6140fbd90 0x7ff6141121b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.583+0000 7ff612ffd640 1 -- 172.21.15.2:0/999680723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6140fbd90 msgr2=0x7ff6141121b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.583+0000 7ff612ffd640 1 --2- 172.21.15.2:0/999680723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6140fbd90 0x7ff6141121b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.583+0000 7ff612ffd640 1 -- 172.21.15.2:0/999680723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff604005040 con 0x7ff614100410 2024-09-17T01:06:49.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.583+0000 7ff612ffd640 1 --2- 172.21.15.2:0/999680723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff614100410 0x7ff6141126f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff60800b790 tx=0x7ff6080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:49.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.583+0000 7ff5fbfff640 1 -- 172.21.15.2:0/999680723 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff60800c700 con 0x7ff614100410 2024-09-17T01:06:49.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.583+0000 7ff5fbfff640 1 -- 172.21.15.2:0/999680723 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff60800cd00 con 0x7ff614100410 2024-09-17T01:06:49.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.583+0000 7ff619a72640 1 -- 172.21.15.2:0/999680723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61410c410 con 0x7ff614100410 2024-09-17T01:06:49.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.583+0000 7ff5fbfff640 1 -- 172.21.15.2:0/999680723 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff608015e80 con 0x7ff614100410 2024-09-17T01:06:49.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.583+0000 7ff619a72640 1 -- 172.21.15.2:0/999680723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61410c930 con 0x7ff614100410 2024-09-17T01:06:49.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.585+0000 7ff619a72640 1 -- 172.21.15.2:0/999680723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6140fcda0 con 0x7ff614100410 2024-09-17T01:06:49.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.585+0000 7ff5fbfff640 1 -- 172.21.15.2:0/999680723 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7ff608012070 con 0x7ff614100410 2024-09-17T01:06:49.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.586+0000 7ff5fbfff640 1 --2- 172.21.15.2:0/999680723 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff5fc06e660 0x7ff5fc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:49.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.586+0000 7ff5fbfff640 1 -- 172.21.15.2:0/999680723 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff60808dc40 con 0x7ff614100410 2024-09-17T01:06:49.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.586+0000 7ff6137fe640 1 --2- 172.21.15.2:0/999680723 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff5fc06e660 0x7ff5fc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:49.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.586+0000 7ff6137fe640 1 --2- 172.21.15.2:0/999680723 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff5fc06e660 0x7ff5fc070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff604009ac0 tx=0x7ff604035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.590+0000 7ff5fbfff640 1 -- 172.21.15.2:0/999680723 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff608056c70 con 0x7ff614100410 2024-09-17T01:06:49.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:49 smithi099 ceph-mon[77412]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:49.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.860+0000 7ff619a72640 1 -- 172.21.15.2:0/999680723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff614108580 con 0x7ff614100410 2024-09-17T01:06:49.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.861+0000 7ff5fbfff640 1 -- 172.21.15.2:0/999680723 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+744 (secure 0 0 0) 0x7ff60805a330 con 0x7ff614100410 2024-09-17T01:06:49.859 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:06:49.859 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:06:49.859 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:06:49.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:06:49.859 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:06:49.859 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:06:49.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:06:49.860 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:06:49.860 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 5 2024-09-17T01:06:49.860 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:06:49.860 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:06:49.860 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:06:49.860 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:06:49.860 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:06:49.860 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 9, 2024-09-17T01:06:49.860 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:06:49.860 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:06:49.861 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:06:49.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.864+0000 7ff619a72640 1 -- 172.21.15.2:0/999680723 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff5fc06e660 msgr2=0x7ff5fc070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:49.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.864+0000 7ff619a72640 1 --2- 172.21.15.2:0/999680723 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff5fc06e660 0x7ff5fc070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff604009ac0 tx=0x7ff604035040 comp rx=0 tx=0).stop 2024-09-17T01:06:49.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.865+0000 7ff619a72640 1 -- 172.21.15.2:0/999680723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff614100410 msgr2=0x7ff6141126f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:49.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.865+0000 7ff619a72640 1 --2- 172.21.15.2:0/999680723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff614100410 0x7ff6141126f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff60800b790 tx=0x7ff6080091d0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.865+0000 7ff619a72640 1 -- 172.21.15.2:0/999680723 shutdown_connections 2024-09-17T01:06:49.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.865+0000 7ff619a72640 1 --2- 172.21.15.2:0/999680723 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff5fc06e660 0x7ff5fc070b10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.865+0000 7ff619a72640 1 --2- 172.21.15.2:0/999680723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff614100410 0x7ff6141126f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.865+0000 7ff619a72640 1 --2- 172.21.15.2:0/999680723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6140fbd90 0x7ff6141121b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.865+0000 7ff619a72640 1 -- 172.21.15.2:0/999680723 >> 172.21.15.2:0/999680723 conn(0x7ff614070ce0 msgr2=0x7ff6140fa4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:49.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.865+0000 7ff619a72640 1 -- 172.21.15.2:0/999680723 shutdown_connections 2024-09-17T01:06:49.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.865+0000 7ff619a72640 1 -- 172.21.15.2:0/999680723 wait complete. 2024-09-17T01:06:49.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.951+0000 7f1c00e2e640 1 -- 172.21.15.2:0/4285448494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bfc102530 msgr2=0x7f1bfc102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.951+0000 7f1c00e2e640 1 --2- 172.21.15.2:0/4285448494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bfc102530 0x7f1bfc102900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1bec0048d0 tx=0x7f1bec009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.951+0000 7f1c00e2e640 1 -- 172.21.15.2:0/4285448494 shutdown_connections 2024-09-17T01:06:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.951+0000 7f1c00e2e640 1 --2- 172.21.15.2:0/4285448494 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bfc102ed0 0x7f1bfc0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.951+0000 7f1c00e2e640 1 --2- 172.21.15.2:0/4285448494 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bfc102530 0x7f1bfc102900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.951+0000 7f1c00e2e640 1 -- 172.21.15.2:0/4285448494 >> 172.21.15.2:0/4285448494 conn(0x7f1bfc0f80f0 msgr2=0x7f1bfc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.951+0000 7f1c00e2e640 1 -- 172.21.15.2:0/4285448494 shutdown_connections 2024-09-17T01:06:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.951+0000 7f1c00e2e640 1 -- 172.21.15.2:0/4285448494 wait complete. 2024-09-17T01:06:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.952+0000 7f1c00e2e640 1 Processor -- start 2024-09-17T01:06:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.952+0000 7f1c00e2e640 1 -- start start 2024-09-17T01:06:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.952+0000 7f1c00e2e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bfc102530 0x7f1bfc113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.952+0000 7f1c00e2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bfc102ed0 0x7f1bfc113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:49.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.952+0000 7f1c00e2e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc113d80 con 0x7f1bfc102ed0 2024-09-17T01:06:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.952+0000 7f1c00e2e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc10d1c0 con 0x7f1bfc102530 2024-09-17T01:06:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.952+0000 7f1bf9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bfc102ed0 0x7f1bfc113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.952+0000 7f1bf9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bfc102ed0 0x7f1bfc113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45818/0 (socket says 172.21.15.2:45818) 2024-09-17T01:06:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.952+0000 7f1bf9d9b640 1 -- 172.21.15.2:0/1556947308 learned_addr learned my addr 172.21.15.2:0/1556947308 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:06:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.952+0000 7f1bfa59c640 1 --2- 172.21.15.2:0/1556947308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bfc102530 0x7f1bfc113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.953+0000 7f1bf9d9b640 1 -- 172.21.15.2:0/1556947308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bfc102530 msgr2=0x7f1bfc113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.953+0000 7f1bf9d9b640 1 --2- 172.21.15.2:0/1556947308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bfc102530 0x7f1bfc113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.953+0000 7f1bf9d9b640 1 -- 172.21.15.2:0/1556947308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec005040 con 0x7f1bfc102ed0 2024-09-17T01:06:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.953+0000 7f1bf9d9b640 1 --2- 172.21.15.2:0/1556947308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bfc102ed0 0x7f1bfc113780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000eb40 tx=0x7f1bf000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.953+0000 7f1beaffd640 1 -- 172.21.15.2:0/1556947308 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf0007c30 con 0x7f1bfc102ed0 2024-09-17T01:06:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.953+0000 7f1beaffd640 1 -- 172.21.15.2:0/1556947308 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1bf000f040 con 0x7f1bfc102ed0 2024-09-17T01:06:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.953+0000 7f1beaffd640 1 -- 172.21.15.2:0/1556947308 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf000ca90 con 0x7f1bfc102ed0 2024-09-17T01:06:49.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.953+0000 7f1c00e2e640 1 -- 172.21.15.2:0/1556947308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc10d440 con 0x7f1bfc102ed0 2024-09-17T01:06:49.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.953+0000 7f1c00e2e640 1 -- 172.21.15.2:0/1556947308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc10d9e0 con 0x7f1bfc102ed0 2024-09-17T01:06:49.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.955+0000 7f1be8ff9640 1 -- 172.21.15.2:0/1556947308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be0005210 con 0x7f1bfc102ed0 2024-09-17T01:06:49.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.956+0000 7f1beaffd640 1 -- 172.21.15.2:0/1556947308 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7f1bf000cbf0 con 0x7f1bfc102ed0 2024-09-17T01:06:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.957+0000 7f1beaffd640 1 --2- 172.21.15.2:0/1556947308 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1be406e660 0x7f1be4070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.957+0000 7f1beaffd640 1 -- 172.21.15.2:0/1556947308 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1bf008e3c0 con 0x7f1bfc102ed0 2024-09-17T01:06:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.957+0000 7f1bfa59c640 1 --2- 172.21.15.2:0/1556947308 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1be406e660 0x7f1be4070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.958+0000 7f1bfa59c640 1 --2- 172.21.15.2:0/1556947308 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1be406e660 0x7f1be4070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1bec003080 tx=0x7f1bec035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:49.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:49.961+0000 7f1beaffd640 1 -- 172.21.15.2:0/1556947308 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1bf0057370 con 0x7f1bfc102ed0 2024-09-17T01:06:50.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.177+0000 7f1be8ff9640 1 -- 172.21.15.2:0/1556947308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1be0005790 con 0x7f1bfc102ed0 2024-09-17T01:06:50.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.178+0000 7f1beaffd640 1 -- 172.21.15.2:0/1556947308 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1946 (secure 0 0 0) 0x7f1bf00197b0 con 0x7f1bfc102ed0 2024-09-17T01:06:50.176 INFO:teuthology.orchestra.run.smithi002.stdout:e25 2024-09-17T01:06:50.176 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-17T01:05:48:747321+0000 2024-09-17T01:06:50.176 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:06:50.176 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:06:50.176 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-17T01:06:50.176 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:06:50.176 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:06:50.176 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-17T01:06:50.176 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 25 2024-09-17T01:06:50.176 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:06:50.176 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-17T00:59:20.485696+0000 2024-09-17T01:06:50.176 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-17T01:05:47.816861+0000 2024-09-17T01:06:50.176 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-17T01:06:50.177 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-17T01:06:50.177 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-17T01:06:50.177 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-17T01:06:50.177 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-17T01:06:50.177 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-17T01:06:50.177 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-17T01:06:50.177 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-17T01:06:50.177 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 44 2024-09-17T01:06:50.177 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:06:50.177 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2024-09-17T01:06:50.177 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2024-09-17T01:06:50.177 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=14464,1=24269} 2024-09-17T01:06:50.177 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-17T01:06:50.177 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-17T01:06:50.178 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-17T01:06:50.178 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-17T01:06:50.178 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-17T01:06:50.178 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-17T01:06:50.178 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-17T01:06:50.178 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-17T01:06:50.178 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-17T01:06:50.178 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 14464 members: 24269,14464 2024-09-17T01:06:50.178 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.fmyyzz{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:50.178 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.zmrgxd{0:24287} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/2986470392,v1:172.21.15.2:6827/2986470392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:50.178 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.hgawhu{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:50.178 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.heckcd{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:06:50.178 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:06:50.178 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:06:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-17T01:06:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.180+0000 7f1be8ff9640 1 -- 172.21.15.2:0/1556947308 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1be406e660 msgr2=0x7f1be4070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.180+0000 7f1be8ff9640 1 --2- 172.21.15.2:0/1556947308 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1be406e660 0x7f1be4070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1bec003080 tx=0x7f1bec035040 comp rx=0 tx=0).stop 2024-09-17T01:06:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.180+0000 7f1be8ff9640 1 -- 172.21.15.2:0/1556947308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bfc102ed0 msgr2=0x7f1bfc113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.180+0000 7f1be8ff9640 1 --2- 172.21.15.2:0/1556947308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bfc102ed0 0x7f1bfc113780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000eb40 tx=0x7f1bf000b040 comp rx=0 tx=0).stop 2024-09-17T01:06:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.180+0000 7f1be8ff9640 1 -- 172.21.15.2:0/1556947308 shutdown_connections 2024-09-17T01:06:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.180+0000 7f1be8ff9640 1 --2- 172.21.15.2:0/1556947308 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1be406e660 0x7f1be4070b10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.180+0000 7f1be8ff9640 1 --2- 172.21.15.2:0/1556947308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bfc102ed0 0x7f1bfc113780 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.180+0000 7f1be8ff9640 1 --2- 172.21.15.2:0/1556947308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bfc102530 0x7f1bfc113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.180+0000 7f1be8ff9640 1 -- 172.21.15.2:0/1556947308 >> 172.21.15.2:0/1556947308 conn(0x7f1bfc0f80f0 msgr2=0x7f1bfc0f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.180+0000 7f1be8ff9640 1 -- 172.21.15.2:0/1556947308 shutdown_connections 2024-09-17T01:06:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.180+0000 7f1be8ff9640 1 -- 172.21.15.2:0/1556947308 wait complete. 2024-09-17T01:06:50.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.264+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/3110678787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8ac0658f0 msgr2=0x7fa8ac108b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:50.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.264+0000 7fa8b3e3f640 1 --2- 172.21.15.2:0/3110678787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8ac0658f0 0x7fa8ac108b00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0048d0 tx=0x7fa89c009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.264+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/3110678787 shutdown_connections 2024-09-17T01:06:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.264+0000 7fa8b3e3f640 1 --2- 172.21.15.2:0/3110678787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8ac0658f0 0x7fa8ac108b00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.264+0000 7fa8b3e3f640 1 --2- 172.21.15.2:0/3110678787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ac064fe0 0x7fa8ac0653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.264+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/3110678787 >> 172.21.15.2:0/3110678787 conn(0x7fa8ac0723b0 msgr2=0x7fa8ac0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.264+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/3110678787 shutdown_connections 2024-09-17T01:06:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.264+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/3110678787 wait complete. 2024-09-17T01:06:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.265+0000 7fa8b3e3f640 1 Processor -- start 2024-09-17T01:06:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.265+0000 7fa8b3e3f640 1 -- start start 2024-09-17T01:06:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.265+0000 7fa8b3e3f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8ac064fe0 0x7fa8ac115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.265+0000 7fa8b3e3f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ac0658f0 0x7fa8ac115970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.265+0000 7fa8b3e3f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac115f70 con 0x7fa8ac064fe0 2024-09-17T01:06:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.265+0000 7fa8b3e3f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac1160e0 con 0x7fa8ac0658f0 2024-09-17T01:06:50.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.265+0000 7fa8b1bdb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8ac064fe0 0x7fa8ac115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:50.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.265+0000 7fa8b1bdb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8ac064fe0 0x7fa8ac115430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45848/0 (socket says 172.21.15.2:45848) 2024-09-17T01:06:50.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.265+0000 7fa8b1bdb640 1 -- 172.21.15.2:0/110697554 learned_addr learned my addr 172.21.15.2:0/110697554 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:06:50.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.265+0000 7fa8b13da640 1 --2- 172.21.15.2:0/110697554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ac0658f0 0x7fa8ac115970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:50.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.266+0000 7fa8b1bdb640 1 -- 172.21.15.2:0/110697554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ac0658f0 msgr2=0x7fa8ac115970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:50.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.266+0000 7fa8b1bdb640 1 --2- 172.21.15.2:0/110697554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ac0658f0 0x7fa8ac115970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:50.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.266+0000 7fa8b1bdb640 1 -- 172.21.15.2:0/110697554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c005040 con 0x7fa8ac064fe0 2024-09-17T01:06:50.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.266+0000 7fa8b1bdb640 1 --2- 172.21.15.2:0/110697554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8ac064fe0 0x7fa8ac115430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8002a50 tx=0x7fa8a8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:50.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.266+0000 7fa8a27fc640 1 -- 172.21.15.2:0/110697554 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8a8007c30 con 0x7fa8ac064fe0 2024-09-17T01:06:50.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.266+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/110697554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac10f5b0 con 0x7fa8ac064fe0 2024-09-17T01:06:50.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.266+0000 7fa8a27fc640 1 -- 172.21.15.2:0/110697554 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa8a800f040 con 0x7fa8ac064fe0 2024-09-17T01:06:50.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.266+0000 7fa8a27fc640 1 -- 172.21.15.2:0/110697554 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8a800da10 con 0x7fa8ac064fe0 2024-09-17T01:06:50.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.266+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/110697554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac10faa0 con 0x7fa8ac064fe0 2024-09-17T01:06:50.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.267+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/110697554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac0fbad0 con 0x7fa8ac064fe0 2024-09-17T01:06:50.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.268+0000 7fa8a27fc640 1 -- 172.21.15.2:0/110697554 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7fa8a800dc80 con 0x7fa8ac064fe0 2024-09-17T01:06:50.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.268+0000 7fa8a27fc640 1 --2- 172.21.15.2:0/110697554 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa89806e660 0x7fa898070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:50.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.268+0000 7fa8a27fc640 1 -- 172.21.15.2:0/110697554 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa8a808dba0 con 0x7fa8ac064fe0 2024-09-17T01:06:50.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.268+0000 7fa8b13da640 1 --2- 172.21.15.2:0/110697554 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa89806e660 0x7fa898070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:50.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.269+0000 7fa8b13da640 1 --2- 172.21.15.2:0/110697554 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa89806e660 0x7fa898070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa89c000c00 tx=0x7fa89c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:50.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.273+0000 7fa8a27fc640 1 -- 172.21.15.2:0/110697554 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa8a8056b70 con 0x7fa8ac064fe0 2024-09-17T01:06:50.360 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:50 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0[109154]: 2024-09-17T01:06:50.050+0000 7f5278079640 -1 osd.0 47 log_to_monitors true 2024-09-17T01:06:50.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.507+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/110697554 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8ac04b780 con 0x7fa89806e660 2024-09-17T01:06:50.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.509+0000 7fa8a27fc640 1 -- 172.21.15.2:0/110697554 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa8ac04b780 con 0x7fa89806e660 2024-09-17T01:06:50.506 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:06:50.506 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:06:50.507 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:06:50.507 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:06:50.507 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-17T01:06:50.507 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-17T01:06:50.507 INFO:teuthology.orchestra.run.smithi002.stdout: "mon", 2024-09-17T01:06:50.507 INFO:teuthology.orchestra.run.smithi002.stdout: "crash" 2024-09-17T01:06:50.507 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-17T01:06:50.507 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "7/21 daemons upgraded", 2024-09-17T01:06:50.507 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:06:50.507 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:06:50.507 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:06:50.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.511+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/110697554 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa89806e660 msgr2=0x7fa898070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:50.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.511+0000 7fa8b3e3f640 1 --2- 172.21.15.2:0/110697554 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa89806e660 0x7fa898070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa89c000c00 tx=0x7fa89c035040 comp rx=0 tx=0).stop 2024-09-17T01:06:50.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.511+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/110697554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8ac064fe0 msgr2=0x7fa8ac115430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:50.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.511+0000 7fa8b3e3f640 1 --2- 172.21.15.2:0/110697554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8ac064fe0 0x7fa8ac115430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8002a50 tx=0x7fa8a8004600 comp rx=0 tx=0).stop 2024-09-17T01:06:50.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.511+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/110697554 shutdown_connections 2024-09-17T01:06:50.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.511+0000 7fa8b3e3f640 1 --2- 172.21.15.2:0/110697554 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa89806e660 0x7fa898070b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:50.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.511+0000 7fa8b3e3f640 1 --2- 172.21.15.2:0/110697554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8ac0658f0 0x7fa8ac115970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:50.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.511+0000 7fa8b3e3f640 1 --2- 172.21.15.2:0/110697554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8ac064fe0 0x7fa8ac115430 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:50.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.511+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/110697554 >> 172.21.15.2:0/110697554 conn(0x7fa8ac0723b0 msgr2=0x7fa8ac103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:50.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.511+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/110697554 shutdown_connections 2024-09-17T01:06:50.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.511+0000 7fa8b3e3f640 1 -- 172.21.15.2:0/110697554 wait complete. 2024-09-17T01:06:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.626+0000 7fcfeb885640 1 -- 172.21.15.2:0/2977031751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe40facf0 msgr2=0x7fcfe40fb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.626+0000 7fcfeb885640 1 --2- 172.21.15.2:0/2977031751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe40facf0 0x7fcfe40fb160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcfd40048d0 tx=0x7fcfd4009da0 comp rx=0 tx=0).stop 2024-09-17T01:06:50.624 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:50 smithi002 ceph-mon[98018]: pgmap v47: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 69/354 objects degraded (19.492%) 2024-09-17T01:06:50.624 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:50 smithi002 ceph-mon[98018]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:50.624 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:50 smithi002 ceph-mon[98018]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:50.624 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:50 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/999680723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:50.624 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:50 smithi002 ceph-mon[98018]: from='osd.0 [v2:172.21.15.2:6802/3102383891,v1:172.21.15.2:6803/3102383891]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:06:50.625 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:50 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1556947308' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:06:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.627+0000 7fcfeb885640 1 -- 172.21.15.2:0/2977031751 shutdown_connections 2024-09-17T01:06:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.627+0000 7fcfeb885640 1 --2- 172.21.15.2:0/2977031751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe40facf0 0x7fcfe40fb160 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.627+0000 7fcfeb885640 1 --2- 172.21.15.2:0/2977031751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfe40fd410 0x7fcfe40fd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.627+0000 7fcfeb885640 1 -- 172.21.15.2:0/2977031751 >> 172.21.15.2:0/2977031751 conn(0x7fcfe4070d50 msgr2=0x7fcfe4071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.627+0000 7fcfeb885640 1 -- 172.21.15.2:0/2977031751 shutdown_connections 2024-09-17T01:06:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.627+0000 7fcfeb885640 1 -- 172.21.15.2:0/2977031751 wait complete. 2024-09-17T01:06:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.628+0000 7fcfeb885640 1 Processor -- start 2024-09-17T01:06:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.628+0000 7fcfeb885640 1 -- start start 2024-09-17T01:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.629+0000 7fcfeb885640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfe40facf0 0x7fcfe4115400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.629+0000 7fcfeb885640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe40fd410 0x7fcfe4115940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.629+0000 7fcfeb885640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe4115f40 con 0x7fcfe40fd410 2024-09-17T01:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.629+0000 7fcfeb885640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe41160b0 con 0x7fcfe40facf0 2024-09-17T01:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.629+0000 7fcfe8e20640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe40fd410 0x7fcfe4115940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.629+0000 7fcfe9621640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfe40facf0 0x7fcfe4115400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.629+0000 7fcfe8e20640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe40fd410 0x7fcfe4115940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60430/0 (socket says 172.21.15.2:60430) 2024-09-17T01:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.629+0000 7fcfe9621640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfe40facf0 0x7fcfe4115400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.2:35318/0 (socket says 172.21.15.2:35318) 2024-09-17T01:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.629+0000 7fcfe9621640 1 -- 172.21.15.2:0/3882958033 learned_addr learned my addr 172.21.15.2:0/3882958033 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:06:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.629+0000 7fcfe9621640 1 -- 172.21.15.2:0/3882958033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe40fd410 msgr2=0x7fcfe4115940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.629+0000 7fcfe9621640 1 --2- 172.21.15.2:0/3882958033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe40fd410 0x7fcfe4115940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.629+0000 7fcfe9621640 1 -- 172.21.15.2:0/3882958033 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd4005040 con 0x7fcfe40facf0 2024-09-17T01:06:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.630+0000 7fcfe8e20640 1 --2- 172.21.15.2:0/3882958033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe40fd410 0x7fcfe4115940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:06:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.630+0000 7fcfe9621640 1 --2- 172.21.15.2:0/3882958033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfe40facf0 0x7fcfe4115400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0002a50 tx=0x7fcfe0004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.630+0000 7fcfd9ffb640 1 -- 172.21.15.2:0/3882958033 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfe0007c30 con 0x7fcfe40facf0 2024-09-17T01:06:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.630+0000 7fcfeb885640 1 -- 172.21.15.2:0/3882958033 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe410f530 con 0x7fcfe40facf0 2024-09-17T01:06:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.630+0000 7fcfd9ffb640 1 -- 172.21.15.2:0/3882958033 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcfe000f040 con 0x7fcfe40facf0 2024-09-17T01:06:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.630+0000 7fcfd9ffb640 1 -- 172.21.15.2:0/3882958033 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfe000da90 con 0x7fcfe40facf0 2024-09-17T01:06:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.630+0000 7fcfeb885640 1 -- 172.21.15.2:0/3882958033 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe410fa20 con 0x7fcfe40facf0 2024-09-17T01:06:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.632+0000 7fcfeb885640 1 -- 172.21.15.2:0/3882958033 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe40fbd00 con 0x7fcfe40facf0 2024-09-17T01:06:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.632+0000 7fcfd9ffb640 1 -- 172.21.15.2:0/3882958033 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 38) v1 ==== 92651+0+0 (secure 0 0 0) 0x7fcfe000dc80 con 0x7fcfe40facf0 2024-09-17T01:06:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.633+0000 7fcfd9ffb640 1 --2- 172.21.15.2:0/3882958033 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcfd006e660 0x7fcfd0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:06:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.633+0000 7fcfd9ffb640 1 -- 172.21.15.2:0/3882958033 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fcfe008e2c0 con 0x7fcfe40facf0 2024-09-17T01:06:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.633+0000 7fcfe8e20640 1 --2- 172.21.15.2:0/3882958033 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcfd006e660 0x7fcfd0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:06:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.634+0000 7fcfe8e20640 1 --2- 172.21.15.2:0/3882958033 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcfd006e660 0x7fcfd0070b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009ac0 tx=0x7fcfd4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:06:50.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:50.638+0000 7fcfd9ffb640 1 -- 172.21.15.2:0/3882958033 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcfe00571e0 con 0x7fcfe40facf0 2024-09-17T01:06:50.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:50 smithi099 ceph-mon[77412]: pgmap v47: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 69/354 objects degraded (19.492%) 2024-09-17T01:06:50.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:50 smithi099 ceph-mon[77412]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:50.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:50 smithi099 ceph-mon[77412]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:50.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:50 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/999680723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:50.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:50 smithi099 ceph-mon[77412]: from='osd.0 [v2:172.21.15.2:6802/3102383891,v1:172.21.15.2:6803/3102383891]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:06:50.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:50 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1556947308' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:06:51.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:51.071+0000 7fcfeb885640 1 -- 172.21.15.2:0/3882958033 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcfe4074c70 con 0x7fcfe40facf0 2024-09-17T01:06:51.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:51.072+0000 7fcfd9ffb640 1 -- 172.21.15.2:0/3882958033 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1573 (secure 0 0 0) 0x7fcfe005a8a0 con 0x7fcfe40facf0 2024-09-17T01:06:51.070 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 69/354 objects degraded (19.492%), 20 pgs degraded 2024-09-17T01:06:51.070 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:06:51.070 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:06:51.070 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:06:51.070 INFO:teuthology.orchestra.run.smithi002.stdout: osd.0 (root=default,host=smithi002) is down 2024-09-17T01:06:51.070 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 69/354 objects degraded (19.492%), 20 pgs degraded 2024-09-17T01:06:51.070 INFO:teuthology.orchestra.run.smithi002.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-17T01:06:51.070 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-17T01:06:51.070 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-17T01:06:51.071 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-17T01:06:51.071 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-17T01:06:51.071 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-17T01:06:51.071 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-17T01:06:51.071 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-17T01:06:51.071 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-17T01:06:51.071 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-17T01:06:51.071 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-17T01:06:51.071 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-17T01:06:51.071 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-09-17T01:06:51.071 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-17T01:06:51.071 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-17T01:06:51.071 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-17T01:06:51.071 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-17T01:06:51.072 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-17T01:06:51.072 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-17T01:06:51.072 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-17T01:06:51.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:51.075+0000 7fcfeb885640 1 -- 172.21.15.2:0/3882958033 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcfd006e660 msgr2=0x7fcfd0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:51.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:51.075+0000 7fcfeb885640 1 --2- 172.21.15.2:0/3882958033 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcfd006e660 0x7fcfd0070b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009ac0 tx=0x7fcfd4035040 comp rx=0 tx=0).stop 2024-09-17T01:06:51.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:51.076+0000 7fcfeb885640 1 -- 172.21.15.2:0/3882958033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfe40facf0 msgr2=0x7fcfe4115400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:06:51.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:51.076+0000 7fcfeb885640 1 --2- 172.21.15.2:0/3882958033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfe40facf0 0x7fcfe4115400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0002a50 tx=0x7fcfe0004600 comp rx=0 tx=0).stop 2024-09-17T01:06:51.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:51.076+0000 7fcfeb885640 1 -- 172.21.15.2:0/3882958033 shutdown_connections 2024-09-17T01:06:51.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:51.076+0000 7fcfeb885640 1 --2- 172.21.15.2:0/3882958033 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcfd006e660 0x7fcfd0070b10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:51.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:51.076+0000 7fcfeb885640 1 --2- 172.21.15.2:0/3882958033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe40fd410 0x7fcfe4115940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:51.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:51.076+0000 7fcfeb885640 1 --2- 172.21.15.2:0/3882958033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfe40facf0 0x7fcfe4115400 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:06:51.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:51.076+0000 7fcfeb885640 1 -- 172.21.15.2:0/3882958033 >> 172.21.15.2:0/3882958033 conn(0x7fcfe4070d50 msgr2=0x7fcfe40fa4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:06:51.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:51.076+0000 7fcfeb885640 1 -- 172.21.15.2:0/3882958033 shutdown_connections 2024-09-17T01:06:51.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:06:51.076+0000 7fcfeb885640 1 -- 172.21.15.2:0/3882958033 wait complete. 2024-09-17T01:06:51.365 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:06:51 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0[109154]: 2024-09-17T01:06:51.204+0000 7f526be0b640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:06:51.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:51 smithi002 ceph-mon[98018]: from='osd.0 [v2:172.21.15.2:6802/3102383891,v1:172.21.15.2:6803/3102383891]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:06:51.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:51 smithi002 ceph-mon[98018]: osdmap e50: 6 total, 5 up, 6 in 2024-09-17T01:06:51.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:51 smithi002 ceph-mon[98018]: from='osd.0 [v2:172.21.15.2:6802/3102383891,v1:172.21.15.2:6803/3102383891]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-17T01:06:51.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:51 smithi002 ceph-mon[98018]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:51.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:51 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3882958033' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:06:51.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:51 smithi002 ceph-mon[98018]: from='osd.0 [v2:172.21.15.2:6802/3102383891,v1:172.21.15.2:6803/3102383891]' entity='osd.0' 2024-09-17T01:06:51.694 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:51 smithi099 ceph-mon[77412]: from='osd.0 [v2:172.21.15.2:6802/3102383891,v1:172.21.15.2:6803/3102383891]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:06:51.694 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:51 smithi099 ceph-mon[77412]: osdmap e50: 6 total, 5 up, 6 in 2024-09-17T01:06:51.694 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:51 smithi099 ceph-mon[77412]: from='osd.0 [v2:172.21.15.2:6802/3102383891,v1:172.21.15.2:6803/3102383891]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-17T01:06:51.694 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:51 smithi099 ceph-mon[77412]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:06:51.694 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:51 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3882958033' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:06:51.695 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:51 smithi099 ceph-mon[77412]: from='osd.0 [v2:172.21.15.2:6802/3102383891,v1:172.21.15.2:6803/3102383891]' entity='osd.0' 2024-09-17T01:06:52.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: pgmap v49: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 69/354 objects degraded (19.492%) 2024-09-17T01:06:52.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:52.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:52.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:52.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:52.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:52.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:52.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:52.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:52.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:52.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:06:52.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:06:52.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-17T01:06:52.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:06:52.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: osd.0 [v2:172.21.15.2:6802/3102383891,v1:172.21.15.2:6803/3102383891] boot 2024-09-17T01:06:52.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: osdmap e51: 6 total, 6 up, 6 in 2024-09-17T01:06:52.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:06:52.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: pgmap v49: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 69/354 objects degraded (19.492%) 2024-09-17T01:06:52.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:52.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:52.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:06:52.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:06:52.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:52.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:06:52.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:52.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:52.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:06:52.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:06:52.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:06:52.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-17T01:06:52.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:06:52.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: osd.0 [v2:172.21.15.2:6802/3102383891,v1:172.21.15.2:6803/3102383891] boot 2024-09-17T01:06:52.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: osdmap e51: 6 total, 6 up, 6 in 2024-09-17T01:06:52.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:06:54.451 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:54 smithi002 ceph-mon[98018]: pgmap v51: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 69/354 objects degraded (19.492%) 2024-09-17T01:06:54.451 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:54 smithi002 ceph-mon[98018]: osdmap e52: 6 total, 6 up, 6 in 2024-09-17T01:06:54.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:54 smithi099 ceph-mon[77412]: pgmap v51: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 69/354 objects degraded (19.492%) 2024-09-17T01:06:54.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:54 smithi099 ceph-mon[77412]: osdmap e52: 6 total, 6 up, 6 in 2024-09-17T01:06:56.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:56 smithi002 ceph-mon[98018]: pgmap v53: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 69/354 objects degraded (19.492%) 2024-09-17T01:06:56.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:56 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:56.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:56 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:56.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:56 smithi099 ceph-mon[77412]: pgmap v53: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 69/354 objects degraded (19.492%) 2024-09-17T01:06:56.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:56 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:06:56.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:56 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:06:57.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:57 smithi002 ceph-mon[98018]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 69/354 objects degraded (19.492%), 20 pgs degraded) 2024-09-17T01:06:57.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:57 smithi002 ceph-mon[98018]: mgrmap e39: smithi002.vjeexr(active, since 92s), standbys: smithi099.vswzrb 2024-09-17T01:06:57.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:57 smithi099 ceph-mon[77412]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 69/354 objects degraded (19.492%), 20 pgs degraded) 2024-09-17T01:06:57.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:57 smithi099 ceph-mon[77412]: mgrmap e39: smithi002.vjeexr(active, since 92s), standbys: smithi099.vswzrb 2024-09-17T01:06:58.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:06:58 smithi002 ceph-mon[98018]: pgmap v54: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 763 B/s wr, 6 op/s 2024-09-17T01:06:58.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:06:58 smithi099 ceph-mon[77412]: pgmap v54: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 763 B/s wr, 6 op/s 2024-09-17T01:07:00.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:00 smithi002 ceph-mon[98018]: pgmap v55: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-09-17T01:07:00.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:00 smithi099 ceph-mon[77412]: pgmap v55: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-09-17T01:07:02.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:02 smithi002 ceph-mon[98018]: pgmap v56: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 577 B/s wr, 4 op/s 2024-09-17T01:07:02.425 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:02 smithi099 ceph-mon[77412]: pgmap v56: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 577 B/s wr, 4 op/s 2024-09-17T01:07:04.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:04 smithi002 ceph-mon[98018]: pgmap v57: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-17T01:07:04.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:04 smithi099 ceph-mon[77412]: pgmap v57: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-17T01:07:06.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:06 smithi002 ceph-mon[98018]: pgmap v58: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 431 B/s wr, 3 op/s 2024-09-17T01:07:06.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:06 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:06.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:06 smithi099 ceph-mon[77412]: pgmap v58: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 431 B/s wr, 3 op/s 2024-09-17T01:07:06.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:06 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:07.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:07 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:07:07.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:07 smithi002 ceph-mon[98018]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:07:07.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:07 smithi002 ceph-mon[98018]: Upgrade: osd.1 is safe to restart 2024-09-17T01:07:07.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:07 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:07:07.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:07 smithi099 ceph-mon[77412]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:07:07.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:07 smithi099 ceph-mon[77412]: Upgrade: osd.1 is safe to restart 2024-09-17T01:07:08.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:08 smithi002 ceph-mon[98018]: pgmap v59: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-17T01:07:08.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:08 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:08.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:08 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:07:08.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:08 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:08.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:08 smithi099 ceph-mon[77412]: pgmap v59: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-17T01:07:08.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:08 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:08.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:08 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:07:08.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:08 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:09.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:09 smithi002 ceph-mon[98018]: Upgrade: Updating osd.1 2024-09-17T01:07:09.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:09 smithi002 ceph-mon[98018]: Deploying daemon osd.1 on smithi002 2024-09-17T01:07:09.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:09 smithi099 ceph-mon[77412]: Upgrade: Updating osd.1 2024-09-17T01:07:09.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:09 smithi099 ceph-mon[77412]: Deploying daemon osd.1 on smithi002 2024-09-17T01:07:10.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:10 smithi002 ceph-mon[98018]: pgmap v60: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:07:10.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:10 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:10.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:10 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:10.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:10 smithi099 ceph-mon[77412]: pgmap v60: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:07:10.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:10 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:10.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:10 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:11.205 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:10 smithi002 systemd[1]: Stopping Ceph osd.1 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:07:11.654 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:11 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1[53381]: 2024-09-17T01:07:11.206+0000 7f09cbe6a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:07:11.655 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:11 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1[53381]: 2024-09-17T01:07:11.206+0000 7f09cbe6a640 -1 osd.1 52 *** Got signal Terminated *** 2024-09-17T01:07:11.655 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:11 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1[53381]: 2024-09-17T01:07:11.206+0000 7f09cbe6a640 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:07:12.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:12 smithi002 ceph-mon[98018]: pgmap v61: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:07:12.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:12 smithi002 ceph-mon[98018]: osd.1 marked itself down and dead 2024-09-17T01:07:12.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:12 smithi099 ceph-mon[77412]: pgmap v61: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:07:12.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:12 smithi099 ceph-mon[77412]: osd.1 marked itself down and dead 2024-09-17T01:07:12.963 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:12 smithi002 podman[114454]: 2024-09-17 01:07:12.691413375 +0000 UTC m=+1.606370749 container died 629defddb38c598225c349df96b268924ae55477217378158708dbb2f3a83924 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-4a70413, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:07:13.330 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:13 smithi002 ceph-mon[98018]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:07:13.330 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:13 smithi002 ceph-mon[98018]: osdmap e53: 6 total, 5 up, 6 in 2024-09-17T01:07:13.331 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:13 smithi002 podman[114454]: 2024-09-17 01:07:13.056419027 +0000 UTC m=+1.971376399 container cleanup 629defddb38c598225c349df96b268924ae55477217378158708dbb2f3a83924 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, RELEASE=quincy-4a70413, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:07:13.331 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:13 smithi002 bash[114454]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1 2024-09-17T01:07:13.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:13 smithi099 ceph-mon[77412]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:07:13.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:13 smithi099 ceph-mon[77412]: osdmap e53: 6 total, 5 up, 6 in 2024-09-17T01:07:13.650 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:13 smithi002 podman[114470]: 2024-09-17 01:07:13.333265431 +0000 UTC m=+0.639124023 container remove 629defddb38c598225c349df96b268924ae55477217378158708dbb2f3a83924 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1, RELEASE=quincy-4a70413, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:07:13.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:13 smithi002 podman[114557]: 2024-09-17 01:07:13.556271266 +0000 UTC m=+0.016793020 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:07:13.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:13 smithi002 podman[114557]: 2024-09-17 01:07:13.675799474 +0000 UTC m=+0.136321226 container create d3e23393cfe498ae8f20f10d01f65c0f8917d928fc4fbf3ba3c38ed4b8691518 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:07:14.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:14 smithi002 ceph-mon[98018]: pgmap v63: 65 pgs: 12 stale+active+clean, 53 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:07:14.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:14 smithi002 ceph-mon[98018]: osdmap e54: 6 total, 5 up, 6 in 2024-09-17T01:07:14.405 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:13 smithi002 podman[114557]: 2024-09-17 01:07:13.908517745 +0000 UTC m=+0.369039513 container init d3e23393cfe498ae8f20f10d01f65c0f8917d928fc4fbf3ba3c38ed4b8691518 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:07:14.405 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:13 smithi002 podman[114557]: 2024-09-17 01:07:13.912151854 +0000 UTC m=+0.372673607 container start d3e23393cfe498ae8f20f10d01f65c0f8917d928fc4fbf3ba3c38ed4b8691518 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-17T01:07:14.405 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:14 smithi002 podman[114557]: 2024-09-17 01:07:14.019938572 +0000 UTC m=+0.480460336 container attach d3e23393cfe498ae8f20f10d01f65c0f8917d928fc4fbf3ba3c38ed4b8691518 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97) 2024-09-17T01:07:14.405 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:14 smithi002 podman[114557]: 2024-09-17 01:07:14.114805299 +0000 UTC m=+0.575327061 container died d3e23393cfe498ae8f20f10d01f65c0f8917d928fc4fbf3ba3c38ed4b8691518 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-17T01:07:14.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:14 smithi099 ceph-mon[77412]: pgmap v63: 65 pgs: 12 stale+active+clean, 53 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:07:14.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:14 smithi099 ceph-mon[77412]: osdmap e54: 6 total, 5 up, 6 in 2024-09-17T01:07:14.930 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:14 smithi002 podman[114581]: 2024-09-17 01:07:14.682278201 +0000 UTC m=+0.561609265 container remove d3e23393cfe498ae8f20f10d01f65c0f8917d928fc4fbf3ba3c38ed4b8691518 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-17T01:07:14.930 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:14 smithi002 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-17T01:07:14.930 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:14 smithi002 systemd[1]: Stopped Ceph osd.1 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:07:14.930 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:14 smithi002 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 2.435s CPU time. 2024-09-17T01:07:14.930 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:14 smithi002 systemd[1]: Starting Ceph osd.1 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:07:15.391 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:15 smithi002 podman[114678]: 2024-09-17 01:07:15.045726981 +0000 UTC m=+0.016035500 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:07:15.391 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:15 smithi002 podman[114678]: 2024-09-17 01:07:15.15830445 +0000 UTC m=+0.128612964 container create 4d557acd8c94e8a77501172322eee046a24f969d7e4ca5a39f1c1f4590f21b66 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-17T01:07:15.391 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:15 smithi002 podman[114678]: 2024-09-17 01:07:15.394188343 +0000 UTC m=+0.364496866 container init 4d557acd8c94e8a77501172322eee046a24f969d7e4ca5a39f1c1f4590f21b66 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97) 2024-09-17T01:07:15.655 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:15 smithi002 podman[114678]: 2024-09-17 01:07:15.397961066 +0000 UTC m=+0.368269580 container start 4d557acd8c94e8a77501172322eee046a24f969d7e4ca5a39f1c1f4590f21b66 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD) 2024-09-17T01:07:15.655 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:15 smithi002 podman[114678]: 2024-09-17 01:07:15.494303806 +0000 UTC m=+0.464612320 container attach 4d557acd8c94e8a77501172322eee046a24f969d7e4ca5a39f1c1f4590f21b66 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:07:15.655 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:15 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate[114693]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:07:15.655 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:15 smithi002 bash[114678]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:07:15.655 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:15 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate[114693]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:07:15.655 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:15 smithi002 bash[114678]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:07:16.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:16 smithi002 ceph-mon[98018]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:07:16.405 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate[114693]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:07:16.405 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 bash[114678]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:07:16.405 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate[114693]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:07:16.405 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 bash[114678]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:07:16.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:16 smithi099 ceph-mon[77412]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:07:16.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate[114693]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:07:16.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 bash[114678]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:07:16.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate[114693]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:07:16.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 bash[114678]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:07:16.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate[114693]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T01:07:16.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 bash[114678]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T01:07:16.906 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate[114693]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:07:16.906 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 bash[114678]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:07:16.906 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate[114693]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T01:07:16.906 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 bash[114678]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T01:07:16.906 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:16 smithi002 podman[114678]: 2024-09-17 01:07:16.590953375 +0000 UTC m=+1.561261891 container died 4d557acd8c94e8a77501172322eee046a24f969d7e4ca5a39f1c1f4590f21b66 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-17T01:07:17.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:17 smithi099 ceph-mon[77412]: Health check failed: Degraded data redundancy: 55/354 objects degraded (15.537%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T01:07:17.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:17 smithi002 ceph-mon[98018]: Health check failed: Degraded data redundancy: 55/354 objects degraded (15.537%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T01:07:17.544 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:17 smithi002 podman[114836]: 2024-09-17 01:07:17.22330639 +0000 UTC m=+0.625455432 container remove 4d557acd8c94e8a77501172322eee046a24f969d7e4ca5a39f1c1f4590f21b66 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-17T01:07:17.544 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:17 smithi002 podman[114892]: 2024-09-17 01:07:17.441018681 +0000 UTC m=+0.112436618 container create cc26caf558d7ee13b040020935765daeecf6c68fceb102e0b78a0efce0f6f828 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux ) 2024-09-17T01:07:17.545 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:17 smithi002 podman[114892]: 2024-09-17 01:07:17.345921652 +0000 UTC m=+0.017339610 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:07:17.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:17 smithi002 podman[114892]: 2024-09-17 01:07:17.660139426 +0000 UTC m=+0.331557373 container init cc26caf558d7ee13b040020935765daeecf6c68fceb102e0b78a0efce0f6f828 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-17T01:07:17.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:17 smithi002 podman[114892]: 2024-09-17 01:07:17.663614066 +0000 UTC m=+0.335032004 container start cc26caf558d7ee13b040020935765daeecf6c68fceb102e0b78a0efce0f6f828 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97) 2024-09-17T01:07:17.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:17 smithi002 ceph-osd[114912]: -- 172.21.15.2:0/70897195 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f8679e81e0 con 0x55f866b95c00 2024-09-17T01:07:17.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:17 smithi002 bash[114892]: cc26caf558d7ee13b040020935765daeecf6c68fceb102e0b78a0efce0f6f828 2024-09-17T01:07:17.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:17 smithi002 systemd[1]: Started Ceph osd.1 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:18 smithi002 ceph-mon[98018]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:18 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:18 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:18.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:18 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:18 smithi099 ceph-mon[77412]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:07:19.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:18 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:19.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:18 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:19.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:18 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:19.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:19 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1[114908]: 2024-09-17T01:07:19.563+0000 7f75dbf28640 -1 Falling back to public interface 2024-09-17T01:07:21.095 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:20 smithi099 ceph-mon[77412]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:07:21.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:20 smithi002 ceph-mon[98018]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:07:21.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.186+0000 7f6638dfa640 1 -- 172.21.15.2:0/3344446006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66340fb480 msgr2=0x7f66340fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:21.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.186+0000 7f6638dfa640 1 --2- 172.21.15.2:0/3344446006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66340fb480 0x7f66340fb8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f66280048d0 tx=0x7f6628009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.186+0000 7f6638dfa640 1 -- 172.21.15.2:0/3344446006 shutdown_connections 2024-09-17T01:07:21.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.186+0000 7f6638dfa640 1 --2- 172.21.15.2:0/3344446006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66340fb480 0x7f66340fb8f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.186+0000 7f6638dfa640 1 --2- 172.21.15.2:0/3344446006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66341014c0 0x7f6634101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.186+0000 7f6638dfa640 1 -- 172.21.15.2:0/3344446006 >> 172.21.15.2:0/3344446006 conn(0x7f66340f7000 msgr2=0x7f66340f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:21.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.186+0000 7f6638dfa640 1 -- 172.21.15.2:0/3344446006 shutdown_connections 2024-09-17T01:07:21.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.186+0000 7f6638dfa640 1 -- 172.21.15.2:0/3344446006 wait complete. 2024-09-17T01:07:21.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.186+0000 7f6638dfa640 1 Processor -- start 2024-09-17T01:07:21.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.186+0000 7f6638dfa640 1 -- start start 2024-09-17T01:07:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.187+0000 7f6638dfa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66340fb480 0x7f66341131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.187+0000 7f6638dfa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66341014c0 0x7f6634113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.187+0000 7f6638dfa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6634113d00 con 0x7f66341014c0 2024-09-17T01:07:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.187+0000 7f6638dfa640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663410d140 con 0x7f66340fb480 2024-09-17T01:07:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.187+0000 7f6631d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66341014c0 0x7f6634113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.187+0000 7f6631d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66341014c0 0x7f6634113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51282/0 (socket says 172.21.15.2:51282) 2024-09-17T01:07:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.187+0000 7f6631d9b640 1 -- 172.21.15.2:0/3518189773 learned_addr learned my addr 172.21.15.2:0/3518189773 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:07:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.187+0000 7f663259c640 1 --2- 172.21.15.2:0/3518189773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66340fb480 0x7f66341131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.187+0000 7f6631d9b640 1 -- 172.21.15.2:0/3518189773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66340fb480 msgr2=0x7f66341131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:21.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.187+0000 7f6631d9b640 1 --2- 172.21.15.2:0/3518189773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66340fb480 0x7f66341131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.187+0000 7f6631d9b640 1 -- 172.21.15.2:0/3518189773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6628005040 con 0x7f66341014c0 2024-09-17T01:07:21.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.187+0000 7f6631d9b640 1 --2- 172.21.15.2:0/3518189773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66341014c0 0x7f6634113700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6628000c00 tx=0x7f6628009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:21.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.188+0000 7f6622ffd640 1 -- 172.21.15.2:0/3518189773 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6628038070 con 0x7f66341014c0 2024-09-17T01:07:21.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.188+0000 7f6622ffd640 1 -- 172.21.15.2:0/3518189773 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f662802ade0 con 0x7f66341014c0 2024-09-17T01:07:21.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.188+0000 7f6638dfa640 1 -- 172.21.15.2:0/3518189773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663410d3c0 con 0x7f66341014c0 2024-09-17T01:07:21.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.188+0000 7f6622ffd640 1 -- 172.21.15.2:0/3518189773 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f662802c7e0 con 0x7f66341014c0 2024-09-17T01:07:21.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.188+0000 7f6638dfa640 1 -- 172.21.15.2:0/3518189773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663410d900 con 0x7f66341014c0 2024-09-17T01:07:21.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.189+0000 7f6638dfa640 1 -- 172.21.15.2:0/3518189773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66340fcbc0 con 0x7f66341014c0 2024-09-17T01:07:21.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.190+0000 7f6622ffd640 1 -- 172.21.15.2:0/3518189773 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f6628030020 con 0x7f66341014c0 2024-09-17T01:07:21.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.190+0000 7f6622ffd640 1 --2- 172.21.15.2:0/3518189773 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f661c06e530 0x7f661c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:21.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.190+0000 7f6622ffd640 1 -- 172.21.15.2:0/3518189773 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f66280adda0 con 0x7f66341014c0 2024-09-17T01:07:21.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.190+0000 7f663259c640 1 --2- 172.21.15.2:0/3518189773 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f661c06e530 0x7f661c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:21.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.191+0000 7f663259c640 1 --2- 172.21.15.2:0/3518189773 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f661c06e530 0x7f661c0709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6624004eb0 tx=0x7f662400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:21.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.195+0000 7f6622ffd640 1 -- 172.21.15.2:0/3518189773 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6628076f90 con 0x7f66341014c0 2024-09-17T01:07:21.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.392+0000 7f6638dfa640 1 -- 172.21.15.2:0/3518189773 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66341084e0 con 0x7f661c06e530 2024-09-17T01:07:21.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.393+0000 7f6622ffd640 1 -- 172.21.15.2:0/3518189773 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f662400f040 con 0x7f661c06e530 2024-09-17T01:07:21.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.395+0000 7f6638dfa640 1 -- 172.21.15.2:0/3518189773 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f661c06e530 msgr2=0x7f661c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:21.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.395+0000 7f6638dfa640 1 --2- 172.21.15.2:0/3518189773 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f661c06e530 0x7f661c0709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6624004eb0 tx=0x7f662400b040 comp rx=0 tx=0).stop 2024-09-17T01:07:21.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.395+0000 7f6638dfa640 1 -- 172.21.15.2:0/3518189773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66341014c0 msgr2=0x7f6634113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:21.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.395+0000 7f6638dfa640 1 --2- 172.21.15.2:0/3518189773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66341014c0 0x7f6634113700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6628000c00 tx=0x7f6628009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.395+0000 7f6638dfa640 1 -- 172.21.15.2:0/3518189773 shutdown_connections 2024-09-17T01:07:21.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.395+0000 7f6638dfa640 1 --2- 172.21.15.2:0/3518189773 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f661c06e530 0x7f661c0709e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.395+0000 7f6638dfa640 1 --2- 172.21.15.2:0/3518189773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66341014c0 0x7f6634113700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.395+0000 7f6638dfa640 1 --2- 172.21.15.2:0/3518189773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66340fb480 0x7f66341131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.395+0000 7f6638dfa640 1 -- 172.21.15.2:0/3518189773 >> 172.21.15.2:0/3518189773 conn(0x7f66340f7000 msgr2=0x7f6634065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:21.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.396+0000 7f6638dfa640 1 -- 172.21.15.2:0/3518189773 shutdown_connections 2024-09-17T01:07:21.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.396+0000 7f6638dfa640 1 -- 172.21.15.2:0/3518189773 wait complete. 2024-09-17T01:07:21.403 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:07:21.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.484+0000 7f095f47e640 1 -- 172.21.15.2:0/391246994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09580fe450 msgr2=0x7f09580fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:21.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.484+0000 7f095f47e640 1 --2- 172.21.15.2:0/391246994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09580fe450 0x7f09580fe820 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0948009c50 tx=0x7f0948004d10 comp rx=0 tx=0).stop 2024-09-17T01:07:21.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.484+0000 7f095f47e640 1 -- 172.21.15.2:0/391246994 shutdown_connections 2024-09-17T01:07:21.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.484+0000 7f095f47e640 1 --2- 172.21.15.2:0/391246994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0958064fe0 0x7f0958065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.484+0000 7f095f47e640 1 --2- 172.21.15.2:0/391246994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09580fe450 0x7f09580fe820 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.484+0000 7f095f47e640 1 -- 172.21.15.2:0/391246994 >> 172.21.15.2:0/391246994 conn(0x7f09580723b0 msgr2=0x7f09580727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:21.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.484+0000 7f095f47e640 1 -- 172.21.15.2:0/391246994 shutdown_connections 2024-09-17T01:07:21.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.484+0000 7f095f47e640 1 -- 172.21.15.2:0/391246994 wait complete. 2024-09-17T01:07:21.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.485+0000 7f095f47e640 1 Processor -- start 2024-09-17T01:07:21.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.485+0000 7f095f47e640 1 -- start start 2024-09-17T01:07:21.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.485+0000 7f095f47e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0958064fe0 0x7f0958113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:21.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.485+0000 7f095f47e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09580fe450 0x7f0958113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:21.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.485+0000 7f095f47e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0958113d50 con 0x7f0958064fe0 2024-09-17T01:07:21.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.485+0000 7f095f47e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095810d190 con 0x7f09580fe450 2024-09-17T01:07:21.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.485+0000 7f095d21a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0958064fe0 0x7f0958113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:21.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.485+0000 7f095d21a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0958064fe0 0x7f0958113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51304/0 (socket says 172.21.15.2:51304) 2024-09-17T01:07:21.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.485+0000 7f095d21a640 1 -- 172.21.15.2:0/865768792 learned_addr learned my addr 172.21.15.2:0/865768792 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:07:21.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.485+0000 7f095ca19640 1 --2- 172.21.15.2:0/865768792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09580fe450 0x7f0958113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:21.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.486+0000 7f095d21a640 1 -- 172.21.15.2:0/865768792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09580fe450 msgr2=0x7f0958113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:21.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.486+0000 7f095d21a640 1 --2- 172.21.15.2:0/865768792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09580fe450 0x7f0958113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.486+0000 7f095d21a640 1 -- 172.21.15.2:0/865768792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09480098b0 con 0x7f0958064fe0 2024-09-17T01:07:21.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.486+0000 7f095d21a640 1 --2- 172.21.15.2:0/865768792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0958064fe0 0x7f0958113210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0948003400 tx=0x7f0948004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:21.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.486+0000 7f0955ffb640 1 -- 172.21.15.2:0/865768792 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09480094c0 con 0x7f0958064fe0 2024-09-17T01:07:21.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.486+0000 7f0955ffb640 1 -- 172.21.15.2:0/865768792 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0948009620 con 0x7f0958064fe0 2024-09-17T01:07:21.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.486+0000 7f095f47e640 1 -- 172.21.15.2:0/865768792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095810d410 con 0x7f0958064fe0 2024-09-17T01:07:21.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.486+0000 7f0955ffb640 1 -- 172.21.15.2:0/865768792 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f094803d8f0 con 0x7f0958064fe0 2024-09-17T01:07:21.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.486+0000 7f095f47e640 1 -- 172.21.15.2:0/865768792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095810d930 con 0x7f0958064fe0 2024-09-17T01:07:21.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.487+0000 7f095f47e640 1 -- 172.21.15.2:0/865768792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09580fdce0 con 0x7f0958064fe0 2024-09-17T01:07:21.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.488+0000 7f0955ffb640 1 -- 172.21.15.2:0/865768792 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f094802f030 con 0x7f0958064fe0 2024-09-17T01:07:21.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.488+0000 7f0955ffb640 1 --2- 172.21.15.2:0/865768792 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f094006e530 0x7f09400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:21.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.489+0000 7f0955ffb640 1 -- 172.21.15.2:0/865768792 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f09480af500 con 0x7f0958064fe0 2024-09-17T01:07:21.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.489+0000 7f095ca19640 1 --2- 172.21.15.2:0/865768792 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f094006e530 0x7f09400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:21.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.489+0000 7f095ca19640 1 --2- 172.21.15.2:0/865768792 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f094006e530 0x7f09400709e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f095810ead0 tx=0x7f094c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:21.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.493+0000 7f0955ffb640 1 -- 172.21.15.2:0/865768792 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f09480786a0 con 0x7f0958064fe0 2024-09-17T01:07:21.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.689+0000 7f095f47e640 1 -- 172.21.15.2:0/865768792 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f095804b720 con 0x7f094006e530 2024-09-17T01:07:21.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.691+0000 7f0955ffb640 1 -- 172.21.15.2:0/865768792 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f095804b720 con 0x7f094006e530 2024-09-17T01:07:21.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.693+0000 7f095f47e640 1 -- 172.21.15.2:0/865768792 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f094006e530 msgr2=0x7f09400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:21.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.693+0000 7f095f47e640 1 --2- 172.21.15.2:0/865768792 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f094006e530 0x7f09400709e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f095810ead0 tx=0x7f094c00b040 comp rx=0 tx=0).stop 2024-09-17T01:07:21.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.693+0000 7f095f47e640 1 -- 172.21.15.2:0/865768792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0958064fe0 msgr2=0x7f0958113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:21.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.693+0000 7f095f47e640 1 --2- 172.21.15.2:0/865768792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0958064fe0 0x7f0958113210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0948003400 tx=0x7f0948004d10 comp rx=0 tx=0).stop 2024-09-17T01:07:21.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.693+0000 7f095f47e640 1 -- 172.21.15.2:0/865768792 shutdown_connections 2024-09-17T01:07:21.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.693+0000 7f095f47e640 1 --2- 172.21.15.2:0/865768792 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f094006e530 0x7f09400709e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.693+0000 7f095f47e640 1 --2- 172.21.15.2:0/865768792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f09580fe450 0x7f0958113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.693+0000 7f095f47e640 1 --2- 172.21.15.2:0/865768792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0958064fe0 0x7f0958113210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.693+0000 7f095f47e640 1 -- 172.21.15.2:0/865768792 >> 172.21.15.2:0/865768792 conn(0x7f09580723b0 msgr2=0x7f09580fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:21.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.693+0000 7f095f47e640 1 -- 172.21.15.2:0/865768792 shutdown_connections 2024-09-17T01:07:21.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.693+0000 7f095f47e640 1 -- 172.21.15.2:0/865768792 wait complete. 2024-09-17T01:07:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.776+0000 7f2908d6b640 1 -- 172.21.15.2:0/3693408888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904102620 msgr2=0x7f29041029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.776+0000 7f2908d6b640 1 --2- 172.21.15.2:0/3693408888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904102620 0x7f29041029f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009c50 tx=0x7f28f4004d10 comp rx=0 tx=0).stop 2024-09-17T01:07:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.776+0000 7f2908d6b640 1 -- 172.21.15.2:0/3693408888 shutdown_connections 2024-09-17T01:07:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.776+0000 7f2908d6b640 1 --2- 172.21.15.2:0/3693408888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29040fac80 0x7f29040fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.776+0000 7f2908d6b640 1 --2- 172.21.15.2:0/3693408888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904102620 0x7f29041029f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.776+0000 7f2908d6b640 1 -- 172.21.15.2:0/3693408888 >> 172.21.15.2:0/3693408888 conn(0x7f2904070ce0 msgr2=0x7f29040710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:21.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.776+0000 7f2908d6b640 1 -- 172.21.15.2:0/3693408888 shutdown_connections 2024-09-17T01:07:21.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.776+0000 7f2908d6b640 1 -- 172.21.15.2:0/3693408888 wait complete. 2024-09-17T01:07:21.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.777+0000 7f2908d6b640 1 Processor -- start 2024-09-17T01:07:21.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.777+0000 7f2908d6b640 1 -- start start 2024-09-17T01:07:21.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.777+0000 7f2908d6b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29040fac80 0x7f29040fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:21.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.777+0000 7f2908d6b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904102620 0x7f29040fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:21.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.777+0000 7f2908d6b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29040fc8e0 con 0x7f2904102620 2024-09-17T01:07:21.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.777+0000 7f2908d6b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29040fca50 con 0x7f29040fac80 2024-09-17T01:07:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.777+0000 7f2901d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904102620 0x7f29040fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.777+0000 7f2901d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904102620 0x7f29040fc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51320/0 (socket says 172.21.15.2:51320) 2024-09-17T01:07:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.777+0000 7f290259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29040fac80 0x7f29040fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.777+0000 7f2901d9b640 1 -- 172.21.15.2:0/3850047572 learned_addr learned my addr 172.21.15.2:0/3850047572 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:07:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.777+0000 7f2901d9b640 1 -- 172.21.15.2:0/3850047572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29040fac80 msgr2=0x7f29040fbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.777+0000 7f2901d9b640 1 --2- 172.21.15.2:0/3850047572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29040fac80 0x7f29040fbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.777+0000 7f2901d9b640 1 -- 172.21.15.2:0/3850047572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f40098b0 con 0x7f2904102620 2024-09-17T01:07:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.778+0000 7f290259c640 1 --2- 172.21.15.2:0/3850047572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29040fac80 0x7f29040fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:07:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.778+0000 7f2901d9b640 1 --2- 172.21.15.2:0/3850047572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904102620 0x7f29040fc3a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f28f800eb70 tx=0x7f28f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.778+0000 7f28f2ffd640 1 -- 172.21.15.2:0/3850047572 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28f8007c30 con 0x7f2904102620 2024-09-17T01:07:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.778+0000 7f2908d6b640 1 -- 172.21.15.2:0/3850047572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29040fcc80 con 0x7f2904102620 2024-09-17T01:07:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.778+0000 7f28f2ffd640 1 -- 172.21.15.2:0/3850047572 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f28f800f040 con 0x7f2904102620 2024-09-17T01:07:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.778+0000 7f28f2ffd640 1 -- 172.21.15.2:0/3850047572 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28f8009510 con 0x7f2904102620 2024-09-17T01:07:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.778+0000 7f2908d6b640 1 -- 172.21.15.2:0/3850047572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2904119890 con 0x7f2904102620 2024-09-17T01:07:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.779+0000 7f2908d6b640 1 -- 172.21.15.2:0/3850047572 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29040657b0 con 0x7f2904102620 2024-09-17T01:07:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.780+0000 7f28f2ffd640 1 -- 172.21.15.2:0/3850047572 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f28f800cbd0 con 0x7f2904102620 2024-09-17T01:07:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.780+0000 7f28f2ffd640 1 --2- 172.21.15.2:0/3850047572 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f28ec06e530 0x7f28ec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.780+0000 7f28f2ffd640 1 -- 172.21.15.2:0/3850047572 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f28f808dcf0 con 0x7f2904102620 2024-09-17T01:07:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.780+0000 7f290259c640 1 --2- 172.21.15.2:0/3850047572 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f28ec06e530 0x7f28ec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.781+0000 7f290259c640 1 --2- 172.21.15.2:0/3850047572 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f28ec06e530 0x7f28ec0709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f28f4000f80 tx=0x7f28f4004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:21.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:21.785+0000 7f28f2ffd640 1 -- 172.21.15.2:0/3850047572 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f28f8056f60 con 0x7f2904102620 2024-09-17T01:07:22.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.014+0000 7f2908d6b640 1 -- 172.21.15.2:0/3850047572 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2904109590 con 0x7f28ec06e530 2024-09-17T01:07:22.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.023+0000 7f28f2ffd640 1 -- 172.21.15.2:0/3850047572 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2904109590 con 0x7f28ec06e530 2024-09-17T01:07:22.022 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:07:22.022 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (4m) 34s ago 13m 26.6M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:07:22.022 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (64s) 34s ago 13m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de b7ed6c8d5a92 2024-09-17T01:07:22.022 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (60s) 56s ago 12m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de ae713b940078 2024-09-17T01:07:22.022 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (3m) 34s ago 13m 76.3M - 9.4.12 2bacad6d85d8 5fe408c103d6 2024-09-17T01:07:22.022 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (7m) 34s ago 7m 125M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:07:22.022 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (7m) 34s ago 7m 65.1M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:07:22.022 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (7m) 56s ago 7m 64.8M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:07:22.022 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (7m) 56s ago 7m 115M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:07:22.022 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (4m) 34s ago 14m 494M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:07:22.022 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (3m) 56s ago 12m 439M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:07:22.022 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (2m) 34s ago 14m 41.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de da5247385c2d 2024-09-17T01:07:22.023 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (101s) 56s ago 12m 33.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b92f98b2cab9 2024-09-17T01:07:22.023 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (4m) 34s ago 13m 15.9M - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:07:22.023 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (4m) 56s ago 12m 16.1M - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:07:22.023 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (39s) 34s ago 11m 11.7M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 563188d6089b 2024-09-17T01:07:22.023 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 starting - - - 1558M 2024-09-17T01:07:22.023 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (10m) 34s ago 10m 197M 1558M 17.2.7-1635-g4a704134 f22ead590bad 5dff1cf9fc56 2024-09-17T01:07:22.023 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (10m) 56s ago 10m 273M 2581M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:07:22.023 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (9m) 56s ago 9m 240M 2581M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:07:22.023 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (9m) 56s ago 9m 222M 2581M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:07:22.023 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (3m) 34s ago 12m 63.9M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:07:22.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.025+0000 7f2908d6b640 1 -- 172.21.15.2:0/3850047572 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f28ec06e530 msgr2=0x7f28ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:22.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.025+0000 7f2908d6b640 1 --2- 172.21.15.2:0/3850047572 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f28ec06e530 0x7f28ec0709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f28f4000f80 tx=0x7f28f4004d10 comp rx=0 tx=0).stop 2024-09-17T01:07:22.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.025+0000 7f2908d6b640 1 -- 172.21.15.2:0/3850047572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904102620 msgr2=0x7f29040fc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:22.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.025+0000 7f2908d6b640 1 --2- 172.21.15.2:0/3850047572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904102620 0x7f29040fc3a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f28f800eb70 tx=0x7f28f800b040 comp rx=0 tx=0).stop 2024-09-17T01:07:22.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.025+0000 7f2908d6b640 1 -- 172.21.15.2:0/3850047572 shutdown_connections 2024-09-17T01:07:22.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.025+0000 7f2908d6b640 1 --2- 172.21.15.2:0/3850047572 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f28ec06e530 0x7f28ec0709e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.025+0000 7f2908d6b640 1 --2- 172.21.15.2:0/3850047572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2904102620 0x7f29040fc3a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.025+0000 7f2908d6b640 1 --2- 172.21.15.2:0/3850047572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29040fac80 0x7f29040fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.025+0000 7f2908d6b640 1 -- 172.21.15.2:0/3850047572 >> 172.21.15.2:0/3850047572 conn(0x7f2904070ce0 msgr2=0x7f2904105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:22.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.026+0000 7f2908d6b640 1 -- 172.21.15.2:0/3850047572 shutdown_connections 2024-09-17T01:07:22.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.026+0000 7f2908d6b640 1 -- 172.21.15.2:0/3850047572 wait complete. 2024-09-17T01:07:22.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.107+0000 7fb4d7334640 1 -- 172.21.15.2:0/4129906907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d00fd590 msgr2=0x7fb4d00fd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:22.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.107+0000 7fb4d7334640 1 --2- 172.21.15.2:0/4129906907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d00fd590 0x7fb4d00fd960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc004900 tx=0x7fb4cc009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.108+0000 7fb4d7334640 1 -- 172.21.15.2:0/4129906907 shutdown_connections 2024-09-17T01:07:22.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.108+0000 7fb4d7334640 1 --2- 172.21.15.2:0/4129906907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d00fdf30 0x7fb4d0106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.108+0000 7fb4d7334640 1 --2- 172.21.15.2:0/4129906907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d00fd590 0x7fb4d00fd960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.108+0000 7fb4d7334640 1 -- 172.21.15.2:0/4129906907 >> 172.21.15.2:0/4129906907 conn(0x7fb4d00f7090 msgr2=0x7fb4d00f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:22.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.108+0000 7fb4d7334640 1 -- 172.21.15.2:0/4129906907 shutdown_connections 2024-09-17T01:07:22.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.108+0000 7fb4d7334640 1 -- 172.21.15.2:0/4129906907 wait complete. 2024-09-17T01:07:22.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.108+0000 7fb4d7334640 1 Processor -- start 2024-09-17T01:07:22.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.108+0000 7fb4d7334640 1 -- start start 2024-09-17T01:07:22.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4d7334640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d00fd590 0x7fb4d0113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:22.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4d7334640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d00fdf30 0x7fb4d0113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:22.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4d7334640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d0113d40 con 0x7fb4d00fd590 2024-09-17T01:07:22.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4d7334640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d0113eb0 con 0x7fb4d00fdf30 2024-09-17T01:07:22.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4d50d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d00fd590 0x7fb4d0113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:22.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4d50d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d00fd590 0x7fb4d0113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51326/0 (socket says 172.21.15.2:51326) 2024-09-17T01:07:22.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4d50d0640 1 -- 172.21.15.2:0/3838776452 learned_addr learned my addr 172.21.15.2:0/3838776452 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:07:22.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4d48cf640 1 --2- 172.21.15.2:0/3838776452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d00fdf30 0x7fb4d0113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:22.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4d50d0640 1 -- 172.21.15.2:0/3838776452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d00fdf30 msgr2=0x7fb4d0113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:22.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4d50d0640 1 --2- 172.21.15.2:0/3838776452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d00fdf30 0x7fb4d0113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4d50d0640 1 -- 172.21.15.2:0/3838776452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4cc005040 con 0x7fb4d00fd590 2024-09-17T01:07:22.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4d48cf640 1 --2- 172.21.15.2:0/3838776452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d00fdf30 0x7fb4d0113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:07:22.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4d50d0640 1 --2- 172.21.15.2:0/3838776452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d00fd590 0x7fb4d0113200 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc004960 tx=0x7fb4cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:22.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4c5ffb640 1 -- 172.21.15.2:0/3838776452 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4cc038070 con 0x7fb4d00fd590 2024-09-17T01:07:22.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4c5ffb640 1 -- 172.21.15.2:0/3838776452 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb4cc02cef0 con 0x7fb4d00fd590 2024-09-17T01:07:22.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4d7334640 1 -- 172.21.15.2:0/3838776452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d010d2d0 con 0x7fb4d00fd590 2024-09-17T01:07:22.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.109+0000 7fb4c5ffb640 1 -- 172.21.15.2:0/3838776452 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4cc009480 con 0x7fb4d00fd590 2024-09-17T01:07:22.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.110+0000 7fb4d7334640 1 -- 172.21.15.2:0/3838776452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d010d790 con 0x7fb4d00fd590 2024-09-17T01:07:22.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.111+0000 7fb4d7334640 1 -- 172.21.15.2:0/3838776452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d00662d0 con 0x7fb4d00fd590 2024-09-17T01:07:22.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.111+0000 7fb4c5ffb640 1 -- 172.21.15.2:0/3838776452 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fb4cc030020 con 0x7fb4d00fd590 2024-09-17T01:07:22.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.112+0000 7fb4c5ffb640 1 --2- 172.21.15.2:0/3838776452 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb4bc06e530 0x7fb4bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:22.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.112+0000 7fb4c5ffb640 1 -- 172.21.15.2:0/3838776452 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb4cc0adde0 con 0x7fb4d00fd590 2024-09-17T01:07:22.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.112+0000 7fb4d48cf640 1 --2- 172.21.15.2:0/3838776452 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb4bc06e530 0x7fb4bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:22.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.113+0000 7fb4d48cf640 1 --2- 172.21.15.2:0/3838776452 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb4bc06e530 0x7fb4bc0709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0004fd0 tx=0x7fb4c000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:22.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.117+0000 7fb4c5ffb640 1 -- 172.21.15.2:0/3838776452 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb4cc077050 con 0x7fb4d00fd590 2024-09-17T01:07:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.369+0000 7fb4d7334640 1 -- 172.21.15.2:0/3838776452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb4d00fac90 con 0x7fb4d00fd590 2024-09-17T01:07:22.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.370+0000 7fb4c5ffb640 1 -- 172.21.15.2:0/3838776452 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fb4cc07a710 con 0x7fb4d00fd590 2024-09-17T01:07:22.368 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:07:22.368 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:07:22.368 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:07:22.368 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:07:22.369 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:07:22.369 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:07:22.369 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:07:22.369 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:07:22.369 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4, 2024-09-17T01:07:22.369 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:07:22.369 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:07:22.369 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:07:22.369 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:07:22.369 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:07:22.369 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:07:22.370 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 8, 2024-09-17T01:07:22.370 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5 2024-09-17T01:07:22.370 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:07:22.370 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:07:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.372+0000 7fb4d7334640 1 -- 172.21.15.2:0/3838776452 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb4bc06e530 msgr2=0x7fb4bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.372+0000 7fb4d7334640 1 --2- 172.21.15.2:0/3838776452 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb4bc06e530 0x7fb4bc0709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0004fd0 tx=0x7fb4c000b040 comp rx=0 tx=0).stop 2024-09-17T01:07:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.372+0000 7fb4d7334640 1 -- 172.21.15.2:0/3838776452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d00fd590 msgr2=0x7fb4d0113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.372+0000 7fb4d7334640 1 --2- 172.21.15.2:0/3838776452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d00fd590 0x7fb4d0113200 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc004960 tx=0x7fb4cc009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.372+0000 7fb4d7334640 1 -- 172.21.15.2:0/3838776452 shutdown_connections 2024-09-17T01:07:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.372+0000 7fb4d7334640 1 --2- 172.21.15.2:0/3838776452 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb4bc06e530 0x7fb4bc0709e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.372+0000 7fb4d7334640 1 --2- 172.21.15.2:0/3838776452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d00fdf30 0x7fb4d0113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.372+0000 7fb4d7334640 1 --2- 172.21.15.2:0/3838776452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4d00fd590 0x7fb4d0113200 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.372+0000 7fb4d7334640 1 -- 172.21.15.2:0/3838776452 >> 172.21.15.2:0/3838776452 conn(0x7fb4d00f7090 msgr2=0x7fb4d0105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.372+0000 7fb4d7334640 1 -- 172.21.15.2:0/3838776452 shutdown_connections 2024-09-17T01:07:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.372+0000 7fb4d7334640 1 -- 172.21.15.2:0/3838776452 wait complete. 2024-09-17T01:07:22.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.455+0000 7f89c2300640 1 -- 172.21.15.2:0/3403887885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89bc0fb4d0 msgr2=0x7f89bc0fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:22.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.455+0000 7f89c2300640 1 --2- 172.21.15.2:0/3403887885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89bc0fb4d0 0x7f89bc0fb940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f89b00048d0 tx=0x7f89b0009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.455+0000 7f89c2300640 1 -- 172.21.15.2:0/3403887885 shutdown_connections 2024-09-17T01:07:22.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.455+0000 7f89c2300640 1 --2- 172.21.15.2:0/3403887885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89bc0fb4d0 0x7f89bc0fb940 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.455+0000 7f89c2300640 1 --2- 172.21.15.2:0/3403887885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89bc101510 0x7f89bc1018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.455+0000 7f89c2300640 1 -- 172.21.15.2:0/3403887885 >> 172.21.15.2:0/3403887885 conn(0x7f89bc0f7090 msgr2=0x7f89bc0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:22.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.455+0000 7f89c2300640 1 -- 172.21.15.2:0/3403887885 shutdown_connections 2024-09-17T01:07:22.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.455+0000 7f89c2300640 1 -- 172.21.15.2:0/3403887885 wait complete. 2024-09-17T01:07:22.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.456+0000 7f89c2300640 1 Processor -- start 2024-09-17T01:07:22.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.456+0000 7f89c2300640 1 -- start start 2024-09-17T01:07:22.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.456+0000 7f89c2300640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89bc0fb4d0 0x7f89bc10e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:22.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.456+0000 7f89c2300640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89bc101510 0x7f89bc10e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:22.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.456+0000 7f89c2300640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc10ecb0 con 0x7f89bc101510 2024-09-17T01:07:22.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.456+0000 7f89c2300640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc10ee20 con 0x7f89bc0fb4d0 2024-09-17T01:07:22.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.456+0000 7f89bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89bc101510 0x7f89bc10e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:22.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.456+0000 7f89bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89bc101510 0x7f89bc10e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51342/0 (socket says 172.21.15.2:51342) 2024-09-17T01:07:22.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.456+0000 7f89bb7fe640 1 -- 172.21.15.2:0/3805250740 learned_addr learned my addr 172.21.15.2:0/3805250740 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:07:22.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.456+0000 7f89bbfff640 1 --2- 172.21.15.2:0/3805250740 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89bc0fb4d0 0x7f89bc10e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:22.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.457+0000 7f89bb7fe640 1 -- 172.21.15.2:0/3805250740 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89bc0fb4d0 msgr2=0x7f89bc10e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:22.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.457+0000 7f89bb7fe640 1 --2- 172.21.15.2:0/3805250740 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89bc0fb4d0 0x7f89bc10e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.457+0000 7f89bb7fe640 1 -- 172.21.15.2:0/3805250740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b0005040 con 0x7f89bc101510 2024-09-17T01:07:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.457+0000 7f89bb7fe640 1 --2- 172.21.15.2:0/3805250740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89bc101510 0x7f89bc10e6b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f89b0000c00 tx=0x7f89b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.457+0000 7f89b8ff9640 1 -- 172.21.15.2:0/3805250740 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89b0038070 con 0x7f89bc101510 2024-09-17T01:07:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.457+0000 7f89b8ff9640 1 -- 172.21.15.2:0/3805250740 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f89b002ade0 con 0x7f89bc101510 2024-09-17T01:07:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.457+0000 7f89c2300640 1 -- 172.21.15.2:0/3805250740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89bc1171e0 con 0x7f89bc101510 2024-09-17T01:07:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.457+0000 7f89b8ff9640 1 -- 172.21.15.2:0/3805250740 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89b002c7e0 con 0x7f89bc101510 2024-09-17T01:07:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.457+0000 7f89c2300640 1 -- 172.21.15.2:0/3805250740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89bc117640 con 0x7f89bc101510 2024-09-17T01:07:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.458+0000 7f89c2300640 1 -- 172.21.15.2:0/3805250740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89bc0fcc10 con 0x7f89bc101510 2024-09-17T01:07:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.459+0000 7f89b8ff9640 1 -- 172.21.15.2:0/3805250740 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f89b0030020 con 0x7f89bc101510 2024-09-17T01:07:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.459+0000 7f89b8ff9640 1 --2- 172.21.15.2:0/3805250740 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f89a406e530 0x7f89a40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:22.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.459+0000 7f89b8ff9640 1 -- 172.21.15.2:0/3805250740 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f89b00adda0 con 0x7f89bc101510 2024-09-17T01:07:22.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.459+0000 7f89bbfff640 1 --2- 172.21.15.2:0/3805250740 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f89a406e530 0x7f89a40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:22.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.460+0000 7f89bbfff640 1 --2- 172.21.15.2:0/3805250740 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f89a406e530 0x7f89a40709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f89ac004eb0 tx=0x7f89ac00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:22.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.463+0000 7f89b8ff9640 1 -- 172.21.15.2:0/3805250740 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f89b0076f90 con 0x7f89bc101510 2024-09-17T01:07:22.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.681+0000 7f89c2300640 1 -- 172.21.15.2:0/3805250740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f89bc04b720 con 0x7f89bc101510 2024-09-17T01:07:22.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.681+0000 7f89b8ff9640 1 -- 172.21.15.2:0/3805250740 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1946 (secure 0 0 0) 0x7f89b007a650 con 0x7f89bc101510 2024-09-17T01:07:22.680 INFO:teuthology.orchestra.run.smithi002.stdout:e25 2024-09-17T01:07:22.680 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-17T01:05:48:747321+0000 2024-09-17T01:07:22.680 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:07:22.680 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:07:22.680 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-17T01:07:22.680 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:07:22.680 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:07:22.680 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-17T01:07:22.680 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 25 2024-09-17T01:07:22.680 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:07:22.681 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-17T00:59:20.485696+0000 2024-09-17T01:07:22.681 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-17T01:05:47.816861+0000 2024-09-17T01:07:22.681 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-17T01:07:22.681 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-17T01:07:22.681 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-17T01:07:22.681 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-17T01:07:22.681 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-17T01:07:22.681 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-17T01:07:22.681 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-17T01:07:22.681 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-17T01:07:22.681 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 44 2024-09-17T01:07:22.681 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:07:22.681 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2024-09-17T01:07:22.681 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2024-09-17T01:07:22.682 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=14464,1=24269} 2024-09-17T01:07:22.684 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-17T01:07:22.684 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-17T01:07:22.684 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-17T01:07:22.684 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-17T01:07:22.684 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-17T01:07:22.684 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-17T01:07:22.684 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-17T01:07:22.684 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-17T01:07:22.684 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-17T01:07:22.685 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 14464 members: 24269,14464 2024-09-17T01:07:22.685 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.fmyyzz{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:07:22.685 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.zmrgxd{0:24287} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/2986470392,v1:172.21.15.2:6827/2986470392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:07:22.685 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.hgawhu{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:07:22.685 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.heckcd{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:07:22.685 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:07:22.685 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:07:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-17T01:07:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.683+0000 7f89c2300640 1 -- 172.21.15.2:0/3805250740 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f89a406e530 msgr2=0x7f89a40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.683+0000 7f89c2300640 1 --2- 172.21.15.2:0/3805250740 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f89a406e530 0x7f89a40709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f89ac004eb0 tx=0x7f89ac00b040 comp rx=0 tx=0).stop 2024-09-17T01:07:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.683+0000 7f89c2300640 1 -- 172.21.15.2:0/3805250740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89bc101510 msgr2=0x7f89bc10e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.683+0000 7f89c2300640 1 --2- 172.21.15.2:0/3805250740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89bc101510 0x7f89bc10e6b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f89b0000c00 tx=0x7f89b0009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.683+0000 7f89c2300640 1 -- 172.21.15.2:0/3805250740 shutdown_connections 2024-09-17T01:07:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.683+0000 7f89c2300640 1 --2- 172.21.15.2:0/3805250740 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f89a406e530 0x7f89a40709e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.683+0000 7f89c2300640 1 --2- 172.21.15.2:0/3805250740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89bc101510 0x7f89bc10e6b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.683+0000 7f89c2300640 1 --2- 172.21.15.2:0/3805250740 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89bc0fb4d0 0x7f89bc10e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.683+0000 7f89c2300640 1 -- 172.21.15.2:0/3805250740 >> 172.21.15.2:0/3805250740 conn(0x7f89bc0f7090 msgr2=0x7f89bc0f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.683+0000 7f89c2300640 1 -- 172.21.15.2:0/3805250740 shutdown_connections 2024-09-17T01:07:22.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.683+0000 7f89c2300640 1 -- 172.21.15.2:0/3805250740 wait complete. 2024-09-17T01:07:22.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.765+0000 7f12bb2fb640 1 -- 172.21.15.2:0/1002865538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b4102ed0 msgr2=0x7f12b40fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:22.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.765+0000 7f12bb2fb640 1 --2- 172.21.15.2:0/1002865538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b4102ed0 0x7f12b40fc590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f12a40048d0 tx=0x7f12a4009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.766+0000 7f12bb2fb640 1 -- 172.21.15.2:0/1002865538 shutdown_connections 2024-09-17T01:07:22.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.766+0000 7f12bb2fb640 1 --2- 172.21.15.2:0/1002865538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b4102ed0 0x7f12b40fc590 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.766+0000 7f12bb2fb640 1 --2- 172.21.15.2:0/1002865538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b4102530 0x7f12b4102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.766+0000 7f12bb2fb640 1 -- 172.21.15.2:0/1002865538 >> 172.21.15.2:0/1002865538 conn(0x7f12b40f80f0 msgr2=0x7f12b40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:22.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.766+0000 7f12bb2fb640 1 -- 172.21.15.2:0/1002865538 shutdown_connections 2024-09-17T01:07:22.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.766+0000 7f12bb2fb640 1 -- 172.21.15.2:0/1002865538 wait complete. 2024-09-17T01:07:22.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.766+0000 7f12bb2fb640 1 Processor -- start 2024-09-17T01:07:22.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.766+0000 7f12bb2fb640 1 -- start start 2024-09-17T01:07:22.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.766+0000 7f12bb2fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b4102530 0x7f12b41131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:22.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.766+0000 7f12bb2fb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b4102ed0 0x7f12b4113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:22.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.766+0000 7f12bb2fb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b4113d30 con 0x7f12b4102530 2024-09-17T01:07:22.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.766+0000 7f12bb2fb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b410d170 con 0x7f12b4102ed0 2024-09-17T01:07:22.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.767+0000 7f12b9097640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b4102530 0x7f12b41131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:22.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.767+0000 7f12b9097640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b4102530 0x7f12b41131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51366/0 (socket says 172.21.15.2:51366) 2024-09-17T01:07:22.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.767+0000 7f12b9097640 1 -- 172.21.15.2:0/291877719 learned_addr learned my addr 172.21.15.2:0/291877719 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:07:22.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.767+0000 7f12b8896640 1 --2- 172.21.15.2:0/291877719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b4102ed0 0x7f12b4113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:22.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.767+0000 7f12b9097640 1 -- 172.21.15.2:0/291877719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b4102ed0 msgr2=0x7f12b4113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:22.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.767+0000 7f12b9097640 1 --2- 172.21.15.2:0/291877719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b4102ed0 0x7f12b4113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:22.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.767+0000 7f12b9097640 1 -- 172.21.15.2:0/291877719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a4005040 con 0x7f12b4102530 2024-09-17T01:07:22.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.767+0000 7f12b9097640 1 --2- 172.21.15.2:0/291877719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b4102530 0x7f12b41131f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f12b000eb70 tx=0x7f12b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:22.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.767+0000 7f12a9ffb640 1 -- 172.21.15.2:0/291877719 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12b0007c30 con 0x7f12b4102530 2024-09-17T01:07:22.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.767+0000 7f12a9ffb640 1 -- 172.21.15.2:0/291877719 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f12b000f040 con 0x7f12b4102530 2024-09-17T01:07:22.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.767+0000 7f12bb2fb640 1 -- 172.21.15.2:0/291877719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b410d3f0 con 0x7f12b4102530 2024-09-17T01:07:22.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.767+0000 7f12a9ffb640 1 -- 172.21.15.2:0/291877719 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12b000ca60 con 0x7f12b4102530 2024-09-17T01:07:22.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.768+0000 7f12bb2fb640 1 -- 172.21.15.2:0/291877719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b410d960 con 0x7f12b4102530 2024-09-17T01:07:22.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.769+0000 7f12bb2fb640 1 -- 172.21.15.2:0/291877719 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b40fdcb0 con 0x7f12b4102530 2024-09-17T01:07:22.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.769+0000 7f12a9ffb640 1 -- 172.21.15.2:0/291877719 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f12b000cbc0 con 0x7f12b4102530 2024-09-17T01:07:22.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.770+0000 7f12a9ffb640 1 --2- 172.21.15.2:0/291877719 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f12a006e530 0x7f12a00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:22.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.770+0000 7f12a9ffb640 1 -- 172.21.15.2:0/291877719 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f12b008dd30 con 0x7f12b4102530 2024-09-17T01:07:22.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.770+0000 7f12b8896640 1 --2- 172.21.15.2:0/291877719 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f12a006e530 0x7f12a00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:22.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.770+0000 7f12b8896640 1 --2- 172.21.15.2:0/291877719 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f12a006e530 0x7f12a00709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f12a4000c00 tx=0x7f12a4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:22.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:22.775+0000 7f12a9ffb640 1 -- 172.21.15.2:0/291877719 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f12b0056f20 con 0x7f12b4102530 2024-09-17T01:07:22.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.001+0000 7f12bb2fb640 1 -- 172.21.15.2:0/291877719 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12b404b720 con 0x7f12a006e530 2024-09-17T01:07:22.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:22 smithi002 ceph-mon[98018]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:07:22.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:22 smithi002 ceph-mon[98018]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:23.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:22 smithi002 ceph-mon[98018]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:23.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:22 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3838776452' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:22 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3805250740' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:07:23.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.002+0000 7f12a9ffb640 1 -- 172.21.15.2:0/291877719 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f12b404b720 con 0x7f12a006e530 2024-09-17T01:07:23.001 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:07:23.001 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:07:23.001 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:07:23.001 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:07:23.001 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-17T01:07:23.001 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-17T01:07:23.001 INFO:teuthology.orchestra.run.smithi002.stdout: "mon", 2024-09-17T01:07:23.001 INFO:teuthology.orchestra.run.smithi002.stdout: "crash" 2024-09-17T01:07:23.001 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-17T01:07:23.001 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "8/21 daemons upgraded", 2024-09-17T01:07:23.001 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:07:23.002 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:07:23.002 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:07:23.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.005+0000 7f12bb2fb640 1 -- 172.21.15.2:0/291877719 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f12a006e530 msgr2=0x7f12a00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:23.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.005+0000 7f12bb2fb640 1 --2- 172.21.15.2:0/291877719 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f12a006e530 0x7f12a00709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f12a4000c00 tx=0x7f12a4035040 comp rx=0 tx=0).stop 2024-09-17T01:07:23.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.005+0000 7f12bb2fb640 1 -- 172.21.15.2:0/291877719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b4102530 msgr2=0x7f12b41131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:23.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.005+0000 7f12bb2fb640 1 --2- 172.21.15.2:0/291877719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b4102530 0x7f12b41131f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f12b000eb70 tx=0x7f12b000b040 comp rx=0 tx=0).stop 2024-09-17T01:07:23.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.005+0000 7f12bb2fb640 1 -- 172.21.15.2:0/291877719 shutdown_connections 2024-09-17T01:07:23.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.005+0000 7f12bb2fb640 1 --2- 172.21.15.2:0/291877719 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f12a006e530 0x7f12a00709e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:23.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.005+0000 7f12bb2fb640 1 --2- 172.21.15.2:0/291877719 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12b4102ed0 0x7f12b4113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:23.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.005+0000 7f12bb2fb640 1 --2- 172.21.15.2:0/291877719 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12b4102530 0x7f12b41131f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:23.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.005+0000 7f12bb2fb640 1 -- 172.21.15.2:0/291877719 >> 172.21.15.2:0/291877719 conn(0x7f12b40f80f0 msgr2=0x7f12b40f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:23.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.005+0000 7f12bb2fb640 1 -- 172.21.15.2:0/291877719 shutdown_connections 2024-09-17T01:07:23.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.006+0000 7f12bb2fb640 1 -- 172.21.15.2:0/291877719 wait complete. 2024-09-17T01:07:23.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.094+0000 7fe9b4578640 1 -- 172.21.15.2:0/3566535028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ac0658f0 msgr2=0x7fe9ac108b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:23.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.094+0000 7fe9b4578640 1 --2- 172.21.15.2:0/3566535028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ac0658f0 0x7fe9ac108b00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe99c004810 tx=0x7fe99c009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:23.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.094+0000 7fe9b4578640 1 -- 172.21.15.2:0/3566535028 shutdown_connections 2024-09-17T01:07:23.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.094+0000 7fe9b4578640 1 --2- 172.21.15.2:0/3566535028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ac0658f0 0x7fe9ac108b00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:23.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.094+0000 7fe9b4578640 1 --2- 172.21.15.2:0/3566535028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ac064fe0 0x7fe9ac0653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:23.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.094+0000 7fe9b4578640 1 -- 172.21.15.2:0/3566535028 >> 172.21.15.2:0/3566535028 conn(0x7fe9ac0723b0 msgr2=0x7fe9ac0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:23.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.095+0000 7fe9b4578640 1 -- 172.21.15.2:0/3566535028 shutdown_connections 2024-09-17T01:07:23.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.095+0000 7fe9b4578640 1 -- 172.21.15.2:0/3566535028 wait complete. 2024-09-17T01:07:23.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.095+0000 7fe9b4578640 1 Processor -- start 2024-09-17T01:07:23.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.095+0000 7fe9b4578640 1 -- start start 2024-09-17T01:07:23.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.096+0000 7fe9b4578640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ac064fe0 0x7fe9ac115480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:23.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.096+0000 7fe9b4578640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ac0658f0 0x7fe9ac1159c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:23.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.096+0000 7fe9b4578640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac116010 con 0x7fe9ac064fe0 2024-09-17T01:07:23.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.096+0000 7fe9b4578640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac10f420 con 0x7fe9ac0658f0 2024-09-17T01:07:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.096+0000 7fe9b2314640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ac064fe0 0x7fe9ac115480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.096+0000 7fe9b2314640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ac064fe0 0x7fe9ac115480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51386/0 (socket says 172.21.15.2:51386) 2024-09-17T01:07:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.096+0000 7fe9b2314640 1 -- 172.21.15.2:0/1422868123 learned_addr learned my addr 172.21.15.2:0/1422868123 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:07:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.096+0000 7fe9b1b13640 1 --2- 172.21.15.2:0/1422868123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ac0658f0 0x7fe9ac1159c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.096+0000 7fe9b2314640 1 -- 172.21.15.2:0/1422868123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ac0658f0 msgr2=0x7fe9ac1159c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.096+0000 7fe9b2314640 1 --2- 172.21.15.2:0/1422868123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ac0658f0 0x7fe9ac1159c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.096+0000 7fe9b2314640 1 -- 172.21.15.2:0/1422868123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a8005040 con 0x7fe9ac064fe0 2024-09-17T01:07:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.096+0000 7fe9b1b13640 1 --2- 172.21.15.2:0/1422868123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ac0658f0 0x7fe9ac1159c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:07:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.096+0000 7fe9b2314640 1 --2- 172.21.15.2:0/1422868123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ac064fe0 0x7fe9ac115480 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80094d0 tx=0x7fe9a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.097+0000 7fe9a2ffd640 1 -- 172.21.15.2:0/1422868123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a800e8b0 con 0x7fe9ac064fe0 2024-09-17T01:07:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.097+0000 7fe9b4578640 1 -- 172.21.15.2:0/1422868123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c005040 con 0x7fe9ac064fe0 2024-09-17T01:07:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.097+0000 7fe9b4578640 1 -- 172.21.15.2:0/1422868123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ac10fa60 con 0x7fe9ac064fe0 2024-09-17T01:07:23.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.097+0000 7fe9a2ffd640 1 -- 172.21.15.2:0/1422868123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe9a800f040 con 0x7fe9ac064fe0 2024-09-17T01:07:23.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.097+0000 7fe9a2ffd640 1 -- 172.21.15.2:0/1422868123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a8013d90 con 0x7fe9ac064fe0 2024-09-17T01:07:23.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.098+0000 7fe9b4578640 1 -- 172.21.15.2:0/1422868123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe990005210 con 0x7fe9ac064fe0 2024-09-17T01:07:23.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.098+0000 7fe9a2ffd640 1 -- 172.21.15.2:0/1422868123 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fe9a801c410 con 0x7fe9ac064fe0 2024-09-17T01:07:23.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.099+0000 7fe9a2ffd640 1 --2- 172.21.15.2:0/1422868123 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe99806e530 0x7fe9980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:23.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.099+0000 7fe9a2ffd640 1 -- 172.21.15.2:0/1422868123 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe9a808de30 con 0x7fe9ac064fe0 2024-09-17T01:07:23.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.099+0000 7fe9b1b13640 1 --2- 172.21.15.2:0/1422868123 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe99806e530 0x7fe9980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:23.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.100+0000 7fe9b1b13640 1 --2- 172.21.15.2:0/1422868123 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe99806e530 0x7fe9980709e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe99c000c00 tx=0x7fe99c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:23.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.104+0000 7fe9a2ffd640 1 -- 172.21.15.2:0/1422868123 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe9a8056fe0 con 0x7fe9ac064fe0 2024-09-17T01:07:23.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:22 smithi099 ceph-mon[77412]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:07:23.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:22 smithi099 ceph-mon[77412]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:23.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:22 smithi099 ceph-mon[77412]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:23.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:22 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3838776452' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:23.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:22 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3805250740' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:07:23.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.355+0000 7fe9b4578640 1 -- 172.21.15.2:0/1422868123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe9900054c0 con 0x7fe9ac064fe0 2024-09-17T01:07:23.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.356+0000 7fe9a2ffd640 1 -- 172.21.15.2:0/1422868123 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1350 (secure 0 0 0) 0x7fe9a805a6a0 con 0x7fe9ac064fe0 2024-09-17T01:07:23.354 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 55/354 objects degraded (15.537%), 16 pgs degraded 2024-09-17T01:07:23.355 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:07:23.355 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:07:23.355 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:07:23.355 INFO:teuthology.orchestra.run.smithi002.stdout: osd.1 (root=default,host=smithi002) is down 2024-09-17T01:07:23.355 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 55/354 objects degraded (15.537%), 16 pgs degraded 2024-09-17T01:07:23.355 INFO:teuthology.orchestra.run.smithi002.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-17T01:07:23.355 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-17T01:07:23.355 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-17T01:07:23.355 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-17T01:07:23.355 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-17T01:07:23.355 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-17T01:07:23.355 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-17T01:07:23.355 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-17T01:07:23.356 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-17T01:07:23.356 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-17T01:07:23.356 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-17T01:07:23.356 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-09-17T01:07:23.356 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-09-17T01:07:23.356 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-17T01:07:23.356 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-09-17T01:07:23.356 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-17T01:07:23.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.359+0000 7fe9b4578640 1 -- 172.21.15.2:0/1422868123 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe99806e530 msgr2=0x7fe9980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:23.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.359+0000 7fe9b4578640 1 --2- 172.21.15.2:0/1422868123 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe99806e530 0x7fe9980709e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe99c000c00 tx=0x7fe99c035040 comp rx=0 tx=0).stop 2024-09-17T01:07:23.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.359+0000 7fe9b4578640 1 -- 172.21.15.2:0/1422868123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ac064fe0 msgr2=0x7fe9ac115480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:23.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.359+0000 7fe9b4578640 1 --2- 172.21.15.2:0/1422868123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ac064fe0 0x7fe9ac115480 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80094d0 tx=0x7fe9a8009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:23.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.359+0000 7fe9b4578640 1 -- 172.21.15.2:0/1422868123 shutdown_connections 2024-09-17T01:07:23.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.359+0000 7fe9b4578640 1 --2- 172.21.15.2:0/1422868123 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe99806e530 0x7fe9980709e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:23.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.359+0000 7fe9b4578640 1 --2- 172.21.15.2:0/1422868123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9ac0658f0 0x7fe9ac1159c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:23.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.359+0000 7fe9b4578640 1 --2- 172.21.15.2:0/1422868123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9ac064fe0 0x7fe9ac115480 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:23.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.359+0000 7fe9b4578640 1 -- 172.21.15.2:0/1422868123 >> 172.21.15.2:0/1422868123 conn(0x7fe9ac0723b0 msgr2=0x7fe9ac103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:23.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.360+0000 7fe9b4578640 1 -- 172.21.15.2:0/1422868123 shutdown_connections 2024-09-17T01:07:23.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:23.360+0000 7fe9b4578640 1 -- 172.21.15.2:0/1422868123 wait complete. 2024-09-17T01:07:24.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:23 smithi002 ceph-mon[98018]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:24.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:23 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:24.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:23 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:24.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:23 smithi002 ceph-mon[98018]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:24.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:23 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1422868123' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:07:24.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:23 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:24.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:23 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:24.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:23 smithi099 ceph-mon[77412]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:24.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:23 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:24.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:23 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:24.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:23 smithi099 ceph-mon[77412]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:24.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:23 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1422868123' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:07:24.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:23 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:24.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:23 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:25.223 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:24 smithi002 ceph-mon[98018]: pgmap v69: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:07:25.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:24 smithi099 ceph-mon[77412]: pgmap v69: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:07:25.905 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:25 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1[114908]: 2024-09-17T01:07:25.687+0000 7f75dbf28640 -1 osd.1 52 log_to_monitors true 2024-09-17T01:07:26.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:26 smithi002 ceph-mon[98018]: pgmap v70: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:07:26.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:26.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:26.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:26 smithi002 ceph-mon[98018]: from='osd.1 [v2:172.21.15.2:6810/2871329884,v1:172.21.15.2:6811/2871329884]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:07:26.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:26 smithi099 ceph-mon[77412]: pgmap v70: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:07:26.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:26.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:26.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:26 smithi099 ceph-mon[77412]: from='osd.1 [v2:172.21.15.2:6810/2871329884,v1:172.21.15.2:6811/2871329884]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:07:27.155 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:07:26 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1[114908]: 2024-09-17T01:07:26.925+0000 7f75cfcba640 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:07:27.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:27 smithi002 ceph-mon[98018]: from='osd.1 [v2:172.21.15.2:6810/2871329884,v1:172.21.15.2:6811/2871329884]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:07:27.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:27 smithi002 ceph-mon[98018]: osdmap e55: 6 total, 5 up, 6 in 2024-09-17T01:07:27.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:27 smithi002 ceph-mon[98018]: from='osd.1 [v2:172.21.15.2:6810/2871329884,v1:172.21.15.2:6811/2871329884]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-17T01:07:27.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:27 smithi002 ceph-mon[98018]: from='osd.1 [v2:172.21.15.2:6810/2871329884,v1:172.21.15.2:6811/2871329884]' entity='osd.1' 2024-09-17T01:07:27.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:27 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:27.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:27 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:27.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:27 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:27 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:27 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:27.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:27 smithi099 ceph-mon[77412]: from='osd.1 [v2:172.21.15.2:6810/2871329884,v1:172.21.15.2:6811/2871329884]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:07:27.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:27 smithi099 ceph-mon[77412]: osdmap e55: 6 total, 5 up, 6 in 2024-09-17T01:07:27.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:27 smithi099 ceph-mon[77412]: from='osd.1 [v2:172.21.15.2:6810/2871329884,v1:172.21.15.2:6811/2871329884]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-17T01:07:27.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:27 smithi099 ceph-mon[77412]: from='osd.1 [v2:172.21.15.2:6810/2871329884,v1:172.21.15.2:6811/2871329884]' entity='osd.1' 2024-09-17T01:07:27.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:27 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:27.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:27 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:27.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:27 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:27.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:27 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:07:27.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:27 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:28 smithi002 ceph-mon[98018]: pgmap v72: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 55/354 objects degraded (15.537%) 2024-09-17T01:07:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:28 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:28 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:28 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:28 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:28 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:07:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:28 smithi002 ceph-mon[98018]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:07:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:28 smithi002 ceph-mon[98018]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-17T01:07:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:28 smithi002 ceph-mon[98018]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:07:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:28 smithi002 ceph-mon[98018]: osd.1 [v2:172.21.15.2:6810/2871329884,v1:172.21.15.2:6811/2871329884] boot 2024-09-17T01:07:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:28 smithi002 ceph-mon[98018]: osdmap e56: 6 total, 6 up, 6 in 2024-09-17T01:07:28.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:28 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:07:28.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:28 smithi099 ceph-mon[77412]: pgmap v72: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 55/354 objects degraded (15.537%) 2024-09-17T01:07:28.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:28 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:28.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:28 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:28 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:28 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:28.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:28 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:07:28.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:28 smithi099 ceph-mon[77412]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:07:28.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:28 smithi099 ceph-mon[77412]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-17T01:07:28.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:28 smithi099 ceph-mon[77412]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:07:28.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:28 smithi099 ceph-mon[77412]: osd.1 [v2:172.21.15.2:6810/2871329884,v1:172.21.15.2:6811/2871329884] boot 2024-09-17T01:07:28.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:28 smithi099 ceph-mon[77412]: osdmap e56: 6 total, 6 up, 6 in 2024-09-17T01:07:28.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:28 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:07:30.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:29 smithi099 ceph-mon[77412]: osdmap e57: 6 total, 6 up, 6 in 2024-09-17T01:07:30.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:29 smithi002 ceph-mon[98018]: osdmap e57: 6 total, 6 up, 6 in 2024-09-17T01:07:31.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:30 smithi099 ceph-mon[77412]: pgmap v75: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 55/354 objects degraded (15.537%) 2024-09-17T01:07:31.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:30 smithi002 ceph-mon[98018]: pgmap v75: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 55/354 objects degraded (15.537%) 2024-09-17T01:07:32.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:31 smithi099 ceph-mon[77412]: Health check update: Degraded data redundancy: 24/354 objects degraded (6.780%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:07:32.311 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:31 smithi002 ceph-mon[98018]: Health check update: Degraded data redundancy: 24/354 objects degraded (6.780%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:07:33.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:32 smithi099 ceph-mon[77412]: pgmap v76: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 24/354 objects degraded (6.780%) 2024-09-17T01:07:33.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:32 smithi002 ceph-mon[98018]: pgmap v76: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 24/354 objects degraded (6.780%) 2024-09-17T01:07:34.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:34 smithi099 ceph-mon[77412]: pgmap v77: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-17T01:07:34.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:34 smithi099 ceph-mon[77412]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/354 objects degraded (6.780%), 7 pgs degraded) 2024-09-17T01:07:34.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:34 smithi002 ceph-mon[98018]: pgmap v77: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-17T01:07:34.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:34 smithi002 ceph-mon[98018]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/354 objects degraded (6.780%), 7 pgs degraded) 2024-09-17T01:07:36.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:36 smithi002 ceph-mon[98018]: pgmap v78: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T01:07:36.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:36 smithi099 ceph-mon[77412]: pgmap v78: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-17T01:07:38.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:38 smithi002 ceph-mon[98018]: pgmap v79: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:07:38.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:38 smithi099 ceph-mon[77412]: pgmap v79: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:07:40.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:40 smithi002 ceph-mon[98018]: pgmap v80: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:07:40.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:40 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:40.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:40 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:40.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:40 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:40.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:40 smithi099 ceph-mon[77412]: pgmap v80: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:07:40.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:40 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:40.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:40 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:40.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:40 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:42.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:42 smithi002 ceph-mon[98018]: pgmap v81: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-17T01:07:42.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:42 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:07:42.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:42 smithi099 ceph-mon[77412]: pgmap v81: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-17T01:07:42.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:42 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:07:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:43 smithi002 ceph-mon[98018]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:07:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:43 smithi002 ceph-mon[98018]: Upgrade: osd.2 is safe to restart 2024-09-17T01:07:43.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:43 smithi099 ceph-mon[77412]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:07:43.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:43 smithi099 ceph-mon[77412]: Upgrade: osd.2 is safe to restart 2024-09-17T01:07:45.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:44 smithi099 ceph-mon[77412]: pgmap v82: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:07:45.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:44 smithi099 ceph-mon[77412]: Upgrade: Updating osd.2 2024-09-17T01:07:45.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:44 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:45.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:44 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:07:45.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:44 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:45.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:44 smithi099 ceph-mon[77412]: Deploying daemon osd.2 on smithi002 2024-09-17T01:07:45.096 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:44 smithi002 ceph-mon[98018]: pgmap v82: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:07:45.096 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:44 smithi002 ceph-mon[98018]: Upgrade: Updating osd.2 2024-09-17T01:07:45.096 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:44 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:45.096 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:44 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:07:45.096 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:44 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:07:45.096 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:44 smithi002 ceph-mon[98018]: Deploying daemon osd.2 on smithi002 2024-09-17T01:07:46.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:46 smithi002 ceph-mon[98018]: pgmap v83: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:07:46.905 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:46 smithi002 systemd[1]: Stopping Ceph osd.2 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:07:47.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:46 smithi099 ceph-mon[77412]: pgmap v83: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:07:47.405 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:46 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2[60611]: 2024-09-17T01:07:46.952+0000 7fde83d91640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:07:47.405 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:46 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2[60611]: 2024-09-17T01:07:46.952+0000 7fde83d91640 -1 osd.2 57 *** Got signal Terminated *** 2024-09-17T01:07:47.405 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:46 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2[60611]: 2024-09-17T01:07:46.952+0000 7fde83d91640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:07:48.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:47 smithi099 ceph-mon[77412]: osd.2 marked itself down and dead 2024-09-17T01:07:48.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:47 smithi002 ceph-mon[98018]: osd.2 marked itself down and dead 2024-09-17T01:07:48.518 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:48 smithi002 podman[120057]: 2024-09-17 01:07:48.23347297 +0000 UTC m=+1.372352997 container died 5dff1cf9fc565783fffe54b504ff269166b2fdf8a014b267a24427c5f154f564 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=quincy-4a70413, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-17T01:07:48.868 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:48 smithi002 ceph-mon[98018]: pgmap v84: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:07:48.868 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:48 smithi002 ceph-mon[98018]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:07:48.868 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:48 smithi002 ceph-mon[98018]: osdmap e58: 6 total, 5 up, 6 in 2024-09-17T01:07:48.868 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:48 smithi002 podman[120057]: 2024-09-17 01:07:48.618928495 +0000 UTC m=+1.757808516 container cleanup 5dff1cf9fc565783fffe54b504ff269166b2fdf8a014b267a24427c5f154f564 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=quincy-4a70413, maintainer=Guillaume Abrioux ) 2024-09-17T01:07:48.868 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:48 smithi002 bash[120057]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2 2024-09-17T01:07:49.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:48 smithi099 ceph-mon[77412]: pgmap v84: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:07:49.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:48 smithi099 ceph-mon[77412]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:07:49.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:48 smithi099 ceph-mon[77412]: osdmap e58: 6 total, 5 up, 6 in 2024-09-17T01:07:49.155 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:48 smithi002 podman[120071]: 2024-09-17 01:07:48.870736857 +0000 UTC m=+0.639249073 container remove 5dff1cf9fc565783fffe54b504ff269166b2fdf8a014b267a24427c5f154f564 (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2, RELEASE=quincy-4a70413, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:07:49.588 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:49 smithi002 podman[120162]: 2024-09-17 01:07:49.107470127 +0000 UTC m=+0.016352937 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:07:49.588 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:49 smithi002 podman[120162]: 2024-09-17 01:07:49.213283199 +0000 UTC m=+0.122165999 container create 6a0881458c75e8048351439cd2336c6fe3737094b7d91a7859130f2243c47c11 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-17T01:07:49.588 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:49 smithi002 podman[120162]: 2024-09-17 01:07:49.590941031 +0000 UTC m=+0.499823841 container init 6a0881458c75e8048351439cd2336c6fe3737094b7d91a7859130f2243c47c11 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS) 2024-09-17T01:07:49.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:49 smithi002 ceph-mon[98018]: osdmap e59: 6 total, 5 up, 6 in 2024-09-17T01:07:49.905 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:49 smithi002 podman[120162]: 2024-09-17 01:07:49.594497819 +0000 UTC m=+0.503380619 container start 6a0881458c75e8048351439cd2336c6fe3737094b7d91a7859130f2243c47c11 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0) 2024-09-17T01:07:49.905 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:49 smithi002 podman[120162]: 2024-09-17 01:07:49.665881325 +0000 UTC m=+0.574764126 container attach 6a0881458c75e8048351439cd2336c6fe3737094b7d91a7859130f2243c47c11 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:07:49.905 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:49 smithi002 podman[120162]: 2024-09-17 01:07:49.795665733 +0000 UTC m=+0.704548538 container died 6a0881458c75e8048351439cd2336c6fe3737094b7d91a7859130f2243c47c11 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:07:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:49 smithi099 ceph-mon[77412]: osdmap e59: 6 total, 5 up, 6 in 2024-09-17T01:07:50.613 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:50 smithi002 podman[120184]: 2024-09-17 01:07:50.36170971 +0000 UTC m=+0.559733831 container remove 6a0881458c75e8048351439cd2336c6fe3737094b7d91a7859130f2243c47c11 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-17T01:07:50.613 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:50 smithi002 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-17T01:07:50.613 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:50 smithi002 systemd[1]: Stopped Ceph osd.2 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:07:50.613 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:50 smithi002 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.2.service: Consumed 51.289s CPU time. 2024-09-17T01:07:50.877 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:50 smithi002 ceph-mon[98018]: pgmap v87: 65 pgs: 9 stale+active+clean, 56 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:07:50.877 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:50 smithi002 systemd[1]: Starting Ceph osd.2 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:07:50.877 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:50 smithi002 podman[120285]: 2024-09-17 01:07:50.731457035 +0000 UTC m=+0.016354388 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:07:50.877 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:50 smithi002 podman[120285]: 2024-09-17 01:07:50.879625143 +0000 UTC m=+0.164522544 container create 57ade43bd782e27b812bae5badc21a96a73298315d5239a98f7f36f68c595128 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-17T01:07:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:50 smithi099 ceph-mon[77412]: pgmap v87: 65 pgs: 9 stale+active+clean, 56 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:07:51.155 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:51 smithi002 podman[120285]: 2024-09-17 01:07:51.124062242 +0000 UTC m=+0.408959595 container init 57ade43bd782e27b812bae5badc21a96a73298315d5239a98f7f36f68c595128 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:07:51.155 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:51 smithi002 podman[120285]: 2024-09-17 01:07:51.127564438 +0000 UTC m=+0.412461791 container start 57ade43bd782e27b812bae5badc21a96a73298315d5239a98f7f36f68c595128 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-17T01:07:51.655 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:51 smithi002 podman[120285]: 2024-09-17 01:07:51.207171813 +0000 UTC m=+0.492069175 container attach 57ade43bd782e27b812bae5badc21a96a73298315d5239a98f7f36f68c595128 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-17T01:07:51.655 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:51 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate[120299]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:07:51.655 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:51 smithi002 bash[120285]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:07:51.655 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:51 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate[120299]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:07:51.655 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:51 smithi002 bash[120285]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:07:52.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:51 smithi002 ceph-mon[98018]: Health check failed: Degraded data redundancy: 28/354 objects degraded (7.910%), 10 pgs degraded (PG_DEGRADED) 2024-09-17T01:07:52.156 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate[120299]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:07:52.156 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 bash[120285]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:07:52.156 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate[120299]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:07:52.156 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 bash[120285]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:07:52.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:51 smithi099 ceph-mon[77412]: Health check failed: Degraded data redundancy: 28/354 objects degraded (7.910%), 10 pgs degraded (PG_DEGRADED) 2024-09-17T01:07:52.609 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate[120299]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:07:52.609 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 bash[120285]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:07:52.609 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate[120299]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:07:52.609 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 bash[120285]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:07:52.609 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate[120299]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-17T01:07:52.609 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 bash[120285]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-17T01:07:52.609 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate[120299]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:07:52.609 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 bash[120285]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:07:52.609 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate[120299]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-17T01:07:52.609 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 bash[120285]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-17T01:07:52.610 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 podman[120285]: 2024-09-17 01:07:52.324437474 +0000 UTC m=+1.609334829 container died 57ade43bd782e27b812bae5badc21a96a73298315d5239a98f7f36f68c595128 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:07:52.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:52 smithi002 ceph-mon[98018]: pgmap v88: 65 pgs: 10 active+undersized, 4 stale+active+clean, 10 active+undersized+degraded, 41 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 28/354 objects degraded (7.910%) 2024-09-17T01:07:53.271 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:52 smithi002 podman[120433]: 2024-09-17 01:07:52.927798413 +0000 UTC m=+0.596599104 container remove 57ade43bd782e27b812bae5badc21a96a73298315d5239a98f7f36f68c595128 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True) 2024-09-17T01:07:53.271 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:53 smithi002 podman[120492]: 2024-09-17 01:07:53.049417175 +0000 UTC m=+0.017166960 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:07:53.271 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:53 smithi002 podman[120492]: 2024-09-17 01:07:53.170710392 +0000 UTC m=+0.138460199 container create 0aac20af558015a4460672d2aa9cb6427f65449727967c98755c635339bb5dd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-17T01:07:53.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:52 smithi099 ceph-mon[77412]: pgmap v88: 65 pgs: 10 active+undersized, 4 stale+active+clean, 10 active+undersized+degraded, 41 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 28/354 objects degraded (7.910%) 2024-09-17T01:07:53.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.451+0000 7f87a2068640 1 -- 172.21.15.2:0/2409977426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f879c0fe450 msgr2=0x7f879c0fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:53.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.451+0000 7f87a2068640 1 --2- 172.21.15.2:0/2409977426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f879c0fe450 0x7f879c0fe820 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f878c0048d0 tx=0x7f878c009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.452+0000 7f87a2068640 1 -- 172.21.15.2:0/2409977426 shutdown_connections 2024-09-17T01:07:53.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.452+0000 7f87a2068640 1 --2- 172.21.15.2:0/2409977426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f879c064fe0 0x7f879c065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.452+0000 7f87a2068640 1 --2- 172.21.15.2:0/2409977426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f879c0fe450 0x7f879c0fe820 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.452+0000 7f87a2068640 1 -- 172.21.15.2:0/2409977426 >> 172.21.15.2:0/2409977426 conn(0x7f879c0723b0 msgr2=0x7f879c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.452+0000 7f87a2068640 1 -- 172.21.15.2:0/2409977426 shutdown_connections 2024-09-17T01:07:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.452+0000 7f87a2068640 1 -- 172.21.15.2:0/2409977426 wait complete. 2024-09-17T01:07:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.452+0000 7f87a2068640 1 Processor -- start 2024-09-17T01:07:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.452+0000 7f87a2068640 1 -- start start 2024-09-17T01:07:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.453+0000 7f87a2068640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f879c064fe0 0x7f879c113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.453+0000 7f87a2068640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f879c0fe450 0x7f879c113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.453+0000 7f87a2068640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c113d50 con 0x7f879c064fe0 2024-09-17T01:07:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.453+0000 7f87a2068640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c10d190 con 0x7f879c0fe450 2024-09-17T01:07:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.453+0000 7f879b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f879c064fe0 0x7f879c113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.453+0000 7f879b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f879c064fe0 0x7f879c113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58824/0 (socket says 172.21.15.2:58824) 2024-09-17T01:07:53.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.453+0000 7f879b7fe640 1 -- 172.21.15.2:0/2183924633 learned_addr learned my addr 172.21.15.2:0/2183924633 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:07:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.453+0000 7f879affd640 1 --2- 172.21.15.2:0/2183924633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f879c0fe450 0x7f879c113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.453+0000 7f879b7fe640 1 -- 172.21.15.2:0/2183924633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f879c0fe450 msgr2=0x7f879c113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.453+0000 7f879b7fe640 1 --2- 172.21.15.2:0/2183924633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f879c0fe450 0x7f879c113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.453+0000 7f879b7fe640 1 -- 172.21.15.2:0/2183924633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c005040 con 0x7f879c064fe0 2024-09-17T01:07:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.453+0000 7f879b7fe640 1 --2- 172.21.15.2:0/2183924633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f879c064fe0 0x7f879c113210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f878c003080 tx=0x7f878c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.453+0000 7f8783fff640 1 -- 172.21.15.2:0/2183924633 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f878c038070 con 0x7f879c064fe0 2024-09-17T01:07:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.454+0000 7f87a2068640 1 -- 172.21.15.2:0/2183924633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c10d410 con 0x7f879c064fe0 2024-09-17T01:07:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.454+0000 7f8783fff640 1 -- 172.21.15.2:0/2183924633 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f878c02ade0 con 0x7f879c064fe0 2024-09-17T01:07:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.454+0000 7f8783fff640 1 -- 172.21.15.2:0/2183924633 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f878c02c880 con 0x7f879c064fe0 2024-09-17T01:07:53.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.454+0000 7f87a2068640 1 -- 172.21.15.2:0/2183924633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c10d870 con 0x7f879c064fe0 2024-09-17T01:07:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.455+0000 7f87a2068640 1 -- 172.21.15.2:0/2183924633 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c0fdce0 con 0x7f879c064fe0 2024-09-17T01:07:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.455+0000 7f8783fff640 1 -- 172.21.15.2:0/2183924633 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f878c030020 con 0x7f879c064fe0 2024-09-17T01:07:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.456+0000 7f8783fff640 1 --2- 172.21.15.2:0/2183924633 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f878406e530 0x7f87840709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.456+0000 7f8783fff640 1 -- 172.21.15.2:0/2183924633 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f878c0ae110 con 0x7f879c064fe0 2024-09-17T01:07:53.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.456+0000 7f879affd640 1 --2- 172.21.15.2:0/2183924633 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f878406e530 0x7f87840709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:53.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.456+0000 7f879affd640 1 --2- 172.21.15.2:0/2183924633 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f878406e530 0x7f87840709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f879c10ead0 tx=0x7f8790004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:53.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.460+0000 7f8783fff640 1 -- 172.21.15.2:0/2183924633 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f878c077250 con 0x7f879c064fe0 2024-09-17T01:07:53.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.669+0000 7f87a2068640 1 -- 172.21.15.2:0/2183924633 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f879c04b7c0 con 0x7f878406e530 2024-09-17T01:07:53.668 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:53 smithi002 podman[120492]: 2024-09-17 01:07:53.414554397 +0000 UTC m=+0.382304174 container init 0aac20af558015a4460672d2aa9cb6427f65449727967c98755c635339bb5dd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-17T01:07:53.668 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:53 smithi002 podman[120492]: 2024-09-17 01:07:53.417993912 +0000 UTC m=+0.385743678 container start 0aac20af558015a4460672d2aa9cb6427f65449727967c98755c635339bb5dd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=) 2024-09-17T01:07:53.668 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:53 smithi002 ceph-osd[120514]: -- 172.21.15.2:0/1041798762 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561207a1a1e0 con 0x561206c2fc00 2024-09-17T01:07:53.668 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:53 smithi002 bash[120492]: 0aac20af558015a4460672d2aa9cb6427f65449727967c98755c635339bb5dd9 2024-09-17T01:07:53.668 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:53 smithi002 systemd[1]: Started Ceph osd.2 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:07:53.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.671+0000 7f8783fff640 1 -- 172.21.15.2:0/2183924633 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f87900049a0 con 0x7f878406e530 2024-09-17T01:07:53.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.673+0000 7f87a2068640 1 -- 172.21.15.2:0/2183924633 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f878406e530 msgr2=0x7f87840709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:53.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.673+0000 7f87a2068640 1 --2- 172.21.15.2:0/2183924633 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f878406e530 0x7f87840709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f879c10ead0 tx=0x7f8790004330 comp rx=0 tx=0).stop 2024-09-17T01:07:53.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.673+0000 7f87a2068640 1 -- 172.21.15.2:0/2183924633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f879c064fe0 msgr2=0x7f879c113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:53.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.673+0000 7f87a2068640 1 --2- 172.21.15.2:0/2183924633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f879c064fe0 0x7f879c113210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f878c003080 tx=0x7f878c009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.673+0000 7f87a2068640 1 -- 172.21.15.2:0/2183924633 shutdown_connections 2024-09-17T01:07:53.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.673+0000 7f87a2068640 1 --2- 172.21.15.2:0/2183924633 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f878406e530 0x7f87840709e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.673+0000 7f87a2068640 1 --2- 172.21.15.2:0/2183924633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f879c0fe450 0x7f879c113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.673+0000 7f87a2068640 1 --2- 172.21.15.2:0/2183924633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f879c064fe0 0x7f879c113210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.673+0000 7f87a2068640 1 -- 172.21.15.2:0/2183924633 >> 172.21.15.2:0/2183924633 conn(0x7f879c0723b0 msgr2=0x7f879c0fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:53.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.674+0000 7f87a2068640 1 -- 172.21.15.2:0/2183924633 shutdown_connections 2024-09-17T01:07:53.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.674+0000 7f87a2068640 1 -- 172.21.15.2:0/2183924633 wait complete. 2024-09-17T01:07:53.681 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:07:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.758+0000 7f2f76afb640 1 -- 172.21.15.2:0/3036917412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f70102530 msgr2=0x7f2f70102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.758+0000 7f2f76afb640 1 --2- 172.21.15.2:0/3036917412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f70102530 0x7f2f70102900 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2f680048d0 tx=0x7f2f68009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.758+0000 7f2f76afb640 1 -- 172.21.15.2:0/3036917412 shutdown_connections 2024-09-17T01:07:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.758+0000 7f2f76afb640 1 --2- 172.21.15.2:0/3036917412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f70102ed0 0x7f2f700fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.758+0000 7f2f76afb640 1 --2- 172.21.15.2:0/3036917412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f70102530 0x7f2f70102900 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.758+0000 7f2f76afb640 1 -- 172.21.15.2:0/3036917412 >> 172.21.15.2:0/3036917412 conn(0x7f2f700f80f0 msgr2=0x7f2f700fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.758+0000 7f2f76afb640 1 -- 172.21.15.2:0/3036917412 shutdown_connections 2024-09-17T01:07:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.758+0000 7f2f76afb640 1 -- 172.21.15.2:0/3036917412 wait complete. 2024-09-17T01:07:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.759+0000 7f2f76afb640 1 Processor -- start 2024-09-17T01:07:53.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.759+0000 7f2f76afb640 1 -- start start 2024-09-17T01:07:53.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.759+0000 7f2f76afb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f70102530 0x7f2f701153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:53.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.759+0000 7f2f76afb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f70102ed0 0x7f2f70115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:53.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.759+0000 7f2f76afb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f70115f20 con 0x7f2f70102530 2024-09-17T01:07:53.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.759+0000 7f2f76afb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f70116090 con 0x7f2f70102ed0 2024-09-17T01:07:53.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.759+0000 7f2f74897640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f70102530 0x7f2f701153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:53.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.759+0000 7f2f6ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f70102ed0 0x7f2f70115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:53.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.759+0000 7f2f74897640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f70102530 0x7f2f701153e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58832/0 (socket says 172.21.15.2:58832) 2024-09-17T01:07:53.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.759+0000 7f2f74897640 1 -- 172.21.15.2:0/2758934977 learned_addr learned my addr 172.21.15.2:0/2758934977 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:07:53.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.760+0000 7f2f74897640 1 -- 172.21.15.2:0/2758934977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f70102ed0 msgr2=0x7f2f70115920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:53.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.760+0000 7f2f74897640 1 --2- 172.21.15.2:0/2758934977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f70102ed0 0x7f2f70115920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.760+0000 7f2f74897640 1 -- 172.21.15.2:0/2758934977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f68005040 con 0x7f2f70102530 2024-09-17T01:07:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.760+0000 7f2f6ffff640 1 --2- 172.21.15.2:0/2758934977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f70102ed0 0x7f2f70115920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:07:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.760+0000 7f2f74897640 1 --2- 172.21.15.2:0/2758934977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f70102530 0x7f2f701153e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2f680043d0 tx=0x7f2f68009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.760+0000 7f2f6d7fa640 1 -- 172.21.15.2:0/2758934977 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f68038070 con 0x7f2f70102530 2024-09-17T01:07:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.760+0000 7f2f6d7fa640 1 -- 172.21.15.2:0/2758934977 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2f680096e0 con 0x7f2f70102530 2024-09-17T01:07:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.760+0000 7f2f76afb640 1 -- 172.21.15.2:0/2758934977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7010f4b0 con 0x7f2f70102530 2024-09-17T01:07:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.760+0000 7f2f6d7fa640 1 -- 172.21.15.2:0/2758934977 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f6803d420 con 0x7f2f70102530 2024-09-17T01:07:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.760+0000 7f2f76afb640 1 -- 172.21.15.2:0/2758934977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7010f980 con 0x7f2f70102530 2024-09-17T01:07:53.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.761+0000 7f2f76afb640 1 -- 172.21.15.2:0/2758934977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f700fdcb0 con 0x7f2f70102530 2024-09-17T01:07:53.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.762+0000 7f2f6d7fa640 1 -- 172.21.15.2:0/2758934977 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f2f68030020 con 0x7f2f70102530 2024-09-17T01:07:53.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.762+0000 7f2f6d7fa640 1 --2- 172.21.15.2:0/2758934977 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2f5c06e530 0x7f2f5c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:53.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.763+0000 7f2f6d7fa640 1 -- 172.21.15.2:0/2758934977 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2f680ae5f0 con 0x7f2f70102530 2024-09-17T01:07:53.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.763+0000 7f2f6ffff640 1 --2- 172.21.15.2:0/2758934977 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2f5c06e530 0x7f2f5c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:53.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.763+0000 7f2f6ffff640 1 --2- 172.21.15.2:0/2758934977 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2f5c06e530 0x7f2f5c0709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f70110ce0 tx=0x7f2f60009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:53.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.767+0000 7f2f6d7fa640 1 -- 172.21.15.2:0/2758934977 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2f68077730 con 0x7f2f70102530 2024-09-17T01:07:53.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.980+0000 7f2f76afb640 1 -- 172.21.15.2:0/2758934977 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f70110a90 con 0x7f2f5c06e530 2024-09-17T01:07:53.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.981+0000 7f2f6d7fa640 1 -- 172.21.15.2:0/2758934977 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2f70110a90 con 0x7f2f5c06e530 2024-09-17T01:07:53.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.984+0000 7f2f76afb640 1 -- 172.21.15.2:0/2758934977 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2f5c06e530 msgr2=0x7f2f5c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:53.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.984+0000 7f2f76afb640 1 --2- 172.21.15.2:0/2758934977 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2f5c06e530 0x7f2f5c0709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f70110ce0 tx=0x7f2f60009040 comp rx=0 tx=0).stop 2024-09-17T01:07:53.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.984+0000 7f2f76afb640 1 -- 172.21.15.2:0/2758934977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f70102530 msgr2=0x7f2f701153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:53.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.984+0000 7f2f76afb640 1 --2- 172.21.15.2:0/2758934977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f70102530 0x7f2f701153e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2f680043d0 tx=0x7f2f68009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.984+0000 7f2f76afb640 1 -- 172.21.15.2:0/2758934977 shutdown_connections 2024-09-17T01:07:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.984+0000 7f2f76afb640 1 --2- 172.21.15.2:0/2758934977 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f2f5c06e530 0x7f2f5c0709e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.984+0000 7f2f76afb640 1 --2- 172.21.15.2:0/2758934977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f70102ed0 0x7f2f70115920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.984+0000 7f2f76afb640 1 --2- 172.21.15.2:0/2758934977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f70102530 0x7f2f701153e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.984+0000 7f2f76afb640 1 -- 172.21.15.2:0/2758934977 >> 172.21.15.2:0/2758934977 conn(0x7f2f700f80f0 msgr2=0x7f2f700f8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.984+0000 7f2f76afb640 1 -- 172.21.15.2:0/2758934977 shutdown_connections 2024-09-17T01:07:53.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:53.984+0000 7f2f76afb640 1 -- 172.21.15.2:0/2758934977 wait complete. 2024-09-17T01:07:54.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.071+0000 7f40a68b2640 1 -- 172.21.15.2:0/1956263279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40a01014d0 msgr2=0x7f40a01018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:54.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.071+0000 7f40a68b2640 1 --2- 172.21.15.2:0/1956263279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40a01014d0 0x7f40a01018a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f40900048d0 tx=0x7f4090009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.071+0000 7f40a68b2640 1 -- 172.21.15.2:0/1956263279 shutdown_connections 2024-09-17T01:07:54.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.071+0000 7f40a68b2640 1 --2- 172.21.15.2:0/1956263279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40a00fb490 0x7f40a00fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.071+0000 7f40a68b2640 1 --2- 172.21.15.2:0/1956263279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40a01014d0 0x7f40a01018a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.071+0000 7f40a68b2640 1 -- 172.21.15.2:0/1956263279 >> 172.21.15.2:0/1956263279 conn(0x7f40a00f7010 msgr2=0x7f40a00f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:54.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.071+0000 7f40a68b2640 1 -- 172.21.15.2:0/1956263279 shutdown_connections 2024-09-17T01:07:54.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.071+0000 7f40a68b2640 1 -- 172.21.15.2:0/1956263279 wait complete. 2024-09-17T01:07:54.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.072+0000 7f40a68b2640 1 Processor -- start 2024-09-17T01:07:54.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.072+0000 7f40a68b2640 1 -- start start 2024-09-17T01:07:54.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.072+0000 7f40a68b2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40a00fb490 0x7f40a01131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:54.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.072+0000 7f40a68b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40a01014d0 0x7f40a0113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:54.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.072+0000 7f40a68b2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a0113d30 con 0x7f40a01014d0 2024-09-17T01:07:54.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.072+0000 7f40a68b2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a010d170 con 0x7f40a00fb490 2024-09-17T01:07:54.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.072+0000 7f409f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40a01014d0 0x7f40a0113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:54.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.072+0000 7f409ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40a00fb490 0x7f40a01131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:54.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.072+0000 7f409f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40a01014d0 0x7f40a0113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58854/0 (socket says 172.21.15.2:58854) 2024-09-17T01:07:54.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.072+0000 7f409f7fe640 1 -- 172.21.15.2:0/4161543982 learned_addr learned my addr 172.21.15.2:0/4161543982 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:07:54.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.073+0000 7f409ffff640 1 -- 172.21.15.2:0/4161543982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40a01014d0 msgr2=0x7f40a0113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:54.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.073+0000 7f409ffff640 1 --2- 172.21.15.2:0/4161543982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40a01014d0 0x7f40a0113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.073+0000 7f409ffff640 1 -- 172.21.15.2:0/4161543982 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4090005040 con 0x7f40a00fb490 2024-09-17T01:07:54.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.073+0000 7f409f7fe640 1 --2- 172.21.15.2:0/4161543982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40a01014d0 0x7f40a0113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:07:54.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.073+0000 7f409ffff640 1 --2- 172.21.15.2:0/4161543982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40a00fb490 0x7f40a01131f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f409002a530 tx=0x7f4090009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:54.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.073+0000 7f409cff9640 1 -- 172.21.15.2:0/4161543982 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f409003c070 con 0x7f40a00fb490 2024-09-17T01:07:54.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.073+0000 7f409cff9640 1 -- 172.21.15.2:0/4161543982 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f409002ade0 con 0x7f40a00fb490 2024-09-17T01:07:54.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.073+0000 7f40a68b2640 1 -- 172.21.15.2:0/4161543982 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a010d3f0 con 0x7f40a00fb490 2024-09-17T01:07:54.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.073+0000 7f409cff9640 1 -- 172.21.15.2:0/4161543982 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f409002c070 con 0x7f40a00fb490 2024-09-17T01:07:54.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.073+0000 7f40a68b2640 1 -- 172.21.15.2:0/4161543982 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a010d930 con 0x7f40a00fb490 2024-09-17T01:07:54.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.074+0000 7f40a68b2640 1 -- 172.21.15.2:0/4161543982 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a00fcbd0 con 0x7f40a00fb490 2024-09-17T01:07:54.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.075+0000 7f409cff9640 1 -- 172.21.15.2:0/4161543982 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f4090030020 con 0x7f40a00fb490 2024-09-17T01:07:54.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.075+0000 7f409cff9640 1 --2- 172.21.15.2:0/4161543982 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f408806e530 0x7f40880709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:54.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.075+0000 7f409cff9640 1 -- 172.21.15.2:0/4161543982 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f40900b2970 con 0x7f40a00fb490 2024-09-17T01:07:54.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.075+0000 7f409f7fe640 1 --2- 172.21.15.2:0/4161543982 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f408806e530 0x7f40880709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.076+0000 7f409f7fe640 1 --2- 172.21.15.2:0/4161543982 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f408806e530 0x7f40880709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f40a010eab0 tx=0x7f409400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:54.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.080+0000 7f409cff9640 1 -- 172.21.15.2:0/4161543982 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f409007bad0 con 0x7f40a00fb490 2024-09-17T01:07:54.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.269+0000 7f40a68b2640 1 -- 172.21.15.2:0/4161543982 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f40a004b720 con 0x7f408806e530 2024-09-17T01:07:54.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.278+0000 7f409cff9640 1 -- 172.21.15.2:0/4161543982 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f40a004b720 con 0x7f408806e530 2024-09-17T01:07:54.277 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:07:54.277 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (4m) 31s ago 13m 25.3M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:07:54.277 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (97s) 31s ago 14m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de b7ed6c8d5a92 2024-09-17T01:07:54.278 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (92s) 89s ago 13m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de ae713b940078 2024-09-17T01:07:54.278 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (3m) 31s ago 13m 77.8M - 9.4.12 2bacad6d85d8 5fe408c103d6 2024-09-17T01:07:54.278 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (8m) 31s ago 8m 124M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:07:54.278 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (8m) 31s ago 8m 65.1M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:07:54.278 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (8m) 89s ago 8m 64.8M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:07:54.278 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (8m) 89s ago 8m 115M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:07:54.278 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (4m) 31s ago 15m 496M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:07:54.278 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (4m) 89s ago 12m 439M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:07:54.278 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (2m) 31s ago 15m 44.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de da5247385c2d 2024-09-17T01:07:54.278 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (2m) 89s ago 12m 33.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b92f98b2cab9 2024-09-17T01:07:54.278 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (5m) 31s ago 13m 15.6M - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:07:54.278 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (4m) 89s ago 13m 16.1M - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:07:54.279 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (72s) 31s ago 12m 92.7M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 563188d6089b 2024-09-17T01:07:54.279 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (36s) 31s ago 11m 12.1M 1558M 19.1.1-330-gc2ddf972 ebb0615149de cc26caf558d7 2024-09-17T01:07:54.279 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 starting - - - 1558M 2024-09-17T01:07:54.279 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (10m) 89s ago 10m 273M 2581M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:07:54.279 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (10m) 89s ago 10m 240M 2581M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:07:54.279 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (10m) 89s ago 10m 222M 2581M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:07:54.279 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (4m) 31s ago 13m 63.9M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:07:54.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.281+0000 7f40a68b2640 1 -- 172.21.15.2:0/4161543982 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f408806e530 msgr2=0x7f40880709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:54.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.281+0000 7f40a68b2640 1 --2- 172.21.15.2:0/4161543982 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f408806e530 0x7f40880709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f40a010eab0 tx=0x7f409400b040 comp rx=0 tx=0).stop 2024-09-17T01:07:54.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.281+0000 7f40a68b2640 1 -- 172.21.15.2:0/4161543982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40a00fb490 msgr2=0x7f40a01131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:54.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.281+0000 7f40a68b2640 1 --2- 172.21.15.2:0/4161543982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40a00fb490 0x7f40a01131f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f409002a530 tx=0x7f4090009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.281+0000 7f40a68b2640 1 -- 172.21.15.2:0/4161543982 shutdown_connections 2024-09-17T01:07:54.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.281+0000 7f40a68b2640 1 --2- 172.21.15.2:0/4161543982 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f408806e530 0x7f40880709e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.281+0000 7f40a68b2640 1 --2- 172.21.15.2:0/4161543982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40a01014d0 0x7f40a0113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.281+0000 7f40a68b2640 1 --2- 172.21.15.2:0/4161543982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40a00fb490 0x7f40a01131f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.281+0000 7f40a68b2640 1 -- 172.21.15.2:0/4161543982 >> 172.21.15.2:0/4161543982 conn(0x7f40a00f7010 msgr2=0x7f40a00f73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:54.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.281+0000 7f40a68b2640 1 -- 172.21.15.2:0/4161543982 shutdown_connections 2024-09-17T01:07:54.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.281+0000 7f40a68b2640 1 -- 172.21.15.2:0/4161543982 wait complete. 2024-09-17T01:07:54.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.363+0000 7f4f57cd7640 1 -- 172.21.15.2:0/2043435045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f50070340 msgr2=0x7f4f50108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:54.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.363+0000 7f4f57cd7640 1 --2- 172.21.15.2:0/2043435045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f50070340 0x7f4f50108910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4f400048d0 tx=0x7f4f40009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.363+0000 7f4f57cd7640 1 -- 172.21.15.2:0/2043435045 shutdown_connections 2024-09-17T01:07:54.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.363+0000 7f4f57cd7640 1 --2- 172.21.15.2:0/2043435045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f50070340 0x7f4f50108910 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.363+0000 7f4f57cd7640 1 --2- 172.21.15.2:0/2043435045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f5006fa30 0x7f4f5006fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.363+0000 7f4f57cd7640 1 -- 172.21.15.2:0/2043435045 >> 172.21.15.2:0/2043435045 conn(0x7f4f500f80f0 msgr2=0x7f4f500fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:54.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.363+0000 7f4f57cd7640 1 -- 172.21.15.2:0/2043435045 shutdown_connections 2024-09-17T01:07:54.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.363+0000 7f4f57cd7640 1 -- 172.21.15.2:0/2043435045 wait complete. 2024-09-17T01:07:54.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.364+0000 7f4f57cd7640 1 Processor -- start 2024-09-17T01:07:54.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.364+0000 7f4f57cd7640 1 -- start start 2024-09-17T01:07:54.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.364+0000 7f4f57cd7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f5006fa30 0x7f4f501157b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:54.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.364+0000 7f4f57cd7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f50070340 0x7f4f50115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:54.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.364+0000 7f4f57cd7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f50116340 con 0x7f4f5006fa30 2024-09-17T01:07:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.364+0000 7f4f57cd7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5010f750 con 0x7f4f50070340 2024-09-17T01:07:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.364+0000 7f4f55a73640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f5006fa30 0x7f4f501157b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.364+0000 7f4f55a73640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f5006fa30 0x7f4f501157b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58868/0 (socket says 172.21.15.2:58868) 2024-09-17T01:07:54.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.364+0000 7f4f55a73640 1 -- 172.21.15.2:0/489126751 learned_addr learned my addr 172.21.15.2:0/489126751 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:07:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.364+0000 7f4f55272640 1 --2- 172.21.15.2:0/489126751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f50070340 0x7f4f50115cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.364+0000 7f4f55a73640 1 -- 172.21.15.2:0/489126751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f50070340 msgr2=0x7f4f50115cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.365+0000 7f4f55a73640 1 --2- 172.21.15.2:0/489126751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f50070340 0x7f4f50115cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.365+0000 7f4f55a73640 1 -- 172.21.15.2:0/489126751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f40005040 con 0x7f4f5006fa30 2024-09-17T01:07:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.365+0000 7f4f55a73640 1 --2- 172.21.15.2:0/489126751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f5006fa30 0x7f4f501157b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00eb70 tx=0x7f4f4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.365+0000 7f4f467fc640 1 -- 172.21.15.2:0/489126751 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f4c007c30 con 0x7f4f5006fa30 2024-09-17T01:07:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.365+0000 7f4f57cd7640 1 -- 172.21.15.2:0/489126751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5010f9d0 con 0x7f4f5006fa30 2024-09-17T01:07:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.365+0000 7f4f467fc640 1 -- 172.21.15.2:0/489126751 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4f4c00f040 con 0x7f4f5006fa30 2024-09-17T01:07:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.365+0000 7f4f467fc640 1 -- 172.21.15.2:0/489126751 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f4c00ca60 con 0x7f4f5006fa30 2024-09-17T01:07:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.365+0000 7f4f57cd7640 1 -- 172.21.15.2:0/489126751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5010fec0 con 0x7f4f5006fa30 2024-09-17T01:07:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.366+0000 7f4f57cd7640 1 -- 172.21.15.2:0/489126751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f50071170 con 0x7f4f5006fa30 2024-09-17T01:07:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.367+0000 7f4f467fc640 1 -- 172.21.15.2:0/489126751 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f4f4c00cbc0 con 0x7f4f5006fa30 2024-09-17T01:07:54.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.367+0000 7f4f467fc640 1 --2- 172.21.15.2:0/489126751 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4f3c06e530 0x7f4f3c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:54.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.367+0000 7f4f467fc640 1 -- 172.21.15.2:0/489126751 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f4f4c08de30 con 0x7f4f5006fa30 2024-09-17T01:07:54.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.367+0000 7f4f55272640 1 --2- 172.21.15.2:0/489126751 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4f3c06e530 0x7f4f3c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:54.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.368+0000 7f4f55272640 1 --2- 172.21.15.2:0/489126751 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4f3c06e530 0x7f4f3c0709e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f50110b70 tx=0x7f4f40035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:54.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.371+0000 7f4f467fc640 1 -- 172.21.15.2:0/489126751 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4f4c056f70 con 0x7f4f5006fa30 2024-09-17T01:07:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.620+0000 7f4f57cd7640 1 -- 172.21.15.2:0/489126751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4f5010b780 con 0x7f4f5006fa30 2024-09-17T01:07:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.620+0000 7f4f467fc640 1 -- 172.21.15.2:0/489126751 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f4f4c05a630 con 0x7f4f5006fa30 2024-09-17T01:07:54.620 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:07:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:07:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:07:54.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:07:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:07:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:07:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:07:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:07:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 3, 2024-09-17T01:07:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:07:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:07:54.621 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:07:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:07:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:07:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:07:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 7, 2024-09-17T01:07:54.622 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:07:54.623 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:07:54.623 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:07:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.622+0000 7f4f57cd7640 1 -- 172.21.15.2:0/489126751 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4f3c06e530 msgr2=0x7f4f3c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.622+0000 7f4f57cd7640 1 --2- 172.21.15.2:0/489126751 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4f3c06e530 0x7f4f3c0709e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f50110b70 tx=0x7f4f40035040 comp rx=0 tx=0).stop 2024-09-17T01:07:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.622+0000 7f4f57cd7640 1 -- 172.21.15.2:0/489126751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f5006fa30 msgr2=0x7f4f501157b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.622+0000 7f4f57cd7640 1 --2- 172.21.15.2:0/489126751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f5006fa30 0x7f4f501157b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00eb70 tx=0x7f4f4c00b040 comp rx=0 tx=0).stop 2024-09-17T01:07:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.623+0000 7f4f57cd7640 1 -- 172.21.15.2:0/489126751 shutdown_connections 2024-09-17T01:07:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.623+0000 7f4f57cd7640 1 --2- 172.21.15.2:0/489126751 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4f3c06e530 0x7f4f3c0709e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.623+0000 7f4f57cd7640 1 --2- 172.21.15.2:0/489126751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f50070340 0x7f4f50115cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.623+0000 7f4f57cd7640 1 --2- 172.21.15.2:0/489126751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f5006fa30 0x7f4f501157b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.623+0000 7f4f57cd7640 1 -- 172.21.15.2:0/489126751 >> 172.21.15.2:0/489126751 conn(0x7f4f500f80f0 msgr2=0x7f4f500f9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.623+0000 7f4f57cd7640 1 -- 172.21.15.2:0/489126751 shutdown_connections 2024-09-17T01:07:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.623+0000 7f4f57cd7640 1 -- 172.21.15.2:0/489126751 wait complete. 2024-09-17T01:07:54.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.706+0000 7faba89ce640 1 -- 172.21.15.2:0/2690522360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fe450 msgr2=0x7faba40fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:54.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.706+0000 7faba89ce640 1 --2- 172.21.15.2:0/2690522360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fe450 0x7faba40fe820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fab940048d0 tx=0x7fab94009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.707+0000 7faba89ce640 1 -- 172.21.15.2:0/2690522360 shutdown_connections 2024-09-17T01:07:54.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.707+0000 7faba89ce640 1 --2- 172.21.15.2:0/2690522360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faba4064fe0 0x7faba4065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.707+0000 7faba89ce640 1 --2- 172.21.15.2:0/2690522360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fe450 0x7faba40fe820 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.707+0000 7faba89ce640 1 -- 172.21.15.2:0/2690522360 >> 172.21.15.2:0/2690522360 conn(0x7faba40723b0 msgr2=0x7faba40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:54.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.707+0000 7faba89ce640 1 -- 172.21.15.2:0/2690522360 shutdown_connections 2024-09-17T01:07:54.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.707+0000 7faba89ce640 1 -- 172.21.15.2:0/2690522360 wait complete. 2024-09-17T01:07:54.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.707+0000 7faba89ce640 1 Processor -- start 2024-09-17T01:07:54.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.707+0000 7faba89ce640 1 -- start start 2024-09-17T01:07:54.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.708+0000 7faba89ce640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faba4064fe0 0x7faba4113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:54.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.708+0000 7faba89ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fe450 0x7faba4113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:54.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.708+0000 7faba89ce640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4113d50 con 0x7faba40fe450 2024-09-17T01:07:54.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.708+0000 7faba89ce640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba410d190 con 0x7faba4064fe0 2024-09-17T01:07:54.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.708+0000 7faba1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fe450 0x7faba4113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:54.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.708+0000 7faba1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fe450 0x7faba4113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58890/0 (socket says 172.21.15.2:58890) 2024-09-17T01:07:54.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.708+0000 7faba1d9b640 1 -- 172.21.15.2:0/835548608 learned_addr learned my addr 172.21.15.2:0/835548608 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:07:54.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.708+0000 7faba259c640 1 --2- 172.21.15.2:0/835548608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faba4064fe0 0x7faba4113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:54.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.708+0000 7faba1d9b640 1 -- 172.21.15.2:0/835548608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faba4064fe0 msgr2=0x7faba4113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:54.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.708+0000 7faba1d9b640 1 --2- 172.21.15.2:0/835548608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faba4064fe0 0x7faba4113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.708+0000 7faba1d9b640 1 -- 172.21.15.2:0/835548608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab94005040 con 0x7faba40fe450 2024-09-17T01:07:54.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.708+0000 7faba1d9b640 1 --2- 172.21.15.2:0/835548608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fe450 0x7faba4113750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab98002a50 tx=0x7fab98004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:54.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.708+0000 7fab92ffd640 1 -- 172.21.15.2:0/835548608 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab98007c30 con 0x7faba40fe450 2024-09-17T01:07:54.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.709+0000 7faba89ce640 1 -- 172.21.15.2:0/835548608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba410d470 con 0x7faba40fe450 2024-09-17T01:07:54.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.709+0000 7fab92ffd640 1 -- 172.21.15.2:0/835548608 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fab9800f040 con 0x7faba40fe450 2024-09-17T01:07:54.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.709+0000 7faba89ce640 1 -- 172.21.15.2:0/835548608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba410d990 con 0x7faba40fe450 2024-09-17T01:07:54.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.709+0000 7fab92ffd640 1 -- 172.21.15.2:0/835548608 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab9800da10 con 0x7faba40fe450 2024-09-17T01:07:54.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.710+0000 7faba89ce640 1 -- 172.21.15.2:0/835548608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba40fdce0 con 0x7faba40fe450 2024-09-17T01:07:54.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.710+0000 7fab92ffd640 1 -- 172.21.15.2:0/835548608 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fab9800dc80 con 0x7faba40fe450 2024-09-17T01:07:54.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.711+0000 7fab92ffd640 1 --2- 172.21.15.2:0/835548608 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fab8c06e530 0x7fab8c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:54.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.711+0000 7fab92ffd640 1 -- 172.21.15.2:0/835548608 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fab9808d910 con 0x7faba40fe450 2024-09-17T01:07:54.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.711+0000 7faba259c640 1 --2- 172.21.15.2:0/835548608 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fab8c06e530 0x7fab8c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:54.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.711+0000 7faba259c640 1 --2- 172.21.15.2:0/835548608 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fab8c06e530 0x7fab8c0709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fab94009ac0 tx=0x7fab94035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:54.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.716+0000 7fab92ffd640 1 -- 172.21.15.2:0/835548608 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fab98056b00 con 0x7faba40fe450 2024-09-17T01:07:54.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:54 smithi002 ceph-mon[98018]: pgmap v89: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/354 objects degraded (11.582%) 2024-09-17T01:07:54.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:54 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:54.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:54 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:54.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:54 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:54.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:54 smithi002 ceph-mon[98018]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:54.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:54 smithi002 ceph-mon[98018]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:54.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.962+0000 7faba89ce640 1 -- 172.21.15.2:0/835548608 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faba410e880 con 0x7faba40fe450 2024-09-17T01:07:54.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.962+0000 7fab92ffd640 1 -- 172.21.15.2:0/835548608 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1946 (secure 0 0 0) 0x7fab9805a1c0 con 0x7faba40fe450 2024-09-17T01:07:54.961 INFO:teuthology.orchestra.run.smithi002.stdout:e25 2024-09-17T01:07:54.961 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-17T01:05:48:747321+0000 2024-09-17T01:07:54.961 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:07:54.961 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:07:54.961 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-17T01:07:54.962 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:07:54.962 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:07:54.962 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-17T01:07:54.962 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 25 2024-09-17T01:07:54.962 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:07:54.962 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-17T00:59:20.485696+0000 2024-09-17T01:07:54.962 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-17T01:05:47.816861+0000 2024-09-17T01:07:54.962 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-17T01:07:54.962 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-17T01:07:54.962 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-17T01:07:54.962 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-17T01:07:54.962 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-17T01:07:54.962 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-17T01:07:54.962 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-17T01:07:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-17T01:07:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 44 2024-09-17T01:07:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:07:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2024-09-17T01:07:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2024-09-17T01:07:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=14464,1=24269} 2024-09-17T01:07:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-17T01:07:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-17T01:07:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-17T01:07:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-17T01:07:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-17T01:07:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-17T01:07:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-17T01:07:54.963 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-17T01:07:54.964 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-17T01:07:54.964 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 14464 members: 24269,14464 2024-09-17T01:07:54.964 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.fmyyzz{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:07:54.964 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.zmrgxd{0:24287} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/2986470392,v1:172.21.15.2:6827/2986470392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:07:54.964 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.hgawhu{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:07:54.964 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.heckcd{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:07:54.964 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:07:54.964 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:07:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-17T01:07:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.965+0000 7faba89ce640 1 -- 172.21.15.2:0/835548608 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fab8c06e530 msgr2=0x7fab8c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.965+0000 7faba89ce640 1 --2- 172.21.15.2:0/835548608 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fab8c06e530 0x7fab8c0709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fab94009ac0 tx=0x7fab94035040 comp rx=0 tx=0).stop 2024-09-17T01:07:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.965+0000 7faba89ce640 1 -- 172.21.15.2:0/835548608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fe450 msgr2=0x7faba4113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.965+0000 7faba89ce640 1 --2- 172.21.15.2:0/835548608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fe450 0x7faba4113750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab98002a50 tx=0x7fab98004600 comp rx=0 tx=0).stop 2024-09-17T01:07:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.965+0000 7faba89ce640 1 -- 172.21.15.2:0/835548608 shutdown_connections 2024-09-17T01:07:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.965+0000 7faba89ce640 1 --2- 172.21.15.2:0/835548608 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fab8c06e530 0x7fab8c0709e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.965+0000 7faba89ce640 1 --2- 172.21.15.2:0/835548608 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faba40fe450 0x7faba4113750 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.965+0000 7faba89ce640 1 --2- 172.21.15.2:0/835548608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faba4064fe0 0x7faba4113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:54.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.965+0000 7faba89ce640 1 -- 172.21.15.2:0/835548608 >> 172.21.15.2:0/835548608 conn(0x7faba40723b0 msgr2=0x7faba40fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:54.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.965+0000 7faba89ce640 1 -- 172.21.15.2:0/835548608 shutdown_connections 2024-09-17T01:07:54.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:54.965+0000 7faba89ce640 1 -- 172.21.15.2:0/835548608 wait complete. 2024-09-17T01:07:55.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:54 smithi099 ceph-mon[77412]: pgmap v89: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/354 objects degraded (11.582%) 2024-09-17T01:07:55.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:54 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:55.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:54 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:55.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:54 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:07:55.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:54 smithi099 ceph-mon[77412]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:55.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:54 smithi099 ceph-mon[77412]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.047+0000 7fef7ee4f640 1 -- 172.21.15.2:0/1490295957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef780fb810 msgr2=0x7fef780fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.047+0000 7fef7ee4f640 1 --2- 172.21.15.2:0/1490295957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef780fb810 0x7fef780fbbe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0048d0 tx=0x7fef6c009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.047+0000 7fef7ee4f640 1 -- 172.21.15.2:0/1490295957 shutdown_connections 2024-09-17T01:07:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.047+0000 7fef7ee4f640 1 --2- 172.21.15.2:0/1490295957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef780fcf80 0x7fef780fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.047+0000 7fef7ee4f640 1 --2- 172.21.15.2:0/1490295957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef780fb810 0x7fef780fbbe0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.047+0000 7fef7ee4f640 1 -- 172.21.15.2:0/1490295957 >> 172.21.15.2:0/1490295957 conn(0x7fef780723b0 msgr2=0x7fef780727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.047+0000 7fef7ee4f640 1 -- 172.21.15.2:0/1490295957 shutdown_connections 2024-09-17T01:07:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.047+0000 7fef7ee4f640 1 -- 172.21.15.2:0/1490295957 wait complete. 2024-09-17T01:07:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.048+0000 7fef7ee4f640 1 Processor -- start 2024-09-17T01:07:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.048+0000 7fef7ee4f640 1 -- start start 2024-09-17T01:07:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.048+0000 7fef7ee4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef780fb810 0x7fef78113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.048+0000 7fef7ee4f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef780fcf80 0x7fef78113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.048+0000 7fef7ee4f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef78113d40 con 0x7fef780fb810 2024-09-17T01:07:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.048+0000 7fef7ee4f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7810d180 con 0x7fef780fcf80 2024-09-17T01:07:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.048+0000 7fef7cbeb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef780fb810 0x7fef78113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:55.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.048+0000 7fef7cbeb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef780fb810 0x7fef78113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58912/0 (socket says 172.21.15.2:58912) 2024-09-17T01:07:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.048+0000 7fef7cbeb640 1 -- 172.21.15.2:0/523405635 learned_addr learned my addr 172.21.15.2:0/523405635 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:07:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.048+0000 7fef77fff640 1 --2- 172.21.15.2:0/523405635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef780fcf80 0x7fef78113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.048+0000 7fef7cbeb640 1 -- 172.21.15.2:0/523405635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef780fcf80 msgr2=0x7fef78113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.048+0000 7fef7cbeb640 1 --2- 172.21.15.2:0/523405635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef780fcf80 0x7fef78113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.049+0000 7fef7cbeb640 1 -- 172.21.15.2:0/523405635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c005040 con 0x7fef780fb810 2024-09-17T01:07:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.049+0000 7fef7cbeb640 1 --2- 172.21.15.2:0/523405635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef780fb810 0x7fef78113200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fef6c000c00 tx=0x7fef6c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.049+0000 7fef757fa640 1 -- 172.21.15.2:0/523405635 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef6c038070 con 0x7fef780fb810 2024-09-17T01:07:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.049+0000 7fef757fa640 1 -- 172.21.15.2:0/523405635 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fef6c02ade0 con 0x7fef780fb810 2024-09-17T01:07:55.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.049+0000 7fef7ee4f640 1 -- 172.21.15.2:0/523405635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7810d400 con 0x7fef780fb810 2024-09-17T01:07:55.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.049+0000 7fef757fa640 1 -- 172.21.15.2:0/523405635 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef6c02c7b0 con 0x7fef780fb810 2024-09-17T01:07:55.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.049+0000 7fef7ee4f640 1 -- 172.21.15.2:0/523405635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7810d940 con 0x7fef780fb810 2024-09-17T01:07:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.050+0000 7fef7ee4f640 1 -- 172.21.15.2:0/523405635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef780fcbc0 con 0x7fef780fb810 2024-09-17T01:07:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.050+0000 7fef757fa640 1 -- 172.21.15.2:0/523405635 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fef6c030020 con 0x7fef780fb810 2024-09-17T01:07:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.051+0000 7fef757fa640 1 --2- 172.21.15.2:0/523405635 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fef6806e530 0x7fef680709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.051+0000 7fef757fa640 1 -- 172.21.15.2:0/523405635 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fef6c0ae480 con 0x7fef780fb810 2024-09-17T01:07:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.051+0000 7fef77fff640 1 --2- 172.21.15.2:0/523405635 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fef6806e530 0x7fef680709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.051+0000 7fef77fff640 1 --2- 172.21.15.2:0/523405635 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fef6806e530 0x7fef680709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fef7810eac0 tx=0x7fef6400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.055+0000 7fef757fa640 1 -- 172.21.15.2:0/523405635 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fef6c077640 con 0x7fef780fb810 2024-09-17T01:07:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.257+0000 7fef7ee4f640 1 -- 172.21.15.2:0/523405635 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef7804b720 con 0x7fef6806e530 2024-09-17T01:07:55.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.259+0000 7fef757fa640 1 -- 172.21.15.2:0/523405635 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fef7804b720 con 0x7fef6806e530 2024-09-17T01:07:55.258 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:07:55.258 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:07:55.258 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:07:55.258 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:07:55.258 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-17T01:07:55.258 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-17T01:07:55.258 INFO:teuthology.orchestra.run.smithi002.stdout: "mon", 2024-09-17T01:07:55.258 INFO:teuthology.orchestra.run.smithi002.stdout: "crash" 2024-09-17T01:07:55.258 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-17T01:07:55.258 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "8/21 daemons upgraded", 2024-09-17T01:07:55.258 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:07:55.258 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:07:55.258 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:07:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.261+0000 7fef7ee4f640 1 -- 172.21.15.2:0/523405635 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fef6806e530 msgr2=0x7fef680709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.261+0000 7fef7ee4f640 1 --2- 172.21.15.2:0/523405635 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fef6806e530 0x7fef680709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fef7810eac0 tx=0x7fef6400b040 comp rx=0 tx=0).stop 2024-09-17T01:07:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.261+0000 7fef7ee4f640 1 -- 172.21.15.2:0/523405635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef780fb810 msgr2=0x7fef78113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.261+0000 7fef7ee4f640 1 --2- 172.21.15.2:0/523405635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef780fb810 0x7fef78113200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fef6c000c00 tx=0x7fef6c009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.262+0000 7fef7ee4f640 1 -- 172.21.15.2:0/523405635 shutdown_connections 2024-09-17T01:07:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.262+0000 7fef7ee4f640 1 --2- 172.21.15.2:0/523405635 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fef6806e530 0x7fef680709e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.262+0000 7fef7ee4f640 1 --2- 172.21.15.2:0/523405635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef780fcf80 0x7fef78113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.262+0000 7fef7ee4f640 1 --2- 172.21.15.2:0/523405635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef780fb810 0x7fef78113200 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.262+0000 7fef7ee4f640 1 -- 172.21.15.2:0/523405635 >> 172.21.15.2:0/523405635 conn(0x7fef780723b0 msgr2=0x7fef78064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.262+0000 7fef7ee4f640 1 -- 172.21.15.2:0/523405635 shutdown_connections 2024-09-17T01:07:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.262+0000 7fef7ee4f640 1 -- 172.21.15.2:0/523405635 wait complete. 2024-09-17T01:07:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.345+0000 7fcb5d710640 1 -- 172.21.15.2:0/2891491833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58102ef0 msgr2=0x7fcb580fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.345+0000 7fcb5d710640 1 --2- 172.21.15.2:0/2891491833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58102ef0 0x7fcb580fc5b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0048d0 tx=0x7fcb4c009da0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.345+0000 7fcb5d710640 1 -- 172.21.15.2:0/2891491833 shutdown_connections 2024-09-17T01:07:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.345+0000 7fcb5d710640 1 --2- 172.21.15.2:0/2891491833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58102ef0 0x7fcb580fc5b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.345+0000 7fcb5d710640 1 --2- 172.21.15.2:0/2891491833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb58102550 0x7fcb58102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.345+0000 7fcb5d710640 1 -- 172.21.15.2:0/2891491833 >> 172.21.15.2:0/2891491833 conn(0x7fcb580f80f0 msgr2=0x7fcb580fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.345+0000 7fcb5d710640 1 -- 172.21.15.2:0/2891491833 shutdown_connections 2024-09-17T01:07:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.345+0000 7fcb5d710640 1 -- 172.21.15.2:0/2891491833 wait complete. 2024-09-17T01:07:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.346+0000 7fcb5d710640 1 Processor -- start 2024-09-17T01:07:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.346+0000 7fcb5d710640 1 -- start start 2024-09-17T01:07:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.346+0000 7fcb5d710640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58102550 0x7fcb581135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.346+0000 7fcb5d710640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb58102ef0 0x7fcb58113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.346+0000 7fcb5d710640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb581141d0 con 0x7fcb58102550 2024-09-17T01:07:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.346+0000 7fcb5d710640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5810d550 con 0x7fcb58102ef0 2024-09-17T01:07:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.346+0000 7fcb56ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58102550 0x7fcb581135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.346+0000 7fcb56ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58102550 0x7fcb581135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58922/0 (socket says 172.21.15.2:58922) 2024-09-17T01:07:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.346+0000 7fcb56ffd640 1 -- 172.21.15.2:0/1260705125 learned_addr learned my addr 172.21.15.2:0/1260705125 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:07:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.346+0000 7fcb567fc640 1 --2- 172.21.15.2:0/1260705125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb58102ef0 0x7fcb58113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.346+0000 7fcb56ffd640 1 -- 172.21.15.2:0/1260705125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb58102ef0 msgr2=0x7fcb58113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.346+0000 7fcb56ffd640 1 --2- 172.21.15.2:0/1260705125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb58102ef0 0x7fcb58113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.347+0000 7fcb56ffd640 1 -- 172.21.15.2:0/1260705125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c005040 con 0x7fcb58102550 2024-09-17T01:07:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.347+0000 7fcb56ffd640 1 --2- 172.21.15.2:0/1260705125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58102550 0x7fcb581135b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800b790 tx=0x7fcb480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.347+0000 7fcb3f7fe640 1 -- 172.21.15.2:0/1260705125 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb4800c700 con 0x7fcb58102550 2024-09-17T01:07:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.347+0000 7fcb3f7fe640 1 -- 172.21.15.2:0/1260705125 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcb4800cd00 con 0x7fcb58102550 2024-09-17T01:07:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.347+0000 7fcb5d710640 1 -- 172.21.15.2:0/1260705125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5810d7e0 con 0x7fcb58102550 2024-09-17T01:07:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.347+0000 7fcb3f7fe640 1 -- 172.21.15.2:0/1260705125 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb48015e80 con 0x7fcb58102550 2024-09-17T01:07:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.347+0000 7fcb5d710640 1 -- 172.21.15.2:0/1260705125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5810dcd0 con 0x7fcb58102550 2024-09-17T01:07:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.348+0000 7fcb5d710640 1 -- 172.21.15.2:0/1260705125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb580fdcd0 con 0x7fcb58102550 2024-09-17T01:07:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.349+0000 7fcb3f7fe640 1 -- 172.21.15.2:0/1260705125 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fcb48012070 con 0x7fcb58102550 2024-09-17T01:07:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.349+0000 7fcb3f7fe640 1 --2- 172.21.15.2:0/1260705125 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcb4006e530 0x7fcb400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:07:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.349+0000 7fcb3f7fe640 1 -- 172.21.15.2:0/1260705125 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fcb4808da10 con 0x7fcb58102550 2024-09-17T01:07:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.349+0000 7fcb567fc640 1 --2- 172.21.15.2:0/1260705125 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcb4006e530 0x7fcb400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:07:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.350+0000 7fcb567fc640 1 --2- 172.21.15.2:0/1260705125 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcb4006e530 0x7fcb400709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0048a0 tx=0x7fcb4c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:07:55.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.354+0000 7fcb3f7fe640 1 -- 172.21.15.2:0/1260705125 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcb48056b50 con 0x7fcb58102550 2024-09-17T01:07:55.589 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:07:55 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2[120507]: 2024-09-17T01:07:55.315+0000 7f2d62b02640 -1 Falling back to public interface 2024-09-17T01:07:55.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.602+0000 7fcb5d710640 1 -- 172.21.15.2:0/1260705125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcb5810ec20 con 0x7fcb58102550 2024-09-17T01:07:55.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.602+0000 7fcb3f7fe640 1 -- 172.21.15.2:0/1260705125 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1186 (secure 0 0 0) 0x7fcb4805a210 con 0x7fcb58102550 2024-09-17T01:07:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 41/354 objects degraded (11.582%), 13 pgs degraded 2024-09-17T01:07:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:07:55.602 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:07:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:07:55.602 INFO:teuthology.orchestra.run.smithi002.stdout: osd.2 (root=default,host=smithi002) is down 2024-09-17T01:07:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 41/354 objects degraded (11.582%), 13 pgs degraded 2024-09-17T01:07:55.603 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-17T01:07:55.603 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-17T01:07:55.603 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-17T01:07:55.603 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-17T01:07:55.603 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-17T01:07:55.603 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-17T01:07:55.603 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-17T01:07:55.604 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-17T01:07:55.604 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-17T01:07:55.604 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-09-17T01:07:55.604 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-17T01:07:55.604 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-17T01:07:55.605 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-17T01:07:55.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.605+0000 7fcb5d710640 1 -- 172.21.15.2:0/1260705125 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcb4006e530 msgr2=0x7fcb400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:55.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.605+0000 7fcb5d710640 1 --2- 172.21.15.2:0/1260705125 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcb4006e530 0x7fcb400709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0048a0 tx=0x7fcb4c035040 comp rx=0 tx=0).stop 2024-09-17T01:07:55.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.605+0000 7fcb5d710640 1 -- 172.21.15.2:0/1260705125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58102550 msgr2=0x7fcb581135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:07:55.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.605+0000 7fcb5d710640 1 --2- 172.21.15.2:0/1260705125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58102550 0x7fcb581135b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800b790 tx=0x7fcb480091d0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.605+0000 7fcb5d710640 1 -- 172.21.15.2:0/1260705125 shutdown_connections 2024-09-17T01:07:55.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.605+0000 7fcb5d710640 1 --2- 172.21.15.2:0/1260705125 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcb4006e530 0x7fcb400709e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.605+0000 7fcb5d710640 1 --2- 172.21.15.2:0/1260705125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb58102ef0 0x7fcb58113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.605+0000 7fcb5d710640 1 --2- 172.21.15.2:0/1260705125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb58102550 0x7fcb581135b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:07:55.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.605+0000 7fcb5d710640 1 -- 172.21.15.2:0/1260705125 >> 172.21.15.2:0/1260705125 conn(0x7fcb580f80f0 msgr2=0x7fcb580f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:07:55.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.605+0000 7fcb5d710640 1 -- 172.21.15.2:0/1260705125 shutdown_connections 2024-09-17T01:07:55.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:07:55.605+0000 7fcb5d710640 1 -- 172.21.15.2:0/1260705125 wait complete. 2024-09-17T01:07:55.867 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:55 smithi002 ceph-mon[98018]: from='client.44193 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:55.867 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:55 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/489126751' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:55.867 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:55 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/835548608' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:07:55.867 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:55.868 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:56.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:55 smithi099 ceph-mon[77412]: from='client.44193 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:56.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:55 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/489126751' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:07:56.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:55 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/835548608' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:07:56.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:56.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:07:56.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:56 smithi002 ceph-mon[98018]: pgmap v90: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/354 objects degraded (11.582%) 2024-09-17T01:07:56.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:56 smithi002 ceph-mon[98018]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:56.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:56 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1260705125' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:07:57.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:56 smithi099 ceph-mon[77412]: pgmap v90: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/354 objects degraded (11.582%) 2024-09-17T01:07:57.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:56 smithi099 ceph-mon[77412]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:07:57.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:56 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1260705125' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:07:58.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:58 smithi002 ceph-mon[98018]: pgmap v91: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/354 objects degraded (11.582%) 2024-09-17T01:07:58.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:58 smithi002 ceph-mon[98018]: Health check update: Degraded data redundancy: 41/354 objects degraded (11.582%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T01:07:59.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:58 smithi099 ceph-mon[77412]: pgmap v91: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/354 objects degraded (11.582%) 2024-09-17T01:07:59.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:58 smithi099 ceph-mon[77412]: Health check update: Degraded data redundancy: 41/354 objects degraded (11.582%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T01:07:59.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:59 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:59.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:59 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:59.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:59 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:07:59.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:07:59 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:00.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:59 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:00.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:59 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:00.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:59 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:00.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:07:59 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:00.605 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:08:00 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2[120507]: 2024-09-17T01:08:00.441+0000 7f2d62b02640 -1 osd.2 57 log_to_monitors true 2024-09-17T01:08:00.887 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:00 smithi002 ceph-mon[98018]: pgmap v92: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/354 objects degraded (11.582%) 2024-09-17T01:08:00.887 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:00 smithi002 ceph-mon[98018]: from='osd.2 [v2:172.21.15.2:6818/654174002,v1:172.21.15.2:6819/654174002]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:08:01.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:00 smithi099 ceph-mon[77412]: pgmap v92: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 41/354 objects degraded (11.582%) 2024-09-17T01:08:01.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:00 smithi099 ceph-mon[77412]: from='osd.2 [v2:172.21.15.2:6818/654174002,v1:172.21.15.2:6819/654174002]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:08:01.610 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:08:01 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2[120507]: 2024-09-17T01:08:01.458+0000 7f2d56894640 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:08:01.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:01 smithi002 ceph-mon[98018]: from='osd.2 [v2:172.21.15.2:6818/654174002,v1:172.21.15.2:6819/654174002]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:08:01.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:01 smithi002 ceph-mon[98018]: osdmap e60: 6 total, 5 up, 6 in 2024-09-17T01:08:01.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:01 smithi002 ceph-mon[98018]: from='osd.2 [v2:172.21.15.2:6818/654174002,v1:172.21.15.2:6819/654174002]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-17T01:08:01.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:01 smithi002 ceph-mon[98018]: from='osd.2 [v2:172.21.15.2:6818/654174002,v1:172.21.15.2:6819/654174002]' entity='osd.2' 2024-09-17T01:08:02.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:01 smithi099 ceph-mon[77412]: from='osd.2 [v2:172.21.15.2:6818/654174002,v1:172.21.15.2:6819/654174002]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:08:02.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:01 smithi099 ceph-mon[77412]: osdmap e60: 6 total, 5 up, 6 in 2024-09-17T01:08:02.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:01 smithi099 ceph-mon[77412]: from='osd.2 [v2:172.21.15.2:6818/654174002,v1:172.21.15.2:6819/654174002]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-09-17T01:08:02.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:01 smithi099 ceph-mon[77412]: from='osd.2 [v2:172.21.15.2:6818/654174002,v1:172.21.15.2:6819/654174002]' entity='osd.2' 2024-09-17T01:08:02.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:02 smithi002 ceph-mon[98018]: pgmap v94: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 41/354 objects degraded (11.582%) 2024-09-17T01:08:02.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:02 smithi002 ceph-mon[98018]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:08:02.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:02 smithi002 ceph-mon[98018]: osd.2 [v2:172.21.15.2:6818/654174002,v1:172.21.15.2:6819/654174002] boot 2024-09-17T01:08:02.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:02 smithi002 ceph-mon[98018]: osdmap e61: 6 total, 6 up, 6 in 2024-09-17T01:08:02.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:02 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:08:03.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:02 smithi099 ceph-mon[77412]: pgmap v94: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 41/354 objects degraded (11.582%) 2024-09-17T01:08:03.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:02 smithi099 ceph-mon[77412]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:08:03.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:02 smithi099 ceph-mon[77412]: osd.2 [v2:172.21.15.2:6818/654174002,v1:172.21.15.2:6819/654174002] boot 2024-09-17T01:08:03.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:02 smithi099 ceph-mon[77412]: osdmap e61: 6 total, 6 up, 6 in 2024-09-17T01:08:03.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:02 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:08:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:08:04.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:03 smithi002 ceph-mon[98018]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:08:04.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:03 smithi002 ceph-mon[98018]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:08:04.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:03 smithi002 ceph-mon[98018]: osdmap e62: 6 total, 6 up, 6 in 2024-09-17T01:08:04.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:04.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:04.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:04.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:04.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:04.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:04.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:04.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:04.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:04.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:08:04.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:03 smithi099 ceph-mon[77412]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:08:04.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:03 smithi099 ceph-mon[77412]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:08:04.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:03 smithi099 ceph-mon[77412]: osdmap e62: 6 total, 6 up, 6 in 2024-09-17T01:08:05.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:04 smithi002 ceph-mon[98018]: pgmap v96: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 41/354 objects degraded (11.582%) 2024-09-17T01:08:05.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:04 smithi099 ceph-mon[77412]: pgmap v96: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 41/354 objects degraded (11.582%) 2024-09-17T01:08:06.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:06 smithi002 ceph-mon[98018]: pgmap v98: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 41/354 objects degraded (11.582%) 2024-09-17T01:08:07.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:06 smithi099 ceph-mon[77412]: pgmap v98: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 41/354 objects degraded (11.582%) 2024-09-17T01:08:08.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:07 smithi002 ceph-mon[98018]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/354 objects degraded (11.582%), 13 pgs degraded) 2024-09-17T01:08:08.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:07 smithi099 ceph-mon[77412]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/354 objects degraded (11.582%), 13 pgs degraded) 2024-09-17T01:08:09.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:08 smithi002 ceph-mon[98018]: pgmap v99: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-17T01:08:09.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:08 smithi099 ceph-mon[77412]: pgmap v99: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-09-17T01:08:11.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:10 smithi002 ceph-mon[98018]: pgmap v100: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:08:11.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:10 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:11.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:10 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:11.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:10 smithi099 ceph-mon[77412]: pgmap v100: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 op/s 2024-09-17T01:08:11.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:10 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:11.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:10 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:13.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:12 smithi002 ceph-mon[98018]: pgmap v101: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-17T01:08:13.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:12 smithi099 ceph-mon[77412]: pgmap v101: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-17T01:08:15.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:14 smithi002 ceph-mon[98018]: pgmap v102: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-17T01:08:15.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:14 smithi099 ceph-mon[77412]: pgmap v102: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-09-17T01:08:16.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:16 smithi002 ceph-mon[98018]: pgmap v103: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T01:08:16.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:16 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:16.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:16 smithi099 ceph-mon[77412]: pgmap v103: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-09-17T01:08:16.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:16 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:18.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:18 smithi002 ceph-mon[98018]: pgmap v104: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-17T01:08:18.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:18 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:08:18.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:18 smithi002 ceph-mon[98018]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:08:18.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:18 smithi002 ceph-mon[98018]: Upgrade: osd.3 is safe to restart 2024-09-17T01:08:18.479 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:18 smithi099 ceph-mon[77412]: pgmap v104: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-09-17T01:08:18.479 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:18 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:08:18.479 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:18 smithi099 ceph-mon[77412]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:08:18.479 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:18 smithi099 ceph-mon[77412]: Upgrade: osd.3 is safe to restart 2024-09-17T01:08:20.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:20 smithi099 ceph-mon[77412]: pgmap v105: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:08:20.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:20 smithi099 ceph-mon[77412]: Upgrade: Updating osd.3 2024-09-17T01:08:20.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:20 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:20.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:20 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:08:20.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:20 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:20.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:20 smithi099 ceph-mon[77412]: Deploying daemon osd.3 on smithi099 2024-09-17T01:08:20.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:20 smithi002 ceph-mon[98018]: pgmap v105: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:08:20.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:20 smithi002 ceph-mon[98018]: Upgrade: Updating osd.3 2024-09-17T01:08:20.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:20 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:20.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:20 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:08:20.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:20 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:20.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:20 smithi002 ceph-mon[98018]: Deploying daemon osd.3 on smithi099 2024-09-17T01:08:22.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:22 smithi002 ceph-mon[98018]: pgmap v106: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:08:22.739 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:22 smithi099 ceph-mon[77412]: pgmap v106: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:08:22.739 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:22 smithi099 systemd[1]: Stopping Ceph osd.3 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:08:23.043 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:22 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3[39813]: 2024-09-17T01:08:22.744+0000 7fb675876640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:08:23.043 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:22 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3[39813]: 2024-09-17T01:08:22.744+0000 7fb675876640 -1 osd.3 62 *** Got signal Terminated *** 2024-09-17T01:08:23.043 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:22 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3[39813]: 2024-09-17T01:08:22.744+0000 7fb675876640 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:08:23.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:23 smithi099 ceph-mon[77412]: osd.3 marked itself down and dead 2024-09-17T01:08:23.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:23 smithi002 ceph-mon[98018]: osd.3 marked itself down and dead 2024-09-17T01:08:24.293 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:24 smithi099 podman[86196]: 2024-09-17 01:08:24.017269758 +0000 UTC m=+1.381652853 container died da04ecc3dd7aef24075452adbdb7d4d5fa7738182d3fd0cf51acd39aad4b34de (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, RELEASE=quincy-4a70413, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-17T01:08:24.718 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:24 smithi099 ceph-mon[77412]: pgmap v107: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:08:24.718 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:24 smithi099 ceph-mon[77412]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:08:24.718 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:24 smithi099 ceph-mon[77412]: osdmap e63: 6 total, 5 up, 6 in 2024-09-17T01:08:24.719 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:24 smithi099 podman[86196]: 2024-09-17 01:08:24.427571873 +0000 UTC m=+1.791954968 container cleanup da04ecc3dd7aef24075452adbdb7d4d5fa7738182d3fd0cf51acd39aad4b34de (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3, RELEASE=quincy-4a70413, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-17T01:08:24.719 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:24 smithi099 bash[86196]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3 2024-09-17T01:08:24.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:24 smithi002 ceph-mon[98018]: pgmap v107: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:08:24.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:24 smithi002 ceph-mon[98018]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:08:24.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:24 smithi002 ceph-mon[98018]: osdmap e63: 6 total, 5 up, 6 in 2024-09-17T01:08:25.026 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:24 smithi099 podman[86221]: 2024-09-17 01:08:24.720868066 +0000 UTC m=+0.698925042 container remove da04ecc3dd7aef24075452adbdb7d4d5fa7738182d3fd0cf51acd39aad4b34de (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=quincy-4a70413, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:08:25.293 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:25 smithi099 podman[86311]: 2024-09-17 01:08:24.931574969 +0000 UTC m=+0.015496145 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:08:25.293 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:25 smithi099 podman[86311]: 2024-09-17 01:08:25.080289601 +0000 UTC m=+0.164210762 container create 45edc5845d3cbafd3ed43d91e073b06057c8cc943aa0b7165d01c0292b220a2c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-17T01:08:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.703+0000 7f3187ea1640 1 -- 172.21.15.2:0/361841944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31800fe460 msgr2=0x7f31800fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.703+0000 7f3187ea1640 1 --2- 172.21.15.2:0/361841944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31800fe460 0x7f31800fe830 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f317c0048d0 tx=0x7f317c009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.703+0000 7f3187ea1640 1 -- 172.21.15.2:0/361841944 shutdown_connections 2024-09-17T01:08:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.703+0000 7f3187ea1640 1 --2- 172.21.15.2:0/361841944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800fabe0 0x7f31800fb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.703+0000 7f3187ea1640 1 --2- 172.21.15.2:0/361841944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31800fe460 0x7f31800fe830 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.703+0000 7f3187ea1640 1 -- 172.21.15.2:0/361841944 >> 172.21.15.2:0/361841944 conn(0x7f3180071b00 msgr2=0x7f3180071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.703+0000 7f3187ea1640 1 -- 172.21.15.2:0/361841944 shutdown_connections 2024-09-17T01:08:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.703+0000 7f3187ea1640 1 -- 172.21.15.2:0/361841944 wait complete. 2024-09-17T01:08:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.704+0000 7f3187ea1640 1 Processor -- start 2024-09-17T01:08:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.704+0000 7f3187ea1640 1 -- start start 2024-09-17T01:08:25.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.704+0000 7f3187ea1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800fabe0 0x7f3180113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:25.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.704+0000 7f3187ea1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31800fe460 0x7f31801136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:25.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.704+0000 7f3187ea1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3180113cd0 con 0x7f31800fe460 2024-09-17T01:08:25.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.704+0000 7f3187ea1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318010d110 con 0x7f31800fabe0 2024-09-17T01:08:25.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.704+0000 7f318543c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31800fe460 0x7f31801136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:25.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.704+0000 7f3185c3d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800fabe0 0x7f3180113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:25.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.704+0000 7f3185c3d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800fabe0 0x7f3180113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.2:40810/0 (socket says 172.21.15.2:40810) 2024-09-17T01:08:25.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.704+0000 7f318543c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31800fe460 0x7f31801136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46048/0 (socket says 172.21.15.2:46048) 2024-09-17T01:08:25.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.704+0000 7f3185c3d640 1 -- 172.21.15.2:0/1936537535 learned_addr learned my addr 172.21.15.2:0/1936537535 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:08:25.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.705+0000 7f318543c640 1 -- 172.21.15.2:0/1936537535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800fabe0 msgr2=0x7f3180113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:25.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.705+0000 7f318543c640 1 --2- 172.21.15.2:0/1936537535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800fabe0 0x7f3180113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:25.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.705+0000 7f318543c640 1 -- 172.21.15.2:0/1936537535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c005040 con 0x7f31800fe460 2024-09-17T01:08:25.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.705+0000 7f3185c3d640 1 --2- 172.21.15.2:0/1936537535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800fabe0 0x7f3180113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:08:25.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.705+0000 7f318543c640 1 --2- 172.21.15.2:0/1936537535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31800fe460 0x7f31801136d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3170002820 tx=0x7f3170004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:25.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.705+0000 7f31767fc640 1 -- 172.21.15.2:0/1936537535 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3170002e10 con 0x7f31800fe460 2024-09-17T01:08:25.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.705+0000 7f31767fc640 1 -- 172.21.15.2:0/1936537535 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f317000f040 con 0x7f31800fe460 2024-09-17T01:08:25.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.705+0000 7f3187ea1640 1 -- 172.21.15.2:0/1936537535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318010d3f0 con 0x7f31800fe460 2024-09-17T01:08:25.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.705+0000 7f31767fc640 1 -- 172.21.15.2:0/1936537535 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31700094b0 con 0x7f31800fe460 2024-09-17T01:08:25.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.705+0000 7f3187ea1640 1 -- 172.21.15.2:0/1936537535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318010d910 con 0x7f31800fe460 2024-09-17T01:08:25.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.707+0000 7f3187ea1640 1 -- 172.21.15.2:0/1936537535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3180064d40 con 0x7f31800fe460 2024-09-17T01:08:25.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.707+0000 7f31767fc640 1 -- 172.21.15.2:0/1936537535 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f3170007c30 con 0x7f31800fe460 2024-09-17T01:08:25.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.708+0000 7f31767fc640 1 --2- 172.21.15.2:0/1936537535 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f316c06e530 0x7f316c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:25.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.708+0000 7f31767fc640 1 -- 172.21.15.2:0/1936537535 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f317008e080 con 0x7f31800fe460 2024-09-17T01:08:25.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.708+0000 7f3185c3d640 1 --2- 172.21.15.2:0/1936537535 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f316c06e530 0x7f316c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:25.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.709+0000 7f3185c3d640 1 --2- 172.21.15.2:0/1936537535 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f316c06e530 0x7f316c0709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f317c004540 tx=0x7f317c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:25.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.713+0000 7f31767fc640 1 -- 172.21.15.2:0/1936537535 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f31700570f0 con 0x7f31800fe460 2024-09-17T01:08:25.793 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:25 smithi099 podman[86311]: 2024-09-17 01:08:25.307791697 +0000 UTC m=+0.391712868 container init 45edc5845d3cbafd3ed43d91e073b06057c8cc943aa0b7165d01c0292b220a2c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:08:25.793 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:25 smithi099 podman[86311]: 2024-09-17 01:08:25.311076911 +0000 UTC m=+0.394998082 container start 45edc5845d3cbafd3ed43d91e073b06057c8cc943aa0b7165d01c0292b220a2c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-17T01:08:25.793 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:25 smithi099 podman[86311]: 2024-09-17 01:08:25.391109226 +0000 UTC m=+0.475030392 container attach 45edc5845d3cbafd3ed43d91e073b06057c8cc943aa0b7165d01c0292b220a2c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-17T01:08:25.793 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:25 smithi099 podman[86311]: 2024-09-17 01:08:25.506634478 +0000 UTC m=+0.590555652 container died 45edc5845d3cbafd3ed43d91e073b06057c8cc943aa0b7165d01c0292b220a2c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-17T01:08:25.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:25 smithi099 ceph-mon[77412]: osdmap e64: 6 total, 5 up, 6 in 2024-09-17T01:08:25.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]: dispatch 2024-09-17T01:08:25.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 3]}]: dispatch 2024-09-17T01:08:25.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 3]}]: dispatch 2024-09-17T01:08:25.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 3]}]: dispatch 2024-09-17T01:08:25.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 5]}]: dispatch 2024-09-17T01:08:25.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 2]}]: dispatch 2024-09-17T01:08:25.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 3]}]: dispatch 2024-09-17T01:08:25.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:25.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:25.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.905+0000 7f3187ea1640 1 -- 172.21.15.2:0/1936537535 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f318010e800 con 0x7f316c06e530 2024-09-17T01:08:25.903 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:25 smithi002 ceph-mon[98018]: osdmap e64: 6 total, 5 up, 6 in 2024-09-17T01:08:25.903 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]: dispatch 2024-09-17T01:08:25.903 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 3]}]: dispatch 2024-09-17T01:08:25.903 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 3]}]: dispatch 2024-09-17T01:08:25.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 3]}]: dispatch 2024-09-17T01:08:25.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 5]}]: dispatch 2024-09-17T01:08:25.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 2]}]: dispatch 2024-09-17T01:08:25.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 3]}]: dispatch 2024-09-17T01:08:25.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:25.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:25.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.907+0000 7f31767fc640 1 -- 172.21.15.2:0/1936537535 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f318010e800 con 0x7f316c06e530 2024-09-17T01:08:25.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.909+0000 7f3187ea1640 1 -- 172.21.15.2:0/1936537535 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f316c06e530 msgr2=0x7f316c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:25.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.909+0000 7f3187ea1640 1 --2- 172.21.15.2:0/1936537535 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f316c06e530 0x7f316c0709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f317c004540 tx=0x7f317c035040 comp rx=0 tx=0).stop 2024-09-17T01:08:25.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.909+0000 7f3187ea1640 1 -- 172.21.15.2:0/1936537535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31800fe460 msgr2=0x7f31801136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:25.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.909+0000 7f3187ea1640 1 --2- 172.21.15.2:0/1936537535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31800fe460 0x7f31801136d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3170002820 tx=0x7f3170004570 comp rx=0 tx=0).stop 2024-09-17T01:08:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.909+0000 7f3187ea1640 1 -- 172.21.15.2:0/1936537535 shutdown_connections 2024-09-17T01:08:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.909+0000 7f3187ea1640 1 --2- 172.21.15.2:0/1936537535 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f316c06e530 0x7f316c0709e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.909+0000 7f3187ea1640 1 --2- 172.21.15.2:0/1936537535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31800fe460 0x7f31801136d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.909+0000 7f3187ea1640 1 --2- 172.21.15.2:0/1936537535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31800fabe0 0x7f3180113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.909+0000 7f3187ea1640 1 -- 172.21.15.2:0/1936537535 >> 172.21.15.2:0/1936537535 conn(0x7f3180071b00 msgr2=0x7f31800f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.909+0000 7f3187ea1640 1 -- 172.21.15.2:0/1936537535 shutdown_connections 2024-09-17T01:08:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.909+0000 7f3187ea1640 1 -- 172.21.15.2:0/1936537535 wait complete. 2024-09-17T01:08:25.915 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:08:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.991+0000 7f31bb2fb640 1 -- 172.21.15.2:0/349733478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31b4101510 msgr2=0x7f31b41018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:25.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.991+0000 7f31bb2fb640 1 --2- 172.21.15.2:0/349733478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31b4101510 0x7f31b41018e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f31b00048d0 tx=0x7f31b0009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.991+0000 7f31bb2fb640 1 -- 172.21.15.2:0/349733478 shutdown_connections 2024-09-17T01:08:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.991+0000 7f31bb2fb640 1 --2- 172.21.15.2:0/349733478 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b40fb4d0 0x7f31b40fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.991+0000 7f31bb2fb640 1 --2- 172.21.15.2:0/349733478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31b4101510 0x7f31b41018e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.991+0000 7f31bb2fb640 1 -- 172.21.15.2:0/349733478 >> 172.21.15.2:0/349733478 conn(0x7f31b40f7090 msgr2=0x7f31b40f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.991+0000 7f31bb2fb640 1 -- 172.21.15.2:0/349733478 shutdown_connections 2024-09-17T01:08:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.991+0000 7f31bb2fb640 1 -- 172.21.15.2:0/349733478 wait complete. 2024-09-17T01:08:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.992+0000 7f31bb2fb640 1 Processor -- start 2024-09-17T01:08:25.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.992+0000 7f31bb2fb640 1 -- start start 2024-09-17T01:08:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.992+0000 7f31bb2fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31b40fb4d0 0x7f31b41130c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.992+0000 7f31bb2fb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b4101510 0x7f31b4113600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.992+0000 7f31bb2fb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b4113c00 con 0x7f31b40fb4d0 2024-09-17T01:08:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.992+0000 7f31bb2fb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b4113d70 con 0x7f31b4101510 2024-09-17T01:08:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.992+0000 7f31b9097640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31b40fb4d0 0x7f31b41130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.992+0000 7f31b9097640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31b40fb4d0 0x7f31b41130c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46068/0 (socket says 172.21.15.2:46068) 2024-09-17T01:08:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.992+0000 7f31b9097640 1 -- 172.21.15.2:0/1081709810 learned_addr learned my addr 172.21.15.2:0/1081709810 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:08:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.992+0000 7f31b8896640 1 --2- 172.21.15.2:0/1081709810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b4101510 0x7f31b4113600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.992+0000 7f31b9097640 1 -- 172.21.15.2:0/1081709810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b4101510 msgr2=0x7f31b4113600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.992+0000 7f31b9097640 1 --2- 172.21.15.2:0/1081709810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b4101510 0x7f31b4113600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.992+0000 7f31b9097640 1 -- 172.21.15.2:0/1081709810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0005040 con 0x7f31b40fb4d0 2024-09-17T01:08:25.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.993+0000 7f31b9097640 1 --2- 172.21.15.2:0/1081709810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31b40fb4d0 0x7f31b41130c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f31b0000c00 tx=0x7f31b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:25.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.993+0000 7f31a9ffb640 1 -- 172.21.15.2:0/1081709810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31b0038070 con 0x7f31b40fb4d0 2024-09-17T01:08:25.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.993+0000 7f31bb2fb640 1 -- 172.21.15.2:0/1081709810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b410d200 con 0x7f31b40fb4d0 2024-09-17T01:08:25.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.993+0000 7f31a9ffb640 1 -- 172.21.15.2:0/1081709810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f31b002ade0 con 0x7f31b40fb4d0 2024-09-17T01:08:25.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.993+0000 7f31a9ffb640 1 -- 172.21.15.2:0/1081709810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31b002c7e0 con 0x7f31b40fb4d0 2024-09-17T01:08:25.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.993+0000 7f31bb2fb640 1 -- 172.21.15.2:0/1081709810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b410d6c0 con 0x7f31b40fb4d0 2024-09-17T01:08:25.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.994+0000 7f31bb2fb640 1 -- 172.21.15.2:0/1081709810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b40fcc10 con 0x7f31b40fb4d0 2024-09-17T01:08:25.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.995+0000 7f31a9ffb640 1 -- 172.21.15.2:0/1081709810 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f31b0030020 con 0x7f31b40fb4d0 2024-09-17T01:08:25.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.995+0000 7f31a9ffb640 1 --2- 172.21.15.2:0/1081709810 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f31a006e530 0x7f31a00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:25.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.996+0000 7f31b8896640 1 --2- 172.21.15.2:0/1081709810 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f31a006e530 0x7f31a00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:25.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.995+0000 7f31a9ffb640 1 -- 172.21.15.2:0/1081709810 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f31b00ade70 con 0x7f31b40fb4d0 2024-09-17T01:08:25.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:25.996+0000 7f31b8896640 1 --2- 172.21.15.2:0/1081709810 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f31a006e530 0x7f31a00709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f31b4066aa0 tx=0x7f31a400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.000+0000 7f31a9ffb640 1 -- 172.21.15.2:0/1081709810 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f31b0076f90 con 0x7f31b40fb4d0 2024-09-17T01:08:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.195+0000 7f31bb2fb640 1 -- 172.21.15.2:0/1081709810 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f31b404b720 con 0x7f31a006e530 2024-09-17T01:08:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.196+0000 7f31a9ffb640 1 -- 172.21.15.2:0/1081709810 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f31b404b720 con 0x7f31a006e530 2024-09-17T01:08:26.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.198+0000 7f31bb2fb640 1 -- 172.21.15.2:0/1081709810 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f31a006e530 msgr2=0x7f31a00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:26.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.198+0000 7f31bb2fb640 1 --2- 172.21.15.2:0/1081709810 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f31a006e530 0x7f31a00709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f31b4066aa0 tx=0x7f31a400b040 comp rx=0 tx=0).stop 2024-09-17T01:08:26.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.198+0000 7f31bb2fb640 1 -- 172.21.15.2:0/1081709810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31b40fb4d0 msgr2=0x7f31b41130c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:26.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.198+0000 7f31bb2fb640 1 --2- 172.21.15.2:0/1081709810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31b40fb4d0 0x7f31b41130c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f31b0000c00 tx=0x7f31b0009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.198+0000 7f31bb2fb640 1 -- 172.21.15.2:0/1081709810 shutdown_connections 2024-09-17T01:08:26.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.198+0000 7f31bb2fb640 1 --2- 172.21.15.2:0/1081709810 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f31a006e530 0x7f31a00709e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.198+0000 7f31bb2fb640 1 --2- 172.21.15.2:0/1081709810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f31b4101510 0x7f31b4113600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.198+0000 7f31bb2fb640 1 --2- 172.21.15.2:0/1081709810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31b40fb4d0 0x7f31b41130c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.198+0000 7f31bb2fb640 1 -- 172.21.15.2:0/1081709810 >> 172.21.15.2:0/1081709810 conn(0x7f31b40f7090 msgr2=0x7f31b4065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:26.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.198+0000 7f31bb2fb640 1 -- 172.21.15.2:0/1081709810 shutdown_connections 2024-09-17T01:08:26.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.198+0000 7f31bb2fb640 1 -- 172.21.15.2:0/1081709810 wait complete. 2024-09-17T01:08:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.279+0000 7f74df362640 1 -- 172.21.15.2:0/3734849730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d80fd3a0 msgr2=0x7f74d80fd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.279+0000 7f74df362640 1 --2- 172.21.15.2:0/3734849730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d80fd3a0 0x7f74d80fd770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f74d40048d0 tx=0x7f74d4009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.279+0000 7f74df362640 1 -- 172.21.15.2:0/3734849730 shutdown_connections 2024-09-17T01:08:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.279+0000 7f74df362640 1 --2- 172.21.15.2:0/3734849730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74d80fac80 0x7f74d80fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.279+0000 7f74df362640 1 --2- 172.21.15.2:0/3734849730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d80fd3a0 0x7f74d80fd770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.279+0000 7f74df362640 1 -- 172.21.15.2:0/3734849730 >> 172.21.15.2:0/3734849730 conn(0x7f74d8070ce0 msgr2=0x7f74d80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.279+0000 7f74df362640 1 -- 172.21.15.2:0/3734849730 shutdown_connections 2024-09-17T01:08:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.279+0000 7f74df362640 1 -- 172.21.15.2:0/3734849730 wait complete. 2024-09-17T01:08:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.280+0000 7f74df362640 1 Processor -- start 2024-09-17T01:08:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.280+0000 7f74df362640 1 -- start start 2024-09-17T01:08:26.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.280+0000 7f74df362640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74d80fac80 0x7f74d81153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.280+0000 7f74df362640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d80fd3a0 0x7f74d8115930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.280+0000 7f74df362640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d8115f30 con 0x7f74d80fd3a0 2024-09-17T01:08:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.280+0000 7f74df362640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d81160a0 con 0x7f74d80fac80 2024-09-17T01:08:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.280+0000 7f74dc8fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d80fd3a0 0x7f74d8115930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.280+0000 7f74dd0fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74d80fac80 0x7f74d81153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.280+0000 7f74dc8fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d80fd3a0 0x7f74d8115930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46084/0 (socket says 172.21.15.2:46084) 2024-09-17T01:08:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.280+0000 7f74dc8fd640 1 -- 172.21.15.2:0/638759565 learned_addr learned my addr 172.21.15.2:0/638759565 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:08:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.280+0000 7f74dc8fd640 1 -- 172.21.15.2:0/638759565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74d80fac80 msgr2=0x7f74d81153f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.280+0000 7f74dc8fd640 1 --2- 172.21.15.2:0/638759565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74d80fac80 0x7f74d81153f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.281+0000 7f74dc8fd640 1 -- 172.21.15.2:0/638759565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d4005040 con 0x7f74d80fd3a0 2024-09-17T01:08:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.281+0000 7f74dc8fd640 1 --2- 172.21.15.2:0/638759565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d80fd3a0 0x7f74d8115930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f74c8002a80 tx=0x7f74c8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.281+0000 7f74cdffb640 1 -- 172.21.15.2:0/638759565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74c8007c30 con 0x7f74d80fd3a0 2024-09-17T01:08:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.281+0000 7f74cdffb640 1 -- 172.21.15.2:0/638759565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f74c800f040 con 0x7f74d80fd3a0 2024-09-17T01:08:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.281+0000 7f74df362640 1 -- 172.21.15.2:0/638759565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d810f520 con 0x7f74d80fd3a0 2024-09-17T01:08:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.281+0000 7f74cdffb640 1 -- 172.21.15.2:0/638759565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74c800dab0 con 0x7f74d80fd3a0 2024-09-17T01:08:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.281+0000 7f74df362640 1 -- 172.21.15.2:0/638759565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d810fa40 con 0x7f74d80fd3a0 2024-09-17T01:08:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.282+0000 7f74df362640 1 -- 172.21.15.2:0/638759565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d80fbc90 con 0x7f74d80fd3a0 2024-09-17T01:08:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.283+0000 7f74cdffb640 1 -- 172.21.15.2:0/638759565 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f74c800dc10 con 0x7f74d80fd3a0 2024-09-17T01:08:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.283+0000 7f74cdffb640 1 --2- 172.21.15.2:0/638759565 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f74c406e530 0x7f74c40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.283+0000 7f74cdffb640 1 -- 172.21.15.2:0/638759565 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f74c808d9b0 con 0x7f74d80fd3a0 2024-09-17T01:08:26.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.283+0000 7f74dd0fe640 1 --2- 172.21.15.2:0/638759565 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f74c406e530 0x7f74c40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:26.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.284+0000 7f74dd0fe640 1 --2- 172.21.15.2:0/638759565 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f74c406e530 0x7f74c40709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74d4009ac0 tx=0x7f74d4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:26.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.288+0000 7f74cdffb640 1 -- 172.21.15.2:0/638759565 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f74c8056b50 con 0x7f74d80fd3a0 2024-09-17T01:08:26.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.472+0000 7f74df362640 1 -- 172.21.15.2:0/638759565 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f74d804b720 con 0x7f74c406e530 2024-09-17T01:08:26.481 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:26 smithi099 podman[86334]: 2024-09-17 01:08:26.103512427 +0000 UTC m=+0.586971648 container remove 45edc5845d3cbafd3ed43d91e073b06057c8cc943aa0b7165d01c0292b220a2c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:08:26.481 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:26 smithi099 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-17T01:08:26.481 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:26 smithi099 systemd[1]: Stopped Ceph osd.3 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:08:26.481 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:26 smithi099 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 6.981s CPU time. 2024-09-17T01:08:26.481 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:26 smithi099 systemd[1]: Starting Ceph osd.3 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:08:26.482 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:08:26.482 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (5m) 27s ago 14m 25.3M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:08:26.482 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (2m) 27s ago 14m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de b7ed6c8d5a92 2024-09-17T01:08:26.482 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (2m) 2m ago 13m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de ae713b940078 2024-09-17T01:08:26.482 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (4m) 27s ago 14m 81.8M - 9.4.12 2bacad6d85d8 5fe408c103d6 2024-09-17T01:08:26.482 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (8m) 27s ago 8m 124M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:08:26.482 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (9m) 27s ago 9m 65.0M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:08:26.483 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (8m) 2m ago 8m 64.8M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:08:26.483 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (8m) 2m ago 8m 115M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:08:26.483 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (5m) 27s ago 15m 497M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:08:26.483 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (4m) 2m ago 13m 439M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:08:26.483 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (3m) 27s ago 15m 47.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de da5247385c2d 2024-09-17T01:08:26.483 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (2m) 2m ago 13m 33.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b92f98b2cab9 2024-09-17T01:08:26.483 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (5m) 27s ago 14m 16.3M - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:08:26.483 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (5m) 2m ago 13m 16.1M - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:08:26.483 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (104s) 27s ago 12m 94.2M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 563188d6089b 2024-09-17T01:08:26.483 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (69s) 27s ago 12m 100M 1558M 19.1.1-330-gc2ddf972 ebb0615149de cc26caf558d7 2024-09-17T01:08:26.483 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (33s) 27s ago 11m 11.8M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 0aac20af5580 2024-09-17T01:08:26.483 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (11m) 2m ago 11m 273M 2581M 17.2.7-1635-g4a704134 f22ead590bad da04ecc3dd7a 2024-09-17T01:08:26.483 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (10m) 2m ago 10m 240M 2581M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:08:26.483 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (10m) 2m ago 10m 222M 2581M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:08:26.484 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (4m) 27s ago 13m 64.0M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:08:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.484+0000 7f74cdffb640 1 -- 172.21.15.2:0/638759565 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f74d804b720 con 0x7f74c406e530 2024-09-17T01:08:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.488+0000 7f74df362640 1 -- 172.21.15.2:0/638759565 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f74c406e530 msgr2=0x7f74c40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.488+0000 7f74df362640 1 --2- 172.21.15.2:0/638759565 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f74c406e530 0x7f74c40709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74d4009ac0 tx=0x7f74d4035040 comp rx=0 tx=0).stop 2024-09-17T01:08:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.488+0000 7f74df362640 1 -- 172.21.15.2:0/638759565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d80fd3a0 msgr2=0x7f74d8115930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.488+0000 7f74df362640 1 --2- 172.21.15.2:0/638759565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d80fd3a0 0x7f74d8115930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f74c8002a80 tx=0x7f74c8004600 comp rx=0 tx=0).stop 2024-09-17T01:08:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.488+0000 7f74df362640 1 -- 172.21.15.2:0/638759565 shutdown_connections 2024-09-17T01:08:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.488+0000 7f74df362640 1 --2- 172.21.15.2:0/638759565 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f74c406e530 0x7f74c40709e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.488+0000 7f74df362640 1 --2- 172.21.15.2:0/638759565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d80fd3a0 0x7f74d8115930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.488+0000 7f74df362640 1 --2- 172.21.15.2:0/638759565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74d80fac80 0x7f74d81153f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.488+0000 7f74df362640 1 -- 172.21.15.2:0/638759565 >> 172.21.15.2:0/638759565 conn(0x7f74d8070ce0 msgr2=0x7f74d80f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:26.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.488+0000 7f74df362640 1 -- 172.21.15.2:0/638759565 shutdown_connections 2024-09-17T01:08:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.488+0000 7f74df362640 1 -- 172.21.15.2:0/638759565 wait complete. 2024-09-17T01:08:26.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.569+0000 7f040e3c4640 1 -- 172.21.15.2:0/4049642826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04080fac80 msgr2=0x7f04080fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:26.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.569+0000 7f040e3c4640 1 --2- 172.21.15.2:0/4049642826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04080fac80 0x7f04080fb0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0048d0 tx=0x7f03fc009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.569+0000 7f040e3c4640 1 -- 172.21.15.2:0/4049642826 shutdown_connections 2024-09-17T01:08:26.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.569+0000 7f040e3c4640 1 --2- 172.21.15.2:0/4049642826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04080fac80 0x7f04080fb0d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.569+0000 7f040e3c4640 1 --2- 172.21.15.2:0/4049642826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0408102660 0x7f0408102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.569+0000 7f040e3c4640 1 -- 172.21.15.2:0/4049642826 >> 172.21.15.2:0/4049642826 conn(0x7f0408070ce0 msgr2=0x7f04080710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:26.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.569+0000 7f040e3c4640 1 -- 172.21.15.2:0/4049642826 shutdown_connections 2024-09-17T01:08:26.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.569+0000 7f040e3c4640 1 -- 172.21.15.2:0/4049642826 wait complete. 2024-09-17T01:08:26.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.569+0000 7f040e3c4640 1 Processor -- start 2024-09-17T01:08:26.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.570+0000 7f040e3c4640 1 -- start start 2024-09-17T01:08:26.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.570+0000 7f040e3c4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04080fac80 0x7f0408113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:26.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.570+0000 7f040e3c4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0408102660 0x7f04081136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:26.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.570+0000 7f040e3c4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0408113cd0 con 0x7f0408102660 2024-09-17T01:08:26.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.570+0000 7f040e3c4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0408113e40 con 0x7f04080fac80 2024-09-17T01:08:26.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.570+0000 7f04077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0408102660 0x7f04081136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:26.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.570+0000 7f04077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0408102660 0x7f04081136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46092/0 (socket says 172.21.15.2:46092) 2024-09-17T01:08:26.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.570+0000 7f04077fe640 1 -- 172.21.15.2:0/6176900 learned_addr learned my addr 172.21.15.2:0/6176900 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:08:26.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.570+0000 7f0407fff640 1 --2- 172.21.15.2:0/6176900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04080fac80 0x7f0408113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:26.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.570+0000 7f04077fe640 1 -- 172.21.15.2:0/6176900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04080fac80 msgr2=0x7f0408113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:26.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.570+0000 7f04077fe640 1 --2- 172.21.15.2:0/6176900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04080fac80 0x7f0408113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.570+0000 7f04077fe640 1 -- 172.21.15.2:0/6176900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc005040 con 0x7f0408102660 2024-09-17T01:08:26.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.570+0000 7f0407fff640 1 --2- 172.21.15.2:0/6176900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04080fac80 0x7f0408113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:08:26.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.570+0000 7f04077fe640 1 --2- 172.21.15.2:0/6176900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0408102660 0x7f04081136d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f03fc003080 tx=0x7f03fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:26.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.571+0000 7f0404ff9640 1 -- 172.21.15.2:0/6176900 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03fc038070 con 0x7f0408102660 2024-09-17T01:08:26.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.571+0000 7f0404ff9640 1 -- 172.21.15.2:0/6176900 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f03fc02ade0 con 0x7f0408102660 2024-09-17T01:08:26.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.571+0000 7f040e3c4640 1 -- 172.21.15.2:0/6176900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040810d260 con 0x7f0408102660 2024-09-17T01:08:26.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.571+0000 7f040e3c4640 1 -- 172.21.15.2:0/6176900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040810d740 con 0x7f0408102660 2024-09-17T01:08:26.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.571+0000 7f0404ff9640 1 -- 172.21.15.2:0/6176900 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03fc02c880 con 0x7f0408102660 2024-09-17T01:08:26.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.572+0000 7f040e3c4640 1 -- 172.21.15.2:0/6176900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04080657d0 con 0x7f0408102660 2024-09-17T01:08:26.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.572+0000 7f0404ff9640 1 -- 172.21.15.2:0/6176900 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f03fc030020 con 0x7f0408102660 2024-09-17T01:08:26.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.573+0000 7f0404ff9640 1 --2- 172.21.15.2:0/6176900 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03f006e530 0x7f03f00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:26.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.573+0000 7f0404ff9640 1 -- 172.21.15.2:0/6176900 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6832+0+0 (secure 0 0 0) 0x7f03fc0ae340 con 0x7f0408102660 2024-09-17T01:08:26.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.573+0000 7f0407fff640 1 --2- 172.21.15.2:0/6176900 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03f006e530 0x7f03f00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:26.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.573+0000 7f0407fff640 1 --2- 172.21.15.2:0/6176900 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03f006e530 0x7f03f00709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f03f80041d0 tx=0x7f03f8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:26.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.577+0000 7f0404ff9640 1 -- 172.21.15.2:0/6176900 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f03fc0772e0 con 0x7f0408102660 2024-09-17T01:08:26.779 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:26 smithi099 podman[86434]: 2024-09-17 01:08:26.44047919 +0000 UTC m=+0.015652052 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:08:26.780 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:26 smithi099 podman[86434]: 2024-09-17 01:08:26.579799781 +0000 UTC m=+0.154972634 container create 8d0390a4df2fd0f85a9d1bd777d5268bca9795566044cdb28c55b5cc46e2825b (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-17T01:08:26.780 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:26 smithi099 podman[86434]: 2024-09-17 01:08:26.782450536 +0000 UTC m=+0.357623391 container init 8d0390a4df2fd0f85a9d1bd777d5268bca9795566044cdb28c55b5cc46e2825b (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-17T01:08:26.780 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:26 smithi099 ceph-mon[77412]: pgmap v110: 65 pgs: 16 stale+active+clean, 49 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:08:26.780 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]': finished 2024-09-17T01:08:26.780 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 3]}]': finished 2024-09-17T01:08:26.780 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 3]}]': finished 2024-09-17T01:08:26.780 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 3]}]': finished 2024-09-17T01:08:26.780 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 5]}]': finished 2024-09-17T01:08:26.780 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 2]}]': finished 2024-09-17T01:08:26.780 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 3]}]': finished 2024-09-17T01:08:26.780 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:26 smithi099 ceph-mon[77412]: osdmap e65: 6 total, 5 up, 6 in 2024-09-17T01:08:26.781 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:26 smithi099 ceph-mon[77412]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:26.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.821+0000 7f040e3c4640 1 -- 172.21.15.2:0/6176900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0408074c00 con 0x7f0408102660 2024-09-17T01:08:26.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:26 smithi002 ceph-mon[98018]: pgmap v110: 65 pgs: 16 stale+active+clean, 49 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-17T01:08:26.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [0, 2]}]': finished 2024-09-17T01:08:26.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.19", "id": [0, 3]}]': finished 2024-09-17T01:08:26.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 3]}]': finished 2024-09-17T01:08:26.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [1, 3]}]': finished 2024-09-17T01:08:26.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 5]}]': finished 2024-09-17T01:08:26.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [4, 2]}]': finished 2024-09-17T01:08:26.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [1, 3]}]': finished 2024-09-17T01:08:26.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:26 smithi002 ceph-mon[98018]: osdmap e65: 6 total, 5 up, 6 in 2024-09-17T01:08:26.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:26 smithi002 ceph-mon[98018]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:26.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.822+0000 7f0404ff9640 1 -- 172.21.15.2:0/6176900 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f03fc07a9a0 con 0x7f0408102660 2024-09-17T01:08:26.820 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:08:26.820 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:08:26.820 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:08:26.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:08:26.820 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:08:26.820 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:08:26.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:08:26.820 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:08:26.821 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 2, 2024-09-17T01:08:26.821 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:08:26.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:08:26.821 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:08:26.821 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:08:26.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:08:26.821 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:08:26.821 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 6, 2024-09-17T01:08:26.821 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 7 2024-09-17T01:08:26.821 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:08:26.821 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:08:26.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.824+0000 7f040e3c4640 1 -- 172.21.15.2:0/6176900 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03f006e530 msgr2=0x7f03f00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:26.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.824+0000 7f040e3c4640 1 --2- 172.21.15.2:0/6176900 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03f006e530 0x7f03f00709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f03f80041d0 tx=0x7f03f8009040 comp rx=0 tx=0).stop 2024-09-17T01:08:26.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.824+0000 7f040e3c4640 1 -- 172.21.15.2:0/6176900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0408102660 msgr2=0x7f04081136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:26.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.824+0000 7f040e3c4640 1 --2- 172.21.15.2:0/6176900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0408102660 0x7f04081136d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f03fc003080 tx=0x7f03fc009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.824+0000 7f040e3c4640 1 -- 172.21.15.2:0/6176900 shutdown_connections 2024-09-17T01:08:26.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.824+0000 7f040e3c4640 1 --2- 172.21.15.2:0/6176900 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03f006e530 0x7f03f00709e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.824+0000 7f040e3c4640 1 --2- 172.21.15.2:0/6176900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0408102660 0x7f04081136d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.824+0000 7f040e3c4640 1 --2- 172.21.15.2:0/6176900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04080fac80 0x7f0408113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.824+0000 7f040e3c4640 1 -- 172.21.15.2:0/6176900 >> 172.21.15.2:0/6176900 conn(0x7f0408070ce0 msgr2=0x7f04080fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:26.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.824+0000 7f040e3c4640 1 -- 172.21.15.2:0/6176900 shutdown_connections 2024-09-17T01:08:26.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.824+0000 7f040e3c4640 1 -- 172.21.15.2:0/6176900 wait complete. 2024-09-17T01:08:26.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.906+0000 7f5e6b637640 1 -- 172.21.15.2:0/3104320009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64102580 msgr2=0x7f5e64102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:26.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.906+0000 7f5e6b637640 1 --2- 172.21.15.2:0/3104320009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64102580 0x7f5e64102950 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5e600048d0 tx=0x7f5e60009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.906+0000 7f5e6b637640 1 -- 172.21.15.2:0/3104320009 shutdown_connections 2024-09-17T01:08:26.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.906+0000 7f5e6b637640 1 --2- 172.21.15.2:0/3104320009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e64102f20 0x7f5e640fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.906+0000 7f5e6b637640 1 --2- 172.21.15.2:0/3104320009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64102580 0x7f5e64102950 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.906+0000 7f5e6b637640 1 -- 172.21.15.2:0/3104320009 >> 172.21.15.2:0/3104320009 conn(0x7f5e640f81a0 msgr2=0x7f5e640fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:26.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.906+0000 7f5e6b637640 1 -- 172.21.15.2:0/3104320009 shutdown_connections 2024-09-17T01:08:26.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.906+0000 7f5e6b637640 1 -- 172.21.15.2:0/3104320009 wait complete. 2024-09-17T01:08:26.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.906+0000 7f5e6b637640 1 Processor -- start 2024-09-17T01:08:26.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.907+0000 7f5e6b637640 1 -- start start 2024-09-17T01:08:26.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.907+0000 7f5e6b637640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e64102580 0x7f5e64113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:26.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.907+0000 7f5e6b637640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64102f20 0x7f5e64113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:26.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.907+0000 7f5e6b637640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e64113d60 con 0x7f5e64102f20 2024-09-17T01:08:26.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.907+0000 7f5e6b637640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6410d1a0 con 0x7f5e64102580 2024-09-17T01:08:26.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.907+0000 7f5e68bd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64102f20 0x7f5e64113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:26.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.907+0000 7f5e68bd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64102f20 0x7f5e64113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46098/0 (socket says 172.21.15.2:46098) 2024-09-17T01:08:26.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.907+0000 7f5e68bd2640 1 -- 172.21.15.2:0/3680732199 learned_addr learned my addr 172.21.15.2:0/3680732199 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:08:26.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.907+0000 7f5e693d3640 1 --2- 172.21.15.2:0/3680732199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e64102580 0x7f5e64113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:26.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.907+0000 7f5e68bd2640 1 -- 172.21.15.2:0/3680732199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e64102580 msgr2=0x7f5e64113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:26.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.907+0000 7f5e68bd2640 1 --2- 172.21.15.2:0/3680732199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e64102580 0x7f5e64113220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:26.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.907+0000 7f5e68bd2640 1 -- 172.21.15.2:0/3680732199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60005040 con 0x7f5e64102f20 2024-09-17T01:08:26.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.907+0000 7f5e68bd2640 1 --2- 172.21.15.2:0/3680732199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64102f20 0x7f5e64113760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5e54002870 tx=0x7f5e54004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:26.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.908+0000 7f5e59ffb640 1 -- 172.21.15.2:0/3680732199 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e54007c30 con 0x7f5e64102f20 2024-09-17T01:08:26.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.908+0000 7f5e59ffb640 1 -- 172.21.15.2:0/3680732199 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e5400f040 con 0x7f5e64102f20 2024-09-17T01:08:26.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.908+0000 7f5e59ffb640 1 -- 172.21.15.2:0/3680732199 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e5400daf0 con 0x7f5e64102f20 2024-09-17T01:08:26.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.908+0000 7f5e6b637640 1 -- 172.21.15.2:0/3680732199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6410d480 con 0x7f5e64102f20 2024-09-17T01:08:26.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.908+0000 7f5e6b637640 1 -- 172.21.15.2:0/3680732199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6410d9a0 con 0x7f5e64102f20 2024-09-17T01:08:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.909+0000 7f5e6b637640 1 -- 172.21.15.2:0/3680732199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e640fdd00 con 0x7f5e64102f20 2024-09-17T01:08:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.909+0000 7f5e59ffb640 1 -- 172.21.15.2:0/3680732199 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f5e5400dc50 con 0x7f5e64102f20 2024-09-17T01:08:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.910+0000 7f5e59ffb640 1 --2- 172.21.15.2:0/3680732199 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f5e5006e530 0x7f5e500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.910+0000 7f5e59ffb640 1 -- 172.21.15.2:0/3680732199 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6832+0+0 (secure 0 0 0) 0x7f5e5408e050 con 0x7f5e64102f20 2024-09-17T01:08:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.910+0000 7f5e693d3640 1 --2- 172.21.15.2:0/3680732199 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f5e5006e530 0x7f5e500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.910+0000 7f5e693d3640 1 --2- 172.21.15.2:0/3680732199 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f5e5006e530 0x7f5e500709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009ac0 tx=0x7f5e60035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:26.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:26.914+0000 7f5e59ffb640 1 -- 172.21.15.2:0/3680732199 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5e54057070 con 0x7f5e64102f20 2024-09-17T01:08:27.043 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:26 smithi099 podman[86434]: 2024-09-17 01:08:26.785764255 +0000 UTC m=+0.360937109 container start 8d0390a4df2fd0f85a9d1bd777d5268bca9795566044cdb28c55b5cc46e2825b (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-17T01:08:27.043 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:26 smithi099 podman[86434]: 2024-09-17 01:08:26.882274711 +0000 UTC m=+0.457447583 container attach 8d0390a4df2fd0f85a9d1bd777d5268bca9795566044cdb28c55b5cc46e2825b (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-09-17T01:08:27.043 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:26 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate[86449]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:08:27.043 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:26 smithi099 bash[86434]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:08:27.043 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:26 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate[86449]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:08:27.043 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:26 smithi099 bash[86434]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:08:27.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.125+0000 7f5e6b637640 1 -- 172.21.15.2:0/3680732199 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5e640fbda0 con 0x7f5e64102f20 2024-09-17T01:08:27.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.126+0000 7f5e59ffb640 1 -- 172.21.15.2:0/3680732199 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1946 (secure 0 0 0) 0x7f5e5405a730 con 0x7f5e64102f20 2024-09-17T01:08:27.123 INFO:teuthology.orchestra.run.smithi002.stdout:e25 2024-09-17T01:08:27.123 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-17T01:05:48:747321+0000 2024-09-17T01:08:27.124 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:08:27.124 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:08:27.124 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-17T01:08:27.124 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:08:27.124 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:08:27.124 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-17T01:08:27.124 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 25 2024-09-17T01:08:27.124 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:08:27.124 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-17T00:59:20.485696+0000 2024-09-17T01:08:27.124 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-17T01:05:47.816861+0000 2024-09-17T01:08:27.124 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-17T01:08:27.124 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-17T01:08:27.124 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-17T01:08:27.124 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-17T01:08:27.125 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-17T01:08:27.125 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-17T01:08:27.125 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-17T01:08:27.125 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-17T01:08:27.125 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 44 2024-09-17T01:08:27.125 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:08:27.125 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2024-09-17T01:08:27.125 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2024-09-17T01:08:27.125 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=14464,1=24269} 2024-09-17T01:08:27.125 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-17T01:08:27.125 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-17T01:08:27.125 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-17T01:08:27.126 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-17T01:08:27.126 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-17T01:08:27.126 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-17T01:08:27.126 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-17T01:08:27.126 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-17T01:08:27.126 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-17T01:08:27.126 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 14464 members: 24269,14464 2024-09-17T01:08:27.126 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.fmyyzz{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:27.126 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.zmrgxd{0:24287} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/2986470392,v1:172.21.15.2:6827/2986470392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:27.126 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.hgawhu{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:27.126 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.heckcd{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:27.126 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:08:27.126 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:08:27.127 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-17T01:08:27.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.128+0000 7f5e6b637640 1 -- 172.21.15.2:0/3680732199 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f5e5006e530 msgr2=0x7f5e500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:27.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.128+0000 7f5e6b637640 1 --2- 172.21.15.2:0/3680732199 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f5e5006e530 0x7f5e500709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009ac0 tx=0x7f5e60035040 comp rx=0 tx=0).stop 2024-09-17T01:08:27.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.128+0000 7f5e6b637640 1 -- 172.21.15.2:0/3680732199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64102f20 msgr2=0x7f5e64113760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:27.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.128+0000 7f5e6b637640 1 --2- 172.21.15.2:0/3680732199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64102f20 0x7f5e64113760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5e54002870 tx=0x7f5e54004600 comp rx=0 tx=0).stop 2024-09-17T01:08:27.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.128+0000 7f5e6b637640 1 -- 172.21.15.2:0/3680732199 shutdown_connections 2024-09-17T01:08:27.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.128+0000 7f5e6b637640 1 --2- 172.21.15.2:0/3680732199 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f5e5006e530 0x7f5e500709e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.128+0000 7f5e6b637640 1 --2- 172.21.15.2:0/3680732199 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64102f20 0x7f5e64113760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.128+0000 7f5e6b637640 1 --2- 172.21.15.2:0/3680732199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e64102580 0x7f5e64113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.128+0000 7f5e6b637640 1 -- 172.21.15.2:0/3680732199 >> 172.21.15.2:0/3680732199 conn(0x7f5e640f81a0 msgr2=0x7f5e640f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.128+0000 7f5e6b637640 1 -- 172.21.15.2:0/3680732199 shutdown_connections 2024-09-17T01:08:27.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.128+0000 7f5e6b637640 1 -- 172.21.15.2:0/3680732199 wait complete. 2024-09-17T01:08:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.212+0000 7f84a4f86640 1 -- 172.21.15.2:0/1162037884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84a00fcf80 msgr2=0x7f84a00fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.212+0000 7f84a4f86640 1 --2- 172.21.15.2:0/1162037884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84a00fcf80 0x7f84a00fd3d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f84880048d0 tx=0x7f8488009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.212+0000 7f84a4f86640 1 -- 172.21.15.2:0/1162037884 shutdown_connections 2024-09-17T01:08:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.212+0000 7f84a4f86640 1 --2- 172.21.15.2:0/1162037884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84a00fcf80 0x7f84a00fd3d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.212+0000 7f84a4f86640 1 --2- 172.21.15.2:0/1162037884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a00fb810 0x7f84a00fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.212+0000 7f84a4f86640 1 -- 172.21.15.2:0/1162037884 >> 172.21.15.2:0/1162037884 conn(0x7f84a00723b0 msgr2=0x7f84a00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.212+0000 7f84a4f86640 1 -- 172.21.15.2:0/1162037884 shutdown_connections 2024-09-17T01:08:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.212+0000 7f84a4f86640 1 -- 172.21.15.2:0/1162037884 wait complete. 2024-09-17T01:08:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.212+0000 7f84a4f86640 1 Processor -- start 2024-09-17T01:08:27.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.212+0000 7f84a4f86640 1 -- start start 2024-09-17T01:08:27.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.213+0000 7f84a4f86640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84a00fb810 0x7f84a0113150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:27.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.213+0000 7f84a4f86640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a00fcf80 0x7f84a0113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:27.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.213+0000 7f84a4f86640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a0113c90 con 0x7f84a00fb810 2024-09-17T01:08:27.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.213+0000 7f84a4f86640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a010d0d0 con 0x7f84a00fcf80 2024-09-17T01:08:27.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.213+0000 7f849e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84a00fb810 0x7f84a0113150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:27.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.213+0000 7f849e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84a00fb810 0x7f84a0113150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46128/0 (socket says 172.21.15.2:46128) 2024-09-17T01:08:27.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.213+0000 7f849e59c640 1 -- 172.21.15.2:0/3024891393 learned_addr learned my addr 172.21.15.2:0/3024891393 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:08:27.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.213+0000 7f8497fff640 1 --2- 172.21.15.2:0/3024891393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a00fcf80 0x7f84a0113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:27.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.213+0000 7f849e59c640 1 -- 172.21.15.2:0/3024891393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a00fcf80 msgr2=0x7f84a0113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:27.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.213+0000 7f849e59c640 1 --2- 172.21.15.2:0/3024891393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a00fcf80 0x7f84a0113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.213+0000 7f849e59c640 1 -- 172.21.15.2:0/3024891393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488005040 con 0x7f84a00fb810 2024-09-17T01:08:27.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.213+0000 7f849e59c640 1 --2- 172.21.15.2:0/3024891393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84a00fb810 0x7f84a0113150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8490002a50 tx=0x7f8490004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:27.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.213+0000 7f8496ffd640 1 -- 172.21.15.2:0/3024891393 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8490007c30 con 0x7f84a00fb810 2024-09-17T01:08:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.214+0000 7f8496ffd640 1 -- 172.21.15.2:0/3024891393 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f849000f040 con 0x7f84a00fb810 2024-09-17T01:08:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.214+0000 7f84a4f86640 1 -- 172.21.15.2:0/3024891393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a010d3b0 con 0x7f84a00fb810 2024-09-17T01:08:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.214+0000 7f8496ffd640 1 -- 172.21.15.2:0/3024891393 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f849000da10 con 0x7f84a00fb810 2024-09-17T01:08:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.214+0000 7f84a4f86640 1 -- 172.21.15.2:0/3024891393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a010d920 con 0x7f84a00fb810 2024-09-17T01:08:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.215+0000 7f84a4f86640 1 -- 172.21.15.2:0/3024891393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a00fcbc0 con 0x7f84a00fb810 2024-09-17T01:08:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.215+0000 7f8496ffd640 1 -- 172.21.15.2:0/3024891393 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f849000dc80 con 0x7f84a00fb810 2024-09-17T01:08:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.216+0000 7f8496ffd640 1 --2- 172.21.15.2:0/3024891393 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f848c06e530 0x7f848c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.216+0000 7f8496ffd640 1 -- 172.21.15.2:0/3024891393 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6832+0+0 (secure 0 0 0) 0x7f849008da80 con 0x7f84a00fb810 2024-09-17T01:08:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.216+0000 7f8497fff640 1 --2- 172.21.15.2:0/3024891393 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f848c06e530 0x7f848c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:27.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.216+0000 7f8497fff640 1 --2- 172.21.15.2:0/3024891393 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f848c06e530 0x7f848c0709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8488009ac0 tx=0x7f8488035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:27.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.220+0000 7f8496ffd640 1 -- 172.21.15.2:0/3024891393 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8490056ad0 con 0x7f84a00fb810 2024-09-17T01:08:27.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.412+0000 7f84a4f86640 1 -- 172.21.15.2:0/3024891393 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84a004b780 con 0x7f848c06e530 2024-09-17T01:08:27.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.413+0000 7f8496ffd640 1 -- 172.21.15.2:0/3024891393 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f84a004b780 con 0x7f848c06e530 2024-09-17T01:08:27.411 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:08:27.411 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:08:27.411 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:08:27.411 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:08:27.411 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-17T01:08:27.411 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-17T01:08:27.411 INFO:teuthology.orchestra.run.smithi002.stdout: "mon", 2024-09-17T01:08:27.411 INFO:teuthology.orchestra.run.smithi002.stdout: "crash" 2024-09-17T01:08:27.411 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-17T01:08:27.411 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "9/21 daemons upgraded", 2024-09-17T01:08:27.411 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:08:27.411 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:08:27.411 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.415+0000 7f84a4f86640 1 -- 172.21.15.2:0/3024891393 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f848c06e530 msgr2=0x7f848c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.416+0000 7f84a4f86640 1 --2- 172.21.15.2:0/3024891393 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f848c06e530 0x7f848c0709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8488009ac0 tx=0x7f8488035040 comp rx=0 tx=0).stop 2024-09-17T01:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.416+0000 7f84a4f86640 1 -- 172.21.15.2:0/3024891393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84a00fb810 msgr2=0x7f84a0113150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.416+0000 7f84a4f86640 1 --2- 172.21.15.2:0/3024891393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84a00fb810 0x7f84a0113150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8490002a50 tx=0x7f8490004600 comp rx=0 tx=0).stop 2024-09-17T01:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.416+0000 7f84a4f86640 1 -- 172.21.15.2:0/3024891393 shutdown_connections 2024-09-17T01:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.416+0000 7f84a4f86640 1 --2- 172.21.15.2:0/3024891393 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f848c06e530 0x7f848c0709e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.416+0000 7f84a4f86640 1 --2- 172.21.15.2:0/3024891393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a00fcf80 0x7f84a0113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.416+0000 7f84a4f86640 1 --2- 172.21.15.2:0/3024891393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84a00fb810 0x7f84a0113150 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.416+0000 7f84a4f86640 1 -- 172.21.15.2:0/3024891393 >> 172.21.15.2:0/3024891393 conn(0x7f84a00723b0 msgr2=0x7f84a0101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.416+0000 7f84a4f86640 1 -- 172.21.15.2:0/3024891393 shutdown_connections 2024-09-17T01:08:27.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.416+0000 7f84a4f86640 1 -- 172.21.15.2:0/3024891393 wait complete. 2024-09-17T01:08:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.508+0000 7fca2f2e9640 1 -- 172.21.15.2:0/1813006785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2806fa30 msgr2=0x7fca2806fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.508+0000 7fca2f2e9640 1 --2- 172.21.15.2:0/1813006785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2806fa30 0x7fca2806fe00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fca240048d0 tx=0x7fca24009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.508+0000 7fca2f2e9640 1 -- 172.21.15.2:0/1813006785 shutdown_connections 2024-09-17T01:08:27.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.508+0000 7fca2f2e9640 1 --2- 172.21.15.2:0/1813006785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca28070340 0x7fca28108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.508+0000 7fca2f2e9640 1 --2- 172.21.15.2:0/1813006785 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2806fa30 0x7fca2806fe00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.508+0000 7fca2f2e9640 1 -- 172.21.15.2:0/1813006785 >> 172.21.15.2:0/1813006785 conn(0x7fca280f8100 msgr2=0x7fca280fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:27.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.508+0000 7fca2f2e9640 1 -- 172.21.15.2:0/1813006785 shutdown_connections 2024-09-17T01:08:27.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.508+0000 7fca2f2e9640 1 -- 172.21.15.2:0/1813006785 wait complete. 2024-09-17T01:08:27.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.509+0000 7fca2f2e9640 1 Processor -- start 2024-09-17T01:08:27.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.509+0000 7fca2f2e9640 1 -- start start 2024-09-17T01:08:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.509+0000 7fca2f2e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2806fa30 0x7fca281153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.509+0000 7fca2f2e9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca28070340 0x7fca28115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.509+0000 7fca2f2e9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca28115f20 con 0x7fca2806fa30 2024-09-17T01:08:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.509+0000 7fca2f2e9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca28116090 con 0x7fca28070340 2024-09-17T01:08:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.509+0000 7fca2d085640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2806fa30 0x7fca281153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:27.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.509+0000 7fca2d085640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2806fa30 0x7fca281153e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46158/0 (socket says 172.21.15.2:46158) 2024-09-17T01:08:27.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.509+0000 7fca2d085640 1 -- 172.21.15.2:0/3457551303 learned_addr learned my addr 172.21.15.2:0/3457551303 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:08:27.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.509+0000 7fca2c884640 1 --2- 172.21.15.2:0/3457551303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca28070340 0x7fca28115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:27.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.510+0000 7fca2d085640 1 -- 172.21.15.2:0/3457551303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca28070340 msgr2=0x7fca28115920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:27.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.510+0000 7fca2d085640 1 --2- 172.21.15.2:0/3457551303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca28070340 0x7fca28115920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.510+0000 7fca2d085640 1 -- 172.21.15.2:0/3457551303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca24005040 con 0x7fca2806fa30 2024-09-17T01:08:27.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.510+0000 7fca2d085640 1 --2- 172.21.15.2:0/3457551303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2806fa30 0x7fca281153e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fca24000c00 tx=0x7fca24009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:27.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.510+0000 7fca1dffb640 1 -- 172.21.15.2:0/3457551303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca24038070 con 0x7fca2806fa30 2024-09-17T01:08:27.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.510+0000 7fca2f2e9640 1 -- 172.21.15.2:0/3457551303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2810f4b0 con 0x7fca2806fa30 2024-09-17T01:08:27.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.510+0000 7fca1dffb640 1 -- 172.21.15.2:0/3457551303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fca2402ade0 con 0x7fca2806fa30 2024-09-17T01:08:27.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.510+0000 7fca1dffb640 1 -- 172.21.15.2:0/3457551303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca2402c7e0 con 0x7fca2806fa30 2024-09-17T01:08:27.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.511+0000 7fca2f2e9640 1 -- 172.21.15.2:0/3457551303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2810f970 con 0x7fca2806fa30 2024-09-17T01:08:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.512+0000 7fca2f2e9640 1 -- 172.21.15.2:0/3457551303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca28071170 con 0x7fca2806fa30 2024-09-17T01:08:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.512+0000 7fca1dffb640 1 -- 172.21.15.2:0/3457551303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fca24030020 con 0x7fca2806fa30 2024-09-17T01:08:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.513+0000 7fca1dffb640 1 --2- 172.21.15.2:0/3457551303 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fca1406e530 0x7fca140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.513+0000 7fca1dffb640 1 -- 172.21.15.2:0/3457551303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6832+0+0 (secure 0 0 0) 0x7fca240ade30 con 0x7fca2806fa30 2024-09-17T01:08:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.513+0000 7fca2c884640 1 --2- 172.21.15.2:0/3457551303 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fca1406e530 0x7fca140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.514+0000 7fca2c884640 1 --2- 172.21.15.2:0/3457551303 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fca1406e530 0x7fca140709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fca28110ce0 tx=0x7fca1800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:27.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.522+0000 7fca1dffb640 1 -- 172.21.15.2:0/3457551303 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fca24076f00 con 0x7fca2806fa30 2024-09-17T01:08:27.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.781+0000 7fca2f2e9640 1 -- 172.21.15.2:0/3457551303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fca280fbd60 con 0x7fca2806fa30 2024-09-17T01:08:27.778 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:27 smithi002 ceph-mon[98018]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:27.778 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:27 smithi002 ceph-mon[98018]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:27.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:27 smithi002 ceph-mon[98018]: osdmap e66: 6 total, 5 up, 6 in 2024-09-17T01:08:27.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:27 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/6176900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:27.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:27 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3680732199' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:08:27.779 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:27 smithi002 ceph-mon[98018]: osdmap e67: 6 total, 5 up, 6 in 2024-09-17T01:08:27.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.781+0000 7fca1dffb640 1 -- 172.21.15.2:0/3457551303 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1701 (secure 0 0 0) 0x7fca240416c0 con 0x7fca2806fa30 2024-09-17T01:08:27.779 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 1 pg peering; Degraded data redundancy: 71/345 objects degraded (20.580%), 19 pgs degraded 2024-09-17T01:08:27.779 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:08:27.779 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:08:27.780 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:08:27.780 INFO:teuthology.orchestra.run.smithi002.stdout: osd.3 (root=default,host=smithi099) is down 2024-09-17T01:08:27.780 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 1 pg peering 2024-09-17T01:08:27.780 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.19 is stuck peering for 95s, current state peering, last acting [4,2] 2024-09-17T01:08:27.780 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 71/345 objects degraded (20.580%), 19 pgs degraded 2024-09-17T01:08:27.780 INFO:teuthology.orchestra.run.smithi002.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-17T01:08:27.780 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-17T01:08:27.780 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-17T01:08:27.780 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-17T01:08:27.780 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-17T01:08:27.780 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-17T01:08:27.780 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-17T01:08:27.780 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-17T01:08:27.780 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-17T01:08:27.781 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-17T01:08:27.781 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.11 is active+undersized+degraded, acting [4,1] 2024-09-17T01:08:27.781 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-09-17T01:08:27.781 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-17T01:08:27.781 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-17T01:08:27.781 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-17T01:08:27.781 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-17T01:08:27.781 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-17T01:08:27.781 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-17T01:08:27.781 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-17T01:08:27.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.784+0000 7fca2f2e9640 1 -- 172.21.15.2:0/3457551303 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fca1406e530 msgr2=0x7fca140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:27.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.784+0000 7fca2f2e9640 1 --2- 172.21.15.2:0/3457551303 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fca1406e530 0x7fca140709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fca28110ce0 tx=0x7fca1800b040 comp rx=0 tx=0).stop 2024-09-17T01:08:27.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.784+0000 7fca2f2e9640 1 -- 172.21.15.2:0/3457551303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2806fa30 msgr2=0x7fca281153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:27.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.784+0000 7fca2f2e9640 1 --2- 172.21.15.2:0/3457551303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2806fa30 0x7fca281153e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fca24000c00 tx=0x7fca24009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.784+0000 7fca2f2e9640 1 -- 172.21.15.2:0/3457551303 shutdown_connections 2024-09-17T01:08:27.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.784+0000 7fca2f2e9640 1 --2- 172.21.15.2:0/3457551303 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fca1406e530 0x7fca140709e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.784+0000 7fca2f2e9640 1 --2- 172.21.15.2:0/3457551303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca28070340 0x7fca28115920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.784+0000 7fca2f2e9640 1 --2- 172.21.15.2:0/3457551303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2806fa30 0x7fca281153e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:27.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.784+0000 7fca2f2e9640 1 -- 172.21.15.2:0/3457551303 >> 172.21.15.2:0/3457551303 conn(0x7fca280f8100 msgr2=0x7fca280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:27.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.784+0000 7fca2f2e9640 1 -- 172.21.15.2:0/3457551303 shutdown_connections 2024-09-17T01:08:27.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:27.784+0000 7fca2f2e9640 1 -- 172.21.15.2:0/3457551303 wait complete. 2024-09-17T01:08:27.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:27 smithi099 ceph-mon[77412]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:27.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:27 smithi099 ceph-mon[77412]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:27.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:27 smithi099 ceph-mon[77412]: osdmap e66: 6 total, 5 up, 6 in 2024-09-17T01:08:27.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:27 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/6176900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:27.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:27 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3680732199' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:08:27.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:27 smithi099 ceph-mon[77412]: osdmap e67: 6 total, 5 up, 6 in 2024-09-17T01:08:27.793 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate[86449]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:08:27.793 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 bash[86434]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:08:27.793 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate[86449]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:08:27.793 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 bash[86434]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:08:28.293 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate[86449]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:08:28.293 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 bash[86434]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:08:28.293 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate[86449]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:08:28.293 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 bash[86434]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:08:28.293 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate[86449]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-17T01:08:28.293 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 bash[86434]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-17T01:08:28.293 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate[86449]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:08:28.293 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 bash[86434]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:08:28.294 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate[86449]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T01:08:28.294 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 bash[86434]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T01:08:28.294 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:27 smithi099 podman[86434]: 2024-09-17 01:08:27.969725543 +0000 UTC m=+1.544898402 container died 8d0390a4df2fd0f85a9d1bd777d5268bca9795566044cdb28c55b5cc46e2825b (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-17T01:08:28.642 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:28 smithi099 ceph-mon[77412]: pgmap v113: 65 pgs: 4 peering, 1 unknown, 17 active+undersized, 1 stale+active+clean, 19 active+undersized+degraded, 23 active+clean; 292 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 71/345 objects degraded (20.580%) 2024-09-17T01:08:28.642 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:28 smithi099 ceph-mon[77412]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:28.642 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:28 smithi099 ceph-mon[77412]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T01:08:28.642 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:28 smithi099 ceph-mon[77412]: Health check failed: Degraded data redundancy: 71/345 objects degraded (20.580%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:28.642 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:28 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3457551303' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:08:28.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:28 smithi002 ceph-mon[98018]: pgmap v113: 65 pgs: 4 peering, 1 unknown, 17 active+undersized, 1 stale+active+clean, 19 active+undersized+degraded, 23 active+clean; 292 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 71/345 objects degraded (20.580%) 2024-09-17T01:08:28.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:28 smithi002 ceph-mon[98018]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:28.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:28 smithi002 ceph-mon[98018]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T01:08:28.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:28 smithi002 ceph-mon[98018]: Health check failed: Degraded data redundancy: 71/345 objects degraded (20.580%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:28.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:28 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3457551303' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:08:28.976 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:28 smithi099 podman[86594]: 2024-09-17 01:08:28.645292922 +0000 UTC m=+0.669328968 container remove 8d0390a4df2fd0f85a9d1bd777d5268bca9795566044cdb28c55b5cc46e2825b (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97) 2024-09-17T01:08:28.976 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:28 smithi099 podman[86655]: 2024-09-17 01:08:28.754391502 +0000 UTC m=+0.015516223 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:08:28.976 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:28 smithi099 podman[86655]: 2024-09-17 01:08:28.863156613 +0000 UTC m=+0.124281334 container create 0740cf987fef35ee53b2ce5b50dc0b64a1eab23a28aa5779e9a0172b86775ea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux ) 2024-09-17T01:08:29.496 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:29 smithi099 podman[86655]: 2024-09-17 01:08:29.085075195 +0000 UTC m=+0.346199925 container init 0740cf987fef35ee53b2ce5b50dc0b64a1eab23a28aa5779e9a0172b86775ea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-17T01:08:29.496 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:29 smithi099 podman[86655]: 2024-09-17 01:08:29.088361529 +0000 UTC m=+0.349486258 container start 0740cf987fef35ee53b2ce5b50dc0b64a1eab23a28aa5779e9a0172b86775ea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-17T01:08:29.496 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:29 smithi099 ceph-osd[86674]: -- 172.21.15.99:0/1468035557 <== mon.1 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e3b362c1e0 con 0x55e3b27d5c00 2024-09-17T01:08:29.496 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:29 smithi099 bash[86655]: 0740cf987fef35ee53b2ce5b50dc0b64a1eab23a28aa5779e9a0172b86775ea3 2024-09-17T01:08:29.496 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:29 smithi099 systemd[1]: Started Ceph osd.3 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:08:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:29 smithi099 ceph-mon[77412]: osdmap e68: 6 total, 5 up, 6 in 2024-09-17T01:08:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:29 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:29 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:29.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:29 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:29.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:29 smithi002 ceph-mon[98018]: osdmap e68: 6 total, 5 up, 6 in 2024-09-17T01:08:29.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:29 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:29.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:29 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:29.806 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:29 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:30.756 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:30 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3[86670]: 2024-09-17T01:08:30.715+0000 7f1832a6f640 -1 Falling back to public interface 2024-09-17T01:08:30.756 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:30 smithi099 ceph-mon[77412]: pgmap v116: 65 pgs: 4 peering, 1 unknown, 17 active+undersized, 1 stale+active+clean, 19 active+undersized+degraded, 23 active+clean; 292 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 71/345 objects degraded (20.580%) 2024-09-17T01:08:30.756 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:30 smithi099 ceph-mon[77412]: osdmap e69: 6 total, 5 up, 6 in 2024-09-17T01:08:30.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:30 smithi002 ceph-mon[98018]: pgmap v116: 65 pgs: 4 peering, 1 unknown, 17 active+undersized, 1 stale+active+clean, 19 active+undersized+degraded, 23 active+clean; 292 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 71/345 objects degraded (20.580%) 2024-09-17T01:08:30.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:30 smithi002 ceph-mon[98018]: osdmap e69: 6 total, 5 up, 6 in 2024-09-17T01:08:31.642 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:31 smithi099 ceph-mon[77412]: osdmap e70: 6 total, 5 up, 6 in 2024-09-17T01:08:31.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:31 smithi002 ceph-mon[98018]: osdmap e70: 6 total, 5 up, 6 in 2024-09-17T01:08:32.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:32 smithi002 ceph-mon[98018]: pgmap v119: 65 pgs: 5 active+clean+remapped, 1 active+undersized+remapped, 1 peering, 16 active+undersized, 19 active+undersized+degraded, 23 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 125 op/s; 71/354 objects degraded (20.056%); 6/354 objects misplaced (1.695%); 2.0 MiB/s, 356 objects/s recovering 2024-09-17T01:08:32.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:32 smithi002 ceph-mon[98018]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T01:08:32.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:32 smithi002 ceph-mon[98018]: osdmap e71: 6 total, 5 up, 6 in 2024-09-17T01:08:32.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:32.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:32 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:32.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:32 smithi099 ceph-mon[77412]: pgmap v119: 65 pgs: 5 active+clean+remapped, 1 active+undersized+remapped, 1 peering, 16 active+undersized, 19 active+undersized+degraded, 23 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 125 op/s; 71/354 objects degraded (20.056%); 6/354 objects misplaced (1.695%); 2.0 MiB/s, 356 objects/s recovering 2024-09-17T01:08:32.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:32 smithi099 ceph-mon[77412]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T01:08:32.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:32 smithi099 ceph-mon[77412]: osdmap e71: 6 total, 5 up, 6 in 2024-09-17T01:08:32.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:32.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:32 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:33.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:33 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:33.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:33 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:33.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:33 smithi002 ceph-mon[98018]: Health check update: Degraded data redundancy: 71/354 objects degraded (20.056%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:34.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:33 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:34.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:33 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:34.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:33 smithi099 ceph-mon[77412]: Health check update: Degraded data redundancy: 71/354 objects degraded (20.056%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:34.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:34 smithi002 ceph-mon[98018]: pgmap v121: 65 pgs: 6 active+clean+remapped, 1 active+undersized+remapped, 16 active+undersized, 19 active+undersized+degraded, 23 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 109 op/s; 71/354 objects degraded (20.056%); 10/354 objects misplaced (2.825%); 1.7 MiB/s, 311 objects/s recovering 2024-09-17T01:08:35.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:34 smithi099 ceph-mon[77412]: pgmap v121: 65 pgs: 6 active+clean+remapped, 1 active+undersized+remapped, 16 active+undersized, 19 active+undersized+degraded, 23 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 109 op/s; 71/354 objects degraded (20.056%); 10/354 objects misplaced (2.825%); 1.7 MiB/s, 311 objects/s recovering 2024-09-17T01:08:36.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:36 smithi002 ceph-mon[98018]: pgmap v122: 65 pgs: 6 active+clean+remapped, 1 active+undersized+remapped, 16 active+undersized, 19 active+undersized+degraded, 23 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 83 op/s; 71/354 objects degraded (20.056%); 10/354 objects misplaced (2.825%); 1.3 MiB/s, 237 objects/s recovering 2024-09-17T01:08:36.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:36 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:36.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:36 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:36.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:36 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:36.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:36 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:36.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:36 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:36.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:36 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:36.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:36 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:36.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:36 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:36.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:36 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:36.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:36 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:08:36.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:36 smithi002 ceph-mon[98018]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:08:36.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:36 smithi002 ceph-mon[98018]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-09-17T01:08:37.293 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:36 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3[86670]: 2024-09-17T01:08:36.881+0000 7f1832a6f640 -1 osd.3 62 log_to_monitors true 2024-09-17T01:08:37.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:36 smithi099 ceph-mon[77412]: pgmap v122: 65 pgs: 6 active+clean+remapped, 1 active+undersized+remapped, 16 active+undersized, 19 active+undersized+degraded, 23 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 83 op/s; 71/354 objects degraded (20.056%); 10/354 objects misplaced (2.825%); 1.3 MiB/s, 237 objects/s recovering 2024-09-17T01:08:37.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:36 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:37.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:36 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:37.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:36 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:37.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:36 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:08:37.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:36 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:37.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:36 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:08:37.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:36 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:37.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:36 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:37.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:36 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:37.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:36 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:08:37.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:36 smithi099 ceph-mon[77412]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:08:37.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:36 smithi099 ceph-mon[77412]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-09-17T01:08:38.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:37 smithi002 ceph-mon[98018]: from='osd.3 [v2:172.21.15.99:6800/467895627,v1:172.21.15.99:6801/467895627]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:08:38.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:37 smithi002 ceph-mon[98018]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:08:38.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:37 smithi099 ceph-mon[77412]: from='osd.3 [v2:172.21.15.99:6800/467895627,v1:172.21.15.99:6801/467895627]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:08:38.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:37 smithi099 ceph-mon[77412]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:08:39.043 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:08:38 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3[86670]: 2024-09-17T01:08:38.637+0000 7f1826801640 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:08:39.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:38 smithi099 ceph-mon[77412]: pgmap v123: 65 pgs: 7 active+clean+remapped, 16 active+undersized, 19 active+undersized+degraded, 23 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 69 op/s; 71/354 objects degraded (20.056%); 10/354 objects misplaced (2.825%); 1.1 MiB/s, 188 objects/s recovering 2024-09-17T01:08:39.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:38 smithi099 ceph-mon[77412]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:08:39.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:38 smithi099 ceph-mon[77412]: osdmap e72: 6 total, 5 up, 6 in 2024-09-17T01:08:39.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:38 smithi099 ceph-mon[77412]: from='osd.3 [v2:172.21.15.99:6800/467895627,v1:172.21.15.99:6801/467895627]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T01:08:39.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:38 smithi099 ceph-mon[77412]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T01:08:39.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:38 smithi099 ceph-mon[77412]: from='osd.3 ' entity='osd.3' 2024-09-17T01:08:39.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:38 smithi002 ceph-mon[98018]: pgmap v123: 65 pgs: 7 active+clean+remapped, 16 active+undersized, 19 active+undersized+degraded, 23 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 69 op/s; 71/354 objects degraded (20.056%); 10/354 objects misplaced (2.825%); 1.1 MiB/s, 188 objects/s recovering 2024-09-17T01:08:39.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:38 smithi002 ceph-mon[98018]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:08:39.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:38 smithi002 ceph-mon[98018]: osdmap e72: 6 total, 5 up, 6 in 2024-09-17T01:08:39.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:38 smithi002 ceph-mon[98018]: from='osd.3 [v2:172.21.15.99:6800/467895627,v1:172.21.15.99:6801/467895627]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T01:08:39.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:38 smithi002 ceph-mon[98018]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T01:08:39.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:38 smithi002 ceph-mon[98018]: from='osd.3 ' entity='osd.3' 2024-09-17T01:08:40.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:39 smithi002 ceph-mon[98018]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:08:40.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:39 smithi002 ceph-mon[98018]: osd.3 [v2:172.21.15.99:6800/467895627,v1:172.21.15.99:6801/467895627] boot 2024-09-17T01:08:40.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:39 smithi002 ceph-mon[98018]: osdmap e73: 6 total, 6 up, 6 in 2024-09-17T01:08:40.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:39 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:08:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:39 smithi099 ceph-mon[77412]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:08:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:39 smithi099 ceph-mon[77412]: osd.3 [v2:172.21.15.99:6800/467895627,v1:172.21.15.99:6801/467895627] boot 2024-09-17T01:08:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:39 smithi099 ceph-mon[77412]: osdmap e73: 6 total, 6 up, 6 in 2024-09-17T01:08:40.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:39 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:08:41.145 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:40 smithi002 ceph-mon[98018]: pgmap v125: 65 pgs: 7 active+clean+remapped, 16 active+undersized, 19 active+undersized+degraded, 23 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 71/354 objects degraded (20.056%); 10/354 objects misplaced (2.825%) 2024-09-17T01:08:41.145 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:40 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:41.145 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:40 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:41.145 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:40 smithi002 ceph-mon[98018]: osdmap e74: 6 total, 6 up, 6 in 2024-09-17T01:08:41.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:40 smithi099 ceph-mon[77412]: pgmap v125: 65 pgs: 7 active+clean+remapped, 16 active+undersized, 19 active+undersized+degraded, 23 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 71/354 objects degraded (20.056%); 10/354 objects misplaced (2.825%) 2024-09-17T01:08:41.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:40 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:41.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:40 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:41.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:40 smithi099 ceph-mon[77412]: osdmap e74: 6 total, 6 up, 6 in 2024-09-17T01:08:42.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:42 smithi002 ceph-mon[98018]: pgmap v128: 65 pgs: 7 peering, 5 remapped+peering, 2 active+clean+remapped, 7 active+undersized, 13 active+undersized+degraded, 31 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 5 op/s; 54/354 objects degraded (15.254%); 4/354 objects misplaced (1.130%) 2024-09-17T01:08:42.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:42 smithi002 ceph-mon[98018]: osdmap e75: 6 total, 6 up, 6 in 2024-09-17T01:08:42.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:42 smithi002 ceph-mon[98018]: Health check update: Degraded data redundancy: 54/354 objects degraded (15.254%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:43.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:42 smithi099 ceph-mon[77412]: pgmap v128: 65 pgs: 7 peering, 5 remapped+peering, 2 active+clean+remapped, 7 active+undersized, 13 active+undersized+degraded, 31 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 5 op/s; 54/354 objects degraded (15.254%); 4/354 objects misplaced (1.130%) 2024-09-17T01:08:43.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:42 smithi099 ceph-mon[77412]: osdmap e75: 6 total, 6 up, 6 in 2024-09-17T01:08:43.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:42 smithi099 ceph-mon[77412]: Health check update: Degraded data redundancy: 54/354 objects degraded (15.254%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T01:08:43.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:43 smithi002 ceph-mon[98018]: osdmap e76: 6 total, 6 up, 6 in 2024-09-17T01:08:43.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:43 smithi002 ceph-mon[98018]: osdmap e77: 6 total, 6 up, 6 in 2024-09-17T01:08:44.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:43 smithi099 ceph-mon[77412]: osdmap e76: 6 total, 6 up, 6 in 2024-09-17T01:08:44.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:43 smithi099 ceph-mon[77412]: osdmap e77: 6 total, 6 up, 6 in 2024-09-17T01:08:44.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:44 smithi002 ceph-mon[98018]: pgmap v131: 65 pgs: 8 peering, 3 remapped+peering, 54 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:08:44.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:44 smithi002 ceph-mon[98018]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T01:08:44.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:44 smithi002 ceph-mon[98018]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 54/354 objects degraded (15.254%), 13 pgs degraded) 2024-09-17T01:08:44.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:44 smithi002 ceph-mon[98018]: osdmap e78: 6 total, 6 up, 6 in 2024-09-17T01:08:45.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:44 smithi099 ceph-mon[77412]: pgmap v131: 65 pgs: 8 peering, 3 remapped+peering, 54 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:08:45.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:44 smithi099 ceph-mon[77412]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-17T01:08:45.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:44 smithi099 ceph-mon[77412]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 54/354 objects degraded (15.254%), 13 pgs degraded) 2024-09-17T01:08:45.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:44 smithi099 ceph-mon[77412]: osdmap e78: 6 total, 6 up, 6 in 2024-09-17T01:08:46.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:46 smithi002 ceph-mon[98018]: pgmap v134: 65 pgs: 8 peering, 3 remapped+peering, 54 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:46.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:46 smithi002 ceph-mon[98018]: osdmap e79: 6 total, 6 up, 6 in 2024-09-17T01:08:47.053 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:46 smithi099 ceph-mon[77412]: pgmap v134: 65 pgs: 8 peering, 3 remapped+peering, 54 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-17T01:08:47.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:46 smithi099 ceph-mon[77412]: osdmap e79: 6 total, 6 up, 6 in 2024-09-17T01:08:48.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:48 smithi002 ceph-mon[98018]: pgmap v136: 65 pgs: 1 peering, 64 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 2.7 MiB/s, 313 objects/s recovering 2024-09-17T01:08:49.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:48 smithi099 ceph-mon[77412]: pgmap v136: 65 pgs: 1 peering, 64 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 2.7 MiB/s, 313 objects/s recovering 2024-09-17T01:08:49.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:49 smithi002 ceph-mon[98018]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T01:08:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:49 smithi099 ceph-mon[77412]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-17T01:08:50.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:50 smithi002 ceph-mon[98018]: pgmap v137: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 2.0 MiB/s, 232 objects/s recovering 2024-09-17T01:08:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:50 smithi099 ceph-mon[77412]: pgmap v137: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 2.0 MiB/s, 232 objects/s recovering 2024-09-17T01:08:51.871 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:08:51.871 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:51 smithi099 ceph-mon[77412]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:08:51.871 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:51 smithi099 ceph-mon[77412]: Upgrade: osd.4 is safe to restart 2024-09-17T01:08:51.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:08:51.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:51 smithi002 ceph-mon[98018]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:08:51.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:51 smithi002 ceph-mon[98018]: Upgrade: osd.4 is safe to restart 2024-09-17T01:08:52.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:52 smithi002 ceph-mon[98018]: pgmap v138: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s; 1.6 MiB/s, 184 objects/s recovering 2024-09-17T01:08:53.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:52 smithi099 ceph-mon[77412]: pgmap v138: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s; 1.6 MiB/s, 184 objects/s recovering 2024-09-17T01:08:53.999 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:53 smithi099 ceph-mon[77412]: Upgrade: Updating osd.4 2024-09-17T01:08:53.999 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:53 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:53.999 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:53 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:08:53.999 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:53 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:53.999 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:53 smithi099 ceph-mon[77412]: Deploying daemon osd.4 on smithi099 2024-09-17T01:08:54.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:53 smithi002 ceph-mon[98018]: Upgrade: Updating osd.4 2024-09-17T01:08:54.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:53 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:54.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:53 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:08:54.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:53 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:08:54.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:53 smithi002 ceph-mon[98018]: Deploying daemon osd.4 on smithi099 2024-09-17T01:08:54.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:54 smithi099 ceph-mon[77412]: pgmap v139: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s; 1.4 MiB/s, 163 objects/s recovering 2024-09-17T01:08:55.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:54 smithi002 ceph-mon[98018]: pgmap v139: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s; 1.4 MiB/s, 163 objects/s recovering 2024-09-17T01:08:56.056 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:55 smithi099 systemd[1]: Stopping Ceph osd.4 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:08:56.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:56 smithi002 ceph-mon[98018]: pgmap v140: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 1.2 MiB/s, 139 objects/s recovering 2024-09-17T01:08:56.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:56 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:56.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:56 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:56.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:56 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:56.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:56 smithi002 ceph-mon[98018]: osd.4 marked itself down and dead 2024-09-17T01:08:56.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:56 smithi099 ceph-mon[77412]: pgmap v140: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 1.2 MiB/s, 139 objects/s recovering 2024-09-17T01:08:56.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:56 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:56.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:56 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:08:56.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:56 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:08:56.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:56 smithi099 ceph-mon[77412]: osd.4 marked itself down and dead 2024-09-17T01:08:56.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:56 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[46622]: 2024-09-17T01:08:56.057+0000 7f7e7e45e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:08:56.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:56 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[46622]: 2024-09-17T01:08:56.057+0000 7f7e7e45e640 -1 osd.4 79 *** Got signal Terminated *** 2024-09-17T01:08:56.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:56 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[46622]: 2024-09-17T01:08:56.057+0000 7f7e7e45e640 -1 osd.4 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:08:57.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:57 smithi002 ceph-mon[98018]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:08:57.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:57 smithi002 ceph-mon[98018]: osdmap e80: 6 total, 5 up, 6 in 2024-09-17T01:08:57.540 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:57 smithi099 ceph-mon[77412]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:08:57.540 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:57 smithi099 ceph-mon[77412]: osdmap e80: 6 total, 5 up, 6 in 2024-09-17T01:08:57.540 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:57 smithi099 podman[91511]: 2024-09-17 01:08:57.25399474 +0000 UTC m=+1.305288485 container died 1cbfa35df7be573d1d6d138df048f3975e1d99bb8416f31b42f5c8e226b5163a (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-4a70413, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True) 2024-09-17T01:08:57.792 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:57 smithi099 podman[91511]: 2024-09-17 01:08:57.716101349 +0000 UTC m=+1.767395097 container cleanup 1cbfa35df7be573d1d6d138df048f3975e1d99bb8416f31b42f5c8e226b5163a (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=quincy-4a70413, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-17T01:08:57.793 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:57 smithi099 bash[91511]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4 2024-09-17T01:08:57.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.874+0000 7f9f59576640 1 -- 172.21.15.2:0/1500582946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f540fdf40 msgr2=0x7f9f54106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:57.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.874+0000 7f9f59576640 1 --2- 172.21.15.2:0/1500582946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f540fdf40 0x7f9f54106610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9f480048d0 tx=0x7f9f48009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:57.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.874+0000 7f9f59576640 1 -- 172.21.15.2:0/1500582946 shutdown_connections 2024-09-17T01:08:57.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.874+0000 7f9f59576640 1 --2- 172.21.15.2:0/1500582946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f540fdf40 0x7f9f54106610 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:57.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.874+0000 7f9f59576640 1 --2- 172.21.15.2:0/1500582946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f540fd5a0 0x7f9f540fd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:57.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.874+0000 7f9f59576640 1 -- 172.21.15.2:0/1500582946 >> 172.21.15.2:0/1500582946 conn(0x7f9f540f7000 msgr2=0x7f9f540f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:57.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.874+0000 7f9f59576640 1 -- 172.21.15.2:0/1500582946 shutdown_connections 2024-09-17T01:08:57.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.874+0000 7f9f59576640 1 -- 172.21.15.2:0/1500582946 wait complete. 2024-09-17T01:08:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.875+0000 7f9f59576640 1 Processor -- start 2024-09-17T01:08:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.875+0000 7f9f59576640 1 -- start start 2024-09-17T01:08:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.875+0000 7f9f59576640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f540fd5a0 0x7f9f54113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.875+0000 7f9f59576640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f540fdf40 0x7f9f541137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.875+0000 7f9f59576640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f54113da0 con 0x7f9f540fdf40 2024-09-17T01:08:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.875+0000 7f9f59576640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5410d1e0 con 0x7f9f540fd5a0 2024-09-17T01:08:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.875+0000 7f9f527fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f540fdf40 0x7f9f541137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.875+0000 7f9f527fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f540fdf40 0x7f9f541137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38328/0 (socket says 172.21.15.2:38328) 2024-09-17T01:08:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.875+0000 7f9f527fc640 1 -- 172.21.15.2:0/1844839249 learned_addr learned my addr 172.21.15.2:0/1844839249 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:08:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.875+0000 7f9f52ffd640 1 --2- 172.21.15.2:0/1844839249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f540fd5a0 0x7f9f54113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.876+0000 7f9f527fc640 1 -- 172.21.15.2:0/1844839249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f540fd5a0 msgr2=0x7f9f54113260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:57.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.876+0000 7f9f527fc640 1 --2- 172.21.15.2:0/1844839249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f540fd5a0 0x7f9f54113260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.876+0000 7f9f527fc640 1 -- 172.21.15.2:0/1844839249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f48005040 con 0x7f9f540fdf40 2024-09-17T01:08:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.876+0000 7f9f527fc640 1 --2- 172.21.15.2:0/1844839249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f540fdf40 0x7f9f541137a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f48004930 tx=0x7f9f48009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.876+0000 7f9f3b7fe640 1 -- 172.21.15.2:0/1844839249 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f48038070 con 0x7f9f540fdf40 2024-09-17T01:08:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.876+0000 7f9f3b7fe640 1 -- 172.21.15.2:0/1844839249 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9f48032d00 con 0x7f9f540fdf40 2024-09-17T01:08:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.876+0000 7f9f59576640 1 -- 172.21.15.2:0/1844839249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5410d460 con 0x7f9f540fdf40 2024-09-17T01:08:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.876+0000 7f9f3b7fe640 1 -- 172.21.15.2:0/1844839249 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f480095c0 con 0x7f9f540fdf40 2024-09-17T01:08:57.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.876+0000 7f9f59576640 1 -- 172.21.15.2:0/1844839249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5410d920 con 0x7f9f540fdf40 2024-09-17T01:08:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.877+0000 7f9f59576640 1 -- 172.21.15.2:0/1844839249 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f54066210 con 0x7f9f540fdf40 2024-09-17T01:08:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.878+0000 7f9f3b7fe640 1 -- 172.21.15.2:0/1844839249 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f9f48030020 con 0x7f9f540fdf40 2024-09-17T01:08:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.878+0000 7f9f3b7fe640 1 --2- 172.21.15.2:0/1844839249 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f9f3c06e530 0x7f9f3c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.878+0000 7f9f3b7fe640 1 -- 172.21.15.2:0/1844839249 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f9f480adfb0 con 0x7f9f540fdf40 2024-09-17T01:08:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.878+0000 7f9f52ffd640 1 --2- 172.21.15.2:0/1844839249 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f9f3c06e530 0x7f9f3c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:57.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.879+0000 7f9f52ffd640 1 --2- 172.21.15.2:0/1844839249 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f9f3c06e530 0x7f9f3c0709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9f44007fd0 tx=0x7f9f44009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:57.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:57.883+0000 7f9f3b7fe640 1 -- 172.21.15.2:0/1844839249 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9f48077190 con 0x7f9f540fdf40 2024-09-17T01:08:58.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.074+0000 7f9f59576640 1 -- 172.21.15.2:0/1844839249 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f541094f0 con 0x7f9f3c06e530 2024-09-17T01:08:58.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.075+0000 7f9f3b7fe640 1 -- 172.21.15.2:0/1844839249 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9f541094f0 con 0x7f9f3c06e530 2024-09-17T01:08:58.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.078+0000 7f9f59576640 1 -- 172.21.15.2:0/1844839249 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f9f3c06e530 msgr2=0x7f9f3c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:58.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.078+0000 7f9f59576640 1 --2- 172.21.15.2:0/1844839249 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f9f3c06e530 0x7f9f3c0709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9f44007fd0 tx=0x7f9f44009040 comp rx=0 tx=0).stop 2024-09-17T01:08:58.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.078+0000 7f9f59576640 1 -- 172.21.15.2:0/1844839249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f540fdf40 msgr2=0x7f9f541137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:58.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.078+0000 7f9f59576640 1 --2- 172.21.15.2:0/1844839249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f540fdf40 0x7f9f541137a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f48004930 tx=0x7f9f48009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.078+0000 7f9f59576640 1 -- 172.21.15.2:0/1844839249 shutdown_connections 2024-09-17T01:08:58.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.078+0000 7f9f59576640 1 --2- 172.21.15.2:0/1844839249 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f9f3c06e530 0x7f9f3c0709e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.078+0000 7f9f59576640 1 --2- 172.21.15.2:0/1844839249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f540fdf40 0x7f9f541137a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.078+0000 7f9f59576640 1 --2- 172.21.15.2:0/1844839249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f540fd5a0 0x7f9f54113260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.078+0000 7f9f59576640 1 -- 172.21.15.2:0/1844839249 >> 172.21.15.2:0/1844839249 conn(0x7f9f540f7000 msgr2=0x7f9f540f85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:58.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.078+0000 7f9f59576640 1 -- 172.21.15.2:0/1844839249 shutdown_connections 2024-09-17T01:08:58.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.078+0000 7f9f59576640 1 -- 172.21.15.2:0/1844839249 wait complete. 2024-09-17T01:08:58.085 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:08:58.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.160+0000 7fdf511b8640 1 -- 172.21.15.2:0/2568169331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c0fcf80 msgr2=0x7fdf4c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.160+0000 7fdf511b8640 1 --2- 172.21.15.2:0/2568169331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c0fcf80 0x7fdf4c0fd3d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdf400048d0 tx=0x7fdf40009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.160+0000 7fdf511b8640 1 -- 172.21.15.2:0/2568169331 shutdown_connections 2024-09-17T01:08:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.160+0000 7fdf511b8640 1 --2- 172.21.15.2:0/2568169331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c0fcf80 0x7fdf4c0fd3d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.160+0000 7fdf511b8640 1 --2- 172.21.15.2:0/2568169331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf4c0fb810 0x7fdf4c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.160+0000 7fdf511b8640 1 -- 172.21.15.2:0/2568169331 >> 172.21.15.2:0/2568169331 conn(0x7fdf4c0723b0 msgr2=0x7fdf4c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.160+0000 7fdf511b8640 1 -- 172.21.15.2:0/2568169331 shutdown_connections 2024-09-17T01:08:58.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.160+0000 7fdf511b8640 1 -- 172.21.15.2:0/2568169331 wait complete. 2024-09-17T01:08:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.161+0000 7fdf511b8640 1 Processor -- start 2024-09-17T01:08:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.161+0000 7fdf511b8640 1 -- start start 2024-09-17T01:08:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.161+0000 7fdf511b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c0fb810 0x7fdf4c10e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.161+0000 7fdf511b8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf4c0fcf80 0x7fdf4c10e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.161+0000 7fdf511b8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c10ecb0 con 0x7fdf4c0fb810 2024-09-17T01:08:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.161+0000 7fdf511b8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4c10ee20 con 0x7fdf4c0fcf80 2024-09-17T01:08:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.161+0000 7fdf4ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c0fb810 0x7fdf4c10e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.161+0000 7fdf4ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c0fb810 0x7fdf4c10e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38356/0 (socket says 172.21.15.2:38356) 2024-09-17T01:08:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.161+0000 7fdf4ad9d640 1 -- 172.21.15.2:0/3296048034 learned_addr learned my addr 172.21.15.2:0/3296048034 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:08:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.161+0000 7fdf4a59c640 1 --2- 172.21.15.2:0/3296048034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf4c0fcf80 0x7fdf4c10e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:58.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.161+0000 7fdf4ad9d640 1 -- 172.21.15.2:0/3296048034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf4c0fcf80 msgr2=0x7fdf4c10e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.161+0000 7fdf4ad9d640 1 --2- 172.21.15.2:0/3296048034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf4c0fcf80 0x7fdf4c10e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.161+0000 7fdf4ad9d640 1 -- 172.21.15.2:0/3296048034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf40005040 con 0x7fdf4c0fb810 2024-09-17T01:08:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.162+0000 7fdf4ad9d640 1 --2- 172.21.15.2:0/3296048034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c0fb810 0x7fdf4c10e170 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c002a50 tx=0x7fdf3c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.162+0000 7fdf337fe640 1 -- 172.21.15.2:0/3296048034 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf3c007c30 con 0x7fdf4c0fb810 2024-09-17T01:08:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.162+0000 7fdf511b8640 1 -- 172.21.15.2:0/3296048034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4c1171e0 con 0x7fdf4c0fb810 2024-09-17T01:08:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.162+0000 7fdf337fe640 1 -- 172.21.15.2:0/3296048034 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdf3c00f040 con 0x7fdf4c0fb810 2024-09-17T01:08:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.162+0000 7fdf337fe640 1 -- 172.21.15.2:0/3296048034 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf3c00da10 con 0x7fdf4c0fb810 2024-09-17T01:08:58.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.162+0000 7fdf511b8640 1 -- 172.21.15.2:0/3296048034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4c1176a0 con 0x7fdf4c0fb810 2024-09-17T01:08:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.163+0000 7fdf511b8640 1 -- 172.21.15.2:0/3296048034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf4c0fcbc0 con 0x7fdf4c0fb810 2024-09-17T01:08:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.163+0000 7fdf337fe640 1 -- 172.21.15.2:0/3296048034 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fdf3c00dc80 con 0x7fdf4c0fb810 2024-09-17T01:08:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.164+0000 7fdf337fe640 1 --2- 172.21.15.2:0/3296048034 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fdf3406e530 0x7fdf340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.164+0000 7fdf4a59c640 1 --2- 172.21.15.2:0/3296048034 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fdf3406e530 0x7fdf340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.164+0000 7fdf337fe640 1 -- 172.21.15.2:0/3296048034 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6613+0+0 (secure 0 0 0) 0x7fdf3c08d9b0 con 0x7fdf4c0fb810 2024-09-17T01:08:58.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.165+0000 7fdf4a59c640 1 --2- 172.21.15.2:0/3296048034 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fdf3406e530 0x7fdf340709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009ac0 tx=0x7fdf40035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:58.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.169+0000 7fdf337fe640 1 -- 172.21.15.2:0/3296048034 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdf3c056ad0 con 0x7fdf4c0fb810 2024-09-17T01:08:58.292 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:58 smithi099 podman[91528]: 2024-09-17 01:08:58.011405067 +0000 UTC m=+0.754715318 container remove 1cbfa35df7be573d1d6d138df048f3975e1d99bb8416f31b42f5c8e226b5163a (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=quincy-4a70413, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:08:58.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.362+0000 7fdf511b8640 1 -- 172.21.15.2:0/3296048034 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf4c04b720 con 0x7fdf3406e530 2024-09-17T01:08:58.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.363+0000 7fdf337fe640 1 -- 172.21.15.2:0/3296048034 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fdf4c04b720 con 0x7fdf3406e530 2024-09-17T01:08:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.365+0000 7fdf511b8640 1 -- 172.21.15.2:0/3296048034 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fdf3406e530 msgr2=0x7fdf340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.365+0000 7fdf511b8640 1 --2- 172.21.15.2:0/3296048034 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fdf3406e530 0x7fdf340709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009ac0 tx=0x7fdf40035040 comp rx=0 tx=0).stop 2024-09-17T01:08:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.365+0000 7fdf511b8640 1 -- 172.21.15.2:0/3296048034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c0fb810 msgr2=0x7fdf4c10e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.365+0000 7fdf511b8640 1 --2- 172.21.15.2:0/3296048034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c0fb810 0x7fdf4c10e170 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c002a50 tx=0x7fdf3c004600 comp rx=0 tx=0).stop 2024-09-17T01:08:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.366+0000 7fdf511b8640 1 -- 172.21.15.2:0/3296048034 shutdown_connections 2024-09-17T01:08:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.366+0000 7fdf511b8640 1 --2- 172.21.15.2:0/3296048034 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fdf3406e530 0x7fdf340709e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.366+0000 7fdf511b8640 1 --2- 172.21.15.2:0/3296048034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf4c0fcf80 0x7fdf4c10e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.366+0000 7fdf511b8640 1 --2- 172.21.15.2:0/3296048034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf4c0fb810 0x7fdf4c10e170 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.366+0000 7fdf511b8640 1 -- 172.21.15.2:0/3296048034 >> 172.21.15.2:0/3296048034 conn(0x7fdf4c0723b0 msgr2=0x7fdf4c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.366+0000 7fdf511b8640 1 -- 172.21.15.2:0/3296048034 shutdown_connections 2024-09-17T01:08:58.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.366+0000 7fdf511b8640 1 -- 172.21.15.2:0/3296048034 wait complete. 2024-09-17T01:08:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.446+0000 7f183c38a640 1 -- 172.21.15.2:0/1788865360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834102580 msgr2=0x7f1834102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:58.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.446+0000 7f183c38a640 1 --2- 172.21.15.2:0/1788865360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834102580 0x7f1834102950 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1824009c50 tx=0x7f1824004d10 comp rx=0 tx=0).stop 2024-09-17T01:08:58.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.446+0000 7f183c38a640 1 -- 172.21.15.2:0/1788865360 shutdown_connections 2024-09-17T01:08:58.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.446+0000 7f183c38a640 1 --2- 172.21.15.2:0/1788865360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1834102f20 0x7f18340fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.446+0000 7f183c38a640 1 --2- 172.21.15.2:0/1788865360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834102580 0x7f1834102950 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.446+0000 7f183c38a640 1 -- 172.21.15.2:0/1788865360 >> 172.21.15.2:0/1788865360 conn(0x7f18340f81a0 msgr2=0x7f18340fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:58.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.446+0000 7f183c38a640 1 -- 172.21.15.2:0/1788865360 shutdown_connections 2024-09-17T01:08:58.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.446+0000 7f183c38a640 1 -- 172.21.15.2:0/1788865360 wait complete. 2024-09-17T01:08:58.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.447+0000 7f183c38a640 1 Processor -- start 2024-09-17T01:08:58.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.447+0000 7f183c38a640 1 -- start start 2024-09-17T01:08:58.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.447+0000 7f183c38a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834102580 0x7f1834115410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:58.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.447+0000 7f183c38a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1834102f20 0x7f1834115950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:58.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.447+0000 7f183c38a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1834115f50 con 0x7f1834102580 2024-09-17T01:08:58.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.447+0000 7f183c38a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18341160c0 con 0x7f1834102f20 2024-09-17T01:08:58.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.447+0000 7f183a126640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834102580 0x7f1834115410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:58.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.447+0000 7f183a126640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834102580 0x7f1834115410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38378/0 (socket says 172.21.15.2:38378) 2024-09-17T01:08:58.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.447+0000 7f183a126640 1 -- 172.21.15.2:0/370875094 learned_addr learned my addr 172.21.15.2:0/370875094 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:08:58.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.447+0000 7f1839925640 1 --2- 172.21.15.2:0/370875094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1834102f20 0x7f1834115950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:58.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.448+0000 7f183a126640 1 -- 172.21.15.2:0/370875094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1834102f20 msgr2=0x7f1834115950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:58.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.448+0000 7f183a126640 1 --2- 172.21.15.2:0/370875094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1834102f20 0x7f1834115950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.448+0000 7f183a126640 1 -- 172.21.15.2:0/370875094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18240098b0 con 0x7f1834102580 2024-09-17T01:08:58.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.448+0000 7f183a126640 1 --2- 172.21.15.2:0/370875094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834102580 0x7f1834115410 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1824004750 tx=0x7f1824004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:58.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.448+0000 7f1832ffd640 1 -- 172.21.15.2:0/370875094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1824009610 con 0x7f1834102580 2024-09-17T01:08:58.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.448+0000 7f1832ffd640 1 -- 172.21.15.2:0/370875094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1824032b10 con 0x7f1834102580 2024-09-17T01:08:58.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.448+0000 7f183c38a640 1 -- 172.21.15.2:0/370875094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183410f4e0 con 0x7f1834102580 2024-09-17T01:08:58.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.448+0000 7f1832ffd640 1 -- 172.21.15.2:0/370875094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f182403d990 con 0x7f1834102580 2024-09-17T01:08:58.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.448+0000 7f183c38a640 1 -- 172.21.15.2:0/370875094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183410fa80 con 0x7f1834102580 2024-09-17T01:08:58.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.449+0000 7f183c38a640 1 -- 172.21.15.2:0/370875094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18340fdd00 con 0x7f1834102580 2024-09-17T01:08:58.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.450+0000 7f1832ffd640 1 -- 172.21.15.2:0/370875094 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f182402f030 con 0x7f1834102580 2024-09-17T01:08:58.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.450+0000 7f1832ffd640 1 --2- 172.21.15.2:0/370875094 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f181c06e530 0x7f181c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:58.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.451+0000 7f1839925640 1 --2- 172.21.15.2:0/370875094 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f181c06e530 0x7f181c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:58.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.451+0000 7f1832ffd640 1 -- 172.21.15.2:0/370875094 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f18240af1d0 con 0x7f1834102580 2024-09-17T01:08:58.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.451+0000 7f1839925640 1 --2- 172.21.15.2:0/370875094 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f181c06e530 0x7f181c0709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1834110d10 tx=0x7f182800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:58.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.455+0000 7f1832ffd640 1 -- 172.21.15.2:0/370875094 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1824078380 con 0x7f1834102580 2024-09-17T01:08:58.587 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:58 smithi099 podman[91615]: 2024-09-17 01:08:58.230951525 +0000 UTC m=+0.015997925 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:08:58.587 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:58 smithi099 podman[91615]: 2024-09-17 01:08:58.338127037 +0000 UTC m=+0.123173436 container create c6d456f047874af840316a8dad942826c06e7e3c1295ebddf54d18c281275255 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-17T01:08:58.587 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:58 smithi099 podman[91615]: 2024-09-17 01:08:58.590256776 +0000 UTC m=+0.375303179 container init c6d456f047874af840316a8dad942826c06e7e3c1295ebddf54d18c281275255 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-17T01:08:58.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.639+0000 7f183c38a640 1 -- 172.21.15.2:0/370875094 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1834110ac0 con 0x7f181c06e530 2024-09-17T01:08:58.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.648+0000 7f1832ffd640 1 -- 172.21.15.2:0/370875094 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f1834110ac0 con 0x7f181c06e530 2024-09-17T01:08:58.647 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:08:58.647 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (6m) 60s ago 14m 25.3M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:08:58.647 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (2m) 60s ago 15m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de b7ed6c8d5a92 2024-09-17T01:08:58.647 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (2m) 26s ago 14m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de ae713b940078 2024-09-17T01:08:58.647 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (4m) 60s ago 14m 81.8M - 9.4.12 2bacad6d85d8 5fe408c103d6 2024-09-17T01:08:58.647 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (9m) 60s ago 9m 124M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:08:58.648 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (9m) 60s ago 9m 65.0M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:08:58.648 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (9m) 26s ago 9m 64.8M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:08:58.648 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (9m) 26s ago 9m 115M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:08:58.648 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (5m) 60s ago 16m 497M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:08:58.648 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (5m) 26s ago 14m 441M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:08:58.648 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (3m) 60s ago 16m 47.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de da5247385c2d 2024-09-17T01:08:58.648 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (3m) 26s ago 13m 37.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b92f98b2cab9 2024-09-17T01:08:58.648 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (6m) 60s ago 15m 16.3M - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:08:58.648 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (5m) 26s ago 14m 16.1M - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:08:58.648 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (2m) 60s ago 13m 94.2M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 563188d6089b 2024-09-17T01:08:58.648 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (101s) 60s ago 12m 100M 1558M 19.1.1-330-gc2ddf972 ebb0615149de cc26caf558d7 2024-09-17T01:08:58.649 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (65s) 60s ago 12m 11.8M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 0aac20af5580 2024-09-17T01:08:58.649 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (29s) 26s ago 11m 14.4M 2581M 19.1.1-330-gc2ddf972 ebb0615149de 0740cf987fef 2024-09-17T01:08:58.649 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (11m) 26s ago 11m 239M 2581M 17.2.7-1635-g4a704134 f22ead590bad 1cbfa35df7be 2024-09-17T01:08:58.649 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (11m) 26s ago 11m 229M 2581M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:08:58.649 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (5m) 60s ago 14m 64.0M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:08:58.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.651+0000 7f183c38a640 1 -- 172.21.15.2:0/370875094 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f181c06e530 msgr2=0x7f181c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:58.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.651+0000 7f183c38a640 1 --2- 172.21.15.2:0/370875094 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f181c06e530 0x7f181c0709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1834110d10 tx=0x7f182800b040 comp rx=0 tx=0).stop 2024-09-17T01:08:58.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.651+0000 7f183c38a640 1 -- 172.21.15.2:0/370875094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834102580 msgr2=0x7f1834115410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:58.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.651+0000 7f183c38a640 1 --2- 172.21.15.2:0/370875094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834102580 0x7f1834115410 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1824004750 tx=0x7f1824004d10 comp rx=0 tx=0).stop 2024-09-17T01:08:58.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.651+0000 7f183c38a640 1 -- 172.21.15.2:0/370875094 shutdown_connections 2024-09-17T01:08:58.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.651+0000 7f183c38a640 1 --2- 172.21.15.2:0/370875094 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f181c06e530 0x7f181c0709e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.651+0000 7f183c38a640 1 --2- 172.21.15.2:0/370875094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1834102f20 0x7f1834115950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.651+0000 7f183c38a640 1 --2- 172.21.15.2:0/370875094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1834102580 0x7f1834115410 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.651+0000 7f183c38a640 1 -- 172.21.15.2:0/370875094 >> 172.21.15.2:0/370875094 conn(0x7f18340f81a0 msgr2=0x7f18340f9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:58.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.651+0000 7f183c38a640 1 -- 172.21.15.2:0/370875094 shutdown_connections 2024-09-17T01:08:58.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.651+0000 7f183c38a640 1 -- 172.21.15.2:0/370875094 wait complete. 2024-09-17T01:08:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.733+0000 7f1e966d6640 1 -- 172.21.15.2:0/3962082066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e900fac80 msgr2=0x7f1e900fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:58.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.733+0000 7f1e966d6640 1 --2- 172.21.15.2:0/3962082066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e900fac80 0x7f1e900fb0f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1e840048d0 tx=0x7f1e84009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.733+0000 7f1e966d6640 1 -- 172.21.15.2:0/3962082066 shutdown_connections 2024-09-17T01:08:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.733+0000 7f1e966d6640 1 --2- 172.21.15.2:0/3962082066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e900fac80 0x7f1e900fb0f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.733+0000 7f1e966d6640 1 --2- 172.21.15.2:0/3962082066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e90102620 0x7f1e901029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.733+0000 7f1e966d6640 1 -- 172.21.15.2:0/3962082066 >> 172.21.15.2:0/3962082066 conn(0x7f1e90070ce0 msgr2=0x7f1e900710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.734+0000 7f1e966d6640 1 -- 172.21.15.2:0/3962082066 shutdown_connections 2024-09-17T01:08:58.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.734+0000 7f1e966d6640 1 -- 172.21.15.2:0/3962082066 wait complete. 2024-09-17T01:08:58.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:58 smithi002 ceph-mon[98018]: pgmap v142: 65 pgs: 6 stale+active+clean, 59 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:08:58.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:58 smithi002 ceph-mon[98018]: osdmap e81: 6 total, 5 up, 6 in 2024-09-17T01:08:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.734+0000 7f1e966d6640 1 Processor -- start 2024-09-17T01:08:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.734+0000 7f1e966d6640 1 -- start start 2024-09-17T01:08:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.735+0000 7f1e966d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e900fac80 0x7f1e901131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.735+0000 7f1e966d6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e90102620 0x7f1e90113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:58.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.735+0000 7f1e966d6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e90113d20 con 0x7f1e900fac80 2024-09-17T01:08:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.735+0000 7f1e966d6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9010d160 con 0x7f1e90102620 2024-09-17T01:08:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.735+0000 7f1e8ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e900fac80 0x7f1e901131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.735+0000 7f1e8ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e900fac80 0x7f1e901131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38404/0 (socket says 172.21.15.2:38404) 2024-09-17T01:08:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.735+0000 7f1e8ffff640 1 -- 172.21.15.2:0/3718226976 learned_addr learned my addr 172.21.15.2:0/3718226976 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:08:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.735+0000 7f1e8f7fe640 1 --2- 172.21.15.2:0/3718226976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e90102620 0x7f1e90113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.735+0000 7f1e8ffff640 1 -- 172.21.15.2:0/3718226976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e90102620 msgr2=0x7f1e90113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.735+0000 7f1e8ffff640 1 --2- 172.21.15.2:0/3718226976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e90102620 0x7f1e90113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.735+0000 7f1e8ffff640 1 -- 172.21.15.2:0/3718226976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e84005040 con 0x7f1e900fac80 2024-09-17T01:08:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.735+0000 7f1e8ffff640 1 --2- 172.21.15.2:0/3718226976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e900fac80 0x7f1e901131e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000eb70 tx=0x7f1e8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:58.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.735+0000 7f1e8cff9640 1 -- 172.21.15.2:0/3718226976 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e80007c30 con 0x7f1e900fac80 2024-09-17T01:08:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.735+0000 7f1e8cff9640 1 -- 172.21.15.2:0/3718226976 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1e8000f040 con 0x7f1e900fac80 2024-09-17T01:08:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.736+0000 7f1e966d6640 1 -- 172.21.15.2:0/3718226976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9010d3e0 con 0x7f1e900fac80 2024-09-17T01:08:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.736+0000 7f1e966d6640 1 -- 172.21.15.2:0/3718226976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9010d950 con 0x7f1e900fac80 2024-09-17T01:08:58.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.736+0000 7f1e8cff9640 1 -- 172.21.15.2:0/3718226976 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e8000ca60 con 0x7f1e900fac80 2024-09-17T01:08:58.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.737+0000 7f1e966d6640 1 -- 172.21.15.2:0/3718226976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e900657b0 con 0x7f1e900fac80 2024-09-17T01:08:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.737+0000 7f1e8cff9640 1 -- 172.21.15.2:0/3718226976 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f1e8000cbc0 con 0x7f1e900fac80 2024-09-17T01:08:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.738+0000 7f1e8cff9640 1 --2- 172.21.15.2:0/3718226976 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1e7806e530 0x7f1e780709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.738+0000 7f1e8cff9640 1 -- 172.21.15.2:0/3718226976 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f1e8008dd80 con 0x7f1e900fac80 2024-09-17T01:08:58.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.738+0000 7f1e8f7fe640 1 --2- 172.21.15.2:0/3718226976 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1e7806e530 0x7f1e780709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:58.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.738+0000 7f1e8f7fe640 1 --2- 172.21.15.2:0/3718226976 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1e7806e530 0x7f1e780709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1e900f8f90 tx=0x7f1e84035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:58.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.743+0000 7f1e8cff9640 1 -- 172.21.15.2:0/3718226976 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1e80056f20 con 0x7f1e900fac80 2024-09-17T01:08:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.990+0000 7f1e966d6640 1 -- 172.21.15.2:0/3718226976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e9004b720 con 0x7f1e900fac80 2024-09-17T01:08:58.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.991+0000 7f1e8cff9640 1 -- 172.21.15.2:0/3718226976 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f1e8005a5e0 con 0x7f1e900fac80 2024-09-17T01:08:58.990 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:08:58.990 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:08:58.990 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:08:58.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:08:58.990 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:08:58.990 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:08:58.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:08:58.990 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:08:58.990 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 1, 2024-09-17T01:08:58.990 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:08:58.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:08:58.990 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:08:58.991 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:08:58.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:08:58.991 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:08:58.991 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 5, 2024-09-17T01:08:58.991 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 8 2024-09-17T01:08:58.991 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:08:58.991 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:08:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.994+0000 7f1e966d6640 1 -- 172.21.15.2:0/3718226976 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1e7806e530 msgr2=0x7f1e780709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.994+0000 7f1e966d6640 1 --2- 172.21.15.2:0/3718226976 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1e7806e530 0x7f1e780709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1e900f8f90 tx=0x7f1e84035040 comp rx=0 tx=0).stop 2024-09-17T01:08:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.994+0000 7f1e966d6640 1 -- 172.21.15.2:0/3718226976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e900fac80 msgr2=0x7f1e901131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.994+0000 7f1e966d6640 1 --2- 172.21.15.2:0/3718226976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e900fac80 0x7f1e901131e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000eb70 tx=0x7f1e8000b040 comp rx=0 tx=0).stop 2024-09-17T01:08:58.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.994+0000 7f1e966d6640 1 -- 172.21.15.2:0/3718226976 shutdown_connections 2024-09-17T01:08:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.994+0000 7f1e966d6640 1 --2- 172.21.15.2:0/3718226976 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1e7806e530 0x7f1e780709e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.994+0000 7f1e966d6640 1 --2- 172.21.15.2:0/3718226976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e90102620 0x7f1e90113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.994+0000 7f1e966d6640 1 --2- 172.21.15.2:0/3718226976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e900fac80 0x7f1e901131e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.994+0000 7f1e966d6640 1 -- 172.21.15.2:0/3718226976 >> 172.21.15.2:0/3718226976 conn(0x7f1e90070ce0 msgr2=0x7f1e90105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.994+0000 7f1e966d6640 1 -- 172.21.15.2:0/3718226976 shutdown_connections 2024-09-17T01:08:58.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:58.994+0000 7f1e966d6640 1 -- 172.21.15.2:0/3718226976 wait complete. 2024-09-17T01:08:59.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:58 smithi099 ceph-mon[77412]: pgmap v142: 65 pgs: 6 stale+active+clean, 59 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:08:59.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:58 smithi099 ceph-mon[77412]: osdmap e81: 6 total, 5 up, 6 in 2024-09-17T01:08:59.043 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:58 smithi099 podman[91615]: 2024-09-17 01:08:58.593588636 +0000 UTC m=+0.378635036 container start c6d456f047874af840316a8dad942826c06e7e3c1295ebddf54d18c281275255 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-17T01:08:59.043 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:58 smithi099 podman[91615]: 2024-09-17 01:08:58.715428172 +0000 UTC m=+0.500474589 container attach c6d456f047874af840316a8dad942826c06e7e3c1295ebddf54d18c281275255 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-17T01:08:59.043 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:58 smithi099 podman[91615]: 2024-09-17 01:08:58.791744636 +0000 UTC m=+0.576791036 container died c6d456f047874af840316a8dad942826c06e7e3c1295ebddf54d18c281275255 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-17T01:08:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.074+0000 7f59dde24640 1 -- 172.21.15.2:0/432688790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d80fe460 msgr2=0x7f59d80fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.074+0000 7f59dde24640 1 --2- 172.21.15.2:0/432688790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d80fe460 0x7f59d80fe830 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f59c80048d0 tx=0x7f59c8009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.075+0000 7f59dde24640 1 -- 172.21.15.2:0/432688790 shutdown_connections 2024-09-17T01:08:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.075+0000 7f59dde24640 1 --2- 172.21.15.2:0/432688790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d8064fc0 0x7f59d8065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.075+0000 7f59dde24640 1 --2- 172.21.15.2:0/432688790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d80fe460 0x7f59d80fe830 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.075+0000 7f59dde24640 1 -- 172.21.15.2:0/432688790 >> 172.21.15.2:0/432688790 conn(0x7f59d80723b0 msgr2=0x7f59d80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.075+0000 7f59dde24640 1 -- 172.21.15.2:0/432688790 shutdown_connections 2024-09-17T01:08:59.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.075+0000 7f59dde24640 1 -- 172.21.15.2:0/432688790 wait complete. 2024-09-17T01:08:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.075+0000 7f59dde24640 1 Processor -- start 2024-09-17T01:08:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.075+0000 7f59dde24640 1 -- start start 2024-09-17T01:08:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59dde24640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d8064fc0 0x7f59d8113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59dde24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d80fe460 0x7f59d8113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59dde24640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d8113dd0 con 0x7f59d80fe460 2024-09-17T01:08:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59dde24640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d810d180 con 0x7f59d8064fc0 2024-09-17T01:08:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d80fe460 0x7f59d8113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d80fe460 0x7f59d8113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38434/0 (socket says 172.21.15.2:38434) 2024-09-17T01:08:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59d77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d8064fc0 0x7f59d8113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:59.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59d6ffd640 1 -- 172.21.15.2:0/238179153 learned_addr learned my addr 172.21.15.2:0/238179153 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:08:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59d6ffd640 1 -- 172.21.15.2:0/238179153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d8064fc0 msgr2=0x7f59d8113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59d6ffd640 1 --2- 172.21.15.2:0/238179153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d8064fc0 0x7f59d8113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59d6ffd640 1 -- 172.21.15.2:0/238179153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c8005040 con 0x7f59d80fe460 2024-09-17T01:08:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59d6ffd640 1 --2- 172.21.15.2:0/238179153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d80fe460 0x7f59d8113740 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00b790 tx=0x7f59cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59bffff640 1 -- 172.21.15.2:0/238179153 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59cc00c700 con 0x7f59d80fe460 2024-09-17T01:08:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59bffff640 1 -- 172.21.15.2:0/238179153 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f59cc00cd00 con 0x7f59d80fe460 2024-09-17T01:08:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59dde24640 1 -- 172.21.15.2:0/238179153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d810d460 con 0x7f59d80fe460 2024-09-17T01:08:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.076+0000 7f59bffff640 1 -- 172.21.15.2:0/238179153 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59cc015e80 con 0x7f59d80fe460 2024-09-17T01:08:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.077+0000 7f59dde24640 1 -- 172.21.15.2:0/238179153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d810d980 con 0x7f59d80fe460 2024-09-17T01:08:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.078+0000 7f59dde24640 1 -- 172.21.15.2:0/238179153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d80fdcf0 con 0x7f59d80fe460 2024-09-17T01:08:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.078+0000 7f59bffff640 1 -- 172.21.15.2:0/238179153 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f59cc012070 con 0x7f59d80fe460 2024-09-17T01:08:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.079+0000 7f59bffff640 1 --2- 172.21.15.2:0/238179153 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f59c006e530 0x7f59c00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:59.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.079+0000 7f59bffff640 1 -- 172.21.15.2:0/238179153 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f59cc08da40 con 0x7f59d80fe460 2024-09-17T01:08:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.079+0000 7f59d77fe640 1 --2- 172.21.15.2:0/238179153 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f59c006e530 0x7f59c00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:59.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.079+0000 7f59d77fe640 1 --2- 172.21.15.2:0/238179153 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f59c006e530 0x7f59c00709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009ac0 tx=0x7f59c8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:59.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.083+0000 7f59bffff640 1 -- 172.21.15.2:0/238179153 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f59cc056b30 con 0x7f59d80fe460 2024-09-17T01:08:59.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.295+0000 7f59dde24640 1 -- 172.21.15.2:0/238179153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f59d8072ec0 con 0x7f59d80fe460 2024-09-17T01:08:59.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.296+0000 7f59bffff640 1 -- 172.21.15.2:0/238179153 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1946 (secure 0 0 0) 0x7f59cc05a1f0 con 0x7f59d80fe460 2024-09-17T01:08:59.294 INFO:teuthology.orchestra.run.smithi002.stdout:e25 2024-09-17T01:08:59.294 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-17T01:05:48:747321+0000 2024-09-17T01:08:59.294 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:08:59.295 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:08:59.295 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-17T01:08:59.295 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:08:59.295 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:08:59.295 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-17T01:08:59.295 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 25 2024-09-17T01:08:59.295 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:08:59.295 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-17T00:59:20.485696+0000 2024-09-17T01:08:59.295 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-17T01:05:47.816861+0000 2024-09-17T01:08:59.295 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-17T01:08:59.295 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-17T01:08:59.295 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-17T01:08:59.295 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-17T01:08:59.296 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-17T01:08:59.296 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-17T01:08:59.296 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-17T01:08:59.296 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-17T01:08:59.296 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 44 2024-09-17T01:08:59.296 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:08:59.296 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2024-09-17T01:08:59.296 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2024-09-17T01:08:59.296 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=14464,1=24269} 2024-09-17T01:08:59.296 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-17T01:08:59.296 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-17T01:08:59.296 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-17T01:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-17T01:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-17T01:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-17T01:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-17T01:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-17T01:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-17T01:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 14464 members: 24269,14464 2024-09-17T01:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.fmyyzz{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.zmrgxd{0:24287} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/2986470392,v1:172.21.15.2:6827/2986470392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.hgawhu{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.heckcd{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:08:59.297 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:08:59.298 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-17T01:08:59.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.298+0000 7f59dde24640 1 -- 172.21.15.2:0/238179153 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f59c006e530 msgr2=0x7f59c00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:59.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.298+0000 7f59dde24640 1 --2- 172.21.15.2:0/238179153 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f59c006e530 0x7f59c00709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009ac0 tx=0x7f59c8035040 comp rx=0 tx=0).stop 2024-09-17T01:08:59.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.298+0000 7f59dde24640 1 -- 172.21.15.2:0/238179153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d80fe460 msgr2=0x7f59d8113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:59.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.298+0000 7f59dde24640 1 --2- 172.21.15.2:0/238179153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d80fe460 0x7f59d8113740 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00b790 tx=0x7f59cc0091d0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.298+0000 7f59dde24640 1 -- 172.21.15.2:0/238179153 shutdown_connections 2024-09-17T01:08:59.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.298+0000 7f59dde24640 1 --2- 172.21.15.2:0/238179153 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f59c006e530 0x7f59c00709e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.298+0000 7f59dde24640 1 --2- 172.21.15.2:0/238179153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59d80fe460 0x7f59d8113740 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.298+0000 7f59dde24640 1 --2- 172.21.15.2:0/238179153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f59d8064fc0 0x7f59d8113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.298+0000 7f59dde24640 1 -- 172.21.15.2:0/238179153 >> 172.21.15.2:0/238179153 conn(0x7f59d80723b0 msgr2=0x7f59d8105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:59.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.298+0000 7f59dde24640 1 -- 172.21.15.2:0/238179153 shutdown_connections 2024-09-17T01:08:59.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.298+0000 7f59dde24640 1 -- 172.21.15.2:0/238179153 wait complete. 2024-09-17T01:08:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.381+0000 7f8300745640 1 -- 172.21.15.2:0/978338744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f80fcf80 msgr2=0x7f82f80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.381+0000 7f8300745640 1 --2- 172.21.15.2:0/978338744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f80fcf80 0x7f82f80fd3d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82e80048d0 tx=0x7f82e8009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.381+0000 7f8300745640 1 -- 172.21.15.2:0/978338744 shutdown_connections 2024-09-17T01:08:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.381+0000 7f8300745640 1 --2- 172.21.15.2:0/978338744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f80fcf80 0x7f82f80fd3d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.381+0000 7f8300745640 1 --2- 172.21.15.2:0/978338744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82f80fb810 0x7f82f80fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.381+0000 7f8300745640 1 -- 172.21.15.2:0/978338744 >> 172.21.15.2:0/978338744 conn(0x7f82f80723b0 msgr2=0x7f82f80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.381+0000 7f8300745640 1 -- 172.21.15.2:0/978338744 shutdown_connections 2024-09-17T01:08:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.381+0000 7f8300745640 1 -- 172.21.15.2:0/978338744 wait complete. 2024-09-17T01:08:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.382+0000 7f8300745640 1 Processor -- start 2024-09-17T01:08:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.382+0000 7f8300745640 1 -- start start 2024-09-17T01:08:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.382+0000 7f8300745640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f80fb810 0x7f82f81120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.382+0000 7f8300745640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82f80fcf80 0x7f82f8112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.382+0000 7f8300745640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8112c10 con 0x7f82f80fb810 2024-09-17T01:08:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.382+0000 7f8300745640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f810c050 con 0x7f82f80fcf80 2024-09-17T01:08:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.382+0000 7f82fe4e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f80fb810 0x7f82f81120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.382+0000 7f82fe4e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f80fb810 0x7f82f81120d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38464/0 (socket says 172.21.15.2:38464) 2024-09-17T01:08:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.382+0000 7f82fe4e1640 1 -- 172.21.15.2:0/1211922920 learned_addr learned my addr 172.21.15.2:0/1211922920 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:08:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.382+0000 7f82fdce0640 1 --2- 172.21.15.2:0/1211922920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82f80fcf80 0x7f82f8112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.382+0000 7f82fe4e1640 1 -- 172.21.15.2:0/1211922920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82f80fcf80 msgr2=0x7f82f8112610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.382+0000 7f82fe4e1640 1 --2- 172.21.15.2:0/1211922920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82f80fcf80 0x7f82f8112610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.382+0000 7f82fe4e1640 1 -- 172.21.15.2:0/1211922920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e8005040 con 0x7f82f80fb810 2024-09-17T01:08:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.383+0000 7f82fe4e1640 1 --2- 172.21.15.2:0/1211922920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f80fb810 0x7f82f81120d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82f400fce0 tx=0x7f82f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.383+0000 7f82eeffd640 1 -- 172.21.15.2:0/1211922920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82f400de30 con 0x7f82f80fb810 2024-09-17T01:08:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.383+0000 7f82eeffd640 1 -- 172.21.15.2:0/1211922920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f82f40090d0 con 0x7f82f80fb810 2024-09-17T01:08:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.383+0000 7f8300745640 1 -- 172.21.15.2:0/1211922920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f810c2d0 con 0x7f82f80fb810 2024-09-17T01:08:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.383+0000 7f82eeffd640 1 -- 172.21.15.2:0/1211922920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82f40126a0 con 0x7f82f80fb810 2024-09-17T01:08:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.383+0000 7f8300745640 1 -- 172.21.15.2:0/1211922920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f810c840 con 0x7f82f80fb810 2024-09-17T01:08:59.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.384+0000 7f8300745640 1 -- 172.21.15.2:0/1211922920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f80fcbc0 con 0x7f82f80fb810 2024-09-17T01:08:59.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.384+0000 7f82eeffd640 1 -- 172.21.15.2:0/1211922920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f82f4009240 con 0x7f82f80fb810 2024-09-17T01:08:59.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.385+0000 7f82eeffd640 1 --2- 172.21.15.2:0/1211922920 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f82e406e530 0x7f82e40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:59.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.385+0000 7f82eeffd640 1 -- 172.21.15.2:0/1211922920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f82f4090660 con 0x7f82f80fb810 2024-09-17T01:08:59.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.385+0000 7f82fdce0640 1 --2- 172.21.15.2:0/1211922920 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f82e406e530 0x7f82e40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:59.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.386+0000 7f82fdce0640 1 --2- 172.21.15.2:0/1211922920 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f82e406e530 0x7f82e40709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009ac0 tx=0x7f82e8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:59.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.389+0000 7f82eeffd640 1 -- 172.21.15.2:0/1211922920 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f82f4059800 con 0x7f82f80fb810 2024-09-17T01:08:59.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.583+0000 7f8300745640 1 -- 172.21.15.2:0/1211922920 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82f810d740 con 0x7f82e406e530 2024-09-17T01:08:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.585+0000 7f82eeffd640 1 -- 172.21.15.2:0/1211922920 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f82f810d740 con 0x7f82e406e530 2024-09-17T01:08:59.583 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:08:59.583 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:08:59.583 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:08:59.583 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:08:59.583 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-17T01:08:59.583 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-17T01:08:59.583 INFO:teuthology.orchestra.run.smithi002.stdout: "mon", 2024-09-17T01:08:59.583 INFO:teuthology.orchestra.run.smithi002.stdout: "crash" 2024-09-17T01:08:59.584 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-17T01:08:59.584 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "10/21 daemons upgraded", 2024-09-17T01:08:59.584 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:08:59.584 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:08:59.584 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:08:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.587+0000 7f8300745640 1 -- 172.21.15.2:0/1211922920 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f82e406e530 msgr2=0x7f82e40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.587+0000 7f8300745640 1 --2- 172.21.15.2:0/1211922920 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f82e406e530 0x7f82e40709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009ac0 tx=0x7f82e8035040 comp rx=0 tx=0).stop 2024-09-17T01:08:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.587+0000 7f8300745640 1 -- 172.21.15.2:0/1211922920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f80fb810 msgr2=0x7f82f81120d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.587+0000 7f8300745640 1 --2- 172.21.15.2:0/1211922920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f80fb810 0x7f82f81120d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82f400fce0 tx=0x7f82f4004600 comp rx=0 tx=0).stop 2024-09-17T01:08:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.587+0000 7f8300745640 1 -- 172.21.15.2:0/1211922920 shutdown_connections 2024-09-17T01:08:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.587+0000 7f8300745640 1 --2- 172.21.15.2:0/1211922920 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f82e406e530 0x7f82e40709e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.587+0000 7f8300745640 1 --2- 172.21.15.2:0/1211922920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82f80fcf80 0x7f82f8112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.587+0000 7f8300745640 1 --2- 172.21.15.2:0/1211922920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82f80fb810 0x7f82f81120d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.587+0000 7f8300745640 1 -- 172.21.15.2:0/1211922920 >> 172.21.15.2:0/1211922920 conn(0x7f82f80723b0 msgr2=0x7f82f80fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.587+0000 7f8300745640 1 -- 172.21.15.2:0/1211922920 shutdown_connections 2024-09-17T01:08:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.587+0000 7f8300745640 1 -- 172.21.15.2:0/1211922920 wait complete. 2024-09-17T01:08:59.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.667+0000 7f267374c640 1 -- 172.21.15.2:0/714073479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c102ed0 msgr2=0x7f266c0fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.667+0000 7f267374c640 1 --2- 172.21.15.2:0/714073479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c102ed0 0x7f266c0fc590 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f26600048d0 tx=0x7f2660009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.667+0000 7f267374c640 1 -- 172.21.15.2:0/714073479 shutdown_connections 2024-09-17T01:08:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.667+0000 7f267374c640 1 --2- 172.21.15.2:0/714073479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c102ed0 0x7f266c0fc590 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.667+0000 7f267374c640 1 --2- 172.21.15.2:0/714073479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f266c102530 0x7f266c102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.667+0000 7f267374c640 1 -- 172.21.15.2:0/714073479 >> 172.21.15.2:0/714073479 conn(0x7f266c0f80f0 msgr2=0x7f266c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.668+0000 7f267374c640 1 -- 172.21.15.2:0/714073479 shutdown_connections 2024-09-17T01:08:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.668+0000 7f267374c640 1 -- 172.21.15.2:0/714073479 wait complete. 2024-09-17T01:08:59.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.668+0000 7f267374c640 1 Processor -- start 2024-09-17T01:08:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.668+0000 7f267374c640 1 -- start start 2024-09-17T01:08:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.668+0000 7f267374c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f266c102530 0x7f266c1131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.668+0000 7f267374c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c102ed0 0x7f266c113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.668+0000 7f267374c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c113d10 con 0x7f266c102ed0 2024-09-17T01:08:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.668+0000 7f267374c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c10d150 con 0x7f266c102530 2024-09-17T01:08:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.669+0000 7f2670ce7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c102ed0 0x7f266c113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.669+0000 7f2670ce7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c102ed0 0x7f266c113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38482/0 (socket says 172.21.15.2:38482) 2024-09-17T01:08:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.669+0000 7f26714e8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f266c102530 0x7f266c1131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.669+0000 7f2670ce7640 1 -- 172.21.15.2:0/1319993939 learned_addr learned my addr 172.21.15.2:0/1319993939 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:08:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.669+0000 7f2670ce7640 1 -- 172.21.15.2:0/1319993939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f266c102530 msgr2=0x7f266c1131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.669+0000 7f2670ce7640 1 --2- 172.21.15.2:0/1319993939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f266c102530 0x7f266c1131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.669+0000 7f2670ce7640 1 -- 172.21.15.2:0/1319993939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2660005040 con 0x7f266c102ed0 2024-09-17T01:08:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.669+0000 7f2670ce7640 1 --2- 172.21.15.2:0/1319993939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c102ed0 0x7f266c113710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2660003080 tx=0x7f2660009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.669+0000 7f2669ffb640 1 -- 172.21.15.2:0/1319993939 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2660038070 con 0x7f266c102ed0 2024-09-17T01:08:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.669+0000 7f2669ffb640 1 -- 172.21.15.2:0/1319993939 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2660009760 con 0x7f266c102ed0 2024-09-17T01:08:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.669+0000 7f267374c640 1 -- 172.21.15.2:0/1319993939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266c10d3d0 con 0x7f266c102ed0 2024-09-17T01:08:59.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.669+0000 7f2669ffb640 1 -- 172.21.15.2:0/1319993939 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f266003d420 con 0x7f266c102ed0 2024-09-17T01:08:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.670+0000 7f267374c640 1 -- 172.21.15.2:0/1319993939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266c10d910 con 0x7f266c102ed0 2024-09-17T01:08:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.670+0000 7f267374c640 1 -- 172.21.15.2:0/1319993939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266c0fdcb0 con 0x7f266c102ed0 2024-09-17T01:08:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.671+0000 7f2669ffb640 1 -- 172.21.15.2:0/1319993939 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f2660030020 con 0x7f266c102ed0 2024-09-17T01:08:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.671+0000 7f2669ffb640 1 --2- 172.21.15.2:0/1319993939 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f265406e530 0x7f26540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:08:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.672+0000 7f2669ffb640 1 -- 172.21.15.2:0/1319993939 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f26600ae640 con 0x7f266c102ed0 2024-09-17T01:08:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.672+0000 7f26714e8640 1 --2- 172.21.15.2:0/1319993939 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f265406e530 0x7f26540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:08:59.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.672+0000 7f26714e8640 1 --2- 172.21.15.2:0/1319993939 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f265406e530 0x7f26540709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2664007fd0 tx=0x7f2664009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:08:59.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.676+0000 7f2669ffb640 1 -- 172.21.15.2:0/1319993939 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f26600776b0 con 0x7f266c102ed0 2024-09-17T01:08:59.696 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:59 smithi099 podman[91638]: 2024-09-17 01:08:59.402748957 +0000 UTC m=+0.604601549 container remove c6d456f047874af840316a8dad942826c06e7e3c1295ebddf54d18c281275255 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:08:59.697 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:59 smithi099 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-17T01:08:59.697 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:59 smithi099 systemd[1]: Stopped Ceph osd.4 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:08:59.697 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:59 smithi099 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.4.service: Consumed 54.579s CPU time. 2024-09-17T01:08:59.697 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:59 smithi099 systemd[1]: Starting Ceph osd.4 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:08:59.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:59 smithi002 ceph-mon[98018]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:59.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:59 smithi002 ceph-mon[98018]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:59.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:59 smithi002 ceph-mon[98018]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:59.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:59 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3718226976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:08:59 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/238179153' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:08:59.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.920+0000 7f267374c640 1 -- 172.21.15.2:0/1319993939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f266c0fbd30 con 0x7f266c102ed0 2024-09-17T01:08:59.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.920+0000 7f2669ffb640 1 -- 172.21.15.2:0/1319993939 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+849 (secure 0 0 0) 0x7f266007ad70 con 0x7f266c102ed0 2024-09-17T01:08:59.919 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 30/354 objects degraded (8.475%), 7 pgs degraded 2024-09-17T01:08:59.919 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:08:59.919 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:08:59.919 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:08:59.919 INFO:teuthology.orchestra.run.smithi002.stdout: osd.4 (root=default,host=smithi099) is down 2024-09-17T01:08:59.919 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 30/354 objects degraded (8.475%), 7 pgs degraded 2024-09-17T01:08:59.919 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.5 is active+undersized+degraded, acting [3,2] 2024-09-17T01:08:59.919 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-17T01:08:59.920 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-17T01:08:59.920 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-09-17T01:08:59.920 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-17T01:08:59.920 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.19 is active+undersized+degraded, acting [3,2] 2024-09-17T01:08:59.920 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-17T01:08:59.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.922+0000 7f267374c640 1 -- 172.21.15.2:0/1319993939 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f265406e530 msgr2=0x7f26540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:59.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.922+0000 7f267374c640 1 --2- 172.21.15.2:0/1319993939 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f265406e530 0x7f26540709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2664007fd0 tx=0x7f2664009040 comp rx=0 tx=0).stop 2024-09-17T01:08:59.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.922+0000 7f267374c640 1 -- 172.21.15.2:0/1319993939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c102ed0 msgr2=0x7f266c113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:08:59.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.922+0000 7f267374c640 1 --2- 172.21.15.2:0/1319993939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c102ed0 0x7f266c113710 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2660003080 tx=0x7f2660009da0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.922+0000 7f267374c640 1 -- 172.21.15.2:0/1319993939 shutdown_connections 2024-09-17T01:08:59.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.922+0000 7f267374c640 1 --2- 172.21.15.2:0/1319993939 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f265406e530 0x7f26540709e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.922+0000 7f267374c640 1 --2- 172.21.15.2:0/1319993939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c102ed0 0x7f266c113710 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.922+0000 7f267374c640 1 --2- 172.21.15.2:0/1319993939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f266c102530 0x7f266c1131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:08:59.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.922+0000 7f267374c640 1 -- 172.21.15.2:0/1319993939 >> 172.21.15.2:0/1319993939 conn(0x7f266c0f80f0 msgr2=0x7f266c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:08:59.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.923+0000 7f267374c640 1 -- 172.21.15.2:0/1319993939 shutdown_connections 2024-09-17T01:08:59.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:08:59.923+0000 7f267374c640 1 -- 172.21.15.2:0/1319993939 wait complete. 2024-09-17T01:08:59.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:59 smithi099 ceph-mon[77412]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:59.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:59 smithi099 ceph-mon[77412]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:59.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:59 smithi099 ceph-mon[77412]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:08:59.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:59 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3718226976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:08:59.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:08:59 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/238179153' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:08:59.973 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:59 smithi099 podman[91737]: 2024-09-17 01:08:59.734732704 +0000 UTC m=+0.015762482 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:08:59.973 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:08:59 smithi099 podman[91737]: 2024-09-17 01:08:59.845604837 +0000 UTC m=+0.126634661 container create a4d564c0eb15bf40ce78694a984a501d101da135ee565d74194c5414310e47ae (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:09:00.234 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:00 smithi099 podman[91737]: 2024-09-17 01:09:00.106682227 +0000 UTC m=+0.387711995 container init a4d564c0eb15bf40ce78694a984a501d101da135ee565d74194c5414310e47ae (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-09-17T01:09:00.234 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:00 smithi099 podman[91737]: 2024-09-17 01:09:00.109957123 +0000 UTC m=+0.390986894 container start a4d564c0eb15bf40ce78694a984a501d101da135ee565d74194c5414310e47ae (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-17T01:09:00.235 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:00 smithi099 podman[91737]: 2024-09-17 01:09:00.173960349 +0000 UTC m=+0.454990133 container attach a4d564c0eb15bf40ce78694a984a501d101da135ee565d74194c5414310e47ae (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-17T01:09:00.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:00 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate[91752]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:00.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:00 smithi099 bash[91737]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:00.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:00 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate[91752]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:00.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:00 smithi099 bash[91737]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:00.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:00 smithi099 ceph-mon[77412]: pgmap v144: 65 pgs: 3 active+undersized, 5 stale+active+clean, 7 active+undersized+degraded, 50 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 30/354 objects degraded (8.475%) 2024-09-17T01:09:00.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:00 smithi099 ceph-mon[77412]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:00.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:00 smithi099 ceph-mon[77412]: Health check failed: Degraded data redundancy: 30/354 objects degraded (8.475%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:00.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:00 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1319993939' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:09:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:00 smithi002 ceph-mon[98018]: pgmap v144: 65 pgs: 3 active+undersized, 5 stale+active+clean, 7 active+undersized+degraded, 50 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 30/354 objects degraded (8.475%) 2024-09-17T01:09:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:00 smithi002 ceph-mon[98018]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:00 smithi002 ceph-mon[98018]: Health check failed: Degraded data redundancy: 30/354 objects degraded (8.475%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:00 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1319993939' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:09:01.252 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:00 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate[91752]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:09:01.252 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:00 smithi099 bash[91737]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:09:01.253 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:00 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate[91752]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:09:01.253 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:00 smithi099 bash[91737]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:09:01.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:01 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate[91752]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:09:01.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:01 smithi099 bash[91737]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:09:01.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:01 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate[91752]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:09:01.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:01 smithi099 bash[91737]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:09:01.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:01 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate[91752]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-17T01:09:01.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:01 smithi099 bash[91737]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-17T01:09:01.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:01 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate[91752]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:09:01.544 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:01 smithi099 bash[91737]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:09:01.544 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:01 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate[91752]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-17T01:09:01.544 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:01 smithi099 bash[91737]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-17T01:09:01.544 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:01 smithi099 podman[91737]: 2024-09-17 01:09:01.280329265 +0000 UTC m=+1.561359043 container died a4d564c0eb15bf40ce78694a984a501d101da135ee565d74194c5414310e47ae (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:09:02.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:01 smithi099 podman[91892]: 2024-09-17 01:09:01.920377468 +0000 UTC m=+0.634483149 container remove a4d564c0eb15bf40ce78694a984a501d101da135ee565d74194c5414310e47ae (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-activate, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-17T01:09:02.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:02 smithi099 podman[91951]: 2024-09-17 01:09:02.029429611 +0000 UTC m=+0.015623191 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:09:02.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:02 smithi099 podman[91951]: 2024-09-17 01:09:02.147672261 +0000 UTC m=+0.133865830 container create df5b078898bb1fc3e6419da4cc9aef151b08e4de47925582e216d31294ef80ed (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-17T01:09:02.649 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:02 smithi099 podman[91951]: 2024-09-17 01:09:02.551882516 +0000 UTC m=+0.538076083 container init df5b078898bb1fc3e6419da4cc9aef151b08e4de47925582e216d31294ef80ed (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-17T01:09:02.649 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:02 smithi099 podman[91951]: 2024-09-17 01:09:02.555091436 +0000 UTC m=+0.541285014 container start df5b078898bb1fc3e6419da4cc9aef151b08e4de47925582e216d31294ef80ed (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-17T01:09:02.649 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:02 smithi099 ceph-osd[91970]: -- 172.21.15.99:0/3803019902 <== mon.1 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556cb3ed01e0 con 0x556cb307dc00 2024-09-17T01:09:03.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:02 smithi099 ceph-mon[77412]: pgmap v145: 65 pgs: 12 active+undersized, 1 stale+active+clean, 12 active+undersized+degraded, 40 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 47/354 objects degraded (13.277%) 2024-09-17T01:09:03.043 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:02 smithi099 bash[91951]: df5b078898bb1fc3e6419da4cc9aef151b08e4de47925582e216d31294ef80ed 2024-09-17T01:09:03.043 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:02 smithi099 systemd[1]: Started Ceph osd.4 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:09:03.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:02 smithi002 ceph-mon[98018]: pgmap v145: 65 pgs: 12 active+undersized, 1 stale+active+clean, 12 active+undersized+degraded, 40 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 47/354 objects degraded (13.277%) 2024-09-17T01:09:03.989 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:03.989 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:03.989 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:04.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:04.292 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:04 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:09:04.195+0000 7fe01a9d8640 -1 Falling back to public interface 2024-09-17T01:09:04.991 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:04 smithi099 ceph-mon[77412]: pgmap v146: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 60/354 objects degraded (16.949%) 2024-09-17T01:09:05.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:04 smithi002 ceph-mon[98018]: pgmap v146: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 60/354 objects degraded (16.949%) 2024-09-17T01:09:06.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:06 smithi099 ceph-mon[77412]: pgmap v147: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 60/354 objects degraded (16.949%) 2024-09-17T01:09:06.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:06 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:06.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:06 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:06.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:06 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:06.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:06 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:06.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:06 smithi002 ceph-mon[98018]: pgmap v147: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 60/354 objects degraded (16.949%) 2024-09-17T01:09:06.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:06 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:06.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:06 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:06.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:06 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:06.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:06 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:08.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:08 smithi099 ceph-mon[77412]: pgmap v148: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 60/354 objects degraded (16.949%) 2024-09-17T01:09:08.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:08 smithi002 ceph-mon[98018]: pgmap v148: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 60/354 objects degraded (16.949%) 2024-09-17T01:09:09.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:09 smithi099 ceph-mon[77412]: Health check update: Degraded data redundancy: 60/354 objects degraded (16.949%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:09.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:09 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:09.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:09 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:09.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:09 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:09.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:09 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:09.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:09 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:09.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:09 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:09.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:09 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:09 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:09 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:09 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:09:09.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:09 smithi002 ceph-mon[98018]: Health check update: Degraded data redundancy: 60/354 objects degraded (16.949%), 16 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:09.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:09 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:09.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:09 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:09.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:09 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:09.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:09 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:09.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:09 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:09.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:09 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:09.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:09 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:09 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:09 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:09.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:09 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:09:10.543 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:10 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:09:10.241+0000 7fe01a9d8640 -1 osd.4 79 log_to_monitors true 2024-09-17T01:09:10.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:10 smithi099 ceph-mon[77412]: pgmap v149: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 60/354 objects degraded (16.949%) 2024-09-17T01:09:10.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:10 smithi099 ceph-mon[77412]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:09:10.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:10 smithi099 ceph-mon[77412]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:09:10.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:10 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:10.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:10 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:10.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:10 smithi099 ceph-mon[77412]: from='osd.4 [v2:172.21.15.99:6808/2191571418,v1:172.21.15.99:6809/2191571418]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:09:10.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:10 smithi099 ceph-mon[77412]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:09:10.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:10 smithi002 ceph-mon[98018]: pgmap v149: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 60/354 objects degraded (16.949%) 2024-09-17T01:09:10.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:10 smithi002 ceph-mon[98018]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:09:10.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:10 smithi002 ceph-mon[98018]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:09:10.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:10 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:10.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:10 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:10.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:10 smithi002 ceph-mon[98018]: from='osd.4 [v2:172.21.15.99:6808/2191571418,v1:172.21.15.99:6809/2191571418]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:09:10.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:10 smithi002 ceph-mon[98018]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:09:12.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:09:11 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:09:11.925+0000 7fe00e76a640 -1 osd.4 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:09:12.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:12 smithi099 ceph-mon[77412]: pgmap v150: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 60/354 objects degraded (16.949%) 2024-09-17T01:09:12.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:12 smithi099 ceph-mon[77412]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:09:12.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:12 smithi099 ceph-mon[77412]: osdmap e82: 6 total, 5 up, 6 in 2024-09-17T01:09:12.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:12 smithi099 ceph-mon[77412]: from='osd.4 [v2:172.21.15.99:6808/2191571418,v1:172.21.15.99:6809/2191571418]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T01:09:12.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:12 smithi099 ceph-mon[77412]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T01:09:12.294 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:12 smithi099 ceph-mon[77412]: from='osd.4 ' entity='osd.4' 2024-09-17T01:09:12.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:12 smithi002 ceph-mon[98018]: pgmap v150: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s; 60/354 objects degraded (16.949%) 2024-09-17T01:09:12.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:12 smithi002 ceph-mon[98018]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:09:12.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:12 smithi002 ceph-mon[98018]: osdmap e82: 6 total, 5 up, 6 in 2024-09-17T01:09:12.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:12 smithi002 ceph-mon[98018]: from='osd.4 [v2:172.21.15.99:6808/2191571418,v1:172.21.15.99:6809/2191571418]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T01:09:12.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:12 smithi002 ceph-mon[98018]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T01:09:12.406 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:12 smithi002 ceph-mon[98018]: from='osd.4 ' entity='osd.4' 2024-09-17T01:09:13.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:13 smithi002 ceph-mon[98018]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:09:13.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:13 smithi002 ceph-mon[98018]: osd.4 [v2:172.21.15.99:6808/2191571418,v1:172.21.15.99:6809/2191571418] boot 2024-09-17T01:09:13.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:13 smithi002 ceph-mon[98018]: osdmap e83: 6 total, 6 up, 6 in 2024-09-17T01:09:13.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:13 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:09:13.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:13 smithi099 ceph-mon[77412]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:09:13.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:13 smithi099 ceph-mon[77412]: osd.4 [v2:172.21.15.99:6808/2191571418,v1:172.21.15.99:6809/2191571418] boot 2024-09-17T01:09:13.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:13 smithi099 ceph-mon[77412]: osdmap e83: 6 total, 6 up, 6 in 2024-09-17T01:09:13.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:13 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:09:15.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:14 smithi099 ceph-mon[77412]: pgmap v153: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 60/354 objects degraded (16.949%) 2024-09-17T01:09:15.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:14 smithi099 ceph-mon[77412]: osdmap e84: 6 total, 6 up, 6 in 2024-09-17T01:09:15.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:14 smithi002 ceph-mon[98018]: pgmap v153: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 60/354 objects degraded (16.949%) 2024-09-17T01:09:15.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:14 smithi002 ceph-mon[98018]: osdmap e84: 6 total, 6 up, 6 in 2024-09-17T01:09:17.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:16 smithi099 ceph-mon[77412]: pgmap v155: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 60/354 objects degraded (16.949%) 2024-09-17T01:09:17.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:16 smithi002 ceph-mon[98018]: pgmap v155: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 60/354 objects degraded (16.949%) 2024-09-17T01:09:18.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:17 smithi099 ceph-mon[77412]: Health check update: Degraded data redundancy: 28/354 objects degraded (7.910%), 6 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:18.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:17 smithi002 ceph-mon[98018]: Health check update: Degraded data redundancy: 28/354 objects degraded (7.910%), 6 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:19.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:18 smithi099 ceph-mon[77412]: pgmap v156: 65 pgs: 3 active+undersized, 6 active+undersized+degraded, 56 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 28/354 objects degraded (7.910%) 2024-09-17T01:09:19.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:18 smithi002 ceph-mon[98018]: pgmap v156: 65 pgs: 3 active+undersized, 6 active+undersized+degraded, 56 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 28/354 objects degraded (7.910%) 2024-09-17T01:09:20.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:20 smithi099 ceph-mon[77412]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/354 objects degraded (7.910%), 6 pgs degraded) 2024-09-17T01:09:20.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:20 smithi002 ceph-mon[98018]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/354 objects degraded (7.910%), 6 pgs degraded) 2024-09-17T01:09:21.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:21 smithi099 ceph-mon[77412]: pgmap v157: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-17T01:09:21.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:21 smithi002 ceph-mon[98018]: pgmap v157: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-17T01:09:22.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:22 smithi099 ceph-mon[77412]: pgmap v158: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-17T01:09:22.310 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:22 smithi002 ceph-mon[98018]: pgmap v158: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-17T01:09:24.408 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:24 smithi002 ceph-mon[98018]: pgmap v159: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:09:24.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:24 smithi099 ceph-mon[77412]: pgmap v159: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:09:25.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:09:25.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:25 smithi002 ceph-mon[98018]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:09:25.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:25 smithi002 ceph-mon[98018]: Upgrade: osd.5 is safe to restart 2024-09-17T01:09:25.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:25.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:25.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:25.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:09:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:25 smithi099 ceph-mon[77412]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:09:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:25 smithi099 ceph-mon[77412]: Upgrade: osd.5 is safe to restart 2024-09-17T01:09:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:25.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:26.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:26 smithi002 ceph-mon[98018]: pgmap v160: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-17T01:09:26.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:26 smithi002 ceph-mon[98018]: Upgrade: Updating osd.5 2024-09-17T01:09:26.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:26.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:09:26.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:26.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:26 smithi002 ceph-mon[98018]: Deploying daemon osd.5 on smithi099 2024-09-17T01:09:27.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:26 smithi099 ceph-mon[77412]: pgmap v160: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-17T01:09:27.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:26 smithi099 ceph-mon[77412]: Upgrade: Updating osd.5 2024-09-17T01:09:27.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:27.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:09:27.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:27.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:26 smithi099 ceph-mon[77412]: Deploying daemon osd.5 on smithi099 2024-09-17T01:09:29.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:28 smithi099 ceph-mon[77412]: pgmap v161: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 4 op/s 2024-09-17T01:09:29.043 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:28 smithi099 systemd[1]: Stopping Ceph osd.5 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:09:29.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:28 smithi002 ceph-mon[98018]: pgmap v161: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 4 op/s 2024-09-17T01:09:29.542 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:29 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[53032]: 2024-09-17T01:09:29.084+0000 7ff5ff9db640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:09:29.543 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:29 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[53032]: 2024-09-17T01:09:29.084+0000 7ff5ff9db640 -1 osd.5 84 *** Got signal Terminated *** 2024-09-17T01:09:29.543 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:29 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[53032]: 2024-09-17T01:09:29.084+0000 7ff5ff9db640 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:09:30.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.018+0000 7fd7691ad640 1 -- 172.21.15.2:0/258670248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640fac80 msgr2=0x7fd7640fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:30.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.018+0000 7fd7691ad640 1 --2- 172.21.15.2:0/258670248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640fac80 0x7fd7640fb0f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7580048d0 tx=0x7fd758009da0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.018+0000 7fd7691ad640 1 -- 172.21.15.2:0/258670248 shutdown_connections 2024-09-17T01:09:30.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.018+0000 7fd7691ad640 1 --2- 172.21.15.2:0/258670248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640fac80 0x7fd7640fb0f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.018+0000 7fd7691ad640 1 --2- 172.21.15.2:0/258670248 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7640fd410 0x7fd7640fd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.018+0000 7fd7691ad640 1 -- 172.21.15.2:0/258670248 >> 172.21.15.2:0/258670248 conn(0x7fd764070ce0 msgr2=0x7fd7640710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.018+0000 7fd7691ad640 1 -- 172.21.15.2:0/258670248 shutdown_connections 2024-09-17T01:09:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.018+0000 7fd7691ad640 1 -- 172.21.15.2:0/258670248 wait complete. 2024-09-17T01:09:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.019+0000 7fd7691ad640 1 Processor -- start 2024-09-17T01:09:30.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.019+0000 7fd7691ad640 1 -- start start 2024-09-17T01:09:30.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.019+0000 7fd7691ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640fac80 0x7fd764115380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:30.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.019+0000 7fd7691ad640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7640fd410 0x7fd7641158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:30.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.019+0000 7fd7691ad640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd764115ec0 con 0x7fd7640fac80 2024-09-17T01:09:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.019+0000 7fd7691ad640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76410f300 con 0x7fd7640fd410 2024-09-17T01:09:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.019+0000 7fd762d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640fac80 0x7fd764115380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.020+0000 7fd762d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640fac80 0x7fd764115380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49460/0 (socket says 172.21.15.2:49460) 2024-09-17T01:09:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.020+0000 7fd762d9d640 1 -- 172.21.15.2:0/1081976649 learned_addr learned my addr 172.21.15.2:0/1081976649 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:09:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.020+0000 7fd76259c640 1 --2- 172.21.15.2:0/1081976649 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7640fd410 0x7fd7641158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.020+0000 7fd762d9d640 1 -- 172.21.15.2:0/1081976649 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7640fd410 msgr2=0x7fd7641158c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.020+0000 7fd762d9d640 1 --2- 172.21.15.2:0/1081976649 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7640fd410 0x7fd7641158c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.020+0000 7fd762d9d640 1 -- 172.21.15.2:0/1081976649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758005040 con 0x7fd7640fac80 2024-09-17T01:09:30.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.020+0000 7fd762d9d640 1 --2- 172.21.15.2:0/1081976649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640fac80 0x7fd764115380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd754002a50 tx=0x7fd754004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:30.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.020+0000 7fd74b7fe640 1 -- 172.21.15.2:0/1081976649 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd754007c30 con 0x7fd7640fac80 2024-09-17T01:09:30.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.020+0000 7fd74b7fe640 1 -- 172.21.15.2:0/1081976649 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd75400f040 con 0x7fd7640fac80 2024-09-17T01:09:30.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.020+0000 7fd7691ad640 1 -- 172.21.15.2:0/1081976649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76410f5e0 con 0x7fd7640fac80 2024-09-17T01:09:30.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.020+0000 7fd74b7fe640 1 -- 172.21.15.2:0/1081976649 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd75400da10 con 0x7fd7640fac80 2024-09-17T01:09:30.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.020+0000 7fd7691ad640 1 -- 172.21.15.2:0/1081976649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76410fb50 con 0x7fd7640fac80 2024-09-17T01:09:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.021+0000 7fd7691ad640 1 -- 172.21.15.2:0/1081976649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7640fbc90 con 0x7fd7640fac80 2024-09-17T01:09:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.022+0000 7fd74b7fe640 1 -- 172.21.15.2:0/1081976649 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fd75400dc80 con 0x7fd7640fac80 2024-09-17T01:09:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.023+0000 7fd74b7fe640 1 --2- 172.21.15.2:0/1081976649 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd74c06e530 0x7fd74c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.023+0000 7fd74b7fe640 1 -- 172.21.15.2:0/1081976649 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6613+0+0 (secure 0 0 0) 0x7fd75408d9b0 con 0x7fd7640fac80 2024-09-17T01:09:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.023+0000 7fd76259c640 1 --2- 172.21.15.2:0/1081976649 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd74c06e530 0x7fd74c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.023+0000 7fd76259c640 1 --2- 172.21.15.2:0/1081976649 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd74c06e530 0x7fd74c0709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd758009ac0 tx=0x7fd758035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:30.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.027+0000 7fd74b7fe640 1 -- 172.21.15.2:0/1081976649 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd754056ad0 con 0x7fd7640fac80 2024-09-17T01:09:30.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:29 smithi002 ceph-mon[98018]: osd.5 marked itself down and dead 2024-09-17T01:09:30.185 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:29 smithi099 ceph-mon[77412]: osd.5 marked itself down and dead 2024-09-17T01:09:30.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.224+0000 7fd7691ad640 1 -- 172.21.15.2:0/1081976649 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd76404b750 con 0x7fd74c06e530 2024-09-17T01:09:30.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.225+0000 7fd74b7fe640 1 -- 172.21.15.2:0/1081976649 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd76404b750 con 0x7fd74c06e530 2024-09-17T01:09:30.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.227+0000 7fd7691ad640 1 -- 172.21.15.2:0/1081976649 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd74c06e530 msgr2=0x7fd74c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:30.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.227+0000 7fd7691ad640 1 --2- 172.21.15.2:0/1081976649 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd74c06e530 0x7fd74c0709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd758009ac0 tx=0x7fd758035040 comp rx=0 tx=0).stop 2024-09-17T01:09:30.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.227+0000 7fd7691ad640 1 -- 172.21.15.2:0/1081976649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640fac80 msgr2=0x7fd764115380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:30.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.227+0000 7fd7691ad640 1 --2- 172.21.15.2:0/1081976649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640fac80 0x7fd764115380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd754002a50 tx=0x7fd754004600 comp rx=0 tx=0).stop 2024-09-17T01:09:30.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.227+0000 7fd7691ad640 1 -- 172.21.15.2:0/1081976649 shutdown_connections 2024-09-17T01:09:30.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.227+0000 7fd7691ad640 1 --2- 172.21.15.2:0/1081976649 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd74c06e530 0x7fd74c0709e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.227+0000 7fd7691ad640 1 --2- 172.21.15.2:0/1081976649 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7640fd410 0x7fd7641158c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.227+0000 7fd7691ad640 1 --2- 172.21.15.2:0/1081976649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7640fac80 0x7fd764115380 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.227+0000 7fd7691ad640 1 -- 172.21.15.2:0/1081976649 >> 172.21.15.2:0/1081976649 conn(0x7fd764070ce0 msgr2=0x7fd7640f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:30.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.227+0000 7fd7691ad640 1 -- 172.21.15.2:0/1081976649 shutdown_connections 2024-09-17T01:09:30.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.227+0000 7fd7691ad640 1 -- 172.21.15.2:0/1081976649 wait complete. 2024-09-17T01:09:30.234 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:09:30.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.310+0000 7f514253a640 1 -- 172.21.15.2:0/3946832160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f513c0fcf80 msgr2=0x7f513c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:30.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.310+0000 7f514253a640 1 --2- 172.21.15.2:0/3946832160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f513c0fcf80 0x7f513c0fd3d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f51240048d0 tx=0x7f5124009da0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.310+0000 7f514253a640 1 -- 172.21.15.2:0/3946832160 shutdown_connections 2024-09-17T01:09:30.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.310+0000 7f514253a640 1 --2- 172.21.15.2:0/3946832160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f513c0fcf80 0x7f513c0fd3d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.310+0000 7f514253a640 1 --2- 172.21.15.2:0/3946832160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f513c0fb810 0x7f513c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.310+0000 7f514253a640 1 -- 172.21.15.2:0/3946832160 >> 172.21.15.2:0/3946832160 conn(0x7f513c0723b0 msgr2=0x7f513c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:30.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.310+0000 7f514253a640 1 -- 172.21.15.2:0/3946832160 shutdown_connections 2024-09-17T01:09:30.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.310+0000 7f514253a640 1 -- 172.21.15.2:0/3946832160 wait complete. 2024-09-17T01:09:30.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.310+0000 7f514253a640 1 Processor -- start 2024-09-17T01:09:30.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.310+0000 7f514253a640 1 -- start start 2024-09-17T01:09:30.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f514253a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f513c0fb810 0x7f513c1153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:30.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f514253a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f513c0fcf80 0x7f513c115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:30.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f514253a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c115f10 con 0x7f513c0fb810 2024-09-17T01:09:30.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f514253a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c10f350 con 0x7f513c0fcf80 2024-09-17T01:09:30.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f513bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f513c0fb810 0x7f513c1153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:30.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f513bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f513c0fb810 0x7f513c1153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59568/0 (socket says 172.21.15.2:59568) 2024-09-17T01:09:30.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f513bfff640 1 -- 172.21.15.2:0/1850435893 learned_addr learned my addr 172.21.15.2:0/1850435893 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:09:30.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f5133fff640 1 --2- 172.21.15.2:0/1850435893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f513c0fcf80 0x7f513c115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:30.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f513bfff640 1 -- 172.21.15.2:0/1850435893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f513c0fcf80 msgr2=0x7f513c115910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:30.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f513bfff640 1 --2- 172.21.15.2:0/1850435893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f513c0fcf80 0x7f513c115910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f513bfff640 1 -- 172.21.15.2:0/1850435893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5124005040 con 0x7f513c0fb810 2024-09-17T01:09:30.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f513bfff640 1 --2- 172.21.15.2:0/1850435893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f513c0fb810 0x7f513c1153d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f512c00c790 tx=0x7f512c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:30.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f51397fa640 1 -- 172.21.15.2:0/1850435893 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512c00a7a0 con 0x7f513c0fb810 2024-09-17T01:09:30.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f51397fa640 1 -- 172.21.15.2:0/1850435893 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f512c00ada0 con 0x7f513c0fb810 2024-09-17T01:09:30.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f51397fa640 1 -- 172.21.15.2:0/1850435893 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512c0113a0 con 0x7f513c0fb810 2024-09-17T01:09:30.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.311+0000 7f514253a640 1 -- 172.21.15.2:0/1850435893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c10f630 con 0x7f513c0fb810 2024-09-17T01:09:30.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.312+0000 7f514253a640 1 -- 172.21.15.2:0/1850435893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513c10fb50 con 0x7f513c0fb810 2024-09-17T01:09:30.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.313+0000 7f514253a640 1 -- 172.21.15.2:0/1850435893 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513c0fcbc0 con 0x7f513c0fb810 2024-09-17T01:09:30.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.313+0000 7f51397fa640 1 -- 172.21.15.2:0/1850435893 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f512c00a900 con 0x7f513c0fb810 2024-09-17T01:09:30.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.314+0000 7f51397fa640 1 --2- 172.21.15.2:0/1850435893 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f512806e530 0x7f51280709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:30.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.314+0000 7f51397fa640 1 -- 172.21.15.2:0/1850435893 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f512c08e270 con 0x7f513c0fb810 2024-09-17T01:09:30.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.314+0000 7f5133fff640 1 --2- 172.21.15.2:0/1850435893 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f512806e530 0x7f51280709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:30.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.314+0000 7f5133fff640 1 --2- 172.21.15.2:0/1850435893 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f512806e530 0x7f51280709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5124007ac0 tx=0x7f5124009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:30.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.318+0000 7f51397fa640 1 -- 172.21.15.2:0/1850435893 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f512c05af30 con 0x7f513c0fb810 2024-09-17T01:09:30.442 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:30 smithi099 podman[96518]: 2024-09-17 01:09:30.18771052 +0000 UTC m=+1.182991759 container died 90ca23c2eab2f67bd35d91fc27a2e83f02bee427310e1088372f30cc46690ace (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=quincy-4a70413, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-09-17T01:09:30.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.510+0000 7f514253a640 1 -- 172.21.15.2:0/1850435893 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f513c04b720 con 0x7f512806e530 2024-09-17T01:09:30.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.512+0000 7f51397fa640 1 -- 172.21.15.2:0/1850435893 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f513c04b720 con 0x7f512806e530 2024-09-17T01:09:30.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.514+0000 7f514253a640 1 -- 172.21.15.2:0/1850435893 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f512806e530 msgr2=0x7f51280709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:30.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.514+0000 7f514253a640 1 --2- 172.21.15.2:0/1850435893 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f512806e530 0x7f51280709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5124007ac0 tx=0x7f5124009da0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.514+0000 7f514253a640 1 -- 172.21.15.2:0/1850435893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f513c0fb810 msgr2=0x7f513c1153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:30.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.514+0000 7f514253a640 1 --2- 172.21.15.2:0/1850435893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f513c0fb810 0x7f513c1153d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f512c00c790 tx=0x7f512c0043c0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.514+0000 7f514253a640 1 -- 172.21.15.2:0/1850435893 shutdown_connections 2024-09-17T01:09:30.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.514+0000 7f514253a640 1 --2- 172.21.15.2:0/1850435893 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f512806e530 0x7f51280709e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.514+0000 7f514253a640 1 --2- 172.21.15.2:0/1850435893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f513c0fcf80 0x7f513c115910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.514+0000 7f514253a640 1 --2- 172.21.15.2:0/1850435893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f513c0fb810 0x7f513c1153d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.514+0000 7f514253a640 1 -- 172.21.15.2:0/1850435893 >> 172.21.15.2:0/1850435893 conn(0x7f513c0723b0 msgr2=0x7f513c0f8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:30.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.514+0000 7f514253a640 1 -- 172.21.15.2:0/1850435893 shutdown_connections 2024-09-17T01:09:30.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.514+0000 7f514253a640 1 -- 172.21.15.2:0/1850435893 wait complete. 2024-09-17T01:09:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.595+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/2627770593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8f8102580 msgr2=0x7fd8f8102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.595+0000 7fd8fdcb1640 1 --2- 172.21.15.2:0/2627770593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8f8102580 0x7fd8f8102950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80048d0 tx=0x7fd8e8009da0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.595+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/2627770593 shutdown_connections 2024-09-17T01:09:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.595+0000 7fd8fdcb1640 1 --2- 172.21.15.2:0/2627770593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8f8102f20 0x7fd8f80fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.595+0000 7fd8fdcb1640 1 --2- 172.21.15.2:0/2627770593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8f8102580 0x7fd8f8102950 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.595+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/2627770593 >> 172.21.15.2:0/2627770593 conn(0x7fd8f80f81a0 msgr2=0x7fd8f80fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.595+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/2627770593 shutdown_connections 2024-09-17T01:09:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.595+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/2627770593 wait complete. 2024-09-17T01:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.595+0000 7fd8fdcb1640 1 Processor -- start 2024-09-17T01:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.596+0000 7fd8fdcb1640 1 -- start start 2024-09-17T01:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.596+0000 7fd8fdcb1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8f8102580 0x7fd8f806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.596+0000 7fd8fdcb1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8f8102f20 0x7fd8f806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.596+0000 7fd8fdcb1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f8070490 con 0x7fd8f8102f20 2024-09-17T01:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.596+0000 7fd8fdcb1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f8070600 con 0x7fd8f8102580 2024-09-17T01:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.596+0000 7fd8f6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8f8102f20 0x7fd8f806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.596+0000 7fd8f6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8f8102f20 0x7fd8f806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59586/0 (socket says 172.21.15.2:59586) 2024-09-17T01:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.596+0000 7fd8f6ffd640 1 -- 172.21.15.2:0/846192605 learned_addr learned my addr 172.21.15.2:0/846192605 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.596+0000 7fd8f77fe640 1 --2- 172.21.15.2:0/846192605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8f8102580 0x7fd8f806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.596+0000 7fd8f6ffd640 1 -- 172.21.15.2:0/846192605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8f8102580 msgr2=0x7fd8f806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.596+0000 7fd8f6ffd640 1 --2- 172.21.15.2:0/846192605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8f8102580 0x7fd8f806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.596+0000 7fd8f6ffd640 1 -- 172.21.15.2:0/846192605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e8005040 con 0x7fd8f8102f20 2024-09-17T01:09:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.597+0000 7fd8f6ffd640 1 --2- 172.21.15.2:0/846192605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8f8102f20 0x7fd8f806ff50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009af0 tx=0x7fd8ec004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.597+0000 7fd8dffff640 1 -- 172.21.15.2:0/846192605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8ec007c30 con 0x7fd8f8102f20 2024-09-17T01:09:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.597+0000 7fd8dffff640 1 -- 172.21.15.2:0/846192605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd8ec00f040 con 0x7fd8f8102f20 2024-09-17T01:09:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.597+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/846192605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f8070890 con 0x7fd8f8102f20 2024-09-17T01:09:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.597+0000 7fd8dffff640 1 -- 172.21.15.2:0/846192605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8ec00da10 con 0x7fd8f8102f20 2024-09-17T01:09:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.597+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/846192605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f8119950 con 0x7fd8f8102f20 2024-09-17T01:09:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.598+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/846192605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f80fdd00 con 0x7fd8f8102f20 2024-09-17T01:09:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.598+0000 7fd8dffff640 1 -- 172.21.15.2:0/846192605 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fd8ec009670 con 0x7fd8f8102f20 2024-09-17T01:09:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.599+0000 7fd8dffff640 1 --2- 172.21.15.2:0/846192605 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd8e006e530 0x7fd8e00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.599+0000 7fd8dffff640 1 -- 172.21.15.2:0/846192605 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6613+0+0 (secure 0 0 0) 0x7fd8ec08e010 con 0x7fd8f8102f20 2024-09-17T01:09:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.599+0000 7fd8f77fe640 1 --2- 172.21.15.2:0/846192605 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd8e006e530 0x7fd8e00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.599+0000 7fd8f77fe640 1 --2- 172.21.15.2:0/846192605 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd8e006e530 0x7fd8e00709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009ac0 tx=0x7fd8e8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.603+0000 7fd8dffff640 1 -- 172.21.15.2:0/846192605 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd8ec057080 con 0x7fd8f8102f20 2024-09-17T01:09:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.787+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/846192605 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8f804b720 con 0x7fd8e006e530 2024-09-17T01:09:30.793 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:30 smithi099 podman[96518]: 2024-09-17 01:09:30.542618412 +0000 UTC m=+1.537899640 container cleanup 90ca23c2eab2f67bd35d91fc27a2e83f02bee427310e1088372f30cc46690ace (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=quincy-4a70413, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T01:09:30.793 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:30 smithi099 bash[96518]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5 2024-09-17T01:09:30.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.797+0000 7fd8dffff640 1 -- 172.21.15.2:0/846192605 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd8f804b720 con 0x7fd8e006e530 2024-09-17T01:09:30.795 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:09:30.795 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (6m) 92s ago 15m 25.3M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:09:30.795 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (3m) 92s ago 15m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de b7ed6c8d5a92 2024-09-17T01:09:30.796 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (3m) 25s ago 14m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de ae713b940078 2024-09-17T01:09:30.796 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (5m) 92s ago 15m 81.8M - 9.4.12 2bacad6d85d8 5fe408c103d6 2024-09-17T01:09:30.796 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (9m) 92s ago 9m 124M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:09:30.796 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (10m) 92s ago 10m 65.0M - 17.2.7-1635-g4a704134 f22ead590bad 39a0138ddecf 2024-09-17T01:09:30.796 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (9m) 25s ago 9m 64.7M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:09:30.796 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (10m) 25s ago 10m 115M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:09:30.796 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (6m) 92s ago 16m 497M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:09:30.796 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (5m) 25s ago 14m 441M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:09:30.796 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (4m) 92s ago 16m 47.1M 2048M 19.1.1-330-gc2ddf972 ebb0615149de da5247385c2d 2024-09-17T01:09:30.796 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (3m) 25s ago 14m 36.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b92f98b2cab9 2024-09-17T01:09:30.796 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (6m) 92s ago 15m 16.3M - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:09:30.796 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (6m) 25s ago 14m 15.8M - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:09:30.796 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (2m) 92s ago 13m 94.2M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 563188d6089b 2024-09-17T01:09:30.797 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (2m) 92s ago 13m 100M 1558M 19.1.1-330-gc2ddf972 ebb0615149de cc26caf558d7 2024-09-17T01:09:30.797 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (97s) 92s ago 12m 11.8M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 0aac20af5580 2024-09-17T01:09:30.797 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (62s) 25s ago 12m 142M 2581M 19.1.1-330-gc2ddf972 ebb0615149de 0740cf987fef 2024-09-17T01:09:30.797 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (28s) 25s ago 12m 11.5M 2581M 19.1.1-330-gc2ddf972 ebb0615149de df5b078898bb 2024-09-17T01:09:30.797 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (11m) 25s ago 11m 254M 2581M 17.2.7-1635-g4a704134 f22ead590bad 90ca23c2eab2 2024-09-17T01:09:30.797 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (5m) 92s ago 15m 64.0M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:09:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.799+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/846192605 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd8e006e530 msgr2=0x7fd8e00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.799+0000 7fd8fdcb1640 1 --2- 172.21.15.2:0/846192605 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd8e006e530 0x7fd8e00709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009ac0 tx=0x7fd8e8035040 comp rx=0 tx=0).stop 2024-09-17T01:09:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.799+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/846192605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8f8102f20 msgr2=0x7fd8f806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.799+0000 7fd8fdcb1640 1 --2- 172.21.15.2:0/846192605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8f8102f20 0x7fd8f806ff50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009af0 tx=0x7fd8ec004570 comp rx=0 tx=0).stop 2024-09-17T01:09:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.799+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/846192605 shutdown_connections 2024-09-17T01:09:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.799+0000 7fd8fdcb1640 1 --2- 172.21.15.2:0/846192605 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd8e006e530 0x7fd8e00709e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.799+0000 7fd8fdcb1640 1 --2- 172.21.15.2:0/846192605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8f8102f20 0x7fd8f806ff50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.799+0000 7fd8fdcb1640 1 --2- 172.21.15.2:0/846192605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8f8102580 0x7fd8f806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.799+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/846192605 >> 172.21.15.2:0/846192605 conn(0x7fd8f80f81a0 msgr2=0x7fd8f80f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.799+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/846192605 shutdown_connections 2024-09-17T01:09:30.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.799+0000 7fd8fdcb1640 1 -- 172.21.15.2:0/846192605 wait complete. 2024-09-17T01:09:30.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.891+0000 7f3fb34a9640 1 -- 172.21.15.2:0/1172693894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fac0fdf00 msgr2=0x7f3fac1065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:30.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.891+0000 7f3fb34a9640 1 --2- 172.21.15.2:0/1172693894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fac0fdf00 0x7f3fac1065d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0004900 tx=0x7f3fa0009da0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.891+0000 7f3fb34a9640 1 -- 172.21.15.2:0/1172693894 shutdown_connections 2024-09-17T01:09:30.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.891+0000 7f3fb34a9640 1 --2- 172.21.15.2:0/1172693894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fac0fdf00 0x7f3fac1065d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.891+0000 7f3fb34a9640 1 --2- 172.21.15.2:0/1172693894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3fac0fd560 0x7f3fac0fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.891+0000 7f3fb34a9640 1 -- 172.21.15.2:0/1172693894 >> 172.21.15.2:0/1172693894 conn(0x7f3fac0f7000 msgr2=0x7f3fac0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:30.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.891+0000 7f3fb34a9640 1 -- 172.21.15.2:0/1172693894 shutdown_connections 2024-09-17T01:09:30.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.891+0000 7f3fb34a9640 1 -- 172.21.15.2:0/1172693894 wait complete. 2024-09-17T01:09:30.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.892+0000 7f3fb34a9640 1 Processor -- start 2024-09-17T01:09:30.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.892+0000 7f3fb34a9640 1 -- start start 2024-09-17T01:09:30.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.892+0000 7f3fb34a9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fac0fd560 0x7f3fac0fb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.892+0000 7f3fb34a9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3fac0fdf00 0x7f3fac0fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.892+0000 7f3fb34a9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac0fbef0 con 0x7f3fac0fd560 2024-09-17T01:09:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.892+0000 7f3fb34a9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac0fc060 con 0x7f3fac0fdf00 2024-09-17T01:09:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.892+0000 7f3fb1245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fac0fd560 0x7f3fac0fb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.892+0000 7f3fb1245640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fac0fd560 0x7f3fac0fb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59610/0 (socket says 172.21.15.2:59610) 2024-09-17T01:09:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.892+0000 7f3fb1245640 1 -- 172.21.15.2:0/2267667405 learned_addr learned my addr 172.21.15.2:0/2267667405 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:09:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.892+0000 7f3fb0a44640 1 --2- 172.21.15.2:0/2267667405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3fac0fdf00 0x7f3fac0fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.893+0000 7f3fb1245640 1 -- 172.21.15.2:0/2267667405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3fac0fdf00 msgr2=0x7f3fac0fb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.893+0000 7f3fb1245640 1 --2- 172.21.15.2:0/2267667405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3fac0fdf00 0x7f3fac0fb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.893+0000 7f3fb1245640 1 -- 172.21.15.2:0/2267667405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa0005040 con 0x7f3fac0fd560 2024-09-17T01:09:30.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.893+0000 7f3fb1245640 1 --2- 172.21.15.2:0/2267667405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fac0fd560 0x7f3fac0fb420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8002a80 tx=0x7f3fa8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:30.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.893+0000 7f3f9dffb640 1 -- 172.21.15.2:0/2267667405 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa8007c30 con 0x7f3fac0fd560 2024-09-17T01:09:30.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.893+0000 7f3f9dffb640 1 -- 172.21.15.2:0/2267667405 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3fa800f040 con 0x7f3fac0fd560 2024-09-17T01:09:30.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.893+0000 7f3fb34a9640 1 -- 172.21.15.2:0/2267667405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fac119610 con 0x7f3fac0fd560 2024-09-17T01:09:30.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.893+0000 7f3f9dffb640 1 -- 172.21.15.2:0/2267667405 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa800dab0 con 0x7f3fac0fd560 2024-09-17T01:09:30.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.893+0000 7f3fb34a9640 1 -- 172.21.15.2:0/2267667405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fac119a50 con 0x7f3fac0fd560 2024-09-17T01:09:30.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.894+0000 7f3fb34a9640 1 -- 172.21.15.2:0/2267667405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fac0662b0 con 0x7f3fac0fd560 2024-09-17T01:09:30.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.895+0000 7f3f9dffb640 1 -- 172.21.15.2:0/2267667405 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f3fa800dc10 con 0x7f3fac0fd560 2024-09-17T01:09:30.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.895+0000 7f3f9dffb640 1 --2- 172.21.15.2:0/2267667405 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f3f9806e530 0x7f3f980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:30.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.895+0000 7f3f9dffb640 1 -- 172.21.15.2:0/2267667405 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f3fa808d9b0 con 0x7f3fac0fd560 2024-09-17T01:09:30.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.895+0000 7f3fb0a44640 1 --2- 172.21.15.2:0/2267667405 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f3f9806e530 0x7f3f980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:30.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.896+0000 7f3fb0a44640 1 --2- 172.21.15.2:0/2267667405 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f3f9806e530 0x7f3f980709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0007ac0 tx=0x7f3fa0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:30.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:30.900+0000 7f3f9dffb640 1 -- 172.21.15.2:0/2267667405 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3fa8056b50 con 0x7f3fac0fd560 2024-09-17T01:09:31.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.145+0000 7f3fb34a9640 1 -- 172.21.15.2:0/2267667405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3fac04b750 con 0x7f3fac0fd560 2024-09-17T01:09:31.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:30 smithi002 ceph-mon[98018]: pgmap v162: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:09:31.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:30 smithi002 ceph-mon[98018]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:09:31.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:30 smithi002 ceph-mon[98018]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-17T01:09:31.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:30 smithi002 ceph-mon[98018]: osdmap e85: 6 total, 5 up, 6 in 2024-09-17T01:09:31.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.145+0000 7f3f9dffb640 1 -- 172.21.15.2:0/2267667405 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7f3fa805a210 con 0x7f3fac0fd560 2024-09-17T01:09:31.145 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:09:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:09:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:09:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:09:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:09:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:09:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:09:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:09:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5 2024-09-17T01:09:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:09:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:09:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4 2024-09-17T01:09:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:09:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:09:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 4, 2024-09-17T01:09:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 9 2024-09-17T01:09:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:09:31.146 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:09:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.147+0000 7f3fb34a9640 1 -- 172.21.15.2:0/2267667405 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f3f9806e530 msgr2=0x7f3f980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.147+0000 7f3fb34a9640 1 --2- 172.21.15.2:0/2267667405 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f3f9806e530 0x7f3f980709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0007ac0 tx=0x7f3fa0035040 comp rx=0 tx=0).stop 2024-09-17T01:09:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.147+0000 7f3fb34a9640 1 -- 172.21.15.2:0/2267667405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fac0fd560 msgr2=0x7f3fac0fb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.147+0000 7f3fb34a9640 1 --2- 172.21.15.2:0/2267667405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fac0fd560 0x7f3fac0fb420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8002a80 tx=0x7f3fa8004600 comp rx=0 tx=0).stop 2024-09-17T01:09:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.147+0000 7f3fb34a9640 1 -- 172.21.15.2:0/2267667405 shutdown_connections 2024-09-17T01:09:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.147+0000 7f3fb34a9640 1 --2- 172.21.15.2:0/2267667405 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f3f9806e530 0x7f3f980709e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.147+0000 7f3fb34a9640 1 --2- 172.21.15.2:0/2267667405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3fac0fdf00 0x7f3fac0fb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.147+0000 7f3fb34a9640 1 --2- 172.21.15.2:0/2267667405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fac0fd560 0x7f3fac0fb420 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.147+0000 7f3fb34a9640 1 -- 172.21.15.2:0/2267667405 >> 172.21.15.2:0/2267667405 conn(0x7f3fac0f7000 msgr2=0x7f3fac0f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.148+0000 7f3fb34a9640 1 -- 172.21.15.2:0/2267667405 shutdown_connections 2024-09-17T01:09:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.148+0000 7f3fb34a9640 1 -- 172.21.15.2:0/2267667405 wait complete. 2024-09-17T01:09:31.194 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:30 smithi099 podman[96537]: 2024-09-17 01:09:30.844512941 +0000 UTC m=+0.653441178 container remove 90ca23c2eab2f67bd35d91fc27a2e83f02bee427310e1088372f30cc46690ace (image=quay.ceph.io/ceph-ci/ceph@sha256:c5428a59091f5674ce6e26540d9db0f28844a507e2a324b8305a00f1687ce028, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=quincy-4a70413, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-17T01:09:31.195 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:30 smithi099 ceph-mon[77412]: pgmap v162: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:09:31.195 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:30 smithi099 ceph-mon[77412]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:09:31.195 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:30 smithi099 ceph-mon[77412]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-17T01:09:31.195 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:30 smithi099 ceph-mon[77412]: osdmap e85: 6 total, 5 up, 6 in 2024-09-17T01:09:31.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.229+0000 7f0e68d9b640 1 -- 172.21.15.2:0/436565381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e64101510 msgr2=0x7f0e641018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:31.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.229+0000 7f0e68d9b640 1 --2- 172.21.15.2:0/436565381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e64101510 0x7f0e641018e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0e540048d0 tx=0x7f0e54009da0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.229+0000 7f0e68d9b640 1 -- 172.21.15.2:0/436565381 shutdown_connections 2024-09-17T01:09:31.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.229+0000 7f0e68d9b640 1 --2- 172.21.15.2:0/436565381 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e640fb4d0 0x7f0e640fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.229+0000 7f0e68d9b640 1 --2- 172.21.15.2:0/436565381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e64101510 0x7f0e641018e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.229+0000 7f0e68d9b640 1 -- 172.21.15.2:0/436565381 >> 172.21.15.2:0/436565381 conn(0x7f0e640f7090 msgr2=0x7f0e640f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:31.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.229+0000 7f0e68d9b640 1 -- 172.21.15.2:0/436565381 shutdown_connections 2024-09-17T01:09:31.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.229+0000 7f0e68d9b640 1 -- 172.21.15.2:0/436565381 wait complete. 2024-09-17T01:09:31.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.230+0000 7f0e68d9b640 1 Processor -- start 2024-09-17T01:09:31.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.230+0000 7f0e68d9b640 1 -- start start 2024-09-17T01:09:31.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.230+0000 7f0e68d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e640fb4d0 0x7f0e6410bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:31.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.230+0000 7f0e68d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e64101510 0x7f0e6410c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:31.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.230+0000 7f0e68d9b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6410c9d0 con 0x7f0e64101510 2024-09-17T01:09:31.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.230+0000 7f0e68d9b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6410cb10 con 0x7f0e640fb4d0 2024-09-17T01:09:31.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.230+0000 7f0e5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e64101510 0x7f0e6410c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:31.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.230+0000 7f0e5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e64101510 0x7f0e6410c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59628/0 (socket says 172.21.15.2:59628) 2024-09-17T01:09:31.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.230+0000 7f0e5bfff640 1 -- 172.21.15.2:0/1318763517 learned_addr learned my addr 172.21.15.2:0/1318763517 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:09:31.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.230+0000 7f0e6259c640 1 --2- 172.21.15.2:0/1318763517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e640fb4d0 0x7f0e6410bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:31.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.230+0000 7f0e5bfff640 1 -- 172.21.15.2:0/1318763517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e640fb4d0 msgr2=0x7f0e6410bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:31.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.230+0000 7f0e5bfff640 1 --2- 172.21.15.2:0/1318763517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e640fb4d0 0x7f0e6410bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.230+0000 7f0e5bfff640 1 -- 172.21.15.2:0/1318763517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e54005040 con 0x7f0e64101510 2024-09-17T01:09:31.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.231+0000 7f0e5bfff640 1 --2- 172.21.15.2:0/1318763517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e64101510 0x7f0e6410c490 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c002a50 tx=0x7f0e4c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:31.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.231+0000 7f0e5affd640 1 -- 172.21.15.2:0/1318763517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4c007c30 con 0x7f0e64101510 2024-09-17T01:09:31.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.231+0000 7f0e5affd640 1 -- 172.21.15.2:0/1318763517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0e4c00f040 con 0x7f0e64101510 2024-09-17T01:09:31.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.231+0000 7f0e68d9b640 1 -- 172.21.15.2:0/1318763517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e641195c0 con 0x7f0e64101510 2024-09-17T01:09:31.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.231+0000 7f0e5affd640 1 -- 172.21.15.2:0/1318763517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4c00da10 con 0x7f0e64101510 2024-09-17T01:09:31.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.231+0000 7f0e68d9b640 1 -- 172.21.15.2:0/1318763517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e64119970 con 0x7f0e64101510 2024-09-17T01:09:31.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.232+0000 7f0e68d9b640 1 -- 172.21.15.2:0/1318763517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e640fcc10 con 0x7f0e64101510 2024-09-17T01:09:31.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.232+0000 7f0e5affd640 1 -- 172.21.15.2:0/1318763517 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f0e4c00dbb0 con 0x7f0e64101510 2024-09-17T01:09:31.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.233+0000 7f0e5affd640 1 --2- 172.21.15.2:0/1318763517 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f0e5006e530 0x7f0e500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:31.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.233+0000 7f0e5affd640 1 -- 172.21.15.2:0/1318763517 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f0e4c08d890 con 0x7f0e64101510 2024-09-17T01:09:31.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.233+0000 7f0e6259c640 1 --2- 172.21.15.2:0/1318763517 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f0e5006e530 0x7f0e500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:31.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.234+0000 7f0e6259c640 1 --2- 172.21.15.2:0/1318763517 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f0e5006e530 0x7f0e500709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009ac0 tx=0x7f0e54035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:31.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.237+0000 7f0e5affd640 1 -- 172.21.15.2:0/1318763517 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0e4c056a30 con 0x7f0e64101510 2024-09-17T01:09:31.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.448+0000 7f0e68d9b640 1 -- 172.21.15.2:0/1318763517 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0e6404b720 con 0x7f0e64101510 2024-09-17T01:09:31.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.449+0000 7f0e5affd640 1 -- 172.21.15.2:0/1318763517 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1946 (secure 0 0 0) 0x7f0e4c05a0f0 con 0x7f0e64101510 2024-09-17T01:09:31.447 INFO:teuthology.orchestra.run.smithi002.stdout:e25 2024-09-17T01:09:31.448 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-17T01:05:48:747321+0000 2024-09-17T01:09:31.448 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:09:31.448 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:09:31.448 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-17T01:09:31.448 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:09:31.448 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:09:31.448 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-17T01:09:31.448 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 25 2024-09-17T01:09:31.448 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:09:31.448 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-17T00:59:20.485696+0000 2024-09-17T01:09:31.448 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-17T01:05:47.816861+0000 2024-09-17T01:09:31.448 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-17T01:09:31.449 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-17T01:09:31.449 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-17T01:09:31.449 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-17T01:09:31.449 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-17T01:09:31.449 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-17T01:09:31.449 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-17T01:09:31.449 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-17T01:09:31.449 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 44 2024-09-17T01:09:31.449 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:09:31.449 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2024-09-17T01:09:31.449 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2024-09-17T01:09:31.449 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=14464,1=24269} 2024-09-17T01:09:31.449 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-17T01:09:31.450 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-17T01:09:31.450 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-17T01:09:31.450 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-17T01:09:31.450 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-17T01:09:31.450 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-17T01:09:31.450 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-17T01:09:31.450 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-17T01:09:31.450 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-17T01:09:31.450 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 14464 members: 24269,14464 2024-09-17T01:09:31.450 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.fmyyzz{0:14464} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.2:6828/1494631266,v1:172.21.15.2:6829/1494631266] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:31.450 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.zmrgxd{0:24287} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/2986470392,v1:172.21.15.2:6827/2986470392] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:31.450 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.hgawhu{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.99:6824/4057317500,v1:172.21.15.99:6825/4057317500] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:31.450 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.heckcd{1:24279} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.99:6826/689359372,v1:172.21.15.99:6827/689359372] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:09:31.450 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:09:31.451 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:09:31.452 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-17T01:09:31.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.451+0000 7f0e68d9b640 1 -- 172.21.15.2:0/1318763517 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f0e5006e530 msgr2=0x7f0e500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:31.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.451+0000 7f0e68d9b640 1 --2- 172.21.15.2:0/1318763517 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f0e5006e530 0x7f0e500709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009ac0 tx=0x7f0e54035040 comp rx=0 tx=0).stop 2024-09-17T01:09:31.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.451+0000 7f0e68d9b640 1 -- 172.21.15.2:0/1318763517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e64101510 msgr2=0x7f0e6410c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:31.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.451+0000 7f0e68d9b640 1 --2- 172.21.15.2:0/1318763517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e64101510 0x7f0e6410c490 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c002a50 tx=0x7f0e4c004600 comp rx=0 tx=0).stop 2024-09-17T01:09:31.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.451+0000 7f0e68d9b640 1 -- 172.21.15.2:0/1318763517 shutdown_connections 2024-09-17T01:09:31.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.451+0000 7f0e68d9b640 1 --2- 172.21.15.2:0/1318763517 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f0e5006e530 0x7f0e500709e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.451+0000 7f0e68d9b640 1 --2- 172.21.15.2:0/1318763517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e64101510 0x7f0e6410c490 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.451+0000 7f0e68d9b640 1 --2- 172.21.15.2:0/1318763517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e640fb4d0 0x7f0e6410bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.451+0000 7f0e68d9b640 1 -- 172.21.15.2:0/1318763517 >> 172.21.15.2:0/1318763517 conn(0x7f0e640f7090 msgr2=0x7f0e640f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:31.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.451+0000 7f0e68d9b640 1 -- 172.21.15.2:0/1318763517 shutdown_connections 2024-09-17T01:09:31.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.451+0000 7f0e68d9b640 1 -- 172.21.15.2:0/1318763517 wait complete. 2024-09-17T01:09:31.494 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:31 smithi099 podman[96627]: 2024-09-17 01:09:31.100172219 +0000 UTC m=+0.015850133 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:09:31.495 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:31 smithi099 podman[96627]: 2024-09-17 01:09:31.203918672 +0000 UTC m=+0.119596627 container create 95023b74a46c75ae801e562134b80d01adf09dde8712689ddf204fc3be4b8b6c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-17T01:09:31.495 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:31 smithi099 podman[96627]: 2024-09-17 01:09:31.497675348 +0000 UTC m=+0.413353270 container init 95023b74a46c75ae801e562134b80d01adf09dde8712689ddf204fc3be4b8b6c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-17T01:09:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.534+0000 7f4ba68cb640 1 -- 172.21.15.2:0/3240071943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba00facf0 msgr2=0x7f4ba00fb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.534+0000 7f4ba68cb640 1 --2- 172.21.15.2:0/3240071943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba00facf0 0x7f4ba00fb160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4b940048d0 tx=0x7f4b94009da0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.534+0000 7f4ba68cb640 1 -- 172.21.15.2:0/3240071943 shutdown_connections 2024-09-17T01:09:31.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.534+0000 7f4ba68cb640 1 --2- 172.21.15.2:0/3240071943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba00facf0 0x7f4ba00fb160 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.534+0000 7f4ba68cb640 1 --2- 172.21.15.2:0/3240071943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba0102680 0x7f4ba0102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.534+0000 7f4ba68cb640 1 -- 172.21.15.2:0/3240071943 >> 172.21.15.2:0/3240071943 conn(0x7f4ba0070d50 msgr2=0x7f4ba0071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.534+0000 7f4ba68cb640 1 -- 172.21.15.2:0/3240071943 shutdown_connections 2024-09-17T01:09:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.534+0000 7f4ba68cb640 1 -- 172.21.15.2:0/3240071943 wait complete. 2024-09-17T01:09:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.534+0000 7f4ba68cb640 1 Processor -- start 2024-09-17T01:09:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.535+0000 7f4ba68cb640 1 -- start start 2024-09-17T01:09:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.535+0000 7f4ba68cb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba00facf0 0x7f4ba01132d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.535+0000 7f4ba68cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba0102680 0x7f4ba0113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.535+0000 7f4ba68cb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba0113e10 con 0x7f4ba0102680 2024-09-17T01:09:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.535+0000 7f4ba68cb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba010d250 con 0x7f4ba00facf0 2024-09-17T01:09:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.535+0000 7f4b9f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba0102680 0x7f4ba0113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.535+0000 7f4b9f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba0102680 0x7f4ba0113810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59644/0 (socket says 172.21.15.2:59644) 2024-09-17T01:09:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.535+0000 7f4b9f7fe640 1 -- 172.21.15.2:0/769526003 learned_addr learned my addr 172.21.15.2:0/769526003 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:09:31.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.535+0000 7f4b9ffff640 1 --2- 172.21.15.2:0/769526003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba00facf0 0x7f4ba01132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:31.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.535+0000 7f4b9f7fe640 1 -- 172.21.15.2:0/769526003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba00facf0 msgr2=0x7f4ba01132d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:31.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.535+0000 7f4b9f7fe640 1 --2- 172.21.15.2:0/769526003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba00facf0 0x7f4ba01132d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.535+0000 7f4b9f7fe640 1 -- 172.21.15.2:0/769526003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b94005040 con 0x7f4ba0102680 2024-09-17T01:09:31.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.535+0000 7f4b9f7fe640 1 --2- 172.21.15.2:0/769526003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba0102680 0x7f4ba0113810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4b940043d0 tx=0x7f4b94009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:31.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.536+0000 7f4b9cff9640 1 -- 172.21.15.2:0/769526003 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b94038070 con 0x7f4ba0102680 2024-09-17T01:09:31.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.536+0000 7f4b9cff9640 1 -- 172.21.15.2:0/769526003 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b940096e0 con 0x7f4ba0102680 2024-09-17T01:09:31.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.536+0000 7f4ba68cb640 1 -- 172.21.15.2:0/769526003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba010d4d0 con 0x7f4ba0102680 2024-09-17T01:09:31.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.536+0000 7f4b9cff9640 1 -- 172.21.15.2:0/769526003 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b9403d420 con 0x7f4ba0102680 2024-09-17T01:09:31.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.536+0000 7f4ba68cb640 1 -- 172.21.15.2:0/769526003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba010d9f0 con 0x7f4ba0102680 2024-09-17T01:09:31.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.537+0000 7f4ba68cb640 1 -- 172.21.15.2:0/769526003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba00657f0 con 0x7f4ba0102680 2024-09-17T01:09:31.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.537+0000 7f4b9cff9640 1 -- 172.21.15.2:0/769526003 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f4b94030020 con 0x7f4ba0102680 2024-09-17T01:09:31.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.538+0000 7f4b9cff9640 1 --2- 172.21.15.2:0/769526003 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4b8806e530 0x7f4b880709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:31.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.538+0000 7f4b9cff9640 1 -- 172.21.15.2:0/769526003 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f4b940ae680 con 0x7f4ba0102680 2024-09-17T01:09:31.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.538+0000 7f4b9ffff640 1 --2- 172.21.15.2:0/769526003 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4b8806e530 0x7f4b880709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:31.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.538+0000 7f4b9ffff640 1 --2- 172.21.15.2:0/769526003 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4b8806e530 0x7f4b880709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4b90004ed0 tx=0x7f4b9000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:31.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.542+0000 7f4b9cff9640 1 -- 172.21.15.2:0/769526003 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4b940776d0 con 0x7f4ba0102680 2024-09-17T01:09:31.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.737+0000 7f4ba68cb640 1 -- 172.21.15.2:0/769526003 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ba010e970 con 0x7f4b8806e530 2024-09-17T01:09:31.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.739+0000 7f4b9cff9640 1 -- 172.21.15.2:0/769526003 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4ba010e970 con 0x7f4b8806e530 2024-09-17T01:09:31.737 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:09:31.737 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:09:31.737 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:09:31.737 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:09:31.737 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-17T01:09:31.738 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-17T01:09:31.738 INFO:teuthology.orchestra.run.smithi002.stdout: "mon", 2024-09-17T01:09:31.738 INFO:teuthology.orchestra.run.smithi002.stdout: "crash" 2024-09-17T01:09:31.738 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-17T01:09:31.738 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "11/21 daemons upgraded", 2024-09-17T01:09:31.738 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:09:31.738 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:09:31.738 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:09:31.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.741+0000 7f4ba68cb640 1 -- 172.21.15.2:0/769526003 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4b8806e530 msgr2=0x7f4b880709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:31.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.741+0000 7f4ba68cb640 1 --2- 172.21.15.2:0/769526003 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4b8806e530 0x7f4b880709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4b90004ed0 tx=0x7f4b9000b040 comp rx=0 tx=0).stop 2024-09-17T01:09:31.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.741+0000 7f4ba68cb640 1 -- 172.21.15.2:0/769526003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba0102680 msgr2=0x7f4ba0113810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.741+0000 7f4ba68cb640 1 --2- 172.21.15.2:0/769526003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba0102680 0x7f4ba0113810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4b940043d0 tx=0x7f4b94009da0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.741+0000 7f4ba68cb640 1 -- 172.21.15.2:0/769526003 shutdown_connections 2024-09-17T01:09:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.741+0000 7f4ba68cb640 1 --2- 172.21.15.2:0/769526003 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4b8806e530 0x7f4b880709e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.741+0000 7f4ba68cb640 1 --2- 172.21.15.2:0/769526003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4ba0102680 0x7f4ba0113810 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.741+0000 7f4ba68cb640 1 --2- 172.21.15.2:0/769526003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba00facf0 0x7f4ba01132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.741+0000 7f4ba68cb640 1 -- 172.21.15.2:0/769526003 >> 172.21.15.2:0/769526003 conn(0x7f4ba0070d50 msgr2=0x7f4ba00fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.741+0000 7f4ba68cb640 1 -- 172.21.15.2:0/769526003 shutdown_connections 2024-09-17T01:09:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.741+0000 7f4ba68cb640 1 -- 172.21.15.2:0/769526003 wait complete. 2024-09-17T01:09:31.793 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:31 smithi099 podman[96627]: 2024-09-17 01:09:31.501243755 +0000 UTC m=+0.416921674 container start 95023b74a46c75ae801e562134b80d01adf09dde8712689ddf204fc3be4b8b6c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-17T01:09:31.793 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:31 smithi099 podman[96627]: 2024-09-17 01:09:31.623403056 +0000 UTC m=+0.539080978 container attach 95023b74a46c75ae801e562134b80d01adf09dde8712689ddf204fc3be4b8b6c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-17T01:09:31.793 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:31 smithi099 podman[96627]: 2024-09-17 01:09:31.687034154 +0000 UTC m=+0.602712068 container died 95023b74a46c75ae801e562134b80d01adf09dde8712689ddf204fc3be4b8b6c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True) 2024-09-17T01:09:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.822+0000 7f3508a42640 1 -- 172.21.15.2:0/3023343443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35040fac80 msgr2=0x7f35040fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.822+0000 7f3508a42640 1 --2- 172.21.15.2:0/3023343443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35040fac80 0x7f35040fb0f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f34f80048d0 tx=0x7f34f8009da0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.822+0000 7f3508a42640 1 -- 172.21.15.2:0/3023343443 shutdown_connections 2024-09-17T01:09:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.822+0000 7f3508a42640 1 --2- 172.21.15.2:0/3023343443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35040fac80 0x7f35040fb0f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.822+0000 7f3508a42640 1 --2- 172.21.15.2:0/3023343443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3504102620 0x7f35041029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.822+0000 7f3508a42640 1 -- 172.21.15.2:0/3023343443 >> 172.21.15.2:0/3023343443 conn(0x7f3504070ce0 msgr2=0x7f35040710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.822+0000 7f3508a42640 1 -- 172.21.15.2:0/3023343443 shutdown_connections 2024-09-17T01:09:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.822+0000 7f3508a42640 1 -- 172.21.15.2:0/3023343443 wait complete. 2024-09-17T01:09:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.823+0000 7f3508a42640 1 Processor -- start 2024-09-17T01:09:31.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.823+0000 7f3508a42640 1 -- start start 2024-09-17T01:09:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.823+0000 7f3508a42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35040fac80 0x7f35040fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.823+0000 7f3508a42640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3504102620 0x7f35040fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.823+0000 7f3508a42640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35040fc8e0 con 0x7f35040fac80 2024-09-17T01:09:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.823+0000 7f3508a42640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35040fca50 con 0x7f3504102620 2024-09-17T01:09:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.823+0000 7f350259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35040fac80 0x7f35040fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.823+0000 7f350259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35040fac80 0x7f35040fbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59666/0 (socket says 172.21.15.2:59666) 2024-09-17T01:09:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.823+0000 7f350259c640 1 -- 172.21.15.2:0/1762276930 learned_addr learned my addr 172.21.15.2:0/1762276930 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:09:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.823+0000 7f3501d9b640 1 --2- 172.21.15.2:0/1762276930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3504102620 0x7f35040fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.823+0000 7f350259c640 1 -- 172.21.15.2:0/1762276930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3504102620 msgr2=0x7f35040fc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.824+0000 7f350259c640 1 --2- 172.21.15.2:0/1762276930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3504102620 0x7f35040fc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.824+0000 7f350259c640 1 -- 172.21.15.2:0/1762276930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f8005040 con 0x7f35040fac80 2024-09-17T01:09:31.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.824+0000 7f350259c640 1 --2- 172.21.15.2:0/1762276930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35040fac80 0x7f35040fbe60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f34f400eb70 tx=0x7f34f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.824+0000 7f34f2ffd640 1 -- 172.21.15.2:0/1762276930 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34f4007c30 con 0x7f35040fac80 2024-09-17T01:09:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.824+0000 7f34f2ffd640 1 -- 172.21.15.2:0/1762276930 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f34f400f040 con 0x7f35040fac80 2024-09-17T01:09:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.824+0000 7f3508a42640 1 -- 172.21.15.2:0/1762276930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35040fcc80 con 0x7f35040fac80 2024-09-17T01:09:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.824+0000 7f34f2ffd640 1 -- 172.21.15.2:0/1762276930 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34f400ca60 con 0x7f35040fac80 2024-09-17T01:09:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.824+0000 7f3508a42640 1 -- 172.21.15.2:0/1762276930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35041198b0 con 0x7f35040fac80 2024-09-17T01:09:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.825+0000 7f3508a42640 1 -- 172.21.15.2:0/1762276930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35040657b0 con 0x7f35040fac80 2024-09-17T01:09:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.825+0000 7f34f2ffd640 1 -- 172.21.15.2:0/1762276930 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f34f400cbc0 con 0x7f35040fac80 2024-09-17T01:09:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.826+0000 7f34f2ffd640 1 --2- 172.21.15.2:0/1762276930 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f34ec06e530 0x7f34ec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:09:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.826+0000 7f34f2ffd640 1 -- 172.21.15.2:0/1762276930 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6613+0+0 (secure 0 0 0) 0x7f34f408de30 con 0x7f35040fac80 2024-09-17T01:09:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.826+0000 7f3501d9b640 1 --2- 172.21.15.2:0/1762276930 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f34ec06e530 0x7f34ec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:09:31.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.826+0000 7f3501d9b640 1 --2- 172.21.15.2:0/1762276930 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f34ec06e530 0x7f34ec0709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f35040fd7a0 tx=0x7f34f8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:09:31.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:31.830+0000 7f34f2ffd640 1 -- 172.21.15.2:0/1762276930 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f34f4056f20 con 0x7f35040fac80 2024-09-17T01:09:32.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:32.073+0000 7f3508a42640 1 -- 172.21.15.2:0/1762276930 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f350404b750 con 0x7f35040fac80 2024-09-17T01:09:32.072 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:31 smithi002 ceph-mon[98018]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:32.072 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:31 smithi002 ceph-mon[98018]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:32.072 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:31 smithi002 ceph-mon[98018]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:32.072 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:31 smithi002 ceph-mon[98018]: osdmap e86: 6 total, 5 up, 6 in 2024-09-17T01:09:32.073 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:31 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/2267667405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:32.073 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:31 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1318763517' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:09:32.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:32.074+0000 7f34f2ffd640 1 -- 172.21.15.2:0/1762276930 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1020 (secure 0 0 0) 0x7f34f4019410 con 0x7f35040fac80 2024-09-17T01:09:32.073 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Reduced data availability: 5 pgs peering 2024-09-17T01:09:32.073 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:09:32.073 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:09:32.073 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-17T01:09:32.073 INFO:teuthology.orchestra.run.smithi002.stdout: osd.5 (root=default,host=smithi099) is down 2024-09-17T01:09:32.074 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-17T01:09:32.074 INFO:teuthology.orchestra.run.smithi002.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-17T01:09:32.074 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 5 pgs peering 2024-09-17T01:09:32.074 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.3 is stuck peering for 7m, current state peering, last acting [2,1] 2024-09-17T01:09:32.074 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.17 is stuck peering for 2m, current state peering, last acting [2,1] 2024-09-17T01:09:32.074 INFO:teuthology.orchestra.run.smithi002.stdout: pg 3.5 is stuck peering for 6m, current state peering, last acting [2,3] 2024-09-17T01:09:32.074 INFO:teuthology.orchestra.run.smithi002.stdout: pg 3.c is stuck peering for 6m, current state peering, last acting [0,3] 2024-09-17T01:09:32.074 INFO:teuthology.orchestra.run.smithi002.stdout: pg 3.10 is stuck peering for 6m, current state peering, last acting [0,1] 2024-09-17T01:09:32.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:32.076+0000 7f3508a42640 1 -- 172.21.15.2:0/1762276930 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f34ec06e530 msgr2=0x7f34ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:32.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:32.076+0000 7f3508a42640 1 --2- 172.21.15.2:0/1762276930 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f34ec06e530 0x7f34ec0709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f35040fd7a0 tx=0x7f34f8035040 comp rx=0 tx=0).stop 2024-09-17T01:09:32.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:32.076+0000 7f3508a42640 1 -- 172.21.15.2:0/1762276930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35040fac80 msgr2=0x7f35040fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:09:32.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:32.076+0000 7f3508a42640 1 --2- 172.21.15.2:0/1762276930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35040fac80 0x7f35040fbe60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f34f400eb70 tx=0x7f34f400b040 comp rx=0 tx=0).stop 2024-09-17T01:09:32.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:32.076+0000 7f3508a42640 1 -- 172.21.15.2:0/1762276930 shutdown_connections 2024-09-17T01:09:32.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:32.076+0000 7f3508a42640 1 --2- 172.21.15.2:0/1762276930 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f34ec06e530 0x7f34ec0709e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:32.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:32.076+0000 7f3508a42640 1 --2- 172.21.15.2:0/1762276930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3504102620 0x7f35040fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:32.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:32.076+0000 7f3508a42640 1 --2- 172.21.15.2:0/1762276930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35040fac80 0x7f35040fbe60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:09:32.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:32.076+0000 7f3508a42640 1 -- 172.21.15.2:0/1762276930 >> 172.21.15.2:0/1762276930 conn(0x7f3504070ce0 msgr2=0x7f3504105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:09:32.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:32.076+0000 7f3508a42640 1 -- 172.21.15.2:0/1762276930 shutdown_connections 2024-09-17T01:09:32.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:09:32.076+0000 7f3508a42640 1 -- 172.21.15.2:0/1762276930 wait complete. 2024-09-17T01:09:32.274 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:31 smithi099 ceph-mon[77412]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:32.275 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:31 smithi099 ceph-mon[77412]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:32.275 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:31 smithi099 ceph-mon[77412]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:32.275 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:31 smithi099 ceph-mon[77412]: osdmap e86: 6 total, 5 up, 6 in 2024-09-17T01:09:32.275 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:31 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/2267667405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:32.275 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:31 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1318763517' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:09:32.543 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:32 smithi099 podman[96651]: 2024-09-17 01:09:32.277267697 +0000 UTC m=+0.583618222 container remove 95023b74a46c75ae801e562134b80d01adf09dde8712689ddf204fc3be4b8b6c (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, ceph=True) 2024-09-17T01:09:32.543 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:32 smithi099 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-17T01:09:32.543 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:32 smithi099 systemd[1]: Stopped Ceph osd.5 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:09:32.543 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:32 smithi099 systemd[1]: ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.5.service: Consumed 56.675s CPU time. 2024-09-17T01:09:32.544 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:32 smithi099 systemd[1]: Starting Ceph osd.5 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:09:32.953 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:32 smithi099 ceph-mon[77412]: pgmap v165: 65 pgs: 8 peering, 8 stale+active+clean, 49 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:32.953 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:32 smithi099 ceph-mon[77412]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:32.953 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:32 smithi099 ceph-mon[77412]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2024-09-17T01:09:32.953 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:32 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1762276930' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:09:32.953 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:32 smithi099 podman[96751]: 2024-09-17 01:09:32.595346834 +0000 UTC m=+0.015495765 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:09:32.954 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:32 smithi099 podman[96751]: 2024-09-17 01:09:32.711833751 +0000 UTC m=+0.131982726 container create 50dba092df9d7946e15fafb2cdcc248718082ef3d6d0b58c59b1df4bc1e3d018 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97) 2024-09-17T01:09:32.954 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:32 smithi099 podman[96751]: 2024-09-17 01:09:32.956247511 +0000 UTC m=+0.376396445 container init 50dba092df9d7946e15fafb2cdcc248718082ef3d6d0b58c59b1df4bc1e3d018 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-17T01:09:33.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:32 smithi002 ceph-mon[98018]: pgmap v165: 65 pgs: 8 peering, 8 stale+active+clean, 49 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:33.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:32 smithi002 ceph-mon[98018]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:09:33.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:32 smithi002 ceph-mon[98018]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2024-09-17T01:09:33.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:32 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1762276930' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:09:33.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:32 smithi099 podman[96751]: 2024-09-17 01:09:32.959581893 +0000 UTC m=+0.379730830 container start 50dba092df9d7946e15fafb2cdcc248718082ef3d6d0b58c59b1df4bc1e3d018 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-17T01:09:33.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:33 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate[96766]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:33.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:33 smithi099 podman[96751]: 2024-09-17 01:09:33.089671103 +0000 UTC m=+0.509820048 container attach 50dba092df9d7946e15fafb2cdcc248718082ef3d6d0b58c59b1df4bc1e3d018 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-17T01:09:33.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:33 smithi099 bash[96751]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:33.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:33 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate[96766]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:33.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:33 smithi099 bash[96751]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:09:34.101 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:33 smithi099 ceph-mon[77412]: Health check failed: Degraded data redundancy: 47/354 objects degraded (13.277%), 11 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:34.101 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:33 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate[96766]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:09:34.102 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:33 smithi099 bash[96751]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:09:34.102 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:33 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate[96766]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:09:34.102 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:33 smithi099 bash[96751]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:09:34.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:33 smithi002 ceph-mon[98018]: Health check failed: Degraded data redundancy: 47/354 objects degraded (13.277%), 11 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:34.440 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:34 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate[96766]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:09:34.440 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:34 smithi099 bash[96751]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:09:34.440 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:34 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate[96766]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:09:34.441 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:34 smithi099 bash[96751]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:09:34.441 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:34 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate[96766]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-17T01:09:34.441 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:34 smithi099 bash[96751]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-17T01:09:34.441 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:34 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate[96766]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:09:34.441 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:34 smithi099 bash[96751]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:09:34.441 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:34 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate[96766]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-17T01:09:34.441 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:34 smithi099 bash[96751]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-17T01:09:34.441 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:34 smithi099 podman[96751]: 2024-09-17 01:09:34.13219183 +0000 UTC m=+1.552340761 container died 50dba092df9d7946e15fafb2cdcc248718082ef3d6d0b58c59b1df4bc1e3d018 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97) 2024-09-17T01:09:35.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:34 smithi099 ceph-mon[77412]: pgmap v166: 65 pgs: 10 active+undersized, 8 peering, 11 active+undersized+degraded, 36 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/354 objects degraded (13.277%) 2024-09-17T01:09:35.043 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:34 smithi099 podman[96913]: 2024-09-17 01:09:34.752099896 +0000 UTC m=+0.613471544 container remove 50dba092df9d7946e15fafb2cdcc248718082ef3d6d0b58c59b1df4bc1e3d018 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-17T01:09:35.043 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:34 smithi099 podman[96971]: 2024-09-17 01:09:34.953127435 +0000 UTC m=+0.110286053 container create e26706fa8822f9739cf40a48aad96a0d86a01ef5f1ed1e38558e30ea99b9e0df (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:09:35.044 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:34 smithi099 podman[96971]: 2024-09-17 01:09:34.858255772 +0000 UTC m=+0.015414362 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:09:35.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:34 smithi002 ceph-mon[98018]: pgmap v166: 65 pgs: 10 active+undersized, 8 peering, 11 active+undersized+degraded, 36 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/354 objects degraded (13.277%) 2024-09-17T01:09:35.311 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:35 smithi099 podman[96971]: 2024-09-17 01:09:35.205785777 +0000 UTC m=+0.362944369 container init e26706fa8822f9739cf40a48aad96a0d86a01ef5f1ed1e38558e30ea99b9e0df (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:09:35.311 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:35 smithi099 podman[96971]: 2024-09-17 01:09:35.208913304 +0000 UTC m=+0.366071880 container start e26706fa8822f9739cf40a48aad96a0d86a01ef5f1ed1e38558e30ea99b9e0df (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-09-17T01:09:35.311 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:35 smithi099 ceph-osd[96990]: -- 172.21.15.99:0/1906134163 <== mon.1 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5616236261e0 con 0x5616227d3c00 2024-09-17T01:09:35.793 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:35 smithi099 bash[96971]: e26706fa8822f9739cf40a48aad96a0d86a01ef5f1ed1e38558e30ea99b9e0df 2024-09-17T01:09:35.793 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:35 smithi099 systemd[1]: Started Ceph osd.5 for f8e82564-748e-11ef-bceb-c7b262605968. 2024-09-17T01:09:36.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:36 smithi002 ceph-mon[98018]: pgmap v167: 65 pgs: 10 active+undersized, 8 peering, 11 active+undersized+degraded, 36 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/354 objects degraded (13.277%) 2024-09-17T01:09:36.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:36 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:36.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:36 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:36.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:36 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:36.684 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:36 smithi099 ceph-mon[77412]: pgmap v167: 65 pgs: 10 active+undersized, 8 peering, 11 active+undersized+degraded, 36 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 47/354 objects degraded (13.277%) 2024-09-17T01:09:36.685 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:36 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:36.685 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:36 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:36.685 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:36 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:36.943 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:36 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:09:36.836+0000 7f368802e640 -1 Falling back to public interface 2024-09-17T01:09:37.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:37 smithi099 ceph-mon[77412]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-09-17T01:09:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:37 smithi002 ceph-mon[98018]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-09-17T01:09:38.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:38 smithi099 ceph-mon[77412]: pgmap v168: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:09:38.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:38 smithi002 ceph-mon[98018]: pgmap v168: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:09:39.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:39 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:39.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:39 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:39.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:39 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:39.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:39 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:39.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:39 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:39.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:39 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:39.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:39 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:39.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:39 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:40.749 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:40 smithi099 ceph-mon[77412]: pgmap v169: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:09:40.749 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:40 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:40.749 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:40 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:40.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:40 smithi002 ceph-mon[98018]: pgmap v169: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:09:40.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:40 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:40.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:40 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:42.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:42 smithi002 ceph-mon[98018]: pgmap v170: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:09:42.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:42 smithi002 ceph-mon[98018]: from='osd.5 [v2:172.21.15.99:6816/3345147723,v1:172.21.15.99:6817/3345147723]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:09:42.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:42 smithi002 ceph-mon[98018]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:09:42.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:42 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:42.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:42 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:42.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:42 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:42.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:42 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:42.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:42 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:42.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:42 smithi099 ceph-mon[77412]: pgmap v170: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 55/354 objects degraded (15.537%) 2024-09-17T01:09:42.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:42 smithi099 ceph-mon[77412]: from='osd.5 [v2:172.21.15.99:6816/3345147723,v1:172.21.15.99:6817/3345147723]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:09:42.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:42 smithi099 ceph-mon[77412]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:09:42.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:42 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:42.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:42 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:42.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:42 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:42.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:42 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:42.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:42 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:42.794 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:42 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:09:42.311+0000 7f368802e640 -1 osd.5 84 log_to_monitors true 2024-09-17T01:09:42.794 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:09:42 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:09:42.533+0000 7f367fdc8640 -1 osd.5 84 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:09:43.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:09:43.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: osdmap e87: 6 total, 5 up, 6 in 2024-09-17T01:09:43.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='osd.5 [v2:172.21.15.99:6816/3345147723,v1:172.21.15.99:6817/3345147723]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T01:09:43.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T01:09:43.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:43.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:43.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:43.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:43.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:43.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: Upgrade: Setting container_image for all osd 2024-09-17T01:09:43.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:43.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-17T01:09:43.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T01:09:43.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-17T01:09:43.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T01:09:43.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-17T01:09:43.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T01:09:43.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-17T01:09:43.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T01:09:43.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-17T01:09:43.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T01:09:43.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-17T01:09:43.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T01:09:43.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: Upgrade: Setting require_osd_release to 19 squid 2024-09-17T01:09:43.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-17T01:09:43.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:09:43.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: osdmap e87: 6 total, 5 up, 6 in 2024-09-17T01:09:43.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='osd.5 [v2:172.21.15.99:6816/3345147723,v1:172.21.15.99:6817/3345147723]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T01:09:43.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-17T01:09:43.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:43.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:43.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:43.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:43.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:43.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: Upgrade: Setting container_image for all osd 2024-09-17T01:09:43.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:43.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-17T01:09:43.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T01:09:43.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-17T01:09:43.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T01:09:43.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-17T01:09:43.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T01:09:43.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-17T01:09:43.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T01:09:43.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-17T01:09:43.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T01:09:43.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-17T01:09:43.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T01:09:43.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: Upgrade: Setting require_osd_release to 19 squid 2024-09-17T01:09:43.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-17T01:09:44.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:44 smithi099 ceph-mon[77412]: pgmap v172: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 55/354 objects degraded (15.537%) 2024-09-17T01:09:44.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:44 smithi099 ceph-mon[77412]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:09:44.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:44 smithi099 ceph-mon[77412]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-17T01:09:44.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:44 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-17T01:09:44.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:44 smithi099 ceph-mon[77412]: osd.5 [v2:172.21.15.99:6816/3345147723,v1:172.21.15.99:6817/3345147723] boot 2024-09-17T01:09:44.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:44 smithi099 ceph-mon[77412]: osdmap e88: 6 total, 6 up, 6 in 2024-09-17T01:09:44.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:44 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:09:44.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:44 smithi099 ceph-mon[77412]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-17T01:09:44.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:44 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:44.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:44 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-17T01:09:44.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:44 smithi099 ceph-mon[77412]: Health check update: Degraded data redundancy: 55/354 objects degraded (15.537%), 14 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:44.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:44 smithi099 ceph-mon[77412]: osdmap e89: 6 total, 6 up, 6 in 2024-09-17T01:09:44.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:44 smithi002 ceph-mon[98018]: pgmap v172: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 55/354 objects degraded (15.537%) 2024-09-17T01:09:44.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:44 smithi002 ceph-mon[98018]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:09:44.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:44 smithi002 ceph-mon[98018]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-17T01:09:44.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:44 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-17T01:09:44.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:44 smithi002 ceph-mon[98018]: osd.5 [v2:172.21.15.99:6816/3345147723,v1:172.21.15.99:6817/3345147723] boot 2024-09-17T01:09:44.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:44 smithi002 ceph-mon[98018]: osdmap e88: 6 total, 6 up, 6 in 2024-09-17T01:09:44.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:44 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:09:44.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:44 smithi002 ceph-mon[98018]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-17T01:09:44.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:44 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:44.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:44 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-17T01:09:44.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:44 smithi002 ceph-mon[98018]: Health check update: Degraded data redundancy: 55/354 objects degraded (15.537%), 14 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:44.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:44 smithi002 ceph-mon[98018]: osdmap e89: 6 total, 6 up, 6 in 2024-09-17T01:09:44.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:44 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[98014]: 2024-09-17T01:09:44.669+0000 7f61cfbc2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:09:45.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T01:09:45.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-17T01:09:45.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2024-09-17T01:09:45.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:45.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: osdmap e90: 6 total, 6 up, 6 in 2024-09-17T01:09:45.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-17T01:09:45.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-17T01:09:45.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:09:45.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:09:45.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T01:09:45.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-17T01:09:45.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: osdmap e91: 6 total, 6 up, 6 in 2024-09-17T01:09:45.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.2:6826/3086061169,v1:172.21.15.2:6827/3086061169] up:boot 2024-09-17T01:09:45.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.99:6826/2884389025,v1:172.21.15.99:6827/2884389025] up:boot 2024-09-17T01:09:45.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-17T01:09:45.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T01:09:45.657 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T01:09:45.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T01:09:45.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-17T01:09:45.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: fsmap cephfs:2 {0=cephfs.smithi002.fmyyzz=up:active,1=cephfs.smithi099.hgawhu=up:active} 2024-09-17T01:09:45.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:45.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:09:45.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:45.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: osdmap e90: 6 total, 6 up, 6 in 2024-09-17T01:09:45.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:45.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:09:45.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-17T01:09:45.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-17T01:09:45.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:09:45.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:09:45.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T01:09:45.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-17T01:09:45.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: osdmap e91: 6 total, 6 up, 6 in 2024-09-17T01:09:45.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.2:6826/3086061169,v1:172.21.15.2:6827/3086061169] up:boot 2024-09-17T01:09:45.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.99:6826/2884389025,v1:172.21.15.99:6827/2884389025] up:boot 2024-09-17T01:09:45.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-17T01:09:45.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T01:09:45.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T01:09:46.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:46 smithi002 ceph-mon[98018]: pgmap v177: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 55/354 objects degraded (15.537%) 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:46 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.99:6824/3901555472,v1:172.21.15.99:6825/3901555472] up:boot 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:46 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.2:6828/1844749656,v1:172.21.15.2:6829/1844749656] up:boot 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:46 smithi002 ceph-mon[98018]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:46 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.fmyyzz"}]: dispatch 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:46 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.hgawhu"}]: dispatch 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:46 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:46 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.zmrgxd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:09:46.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:46 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:46 smithi099 ceph-mon[77412]: pgmap v177: 65 pgs: 15 active+undersized, 14 active+undersized+degraded, 36 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 55/354 objects degraded (15.537%) 2024-09-17T01:09:47.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:46 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.99:6824/3901555472,v1:172.21.15.99:6825/3901555472] up:boot 2024-09-17T01:09:47.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:46 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.2:6828/1844749656,v1:172.21.15.2:6829/1844749656] up:boot 2024-09-17T01:09:47.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:46 smithi099 ceph-mon[77412]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-17T01:09:47.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:46 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.fmyyzz"}]: dispatch 2024-09-17T01:09:47.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:46 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.hgawhu"}]: dispatch 2024-09-17T01:09:47.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:46 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:47.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:46 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.zmrgxd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:09:47.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:46 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:09:47.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:47 smithi002 ceph-mon[98018]: Upgrade: Updating mds.cephfs.smithi002.zmrgxd 2024-09-17T01:09:47.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:47 smithi002 ceph-mon[98018]: Deploying daemon mds.cephfs.smithi002.zmrgxd on smithi002 2024-09-17T01:09:48.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:47 smithi099 ceph-mon[77412]: Upgrade: Updating mds.cephfs.smithi002.zmrgxd 2024-09-17T01:09:48.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:47 smithi099 ceph-mon[77412]: Deploying daemon mds.cephfs.smithi002.zmrgxd on smithi002 2024-09-17T01:09:49.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:48 smithi099 ceph-mon[77412]: pgmap v178: 65 pgs: 11 active+undersized, 10 active+undersized+degraded, 44 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 45/354 objects degraded (12.712%) 2024-09-17T01:09:49.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:48 smithi099 ceph-mon[77412]: Health check update: Degraded data redundancy: 45/354 objects degraded (12.712%), 10 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:49.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:48 smithi002 ceph-mon[98018]: pgmap v178: 65 pgs: 11 active+undersized, 10 active+undersized+degraded, 44 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 45/354 objects degraded (12.712%) 2024-09-17T01:09:49.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:48 smithi002 ceph-mon[98018]: Health check update: Degraded data redundancy: 45/354 objects degraded (12.712%), 10 pgs degraded (PG_DEGRADED) 2024-09-17T01:09:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:49 smithi099 ceph-mon[77412]: osdmap e92: 6 total, 6 up, 6 in 2024-09-17T01:09:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:49 smithi099 ceph-mon[77412]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-17T01:09:50.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T01:09:50.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:49 smithi002 ceph-mon[98018]: osdmap e92: 6 total, 6 up, 6 in 2024-09-17T01:09:50.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:49 smithi002 ceph-mon[98018]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-17T01:09:50.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T01:09:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:50 smithi099 ceph-mon[77412]: pgmap v180: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:50 smithi099 ceph-mon[77412]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/354 objects degraded (12.712%), 10 pgs degraded) 2024-09-17T01:09:51.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:50 smithi002 ceph-mon[98018]: pgmap v180: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:51.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:50 smithi002 ceph-mon[98018]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/354 objects degraded (12.712%), 10 pgs degraded) 2024-09-17T01:09:52.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:52 smithi002 ceph-mon[98018]: pgmap v181: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:53.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:52 smithi099 ceph-mon[77412]: pgmap v181: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:55.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:54 smithi099 ceph-mon[77412]: pgmap v182: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:55.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:54 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:55.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:54 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:55.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:54 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:54 smithi002 ceph-mon[98018]: pgmap v182: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:55.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:54 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:55.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:54 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:55.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:54 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:09:55.757 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:55 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.2:6826/2424122669,v1:172.21.15.2:6827/2424122669] up:boot 2024-09-17T01:09:55.757 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:55 smithi002 ceph-mon[98018]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-17T01:09:55.757 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T01:09:55.757 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:56.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:55 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.2:6826/2424122669,v1:172.21.15.2:6827/2424122669] up:boot 2024-09-17T01:09:56.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:55 smithi099 ceph-mon[77412]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-17T01:09:56.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T01:09:56.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:56.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:56.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:56.074 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:09:56.074 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:09:56.795 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:56 smithi002 ceph-mon[98018]: pgmap v183: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:57.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:56 smithi099 ceph-mon[77412]: pgmap v183: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:59.023 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:09:58 smithi002 ceph-mon[98018]: pgmap v184: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:09:59.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:09:58 smithi099 ceph-mon[77412]: pgmap v184: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:00.314 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[98014]: 2024-09-17T01:09:59.999+0000 7f61d23c7640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-17T01:10:00.315 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[98014]: 2024-09-17T01:09:59.999+0000 7f61d23c7640 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-17T01:10:00.315 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[98014]: 2024-09-17T01:09:59.999+0000 7f61d23c7640 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-09-17T01:10:00.315 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[98014]: 2024-09-17T01:09:59.999+0000 7f61d23c7640 -1 log_channel(cluster) log [ERR] : [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:10:00.315 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[98014]: 2024-09-17T01:09:59.999+0000 7f61d23c7640 -1 log_channel(cluster) log [ERR] : fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:10:00.315 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[98014]: 2024-09-17T01:09:59.999+0000 7f61d23c7640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-17T01:10:00.315 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[98014]: 2024-09-17T01:09:59.999+0000 7f61d23c7640 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-09-17T01:10:00.315 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-mon[98018]: pgmap v185: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:00.315 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:00.315 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:00.315 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:00.315 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:00.315 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-mon[98018]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-17T01:10:00.315 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-mon[98018]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-17T01:10:00.315 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-mon[98018]: fs cephfs is degraded 2024-09-17T01:10:00.316 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-mon[98018]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:10:00.316 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-mon[98018]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:10:00.316 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-mon[98018]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-17T01:10:00.316 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:00 smithi002 ceph-mon[98018]: fs cephfs is offline because no MDS is active for it. 2024-09-17T01:10:00.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:00 smithi099 ceph-mon[77412]: pgmap v185: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:00.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:00 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:00.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:00 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:00.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:00 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:00.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:00 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:00.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:00 smithi099 ceph-mon[77412]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-17T01:10:00.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:00 smithi099 ceph-mon[77412]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-17T01:10:00.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:00 smithi099 ceph-mon[77412]: fs cephfs is degraded 2024-09-17T01:10:00.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:00 smithi099 ceph-mon[77412]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:10:00.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:00 smithi099 ceph-mon[77412]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:10:00.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:00 smithi099 ceph-mon[77412]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-17T01:10:00.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:00 smithi099 ceph-mon[77412]: fs cephfs is offline because no MDS is active for it. 2024-09-17T01:10:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.162+0000 7f6e06d75640 1 -- 172.21.15.2:0/562456933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e000fb810 msgr2=0x7f6e000fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.162+0000 7f6e06d75640 1 --2- 172.21.15.2:0/562456933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e000fb810 0x7f6e000fbbe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6df40048d0 tx=0x7f6df4009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.162+0000 7f6e06d75640 1 -- 172.21.15.2:0/562456933 shutdown_connections 2024-09-17T01:10:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.162+0000 7f6e06d75640 1 --2- 172.21.15.2:0/562456933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e000fcf80 0x7f6e000fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.162+0000 7f6e06d75640 1 --2- 172.21.15.2:0/562456933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e000fb810 0x7f6e000fbbe0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.162+0000 7f6e06d75640 1 -- 172.21.15.2:0/562456933 >> 172.21.15.2:0/562456933 conn(0x7f6e000723b0 msgr2=0x7f6e000727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:02.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.162+0000 7f6e06d75640 1 -- 172.21.15.2:0/562456933 shutdown_connections 2024-09-17T01:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.162+0000 7f6e06d75640 1 -- 172.21.15.2:0/562456933 wait complete. 2024-09-17T01:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.162+0000 7f6e06d75640 1 Processor -- start 2024-09-17T01:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.163+0000 7f6e06d75640 1 -- start start 2024-09-17T01:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.163+0000 7f6e06d75640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e000fb810 0x7f6e0010e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.163+0000 7f6e06d75640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e000fcf80 0x7f6e0010e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.163+0000 7f6e06d75640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0010ed30 con 0x7f6e000fcf80 2024-09-17T01:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.163+0000 7f6e06d75640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0010eea0 con 0x7f6e000fb810 2024-09-17T01:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.163+0000 7f6dfffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e000fcf80 0x7f6e0010e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.163+0000 7f6dfffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e000fcf80 0x7f6e0010e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33438/0 (socket says 172.21.15.2:33438) 2024-09-17T01:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.163+0000 7f6dfffff640 1 -- 172.21.15.2:0/3749968985 learned_addr learned my addr 172.21.15.2:0/3749968985 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.163+0000 7f6e04b11640 1 --2- 172.21.15.2:0/3749968985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e000fb810 0x7f6e0010e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.164+0000 7f6dfffff640 1 -- 172.21.15.2:0/3749968985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e000fb810 msgr2=0x7f6e0010e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.164+0000 7f6dfffff640 1 --2- 172.21.15.2:0/3749968985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e000fb810 0x7f6e0010e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.164+0000 7f6dfffff640 1 -- 172.21.15.2:0/3749968985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df4005040 con 0x7f6e000fcf80 2024-09-17T01:10:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.164+0000 7f6dfffff640 1 --2- 172.21.15.2:0/3749968985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e000fcf80 0x7f6e0010e7f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6dec002a50 tx=0x7f6dec004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.164+0000 7f6dfd7fa640 1 -- 172.21.15.2:0/3749968985 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dec007c30 con 0x7f6e000fcf80 2024-09-17T01:10:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.164+0000 7f6e06d75640 1 -- 172.21.15.2:0/3749968985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e00117180 con 0x7f6e000fcf80 2024-09-17T01:10:02.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.164+0000 7f6dfd7fa640 1 -- 172.21.15.2:0/3749968985 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6dec00f040 con 0x7f6e000fcf80 2024-09-17T01:10:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.164+0000 7f6e06d75640 1 -- 172.21.15.2:0/3749968985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e001176f0 con 0x7f6e000fcf80 2024-09-17T01:10:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.164+0000 7f6dfd7fa640 1 -- 172.21.15.2:0/3749968985 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dec00dad0 con 0x7f6e000fcf80 2024-09-17T01:10:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.165+0000 7f6e06d75640 1 -- 172.21.15.2:0/3749968985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de4005210 con 0x7f6e000fcf80 2024-09-17T01:10:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.166+0000 7f6dfd7fa640 1 -- 172.21.15.2:0/3749968985 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f6dec00dc30 con 0x7f6e000fcf80 2024-09-17T01:10:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.167+0000 7f6dfd7fa640 1 --2- 172.21.15.2:0/3749968985 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f6df006e530 0x7f6df00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.167+0000 7f6dfd7fa640 1 -- 172.21.15.2:0/3749968985 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f6dec08e010 con 0x7f6e000fcf80 2024-09-17T01:10:02.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.167+0000 7f6e04b11640 1 --2- 172.21.15.2:0/3749968985 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f6df006e530 0x7f6df00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:02.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.167+0000 7f6e04b11640 1 --2- 172.21.15.2:0/3749968985 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f6df006e530 0x7f6df00709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6df4009ac0 tx=0x7f6df4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:02.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.171+0000 7f6dfd7fa640 1 -- 172.21.15.2:0/3749968985 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6dec056fd0 con 0x7f6e000fcf80 2024-09-17T01:10:02.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.364+0000 7f6e06d75640 1 -- 172.21.15.2:0/3749968985 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6de4000bc0 con 0x7f6df006e530 2024-09-17T01:10:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.366+0000 7f6dfd7fa640 1 -- 172.21.15.2:0/3749968985 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6de4000bc0 con 0x7f6df006e530 2024-09-17T01:10:02.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.368+0000 7f6e06d75640 1 -- 172.21.15.2:0/3749968985 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f6df006e530 msgr2=0x7f6df00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:02.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.368+0000 7f6e06d75640 1 --2- 172.21.15.2:0/3749968985 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f6df006e530 0x7f6df00709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6df4009ac0 tx=0x7f6df4035040 comp rx=0 tx=0).stop 2024-09-17T01:10:02.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.368+0000 7f6e06d75640 1 -- 172.21.15.2:0/3749968985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e000fcf80 msgr2=0x7f6e0010e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.368+0000 7f6e06d75640 1 --2- 172.21.15.2:0/3749968985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e000fcf80 0x7f6e0010e7f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6dec002a50 tx=0x7f6dec004600 comp rx=0 tx=0).stop 2024-09-17T01:10:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.368+0000 7f6e06d75640 1 -- 172.21.15.2:0/3749968985 shutdown_connections 2024-09-17T01:10:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.368+0000 7f6e06d75640 1 --2- 172.21.15.2:0/3749968985 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f6df006e530 0x7f6df00709e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.368+0000 7f6e06d75640 1 --2- 172.21.15.2:0/3749968985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e000fcf80 0x7f6e0010e7f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.368+0000 7f6e06d75640 1 --2- 172.21.15.2:0/3749968985 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e000fb810 0x7f6e0010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.368+0000 7f6e06d75640 1 -- 172.21.15.2:0/3749968985 >> 172.21.15.2:0/3749968985 conn(0x7f6e000723b0 msgr2=0x7f6e000fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.368+0000 7f6e06d75640 1 -- 172.21.15.2:0/3749968985 shutdown_connections 2024-09-17T01:10:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.368+0000 7f6e06d75640 1 -- 172.21.15.2:0/3749968985 wait complete. 2024-09-17T01:10:02.374 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:10:02.433 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:02 smithi002 ceph-mon[98018]: pgmap v186: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:02.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.455+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1058645729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8480fdf00 msgr2=0x7fa848106540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:02.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.455+0000 7fa84e1f9640 1 --2- 172.21.15.2:0/1058645729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8480fdf00 0x7fa848106540 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa8300048d0 tx=0x7fa830009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.455+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1058645729 shutdown_connections 2024-09-17T01:10:02.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.455+0000 7fa84e1f9640 1 --2- 172.21.15.2:0/1058645729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8480fdf00 0x7fa848106540 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.455+0000 7fa84e1f9640 1 --2- 172.21.15.2:0/1058645729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8480fd560 0x7fa8480fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.455+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1058645729 >> 172.21.15.2:0/1058645729 conn(0x7fa8480f7030 msgr2=0x7fa8480f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:02.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.455+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1058645729 shutdown_connections 2024-09-17T01:10:02.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.455+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1058645729 wait complete. 2024-09-17T01:10:02.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.456+0000 7fa84e1f9640 1 Processor -- start 2024-09-17T01:10:02.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.456+0000 7fa84e1f9640 1 -- start start 2024-09-17T01:10:02.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.456+0000 7fa84e1f9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8480fd560 0x7fa848113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:02.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.456+0000 7fa84e1f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8480fdf00 0x7fa848113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:02.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.456+0000 7fa84e1f9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa848113d50 con 0x7fa8480fdf00 2024-09-17T01:10:02.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.456+0000 7fa84e1f9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84810d190 con 0x7fa8480fd560 2024-09-17T01:10:02.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.456+0000 7fa83ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8480fdf00 0x7fa848113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:02.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.456+0000 7fa83ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8480fdf00 0x7fa848113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33462/0 (socket says 172.21.15.2:33462) 2024-09-17T01:10:02.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.456+0000 7fa83ffff640 1 -- 172.21.15.2:0/1899717440 learned_addr learned my addr 172.21.15.2:0/1899717440 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:10:02.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.456+0000 7fa8477fe640 1 --2- 172.21.15.2:0/1899717440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8480fd560 0x7fa848113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:02.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.457+0000 7fa83ffff640 1 -- 172.21.15.2:0/1899717440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8480fd560 msgr2=0x7fa848113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:02.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.457+0000 7fa83ffff640 1 --2- 172.21.15.2:0/1899717440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8480fd560 0x7fa848113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.457+0000 7fa83ffff640 1 -- 172.21.15.2:0/1899717440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa830005040 con 0x7fa8480fdf00 2024-09-17T01:10:02.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.457+0000 7fa83ffff640 1 --2- 172.21.15.2:0/1899717440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8480fdf00 0x7fa848113750 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa830000c00 tx=0x7fa830009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:02.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.457+0000 7fa844ff9640 1 -- 172.21.15.2:0/1899717440 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa830038070 con 0x7fa8480fdf00 2024-09-17T01:10:02.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.457+0000 7fa844ff9640 1 -- 172.21.15.2:0/1899717440 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa83002ade0 con 0x7fa8480fdf00 2024-09-17T01:10:02.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.457+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1899717440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84810d410 con 0x7fa8480fdf00 2024-09-17T01:10:02.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.457+0000 7fa844ff9640 1 -- 172.21.15.2:0/1899717440 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa83002c7e0 con 0x7fa8480fdf00 2024-09-17T01:10:02.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.457+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1899717440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84810d8d0 con 0x7fa8480fdf00 2024-09-17T01:10:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.458+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1899717440 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8480660f0 con 0x7fa8480fdf00 2024-09-17T01:10:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.459+0000 7fa844ff9640 1 -- 172.21.15.2:0/1899717440 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fa830030020 con 0x7fa8480fdf00 2024-09-17T01:10:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.459+0000 7fa844ff9640 1 --2- 172.21.15.2:0/1899717440 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa83406e530 0x7fa8340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:02.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.459+0000 7fa844ff9640 1 -- 172.21.15.2:0/1899717440 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fa8300ade10 con 0x7fa8480fdf00 2024-09-17T01:10:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.459+0000 7fa8477fe640 1 --2- 172.21.15.2:0/1899717440 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa83406e530 0x7fa8340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:02.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.460+0000 7fa8477fe640 1 --2- 172.21.15.2:0/1899717440 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa83406e530 0x7fa8340709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa838009fd0 tx=0x7fa83800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:02.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.464+0000 7fa844ff9640 1 -- 172.21.15.2:0/1899717440 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa830076f00 con 0x7fa8480fdf00 2024-09-17T01:10:02.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:02 smithi099 ceph-mon[77412]: pgmap v186: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:02.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.668+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1899717440 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa848109540 con 0x7fa83406e530 2024-09-17T01:10:02.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.669+0000 7fa844ff9640 1 -- 172.21.15.2:0/1899717440 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa848109540 con 0x7fa83406e530 2024-09-17T01:10:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.671+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1899717440 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa83406e530 msgr2=0x7fa8340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.671+0000 7fa84e1f9640 1 --2- 172.21.15.2:0/1899717440 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa83406e530 0x7fa8340709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa838009fd0 tx=0x7fa83800b040 comp rx=0 tx=0).stop 2024-09-17T01:10:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.671+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1899717440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8480fdf00 msgr2=0x7fa848113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.671+0000 7fa84e1f9640 1 --2- 172.21.15.2:0/1899717440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8480fdf00 0x7fa848113750 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa830000c00 tx=0x7fa830009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.672+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1899717440 shutdown_connections 2024-09-17T01:10:02.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.672+0000 7fa84e1f9640 1 --2- 172.21.15.2:0/1899717440 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa83406e530 0x7fa8340709e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.672+0000 7fa84e1f9640 1 --2- 172.21.15.2:0/1899717440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8480fdf00 0x7fa848113750 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.672+0000 7fa84e1f9640 1 --2- 172.21.15.2:0/1899717440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8480fd560 0x7fa848113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.672+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1899717440 >> 172.21.15.2:0/1899717440 conn(0x7fa8480f7030 msgr2=0x7fa8480f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:02.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.672+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1899717440 shutdown_connections 2024-09-17T01:10:02.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.672+0000 7fa84e1f9640 1 -- 172.21.15.2:0/1899717440 wait complete. 2024-09-17T01:10:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.755+0000 7f7cd8781640 1 -- 172.21.15.2:0/1257208515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cd01014e0 msgr2=0x7f7cd01018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.755+0000 7f7cd8781640 1 --2- 172.21.15.2:0/1257208515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cd01014e0 0x7f7cd01018b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0048d0 tx=0x7f7ccc009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.755+0000 7f7cd8781640 1 -- 172.21.15.2:0/1257208515 shutdown_connections 2024-09-17T01:10:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.755+0000 7f7cd8781640 1 --2- 172.21.15.2:0/1257208515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd00fb4a0 0x7f7cd00fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.755+0000 7f7cd8781640 1 --2- 172.21.15.2:0/1257208515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cd01014e0 0x7f7cd01018b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.755+0000 7f7cd8781640 1 -- 172.21.15.2:0/1257208515 >> 172.21.15.2:0/1257208515 conn(0x7f7cd00f7060 msgr2=0x7f7cd00f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.755+0000 7f7cd8781640 1 -- 172.21.15.2:0/1257208515 shutdown_connections 2024-09-17T01:10:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.755+0000 7f7cd8781640 1 -- 172.21.15.2:0/1257208515 wait complete. 2024-09-17T01:10:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.756+0000 7f7cd8781640 1 Processor -- start 2024-09-17T01:10:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.756+0000 7f7cd8781640 1 -- start start 2024-09-17T01:10:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.756+0000 7f7cd8781640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cd00fb4a0 0x7f7cd01131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.756+0000 7f7cd8781640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd01014e0 0x7f7cd0113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.756+0000 7f7cd8781640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd0113d00 con 0x7f7cd00fb4a0 2024-09-17T01:10:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.756+0000 7f7cd8781640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd010d140 con 0x7f7cd01014e0 2024-09-17T01:10:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.756+0000 7f7cd651d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cd00fb4a0 0x7f7cd01131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.756+0000 7f7cd651d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cd00fb4a0 0x7f7cd01131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33484/0 (socket says 172.21.15.2:33484) 2024-09-17T01:10:02.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.756+0000 7f7cd651d640 1 -- 172.21.15.2:0/3765992709 learned_addr learned my addr 172.21.15.2:0/3765992709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:10:02.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.756+0000 7f7cd5d1c640 1 --2- 172.21.15.2:0/3765992709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd01014e0 0x7f7cd0113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:02.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.756+0000 7f7cd651d640 1 -- 172.21.15.2:0/3765992709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd01014e0 msgr2=0x7f7cd0113700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:02.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.756+0000 7f7cd651d640 1 --2- 172.21.15.2:0/3765992709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd01014e0 0x7f7cd0113700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.756+0000 7f7cd651d640 1 -- 172.21.15.2:0/3765992709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc005040 con 0x7f7cd00fb4a0 2024-09-17T01:10:02.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.756+0000 7f7cd5d1c640 1 --2- 172.21.15.2:0/3765992709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd01014e0 0x7f7cd0113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:10:02.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.757+0000 7f7cd651d640 1 --2- 172.21.15.2:0/3765992709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cd00fb4a0 0x7f7cd01131c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc000c00 tx=0x7f7ccc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:02.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.757+0000 7f7cc6ffd640 1 -- 172.21.15.2:0/3765992709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ccc038070 con 0x7f7cd00fb4a0 2024-09-17T01:10:02.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.757+0000 7f7cd8781640 1 -- 172.21.15.2:0/3765992709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd010d3c0 con 0x7f7cd00fb4a0 2024-09-17T01:10:02.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.757+0000 7f7cc6ffd640 1 -- 172.21.15.2:0/3765992709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7ccc02ade0 con 0x7f7cd00fb4a0 2024-09-17T01:10:02.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.757+0000 7f7cc6ffd640 1 -- 172.21.15.2:0/3765992709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ccc02c7e0 con 0x7f7cd00fb4a0 2024-09-17T01:10:02.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.757+0000 7f7cd8781640 1 -- 172.21.15.2:0/3765992709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd010d900 con 0x7f7cd00fb4a0 2024-09-17T01:10:02.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.758+0000 7f7cd8781640 1 -- 172.21.15.2:0/3765992709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd00fcbe0 con 0x7f7cd00fb4a0 2024-09-17T01:10:02.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.758+0000 7f7cc6ffd640 1 -- 172.21.15.2:0/3765992709 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f7ccc030020 con 0x7f7cd00fb4a0 2024-09-17T01:10:02.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.759+0000 7f7cc6ffd640 1 --2- 172.21.15.2:0/3765992709 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7cbc06e530 0x7f7cbc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:02.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.759+0000 7f7cc6ffd640 1 -- 172.21.15.2:0/3765992709 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f7ccc0adf20 con 0x7f7cd00fb4a0 2024-09-17T01:10:02.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.759+0000 7f7cd5d1c640 1 --2- 172.21.15.2:0/3765992709 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7cbc06e530 0x7f7cbc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:02.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.759+0000 7f7cd5d1c640 1 --2- 172.21.15.2:0/3765992709 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7cbc06e530 0x7f7cbc0709e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0007fd0 tx=0x7f7cc0009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:02.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.763+0000 7f7cc6ffd640 1 -- 172.21.15.2:0/3765992709 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7ccc0e31b0 con 0x7f7cd00fb4a0 2024-09-17T01:10:02.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.948+0000 7f7cd8781640 1 -- 172.21.15.2:0/3765992709 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cd004b720 con 0x7f7cbc06e530 2024-09-17T01:10:02.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.957+0000 7f7cc6ffd640 1 -- 172.21.15.2:0/3765992709 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7cd004b720 con 0x7f7cbc06e530 2024-09-17T01:10:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:10:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (7m) 3s ago 15m 25.5M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:10:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (3m) 3s ago 16m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de b7ed6c8d5a92 2024-09-17T01:10:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (3m) 24s ago 15m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de ae713b940078 2024-09-17T01:10:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (5m) 3s ago 15m 82.2M - 9.4.12 2bacad6d85d8 5fe408c103d6 2024-09-17T01:10:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (10m) 3s ago 10m 10.8M - 17.2.7-1635-g4a704134 f22ead590bad 2f8f839b6991 2024-09-17T01:10:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (9s) 3s ago 10m 14.2M - 19.1.1-330-gc2ddf972 ebb0615149de 8862e6324ff5 2024-09-17T01:10:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (10m) 24s ago 10m 64.8M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:10:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (10m) 24s ago 10m 115M - 17.2.7-1635-g4a704134 f22ead590bad 37939aaa5953 2024-09-17T01:10:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (6m) 3s ago 17m 504M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:10:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (6m) 24s ago 15m 442M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:10:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (4m) 3s ago 17m 48.2M 2048M 19.1.1-330-gc2ddf972 ebb0615149de da5247385c2d 2024-09-17T01:10:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (4m) 24s ago 15m 36.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b92f98b2cab9 2024-09-17T01:10:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (7m) 3s ago 16m 15.4M - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:10:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (6m) 24s ago 15m 15.2M - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:10:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (3m) 3s ago 14m 162M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 563188d6089b 2024-09-17T01:10:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (2m) 3s ago 13m 106M 1558M 19.1.1-330-gc2ddf972 ebb0615149de cc26caf558d7 2024-09-17T01:10:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (2m) 3s ago 13m 135M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 0aac20af5580 2024-09-17T01:10:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (94s) 24s ago 13m 137M 2581M 19.1.1-330-gc2ddf972 ebb0615149de 0740cf987fef 2024-09-17T01:10:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (60s) 24s ago 12m 95.4M 2581M 19.1.1-330-gc2ddf972 ebb0615149de df5b078898bb 2024-09-17T01:10:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (28s) 24s ago 12m 14.4M 2581M 19.1.1-330-gc2ddf972 ebb0615149de e26706fa8822 2024-09-17T01:10:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (6m) 3s ago 15m 64.1M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:10:02.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.959+0000 7f7cd8781640 1 -- 172.21.15.2:0/3765992709 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7cbc06e530 msgr2=0x7f7cbc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:02.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.959+0000 7f7cd8781640 1 --2- 172.21.15.2:0/3765992709 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7cbc06e530 0x7f7cbc0709e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0007fd0 tx=0x7f7cc0009e90 comp rx=0 tx=0).stop 2024-09-17T01:10:02.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.959+0000 7f7cd8781640 1 -- 172.21.15.2:0/3765992709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cd00fb4a0 msgr2=0x7f7cd01131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:02.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.959+0000 7f7cd8781640 1 --2- 172.21.15.2:0/3765992709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cd00fb4a0 0x7f7cd01131c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc000c00 tx=0x7f7ccc009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.959+0000 7f7cd8781640 1 -- 172.21.15.2:0/3765992709 shutdown_connections 2024-09-17T01:10:02.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.959+0000 7f7cd8781640 1 --2- 172.21.15.2:0/3765992709 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7cbc06e530 0x7f7cbc0709e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.959+0000 7f7cd8781640 1 --2- 172.21.15.2:0/3765992709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cd01014e0 0x7f7cd0113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.959+0000 7f7cd8781640 1 --2- 172.21.15.2:0/3765992709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cd00fb4a0 0x7f7cd01131c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:02.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.959+0000 7f7cd8781640 1 -- 172.21.15.2:0/3765992709 >> 172.21.15.2:0/3765992709 conn(0x7f7cd00f7060 msgr2=0x7f7cd0065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:02.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.959+0000 7f7cd8781640 1 -- 172.21.15.2:0/3765992709 shutdown_connections 2024-09-17T01:10:02.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:02.959+0000 7f7cd8781640 1 -- 172.21.15.2:0/3765992709 wait complete. 2024-09-17T01:10:03.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.039+0000 7f126e69c640 1 -- 172.21.15.2:0/1171045795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12680703c0 msgr2=0x7f12681088c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.039+0000 7f126e69c640 1 --2- 172.21.15.2:0/1171045795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12680703c0 0x7f12681088c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f125c0048d0 tx=0x7f125c009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.039+0000 7f126e69c640 1 -- 172.21.15.2:0/1171045795 shutdown_connections 2024-09-17T01:10:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.039+0000 7f126e69c640 1 --2- 172.21.15.2:0/1171045795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12680703c0 0x7f12681088c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.039+0000 7f126e69c640 1 --2- 172.21.15.2:0/1171045795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f126806fab0 0x7f126806fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.039+0000 7f126e69c640 1 -- 172.21.15.2:0/1171045795 >> 172.21.15.2:0/1171045795 conn(0x7f12680f81a0 msgr2=0x7f12680fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.039+0000 7f126e69c640 1 -- 172.21.15.2:0/1171045795 shutdown_connections 2024-09-17T01:10:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.039+0000 7f126e69c640 1 -- 172.21.15.2:0/1171045795 wait complete. 2024-09-17T01:10:03.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.039+0000 7f126e69c640 1 Processor -- start 2024-09-17T01:10:03.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.040+0000 7f126e69c640 1 -- start start 2024-09-17T01:10:03.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.040+0000 7f126e69c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126806fab0 0x7f12681153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.040+0000 7f126e69c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12680703c0 0x7f1268115930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.040+0000 7f126e69c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1268115f30 con 0x7f126806fab0 2024-09-17T01:10:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.040+0000 7f126e69c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12681160a0 con 0x7f12680703c0 2024-09-17T01:10:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.040+0000 7f1267fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126806fab0 0x7f12681153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.040+0000 7f1267fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126806fab0 0x7f12681153f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33494/0 (socket says 172.21.15.2:33494) 2024-09-17T01:10:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.040+0000 7f1267fff640 1 -- 172.21.15.2:0/4132736265 learned_addr learned my addr 172.21.15.2:0/4132736265 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:10:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.040+0000 7f12677fe640 1 --2- 172.21.15.2:0/4132736265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12680703c0 0x7f1268115930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.040+0000 7f1267fff640 1 -- 172.21.15.2:0/4132736265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12680703c0 msgr2=0x7f1268115930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.040+0000 7f1267fff640 1 --2- 172.21.15.2:0/4132736265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12680703c0 0x7f1268115930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.040+0000 7f1267fff640 1 -- 172.21.15.2:0/4132736265 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c005040 con 0x7f126806fab0 2024-09-17T01:10:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.041+0000 7f1267fff640 1 --2- 172.21.15.2:0/4132736265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126806fab0 0x7f12681153f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1258002a80 tx=0x7f1258004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.041+0000 7f1264ff9640 1 -- 172.21.15.2:0/4132736265 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1258007c30 con 0x7f126806fab0 2024-09-17T01:10:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.041+0000 7f1264ff9640 1 -- 172.21.15.2:0/4132736265 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f125800f040 con 0x7f126806fab0 2024-09-17T01:10:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.041+0000 7f126e69c640 1 -- 172.21.15.2:0/4132736265 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126810f520 con 0x7f126806fab0 2024-09-17T01:10:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.041+0000 7f1264ff9640 1 -- 172.21.15.2:0/4132736265 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1258009530 con 0x7f126806fab0 2024-09-17T01:10:03.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.041+0000 7f126e69c640 1 -- 172.21.15.2:0/4132736265 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126810fa40 con 0x7f126806fab0 2024-09-17T01:10:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.042+0000 7f126e69c640 1 -- 172.21.15.2:0/4132736265 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12680711f0 con 0x7f126806fab0 2024-09-17T01:10:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.043+0000 7f1264ff9640 1 -- 172.21.15.2:0/4132736265 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f12580096b0 con 0x7f126806fab0 2024-09-17T01:10:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.043+0000 7f1264ff9640 1 --2- 172.21.15.2:0/4132736265 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f125006e530 0x7f12500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.043+0000 7f1264ff9640 1 -- 172.21.15.2:0/4132736265 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f125808dbc0 con 0x7f126806fab0 2024-09-17T01:10:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.043+0000 7f12677fe640 1 --2- 172.21.15.2:0/4132736265 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f125006e530 0x7f12500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:03.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.044+0000 7f12677fe640 1 --2- 172.21.15.2:0/4132736265 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f125006e530 0x7f12500709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1268110cf0 tx=0x7f125c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:03.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.048+0000 7f1264ff9640 1 -- 172.21.15.2:0/4132736265 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1258056c00 con 0x7f126806fab0 2024-09-17T01:10:03.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.310+0000 7f126e69c640 1 -- 172.21.15.2:0/4132736265 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f126804b7b0 con 0x7f126806fab0 2024-09-17T01:10:03.308 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:03 smithi002 ceph-mon[98018]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:03.308 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:03 smithi002 ceph-mon[98018]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:03.308 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:03 smithi002 ceph-mon[98018]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:03.308 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:03.309 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:03.309 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:03.309 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:03.309 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:03 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:03.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.311+0000 7f1264ff9640 1 -- 172.21.15.2:0/4132736265 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7f125805a2c0 con 0x7f126806fab0 2024-09-17T01:10:03.309 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:10:03.309 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:10:03.310 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:10:03.310 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:10:03.310 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:10:03.310 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:10:03.310 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:10:03.310 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:10:03.310 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:10:03.310 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:10:03.310 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:10:03.310 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 3, 2024-09-17T01:10:03.310 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1 2024-09-17T01:10:03.310 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:10:03.310 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:10:03.310 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 3, 2024-09-17T01:10:03.311 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 11 2024-09-17T01:10:03.311 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:10:03.311 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:10:03.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.314+0000 7f126e69c640 1 -- 172.21.15.2:0/4132736265 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f125006e530 msgr2=0x7f12500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:03.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.314+0000 7f126e69c640 1 --2- 172.21.15.2:0/4132736265 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f125006e530 0x7f12500709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1268110cf0 tx=0x7f125c035040 comp rx=0 tx=0).stop 2024-09-17T01:10:03.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.314+0000 7f126e69c640 1 -- 172.21.15.2:0/4132736265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126806fab0 msgr2=0x7f12681153f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:03.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.314+0000 7f126e69c640 1 --2- 172.21.15.2:0/4132736265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126806fab0 0x7f12681153f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1258002a80 tx=0x7f1258004600 comp rx=0 tx=0).stop 2024-09-17T01:10:03.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.314+0000 7f126e69c640 1 -- 172.21.15.2:0/4132736265 shutdown_connections 2024-09-17T01:10:03.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.314+0000 7f126e69c640 1 --2- 172.21.15.2:0/4132736265 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f125006e530 0x7f12500709e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.314+0000 7f126e69c640 1 --2- 172.21.15.2:0/4132736265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12680703c0 0x7f1268115930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.314+0000 7f126e69c640 1 --2- 172.21.15.2:0/4132736265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126806fab0 0x7f12681153f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.314+0000 7f126e69c640 1 -- 172.21.15.2:0/4132736265 >> 172.21.15.2:0/4132736265 conn(0x7f12680f81a0 msgr2=0x7f12680f96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:03.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.314+0000 7f126e69c640 1 -- 172.21.15.2:0/4132736265 shutdown_connections 2024-09-17T01:10:03.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.314+0000 7f126e69c640 1 -- 172.21.15.2:0/4132736265 wait complete. 2024-09-17T01:10:03.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.399+0000 7fee8d405640 1 -- 172.21.15.2:0/2416537041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88102f00 msgr2=0x7fee880fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.399+0000 7fee8d405640 1 --2- 172.21.15.2:0/2416537041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88102f00 0x7fee880fc5c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fee700048d0 tx=0x7fee70009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.399+0000 7fee8d405640 1 -- 172.21.15.2:0/2416537041 shutdown_connections 2024-09-17T01:10:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.399+0000 7fee8d405640 1 --2- 172.21.15.2:0/2416537041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88102f00 0x7fee880fc5c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.399+0000 7fee8d405640 1 --2- 172.21.15.2:0/2416537041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee88102560 0x7fee88102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.399+0000 7fee8d405640 1 -- 172.21.15.2:0/2416537041 >> 172.21.15.2:0/2416537041 conn(0x7fee880f8120 msgr2=0x7fee880fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.399+0000 7fee8d405640 1 -- 172.21.15.2:0/2416537041 shutdown_connections 2024-09-17T01:10:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.399+0000 7fee8d405640 1 -- 172.21.15.2:0/2416537041 wait complete. 2024-09-17T01:10:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.399+0000 7fee8d405640 1 Processor -- start 2024-09-17T01:10:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.399+0000 7fee8d405640 1 -- start start 2024-09-17T01:10:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.400+0000 7fee8d405640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88102560 0x7fee88113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.400+0000 7fee8d405640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee88102f00 0x7fee88113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.400+0000 7fee8d405640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee88113d40 con 0x7fee88102560 2024-09-17T01:10:03.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.400+0000 7fee8d405640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8810d180 con 0x7fee88102f00 2024-09-17T01:10:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.400+0000 7fee86ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88102560 0x7fee88113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.400+0000 7fee86ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88102560 0x7fee88113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33502/0 (socket says 172.21.15.2:33502) 2024-09-17T01:10:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.400+0000 7fee86ffd640 1 -- 172.21.15.2:0/1943438350 learned_addr learned my addr 172.21.15.2:0/1943438350 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:10:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.400+0000 7fee7ffff640 1 --2- 172.21.15.2:0/1943438350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee88102f00 0x7fee88113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.400+0000 7fee86ffd640 1 -- 172.21.15.2:0/1943438350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee88102f00 msgr2=0x7fee88113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.400+0000 7fee86ffd640 1 --2- 172.21.15.2:0/1943438350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee88102f00 0x7fee88113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.400+0000 7fee86ffd640 1 -- 172.21.15.2:0/1943438350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70005040 con 0x7fee88102560 2024-09-17T01:10:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.400+0000 7fee86ffd640 1 --2- 172.21.15.2:0/1943438350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88102560 0x7fee88113200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fee78002a50 tx=0x7fee78004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.401+0000 7fee7f7fe640 1 -- 172.21.15.2:0/1943438350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee78007c30 con 0x7fee88102560 2024-09-17T01:10:03.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.401+0000 7fee8d405640 1 -- 172.21.15.2:0/1943438350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8810d460 con 0x7fee88102560 2024-09-17T01:10:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.401+0000 7fee7f7fe640 1 -- 172.21.15.2:0/1943438350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fee7800f040 con 0x7fee88102560 2024-09-17T01:10:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.401+0000 7fee7f7fe640 1 -- 172.21.15.2:0/1943438350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee7800dad0 con 0x7fee88102560 2024-09-17T01:10:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.401+0000 7fee8d405640 1 -- 172.21.15.2:0/1943438350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8810d9d0 con 0x7fee88102560 2024-09-17T01:10:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.402+0000 7fee8d405640 1 -- 172.21.15.2:0/1943438350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee880fdce0 con 0x7fee88102560 2024-09-17T01:10:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.402+0000 7fee7f7fe640 1 -- 172.21.15.2:0/1943438350 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fee7800dc30 con 0x7fee88102560 2024-09-17T01:10:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.403+0000 7fee7f7fe640 1 --2- 172.21.15.2:0/1943438350 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fee7406e530 0x7fee740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.403+0000 7fee7f7fe640 1 -- 172.21.15.2:0/1943438350 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fee7808e150 con 0x7fee88102560 2024-09-17T01:10:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.403+0000 7fee7ffff640 1 --2- 172.21.15.2:0/1943438350 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fee7406e530 0x7fee740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:03.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.404+0000 7fee7ffff640 1 --2- 172.21.15.2:0/1943438350 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fee7406e530 0x7fee740709e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fee700048a0 tx=0x7fee70035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:03.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.407+0000 7fee7f7fe640 1 -- 172.21.15.2:0/1943438350 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fee78057110 con 0x7fee88102560 2024-09-17T01:10:03.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:03 smithi099 ceph-mon[77412]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:03.545 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:03 smithi099 ceph-mon[77412]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:03.545 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:03 smithi099 ceph-mon[77412]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:03.545 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:03.545 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:03.545 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:03.545 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:03.545 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:03 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:03.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.627+0000 7fee8d405640 1 -- 172.21.15.2:0/1943438350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fee880fbd60 con 0x7fee88102560 2024-09-17T01:10:03.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.627+0000 7fee7f7fe640 1 -- 172.21.15.2:0/1943438350 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1903 (secure 0 0 0) 0x7fee7805a7d0 con 0x7fee88102560 2024-09-17T01:10:03.625 INFO:teuthology.orchestra.run.smithi002.stdout:e30 2024-09-17T01:10:03.625 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-17T01:09:54:696468+0000 2024-09-17T01:10:03.625 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:10:03.625 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:10:03.625 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-17T01:10:03.625 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:10:03.625 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:10:03.625 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-17T01:10:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 27 2024-09-17T01:10:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-17T01:10:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-17T00:59:20.485696+0000 2024-09-17T01:10:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-17T01:09:44.670921+0000 2024-09-17T01:10:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-17T01:10:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-17T01:10:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-17T01:10:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-17T01:10:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-17T01:10:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-17T01:10:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-17T01:10:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-17T01:10:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 91 2024-09-17T01:10:03.626 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:10:03.627 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2024-09-17T01:10:03.627 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2024-09-17T01:10:03.627 INFO:teuthology.orchestra.run.smithi002.stdout:up {} 2024-09-17T01:10:03.627 INFO:teuthology.orchestra.run.smithi002.stdout:failed 0,1 2024-09-17T01:10:03.627 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-17T01:10:03.627 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-17T01:10:03.627 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-17T01:10:03.627 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-17T01:10:03.627 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-17T01:10:03.627 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-17T01:10:03.627 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-17T01:10:03.627 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-17T01:10:03.627 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:10:03.627 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:10:03.628 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:10:03.628 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-17T01:10:03.628 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:10:03.628 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.fmyyzz{-1:34384} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6828/1844749656,v1:172.21.15.2:6829/1844749656] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:10:03.628 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.zmrgxd{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/2424122669,v1:172.21.15.2:6827/2424122669] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:10:03.628 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.heckcd{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/2884389025,v1:172.21.15.99:6827/2884389025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:10:03.628 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.hgawhu{-1:44305} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6824/3901555472,v1:172.21.15.99:6825/3901555472] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:10:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 30 2024-09-17T01:10:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.630+0000 7fee8d405640 1 -- 172.21.15.2:0/1943438350 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fee7406e530 msgr2=0x7fee740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.630+0000 7fee8d405640 1 --2- 172.21.15.2:0/1943438350 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fee7406e530 0x7fee740709e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fee700048a0 tx=0x7fee70035040 comp rx=0 tx=0).stop 2024-09-17T01:10:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.630+0000 7fee8d405640 1 -- 172.21.15.2:0/1943438350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88102560 msgr2=0x7fee88113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.630+0000 7fee8d405640 1 --2- 172.21.15.2:0/1943438350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88102560 0x7fee88113200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fee78002a50 tx=0x7fee78004600 comp rx=0 tx=0).stop 2024-09-17T01:10:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.630+0000 7fee8d405640 1 -- 172.21.15.2:0/1943438350 shutdown_connections 2024-09-17T01:10:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.630+0000 7fee8d405640 1 --2- 172.21.15.2:0/1943438350 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fee7406e530 0x7fee740709e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.630+0000 7fee8d405640 1 --2- 172.21.15.2:0/1943438350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee88102f00 0x7fee88113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.630+0000 7fee8d405640 1 --2- 172.21.15.2:0/1943438350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88102560 0x7fee88113200 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.630+0000 7fee8d405640 1 -- 172.21.15.2:0/1943438350 >> 172.21.15.2:0/1943438350 conn(0x7fee880f8120 msgr2=0x7fee880f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:03.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.631+0000 7fee8d405640 1 -- 172.21.15.2:0/1943438350 shutdown_connections 2024-09-17T01:10:03.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.631+0000 7fee8d405640 1 -- 172.21.15.2:0/1943438350 wait complete. 2024-09-17T01:10:03.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.715+0000 7f8be4584640 1 -- 172.21.15.2:0/1560841922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc102560 msgr2=0x7f8bdc102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:03.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.715+0000 7f8be4584640 1 --2- 172.21.15.2:0/1560841922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc102560 0x7f8bdc102930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80048d0 tx=0x7f8bd8009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.715+0000 7f8be4584640 1 -- 172.21.15.2:0/1560841922 shutdown_connections 2024-09-17T01:10:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.715+0000 7f8be4584640 1 --2- 172.21.15.2:0/1560841922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bdc102f00 0x7f8bdc0fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.715+0000 7f8be4584640 1 --2- 172.21.15.2:0/1560841922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc102560 0x7f8bdc102930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.715+0000 7f8be4584640 1 -- 172.21.15.2:0/1560841922 >> 172.21.15.2:0/1560841922 conn(0x7f8bdc0f8100 msgr2=0x7f8bdc0fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.715+0000 7f8be4584640 1 -- 172.21.15.2:0/1560841922 shutdown_connections 2024-09-17T01:10:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.715+0000 7f8be4584640 1 -- 172.21.15.2:0/1560841922 wait complete. 2024-09-17T01:10:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.715+0000 7f8be4584640 1 Processor -- start 2024-09-17T01:10:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.715+0000 7f8be4584640 1 -- start start 2024-09-17T01:10:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.716+0000 7f8be4584640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc102560 0x7f8bdc113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.716+0000 7f8be4584640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bdc102f00 0x7f8bdc113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.716+0000 7f8be4584640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc113d40 con 0x7f8bdc102560 2024-09-17T01:10:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.716+0000 7f8be4584640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc10d180 con 0x7f8bdc102f00 2024-09-17T01:10:03.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.716+0000 7f8be2320640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc102560 0x7f8bdc113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:03.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.716+0000 7f8be2320640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc102560 0x7f8bdc113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33522/0 (socket says 172.21.15.2:33522) 2024-09-17T01:10:03.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.716+0000 7f8be2320640 1 -- 172.21.15.2:0/3891823842 learned_addr learned my addr 172.21.15.2:0/3891823842 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:10:03.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.716+0000 7f8be1b1f640 1 --2- 172.21.15.2:0/3891823842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bdc102f00 0x7f8bdc113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:03.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.716+0000 7f8be2320640 1 -- 172.21.15.2:0/3891823842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bdc102f00 msgr2=0x7f8bdc113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:03.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.716+0000 7f8be2320640 1 --2- 172.21.15.2:0/3891823842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bdc102f00 0x7f8bdc113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.716+0000 7f8be2320640 1 -- 172.21.15.2:0/3891823842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd8005040 con 0x7f8bdc102560 2024-09-17T01:10:03.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.716+0000 7f8be2320640 1 --2- 172.21.15.2:0/3891823842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc102560 0x7f8bdc113200 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8000c00 tx=0x7f8bd8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:03.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.716+0000 7f8bd2ffd640 1 -- 172.21.15.2:0/3891823842 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd8038070 con 0x7f8bdc102560 2024-09-17T01:10:03.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.717+0000 7f8be4584640 1 -- 172.21.15.2:0/3891823842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bdc10d400 con 0x7f8bdc102560 2024-09-17T01:10:03.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.717+0000 7f8bd2ffd640 1 -- 172.21.15.2:0/3891823842 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8bd802ade0 con 0x7f8bdc102560 2024-09-17T01:10:03.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.717+0000 7f8bd2ffd640 1 -- 172.21.15.2:0/3891823842 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bd802c7e0 con 0x7f8bdc102560 2024-09-17T01:10:03.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.717+0000 7f8be4584640 1 -- 172.21.15.2:0/3891823842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bdc10d940 con 0x7f8bdc102560 2024-09-17T01:10:03.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.717+0000 7f8be4584640 1 -- 172.21.15.2:0/3891823842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bdc0fdce0 con 0x7f8bdc102560 2024-09-17T01:10:03.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.718+0000 7f8bd2ffd640 1 -- 172.21.15.2:0/3891823842 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f8bd8030020 con 0x7f8bdc102560 2024-09-17T01:10:03.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.719+0000 7f8bd2ffd640 1 --2- 172.21.15.2:0/3891823842 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f8bc806e530 0x7f8bc80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:03.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.719+0000 7f8bd2ffd640 1 -- 172.21.15.2:0/3891823842 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f8bd80adf20 con 0x7f8bdc102560 2024-09-17T01:10:03.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.719+0000 7f8be1b1f640 1 --2- 172.21.15.2:0/3891823842 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f8bc806e530 0x7f8bc80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:03.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.719+0000 7f8be1b1f640 1 --2- 172.21.15.2:0/3891823842 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f8bc806e530 0x7f8bc80709e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc10eac0 tx=0x7f8bcc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:03.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.723+0000 7f8bd2ffd640 1 -- 172.21.15.2:0/3891823842 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8bd80e31b0 con 0x7f8bdc102560 2024-09-17T01:10:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.917+0000 7f8be4584640 1 -- 172.21.15.2:0/3891823842 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bdc04b7b0 con 0x7f8bc806e530 2024-09-17T01:10:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.919+0000 7f8bd2ffd640 1 -- 172.21.15.2:0/3891823842 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8bdc04b7b0 con 0x7f8bc806e530 2024-09-17T01:10:03.916 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:10:03.916 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:10:03.916 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:10:03.916 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:10:03.916 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-17T01:10:03.916 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-17T01:10:03.916 INFO:teuthology.orchestra.run.smithi002.stdout: "mon", 2024-09-17T01:10:03.916 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-17T01:10:03.917 INFO:teuthology.orchestra.run.smithi002.stdout: "osd" 2024-09-17T01:10:03.917 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-17T01:10:03.917 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "13/21 daemons upgraded", 2024-09-17T01:10:03.917 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T01:10:03.917 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:10:03.917 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:10:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.921+0000 7f8be4584640 1 -- 172.21.15.2:0/3891823842 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f8bc806e530 msgr2=0x7f8bc80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.921+0000 7f8be4584640 1 --2- 172.21.15.2:0/3891823842 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f8bc806e530 0x7f8bc80709e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc10eac0 tx=0x7f8bcc00b040 comp rx=0 tx=0).stop 2024-09-17T01:10:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.921+0000 7f8be4584640 1 -- 172.21.15.2:0/3891823842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc102560 msgr2=0x7f8bdc113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.921+0000 7f8be4584640 1 --2- 172.21.15.2:0/3891823842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc102560 0x7f8bdc113200 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8000c00 tx=0x7f8bd8009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.921+0000 7f8be4584640 1 -- 172.21.15.2:0/3891823842 shutdown_connections 2024-09-17T01:10:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.921+0000 7f8be4584640 1 --2- 172.21.15.2:0/3891823842 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f8bc806e530 0x7f8bc80709e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.921+0000 7f8be4584640 1 --2- 172.21.15.2:0/3891823842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bdc102f00 0x7f8bdc113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.921+0000 7f8be4584640 1 --2- 172.21.15.2:0/3891823842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc102560 0x7f8bdc113200 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.921+0000 7f8be4584640 1 -- 172.21.15.2:0/3891823842 >> 172.21.15.2:0/3891823842 conn(0x7f8bdc0f8100 msgr2=0x7f8bdc0f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.921+0000 7f8be4584640 1 -- 172.21.15.2:0/3891823842 shutdown_connections 2024-09-17T01:10:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:03.921+0000 7f8be4584640 1 -- 172.21.15.2:0/3891823842 wait complete. 2024-09-17T01:10:04.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.005+0000 7f41a4856640 1 -- 172.21.15.2:0/3534878747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41a00fcf80 msgr2=0x7f41a00fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.005+0000 7f41a4856640 1 --2- 172.21.15.2:0/3534878747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41a00fcf80 0x7f41a00fd3d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f41900048d0 tx=0x7f4190009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.005+0000 7f41a4856640 1 -- 172.21.15.2:0/3534878747 shutdown_connections 2024-09-17T01:10:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.005+0000 7f41a4856640 1 --2- 172.21.15.2:0/3534878747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41a00fcf80 0x7f41a00fd3d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.005+0000 7f41a4856640 1 --2- 172.21.15.2:0/3534878747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41a00fb810 0x7f41a00fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.005+0000 7f41a4856640 1 -- 172.21.15.2:0/3534878747 >> 172.21.15.2:0/3534878747 conn(0x7f41a00723b0 msgr2=0x7f41a00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.005+0000 7f41a4856640 1 -- 172.21.15.2:0/3534878747 shutdown_connections 2024-09-17T01:10:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.005+0000 7f41a4856640 1 -- 172.21.15.2:0/3534878747 wait complete. 2024-09-17T01:10:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.006+0000 7f41a4856640 1 Processor -- start 2024-09-17T01:10:04.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.006+0000 7f41a4856640 1 -- start start 2024-09-17T01:10:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.006+0000 7f41a4856640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41a00fb810 0x7f41a0113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.006+0000 7f41a4856640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41a00fcf80 0x7f41a01136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.006+0000 7f41a4856640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a0113cb0 con 0x7f41a00fcf80 2024-09-17T01:10:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.006+0000 7f41a4856640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a010d0f0 con 0x7f41a00fb810 2024-09-17T01:10:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.006+0000 7f419dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41a00fcf80 0x7f41a01136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.006+0000 7f419dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41a00fcf80 0x7f41a01136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33546/0 (socket says 172.21.15.2:33546) 2024-09-17T01:10:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.006+0000 7f419dd9b640 1 -- 172.21.15.2:0/2701691398 learned_addr learned my addr 172.21.15.2:0/2701691398 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:10:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.006+0000 7f419e59c640 1 --2- 172.21.15.2:0/2701691398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41a00fb810 0x7f41a0113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.006+0000 7f419dd9b640 1 -- 172.21.15.2:0/2701691398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41a00fb810 msgr2=0x7f41a0113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.006+0000 7f419dd9b640 1 --2- 172.21.15.2:0/2701691398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41a00fb810 0x7f41a0113170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.006+0000 7f419dd9b640 1 -- 172.21.15.2:0/2701691398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4190005040 con 0x7f41a00fcf80 2024-09-17T01:10:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.007+0000 7f419dd9b640 1 --2- 172.21.15.2:0/2701691398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41a00fcf80 0x7f41a01136b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f41900043d0 tx=0x7f4190009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.007+0000 7f4196ffd640 1 -- 172.21.15.2:0/2701691398 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4190038070 con 0x7f41a00fcf80 2024-09-17T01:10:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.007+0000 7f4196ffd640 1 -- 172.21.15.2:0/2701691398 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f41900096e0 con 0x7f41a00fcf80 2024-09-17T01:10:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.007+0000 7f41a4856640 1 -- 172.21.15.2:0/2701691398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a010d370 con 0x7f41a00fcf80 2024-09-17T01:10:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.007+0000 7f4196ffd640 1 -- 172.21.15.2:0/2701691398 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f419003d420 con 0x7f41a00fcf80 2024-09-17T01:10:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.007+0000 7f41a4856640 1 -- 172.21.15.2:0/2701691398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a010d910 con 0x7f41a00fcf80 2024-09-17T01:10:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.008+0000 7f41a4856640 1 -- 172.21.15.2:0/2701691398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a00fcbc0 con 0x7f41a00fcf80 2024-09-17T01:10:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.009+0000 7f4196ffd640 1 -- 172.21.15.2:0/2701691398 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f4190030020 con 0x7f41a00fcf80 2024-09-17T01:10:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.009+0000 7f4196ffd640 1 --2- 172.21.15.2:0/2701691398 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f418c06e530 0x7f418c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.009+0000 7f4196ffd640 1 -- 172.21.15.2:0/2701691398 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f41900ae690 con 0x7f41a00fcf80 2024-09-17T01:10:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.009+0000 7f419e59c640 1 --2- 172.21.15.2:0/2701691398 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f418c06e530 0x7f418c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.010+0000 7f419e59c640 1 --2- 172.21.15.2:0/2701691398 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f418c06e530 0x7f418c0709e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4188004ed0 tx=0x7f418800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:04.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.014+0000 7f4196ffd640 1 -- 172.21.15.2:0/2701691398 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f41900776d0 con 0x7f41a00fcf80 2024-09-17T01:10:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.263+0000 7f41a4856640 1 -- 172.21.15.2:0/2701691398 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f41a010e7e0 con 0x7f41a00fcf80 2024-09-17T01:10:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.263+0000 7f4196ffd640 1 -- 172.21.15.2:0/2701691398 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f419007ad90 con 0x7f41a00fcf80 2024-09-17T01:10:04.261 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-17T01:10:04.261 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-17T01:10:04.261 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs is degraded 2024-09-17T01:10:04.261 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:10:04.261 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:10:04.261 INFO:teuthology.orchestra.run.smithi002.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-17T01:10:04.261 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-17T01:10:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.265+0000 7f41a4856640 1 -- 172.21.15.2:0/2701691398 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f418c06e530 msgr2=0x7f418c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.265+0000 7f41a4856640 1 --2- 172.21.15.2:0/2701691398 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f418c06e530 0x7f418c0709e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4188004ed0 tx=0x7f418800b040 comp rx=0 tx=0).stop 2024-09-17T01:10:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.265+0000 7f41a4856640 1 -- 172.21.15.2:0/2701691398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41a00fcf80 msgr2=0x7f41a01136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.265+0000 7f41a4856640 1 --2- 172.21.15.2:0/2701691398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41a00fcf80 0x7f41a01136b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f41900043d0 tx=0x7f4190009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.265+0000 7f41a4856640 1 -- 172.21.15.2:0/2701691398 shutdown_connections 2024-09-17T01:10:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.265+0000 7f41a4856640 1 --2- 172.21.15.2:0/2701691398 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f418c06e530 0x7f418c0709e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.265+0000 7f41a4856640 1 --2- 172.21.15.2:0/2701691398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41a00fcf80 0x7f41a01136b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.265+0000 7f41a4856640 1 --2- 172.21.15.2:0/2701691398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f41a00fb810 0x7f41a0113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.265+0000 7f41a4856640 1 -- 172.21.15.2:0/2701691398 >> 172.21.15.2:0/2701691398 conn(0x7f41a00723b0 msgr2=0x7f41a0065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.266+0000 7f41a4856640 1 -- 172.21.15.2:0/2701691398 shutdown_connections 2024-09-17T01:10:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:04.266+0000 7f41a4856640 1 -- 172.21.15.2:0/2701691398 wait complete. 2024-09-17T01:10:04.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:04 smithi099 ceph-mon[77412]: pgmap v187: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:04.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:04 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/4132736265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:04.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:04 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:04.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:04 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:04.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:04 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:04.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:04 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:04.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:04 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:04.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:04 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1943438350' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:10:04.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:04 smithi099 ceph-mon[77412]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:04.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:04 smithi002 ceph-mon[98018]: pgmap v187: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:04.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:04 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/4132736265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:04.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:04 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:04.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:04 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:04.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:04 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:04.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:04 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:04.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:04 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:04.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:04 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1943438350' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:10:04.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:04 smithi002 ceph-mon[98018]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:05.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:05 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/2701691398' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:10:05.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:05 smithi002 ceph-mon[98018]: Upgrade: Updating mds.cephfs.smithi002.fmyyzz 2024-09-17T01:10:05.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:05 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:05.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:05 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.fmyyzz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:10:05.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:05 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:05.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:05 smithi002 ceph-mon[98018]: Deploying daemon mds.cephfs.smithi002.fmyyzz on smithi002 2024-09-17T01:10:05.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:05 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/2701691398' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:10:05.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:05 smithi099 ceph-mon[77412]: Upgrade: Updating mds.cephfs.smithi002.fmyyzz 2024-09-17T01:10:05.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:05 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:05.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:05 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.fmyyzz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:10:05.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:05 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:05.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:05 smithi099 ceph-mon[77412]: Deploying daemon mds.cephfs.smithi002.fmyyzz on smithi002 2024-09-17T01:10:07.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:06 smithi099 ceph-mon[77412]: pgmap v188: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:07.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:06 smithi002 ceph-mon[98018]: pgmap v188: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:08.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:07 smithi099 ceph-mon[77412]: osdmap e93: 6 total, 6 up, 6 in 2024-09-17T01:10:08.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:07 smithi099 ceph-mon[77412]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-17T01:10:08.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:07 smithi002 ceph-mon[98018]: osdmap e93: 6 total, 6 up, 6 in 2024-09-17T01:10:08.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:07 smithi002 ceph-mon[98018]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-17T01:10:09.025 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:08 smithi002 ceph-mon[98018]: pgmap v190: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:09.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:08 smithi099 ceph-mon[77412]: pgmap v190: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:11.006 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:10 smithi002 ceph-mon[98018]: pgmap v191: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:11.006 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:10 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:11.006 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:10 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:11.006 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:10 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:11.006 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:10 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:11.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:10 smithi099 ceph-mon[77412]: pgmap v191: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:11.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:10 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:11.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:10 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:11.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:10 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:11.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:10 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:12.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:11 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.2:6828/2400957585,v1:172.21.15.2:6829/2400957585] up:boot 2024-09-17T01:10:12.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:11 smithi099 ceph-mon[77412]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-17T01:10:12.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:11 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.fmyyzz"}]: dispatch 2024-09-17T01:10:12.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:11 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.2:6828/2400957585,v1:172.21.15.2:6829/2400957585] up:boot 2024-09-17T01:10:12.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:11 smithi002 ceph-mon[98018]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-17T01:10:12.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:11 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.fmyyzz"}]: dispatch 2024-09-17T01:10:12.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:12 smithi002 ceph-mon[98018]: pgmap v192: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:13.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:12 smithi099 ceph-mon[77412]: pgmap v192: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:15.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:14 smithi099 ceph-mon[77412]: pgmap v193: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:15.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:14 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:15.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:14 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:15.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:14 smithi002 ceph-mon[98018]: pgmap v193: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:15.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:14 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:15.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:14 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:16.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:16 smithi002 ceph-mon[98018]: pgmap v194: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:16.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:16 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:16.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:16 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:16.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:16 smithi099 ceph-mon[77412]: pgmap v194: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:16.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:16 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:16.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:16 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:18.391 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:18 smithi002 ceph-mon[98018]: pgmap v195: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:18.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:18 smithi099 ceph-mon[77412]: pgmap v195: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:19.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:19 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:19.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:19 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:19.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:19 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:19.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:19 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:19.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:19 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:19.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:19 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:19.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:19 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:19.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:19 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:19.545 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:19 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:19.545 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:19 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:19.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:19 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:19.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:19 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:19.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:19 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:19.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:19 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:19.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:19 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:19.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:19 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:19.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:19 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:19.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:19 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:19.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:19 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:19.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:19 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:21.283 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:20 smithi099 ceph-mon[77412]: pgmap v196: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:21.283 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:20 smithi099 ceph-mon[77412]: Upgrade: Updating mds.cephfs.smithi099.hgawhu 2024-09-17T01:10:21.284 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:20 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:21.284 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:20 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.hgawhu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:10:21.284 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:20 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:21.284 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:20 smithi099 ceph-mon[77412]: Deploying daemon mds.cephfs.smithi099.hgawhu on smithi099 2024-09-17T01:10:21.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:20 smithi002 ceph-mon[98018]: pgmap v196: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:21.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:20 smithi002 ceph-mon[98018]: Upgrade: Updating mds.cephfs.smithi099.hgawhu 2024-09-17T01:10:21.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:20 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:21.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:20 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.hgawhu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:10:21.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:20 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:21.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:20 smithi002 ceph-mon[98018]: Deploying daemon mds.cephfs.smithi099.hgawhu on smithi099 2024-09-17T01:10:23.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:22 smithi099 ceph-mon[77412]: pgmap v197: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:23.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:22 smithi099 ceph-mon[77412]: osdmap e94: 6 total, 6 up, 6 in 2024-09-17T01:10:23.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:22 smithi099 ceph-mon[77412]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-17T01:10:23.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:22 smithi002 ceph-mon[98018]: pgmap v197: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:23.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:22 smithi002 ceph-mon[98018]: osdmap e94: 6 total, 6 up, 6 in 2024-09-17T01:10:23.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:22 smithi002 ceph-mon[98018]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-17T01:10:25.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:24 smithi099 ceph-mon[77412]: pgmap v199: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:25.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:24 smithi002 ceph-mon[98018]: pgmap v199: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:26.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:26.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:27.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:26 smithi099 ceph-mon[77412]: pgmap v200: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:27.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:27.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:27.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:27.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:26 smithi002 ceph-mon[98018]: pgmap v200: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:27.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:27.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:27.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:28.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:27 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.99:6824/1774556036,v1:172.21.15.99:6825/1774556036] up:boot 2024-09-17T01:10:28.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:27 smithi099 ceph-mon[77412]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-17T01:10:28.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:27 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.hgawhu"}]: dispatch 2024-09-17T01:10:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:27 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.99:6824/1774556036,v1:172.21.15.99:6825/1774556036] up:boot 2024-09-17T01:10:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:27 smithi002 ceph-mon[98018]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-17T01:10:28.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:27 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.hgawhu"}]: dispatch 2024-09-17T01:10:29.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:28 smithi099 ceph-mon[77412]: pgmap v201: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:29.306 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:28 smithi002 ceph-mon[98018]: pgmap v201: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:30.532 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:30 smithi099 ceph-mon[77412]: pgmap v202: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:30.532 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:30 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:30.532 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:30 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:30.532 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:30 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:30.532 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:30 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:30.597 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:30 smithi002 ceph-mon[98018]: pgmap v202: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:30.597 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:30 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:30.597 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:30 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:30.597 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:30 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:30.597 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:30 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:32.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:32 smithi099 ceph-mon[77412]: pgmap v203: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:32.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:32 smithi002 ceph-mon[98018]: pgmap v203: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:34.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:34 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:34.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:34 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:34.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:34 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:34 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:34 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:34.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:34 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:34 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:34 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:34 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:34 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.358 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:34 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:34.359 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:34 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:34.359 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:34 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:34.359 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:34 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:34.359 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:34 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:34.359 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:34 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:34.359 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:34 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.359 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:34 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.359 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:34 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.359 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:34 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.360+0000 7f03df522640 1 -- 172.21.15.2:0/3230334772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03d80fb4d0 msgr2=0x7f03d80fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.360+0000 7f03df522640 1 --2- 172.21.15.2:0/3230334772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03d80fb4d0 0x7f03d80fb940 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f03c80048d0 tx=0x7f03c8009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.360+0000 7f03df522640 1 -- 172.21.15.2:0/3230334772 shutdown_connections 2024-09-17T01:10:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.360+0000 7f03df522640 1 --2- 172.21.15.2:0/3230334772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03d80fb4d0 0x7f03d80fb940 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.360+0000 7f03df522640 1 --2- 172.21.15.2:0/3230334772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03d8101510 0x7f03d81018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.360+0000 7f03df522640 1 -- 172.21.15.2:0/3230334772 >> 172.21.15.2:0/3230334772 conn(0x7f03d80f7090 msgr2=0x7f03d80f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.361+0000 7f03df522640 1 -- 172.21.15.2:0/3230334772 shutdown_connections 2024-09-17T01:10:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.361+0000 7f03df522640 1 -- 172.21.15.2:0/3230334772 wait complete. 2024-09-17T01:10:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.361+0000 7f03df522640 1 Processor -- start 2024-09-17T01:10:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.361+0000 7f03df522640 1 -- start start 2024-09-17T01:10:34.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.362+0000 7f03df522640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03d80fb4d0 0x7f03d81131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:34.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.362+0000 7f03df522640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03d8101510 0x7f03d8113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:34.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.362+0000 7f03df522640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d8113d10 con 0x7f03d80fb4d0 2024-09-17T01:10:34.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.362+0000 7f03dd2be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03d80fb4d0 0x7f03d81131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:34.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.362+0000 7f03dcabd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03d8101510 0x7f03d8113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:34.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.362+0000 7f03dcabd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03d8101510 0x7f03d8113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.2:54630/0 (socket says 172.21.15.2:54630) 2024-09-17T01:10:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.362+0000 7f03dcabd640 1 -- 172.21.15.2:0/2517834205 learned_addr learned my addr 172.21.15.2:0/2517834205 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:10:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.362+0000 7f03dd2be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03d80fb4d0 0x7f03d81131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53062/0 (socket says 172.21.15.2:53062) 2024-09-17T01:10:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.362+0000 7f03df522640 1 -- 172.21.15.2:0/2517834205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d810d150 con 0x7f03d8101510 2024-09-17T01:10:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.362+0000 7f03dcabd640 1 -- 172.21.15.2:0/2517834205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03d80fb4d0 msgr2=0x7f03d81131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.362+0000 7f03dcabd640 1 --2- 172.21.15.2:0/2517834205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03d80fb4d0 0x7f03d81131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.362+0000 7f03dcabd640 1 -- 172.21.15.2:0/2517834205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c8005040 con 0x7f03d8101510 2024-09-17T01:10:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.362+0000 7f03dcabd640 1 --2- 172.21.15.2:0/2517834205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03d8101510 0x7f03d8113710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f03c8000c00 tx=0x7f03c8009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.363+0000 7f03cdffb640 1 -- 172.21.15.2:0/2517834205 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03c8038070 con 0x7f03d8101510 2024-09-17T01:10:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.363+0000 7f03cdffb640 1 -- 172.21.15.2:0/2517834205 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f03c802ade0 con 0x7f03d8101510 2024-09-17T01:10:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.363+0000 7f03cdffb640 1 -- 172.21.15.2:0/2517834205 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03c802c7b0 con 0x7f03d8101510 2024-09-17T01:10:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.363+0000 7f03df522640 1 -- 172.21.15.2:0/2517834205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d810d3d0 con 0x7f03d8101510 2024-09-17T01:10:34.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.363+0000 7f03df522640 1 -- 172.21.15.2:0/2517834205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d810d910 con 0x7f03d8101510 2024-09-17T01:10:34.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.364+0000 7f03df522640 1 -- 172.21.15.2:0/2517834205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d80fcc10 con 0x7f03d8101510 2024-09-17T01:10:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.365+0000 7f03cdffb640 1 -- 172.21.15.2:0/2517834205 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f03c8030020 con 0x7f03d8101510 2024-09-17T01:10:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.365+0000 7f03cdffb640 1 --2- 172.21.15.2:0/2517834205 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03c406e530 0x7f03c40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.365+0000 7f03cdffb640 1 -- 172.21.15.2:0/2517834205 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f03c80ae6b0 con 0x7f03d8101510 2024-09-17T01:10:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.365+0000 7f03dd2be640 1 --2- 172.21.15.2:0/2517834205 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03c406e530 0x7f03c40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.366+0000 7f03dd2be640 1 --2- 172.21.15.2:0/2517834205 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03c406e530 0x7f03c40709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009af0 tx=0x7f03d400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:34.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.370+0000 7f03cdffb640 1 -- 172.21.15.2:0/2517834205 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f03c8077650 con 0x7f03d8101510 2024-09-17T01:10:34.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.566+0000 7f03df522640 1 -- 172.21.15.2:0/2517834205 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f03d81084b0 con 0x7f03c406e530 2024-09-17T01:10:34.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.568+0000 7f03cdffb640 1 -- 172.21.15.2:0/2517834205 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f03d81084b0 con 0x7f03c406e530 2024-09-17T01:10:34.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.570+0000 7f03df522640 1 -- 172.21.15.2:0/2517834205 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03c406e530 msgr2=0x7f03c40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:34.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.570+0000 7f03df522640 1 --2- 172.21.15.2:0/2517834205 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03c406e530 0x7f03c40709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009af0 tx=0x7f03d400b040 comp rx=0 tx=0).stop 2024-09-17T01:10:34.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.570+0000 7f03df522640 1 -- 172.21.15.2:0/2517834205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03d8101510 msgr2=0x7f03d8113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:34.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.570+0000 7f03df522640 1 --2- 172.21.15.2:0/2517834205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03d8101510 0x7f03d8113710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f03c8000c00 tx=0x7f03c8009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.570+0000 7f03df522640 1 -- 172.21.15.2:0/2517834205 shutdown_connections 2024-09-17T01:10:34.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.570+0000 7f03df522640 1 --2- 172.21.15.2:0/2517834205 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03c406e530 0x7f03c40709e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.570+0000 7f03df522640 1 --2- 172.21.15.2:0/2517834205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03d8101510 0x7f03d8113710 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.570+0000 7f03df522640 1 --2- 172.21.15.2:0/2517834205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03d80fb4d0 0x7f03d81131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.570+0000 7f03df522640 1 -- 172.21.15.2:0/2517834205 >> 172.21.15.2:0/2517834205 conn(0x7f03d80f7090 msgr2=0x7f03d80659c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:34.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.570+0000 7f03df522640 1 -- 172.21.15.2:0/2517834205 shutdown_connections 2024-09-17T01:10:34.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.570+0000 7f03df522640 1 -- 172.21.15.2:0/2517834205 wait complete. 2024-09-17T01:10:34.576 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:10:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.653+0000 7fedb9905640 1 -- 172.21.15.2:0/593093630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedb40fac80 msgr2=0x7fedb40fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.653+0000 7fedb9905640 1 --2- 172.21.15.2:0/593093630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedb40fac80 0x7fedb40fb0f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0048d0 tx=0x7fed9c009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.653+0000 7fedb9905640 1 -- 172.21.15.2:0/593093630 shutdown_connections 2024-09-17T01:10:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.653+0000 7fedb9905640 1 --2- 172.21.15.2:0/593093630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedb40fac80 0x7fedb40fb0f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.653+0000 7fedb9905640 1 --2- 172.21.15.2:0/593093630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedb4102620 0x7fedb41029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.653+0000 7fedb9905640 1 -- 172.21.15.2:0/593093630 >> 172.21.15.2:0/593093630 conn(0x7fedb4070ce0 msgr2=0x7fedb40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.653+0000 7fedb9905640 1 -- 172.21.15.2:0/593093630 shutdown_connections 2024-09-17T01:10:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.653+0000 7fedb9905640 1 -- 172.21.15.2:0/593093630 wait complete. 2024-09-17T01:10:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.654+0000 7fedb9905640 1 Processor -- start 2024-09-17T01:10:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.654+0000 7fedb9905640 1 -- start start 2024-09-17T01:10:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.654+0000 7fedb9905640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedb40fac80 0x7fedb41131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.654+0000 7fedb9905640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedb4102620 0x7fedb4113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.654+0000 7fedb9905640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb4113d20 con 0x7fedb4102620 2024-09-17T01:10:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.654+0000 7fedb9905640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb410d160 con 0x7fedb40fac80 2024-09-17T01:10:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.654+0000 7fedaa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedb4102620 0x7fedb4113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.654+0000 7fedaa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedb4102620 0x7fedb4113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53090/0 (socket says 172.21.15.2:53090) 2024-09-17T01:10:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.654+0000 7fedb2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedb40fac80 0x7fedb41131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.654+0000 7fedaa7fc640 1 -- 172.21.15.2:0/1213548680 learned_addr learned my addr 172.21.15.2:0/1213548680 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:10:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.654+0000 7fedaa7fc640 1 -- 172.21.15.2:0/1213548680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedb40fac80 msgr2=0x7fedb41131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.654+0000 7fedaa7fc640 1 --2- 172.21.15.2:0/1213548680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedb40fac80 0x7fedb41131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.655+0000 7fedaa7fc640 1 -- 172.21.15.2:0/1213548680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c005040 con 0x7fedb4102620 2024-09-17T01:10:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.655+0000 7fedb2ffd640 1 --2- 172.21.15.2:0/1213548680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedb40fac80 0x7fedb41131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:10:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.655+0000 7fedaa7fc640 1 --2- 172.21.15.2:0/1213548680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedb4102620 0x7fedb4113720 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fed9c000c00 tx=0x7fed9c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.655+0000 7fedabfff640 1 -- 172.21.15.2:0/1213548680 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed9c038070 con 0x7fedb4102620 2024-09-17T01:10:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.655+0000 7fedabfff640 1 -- 172.21.15.2:0/1213548680 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fed9c02ade0 con 0x7fedb4102620 2024-09-17T01:10:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.655+0000 7fedb9905640 1 -- 172.21.15.2:0/1213548680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb410d3e0 con 0x7fedb4102620 2024-09-17T01:10:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.655+0000 7fedabfff640 1 -- 172.21.15.2:0/1213548680 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed9c02c7b0 con 0x7fedb4102620 2024-09-17T01:10:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.655+0000 7fedb9905640 1 -- 172.21.15.2:0/1213548680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb410d920 con 0x7fedb4102620 2024-09-17T01:10:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.656+0000 7fedb9905640 1 -- 172.21.15.2:0/1213548680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb40657b0 con 0x7fedb4102620 2024-09-17T01:10:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.657+0000 7fedabfff640 1 -- 172.21.15.2:0/1213548680 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fed9c030020 con 0x7fedb4102620 2024-09-17T01:10:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.658+0000 7fedabfff640 1 --2- 172.21.15.2:0/1213548680 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7feda006e530 0x7feda00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.658+0000 7fedabfff640 1 -- 172.21.15.2:0/1213548680 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fed9c0ae6f0 con 0x7fedb4102620 2024-09-17T01:10:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.658+0000 7fedb2ffd640 1 --2- 172.21.15.2:0/1213548680 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7feda006e530 0x7feda00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.658+0000 7fedb2ffd640 1 --2- 172.21.15.2:0/1213548680 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7feda006e530 0x7feda00709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feda4004fd0 tx=0x7feda400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:34.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.662+0000 7fedabfff640 1 -- 172.21.15.2:0/1213548680 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fed9c0776b0 con 0x7fedb4102620 2024-09-17T01:10:34.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.858+0000 7fedb9905640 1 -- 172.21.15.2:0/1213548680 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fedb4109590 con 0x7feda006e530 2024-09-17T01:10:34.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.859+0000 7fedabfff640 1 -- 172.21.15.2:0/1213548680 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fedb4109590 con 0x7feda006e530 2024-09-17T01:10:34.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.861+0000 7fedb9905640 1 -- 172.21.15.2:0/1213548680 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7feda006e530 msgr2=0x7feda00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:34.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.861+0000 7fedb9905640 1 --2- 172.21.15.2:0/1213548680 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7feda006e530 0x7feda00709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feda4004fd0 tx=0x7feda400b040 comp rx=0 tx=0).stop 2024-09-17T01:10:34.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.861+0000 7fedb9905640 1 -- 172.21.15.2:0/1213548680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedb4102620 msgr2=0x7fedb4113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:34.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.861+0000 7fedb9905640 1 --2- 172.21.15.2:0/1213548680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedb4102620 0x7fedb4113720 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fed9c000c00 tx=0x7fed9c009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.861+0000 7fedb9905640 1 -- 172.21.15.2:0/1213548680 shutdown_connections 2024-09-17T01:10:34.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.861+0000 7fedb9905640 1 --2- 172.21.15.2:0/1213548680 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7feda006e530 0x7feda00709e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.861+0000 7fedb9905640 1 --2- 172.21.15.2:0/1213548680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedb4102620 0x7fedb4113720 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.862+0000 7fedb9905640 1 --2- 172.21.15.2:0/1213548680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedb40fac80 0x7fedb41131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.862+0000 7fedb9905640 1 -- 172.21.15.2:0/1213548680 >> 172.21.15.2:0/1213548680 conn(0x7fedb4070ce0 msgr2=0x7fedb4105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:34.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.862+0000 7fedb9905640 1 -- 172.21.15.2:0/1213548680 shutdown_connections 2024-09-17T01:10:34.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.862+0000 7fedb9905640 1 -- 172.21.15.2:0/1213548680 wait complete. 2024-09-17T01:10:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.944+0000 7f102dcf4640 1 -- 172.21.15.2:0/1340672937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1028101490 msgr2=0x7f1028101860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:34.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.944+0000 7f102dcf4640 1 --2- 172.21.15.2:0/1340672937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1028101490 0x7f1028101860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f10180048d0 tx=0x7f1018009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.944+0000 7f102dcf4640 1 -- 172.21.15.2:0/1340672937 shutdown_connections 2024-09-17T01:10:34.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.944+0000 7f102dcf4640 1 --2- 172.21.15.2:0/1340672937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10280fb470 0x7f10280fb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.944+0000 7f102dcf4640 1 --2- 172.21.15.2:0/1340672937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1028101490 0x7f1028101860 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.944+0000 7f102dcf4640 1 -- 172.21.15.2:0/1340672937 >> 172.21.15.2:0/1340672937 conn(0x7f1028071450 msgr2=0x7f1028071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:34.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.944+0000 7f102dcf4640 1 -- 172.21.15.2:0/1340672937 shutdown_connections 2024-09-17T01:10:34.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.944+0000 7f102dcf4640 1 -- 172.21.15.2:0/1340672937 wait complete. 2024-09-17T01:10:34.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.944+0000 7f102dcf4640 1 Processor -- start 2024-09-17T01:10:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.945+0000 7f102dcf4640 1 -- start start 2024-09-17T01:10:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.945+0000 7f102dcf4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10280fb470 0x7f1028115330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.945+0000 7f102dcf4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1028101490 0x7f1028115870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.945+0000 7f102dcf4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1028115e70 con 0x7f1028101490 2024-09-17T01:10:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.945+0000 7f102dcf4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102810f2b0 con 0x7f10280fb470 2024-09-17T01:10:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.945+0000 7f1026ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1028101490 0x7f1028115870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.945+0000 7f1026ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1028101490 0x7f1028115870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53096/0 (socket says 172.21.15.2:53096) 2024-09-17T01:10:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.945+0000 7f1026ffd640 1 -- 172.21.15.2:0/2383777206 learned_addr learned my addr 172.21.15.2:0/2383777206 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:10:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.945+0000 7f10277fe640 1 --2- 172.21.15.2:0/2383777206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10280fb470 0x7f1028115330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.945+0000 7f1026ffd640 1 -- 172.21.15.2:0/2383777206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10280fb470 msgr2=0x7f1028115330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.945+0000 7f1026ffd640 1 --2- 172.21.15.2:0/2383777206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10280fb470 0x7f1028115330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:34.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.945+0000 7f1026ffd640 1 -- 172.21.15.2:0/2383777206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1018005040 con 0x7f1028101490 2024-09-17T01:10:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.946+0000 7f1026ffd640 1 --2- 172.21.15.2:0/2383777206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1028101490 0x7f1028115870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f101c00c830 tx=0x7f101c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.946+0000 7f100ffff640 1 -- 172.21.15.2:0/2383777206 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f101c00a7d0 con 0x7f1028101490 2024-09-17T01:10:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.946+0000 7f102dcf4640 1 -- 172.21.15.2:0/2383777206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102810f590 con 0x7f1028101490 2024-09-17T01:10:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.946+0000 7f100ffff640 1 -- 172.21.15.2:0/2383777206 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f101c00add0 con 0x7f1028101490 2024-09-17T01:10:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.946+0000 7f100ffff640 1 -- 172.21.15.2:0/2383777206 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f101c0113a0 con 0x7f1028101490 2024-09-17T01:10:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.946+0000 7f102dcf4640 1 -- 172.21.15.2:0/2383777206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102810fb30 con 0x7f1028101490 2024-09-17T01:10:34.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.947+0000 7f102dcf4640 1 -- 172.21.15.2:0/2383777206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10280fcb50 con 0x7f1028101490 2024-09-17T01:10:34.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.947+0000 7f100ffff640 1 -- 172.21.15.2:0/2383777206 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f101c012400 con 0x7f1028101490 2024-09-17T01:10:34.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.948+0000 7f100ffff640 1 --2- 172.21.15.2:0/2383777206 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f101006e530 0x7f10100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:34.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.948+0000 7f100ffff640 1 -- 172.21.15.2:0/2383777206 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f101c08e3b0 con 0x7f1028101490 2024-09-17T01:10:34.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.948+0000 7f10277fe640 1 --2- 172.21.15.2:0/2383777206 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f101006e530 0x7f10100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:34.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.949+0000 7f10277fe640 1 --2- 172.21.15.2:0/2383777206 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f101006e530 0x7f10100709e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1018003080 tx=0x7f1018035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:34.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:34.953+0000 7f100ffff640 1 -- 172.21.15.2:0/2383777206 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f101c0573f0 con 0x7f1028101490 2024-09-17T01:10:35.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.137+0000 7f102dcf4640 1 -- 172.21.15.2:0/2383777206 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1028108400 con 0x7f101006e530 2024-09-17T01:10:35.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.145+0000 7f100ffff640 1 -- 172.21.15.2:0/2383777206 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1028108400 con 0x7f101006e530 2024-09-17T01:10:35.144 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:10:35.144 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (7m) 20s ago 16m 25.5M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:10:35.145 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (4m) 20s ago 16m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de b7ed6c8d5a92 2024-09-17T01:10:35.145 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (4m) 5s ago 15m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de ae713b940078 2024-09-17T01:10:35.145 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (6m) 20s ago 16m 82.5M - 9.4.12 2bacad6d85d8 5fe408c103d6 2024-09-17T01:10:35.145 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (25s) 20s ago 11m 14.1M - 19.1.1-330-gc2ddf972 ebb0615149de 923cbcf82a29 2024-09-17T01:10:35.145 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (41s) 20s ago 11m 15.5M - 19.1.1-330-gc2ddf972 ebb0615149de 8862e6324ff5 2024-09-17T01:10:35.145 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (11m) 5s ago 11m 11.0M - 17.2.7-1635-g4a704134 f22ead590bad 19bf1708ce45 2024-09-17T01:10:35.145 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (9s) 5s ago 11m 11.8M - 19.1.1-330-gc2ddf972 ebb0615149de 222618d9f6fd 2024-09-17T01:10:35.145 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (7m) 20s ago 17m 504M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:10:35.145 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (6m) 5s ago 15m 442M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:10:35.145 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (5m) 20s ago 17m 49.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de da5247385c2d 2024-09-17T01:10:35.145 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (4m) 5s ago 15m 38.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b92f98b2cab9 2024-09-17T01:10:35.145 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (7m) 20s ago 16m 15.7M - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:10:35.146 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (7m) 5s ago 15m 15.6M - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:10:35.146 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (3m) 20s ago 14m 162M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 563188d6089b 2024-09-17T01:10:35.146 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (3m) 20s ago 14m 106M 1558M 19.1.1-330-gc2ddf972 ebb0615149de cc26caf558d7 2024-09-17T01:10:35.146 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (2m) 20s ago 13m 135M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 0aac20af5580 2024-09-17T01:10:35.146 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (2m) 5s ago 13m 137M 2581M 19.1.1-330-gc2ddf972 ebb0615149de 0740cf987fef 2024-09-17T01:10:35.146 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (93s) 5s ago 13m 96.8M 2581M 19.1.1-330-gc2ddf972 ebb0615149de df5b078898bb 2024-09-17T01:10:35.146 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (60s) 5s ago 12m 90.2M 2581M 19.1.1-330-gc2ddf972 ebb0615149de e26706fa8822 2024-09-17T01:10:35.146 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (6m) 20s ago 16m 66.2M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:10:35.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.148+0000 7f102dcf4640 1 -- 172.21.15.2:0/2383777206 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f101006e530 msgr2=0x7f10100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:35.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.148+0000 7f102dcf4640 1 --2- 172.21.15.2:0/2383777206 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f101006e530 0x7f10100709e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1018003080 tx=0x7f1018035040 comp rx=0 tx=0).stop 2024-09-17T01:10:35.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.148+0000 7f102dcf4640 1 -- 172.21.15.2:0/2383777206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1028101490 msgr2=0x7f1028115870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:35.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.148+0000 7f102dcf4640 1 --2- 172.21.15.2:0/2383777206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1028101490 0x7f1028115870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f101c00c830 tx=0x7f101c004430 comp rx=0 tx=0).stop 2024-09-17T01:10:35.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.148+0000 7f102dcf4640 1 -- 172.21.15.2:0/2383777206 shutdown_connections 2024-09-17T01:10:35.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.148+0000 7f102dcf4640 1 --2- 172.21.15.2:0/2383777206 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f101006e530 0x7f10100709e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.148+0000 7f102dcf4640 1 --2- 172.21.15.2:0/2383777206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1028101490 0x7f1028115870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.148+0000 7f102dcf4640 1 --2- 172.21.15.2:0/2383777206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10280fb470 0x7f1028115330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.148+0000 7f102dcf4640 1 -- 172.21.15.2:0/2383777206 >> 172.21.15.2:0/2383777206 conn(0x7f1028071450 msgr2=0x7f10280f9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:35.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.148+0000 7f102dcf4640 1 -- 172.21.15.2:0/2383777206 shutdown_connections 2024-09-17T01:10:35.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.148+0000 7f102dcf4640 1 -- 172.21.15.2:0/2383777206 wait complete. 2024-09-17T01:10:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.228+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/1214713795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7e4102530 msgr2=0x7fe7e4102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.228+0000 7fe7eb6f7640 1 --2- 172.21.15.2:0/1214713795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7e4102530 0x7fe7e4102900 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00048d0 tx=0x7fe7e0009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.228+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/1214713795 shutdown_connections 2024-09-17T01:10:35.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.228+0000 7fe7eb6f7640 1 --2- 172.21.15.2:0/1214713795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7e4102ed0 0x7fe7e40fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.228+0000 7fe7eb6f7640 1 --2- 172.21.15.2:0/1214713795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7e4102530 0x7fe7e4102900 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.228+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/1214713795 >> 172.21.15.2:0/1214713795 conn(0x7fe7e40f80f0 msgr2=0x7fe7e40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:35.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:35 smithi002 ceph-mon[98018]: pgmap v204: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:35.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:35 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:35.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:35 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.heckcd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:10:35.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:35 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.229+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/1214713795 shutdown_connections 2024-09-17T01:10:35.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.229+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/1214713795 wait complete. 2024-09-17T01:10:35.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.229+0000 7fe7eb6f7640 1 Processor -- start 2024-09-17T01:10:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.229+0000 7fe7eb6f7640 1 -- start start 2024-09-17T01:10:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.229+0000 7fe7eb6f7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7e4102530 0x7fe7e4113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.229+0000 7fe7eb6f7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7e4102ed0 0x7fe7e4113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.229+0000 7fe7eb6f7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e4113d50 con 0x7fe7e4102ed0 2024-09-17T01:10:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.229+0000 7fe7eb6f7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e410d190 con 0x7fe7e4102530 2024-09-17T01:10:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.230+0000 7fe7e8c92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7e4102ed0 0x7fe7e4113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.230+0000 7fe7e8c92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7e4102ed0 0x7fe7e4113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53116/0 (socket says 172.21.15.2:53116) 2024-09-17T01:10:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.230+0000 7fe7e8c92640 1 -- 172.21.15.2:0/3180272280 learned_addr learned my addr 172.21.15.2:0/3180272280 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:10:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.230+0000 7fe7e9493640 1 --2- 172.21.15.2:0/3180272280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7e4102530 0x7fe7e4113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.230+0000 7fe7e8c92640 1 -- 172.21.15.2:0/3180272280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7e4102530 msgr2=0x7fe7e4113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.230+0000 7fe7e8c92640 1 --2- 172.21.15.2:0/3180272280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7e4102530 0x7fe7e4113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.230+0000 7fe7e8c92640 1 -- 172.21.15.2:0/3180272280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e0005040 con 0x7fe7e4102ed0 2024-09-17T01:10:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.230+0000 7fe7e8c92640 1 --2- 172.21.15.2:0/3180272280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7e4102ed0 0x7fe7e4113750 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4002870 tx=0x7fe7d4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.230+0000 7fe7d9ffb640 1 -- 172.21.15.2:0/3180272280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7d4007c30 con 0x7fe7e4102ed0 2024-09-17T01:10:35.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.230+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/3180272280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e410d470 con 0x7fe7e4102ed0 2024-09-17T01:10:35.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.230+0000 7fe7d9ffb640 1 -- 172.21.15.2:0/3180272280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe7d400f040 con 0x7fe7e4102ed0 2024-09-17T01:10:35.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.230+0000 7fe7d9ffb640 1 -- 172.21.15.2:0/3180272280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7d400daf0 con 0x7fe7e4102ed0 2024-09-17T01:10:35.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.231+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/3180272280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e410d990 con 0x7fe7e4102ed0 2024-09-17T01:10:35.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.232+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/3180272280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e40fdcb0 con 0x7fe7e4102ed0 2024-09-17T01:10:35.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.232+0000 7fe7d9ffb640 1 -- 172.21.15.2:0/3180272280 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fe7d400dc50 con 0x7fe7e4102ed0 2024-09-17T01:10:35.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.233+0000 7fe7d9ffb640 1 --2- 172.21.15.2:0/3180272280 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe7d006e530 0x7fe7d00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:35.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.233+0000 7fe7d9ffb640 1 -- 172.21.15.2:0/3180272280 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fe7d408e110 con 0x7fe7e4102ed0 2024-09-17T01:10:35.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.233+0000 7fe7e9493640 1 --2- 172.21.15.2:0/3180272280 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe7d006e530 0x7fe7d00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:35.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.233+0000 7fe7e9493640 1 --2- 172.21.15.2:0/3180272280 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe7d006e530 0x7fe7d00709e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009ac0 tx=0x7fe7e0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:35.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.240+0000 7fe7d9ffb640 1 -- 172.21.15.2:0/3180272280 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe7d40570d0 con 0x7fe7e4102ed0 2024-09-17T01:10:35.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:35 smithi099 ceph-mon[77412]: pgmap v204: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:35.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:35 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:35.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:35 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.heckcd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:10:35.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:35 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:35.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.488+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/3180272280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe7e40fbd30 con 0x7fe7e4102ed0 2024-09-17T01:10:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.489+0000 7fe7d9ffb640 1 -- 172.21.15.2:0/3180272280 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7fe7d405a790 con 0x7fe7e4102ed0 2024-09-17T01:10:35.486 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:10:35.486 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:10:35.486 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:10:35.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:10:35.486 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:10:35.487 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:10:35.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:10:35.487 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:10:35.487 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:10:35.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:10:35.487 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:10:35.487 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 1, 2024-09-17T01:10:35.487 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3 2024-09-17T01:10:35.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:10:35.487 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:10:35.487 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-1635-g4a704134 (4a704134aa895fa24b75bb03cb263f1e3316004e) quincy (stable)": 1, 2024-09-17T01:10:35.487 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 13 2024-09-17T01:10:35.487 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:10:35.488 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.491+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/3180272280 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe7d006e530 msgr2=0x7fe7d00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.491+0000 7fe7eb6f7640 1 --2- 172.21.15.2:0/3180272280 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe7d006e530 0x7fe7d00709e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009ac0 tx=0x7fe7e0035040 comp rx=0 tx=0).stop 2024-09-17T01:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.491+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/3180272280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7e4102ed0 msgr2=0x7fe7e4113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.491+0000 7fe7eb6f7640 1 --2- 172.21.15.2:0/3180272280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7e4102ed0 0x7fe7e4113750 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4002870 tx=0x7fe7d4004600 comp rx=0 tx=0).stop 2024-09-17T01:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.491+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/3180272280 shutdown_connections 2024-09-17T01:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.491+0000 7fe7eb6f7640 1 --2- 172.21.15.2:0/3180272280 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe7d006e530 0x7fe7d00709e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.491+0000 7fe7eb6f7640 1 --2- 172.21.15.2:0/3180272280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7e4102ed0 0x7fe7e4113750 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.491+0000 7fe7eb6f7640 1 --2- 172.21.15.2:0/3180272280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7e4102530 0x7fe7e4113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.491+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/3180272280 >> 172.21.15.2:0/3180272280 conn(0x7fe7e40f80f0 msgr2=0x7fe7e40f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.491+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/3180272280 shutdown_connections 2024-09-17T01:10:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.492+0000 7fe7eb6f7640 1 -- 172.21.15.2:0/3180272280 wait complete. 2024-09-17T01:10:35.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.572+0000 7fb9d4021640 1 -- 172.21.15.2:0/300230689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9cc0fd600 msgr2=0x7fb9cc0fd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:35.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.572+0000 7fb9d4021640 1 --2- 172.21.15.2:0/300230689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9cc0fd600 0x7fb9cc0fd9d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8004900 tx=0x7fb9c8009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.572+0000 7fb9d4021640 1 -- 172.21.15.2:0/300230689 shutdown_connections 2024-09-17T01:10:35.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.572+0000 7fb9d4021640 1 --2- 172.21.15.2:0/300230689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9cc0fdfa0 0x7fb9cc1065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.572+0000 7fb9d4021640 1 --2- 172.21.15.2:0/300230689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9cc0fd600 0x7fb9cc0fd9d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.572+0000 7fb9d4021640 1 -- 172.21.15.2:0/300230689 >> 172.21.15.2:0/300230689 conn(0x7fb9cc0f7090 msgr2=0x7fb9cc0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:35.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.572+0000 7fb9d4021640 1 -- 172.21.15.2:0/300230689 shutdown_connections 2024-09-17T01:10:35.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.572+0000 7fb9d4021640 1 -- 172.21.15.2:0/300230689 wait complete. 2024-09-17T01:10:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.573+0000 7fb9d4021640 1 Processor -- start 2024-09-17T01:10:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.573+0000 7fb9d4021640 1 -- start start 2024-09-17T01:10:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.573+0000 7fb9d4021640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9cc0fd600 0x7fb9cc113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.573+0000 7fb9d4021640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9cc0fdfa0 0x7fb9cc113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.573+0000 7fb9d4021640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc113d50 con 0x7fb9cc0fdfa0 2024-09-17T01:10:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.573+0000 7fb9d4021640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc10d190 con 0x7fb9cc0fd600 2024-09-17T01:10:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.573+0000 7fb9d15bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9cc0fdfa0 0x7fb9cc113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.573+0000 7fb9d15bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9cc0fdfa0 0x7fb9cc113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53138/0 (socket says 172.21.15.2:53138) 2024-09-17T01:10:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.573+0000 7fb9d15bc640 1 -- 172.21.15.2:0/441188852 learned_addr learned my addr 172.21.15.2:0/441188852 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:10:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.573+0000 7fb9d1dbd640 1 --2- 172.21.15.2:0/441188852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9cc0fd600 0x7fb9cc113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.573+0000 7fb9d15bc640 1 -- 172.21.15.2:0/441188852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9cc0fd600 msgr2=0x7fb9cc113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:35.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.573+0000 7fb9d15bc640 1 --2- 172.21.15.2:0/441188852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9cc0fd600 0x7fb9cc113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.573+0000 7fb9d15bc640 1 -- 172.21.15.2:0/441188852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c8005040 con 0x7fb9cc0fdfa0 2024-09-17T01:10:35.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.574+0000 7fb9d15bc640 1 --2- 172.21.15.2:0/441188852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9cc0fdfa0 0x7fb9cc113750 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00eb70 tx=0x7fb9bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:35.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.574+0000 7fb9c27fc640 1 -- 172.21.15.2:0/441188852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9bc007c30 con 0x7fb9cc0fdfa0 2024-09-17T01:10:35.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.574+0000 7fb9c27fc640 1 -- 172.21.15.2:0/441188852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb9bc00f040 con 0x7fb9cc0fdfa0 2024-09-17T01:10:35.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.574+0000 7fb9c27fc640 1 -- 172.21.15.2:0/441188852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9bc00ca60 con 0x7fb9cc0fdfa0 2024-09-17T01:10:35.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.574+0000 7fb9d4021640 1 -- 172.21.15.2:0/441188852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9cc10d410 con 0x7fb9cc0fdfa0 2024-09-17T01:10:35.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.574+0000 7fb9d4021640 1 -- 172.21.15.2:0/441188852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9cc10d930 con 0x7fb9cc0fdfa0 2024-09-17T01:10:35.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.575+0000 7fb9d4021640 1 -- 172.21.15.2:0/441188852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9cc0662f0 con 0x7fb9cc0fdfa0 2024-09-17T01:10:35.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.575+0000 7fb9c27fc640 1 -- 172.21.15.2:0/441188852 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fb9bc00cbc0 con 0x7fb9cc0fdfa0 2024-09-17T01:10:35.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.576+0000 7fb9c27fc640 1 --2- 172.21.15.2:0/441188852 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb9b806e530 0x7fb9b80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:35.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.576+0000 7fb9c27fc640 1 -- 172.21.15.2:0/441188852 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fb9bc08de20 con 0x7fb9cc0fdfa0 2024-09-17T01:10:35.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.576+0000 7fb9d1dbd640 1 --2- 172.21.15.2:0/441188852 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb9b806e530 0x7fb9b80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:35.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.577+0000 7fb9d1dbd640 1 --2- 172.21.15.2:0/441188852 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb9b806e530 0x7fb9b80709e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8003080 tx=0x7fb9c8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:35.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.580+0000 7fb9c27fc640 1 -- 172.21.15.2:0/441188852 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb9bc056f10 con 0x7fb9cc0fdfa0 2024-09-17T01:10:35.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.790+0000 7fb9d4021640 1 -- 172.21.15.2:0/441188852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb9cc109580 con 0x7fb9cc0fdfa0 2024-09-17T01:10:35.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.791+0000 7fb9c27fc640 1 -- 172.21.15.2:0/441188852 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 34 v34) v1 ==== 76+0+1905 (secure 0 0 0) 0x7fb9bc019790 con 0x7fb9cc0fdfa0 2024-09-17T01:10:35.788 INFO:teuthology.orchestra.run.smithi002.stdout:e34 2024-09-17T01:10:35.788 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-17T01:10:26:947392+0000 2024-09-17T01:10:35.789 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:10:35.789 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:10:35.789 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-17T01:10:35.789 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:10:35.789 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:10:35.789 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-17T01:10:35.789 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 27 2024-09-17T01:10:35.789 INFO:teuthology.orchestra.run.smithi002.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-17T01:10:35.789 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-17T00:59:20.485696+0000 2024-09-17T01:10:35.789 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-17T01:09:44.670921+0000 2024-09-17T01:10:35.789 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-17T01:10:35.789 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-17T01:10:35.789 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-17T01:10:35.790 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-17T01:10:35.790 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-17T01:10:35.790 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-17T01:10:35.790 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-17T01:10:35.790 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-17T01:10:35.790 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 91 2024-09-17T01:10:35.790 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:10:35.790 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2024-09-17T01:10:35.790 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2024-09-17T01:10:35.790 INFO:teuthology.orchestra.run.smithi002.stdout:up {} 2024-09-17T01:10:35.790 INFO:teuthology.orchestra.run.smithi002.stdout:failed 0,1 2024-09-17T01:10:35.790 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-17T01:10:35.790 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-17T01:10:35.790 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-17T01:10:35.791 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-17T01:10:35.791 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-17T01:10:35.791 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-17T01:10:35.791 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-17T01:10:35.791 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-17T01:10:35.791 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:10:35.791 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:10:35.791 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:10:35.791 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-09-17T01:10:35.791 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:10:35.791 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.zmrgxd{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/2424122669,v1:172.21.15.2:6827/2424122669] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:10:35.791 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.fmyyzz{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6828/2400957585,v1:172.21.15.2:6829/2400957585] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:10:35.791 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.heckcd{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/2884389025,v1:172.21.15.99:6827/2884389025] compat {c=[1],r=[1],i=[7ff]}] 2024-09-17T01:10:35.791 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.hgawhu{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6824/1774556036,v1:172.21.15.99:6825/1774556036] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:10:35.792 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 34 2024-09-17T01:10:35.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.793+0000 7fb9d4021640 1 -- 172.21.15.2:0/441188852 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb9b806e530 msgr2=0x7fb9b80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:35.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.793+0000 7fb9d4021640 1 --2- 172.21.15.2:0/441188852 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb9b806e530 0x7fb9b80709e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8003080 tx=0x7fb9c8035040 comp rx=0 tx=0).stop 2024-09-17T01:10:35.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.793+0000 7fb9d4021640 1 -- 172.21.15.2:0/441188852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9cc0fdfa0 msgr2=0x7fb9cc113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:35.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.793+0000 7fb9d4021640 1 --2- 172.21.15.2:0/441188852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9cc0fdfa0 0x7fb9cc113750 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc00eb70 tx=0x7fb9bc00b040 comp rx=0 tx=0).stop 2024-09-17T01:10:35.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.793+0000 7fb9d4021640 1 -- 172.21.15.2:0/441188852 shutdown_connections 2024-09-17T01:10:35.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.793+0000 7fb9d4021640 1 --2- 172.21.15.2:0/441188852 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb9b806e530 0x7fb9b80709e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.793+0000 7fb9d4021640 1 --2- 172.21.15.2:0/441188852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9cc0fdfa0 0x7fb9cc113750 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.793+0000 7fb9d4021640 1 --2- 172.21.15.2:0/441188852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9cc0fd600 0x7fb9cc113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.793+0000 7fb9d4021640 1 -- 172.21.15.2:0/441188852 >> 172.21.15.2:0/441188852 conn(0x7fb9cc0f7090 msgr2=0x7fb9cc0f8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:35.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.794+0000 7fb9d4021640 1 -- 172.21.15.2:0/441188852 shutdown_connections 2024-09-17T01:10:35.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.794+0000 7fb9d4021640 1 -- 172.21.15.2:0/441188852 wait complete. 2024-09-17T01:10:35.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.875+0000 7f06c30e0640 1 -- 172.21.15.2:0/3678222018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06bc101510 msgr2=0x7f06bc1018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.875+0000 7f06c30e0640 1 --2- 172.21.15.2:0/3678222018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06bc101510 0x7f06bc1018e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0048d0 tx=0x7f06ac009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.875+0000 7f06c30e0640 1 -- 172.21.15.2:0/3678222018 shutdown_connections 2024-09-17T01:10:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.875+0000 7f06c30e0640 1 --2- 172.21.15.2:0/3678222018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06bc0fb4d0 0x7f06bc0fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.875+0000 7f06c30e0640 1 --2- 172.21.15.2:0/3678222018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06bc101510 0x7f06bc1018e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.875+0000 7f06c30e0640 1 -- 172.21.15.2:0/3678222018 >> 172.21.15.2:0/3678222018 conn(0x7f06bc0f7090 msgr2=0x7f06bc0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.876+0000 7f06c30e0640 1 -- 172.21.15.2:0/3678222018 shutdown_connections 2024-09-17T01:10:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.876+0000 7f06c30e0640 1 -- 172.21.15.2:0/3678222018 wait complete. 2024-09-17T01:10:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.876+0000 7f06c30e0640 1 Processor -- start 2024-09-17T01:10:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.876+0000 7f06c30e0640 1 -- start start 2024-09-17T01:10:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.876+0000 7f06c30e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06bc0fb4d0 0x7f06bc113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.876+0000 7f06c30e0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06bc101510 0x7f06bc1136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.876+0000 7f06c30e0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc113ca0 con 0x7f06bc0fb4d0 2024-09-17T01:10:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.876+0000 7f06c30e0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc113e10 con 0x7f06bc101510 2024-09-17T01:10:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.877+0000 7f06c0e7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06bc0fb4d0 0x7f06bc113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.877+0000 7f06c0e7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06bc0fb4d0 0x7f06bc113160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53170/0 (socket says 172.21.15.2:53170) 2024-09-17T01:10:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.877+0000 7f06c0e7c640 1 -- 172.21.15.2:0/272656566 learned_addr learned my addr 172.21.15.2:0/272656566 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:10:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.877+0000 7f06bbfff640 1 --2- 172.21.15.2:0/272656566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06bc101510 0x7f06bc1136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.877+0000 7f06c0e7c640 1 -- 172.21.15.2:0/272656566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06bc101510 msgr2=0x7f06bc1136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.877+0000 7f06c0e7c640 1 --2- 172.21.15.2:0/272656566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06bc101510 0x7f06bc1136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.877+0000 7f06c0e7c640 1 -- 172.21.15.2:0/272656566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac005040 con 0x7f06bc0fb4d0 2024-09-17T01:10:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.877+0000 7f06bbfff640 1 --2- 172.21.15.2:0/272656566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06bc101510 0x7f06bc1136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:10:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.877+0000 7f06c0e7c640 1 --2- 172.21.15.2:0/272656566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06bc0fb4d0 0x7f06bc113160 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f06ac003080 tx=0x7f06ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.877+0000 7f06b97fa640 1 -- 172.21.15.2:0/272656566 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06ac038070 con 0x7f06bc0fb4d0 2024-09-17T01:10:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.877+0000 7f06c30e0640 1 -- 172.21.15.2:0/272656566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06bc10d230 con 0x7f06bc0fb4d0 2024-09-17T01:10:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.877+0000 7f06b97fa640 1 -- 172.21.15.2:0/272656566 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f06ac02ade0 con 0x7f06bc0fb4d0 2024-09-17T01:10:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.877+0000 7f06b97fa640 1 -- 172.21.15.2:0/272656566 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06ac02c880 con 0x7f06bc0fb4d0 2024-09-17T01:10:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.877+0000 7f06c30e0640 1 -- 172.21.15.2:0/272656566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06bc10d710 con 0x7f06bc0fb4d0 2024-09-17T01:10:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.879+0000 7f06c30e0640 1 -- 172.21.15.2:0/272656566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06bc0fcc10 con 0x7f06bc0fb4d0 2024-09-17T01:10:35.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.879+0000 7f06b97fa640 1 -- 172.21.15.2:0/272656566 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f06ac030020 con 0x7f06bc0fb4d0 2024-09-17T01:10:35.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.879+0000 7f06b97fa640 1 --2- 172.21.15.2:0/272656566 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f06a406e530 0x7f06a40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:35.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.879+0000 7f06b97fa640 1 -- 172.21.15.2:0/272656566 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f06ac0ae370 con 0x7f06bc0fb4d0 2024-09-17T01:10:35.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.879+0000 7f06bbfff640 1 --2- 172.21.15.2:0/272656566 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f06a406e530 0x7f06a40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:35.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.880+0000 7f06bbfff640 1 --2- 172.21.15.2:0/272656566 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f06a406e530 0x7f06a40709e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f06bc10ea60 tx=0x7f06b0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:35.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:35.884+0000 7f06b97fa640 1 -- 172.21.15.2:0/272656566 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f06ac077330 con 0x7f06bc0fb4d0 2024-09-17T01:10:36.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.078+0000 7f06c30e0640 1 -- 172.21.15.2:0/272656566 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f06bc10e810 con 0x7f06a406e530 2024-09-17T01:10:36.075 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:36 smithi002 ceph-mon[98018]: from='client.44353 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:36.076 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:36 smithi002 ceph-mon[98018]: Upgrade: Updating mds.cephfs.smithi099.heckcd 2024-09-17T01:10:36.076 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:36 smithi002 ceph-mon[98018]: Deploying daemon mds.cephfs.smithi099.heckcd on smithi099 2024-09-17T01:10:36.076 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:36 smithi002 ceph-mon[98018]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:36.076 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:36 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3180272280' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.076 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:36 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/441188852' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:10:36.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.079+0000 7f06b97fa640 1 -- 172.21.15.2:0/272656566 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f06bc10e810 con 0x7f06a406e530 2024-09-17T01:10:36.076 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:10:36.077 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3", 2024-09-17T01:10:36.077 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2024-09-17T01:10:36.077 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:10:36.077 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2024-09-17T01:10:36.077 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2024-09-17T01:10:36.077 INFO:teuthology.orchestra.run.smithi002.stdout: "mon", 2024-09-17T01:10:36.077 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-09-17T01:10:36.077 INFO:teuthology.orchestra.run.smithi002.stdout: "osd" 2024-09-17T01:10:36.077 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-17T01:10:36.077 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "15/21 daemons upgraded", 2024-09-17T01:10:36.077 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T01:10:36.077 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:10:36.077 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:10:36.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.081+0000 7f06c30e0640 1 -- 172.21.15.2:0/272656566 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f06a406e530 msgr2=0x7f06a40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.081+0000 7f06c30e0640 1 --2- 172.21.15.2:0/272656566 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f06a406e530 0x7f06a40709e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f06bc10ea60 tx=0x7f06b0009040 comp rx=0 tx=0).stop 2024-09-17T01:10:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.081+0000 7f06c30e0640 1 -- 172.21.15.2:0/272656566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06bc0fb4d0 msgr2=0x7f06bc113160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.081+0000 7f06c30e0640 1 --2- 172.21.15.2:0/272656566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06bc0fb4d0 0x7f06bc113160 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f06ac003080 tx=0x7f06ac009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.081+0000 7f06c30e0640 1 -- 172.21.15.2:0/272656566 shutdown_connections 2024-09-17T01:10:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.081+0000 7f06c30e0640 1 --2- 172.21.15.2:0/272656566 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f06a406e530 0x7f06a40709e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.081+0000 7f06c30e0640 1 --2- 172.21.15.2:0/272656566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06bc101510 0x7f06bc1136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.081+0000 7f06c30e0640 1 --2- 172.21.15.2:0/272656566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06bc0fb4d0 0x7f06bc113160 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.081+0000 7f06c30e0640 1 -- 172.21.15.2:0/272656566 >> 172.21.15.2:0/272656566 conn(0x7f06bc0f7090 msgr2=0x7f06bc0659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.081+0000 7f06c30e0640 1 -- 172.21.15.2:0/272656566 shutdown_connections 2024-09-17T01:10:36.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.081+0000 7f06c30e0640 1 -- 172.21.15.2:0/272656566 wait complete. 2024-09-17T01:10:36.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.162+0000 7fc3a2789640 1 -- 172.21.15.2:0/282379772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c1014c0 msgr2=0x7fc39c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:36.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.162+0000 7fc3a2789640 1 --2- 172.21.15.2:0/282379772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c1014c0 0x7fc39c101890 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc38c0048d0 tx=0x7fc38c009da0 comp rx=0 tx=0).stop 2024-09-17T01:10:36.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.162+0000 7fc3a2789640 1 -- 172.21.15.2:0/282379772 shutdown_connections 2024-09-17T01:10:36.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.162+0000 7fc3a2789640 1 --2- 172.21.15.2:0/282379772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc39c0fb480 0x7fc39c0fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:36.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.162+0000 7fc3a2789640 1 --2- 172.21.15.2:0/282379772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c1014c0 0x7fc39c101890 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:36.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.162+0000 7fc3a2789640 1 -- 172.21.15.2:0/282379772 >> 172.21.15.2:0/282379772 conn(0x7fc39c0f7020 msgr2=0x7fc39c0f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:36.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.162+0000 7fc3a2789640 1 -- 172.21.15.2:0/282379772 shutdown_connections 2024-09-17T01:10:36.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.163+0000 7fc3a2789640 1 -- 172.21.15.2:0/282379772 wait complete. 2024-09-17T01:10:36.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.163+0000 7fc3a2789640 1 Processor -- start 2024-09-17T01:10:36.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.163+0000 7fc3a2789640 1 -- start start 2024-09-17T01:10:36.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.163+0000 7fc3a2789640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc39c0fb480 0x7fc39c10e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:36.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.163+0000 7fc3a2789640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c1014c0 0x7fc39c10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:36.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.163+0000 7fc3a2789640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c10ed20 con 0x7fc39c1014c0 2024-09-17T01:10:36.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.163+0000 7fc3a2789640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c10ee90 con 0x7fc39c0fb480 2024-09-17T01:10:36.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.164+0000 7fc39b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c1014c0 0x7fc39c10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:36.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.164+0000 7fc39b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c1014c0 0x7fc39c10e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53184/0 (socket says 172.21.15.2:53184) 2024-09-17T01:10:36.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.164+0000 7fc39b7fe640 1 -- 172.21.15.2:0/3871853160 learned_addr learned my addr 172.21.15.2:0/3871853160 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:10:36.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.164+0000 7fc39bfff640 1 --2- 172.21.15.2:0/3871853160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc39c0fb480 0x7fc39c10e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:36.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.164+0000 7fc39b7fe640 1 -- 172.21.15.2:0/3871853160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc39c0fb480 msgr2=0x7fc39c10e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:36.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.164+0000 7fc39b7fe640 1 --2- 172.21.15.2:0/3871853160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc39c0fb480 0x7fc39c10e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:36.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.164+0000 7fc39b7fe640 1 -- 172.21.15.2:0/3871853160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c005040 con 0x7fc39c1014c0 2024-09-17T01:10:36.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.164+0000 7fc39bfff640 1 --2- 172.21.15.2:0/3871853160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc39c0fb480 0x7fc39c10e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:10:36.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.164+0000 7fc39b7fe640 1 --2- 172.21.15.2:0/3871853160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c1014c0 0x7fc39c10e6d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc39000eb70 tx=0x7fc39000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:36.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.164+0000 7fc398ff9640 1 -- 172.21.15.2:0/3871853160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc390007c30 con 0x7fc39c1014c0 2024-09-17T01:10:36.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.164+0000 7fc398ff9640 1 -- 172.21.15.2:0/3871853160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc39000f040 con 0x7fc39c1014c0 2024-09-17T01:10:36.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.164+0000 7fc398ff9640 1 -- 172.21.15.2:0/3871853160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc390009470 con 0x7fc39c1014c0 2024-09-17T01:10:36.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.164+0000 7fc3a2789640 1 -- 172.21.15.2:0/3871853160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c117200 con 0x7fc39c1014c0 2024-09-17T01:10:36.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.164+0000 7fc3a2789640 1 -- 172.21.15.2:0/3871853160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c1176c0 con 0x7fc39c1014c0 2024-09-17T01:10:36.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.166+0000 7fc3a2789640 1 -- 172.21.15.2:0/3871853160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39c0fcbc0 con 0x7fc39c1014c0 2024-09-17T01:10:36.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.166+0000 7fc398ff9640 1 -- 172.21.15.2:0/3871853160 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fc3900095d0 con 0x7fc39c1014c0 2024-09-17T01:10:36.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.167+0000 7fc398ff9640 1 --2- 172.21.15.2:0/3871853160 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc38406e530 0x7fc3840709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:10:36.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.167+0000 7fc398ff9640 1 -- 172.21.15.2:0/3871853160 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fc39008dd90 con 0x7fc39c1014c0 2024-09-17T01:10:36.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.167+0000 7fc39bfff640 1 --2- 172.21.15.2:0/3871853160 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc38406e530 0x7fc3840709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:10:36.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.167+0000 7fc39bfff640 1 --2- 172.21.15.2:0/3871853160 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc38406e530 0x7fc3840709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009ac0 tx=0x7fc38c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:10:36.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.171+0000 7fc398ff9640 1 -- 172.21.15.2:0/3871853160 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc390056e80 con 0x7fc39c1014c0 2024-09-17T01:10:36.286 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:36 smithi099 ceph-mon[77412]: from='client.44353 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:36.286 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:36 smithi099 ceph-mon[77412]: Upgrade: Updating mds.cephfs.smithi099.heckcd 2024-09-17T01:10:36.286 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:36 smithi099 ceph-mon[77412]: Deploying daemon mds.cephfs.smithi099.heckcd on smithi099 2024-09-17T01:10:36.287 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:36 smithi099 ceph-mon[77412]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:36.287 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:36 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3180272280' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:36.287 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:36 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/441188852' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:10:36.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.418+0000 7fc3a2789640 1 -- 172.21.15.2:0/3871853160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc39c0fac40 con 0x7fc39c1014c0 2024-09-17T01:10:36.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.418+0000 7fc398ff9640 1 -- 172.21.15.2:0/3871853160 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7fc39005a540 con 0x7fc39c1014c0 2024-09-17T01:10:36.416 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-17T01:10:36.416 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-17T01:10:36.416 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs is degraded 2024-09-17T01:10:36.416 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:10:36.416 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:10:36.416 INFO:teuthology.orchestra.run.smithi002.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-17T01:10:36.416 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-17T01:10:36.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.420+0000 7fc3a2789640 1 -- 172.21.15.2:0/3871853160 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc38406e530 msgr2=0x7fc3840709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:36.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.420+0000 7fc3a2789640 1 --2- 172.21.15.2:0/3871853160 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc38406e530 0x7fc3840709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009ac0 tx=0x7fc38c035040 comp rx=0 tx=0).stop 2024-09-17T01:10:36.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.420+0000 7fc3a2789640 1 -- 172.21.15.2:0/3871853160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c1014c0 msgr2=0x7fc39c10e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:10:36.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.420+0000 7fc3a2789640 1 --2- 172.21.15.2:0/3871853160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c1014c0 0x7fc39c10e6d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc39000eb70 tx=0x7fc39000b040 comp rx=0 tx=0).stop 2024-09-17T01:10:36.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.420+0000 7fc3a2789640 1 -- 172.21.15.2:0/3871853160 shutdown_connections 2024-09-17T01:10:36.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.420+0000 7fc3a2789640 1 --2- 172.21.15.2:0/3871853160 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc38406e530 0x7fc3840709e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:36.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.420+0000 7fc3a2789640 1 --2- 172.21.15.2:0/3871853160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc39c1014c0 0x7fc39c10e6d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:36.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.420+0000 7fc3a2789640 1 --2- 172.21.15.2:0/3871853160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc39c0fb480 0x7fc39c10e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:10:36.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.420+0000 7fc3a2789640 1 -- 172.21.15.2:0/3871853160 >> 172.21.15.2:0/3871853160 conn(0x7fc39c0f7020 msgr2=0x7fc39c0f88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:10:36.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.420+0000 7fc3a2789640 1 -- 172.21.15.2:0/3871853160 shutdown_connections 2024-09-17T01:10:36.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:10:36.420+0000 7fc3a2789640 1 -- 172.21.15.2:0/3871853160 wait complete. 2024-09-17T01:10:37.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:37 smithi099 ceph-mon[77412]: pgmap v205: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:37.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:37 smithi099 ceph-mon[77412]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:37.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:37 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3871853160' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:10:37.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:37 smithi002 ceph-mon[98018]: pgmap v205: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:37.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:37 smithi002 ceph-mon[98018]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:37.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:37 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3871853160' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:10:38.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:38 smithi099 ceph-mon[77412]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:38.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:38 smithi099 ceph-mon[77412]: osdmap e95: 6 total, 6 up, 6 in 2024-09-17T01:10:38.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:38 smithi099 ceph-mon[77412]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-17T01:10:38.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:38 smithi002 ceph-mon[98018]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:10:38.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:38 smithi002 ceph-mon[98018]: osdmap e95: 6 total, 6 up, 6 in 2024-09-17T01:10:38.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:38 smithi002 ceph-mon[98018]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-17T01:10:39.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:39 smithi099 ceph-mon[77412]: pgmap v207: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:39.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:39 smithi002 ceph-mon[98018]: pgmap v207: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:40.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:40 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T01:10:40.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:40 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T01:10:41.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:41 smithi099 ceph-mon[77412]: pgmap v208: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:41.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:41 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:41.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:41 smithi002 ceph-mon[98018]: pgmap v208: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:41.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:41 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:43.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:43 smithi099 ceph-mon[77412]: pgmap v209: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:43.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:43.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:43.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:43 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:43 smithi002 ceph-mon[98018]: pgmap v209: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:43 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:44.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:44 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.99:6826/4220578351,v1:172.21.15.99:6827/4220578351] up:boot 2024-09-17T01:10:44.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:44 smithi002 ceph-mon[98018]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-17T01:10:44.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:44 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T01:10:44.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:44 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.99:6826/4220578351,v1:172.21.15.99:6827/4220578351] up:boot 2024-09-17T01:10:44.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:44 smithi099 ceph-mon[77412]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-17T01:10:44.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:44 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T01:10:45.316 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:45 smithi099 ceph-mon[77412]: pgmap v210: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:45.316 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:45.317 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:45.317 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:45.317 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:45 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:45.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:45 smithi002 ceph-mon[98018]: pgmap v210: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:45.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:45.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:45.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:45.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:45 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:46.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:46 smithi099 ceph-mon[77412]: pgmap v211: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:46.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:46 smithi002 ceph-mon[98018]: pgmap v211: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:48.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:48 smithi099 ceph-mon[77412]: pgmap v212: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:48.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:48 smithi002 ceph-mon[98018]: pgmap v212: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:49.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:49.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:49.793 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:49.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:49.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:49.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:49.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:49.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:49.794 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:49.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:49.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:49.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: Upgrade: Setting container_image for all mds 2024-09-17T01:10:49.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:49.795 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.fmyyzz"}]: dispatch 2024-09-17T01:10:49.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.fmyyzz"}]': finished 2024-09-17T01:10:49.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T01:10:49.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.zmrgxd"}]': finished 2024-09-17T01:10:49.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T01:10:49.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.heckcd"}]': finished 2024-09-17T01:10:49.796 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.hgawhu"}]: dispatch 2024-09-17T01:10:49.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.hgawhu"}]': finished 2024-09-17T01:10:49.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: Upgrade: Setting filesystem cephfs Joinable 2024-09-17T01:10:49.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:49 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-17T01:10:49.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:49.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:49.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:49.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:49.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:49.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:49.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:49.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:49.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:49.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:49.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:49.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: Upgrade: Setting container_image for all mds 2024-09-17T01:10:49.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:49.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.fmyyzz"}]: dispatch 2024-09-17T01:10:49.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.fmyyzz"}]': finished 2024-09-17T01:10:49.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.zmrgxd"}]: dispatch 2024-09-17T01:10:49.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi002.zmrgxd"}]': finished 2024-09-17T01:10:49.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.heckcd"}]: dispatch 2024-09-17T01:10:49.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.heckcd"}]': finished 2024-09-17T01:10:49.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.hgawhu"}]: dispatch 2024-09-17T01:10:49.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.hgawhu"}]': finished 2024-09-17T01:10:49.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: Upgrade: Setting filesystem cephfs Joinable 2024-09-17T01:10:49.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:49 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-17T01:10:50.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:50 smithi002 ceph-mon[98018]: pgmap v213: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:50.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:50 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-17T01:10:50.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:50 smithi002 ceph-mon[98018]: Standby daemon mds.cephfs.smithi002.zmrgxd assigned to filesystem cephfs as rank 0 2024-09-17T01:10:50.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:50 smithi002 ceph-mon[98018]: Standby daemon mds.cephfs.smithi002.fmyyzz assigned to filesystem cephfs as rank 1 2024-09-17T01:10:50.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:50 smithi002 ceph-mon[98018]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:10:50.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:50 smithi002 ceph-mon[98018]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-17T01:10:50.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:50 smithi002 ceph-mon[98018]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-17T01:10:50.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:50 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-17T01:10:50.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:50 smithi002 ceph-mon[98018]: fsmap cephfs:2/2 {0=cephfs.smithi002.zmrgxd=up:replay,1=cephfs.smithi002.fmyyzz=up:replay} 2 up:standby 2024-09-17T01:10:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:50 smithi099 ceph-mon[77412]: pgmap v213: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:10:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:50 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-17T01:10:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:50 smithi099 ceph-mon[77412]: Standby daemon mds.cephfs.smithi002.zmrgxd assigned to filesystem cephfs as rank 0 2024-09-17T01:10:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:50 smithi099 ceph-mon[77412]: Standby daemon mds.cephfs.smithi002.fmyyzz assigned to filesystem cephfs as rank 1 2024-09-17T01:10:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:50 smithi099 ceph-mon[77412]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:10:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:50 smithi099 ceph-mon[77412]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-17T01:10:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:50 smithi099 ceph-mon[77412]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-17T01:10:51.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:50 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-17T01:10:51.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:50 smithi099 ceph-mon[77412]: fsmap cephfs:2/2 {0=cephfs.smithi002.zmrgxd=up:replay,1=cephfs.smithi002.fmyyzz=up:replay} 2 up:standby 2024-09-17T01:10:51.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-17T01:10:51.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: fsmap cephfs:2/2 {0=cephfs.smithi002.zmrgxd=up:replay,1=cephfs.smithi002.fmyyzz=up:replay} 2 up:standby 2024-09-17T01:10:51.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:51.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:51.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: Upgrade: Setting container_image for all rgw 2024-09-17T01:10:51.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:51.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:51.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T01:10:51.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:51.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:51.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:51.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T01:10:51.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:51.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:51.906 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: Upgrade: Setting container_image for all iscsi 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: Upgrade: Setting container_image for all nfs 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: Upgrade: Setting container_image for all nvmeof 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: Upgrade: Finalizing container_image settings 2024-09-17T01:10:51.907 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-17T01:10:51.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-17T01:10:51.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:51.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-17T01:10:51.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-17T01:10:51.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-17T01:10:51.908 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-17T01:10:51.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-17T01:10:51.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-17T01:10:51.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-17T01:10:51.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-17T01:10:51.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-17T01:10:51.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-17T01:10:51.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-17T01:10:51.909 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:51.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-17T01:10:51.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-17T01:10:51.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-17T01:10:51.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-17T01:10:51.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-17T01:10:51.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-17T01:10:51.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-17T01:10:51.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-17T01:10:51.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:51.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:51.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:51.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:51.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:51.910 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:51.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: Upgrade: Complete! 2024-09-17T01:10:51.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-17T01:10:51.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-17T01:10:51.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:51.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:51.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:51.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:51.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:51.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:51.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:51.911 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:52.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-17T01:10:52.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: fsmap cephfs:2/2 {0=cephfs.smithi002.zmrgxd=up:replay,1=cephfs.smithi002.fmyyzz=up:replay} 2 up:standby 2024-09-17T01:10:52.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:52.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:52.044 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: Upgrade: Setting container_image for all rgw 2024-09-17T01:10:52.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:52.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:52.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T01:10:52.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:52.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:52.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:52.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T01:10:52.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:52.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:52.046 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: Upgrade: Setting container_image for all iscsi 2024-09-17T01:10:52.046 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:52.046 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:52.046 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: Upgrade: Setting container_image for all nfs 2024-09-17T01:10:52.046 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:52.046 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:52.046 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: Upgrade: Setting container_image for all nvmeof 2024-09-17T01:10:52.046 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:52.047 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:52.047 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:52.047 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:52.047 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:52.047 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:52.047 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:10:52.047 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: Upgrade: Finalizing container_image settings 2024-09-17T01:10:52.047 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-17T01:10:52.047 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-17T01:10:52.048 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:52.048 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-17T01:10:52.048 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-17T01:10:52.048 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-17T01:10:52.048 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-17T01:10:52.048 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-17T01:10:52.048 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-17T01:10:52.049 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-17T01:10:52.049 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-17T01:10:52.049 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-17T01:10:52.049 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-17T01:10:52.049 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-17T01:10:52.050 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:52.050 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-17T01:10:52.050 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-17T01:10:52.050 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-17T01:10:52.050 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-17T01:10:52.050 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-17T01:10:52.050 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-17T01:10:52.050 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-17T01:10:52.051 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-17T01:10:52.051 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:52.051 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:52.051 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:52.051 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:52.051 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:52.051 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-17T01:10:52.051 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: Upgrade: Complete! 2024-09-17T01:10:52.051 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-17T01:10:52.052 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-17T01:10:52.052 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:52.052 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:52.052 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:52.052 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:52.052 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:10:52.052 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:10:52.052 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:10:52.052 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:53.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:52 smithi002 ceph-mon[98018]: pgmap v214: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 0 op/s 2024-09-17T01:10:53.211 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:52 smithi099 ceph-mon[77412]: pgmap v214: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 0 op/s 2024-09-17T01:10:55.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:54 smithi002 ceph-mon[98018]: pgmap v215: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 6 op/s 2024-09-17T01:10:55.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:54 smithi099 ceph-mon[77412]: pgmap v215: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 6 op/s 2024-09-17T01:10:56.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:55 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.2:6828/2400957585,v1:172.21.15.2:6829/2400957585] up:resolve 2024-09-17T01:10:56.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:55 smithi002 ceph-mon[98018]: fsmap cephfs:2/2 {0=cephfs.smithi002.zmrgxd=up:replay,1=cephfs.smithi002.fmyyzz=up:resolve} 2 up:standby 2024-09-17T01:10:56.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:56.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:56.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:56.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:55 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.2:6828/2400957585,v1:172.21.15.2:6829/2400957585] up:resolve 2024-09-17T01:10:56.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:55 smithi099 ceph-mon[77412]: fsmap cephfs:2/2 {0=cephfs.smithi002.zmrgxd=up:replay,1=cephfs.smithi002.fmyyzz=up:resolve} 2 up:standby 2024-09-17T01:10:56.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:56.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:10:56.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:10:57.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:56 smithi002 ceph-mon[98018]: pgmap v216: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 6 op/s 2024-09-17T01:10:57.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:56 smithi099 ceph-mon[77412]: pgmap v216: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 6 op/s 2024-09-17T01:10:59.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:58 smithi002 ceph-mon[98018]: pgmap v217: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-09-17T01:10:59.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:58 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.2:6826/2424122669,v1:172.21.15.2:6827/2424122669] up:resolve 2024-09-17T01:10:59.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:58 smithi002 ceph-mon[98018]: fsmap cephfs:2/2 {0=cephfs.smithi002.zmrgxd=up:resolve,1=cephfs.smithi002.fmyyzz=up:resolve} 2 up:standby 2024-09-17T01:10:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:58 smithi099 ceph-mon[77412]: pgmap v217: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-09-17T01:10:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:58 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.2:6826/2424122669,v1:172.21.15.2:6827/2424122669] up:resolve 2024-09-17T01:10:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:58 smithi099 ceph-mon[77412]: fsmap cephfs:2/2 {0=cephfs.smithi002.zmrgxd=up:resolve,1=cephfs.smithi002.fmyyzz=up:resolve} 2 up:standby 2024-09-17T01:11:00.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:59 smithi002 ceph-mon[98018]: reconnect by client.24303 v1:172.21.15.2:0/3269658118 after 0.000999977 2024-09-17T01:11:00.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:59 smithi002 ceph-mon[98018]: reconnect by client.24303 v1:172.21.15.2:0/3269658118 after 0.000999977 2024-09-17T01:11:00.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:59 smithi002 ceph-mon[98018]: reconnect by client.14500 v1:172.21.15.99:0/839646600 after 0.000999977 2024-09-17T01:11:00.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:59 smithi002 ceph-mon[98018]: reconnect by client.14500 v1:172.21.15.99:0/839646600 after 0.000999977 2024-09-17T01:11:00.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:59 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.2:6828/2400957585,v1:172.21.15.2:6829/2400957585] up:reconnect 2024-09-17T01:11:00.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:59 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.2:6826/2424122669,v1:172.21.15.2:6827/2424122669] up:reconnect 2024-09-17T01:11:00.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:59 smithi002 ceph-mon[98018]: fsmap cephfs:2/2 {0=cephfs.smithi002.zmrgxd=up:reconnect,1=cephfs.smithi002.fmyyzz=up:reconnect} 2 up:standby 2024-09-17T01:11:00.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:59 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.2:6828/2400957585,v1:172.21.15.2:6829/2400957585] up:rejoin 2024-09-17T01:11:00.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:59 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.2:6826/2424122669,v1:172.21.15.2:6827/2424122669] up:rejoin 2024-09-17T01:11:00.156 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:10:59 smithi002 ceph-mon[98018]: fsmap cephfs:2/2 {0=cephfs.smithi002.zmrgxd=up:rejoin,1=cephfs.smithi002.fmyyzz=up:rejoin} 2 up:standby 2024-09-17T01:11:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:59 smithi099 ceph-mon[77412]: reconnect by client.24303 v1:172.21.15.2:0/3269658118 after 0.000999977 2024-09-17T01:11:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:59 smithi099 ceph-mon[77412]: reconnect by client.24303 v1:172.21.15.2:0/3269658118 after 0.000999977 2024-09-17T01:11:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:59 smithi099 ceph-mon[77412]: reconnect by client.14500 v1:172.21.15.99:0/839646600 after 0.000999977 2024-09-17T01:11:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:59 smithi099 ceph-mon[77412]: reconnect by client.14500 v1:172.21.15.99:0/839646600 after 0.000999977 2024-09-17T01:11:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:59 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.2:6828/2400957585,v1:172.21.15.2:6829/2400957585] up:reconnect 2024-09-17T01:11:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:59 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.2:6826/2424122669,v1:172.21.15.2:6827/2424122669] up:reconnect 2024-09-17T01:11:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:59 smithi099 ceph-mon[77412]: fsmap cephfs:2/2 {0=cephfs.smithi002.zmrgxd=up:reconnect,1=cephfs.smithi002.fmyyzz=up:reconnect} 2 up:standby 2024-09-17T01:11:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:59 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.2:6828/2400957585,v1:172.21.15.2:6829/2400957585] up:rejoin 2024-09-17T01:11:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:59 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.2:6826/2424122669,v1:172.21.15.2:6827/2424122669] up:rejoin 2024-09-17T01:11:00.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:10:59 smithi099 ceph-mon[77412]: fsmap cephfs:2/2 {0=cephfs.smithi002.zmrgxd=up:rejoin,1=cephfs.smithi002.fmyyzz=up:rejoin} 2 up:standby 2024-09-17T01:11:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:00 smithi002 ceph-mon[98018]: pgmap v218: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8 op/s 2024-09-17T01:11:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:00 smithi002 ceph-mon[98018]: daemon mds.cephfs.smithi002.fmyyzz is now active in filesystem cephfs as rank 1 2024-09-17T01:11:01.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:00 smithi002 ceph-mon[98018]: daemon mds.cephfs.smithi002.zmrgxd is now active in filesystem cephfs as rank 0 2024-09-17T01:11:01.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:00 smithi099 ceph-mon[77412]: pgmap v218: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8 op/s 2024-09-17T01:11:01.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:00 smithi099 ceph-mon[77412]: daemon mds.cephfs.smithi002.fmyyzz is now active in filesystem cephfs as rank 1 2024-09-17T01:11:01.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:00 smithi099 ceph-mon[77412]: daemon mds.cephfs.smithi002.zmrgxd is now active in filesystem cephfs as rank 0 2024-09-17T01:11:02.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:01 smithi002 ceph-mon[98018]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:11:02.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:01 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.2:6828/2400957585,v1:172.21.15.2:6829/2400957585] up:active 2024-09-17T01:11:02.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:01 smithi002 ceph-mon[98018]: mds.? [v2:172.21.15.2:6826/2424122669,v1:172.21.15.2:6827/2424122669] up:active 2024-09-17T01:11:02.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:01 smithi002 ceph-mon[98018]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi002.fmyyzz=up:active} 2 up:standby 2024-09-17T01:11:02.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:01 smithi002 ceph-mon[98018]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi002.fmyyzz=up:active} 2 up:standby-replay 2024-09-17T01:11:02.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:01 smithi099 ceph-mon[77412]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:11:02.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:01 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.2:6828/2400957585,v1:172.21.15.2:6829/2400957585] up:active 2024-09-17T01:11:02.297 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:01 smithi099 ceph-mon[77412]: mds.? [v2:172.21.15.2:6826/2424122669,v1:172.21.15.2:6827/2424122669] up:active 2024-09-17T01:11:02.297 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:01 smithi099 ceph-mon[77412]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi002.fmyyzz=up:active} 2 up:standby 2024-09-17T01:11:02.297 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:01 smithi099 ceph-mon[77412]: fsmap cephfs:2 {0=cephfs.smithi002.zmrgxd=up:active,1=cephfs.smithi002.fmyyzz=up:active} 2 up:standby-replay 2024-09-17T01:11:03.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:02 smithi002 ceph-mon[98018]: pgmap v219: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 85 B/s wr, 8 op/s 2024-09-17T01:11:03.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:02 smithi099 ceph-mon[77412]: pgmap v219: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 85 B/s wr, 8 op/s 2024-09-17T01:11:05.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:04 smithi002 ceph-mon[98018]: pgmap v220: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35 MiB/s rd, 341 B/s wr, 15 op/s 2024-09-17T01:11:05.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:04 smithi099 ceph-mon[77412]: pgmap v220: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35 MiB/s rd, 341 B/s wr, 15 op/s 2024-09-17T01:11:06.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.514+0000 7fd4754e7640 1 -- 172.21.15.2:0/1592156559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4700fd5b0 msgr2=0x7fd4700fd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:06.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.514+0000 7fd4754e7640 1 --2- 172.21.15.2:0/1592156559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4700fd5b0 0x7fd4700fd980 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd460004900 tx=0x7fd460009da0 comp rx=0 tx=0).stop 2024-09-17T01:11:06.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.514+0000 7fd4754e7640 1 -- 172.21.15.2:0/1592156559 shutdown_connections 2024-09-17T01:11:06.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.514+0000 7fd4754e7640 1 --2- 172.21.15.2:0/1592156559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4700fdf50 0x7fd470106620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:06.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.514+0000 7fd4754e7640 1 --2- 172.21.15.2:0/1592156559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4700fd5b0 0x7fd4700fd980 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:06.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.514+0000 7fd4754e7640 1 -- 172.21.15.2:0/1592156559 >> 172.21.15.2:0/1592156559 conn(0x7fd4700f7090 msgr2=0x7fd4700f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:06.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.514+0000 7fd4754e7640 1 -- 172.21.15.2:0/1592156559 shutdown_connections 2024-09-17T01:11:06.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.514+0000 7fd4754e7640 1 -- 172.21.15.2:0/1592156559 wait complete. 2024-09-17T01:11:06.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.515+0000 7fd4754e7640 1 Processor -- start 2024-09-17T01:11:06.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.515+0000 7fd4754e7640 1 -- start start 2024-09-17T01:11:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.515+0000 7fd4754e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4700fd5b0 0x7fd470113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.515+0000 7fd4754e7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4700fdf50 0x7fd4701137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.515+0000 7fd4754e7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd470113db0 con 0x7fd4700fd5b0 2024-09-17T01:11:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.515+0000 7fd4754e7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47010d1f0 con 0x7fd4700fdf50 2024-09-17T01:11:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.516+0000 7fd46effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4700fd5b0 0x7fd470113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.516+0000 7fd46effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4700fd5b0 0x7fd470113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36114/0 (socket says 172.21.15.2:36114) 2024-09-17T01:11:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.516+0000 7fd46effd640 1 -- 172.21.15.2:0/2559966312 learned_addr learned my addr 172.21.15.2:0/2559966312 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:11:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.516+0000 7fd46e7fc640 1 --2- 172.21.15.2:0/2559966312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4700fdf50 0x7fd4701137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.516+0000 7fd46effd640 1 -- 172.21.15.2:0/2559966312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4700fdf50 msgr2=0x7fd4701137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.516+0000 7fd46effd640 1 --2- 172.21.15.2:0/2559966312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4700fdf50 0x7fd4701137b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.516+0000 7fd46effd640 1 -- 172.21.15.2:0/2559966312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460005040 con 0x7fd4700fd5b0 2024-09-17T01:11:06.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.516+0000 7fd46e7fc640 1 --2- 172.21.15.2:0/2559966312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4700fdf50 0x7fd4701137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:11:06.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.516+0000 7fd46effd640 1 --2- 172.21.15.2:0/2559966312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4700fd5b0 0x7fd470113270 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd460004960 tx=0x7fd460009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:06.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.516+0000 7fd4577fe640 1 -- 172.21.15.2:0/2559966312 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd460038070 con 0x7fd4700fd5b0 2024-09-17T01:11:06.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.516+0000 7fd4577fe640 1 -- 172.21.15.2:0/2559966312 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd46002cef0 con 0x7fd4700fd5b0 2024-09-17T01:11:06.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.516+0000 7fd4754e7640 1 -- 172.21.15.2:0/2559966312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47010d470 con 0x7fd4700fd5b0 2024-09-17T01:11:06.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.517+0000 7fd4577fe640 1 -- 172.21.15.2:0/2559966312 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd460009480 con 0x7fd4700fd5b0 2024-09-17T01:11:06.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.517+0000 7fd4754e7640 1 -- 172.21.15.2:0/2559966312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47010d930 con 0x7fd4700fd5b0 2024-09-17T01:11:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.518+0000 7fd4754e7640 1 -- 172.21.15.2:0/2559966312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4700662b0 con 0x7fd4700fd5b0 2024-09-17T01:11:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.518+0000 7fd4577fe640 1 -- 172.21.15.2:0/2559966312 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fd460030020 con 0x7fd4700fd5b0 2024-09-17T01:11:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.519+0000 7fd4577fe640 1 --2- 172.21.15.2:0/2559966312 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd45806e530 0x7fd4580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.519+0000 7fd4577fe640 1 -- 172.21.15.2:0/2559966312 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fd4600adf50 con 0x7fd4700fd5b0 2024-09-17T01:11:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.519+0000 7fd46e7fc640 1 --2- 172.21.15.2:0/2559966312 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd45806e530 0x7fd4580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:06.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.519+0000 7fd46e7fc640 1 --2- 172.21.15.2:0/2559966312 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd45806e530 0x7fd4580709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd464004fd0 tx=0x7fd46400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:06.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.524+0000 7fd4577fe640 1 -- 172.21.15.2:0/2559966312 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd4600e31b0 con 0x7fd4700fd5b0 2024-09-17T01:11:06.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.717+0000 7fd4754e7640 1 -- 172.21.15.2:0/2559966312 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd47004b720 con 0x7fd45806e530 2024-09-17T01:11:06.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.718+0000 7fd4577fe640 1 -- 172.21.15.2:0/2559966312 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fd47004b720 con 0x7fd45806e530 2024-09-17T01:11:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.720+0000 7fd4754e7640 1 -- 172.21.15.2:0/2559966312 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd45806e530 msgr2=0x7fd4580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.720+0000 7fd4754e7640 1 --2- 172.21.15.2:0/2559966312 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd45806e530 0x7fd4580709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd464004fd0 tx=0x7fd46400b040 comp rx=0 tx=0).stop 2024-09-17T01:11:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.720+0000 7fd4754e7640 1 -- 172.21.15.2:0/2559966312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4700fd5b0 msgr2=0x7fd470113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.720+0000 7fd4754e7640 1 --2- 172.21.15.2:0/2559966312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4700fd5b0 0x7fd470113270 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd460004960 tx=0x7fd460009da0 comp rx=0 tx=0).stop 2024-09-17T01:11:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.720+0000 7fd4754e7640 1 -- 172.21.15.2:0/2559966312 shutdown_connections 2024-09-17T01:11:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.720+0000 7fd4754e7640 1 --2- 172.21.15.2:0/2559966312 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd45806e530 0x7fd4580709e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.720+0000 7fd4754e7640 1 --2- 172.21.15.2:0/2559966312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4700fdf50 0x7fd4701137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.720+0000 7fd4754e7640 1 --2- 172.21.15.2:0/2559966312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4700fd5b0 0x7fd470113270 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.720+0000 7fd4754e7640 1 -- 172.21.15.2:0/2559966312 >> 172.21.15.2:0/2559966312 conn(0x7fd4700f7090 msgr2=0x7fd4700f8620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.720+0000 7fd4754e7640 1 -- 172.21.15.2:0/2559966312 shutdown_connections 2024-09-17T01:11:06.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:06.720+0000 7fd4754e7640 1 -- 172.21.15.2:0/2559966312 wait complete. 2024-09-17T01:11:07.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:06 smithi099 ceph-mon[77412]: pgmap v221: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 341 B/s wr, 9 op/s 2024-09-17T01:11:07.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:06 smithi002 ceph-mon[98018]: pgmap v221: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 341 B/s wr, 9 op/s 2024-09-17T01:11:07.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch ps' 2024-09-17T01:11:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:11:08.239 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:07 smithi002 ceph-mon[98018]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:08.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:07 smithi099 ceph-mon[77412]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:09.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:08 smithi002 ceph-mon[98018]: pgmap v222: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 4.2 KiB/s wr, 16 op/s 2024-09-17T01:11:09.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:08 smithi099 ceph-mon[77412]: pgmap v222: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 4.2 KiB/s wr, 16 op/s 2024-09-17T01:11:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.380+0000 7f1bcf48d640 1 -- 172.21.15.2:0/1963794871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc80fd570 msgr2=0x7f1bc80fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:09.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.380+0000 7f1bcf48d640 1 --2- 172.21.15.2:0/1963794871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc80fd570 0x7f1bc80fd940 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40048d0 tx=0x7f1bc4009da0 comp rx=0 tx=0).stop 2024-09-17T01:11:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.380+0000 7f1bcf48d640 1 -- 172.21.15.2:0/1963794871 shutdown_connections 2024-09-17T01:11:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.380+0000 7f1bcf48d640 1 --2- 172.21.15.2:0/1963794871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc80fdf10 0x7f1bc81065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.380+0000 7f1bcf48d640 1 --2- 172.21.15.2:0/1963794871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc80fd570 0x7f1bc80fd940 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.380+0000 7f1bcf48d640 1 -- 172.21.15.2:0/1963794871 >> 172.21.15.2:0/1963794871 conn(0x7f1bc80f7030 msgr2=0x7f1bc80f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:09.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.380+0000 7f1bcf48d640 1 -- 172.21.15.2:0/1963794871 shutdown_connections 2024-09-17T01:11:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.380+0000 7f1bcf48d640 1 -- 172.21.15.2:0/1963794871 wait complete. 2024-09-17T01:11:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.381+0000 7f1bcf48d640 1 Processor -- start 2024-09-17T01:11:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.381+0000 7f1bcf48d640 1 -- start start 2024-09-17T01:11:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.381+0000 7f1bcf48d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc80fd570 0x7f1bc81131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.381+0000 7f1bcf48d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc80fdf10 0x7f1bc8113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.381+0000 7f1bcf48d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc8113d10 con 0x7f1bc80fdf10 2024-09-17T01:11:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.381+0000 7f1bcf48d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc8113e80 con 0x7f1bc80fd570 2024-09-17T01:11:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.381+0000 7f1bcca28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc80fdf10 0x7f1bc8113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.381+0000 7f1bcca28640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc80fdf10 0x7f1bc8113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36132/0 (socket says 172.21.15.2:36132) 2024-09-17T01:11:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.381+0000 7f1bcca28640 1 -- 172.21.15.2:0/2061783476 learned_addr learned my addr 172.21.15.2:0/2061783476 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:11:09.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.381+0000 7f1bcd229640 1 --2- 172.21.15.2:0/2061783476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc80fd570 0x7f1bc81131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.382+0000 7f1bcca28640 1 -- 172.21.15.2:0/2061783476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc80fd570 msgr2=0x7f1bc81131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.382+0000 7f1bcca28640 1 --2- 172.21.15.2:0/2061783476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc80fd570 0x7f1bc81131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.382+0000 7f1bcca28640 1 -- 172.21.15.2:0/2061783476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc4005040 con 0x7f1bc80fdf10 2024-09-17T01:11:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.382+0000 7f1bcca28640 1 --2- 172.21.15.2:0/2061783476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc80fdf10 0x7f1bc8113710 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800c830 tx=0x7f1bb8004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.382+0000 7f1bbdffb640 1 -- 172.21.15.2:0/2061783476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bb800a7d0 con 0x7f1bc80fdf10 2024-09-17T01:11:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.382+0000 7f1bcf48d640 1 -- 172.21.15.2:0/2061783476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc810d300 con 0x7f1bc80fdf10 2024-09-17T01:11:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.382+0000 7f1bbdffb640 1 -- 172.21.15.2:0/2061783476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1bb800add0 con 0x7f1bc80fdf10 2024-09-17T01:11:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.382+0000 7f1bbdffb640 1 -- 172.21.15.2:0/2061783476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bb80113a0 con 0x7f1bc80fdf10 2024-09-17T01:11:09.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.382+0000 7f1bcf48d640 1 -- 172.21.15.2:0/2061783476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc810d820 con 0x7f1bc80fdf10 2024-09-17T01:11:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.383+0000 7f1bcf48d640 1 -- 172.21.15.2:0/2061783476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc8066050 con 0x7f1bc80fdf10 2024-09-17T01:11:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.384+0000 7f1bbdffb640 1 -- 172.21.15.2:0/2061783476 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f1bb8012400 con 0x7f1bc80fdf10 2024-09-17T01:11:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.384+0000 7f1bbdffb640 1 --2- 172.21.15.2:0/2061783476 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1bb406e530 0x7f1bb40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:09.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.384+0000 7f1bbdffb640 1 -- 172.21.15.2:0/2061783476 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f1bb808e450 con 0x7f1bc80fdf10 2024-09-17T01:11:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.384+0000 7f1bcd229640 1 --2- 172.21.15.2:0/2061783476 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1bb406e530 0x7f1bb40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:09.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.385+0000 7f1bcd229640 1 --2- 172.21.15.2:0/2061783476 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1bb406e530 0x7f1bb40709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009ac0 tx=0x7f1bc4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:09.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.389+0000 7f1bbdffb640 1 -- 172.21.15.2:0/2061783476 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1bb80573f0 con 0x7f1bc80fdf10 2024-09-17T01:11:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.571+0000 7f1bcf48d640 1 -- 172.21.15.2:0/2061783476 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bc81095c0 con 0x7f1bb406e530 2024-09-17T01:11:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.582+0000 7f1bbdffb640 1 -- 172.21.15.2:0/2061783476 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f1bc81095c0 con 0x7f1bb406e530 2024-09-17T01:11:09.580 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:11:09.581 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (8m) 55s ago 17m 25.5M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:11:09.581 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (4m) 55s ago 17m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de b7ed6c8d5a92 2024-09-17T01:11:09.581 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (4m) 25s ago 16m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de ae713b940078 2024-09-17T01:11:09.581 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (6m) 55s ago 16m 82.5M - 9.4.12 2bacad6d85d8 5fe408c103d6 2024-09-17T01:11:09.581 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (59s) 55s ago 11m 14.1M - 19.1.1-330-gc2ddf972 ebb0615149de 923cbcf82a29 2024-09-17T01:11:09.581 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (76s) 55s ago 11m 15.5M - 19.1.1-330-gc2ddf972 ebb0615149de 8862e6324ff5 2024-09-17T01:11:09.581 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (27s) 25s ago 11m 11.8M - 19.1.1-330-gc2ddf972 ebb0615149de f405ff311e0d 2024-09-17T01:11:09.581 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (43s) 25s ago 11m 13.2M - 19.1.1-330-gc2ddf972 ebb0615149de 222618d9f6fd 2024-09-17T01:11:09.581 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (7m) 55s ago 18m 504M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:11:09.581 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (7m) 25s ago 16m 442M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:11:09.581 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (5m) 55s ago 18m 49.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de da5247385c2d 2024-09-17T01:11:09.581 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (5m) 25s ago 16m 38.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b92f98b2cab9 2024-09-17T01:11:09.581 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (8m) 55s ago 17m 15.7M - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:11:09.582 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (7m) 25s ago 16m 15.4M - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:11:09.582 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (4m) 55s ago 15m 162M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 563188d6089b 2024-09-17T01:11:09.582 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (3m) 55s ago 14m 106M 1558M 19.1.1-330-gc2ddf972 ebb0615149de cc26caf558d7 2024-09-17T01:11:09.582 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (3m) 55s ago 14m 135M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 0aac20af5580 2024-09-17T01:11:09.582 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (2m) 25s ago 14m 137M 2581M 19.1.1-330-gc2ddf972 ebb0615149de 0740cf987fef 2024-09-17T01:11:09.582 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (2m) 25s ago 13m 96.9M 2581M 19.1.1-330-gc2ddf972 ebb0615149de df5b078898bb 2024-09-17T01:11:09.582 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (94s) 25s ago 13m 90.3M 2581M 19.1.1-330-gc2ddf972 ebb0615149de e26706fa8822 2024-09-17T01:11:09.582 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (7m) 55s ago 16m 66.2M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:11:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.585+0000 7f1bcf48d640 1 -- 172.21.15.2:0/2061783476 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1bb406e530 msgr2=0x7f1bb40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.585+0000 7f1bcf48d640 1 --2- 172.21.15.2:0/2061783476 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1bb406e530 0x7f1bb40709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009ac0 tx=0x7f1bc4035040 comp rx=0 tx=0).stop 2024-09-17T01:11:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.585+0000 7f1bcf48d640 1 -- 172.21.15.2:0/2061783476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc80fdf10 msgr2=0x7f1bc8113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.585+0000 7f1bcf48d640 1 --2- 172.21.15.2:0/2061783476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc80fdf10 0x7f1bc8113710 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800c830 tx=0x7f1bb8004430 comp rx=0 tx=0).stop 2024-09-17T01:11:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.585+0000 7f1bcf48d640 1 -- 172.21.15.2:0/2061783476 shutdown_connections 2024-09-17T01:11:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.585+0000 7f1bcf48d640 1 --2- 172.21.15.2:0/2061783476 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f1bb406e530 0x7f1bb40709e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:09.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.585+0000 7f1bcf48d640 1 --2- 172.21.15.2:0/2061783476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bc80fdf10 0x7f1bc8113710 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.585+0000 7f1bcf48d640 1 --2- 172.21.15.2:0/2061783476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc80fd570 0x7f1bc81131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.585+0000 7f1bcf48d640 1 -- 172.21.15.2:0/2061783476 >> 172.21.15.2:0/2061783476 conn(0x7f1bc80f7030 msgr2=0x7f1bc80f8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.585+0000 7f1bcf48d640 1 -- 172.21.15.2:0/2061783476 shutdown_connections 2024-09-17T01:11:09.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:09.585+0000 7f1bcf48d640 1 -- 172.21.15.2:0/2061783476 wait complete. 2024-09-17T01:11:10.268 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch upgrade status' 2024-09-17T01:11:10.529 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:11:11.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:10 smithi099 ceph-mon[77412]: pgmap v223: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 8.4 KiB/s wr, 18 op/s 2024-09-17T01:11:11.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:10 smithi099 ceph-mon[77412]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:11.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:10 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:11:11.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:10 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:11.325 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:10 smithi002 ceph-mon[98018]: pgmap v223: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 8.4 KiB/s wr, 18 op/s 2024-09-17T01:11:11.325 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:10 smithi002 ceph-mon[98018]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:11.326 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:10 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:11:11.326 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:10 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.124+0000 7fadf7de4640 1 -- 172.21.15.2:0/150599019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00fb7c0 msgr2=0x7fadf010cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.124+0000 7fadf7de4640 1 --2- 172.21.15.2:0/150599019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00fb7c0 0x7fadf010cbd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fade00048d0 tx=0x7fade0009da0 comp rx=0 tx=0).stop 2024-09-17T01:11:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.124+0000 7fadf7de4640 1 -- 172.21.15.2:0/150599019 shutdown_connections 2024-09-17T01:11:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.124+0000 7fadf7de4640 1 --2- 172.21.15.2:0/150599019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00fb7c0 0x7fadf010cbd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.125+0000 7fadf7de4640 1 --2- 172.21.15.2:0/150599019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf00faeb0 0x7fadf00fb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.125+0000 7fadf7de4640 1 -- 172.21.15.2:0/150599019 >> 172.21.15.2:0/150599019 conn(0x7fadf0070ce0 msgr2=0x7fadf00710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:12.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.125+0000 7fadf7de4640 1 -- 172.21.15.2:0/150599019 shutdown_connections 2024-09-17T01:11:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.125+0000 7fadf7de4640 1 -- 172.21.15.2:0/150599019 wait complete. 2024-09-17T01:11:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.125+0000 7fadf7de4640 1 Processor -- start 2024-09-17T01:11:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.125+0000 7fadf7de4640 1 -- start start 2024-09-17T01:11:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.125+0000 7fadf7de4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00faeb0 0x7fadf0119840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.125+0000 7fadf7de4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf00fb7c0 0x7fadf0119d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.125+0000 7fadf7de4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf011a3d0 con 0x7fadf00faeb0 2024-09-17T01:11:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.125+0000 7fadf7de4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf01137e0 con 0x7fadf00fb7c0 2024-09-17T01:11:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.125+0000 7fadf5b80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00faeb0 0x7fadf0119840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.126+0000 7fadf5b80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00faeb0 0x7fadf0119840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59128/0 (socket says 172.21.15.2:59128) 2024-09-17T01:11:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.126+0000 7fadf5b80640 1 -- 172.21.15.2:0/242685764 learned_addr learned my addr 172.21.15.2:0/242685764 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:11:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.126+0000 7fadf537f640 1 --2- 172.21.15.2:0/242685764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf00fb7c0 0x7fadf0119d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.126+0000 7fadf5b80640 1 -- 172.21.15.2:0/242685764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf00fb7c0 msgr2=0x7fadf0119d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:12.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.126+0000 7fadf5b80640 1 --2- 172.21.15.2:0/242685764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf00fb7c0 0x7fadf0119d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.126+0000 7fadf5b80640 1 -- 172.21.15.2:0/242685764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade0005040 con 0x7fadf00faeb0 2024-09-17T01:11:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.126+0000 7fadf5b80640 1 --2- 172.21.15.2:0/242685764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00faeb0 0x7fadf0119840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fadec002a80 tx=0x7fadec004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.126+0000 7fade67fc640 1 -- 172.21.15.2:0/242685764 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadec007c30 con 0x7fadf00faeb0 2024-09-17T01:11:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.126+0000 7fade67fc640 1 -- 172.21.15.2:0/242685764 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fadec00f040 con 0x7fadf00faeb0 2024-09-17T01:11:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.126+0000 7fadf7de4640 1 -- 172.21.15.2:0/242685764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf0113ac0 con 0x7fadf00faeb0 2024-09-17T01:11:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.126+0000 7fade67fc640 1 -- 172.21.15.2:0/242685764 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadec009530 con 0x7fadf00faeb0 2024-09-17T01:11:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.126+0000 7fadf7de4640 1 -- 172.21.15.2:0/242685764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf0113fe0 con 0x7fadf00faeb0 2024-09-17T01:11:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.127+0000 7fadf7de4640 1 -- 172.21.15.2:0/242685764 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf00fbc90 con 0x7fadf00faeb0 2024-09-17T01:11:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.128+0000 7fade67fc640 1 -- 172.21.15.2:0/242685764 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fadec0097a0 con 0x7fadf00faeb0 2024-09-17T01:11:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.128+0000 7fade67fc640 1 --2- 172.21.15.2:0/242685764 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faddc06e530 0x7faddc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:12.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.128+0000 7fade67fc640 1 -- 172.21.15.2:0/242685764 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fadec08dcb0 con 0x7fadf00faeb0 2024-09-17T01:11:12.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.128+0000 7fadf537f640 1 --2- 172.21.15.2:0/242685764 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faddc06e530 0x7faddc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:12.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.129+0000 7fadf537f640 1 --2- 172.21.15.2:0/242685764 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faddc06e530 0x7faddc0709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fade0007ac0 tx=0x7fade0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:12.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.133+0000 7fade67fc640 1 -- 172.21.15.2:0/242685764 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fadec056c70 con 0x7fadf00faeb0 2024-09-17T01:11:12.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.327+0000 7fadf7de4640 1 -- 172.21.15.2:0/242685764 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fadf010fb60 con 0x7faddc06e530 2024-09-17T01:11:12.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.328+0000 7fade67fc640 1 -- 172.21.15.2:0/242685764 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fadf010fb60 con 0x7faddc06e530 2024-09-17T01:11:12.326 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:11:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": null, 2024-09-17T01:11:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": false, 2024-09-17T01:11:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "", 2024-09-17T01:11:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2024-09-17T01:11:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": null, 2024-09-17T01:11:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "", 2024-09-17T01:11:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2024-09-17T01:11:12.327 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:11:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.330+0000 7fadf7de4640 1 -- 172.21.15.2:0/242685764 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faddc06e530 msgr2=0x7faddc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:12.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.330+0000 7fadf7de4640 1 --2- 172.21.15.2:0/242685764 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faddc06e530 0x7faddc0709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fade0007ac0 tx=0x7fade0035040 comp rx=0 tx=0).stop 2024-09-17T01:11:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.330+0000 7fadf7de4640 1 -- 172.21.15.2:0/242685764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00faeb0 msgr2=0x7fadf0119840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.330+0000 7fadf7de4640 1 --2- 172.21.15.2:0/242685764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00faeb0 0x7fadf0119840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fadec002a80 tx=0x7fadec004600 comp rx=0 tx=0).stop 2024-09-17T01:11:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.330+0000 7fadf7de4640 1 -- 172.21.15.2:0/242685764 shutdown_connections 2024-09-17T01:11:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.330+0000 7fadf7de4640 1 --2- 172.21.15.2:0/242685764 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faddc06e530 0x7faddc0709e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.330+0000 7fadf7de4640 1 --2- 172.21.15.2:0/242685764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fadf00fb7c0 0x7fadf0119d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.330+0000 7fadf7de4640 1 --2- 172.21.15.2:0/242685764 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fadf00faeb0 0x7fadf0119840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.330+0000 7fadf7de4640 1 -- 172.21.15.2:0/242685764 >> 172.21.15.2:0/242685764 conn(0x7fadf0070ce0 msgr2=0x7fadf00fc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.330+0000 7fadf7de4640 1 -- 172.21.15.2:0/242685764 shutdown_connections 2024-09-17T01:11:12.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:12.330+0000 7fadf7de4640 1 -- 172.21.15.2:0/242685764 wait complete. 2024-09-17T01:11:12.983 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:12 smithi002 ceph-mon[98018]: pgmap v224: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8.4 KiB/s wr, 18 op/s 2024-09-17T01:11:13.011 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph health detail' 2024-09-17T01:11:13.273 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:11:13.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:12 smithi099 ceph-mon[77412]: pgmap v224: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8.4 KiB/s wr, 18 op/s 2024-09-17T01:11:14.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:13 smithi002 ceph-mon[98018]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:14.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:13 smithi099 ceph-mon[77412]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:11:14.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.966+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/2267702417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d441047a0 msgr2=0x7f7d44104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:14.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.966+0000 7f7d4b0d1640 1 --2- 172.21.15.2:0/2267702417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d441047a0 0x7f7d44104b70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7d380048d0 tx=0x7f7d38009da0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.966+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/2267702417 shutdown_connections 2024-09-17T01:11:14.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.966+0000 7f7d4b0d1640 1 --2- 172.21.15.2:0/2267702417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d440fe780 0x7f7d440febf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.966+0000 7f7d4b0d1640 1 --2- 172.21.15.2:0/2267702417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d441047a0 0x7f7d44104b70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.966+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/2267702417 >> 172.21.15.2:0/2267702417 conn(0x7f7d440fa320 msgr2=0x7f7d440fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:14.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.966+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/2267702417 shutdown_connections 2024-09-17T01:11:14.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.966+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/2267702417 wait complete. 2024-09-17T01:11:14.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.967+0000 7f7d4b0d1640 1 Processor -- start 2024-09-17T01:11:14.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.967+0000 7f7d4b0d1640 1 -- start start 2024-09-17T01:11:14.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.967+0000 7f7d4b0d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d440fe780 0x7f7d44115380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.967+0000 7f7d4b0d1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d441047a0 0x7f7d441158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.967+0000 7f7d4b0d1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44115ec0 con 0x7f7d440fe780 2024-09-17T01:11:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.967+0000 7f7d4b0d1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4410f300 con 0x7f7d441047a0 2024-09-17T01:11:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.967+0000 7f7d48e6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d440fe780 0x7f7d44115380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.967+0000 7f7d48e6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d440fe780 0x7f7d44115380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59144/0 (socket says 172.21.15.2:59144) 2024-09-17T01:11:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.967+0000 7f7d48e6d640 1 -- 172.21.15.2:0/275054111 learned_addr learned my addr 172.21.15.2:0/275054111 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:11:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.967+0000 7f7d43fff640 1 --2- 172.21.15.2:0/275054111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d441047a0 0x7f7d441158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.968+0000 7f7d48e6d640 1 -- 172.21.15.2:0/275054111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d441047a0 msgr2=0x7f7d441158c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.968+0000 7f7d48e6d640 1 --2- 172.21.15.2:0/275054111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d441047a0 0x7f7d441158c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.968+0000 7f7d48e6d640 1 -- 172.21.15.2:0/275054111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d38005040 con 0x7f7d440fe780 2024-09-17T01:11:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.968+0000 7f7d48e6d640 1 --2- 172.21.15.2:0/275054111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d440fe780 0x7f7d44115380 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7d38000c00 tx=0x7f7d38009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.968+0000 7f7d417fa640 1 -- 172.21.15.2:0/275054111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d38038070 con 0x7f7d440fe780 2024-09-17T01:11:14.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.968+0000 7f7d417fa640 1 -- 172.21.15.2:0/275054111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7d3802ade0 con 0x7f7d440fe780 2024-09-17T01:11:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.968+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/275054111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4410f580 con 0x7f7d440fe780 2024-09-17T01:11:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.968+0000 7f7d417fa640 1 -- 172.21.15.2:0/275054111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d3802c7e0 con 0x7f7d440fe780 2024-09-17T01:11:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.968+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/275054111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4410fac0 con 0x7f7d440fe780 2024-09-17T01:11:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.969+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/275054111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d440ffec0 con 0x7f7d440fe780 2024-09-17T01:11:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.970+0000 7f7d417fa640 1 -- 172.21.15.2:0/275054111 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f7d38030020 con 0x7f7d440fe780 2024-09-17T01:11:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.970+0000 7f7d417fa640 1 --2- 172.21.15.2:0/275054111 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7d3406e530 0x7f7d340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.970+0000 7f7d417fa640 1 -- 172.21.15.2:0/275054111 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f7d380adf20 con 0x7f7d440fe780 2024-09-17T01:11:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.970+0000 7f7d43fff640 1 --2- 172.21.15.2:0/275054111 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7d3406e530 0x7f7d340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:14.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.971+0000 7f7d43fff640 1 --2- 172.21.15.2:0/275054111 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7d3406e530 0x7f7d340709e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7d30007fd0 tx=0x7f7d30009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:14.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:14.975+0000 7f7d417fa640 1 -- 172.21.15.2:0/275054111 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7d380e31b0 con 0x7f7d440fe780 2024-09-17T01:11:15.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:15.228+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/275054111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7d4404b720 con 0x7f7d440fe780 2024-09-17T01:11:15.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:14 smithi002 ceph-mon[98018]: pgmap v225: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8.3 KiB/s wr, 19 op/s 2024-09-17T01:11:15.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:15.228+0000 7f7d417fa640 1 -- 172.21.15.2:0/275054111 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f7d38076f90 con 0x7f7d440fe780 2024-09-17T01:11:15.227 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:11:15.227 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:11:15.228 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:11:15.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:15.230+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/275054111 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7d3406e530 msgr2=0x7f7d340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:15.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:15.230+0000 7f7d4b0d1640 1 --2- 172.21.15.2:0/275054111 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7d3406e530 0x7f7d340709e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7d30007fd0 tx=0x7f7d30009e90 comp rx=0 tx=0).stop 2024-09-17T01:11:15.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:15.230+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/275054111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d440fe780 msgr2=0x7f7d44115380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:15.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:15.230+0000 7f7d4b0d1640 1 --2- 172.21.15.2:0/275054111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d440fe780 0x7f7d44115380 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7d38000c00 tx=0x7f7d38009da0 comp rx=0 tx=0).stop 2024-09-17T01:11:15.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:15.230+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/275054111 shutdown_connections 2024-09-17T01:11:15.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:15.230+0000 7f7d4b0d1640 1 --2- 172.21.15.2:0/275054111 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7d3406e530 0x7f7d340709e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:15.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:15.230+0000 7f7d4b0d1640 1 --2- 172.21.15.2:0/275054111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d441047a0 0x7f7d441158c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:15.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:15.230+0000 7f7d4b0d1640 1 --2- 172.21.15.2:0/275054111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d440fe780 0x7f7d44115380 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:15.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:15.230+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/275054111 >> 172.21.15.2:0/275054111 conn(0x7f7d440fa320 msgr2=0x7f7d440fb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:15.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:15.231+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/275054111 shutdown_connections 2024-09-17T01:11:15.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:15.231+0000 7f7d4b0d1640 1 -- 172.21.15.2:0/275054111 wait complete. 2024-09-17T01:11:15.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:14 smithi099 ceph-mon[77412]: pgmap v225: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 8.3 KiB/s wr, 19 op/s 2024-09-17T01:11:16.012 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions' 2024-09-17T01:11:16.275 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:11:16.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:15 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/275054111' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:11:16.396 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:15 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/275054111' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:11:17.074 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:16 smithi002 ceph-mon[98018]: pgmap v226: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 8.1 KiB/s wr, 11 op/s 2024-09-17T01:11:17.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:16 smithi099 ceph-mon[77412]: pgmap v226: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 8.1 KiB/s wr, 11 op/s 2024-09-17T01:11:17.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.862+0000 7f990afaa640 1 -- 172.21.15.2:0/2794845207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99040fcf80 msgr2=0x7f99040fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:17.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.862+0000 7f990afaa640 1 --2- 172.21.15.2:0/2794845207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99040fcf80 0x7f99040fd3d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0048d0 tx=0x7f98ec009da0 comp rx=0 tx=0).stop 2024-09-17T01:11:17.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.862+0000 7f990afaa640 1 -- 172.21.15.2:0/2794845207 shutdown_connections 2024-09-17T01:11:17.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.862+0000 7f990afaa640 1 --2- 172.21.15.2:0/2794845207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99040fcf80 0x7f99040fd3d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:17.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.862+0000 7f990afaa640 1 --2- 172.21.15.2:0/2794845207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99040fb810 0x7f99040fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:17.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.862+0000 7f990afaa640 1 -- 172.21.15.2:0/2794845207 >> 172.21.15.2:0/2794845207 conn(0x7f99040723b0 msgr2=0x7f99040727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:17.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.862+0000 7f990afaa640 1 -- 172.21.15.2:0/2794845207 shutdown_connections 2024-09-17T01:11:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.862+0000 7f990afaa640 1 -- 172.21.15.2:0/2794845207 wait complete. 2024-09-17T01:11:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.863+0000 7f990afaa640 1 Processor -- start 2024-09-17T01:11:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.863+0000 7f990afaa640 1 -- start start 2024-09-17T01:11:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.863+0000 7f990afaa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99040fb810 0x7f9904106410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.863+0000 7f990afaa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99040fcf80 0x7f9904106950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.863+0000 7f990afaa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9904106e90 con 0x7f99040fb810 2024-09-17T01:11:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.863+0000 7f990afaa640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9904107000 con 0x7f99040fcf80 2024-09-17T01:11:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.863+0000 7f9908d46640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99040fb810 0x7f9904106410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.863+0000 7f9908d46640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99040fb810 0x7f9904106410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59152/0 (socket says 172.21.15.2:59152) 2024-09-17T01:11:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.863+0000 7f9908d46640 1 -- 172.21.15.2:0/1745686718 learned_addr learned my addr 172.21.15.2:0/1745686718 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:11:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.863+0000 7f9903fff640 1 --2- 172.21.15.2:0/1745686718 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99040fcf80 0x7f9904106950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.864+0000 7f9908d46640 1 -- 172.21.15.2:0/1745686718 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99040fcf80 msgr2=0x7f9904106950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:17.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.864+0000 7f9908d46640 1 --2- 172.21.15.2:0/1745686718 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99040fcf80 0x7f9904106950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.864+0000 7f9908d46640 1 -- 172.21.15.2:0/1745686718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec005040 con 0x7f99040fb810 2024-09-17T01:11:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.864+0000 7f9908d46640 1 --2- 172.21.15.2:0/1745686718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99040fb810 0x7f9904106410 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98f4002a50 tx=0x7f98f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:17.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.864+0000 7f99017fa640 1 -- 172.21.15.2:0/1745686718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98f4007c30 con 0x7f99040fb810 2024-09-17T01:11:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.864+0000 7f99017fa640 1 -- 172.21.15.2:0/1745686718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f98f400f040 con 0x7f99040fb810 2024-09-17T01:11:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.864+0000 7f990afaa640 1 -- 172.21.15.2:0/1745686718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9904107290 con 0x7f99040fb810 2024-09-17T01:11:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.864+0000 7f99017fa640 1 -- 172.21.15.2:0/1745686718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98f400dad0 con 0x7f99040fb810 2024-09-17T01:11:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.864+0000 7f990afaa640 1 -- 172.21.15.2:0/1745686718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9904119880 con 0x7f99040fb810 2024-09-17T01:11:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.865+0000 7f990afaa640 1 -- 172.21.15.2:0/1745686718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99040fcbc0 con 0x7f99040fb810 2024-09-17T01:11:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.866+0000 7f99017fa640 1 -- 172.21.15.2:0/1745686718 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f98f400dc30 con 0x7f99040fb810 2024-09-17T01:11:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.866+0000 7f99017fa640 1 --2- 172.21.15.2:0/1745686718 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f98f006e530 0x7f98f00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:11:17.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.867+0000 7f99017fa640 1 -- 172.21.15.2:0/1745686718 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f98f408e1e0 con 0x7f99040fb810 2024-09-17T01:11:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.867+0000 7f9903fff640 1 --2- 172.21.15.2:0/1745686718 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f98f006e530 0x7f98f00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:11:17.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.867+0000 7f9903fff640 1 --2- 172.21.15.2:0/1745686718 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f98f006e530 0x7f98f00709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f98ec009ac0 tx=0x7f98ec035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:11:17.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:17.871+0000 7f99017fa640 1 -- 172.21.15.2:0/1745686718 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f98f4057100 con 0x7f99040fb810 2024-09-17T01:11:18.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:18.121+0000 7f990afaa640 1 -- 172.21.15.2:0/1745686718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9904107b00 con 0x7f99040fb810 2024-09-17T01:11:18.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:18.121+0000 7f99017fa640 1 -- 172.21.15.2:0/1745686718 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f98f405a7c0 con 0x7f99040fb810 2024-09-17T01:11:18.120 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:11:18.120 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:11:18.120 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:11:18.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:11:18.120 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:11:18.120 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:11:18.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:11:18.121 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:11:18.121 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:11:18.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:11:18.121 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:11:18.121 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:11:18.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:11:18.121 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:11:18.121 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T01:11:18.121 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:11:18.121 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:11:18.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:18.123+0000 7f990afaa640 1 -- 172.21.15.2:0/1745686718 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f98f006e530 msgr2=0x7f98f00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:18.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:18.123+0000 7f990afaa640 1 --2- 172.21.15.2:0/1745686718 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f98f006e530 0x7f98f00709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f98ec009ac0 tx=0x7f98ec035040 comp rx=0 tx=0).stop 2024-09-17T01:11:18.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:18.123+0000 7f990afaa640 1 -- 172.21.15.2:0/1745686718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99040fb810 msgr2=0x7f9904106410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:11:18.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:18.123+0000 7f990afaa640 1 --2- 172.21.15.2:0/1745686718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99040fb810 0x7f9904106410 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98f4002a50 tx=0x7f98f4004600 comp rx=0 tx=0).stop 2024-09-17T01:11:18.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:18.123+0000 7f990afaa640 1 -- 172.21.15.2:0/1745686718 shutdown_connections 2024-09-17T01:11:18.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:18.123+0000 7f990afaa640 1 --2- 172.21.15.2:0/1745686718 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f98f006e530 0x7f98f00709e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:18.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:18.123+0000 7f990afaa640 1 --2- 172.21.15.2:0/1745686718 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99040fcf80 0x7f9904106950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:18.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:18.123+0000 7f990afaa640 1 --2- 172.21.15.2:0/1745686718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99040fb810 0x7f9904106410 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:11:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:18.123+0000 7f990afaa640 1 -- 172.21.15.2:0/1745686718 >> 172.21.15.2:0/1745686718 conn(0x7f99040723b0 msgr2=0x7f99040fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:11:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:18.124+0000 7f990afaa640 1 -- 172.21.15.2:0/1745686718 shutdown_connections 2024-09-17T01:11:18.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:11:18.124+0000 7f990afaa640 1 -- 172.21.15.2:0/1745686718 wait complete. 2024-09-17T01:11:18.756 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-17T01:11:19.015 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:11:19.262 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:18 smithi002 ceph-mon[98018]: pgmap v227: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-09-17T01:11:19.262 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:18 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1745686718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:19.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:18 smithi099 ceph-mon[77412]: pgmap v227: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 8.1 KiB/s wr, 12 op/s 2024-09-17T01:11:19.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:18 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1745686718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:11:20.567 INFO:teuthology.orchestra.run.smithi002.stdout:wait for servicemap items w/ changing names to refresh 2024-09-17T01:11:21.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:20 smithi002 ceph-mon[98018]: pgmap v228: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.0 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-17T01:11:21.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'sleep 60' 2024-09-17T01:11:21.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:20 smithi099 ceph-mon[77412]: pgmap v228: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.0 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-17T01:11:21.516 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:11:23.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:22 smithi099 ceph-mon[77412]: pgmap v229: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.9 KiB/s rd, 3 op/s 2024-09-17T01:11:23.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:22 smithi002 ceph-mon[98018]: pgmap v229: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.9 KiB/s rd, 3 op/s 2024-09-17T01:11:25.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:24 smithi099 ceph-mon[77412]: pgmap v230: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 4 op/s 2024-09-17T01:11:25.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:24 smithi002 ceph-mon[98018]: pgmap v230: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 4 op/s 2024-09-17T01:11:26.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:26.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:27.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:26 smithi099 ceph-mon[77412]: pgmap v231: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:27.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:26 smithi002 ceph-mon[98018]: pgmap v231: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:29.207 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:28 smithi002 ceph-mon[98018]: pgmap v232: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:29.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:28 smithi099 ceph-mon[77412]: pgmap v232: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:31.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:30 smithi099 ceph-mon[77412]: pgmap v233: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:11:31.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:30 smithi002 ceph-mon[98018]: pgmap v233: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:11:33.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:32 smithi099 ceph-mon[77412]: pgmap v234: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:33.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:32 smithi002 ceph-mon[98018]: pgmap v234: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:35.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:34 smithi099 ceph-mon[77412]: pgmap v235: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:11:35.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:34 smithi002 ceph-mon[98018]: pgmap v235: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:11:37.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:36 smithi099 ceph-mon[77412]: pgmap v236: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:37.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:36 smithi002 ceph-mon[98018]: pgmap v236: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:39.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:38 smithi099 ceph-mon[77412]: pgmap v237: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:39.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:38 smithi002 ceph-mon[98018]: pgmap v237: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:41.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:40 smithi099 ceph-mon[77412]: pgmap v238: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:11:41.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:40 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:41.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:40 smithi002 ceph-mon[98018]: pgmap v238: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:11:41.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:40 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:43.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:42 smithi099 ceph-mon[77412]: pgmap v239: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:43.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:42 smithi002 ceph-mon[98018]: pgmap v239: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:45.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:44 smithi099 ceph-mon[77412]: pgmap v240: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:11:45.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:44 smithi002 ceph-mon[98018]: pgmap v240: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:11:47.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:46 smithi099 ceph-mon[77412]: pgmap v241: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:47.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:46 smithi002 ceph-mon[98018]: pgmap v241: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:49.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:48 smithi099 ceph-mon[77412]: pgmap v242: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:49.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:48 smithi002 ceph-mon[98018]: pgmap v242: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:51.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:50 smithi099 ceph-mon[77412]: pgmap v243: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:11:51.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:50 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:51.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:50 smithi002 ceph-mon[98018]: pgmap v243: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:11:51.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:50 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:11:52.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:52.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:52.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:11:52.312 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:11:52.312 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:11:52.312 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:11:53.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:52 smithi099 ceph-mon[77412]: pgmap v244: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:53.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:52 smithi002 ceph-mon[98018]: pgmap v244: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:55.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:54 smithi099 ceph-mon[77412]: pgmap v245: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:11:55.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:54 smithi002 ceph-mon[98018]: pgmap v245: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:11:56.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:56 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:56.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:56 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:11:57.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:57 smithi099 ceph-mon[77412]: pgmap v246: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:57.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:57 smithi002 ceph-mon[98018]: pgmap v246: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:59.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:11:59 smithi099 ceph-mon[77412]: pgmap v247: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:11:59.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:11:59 smithi002 ceph-mon[98018]: pgmap v247: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:01.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:01 smithi099 ceph-mon[77412]: pgmap v248: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:01.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:01 smithi002 ceph-mon[98018]: pgmap v248: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:03.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:03 smithi099 ceph-mon[77412]: pgmap v249: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:03.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:03 smithi002 ceph-mon[98018]: pgmap v249: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:05.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:05 smithi099 ceph-mon[77412]: pgmap v250: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:05.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:05 smithi002 ceph-mon[98018]: pgmap v250: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:07.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:07 smithi099 ceph-mon[77412]: pgmap v251: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:07.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:07 smithi002 ceph-mon[98018]: pgmap v251: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:09.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:09 smithi099 ceph-mon[77412]: pgmap v252: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:09.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:09 smithi002 ceph-mon[98018]: pgmap v252: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:11.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:11 smithi099 ceph-mon[77412]: pgmap v253: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:11.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:11 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:11.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:11 smithi002 ceph-mon[98018]: pgmap v253: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:11.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:11 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:13.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:13 smithi099 ceph-mon[77412]: pgmap v254: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:13.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:13 smithi002 ceph-mon[98018]: pgmap v254: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:15.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:15 smithi099 ceph-mon[77412]: pgmap v255: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:15.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:15 smithi002 ceph-mon[98018]: pgmap v255: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:17.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:17 smithi099 ceph-mon[77412]: pgmap v256: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:17.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:17 smithi002 ceph-mon[98018]: pgmap v256: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:19.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:19 smithi099 ceph-mon[77412]: pgmap v257: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:19.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:19 smithi002 ceph-mon[98018]: pgmap v257: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:21.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:21 smithi099 ceph-mon[77412]: pgmap v258: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:21.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:21 smithi002 ceph-mon[98018]: pgmap v258: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:23.292 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:23 smithi099 ceph-mon[77412]: pgmap v259: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:23.343 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:23 smithi002 ceph-mon[98018]: pgmap v259: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:23.843 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph orch ps' 2024-09-17T01:12:24.113 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:12:25.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:25 smithi002 ceph-mon[98018]: pgmap v260: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:25.544 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:25 smithi099 ceph-mon[77412]: pgmap v260: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:25.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.796+0000 7fb1684be640 1 -- 172.21.15.2:0/2255211751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1600fac80 msgr2=0x7fb1600fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:25.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.796+0000 7fb1684be640 1 --2- 172.21.15.2:0/2255211751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1600fac80 0x7fb1600fb0f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb1500048d0 tx=0x7fb150009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:25.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.796+0000 7fb1684be640 1 -- 172.21.15.2:0/2255211751 shutdown_connections 2024-09-17T01:12:25.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.796+0000 7fb1684be640 1 --2- 172.21.15.2:0/2255211751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1600fac80 0x7fb1600fb0f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:25.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.796+0000 7fb1684be640 1 --2- 172.21.15.2:0/2255211751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb160102620 0x7fb1601029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:25.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.796+0000 7fb1684be640 1 -- 172.21.15.2:0/2255211751 >> 172.21.15.2:0/2255211751 conn(0x7fb160070ce0 msgr2=0x7fb1600710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:25.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.796+0000 7fb1684be640 1 -- 172.21.15.2:0/2255211751 shutdown_connections 2024-09-17T01:12:25.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.796+0000 7fb1684be640 1 -- 172.21.15.2:0/2255211751 wait complete. 2024-09-17T01:12:25.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.796+0000 7fb1684be640 1 Processor -- start 2024-09-17T01:12:25.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.796+0000 7fb1684be640 1 -- start start 2024-09-17T01:12:25.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb1684be640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1600fac80 0x7fb1601131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:25.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb1684be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb160102620 0x7fb160113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:25.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb1684be640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb160113d20 con 0x7fb160102620 2024-09-17T01:12:25.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb1684be640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16010d160 con 0x7fb1600fac80 2024-09-17T01:12:25.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb165a59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb160102620 0x7fb160113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:25.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb165a59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb160102620 0x7fb160113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43556/0 (socket says 172.21.15.2:43556) 2024-09-17T01:12:25.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb165a59640 1 -- 172.21.15.2:0/855343208 learned_addr learned my addr 172.21.15.2:0/855343208 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:12:25.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb16625a640 1 --2- 172.21.15.2:0/855343208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1600fac80 0x7fb1601131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:25.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb165a59640 1 -- 172.21.15.2:0/855343208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1600fac80 msgr2=0x7fb1601131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:25.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb165a59640 1 --2- 172.21.15.2:0/855343208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1600fac80 0x7fb1601131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:25.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb165a59640 1 -- 172.21.15.2:0/855343208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb150005040 con 0x7fb160102620 2024-09-17T01:12:25.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb16625a640 1 --2- 172.21.15.2:0/855343208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1600fac80 0x7fb1601131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:12:25.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb165a59640 1 --2- 172.21.15.2:0/855343208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb160102620 0x7fb160113720 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb150000c00 tx=0x7fb150009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:25.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb156ffd640 1 -- 172.21.15.2:0/855343208 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb150038070 con 0x7fb160102620 2024-09-17T01:12:25.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb156ffd640 1 -- 172.21.15.2:0/855343208 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb15002ade0 con 0x7fb160102620 2024-09-17T01:12:25.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb1684be640 1 -- 172.21.15.2:0/855343208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16010d3e0 con 0x7fb160102620 2024-09-17T01:12:25.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb156ffd640 1 -- 172.21.15.2:0/855343208 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb15002c7e0 con 0x7fb160102620 2024-09-17T01:12:25.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.797+0000 7fb1684be640 1 -- 172.21.15.2:0/855343208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16010d920 con 0x7fb160102620 2024-09-17T01:12:25.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.798+0000 7fb1684be640 1 -- 172.21.15.2:0/855343208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1600657b0 con 0x7fb160102620 2024-09-17T01:12:25.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.799+0000 7fb156ffd640 1 -- 172.21.15.2:0/855343208 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fb150030020 con 0x7fb160102620 2024-09-17T01:12:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.799+0000 7fb156ffd640 1 --2- 172.21.15.2:0/855343208 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb14c06e530 0x7fb14c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.800+0000 7fb156ffd640 1 -- 172.21.15.2:0/855343208 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fb1500adf20 con 0x7fb160102620 2024-09-17T01:12:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.800+0000 7fb16625a640 1 --2- 172.21.15.2:0/855343208 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb14c06e530 0x7fb14c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:25.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.800+0000 7fb16625a640 1 --2- 172.21.15.2:0/855343208 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb14c06e530 0x7fb14c0709e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb15c007fd0 tx=0x7fb15c009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.804+0000 7fb156ffd640 1 -- 172.21.15.2:0/855343208 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb1500e31b0 con 0x7fb160102620 2024-09-17T01:12:25.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:25.989+0000 7fb1684be640 1 -- 172.21.15.2:0/855343208 --> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb160109590 con 0x7fb14c06e530 2024-09-17T01:12:25.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:26.000+0000 7fb156ffd640 1 -- 172.21.15.2:0/855343208 <== mgr.34104 v2:172.21.15.2:6800/2189836750 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb160109590 con 0x7fb14c06e530 2024-09-17T01:12:25.999 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:12:25.999 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (9m) 2m ago 18m 25.5M - 0.25.0 c8568f914cd2 daa1c7f5c182 2024-09-17T01:12:25.999 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (6m) 2m ago 18m 6891k - 19.1.1-330-gc2ddf972 ebb0615149de b7ed6c8d5a92 2024-09-17T01:12:25.999 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi099 smithi099 running (6m) 101s ago 17m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de ae713b940078 2024-09-17T01:12:25.999 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (8m) 2m ago 18m 82.5M - 9.4.12 2bacad6d85d8 5fe408c103d6 2024-09-17T01:12:25.999 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.fmyyzz smithi002 running (2m) 2m ago 12m 14.1M - 19.1.1-330-gc2ddf972 ebb0615149de 923cbcf82a29 2024-09-17T01:12:25.999 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.zmrgxd smithi002 running (2m) 2m ago 13m 15.5M - 19.1.1-330-gc2ddf972 ebb0615149de 8862e6324ff5 2024-09-17T01:12:25.999 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.heckcd smithi099 running (104s) 101s ago 12m 11.8M - 19.1.1-330-gc2ddf972 ebb0615149de f405ff311e0d 2024-09-17T01:12:25.999 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi099.hgawhu smithi099 running (2m) 101s ago 12m 13.2M - 19.1.1-330-gc2ddf972 ebb0615149de 222618d9f6fd 2024-09-17T01:12:25.999 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.vjeexr smithi002 *:8443,9283,8765 running (9m) 2m ago 19m 504M - 19.1.1-330-gc2ddf972 ebb0615149de e304f87801be 2024-09-17T01:12:25.999 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi099.vswzrb smithi099 *:8443,9283,8765 running (8m) 101s ago 17m 442M - 19.1.1-330-gc2ddf972 ebb0615149de ff477d8d4f1a 2024-09-17T01:12:25.999 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (7m) 2m ago 19m 49.6M 2048M 19.1.1-330-gc2ddf972 ebb0615149de da5247385c2d 2024-09-17T01:12:26.000 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi099 smithi099 running (6m) 101s ago 17m 38.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de b92f98b2cab9 2024-09-17T01:12:26.000 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (9m) 2m ago 18m 15.7M - 1.5.0 0da6a335fe13 091104c8b4c2 2024-09-17T01:12:26.000 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi099 smithi099 *:9100 running (9m) 101s ago 17m 15.4M - 1.5.0 0da6a335fe13 06fcd0c9b694 2024-09-17T01:12:26.000 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (5m) 2m ago 16m 162M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 563188d6089b 2024-09-17T01:12:26.000 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (5m) 2m ago 16m 106M 1558M 19.1.1-330-gc2ddf972 ebb0615149de cc26caf558d7 2024-09-17T01:12:26.000 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (4m) 2m ago 15m 135M 1558M 19.1.1-330-gc2ddf972 ebb0615149de 0aac20af5580 2024-09-17T01:12:26.000 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi099 running (3m) 101s ago 15m 137M 2581M 19.1.1-330-gc2ddf972 ebb0615149de 0740cf987fef 2024-09-17T01:12:26.000 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi099 running (3m) 101s ago 14m 96.9M 2581M 19.1.1-330-gc2ddf972 ebb0615149de df5b078898bb 2024-09-17T01:12:26.000 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi099 running (2m) 101s ago 14m 90.3M 2581M 19.1.1-330-gc2ddf972 ebb0615149de e26706fa8822 2024-09-17T01:12:26.000 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (8m) 2m ago 17m 66.2M - 2.43.0 a07b618ecd1d 821d6528dc34 2024-09-17T01:12:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:26.002+0000 7fb1684be640 1 -- 172.21.15.2:0/855343208 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb14c06e530 msgr2=0x7fb14c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:26.002+0000 7fb1684be640 1 --2- 172.21.15.2:0/855343208 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb14c06e530 0x7fb14c0709e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb15c007fd0 tx=0x7fb15c009e90 comp rx=0 tx=0).stop 2024-09-17T01:12:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:26.002+0000 7fb1684be640 1 -- 172.21.15.2:0/855343208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb160102620 msgr2=0x7fb160113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:26.002+0000 7fb1684be640 1 --2- 172.21.15.2:0/855343208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb160102620 0x7fb160113720 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb150000c00 tx=0x7fb150009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:26.002+0000 7fb1684be640 1 -- 172.21.15.2:0/855343208 shutdown_connections 2024-09-17T01:12:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:26.002+0000 7fb1684be640 1 --2- 172.21.15.2:0/855343208 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fb14c06e530 0x7fb14c0709e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:26.002+0000 7fb1684be640 1 --2- 172.21.15.2:0/855343208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb160102620 0x7fb160113720 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:26.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:26.002+0000 7fb1684be640 1 --2- 172.21.15.2:0/855343208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1600fac80 0x7fb1601131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:26.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:26.002+0000 7fb1684be640 1 -- 172.21.15.2:0/855343208 >> 172.21.15.2:0/855343208 conn(0x7fb160070ce0 msgr2=0x7fb160105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:26.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:26.003+0000 7fb1684be640 1 -- 172.21.15.2:0/855343208 shutdown_connections 2024-09-17T01:12:26.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:26.003+0000 7fb1684be640 1 -- 172.21.15.2:0/855343208 wait complete. 2024-09-17T01:12:26.291 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:26 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:26.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:26 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:26.719 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions' 2024-09-17T01:12:26.983 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:12:27.298 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:27 smithi002 ceph-mon[98018]: pgmap v261: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:27.299 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:27 smithi002 ceph-mon[98018]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:27.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:27 smithi099 ceph-mon[77412]: pgmap v261: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:27.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:27 smithi099 ceph-mon[77412]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:12:28.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.544+0000 7f375b8fd640 1 -- 172.21.15.2:0/4044765080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3754101510 msgr2=0x7f37541018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.544+0000 7f375b8fd640 1 --2- 172.21.15.2:0/4044765080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3754101510 0x7f37541018e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f37480048d0 tx=0x7f3748009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.544+0000 7f375b8fd640 1 -- 172.21.15.2:0/4044765080 shutdown_connections 2024-09-17T01:12:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.544+0000 7f375b8fd640 1 --2- 172.21.15.2:0/4044765080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37540fb4d0 0x7f37540fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.544+0000 7f375b8fd640 1 --2- 172.21.15.2:0/4044765080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3754101510 0x7f37541018e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.544+0000 7f375b8fd640 1 -- 172.21.15.2:0/4044765080 >> 172.21.15.2:0/4044765080 conn(0x7f37540f7090 msgr2=0x7f37540f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.544+0000 7f375b8fd640 1 -- 172.21.15.2:0/4044765080 shutdown_connections 2024-09-17T01:12:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.544+0000 7f375b8fd640 1 -- 172.21.15.2:0/4044765080 wait complete. 2024-09-17T01:12:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.544+0000 7f375b8fd640 1 Processor -- start 2024-09-17T01:12:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.544+0000 7f375b8fd640 1 -- start start 2024-09-17T01:12:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.545+0000 7f375b8fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540fb4d0 0x7f3754115360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:28.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.545+0000 7f375b8fd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3754101510 0x7f37541158a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.545+0000 7f375b8fd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3754115ea0 con 0x7f37540fb4d0 2024-09-17T01:12:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.545+0000 7f375b8fd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3754116010 con 0x7f3754101510 2024-09-17T01:12:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.545+0000 7f3759699640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540fb4d0 0x7f3754115360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.545+0000 7f3759699640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540fb4d0 0x7f3754115360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43572/0 (socket says 172.21.15.2:43572) 2024-09-17T01:12:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.545+0000 7f3759699640 1 -- 172.21.15.2:0/2501734276 learned_addr learned my addr 172.21.15.2:0/2501734276 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:12:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.545+0000 7f3758e98640 1 --2- 172.21.15.2:0/2501734276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3754101510 0x7f37541158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.545+0000 7f3759699640 1 -- 172.21.15.2:0/2501734276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3754101510 msgr2=0x7f37541158a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.545+0000 7f3759699640 1 --2- 172.21.15.2:0/2501734276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3754101510 0x7f37541158a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.545+0000 7f3759699640 1 -- 172.21.15.2:0/2501734276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3748005040 con 0x7f37540fb4d0 2024-09-17T01:12:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.545+0000 7f3759699640 1 --2- 172.21.15.2:0/2501734276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540fb4d0 0x7f3754115360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3748000c00 tx=0x7f3748009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.545+0000 7f3745ffb640 1 -- 172.21.15.2:0/2501734276 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3748038070 con 0x7f37540fb4d0 2024-09-17T01:12:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.546+0000 7f3745ffb640 1 -- 172.21.15.2:0/2501734276 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f374802ade0 con 0x7f37540fb4d0 2024-09-17T01:12:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.546+0000 7f375b8fd640 1 -- 172.21.15.2:0/2501734276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375410f430 con 0x7f37540fb4d0 2024-09-17T01:12:28.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.546+0000 7f3745ffb640 1 -- 172.21.15.2:0/2501734276 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f374802c7e0 con 0x7f37540fb4d0 2024-09-17T01:12:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.546+0000 7f375b8fd640 1 -- 172.21.15.2:0/2501734276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375410f970 con 0x7f37540fb4d0 2024-09-17T01:12:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.547+0000 7f375b8fd640 1 -- 172.21.15.2:0/2501734276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37540fcc10 con 0x7f37540fb4d0 2024-09-17T01:12:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.547+0000 7f3745ffb640 1 -- 172.21.15.2:0/2501734276 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f3748030020 con 0x7f37540fb4d0 2024-09-17T01:12:28.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.548+0000 7f3745ffb640 1 --2- 172.21.15.2:0/2501734276 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f374006e530 0x7f37400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.548+0000 7f3745ffb640 1 -- 172.21.15.2:0/2501734276 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f37480ade80 con 0x7f37540fb4d0 2024-09-17T01:12:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.548+0000 7f3758e98640 1 --2- 172.21.15.2:0/2501734276 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f374006e530 0x7f37400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:28.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.549+0000 7f3758e98640 1 --2- 172.21.15.2:0/2501734276 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f374006e530 0x7f37400709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3750007fd0 tx=0x7f3750009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.552+0000 7f3745ffb640 1 -- 172.21.15.2:0/2501734276 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3748076f70 con 0x7f37540fb4d0 2024-09-17T01:12:28.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.798+0000 7f375b8fd640 1 -- 172.21.15.2:0/2501734276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f37540fac90 con 0x7f37540fb4d0 2024-09-17T01:12:28.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.798+0000 7f3745ffb640 1 -- 172.21.15.2:0/2501734276 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f374807a630 con 0x7f37540fb4d0 2024-09-17T01:12:28.797 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-17T01:12:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2024-09-17T01:12:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:12:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:12:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2024-09-17T01:12:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:12:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:12:28.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2024-09-17T01:12:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:12:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:12:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-09-17T01:12:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:12:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-17T01:12:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2024-09-17T01:12:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T01:12:28.798 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-17T01:12:28.798 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-17T01:12:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.800+0000 7f375b8fd640 1 -- 172.21.15.2:0/2501734276 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f374006e530 msgr2=0x7f37400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.800+0000 7f375b8fd640 1 --2- 172.21.15.2:0/2501734276 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f374006e530 0x7f37400709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3750007fd0 tx=0x7f3750009e90 comp rx=0 tx=0).stop 2024-09-17T01:12:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.800+0000 7f375b8fd640 1 -- 172.21.15.2:0/2501734276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540fb4d0 msgr2=0x7f3754115360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.800+0000 7f375b8fd640 1 --2- 172.21.15.2:0/2501734276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540fb4d0 0x7f3754115360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3748000c00 tx=0x7f3748009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.801+0000 7f375b8fd640 1 -- 172.21.15.2:0/2501734276 shutdown_connections 2024-09-17T01:12:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.801+0000 7f375b8fd640 1 --2- 172.21.15.2:0/2501734276 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f374006e530 0x7f37400709e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.801+0000 7f375b8fd640 1 --2- 172.21.15.2:0/2501734276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3754101510 0x7f37541158a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.801+0000 7f375b8fd640 1 --2- 172.21.15.2:0/2501734276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37540fb4d0 0x7f3754115360 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.801+0000 7f375b8fd640 1 -- 172.21.15.2:0/2501734276 >> 172.21.15.2:0/2501734276 conn(0x7f37540f7090 msgr2=0x7f37540659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.801+0000 7f375b8fd640 1 -- 172.21.15.2:0/2501734276 shutdown_connections 2024-09-17T01:12:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:28.801+0000 7f375b8fd640 1 -- 172.21.15.2:0/2501734276 wait complete. 2024-09-17T01:12:29.374 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:29 smithi002 ceph-mon[98018]: pgmap v262: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:29.374 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:29 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/2501734276' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:29.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:29 smithi099 ceph-mon[77412]: pgmap v262: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:29.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:29 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/2501734276' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:29.646 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-17T01:12:29.913 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:12:31.269 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:31 smithi002 ceph-mon[98018]: pgmap v263: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:31.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.520+0000 7fbc4a180640 1 -- 172.21.15.2:0/2800356737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc440fd760 msgr2=0x7fbc440fdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:31.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.520+0000 7fbc4a180640 1 --2- 172.21.15.2:0/2800356737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc440fd760 0x7fbc440fdb30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbc340048d0 tx=0x7fbc34009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:31.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.520+0000 7fbc4a180640 1 -- 172.21.15.2:0/2800356737 shutdown_connections 2024-09-17T01:12:31.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.520+0000 7fbc4a180640 1 --2- 172.21.15.2:0/2800356737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc440fe100 0x7fbc441065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:31.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.520+0000 7fbc4a180640 1 --2- 172.21.15.2:0/2800356737 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc440fd760 0x7fbc440fdb30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:31.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.520+0000 7fbc4a180640 1 -- 172.21.15.2:0/2800356737 >> 172.21.15.2:0/2800356737 conn(0x7fbc440f7030 msgr2=0x7fbc440f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.520+0000 7fbc4a180640 1 -- 172.21.15.2:0/2800356737 shutdown_connections 2024-09-17T01:12:31.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.520+0000 7fbc4a180640 1 -- 172.21.15.2:0/2800356737 wait complete. 2024-09-17T01:12:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.520+0000 7fbc4a180640 1 Processor -- start 2024-09-17T01:12:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.521+0000 7fbc4a180640 1 -- start start 2024-09-17T01:12:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.521+0000 7fbc4a180640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc440fd760 0x7fbc44113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.522+0000 7fbc4a180640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc440fe100 0x7fbc44113870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.522+0000 7fbc4a180640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44113e70 con 0x7fbc440fd760 2024-09-17T01:12:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.522+0000 7fbc4a180640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4410d2b0 con 0x7fbc440fe100 2024-09-17T01:12:31.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.522+0000 7fbc437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc440fd760 0x7fbc44113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:31.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.522+0000 7fbc437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc440fd760 0x7fbc44113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44230/0 (socket says 172.21.15.2:44230) 2024-09-17T01:12:31.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.522+0000 7fbc437fe640 1 -- 172.21.15.2:0/1019006869 learned_addr learned my addr 172.21.15.2:0/1019006869 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:12:31.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.522+0000 7fbc3affd640 1 --2- 172.21.15.2:0/1019006869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc440fe100 0x7fbc44113870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:31.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.522+0000 7fbc437fe640 1 -- 172.21.15.2:0/1019006869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc440fe100 msgr2=0x7fbc44113870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:31.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.522+0000 7fbc437fe640 1 --2- 172.21.15.2:0/1019006869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc440fe100 0x7fbc44113870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:31.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.522+0000 7fbc437fe640 1 -- 172.21.15.2:0/1019006869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc34005040 con 0x7fbc440fd760 2024-09-17T01:12:31.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.522+0000 7fbc437fe640 1 --2- 172.21.15.2:0/1019006869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc440fd760 0x7fbc44113330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbc34000c00 tx=0x7fbc34009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:31.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.523+0000 7fbc40ff9640 1 -- 172.21.15.2:0/1019006869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc34038070 con 0x7fbc440fd760 2024-09-17T01:12:31.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.523+0000 7fbc40ff9640 1 -- 172.21.15.2:0/1019006869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbc3402ade0 con 0x7fbc440fd760 2024-09-17T01:12:31.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.523+0000 7fbc4a180640 1 -- 172.21.15.2:0/1019006869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4410d530 con 0x7fbc440fd760 2024-09-17T01:12:31.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.523+0000 7fbc40ff9640 1 -- 172.21.15.2:0/1019006869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc3402c7e0 con 0x7fbc440fd760 2024-09-17T01:12:31.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.523+0000 7fbc4a180640 1 -- 172.21.15.2:0/1019006869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4410d9f0 con 0x7fbc440fd760 2024-09-17T01:12:31.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.524+0000 7fbc4a180640 1 -- 172.21.15.2:0/1019006869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc440fac90 con 0x7fbc440fd760 2024-09-17T01:12:31.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.524+0000 7fbc40ff9640 1 -- 172.21.15.2:0/1019006869 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fbc34030020 con 0x7fbc440fd760 2024-09-17T01:12:31.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.525+0000 7fbc40ff9640 1 --2- 172.21.15.2:0/1019006869 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbc3006e530 0x7fbc300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:31.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.525+0000 7fbc40ff9640 1 -- 172.21.15.2:0/1019006869 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fbc340ade30 con 0x7fbc440fd760 2024-09-17T01:12:31.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.525+0000 7fbc3affd640 1 --2- 172.21.15.2:0/1019006869 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbc3006e530 0x7fbc300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:31.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.525+0000 7fbc3affd640 1 --2- 172.21.15.2:0/1019006869 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbc3006e530 0x7fbc300709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc4410ebf0 tx=0x7fbc2c009ef0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:31.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.529+0000 7fbc40ff9640 1 -- 172.21.15.2:0/1019006869 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbc34076f20 con 0x7fbc440fd760 2024-09-17T01:12:31.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:31 smithi099 ceph-mon[77412]: pgmap v263: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:31.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.776+0000 7fbc4a180640 1 -- 172.21.15.2:0/1019006869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbc4410e9a0 con 0x7fbc440fd760 2024-09-17T01:12:31.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.777+0000 7fbc40ff9640 1 -- 172.21.15.2:0/1019006869 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fbc3407a5e0 con 0x7fbc440fd760 2024-09-17T01:12:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.779+0000 7fbc4a180640 1 -- 172.21.15.2:0/1019006869 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbc3006e530 msgr2=0x7fbc300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.779+0000 7fbc4a180640 1 --2- 172.21.15.2:0/1019006869 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbc3006e530 0x7fbc300709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc4410ebf0 tx=0x7fbc2c009ef0 comp rx=0 tx=0).stop 2024-09-17T01:12:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.779+0000 7fbc4a180640 1 -- 172.21.15.2:0/1019006869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc440fd760 msgr2=0x7fbc44113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.779+0000 7fbc4a180640 1 --2- 172.21.15.2:0/1019006869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc440fd760 0x7fbc44113330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbc34000c00 tx=0x7fbc34009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.779+0000 7fbc4a180640 1 -- 172.21.15.2:0/1019006869 shutdown_connections 2024-09-17T01:12:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.779+0000 7fbc4a180640 1 --2- 172.21.15.2:0/1019006869 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbc3006e530 0x7fbc300709e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.779+0000 7fbc4a180640 1 --2- 172.21.15.2:0/1019006869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc440fe100 0x7fbc44113870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.779+0000 7fbc4a180640 1 --2- 172.21.15.2:0/1019006869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc440fd760 0x7fbc44113330 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.779+0000 7fbc4a180640 1 -- 172.21.15.2:0/1019006869 >> 172.21.15.2:0/1019006869 conn(0x7fbc440f7030 msgr2=0x7fbc440f8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.779+0000 7fbc4a180640 1 -- 172.21.15.2:0/1019006869 shutdown_connections 2024-09-17T01:12:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:31.779+0000 7fbc4a180640 1 -- 172.21.15.2:0/1019006869 wait complete. 2024-09-17T01:12:31.786 INFO:teuthology.orchestra.run.smithi002.stdout:true 2024-09-17T01:12:32.311 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:32 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1019006869' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -e sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-17T01:12:32.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:32 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1019006869' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:32.728 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:12:33.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:33 smithi002 ceph-mon[98018]: pgmap v264: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:33.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:33 smithi099 ceph-mon[77412]: pgmap v264: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.301+0000 7fce37cd2640 1 -- 172.21.15.2:0/1768545803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce301014c0 msgr2=0x7fce30101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.301+0000 7fce37cd2640 1 --2- 172.21.15.2:0/1768545803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce301014c0 0x7fce30101890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0048d0 tx=0x7fce2c009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.301+0000 7fce37cd2640 1 -- 172.21.15.2:0/1768545803 shutdown_connections 2024-09-17T01:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.301+0000 7fce37cd2640 1 --2- 172.21.15.2:0/1768545803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce300fb480 0x7fce300fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.301+0000 7fce37cd2640 1 --2- 172.21.15.2:0/1768545803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce301014c0 0x7fce30101890 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.301+0000 7fce37cd2640 1 -- 172.21.15.2:0/1768545803 >> 172.21.15.2:0/1768545803 conn(0x7fce300f7000 msgr2=0x7fce300f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.301+0000 7fce37cd2640 1 -- 172.21.15.2:0/1768545803 shutdown_connections 2024-09-17T01:12:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.301+0000 7fce37cd2640 1 -- 172.21.15.2:0/1768545803 wait complete. 2024-09-17T01:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.301+0000 7fce37cd2640 1 Processor -- start 2024-09-17T01:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.301+0000 7fce37cd2640 1 -- start start 2024-09-17T01:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce37cd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce300fb480 0x7fce301131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce37cd2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce301014c0 0x7fce30113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce37cd2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce30113d00 con 0x7fce300fb480 2024-09-17T01:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce37cd2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce30113e70 con 0x7fce301014c0 2024-09-17T01:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce35a6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce300fb480 0x7fce301131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce35a6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce300fb480 0x7fce301131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44250/0 (socket says 172.21.15.2:44250) 2024-09-17T01:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce35a6e640 1 -- 172.21.15.2:0/6982558 learned_addr learned my addr 172.21.15.2:0/6982558 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce3526d640 1 --2- 172.21.15.2:0/6982558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce301014c0 0x7fce30113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce35a6e640 1 -- 172.21.15.2:0/6982558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce301014c0 msgr2=0x7fce30113700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce35a6e640 1 --2- 172.21.15.2:0/6982558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce301014c0 0x7fce30113700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce35a6e640 1 -- 172.21.15.2:0/6982558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c005040 con 0x7fce300fb480 2024-09-17T01:12:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce35a6e640 1 --2- 172.21.15.2:0/6982558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce300fb480 0x7fce301131c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fce2c000c00 tx=0x7fce2c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce267fc640 1 -- 172.21.15.2:0/6982558 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce2c038070 con 0x7fce300fb480 2024-09-17T01:12:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce37cd2640 1 -- 172.21.15.2:0/6982558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3010d290 con 0x7fce300fb480 2024-09-17T01:12:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce267fc640 1 -- 172.21.15.2:0/6982558 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fce2c02ade0 con 0x7fce300fb480 2024-09-17T01:12:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce267fc640 1 -- 172.21.15.2:0/6982558 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce2c02c7e0 con 0x7fce300fb480 2024-09-17T01:12:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.302+0000 7fce37cd2640 1 -- 172.21.15.2:0/6982558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3010d750 con 0x7fce300fb480 2024-09-17T01:12:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.303+0000 7fce37cd2640 1 -- 172.21.15.2:0/6982558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce300fcbc0 con 0x7fce300fb480 2024-09-17T01:12:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.304+0000 7fce267fc640 1 -- 172.21.15.2:0/6982558 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fce2c030020 con 0x7fce300fb480 2024-09-17T01:12:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.304+0000 7fce267fc640 1 --2- 172.21.15.2:0/6982558 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fce1c06e530 0x7fce1c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.304+0000 7fce267fc640 1 -- 172.21.15.2:0/6982558 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fce2c0adf20 con 0x7fce300fb480 2024-09-17T01:12:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.304+0000 7fce3526d640 1 --2- 172.21.15.2:0/6982558 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fce1c06e530 0x7fce1c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.305+0000 7fce3526d640 1 --2- 172.21.15.2:0/6982558 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fce1c06e530 0x7fce1c0709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fce20009fd0 tx=0x7fce20009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.309+0000 7fce267fc640 1 -- 172.21.15.2:0/6982558 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fce2c0e31b0 con 0x7fce300fb480 2024-09-17T01:12:34.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.559+0000 7fce37cd2640 1 -- 172.21.15.2:0/6982558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fce3010e870 con 0x7fce300fb480 2024-09-17T01:12:34.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.560+0000 7fce267fc640 1 -- 172.21.15.2:0/6982558 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fce2c076f90 con 0x7fce300fb480 2024-09-17T01:12:34.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.562+0000 7fce37cd2640 1 -- 172.21.15.2:0/6982558 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fce1c06e530 msgr2=0x7fce1c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:34.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.562+0000 7fce37cd2640 1 --2- 172.21.15.2:0/6982558 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fce1c06e530 0x7fce1c0709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fce20009fd0 tx=0x7fce20009e50 comp rx=0 tx=0).stop 2024-09-17T01:12:34.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.562+0000 7fce37cd2640 1 -- 172.21.15.2:0/6982558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce300fb480 msgr2=0x7fce301131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:34.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.562+0000 7fce37cd2640 1 --2- 172.21.15.2:0/6982558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce300fb480 0x7fce301131c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fce2c000c00 tx=0x7fce2c009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:34.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.562+0000 7fce37cd2640 1 -- 172.21.15.2:0/6982558 shutdown_connections 2024-09-17T01:12:34.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.562+0000 7fce37cd2640 1 --2- 172.21.15.2:0/6982558 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fce1c06e530 0x7fce1c0709e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:34.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.562+0000 7fce37cd2640 1 --2- 172.21.15.2:0/6982558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce301014c0 0x7fce30113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:34.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.562+0000 7fce37cd2640 1 --2- 172.21.15.2:0/6982558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce300fb480 0x7fce301131c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:34.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.562+0000 7fce37cd2640 1 -- 172.21.15.2:0/6982558 >> 172.21.15.2:0/6982558 conn(0x7fce300f7000 msgr2=0x7fce300659f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:34.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.562+0000 7fce37cd2640 1 -- 172.21.15.2:0/6982558 shutdown_connections 2024-09-17T01:12:34.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:34.562+0000 7fce37cd2640 1 -- 172.21.15.2:0/6982558 wait complete. 2024-09-17T01:12:34.569 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)" 2024-09-17T01:12:35.142 DEBUG:teuthology.parallel:result is None 2024-09-17T01:12:35.142 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:12:35.153 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T01:12:35.153 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T01:12:35.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:35 smithi002 ceph-mon[98018]: pgmap v265: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:35.154 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:35 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/6982558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:12:35.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:35 smithi099 ceph-mon[77412]: pgmap v265: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:35.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:35 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/6982558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:12:36.405 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:36 smithi002 ceph-mon[98018]: pgmap v266: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:36.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:36 smithi099 ceph-mon[77412]: pgmap v266: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:36.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.946+0000 7f81d4cd0640 1 -- 172.21.15.2:0/4004465088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d0102580 msgr2=0x7f81d0102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:36.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.946+0000 7f81d4cd0640 1 --2- 172.21.15.2:0/4004465088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d0102580 0x7f81d0102950 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f81c00048d0 tx=0x7f81c0009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.946+0000 7f81d4cd0640 1 -- 172.21.15.2:0/4004465088 shutdown_connections 2024-09-17T01:12:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.946+0000 7f81d4cd0640 1 --2- 172.21.15.2:0/4004465088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81d0102f20 0x7f81d00fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.946+0000 7f81d4cd0640 1 --2- 172.21.15.2:0/4004465088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d0102580 0x7f81d0102950 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.946+0000 7f81d4cd0640 1 -- 172.21.15.2:0/4004465088 >> 172.21.15.2:0/4004465088 conn(0x7f81d00f81a0 msgr2=0x7f81d00fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.946+0000 7f81d4cd0640 1 -- 172.21.15.2:0/4004465088 shutdown_connections 2024-09-17T01:12:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.946+0000 7f81d4cd0640 1 -- 172.21.15.2:0/4004465088 wait complete. 2024-09-17T01:12:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.947+0000 7f81d4cd0640 1 Processor -- start 2024-09-17T01:12:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.947+0000 7f81d4cd0640 1 -- start start 2024-09-17T01:12:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.947+0000 7f81d4cd0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d0102580 0x7f81d0113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.947+0000 7f81d4cd0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81d0102f20 0x7f81d0113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.947+0000 7f81d4cd0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d0113d60 con 0x7f81d0102580 2024-09-17T01:12:36.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.947+0000 7f81d4cd0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d010d1a0 con 0x7f81d0102f20 2024-09-17T01:12:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.947+0000 7f81ce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d0102580 0x7f81d0113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.947+0000 7f81ce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d0102580 0x7f81d0113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44272/0 (socket says 172.21.15.2:44272) 2024-09-17T01:12:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.947+0000 7f81ce59c640 1 -- 172.21.15.2:0/31312035 learned_addr learned my addr 172.21.15.2:0/31312035 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:12:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.947+0000 7f81cdd9b640 1 --2- 172.21.15.2:0/31312035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81d0102f20 0x7f81d0113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.947+0000 7f81ce59c640 1 -- 172.21.15.2:0/31312035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81d0102f20 msgr2=0x7f81d0113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.947+0000 7f81ce59c640 1 --2- 172.21.15.2:0/31312035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81d0102f20 0x7f81d0113760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.948+0000 7f81ce59c640 1 -- 172.21.15.2:0/31312035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c0005040 con 0x7f81d0102580 2024-09-17T01:12:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.948+0000 7f81cdd9b640 1 --2- 172.21.15.2:0/31312035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81d0102f20 0x7f81d0113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:12:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.948+0000 7f81ce59c640 1 --2- 172.21.15.2:0/31312035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d0102580 0x7f81d0113220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f81c0000c00 tx=0x7f81c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.948+0000 7f81beffd640 1 -- 172.21.15.2:0/31312035 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81c0038070 con 0x7f81d0102580 2024-09-17T01:12:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.948+0000 7f81d4cd0640 1 -- 172.21.15.2:0/31312035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d010d420 con 0x7f81d0102580 2024-09-17T01:12:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.948+0000 7f81beffd640 1 -- 172.21.15.2:0/31312035 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f81c002ade0 con 0x7f81d0102580 2024-09-17T01:12:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.948+0000 7f81beffd640 1 -- 172.21.15.2:0/31312035 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81c002c7b0 con 0x7f81d0102580 2024-09-17T01:12:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.948+0000 7f81d4cd0640 1 -- 172.21.15.2:0/31312035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d010d960 con 0x7f81d0102580 2024-09-17T01:12:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.949+0000 7f81d4cd0640 1 -- 172.21.15.2:0/31312035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d00fdd00 con 0x7f81d0102580 2024-09-17T01:12:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.950+0000 7f81beffd640 1 -- 172.21.15.2:0/31312035 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f81c0030020 con 0x7f81d0102580 2024-09-17T01:12:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.950+0000 7f81beffd640 1 --2- 172.21.15.2:0/31312035 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f81b806e530 0x7f81b80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.950+0000 7f81beffd640 1 -- 172.21.15.2:0/31312035 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f81c00ae7a0 con 0x7f81d0102580 2024-09-17T01:12:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.950+0000 7f81cdd9b640 1 --2- 172.21.15.2:0/31312035 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f81b806e530 0x7f81b80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.951+0000 7f81cdd9b640 1 --2- 172.21.15.2:0/31312035 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f81b806e530 0x7f81b80709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f81d010eae0 tx=0x7f81c400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:36.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:36.955+0000 7f81beffd640 1 -- 172.21.15.2:0/31312035 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f81c0077760 con 0x7f81d0102580 2024-09-17T01:12:37.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:37.169+0000 7f81d4cd0640 1 -- 172.21.15.2:0/31312035 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f81d00fbda0 con 0x7f81d0102580 2024-09-17T01:12:37.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:37.169+0000 7f81beffd640 1 -- 172.21.15.2:0/31312035 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 45 v45) v1 ==== 76+0+1998 (secure 0 0 0) 0x7f81c007ae20 con 0x7f81d0102580 2024-09-17T01:12:37.168 INFO:teuthology.orchestra.run.smithi002.stdout:e45 2024-09-17T01:12:37.168 INFO:teuthology.orchestra.run.smithi002.stdout:btime 2024-09-17T01:11:00:897892+0000 2024-09-17T01:12:37.168 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:12:37.168 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T01:12:37.168 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-09-17T01:12:37.168 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:12:37.168 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:12:37.168 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-09-17T01:12:37.168 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 45 2024-09-17T01:12:37.169 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:12:37.169 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-17T00:59:20.485696+0000 2024-09-17T01:12:37.169 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-09-17T01:11:00.897869+0000 2024-09-17T01:12:37.169 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-09-17T01:12:37.169 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-09-17T01:12:37.169 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2024-09-17T01:12:37.169 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-09-17T01:12:37.169 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-09-17T01:12:37.169 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-09-17T01:12:37.169 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-09-17T01:12:37.169 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-09-17T01:12:37.169 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 91 2024-09-17T01:12:37.169 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:12:37.170 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2024-09-17T01:12:37.170 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2024-09-17T01:12:37.170 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=34388,1=34420} 2024-09-17T01:12:37.170 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-09-17T01:12:37.170 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-09-17T01:12:37.170 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-09-17T01:12:37.170 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2024-09-17T01:12:37.170 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-09-17T01:12:37.170 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2024-09-17T01:12:37.170 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-09-17T01:12:37.170 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-09-17T01:12:37.170 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2024-09-17T01:12:37.170 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 34388 members: 34420,34388 2024-09-17T01:12:37.170 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.zmrgxd{0:34388} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.2:6826/2424122669,v1:172.21.15.2:6827/2424122669] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:12:37.171 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.hgawhu{0:44349} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.99:6824/1774556036,v1:172.21.15.99:6825/1774556036] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:12:37.171 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.fmyyzz{1:34420} state up:active seq 16 join_fscid=1 addr [v2:172.21.15.2:6828/2400957585,v1:172.21.15.2:6829/2400957585] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:12:37.171 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi099.heckcd{1:44375} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/4220578351,v1:172.21.15.99:6827/4220578351] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:12:37.171 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:12:37.171 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:12:37.171 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 45 2024-09-17T01:12:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:37.171+0000 7f81d4cd0640 1 -- 172.21.15.2:0/31312035 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f81b806e530 msgr2=0x7f81b80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:37.171+0000 7f81d4cd0640 1 --2- 172.21.15.2:0/31312035 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f81b806e530 0x7f81b80709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f81d010eae0 tx=0x7f81c400b040 comp rx=0 tx=0).stop 2024-09-17T01:12:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:37.171+0000 7f81d4cd0640 1 -- 172.21.15.2:0/31312035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d0102580 msgr2=0x7f81d0113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:37.171+0000 7f81d4cd0640 1 --2- 172.21.15.2:0/31312035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d0102580 0x7f81d0113220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f81c0000c00 tx=0x7f81c0009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:37.171+0000 7f81d4cd0640 1 -- 172.21.15.2:0/31312035 shutdown_connections 2024-09-17T01:12:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:37.171+0000 7f81d4cd0640 1 --2- 172.21.15.2:0/31312035 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f81b806e530 0x7f81b80709e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:37.171+0000 7f81d4cd0640 1 --2- 172.21.15.2:0/31312035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81d0102f20 0x7f81d0113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:37.171+0000 7f81d4cd0640 1 --2- 172.21.15.2:0/31312035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81d0102580 0x7f81d0113220 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:37.171+0000 7f81d4cd0640 1 -- 172.21.15.2:0/31312035 >> 172.21.15.2:0/31312035 conn(0x7f81d00f81a0 msgr2=0x7f81d00f91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:37.171+0000 7f81d4cd0640 1 -- 172.21.15.2:0/31312035 shutdown_connections 2024-09-17T01:12:37.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:37.171+0000 7f81d4cd0640 1 -- 172.21.15.2:0/31312035 wait complete. 2024-09-17T01:12:37.463 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:37 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/31312035' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:12:37.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:37 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/31312035' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:12:37.808 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-17T01:12:37.819 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-17T01:12:38.076 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:12:38.510 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:38 smithi002 ceph-mon[98018]: pgmap v267: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:38.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:38 smithi099 ceph-mon[77412]: pgmap v267: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.624+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1815929097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfcc102ed0 msgr2=0x7fbfcc0fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.624+0000 7fbfd3d80640 1 --2- 172.21.15.2:0/1815929097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfcc102ed0 0x7fbfcc0fc590 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00048d0 tx=0x7fbfc0009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.624+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1815929097 shutdown_connections 2024-09-17T01:12:39.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.624+0000 7fbfd3d80640 1 --2- 172.21.15.2:0/1815929097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfcc102ed0 0x7fbfcc0fc590 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.624+0000 7fbfd3d80640 1 --2- 172.21.15.2:0/1815929097 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfcc102530 0x7fbfcc102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.624+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1815929097 >> 172.21.15.2:0/1815929097 conn(0x7fbfcc0f80f0 msgr2=0x7fbfcc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.624+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1815929097 shutdown_connections 2024-09-17T01:12:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.624+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1815929097 wait complete. 2024-09-17T01:12:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.624+0000 7fbfd3d80640 1 Processor -- start 2024-09-17T01:12:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.625+0000 7fbfd3d80640 1 -- start start 2024-09-17T01:12:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.625+0000 7fbfd3d80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfcc102530 0x7fbfcc1131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.625+0000 7fbfd3d80640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfcc102ed0 0x7fbfcc113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.625+0000 7fbfd3d80640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc113d30 con 0x7fbfcc102530 2024-09-17T01:12:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.625+0000 7fbfd3d80640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc10d170 con 0x7fbfcc102ed0 2024-09-17T01:12:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.625+0000 7fbfd1b1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfcc102530 0x7fbfcc1131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.625+0000 7fbfd1b1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfcc102530 0x7fbfcc1131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44292/0 (socket says 172.21.15.2:44292) 2024-09-17T01:12:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.625+0000 7fbfd1b1c640 1 -- 172.21.15.2:0/1859651112 learned_addr learned my addr 172.21.15.2:0/1859651112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:12:39.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.625+0000 7fbfd131b640 1 --2- 172.21.15.2:0/1859651112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfcc102ed0 0x7fbfcc113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.625+0000 7fbfd1b1c640 1 -- 172.21.15.2:0/1859651112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfcc102ed0 msgr2=0x7fbfcc113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.625+0000 7fbfd1b1c640 1 --2- 172.21.15.2:0/1859651112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfcc102ed0 0x7fbfcc113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.625+0000 7fbfd1b1c640 1 -- 172.21.15.2:0/1859651112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc0005040 con 0x7fbfcc102530 2024-09-17T01:12:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.626+0000 7fbfd1b1c640 1 --2- 172.21.15.2:0/1859651112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfcc102530 0x7fbfcc1131f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00db00 tx=0x7fbfbc004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.626+0000 7fbfca7fc640 1 -- 172.21.15.2:0/1859651112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfbc017070 con 0x7fbfcc102530 2024-09-17T01:12:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.626+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1859651112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfcc10d450 con 0x7fbfcc102530 2024-09-17T01:12:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.626+0000 7fbfca7fc640 1 -- 172.21.15.2:0/1859651112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbfbc00f040 con 0x7fbfcc102530 2024-09-17T01:12:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.626+0000 7fbfca7fc640 1 -- 172.21.15.2:0/1859651112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfbc003960 con 0x7fbfcc102530 2024-09-17T01:12:39.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.626+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1859651112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfcc10d9c0 con 0x7fbfcc102530 2024-09-17T01:12:39.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.627+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1859651112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfcc0fdcb0 con 0x7fbfcc102530 2024-09-17T01:12:39.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.628+0000 7fbfca7fc640 1 -- 172.21.15.2:0/1859651112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fbfbc003b50 con 0x7fbfcc102530 2024-09-17T01:12:39.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.628+0000 7fbfca7fc640 1 --2- 172.21.15.2:0/1859651112 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbfb406e530 0x7fbfb40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:39.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.628+0000 7fbfca7fc640 1 -- 172.21.15.2:0/1859651112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fbfbc08e2b0 con 0x7fbfcc102530 2024-09-17T01:12:39.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.628+0000 7fbfd131b640 1 --2- 172.21.15.2:0/1859651112 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbfb406e530 0x7fbfb40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:39.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.629+0000 7fbfd131b640 1 --2- 172.21.15.2:0/1859651112 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbfb406e530 0x7fbfb40709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00048a0 tx=0x7fbfc0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:39.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.633+0000 7fbfca7fc640 1 -- 172.21.15.2:0/1859651112 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbfbc057270 con 0x7fbfcc102530 2024-09-17T01:12:39.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.841+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1859651112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbfcc109560 con 0x7fbfcc102530 2024-09-17T01:12:39.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.842+0000 7fbfca7fc640 1 -- 172.21.15.2:0/1859651112 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+5282 (secure 0 0 0) 0x7fbfbc05a930 con 0x7fbfcc102530 2024-09-17T01:12:39.841 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:12:39.841 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":45,"btime":"2024-09-17T01:11:00:897892+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":45,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:11:00.897869+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":0,"incarnation":38,"state":"up:active","state_seq":20,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi002.fmyyzz","rank":1,"incarnation":38,"state":"up:active","state_seq":16,"addr":"172.21.15.2:6829/2400957585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2400957585},{"type":"v1","addr":"172.21.15.2:6829","nonce":2400957585}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44349":{"gid":44349,"name":"cephfs.smithi099.hgawhu","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6825/1774556036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1774556036},{"type":"v1","addr":"172.21.15.99:6825","nonce":1774556036}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44375":{"gid":44375,"name":"cephfs.smithi099.heckcd","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6827/4220578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4220578351},{"type":"v1","addr":"172.21.15.99:6827","nonce":4220578351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34388,"qdb_cluster":[34420,34388]},"id":1}]} 2024-09-17T01:12:39.841 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 45 2024-09-17T01:12:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.844+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1859651112 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbfb406e530 msgr2=0x7fbfb40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.844+0000 7fbfd3d80640 1 --2- 172.21.15.2:0/1859651112 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbfb406e530 0x7fbfb40709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00048a0 tx=0x7fbfc0035040 comp rx=0 tx=0).stop 2024-09-17T01:12:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.844+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1859651112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfcc102530 msgr2=0x7fbfcc1131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.844+0000 7fbfd3d80640 1 --2- 172.21.15.2:0/1859651112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfcc102530 0x7fbfcc1131f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00db00 tx=0x7fbfbc004e60 comp rx=0 tx=0).stop 2024-09-17T01:12:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.844+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1859651112 shutdown_connections 2024-09-17T01:12:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.844+0000 7fbfd3d80640 1 --2- 172.21.15.2:0/1859651112 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbfb406e530 0x7fbfb40709e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.844+0000 7fbfd3d80640 1 --2- 172.21.15.2:0/1859651112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbfcc102ed0 0x7fbfcc113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.844+0000 7fbfd3d80640 1 --2- 172.21.15.2:0/1859651112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfcc102530 0x7fbfcc1131f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.844+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1859651112 >> 172.21.15.2:0/1859651112 conn(0x7fbfcc0f80f0 msgr2=0x7fbfcc0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.844+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1859651112 shutdown_connections 2024-09-17T01:12:39.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:39.844+0000 7fbfd3d80640 1 -- 172.21.15.2:0/1859651112 wait complete. 2024-09-17T01:12:40.463 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:40 smithi002 ceph-mon[98018]: pgmap v268: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:40.463 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:40 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1859651112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.463 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:40 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:40.489 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 21, 'max_mds': 2, 'flags': 50} 2024-09-17T01:12:40.489 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-17T01:12:40.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:40 smithi099 ceph-mon[77412]: pgmap v268: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:40.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:40 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1859651112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:12:40.543 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:40 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:40.751 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:12:42.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.282+0000 7f03bd1db640 1 -- 172.21.15.2:0/1130494192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8102ed0 msgr2=0x7f03b80fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.282+0000 7f03bd1db640 1 --2- 172.21.15.2:0/1130494192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8102ed0 0x7f03b80fc590 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0048d0 tx=0x7f03ac009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.282+0000 7f03bd1db640 1 -- 172.21.15.2:0/1130494192 shutdown_connections 2024-09-17T01:12:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.282+0000 7f03bd1db640 1 --2- 172.21.15.2:0/1130494192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8102ed0 0x7f03b80fc590 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.282+0000 7f03bd1db640 1 --2- 172.21.15.2:0/1130494192 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b8102530 0x7f03b8102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.282+0000 7f03bd1db640 1 -- 172.21.15.2:0/1130494192 >> 172.21.15.2:0/1130494192 conn(0x7f03b80f80f0 msgr2=0x7f03b80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.282+0000 7f03bd1db640 1 -- 172.21.15.2:0/1130494192 shutdown_connections 2024-09-17T01:12:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.282+0000 7f03bd1db640 1 -- 172.21.15.2:0/1130494192 wait complete. 2024-09-17T01:12:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.283+0000 7f03bd1db640 1 Processor -- start 2024-09-17T01:12:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.283+0000 7f03bd1db640 1 -- start start 2024-09-17T01:12:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.283+0000 7f03bd1db640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8102530 0x7f03b806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.283+0000 7f03bd1db640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b8102ed0 0x7f03b806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.283+0000 7f03bd1db640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b8070520 con 0x7f03b8102530 2024-09-17T01:12:42.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.283+0000 7f03bd1db640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b8070690 con 0x7f03b8102ed0 2024-09-17T01:12:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.283+0000 7f03b6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8102530 0x7f03b806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.283+0000 7f03b6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8102530 0x7f03b806fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54728/0 (socket says 172.21.15.2:54728) 2024-09-17T01:12:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.283+0000 7f03b6d9d640 1 -- 172.21.15.2:0/3451648858 learned_addr learned my addr 172.21.15.2:0/3451648858 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:12:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.283+0000 7f03b659c640 1 --2- 172.21.15.2:0/3451648858 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b8102ed0 0x7f03b806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.283+0000 7f03b6d9d640 1 -- 172.21.15.2:0/3451648858 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b8102ed0 msgr2=0x7f03b806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.283+0000 7f03b6d9d640 1 --2- 172.21.15.2:0/3451648858 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b8102ed0 0x7f03b806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:42.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.283+0000 7f03b6d9d640 1 -- 172.21.15.2:0/3451648858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac005040 con 0x7f03b8102530 2024-09-17T01:12:42.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.284+0000 7f03b6d9d640 1 --2- 172.21.15.2:0/3451648858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8102530 0x7f03b806fa10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f03a800b790 tx=0x7f03a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:42.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.284+0000 7f039f7fe640 1 -- 172.21.15.2:0/3451648858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03a800c700 con 0x7f03b8102530 2024-09-17T01:12:42.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.284+0000 7f039f7fe640 1 -- 172.21.15.2:0/3451648858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f03a800cd00 con 0x7f03b8102530 2024-09-17T01:12:42.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.284+0000 7f03bd1db640 1 -- 172.21.15.2:0/3451648858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b81195d0 con 0x7f03b8102530 2024-09-17T01:12:42.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.284+0000 7f039f7fe640 1 -- 172.21.15.2:0/3451648858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03a8015e80 con 0x7f03b8102530 2024-09-17T01:12:42.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.284+0000 7f03bd1db640 1 -- 172.21.15.2:0/3451648858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b81199c0 con 0x7f03b8102530 2024-09-17T01:12:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.285+0000 7f03bd1db640 1 -- 172.21.15.2:0/3451648858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b80fdcb0 con 0x7f03b8102530 2024-09-17T01:12:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.285+0000 7f039f7fe640 1 -- 172.21.15.2:0/3451648858 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f03a8012070 con 0x7f03b8102530 2024-09-17T01:12:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.286+0000 7f039f7fe640 1 --2- 172.21.15.2:0/3451648858 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03a006e530 0x7f03a00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.286+0000 7f039f7fe640 1 -- 172.21.15.2:0/3451648858 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f03a808dbb0 con 0x7f03b8102530 2024-09-17T01:12:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.286+0000 7f03b659c640 1 --2- 172.21.15.2:0/3451648858 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03a006e530 0x7f03a00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:42.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.286+0000 7f03b659c640 1 --2- 172.21.15.2:0/3451648858 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03a006e530 0x7f03a00709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0048a0 tx=0x7f03ac035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:42.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.290+0000 7f039f7fe640 1 -- 172.21.15.2:0/3451648858 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f03a8094080 con 0x7f03b8102530 2024-09-17T01:12:42.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:42 smithi002 ceph-mon[98018]: pgmap v269: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:42.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.504+0000 7f03bd1db640 1 -- 172.21.15.2:0/3451648858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f03b804b7b0 con 0x7f03b8102530 2024-09-17T01:12:42.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.505+0000 7f039f7fe640 1 -- 172.21.15.2:0/3451648858 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v45) v1 ==== 107+0+4922 (secure 0 0 0) 0x7f03a8056b70 con 0x7f03b8102530 2024-09-17T01:12:42.503 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:12:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":22,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:01:17.666572+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi002.fmyyzz","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6829/1494631266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1494631266},{"type":"v1","addr":"172.21.15.2:6829","nonce":1494631266}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi099.hgawhu","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6825/4057317500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4057317500},{"type":"v1","addr":"172.21.15.99:6825","nonce":4057317500}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24279":{"gid":24279,"name":"cephfs.smithi099.heckcd","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.99:6827/689359372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":689359372},{"type":"v1","addr":"172.21.15.99:6827","nonce":689359372}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24287":{"gid":24287,"name":"cephfs.smithi002.zmrgxd","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6827/2986470392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2986470392},{"type":"v1","addr":"172.21.15.2:6827","nonce":2986470392}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:12:42.504 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 22 2024-09-17T01:12:42.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.507+0000 7f03bd1db640 1 -- 172.21.15.2:0/3451648858 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03a006e530 msgr2=0x7f03a00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:42.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.507+0000 7f03bd1db640 1 --2- 172.21.15.2:0/3451648858 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03a006e530 0x7f03a00709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0048a0 tx=0x7f03ac035040 comp rx=0 tx=0).stop 2024-09-17T01:12:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.507+0000 7f03bd1db640 1 -- 172.21.15.2:0/3451648858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8102530 msgr2=0x7f03b806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.507+0000 7f03bd1db640 1 --2- 172.21.15.2:0/3451648858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8102530 0x7f03b806fa10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f03a800b790 tx=0x7f03a80091d0 comp rx=0 tx=0).stop 2024-09-17T01:12:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.507+0000 7f03bd1db640 1 -- 172.21.15.2:0/3451648858 shutdown_connections 2024-09-17T01:12:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.507+0000 7f03bd1db640 1 --2- 172.21.15.2:0/3451648858 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f03a006e530 0x7f03a00709e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.507+0000 7f03bd1db640 1 --2- 172.21.15.2:0/3451648858 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03b8102ed0 0x7f03b806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.507+0000 7f03bd1db640 1 --2- 172.21.15.2:0/3451648858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03b8102530 0x7f03b806fa10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.507+0000 7f03bd1db640 1 -- 172.21.15.2:0/3451648858 >> 172.21.15.2:0/3451648858 conn(0x7f03b80f80f0 msgr2=0x7f03b80f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.507+0000 7f03bd1db640 1 -- 172.21.15.2:0/3451648858 shutdown_connections 2024-09-17T01:12:42.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:42.507+0000 7f03bd1db640 1 -- 172.21.15.2:0/3451648858 wait complete. 2024-09-17T01:12:42.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:42 smithi099 ceph-mon[77412]: pgmap v269: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:43.288 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-17T01:12:43.542 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:43 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3451648858' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-17T01:12:43.548 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:12:43.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:43 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3451648858' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-17T01:12:44.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:44 smithi002 ceph-mon[98018]: pgmap v270: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:45.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:44 smithi099 ceph-mon[77412]: pgmap v270: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:45.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.264+0000 7f2027854640 1 -- 172.21.15.2:0/3486834434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20200fb810 msgr2=0x7f20200fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:45.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.264+0000 7f2027854640 1 --2- 172.21.15.2:0/3486834434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20200fb810 0x7f20200fbbe0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2010009c50 tx=0x7f2010004d10 comp rx=0 tx=0).stop 2024-09-17T01:12:45.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.264+0000 7f2027854640 1 -- 172.21.15.2:0/3486834434 shutdown_connections 2024-09-17T01:12:45.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.264+0000 7f2027854640 1 --2- 172.21.15.2:0/3486834434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20200fcf80 0x7f20200fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:45.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.264+0000 7f2027854640 1 --2- 172.21.15.2:0/3486834434 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20200fb810 0x7f20200fbbe0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:45.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.264+0000 7f2027854640 1 -- 172.21.15.2:0/3486834434 >> 172.21.15.2:0/3486834434 conn(0x7f20200723b0 msgr2=0x7f20200727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:45.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.264+0000 7f2027854640 1 -- 172.21.15.2:0/3486834434 shutdown_connections 2024-09-17T01:12:45.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.264+0000 7f2027854640 1 -- 172.21.15.2:0/3486834434 wait complete. 2024-09-17T01:12:45.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.265+0000 7f2027854640 1 Processor -- start 2024-09-17T01:12:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.265+0000 7f2027854640 1 -- start start 2024-09-17T01:12:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.265+0000 7f2027854640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20200fb810 0x7f2020113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.265+0000 7f2027854640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20200fcf80 0x7f20201137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.265+0000 7f2027854640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2020113dd0 con 0x7f20200fcf80 2024-09-17T01:12:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.265+0000 7f2027854640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202010d210 con 0x7f20200fb810 2024-09-17T01:12:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.265+0000 7f2024def640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20200fcf80 0x7f20201137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.265+0000 7f2024def640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20200fcf80 0x7f20201137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54738/0 (socket says 172.21.15.2:54738) 2024-09-17T01:12:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.265+0000 7f2024def640 1 -- 172.21.15.2:0/4265834604 learned_addr learned my addr 172.21.15.2:0/4265834604 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:12:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.265+0000 7f20255f0640 1 --2- 172.21.15.2:0/4265834604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20200fb810 0x7f2020113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.265+0000 7f2024def640 1 -- 172.21.15.2:0/4265834604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20200fb810 msgr2=0x7f2020113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:45.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.265+0000 7f2024def640 1 --2- 172.21.15.2:0/4265834604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20200fb810 0x7f2020113290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:45.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.265+0000 7f2024def640 1 -- 172.21.15.2:0/4265834604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20100098b0 con 0x7f20200fcf80 2024-09-17T01:12:45.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.266+0000 7f2024def640 1 --2- 172.21.15.2:0/4265834604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20200fcf80 0x7f20201137d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2014002a50 tx=0x7f2014004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:45.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.266+0000 7f201dffb640 1 -- 172.21.15.2:0/4265834604 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2014007c30 con 0x7f20200fcf80 2024-09-17T01:12:45.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.266+0000 7f2027854640 1 -- 172.21.15.2:0/4265834604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202010d4f0 con 0x7f20200fcf80 2024-09-17T01:12:45.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.266+0000 7f201dffb640 1 -- 172.21.15.2:0/4265834604 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f201400f040 con 0x7f20200fcf80 2024-09-17T01:12:45.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.266+0000 7f201dffb640 1 -- 172.21.15.2:0/4265834604 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f201400db50 con 0x7f20200fcf80 2024-09-17T01:12:45.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.266+0000 7f2027854640 1 -- 172.21.15.2:0/4265834604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202010da10 con 0x7f20200fcf80 2024-09-17T01:12:45.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.267+0000 7f2027854640 1 -- 172.21.15.2:0/4265834604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20200fcbc0 con 0x7f20200fcf80 2024-09-17T01:12:45.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.267+0000 7f201dffb640 1 -- 172.21.15.2:0/4265834604 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f201400dcb0 con 0x7f20200fcf80 2024-09-17T01:12:45.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.268+0000 7f201dffb640 1 --2- 172.21.15.2:0/4265834604 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f200806e530 0x7f20080709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:45.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.268+0000 7f201dffb640 1 -- 172.21.15.2:0/4265834604 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f201408e0d0 con 0x7f20200fcf80 2024-09-17T01:12:45.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.268+0000 7f20255f0640 1 --2- 172.21.15.2:0/4265834604 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f200806e530 0x7f20080709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:45.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.268+0000 7f20255f0640 1 --2- 172.21.15.2:0/4265834604 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f200806e530 0x7f20080709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2010009c20 tx=0x7f2010004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:45.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.272+0000 7f201dffb640 1 -- 172.21.15.2:0/4265834604 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2014057110 con 0x7f20200fcf80 2024-09-17T01:12:45.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.485+0000 7f2027854640 1 -- 172.21.15.2:0/4265834604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f202010e900 con 0x7f20200fcf80 2024-09-17T01:12:45.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.486+0000 7f201dffb640 1 -- 172.21.15.2:0/4265834604 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v45) v1 ==== 107+0+4923 (secure 0 0 0) 0x7f201405a7d0 con 0x7f20200fcf80 2024-09-17T01:12:45.484 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:12:45.484 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:02:38.321321+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi002.fmyyzz","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6829/1494631266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1494631266},{"type":"v1","addr":"172.21.15.2:6829","nonce":1494631266}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi099.hgawhu","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6825/4057317500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4057317500},{"type":"v1","addr":"172.21.15.99:6825","nonce":4057317500}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24279":{"gid":24279,"name":"cephfs.smithi099.heckcd","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.99:6827/689359372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":689359372},{"type":"v1","addr":"172.21.15.99:6827","nonce":689359372}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24287":{"gid":24287,"name":"cephfs.smithi002.zmrgxd","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6827/2986470392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2986470392},{"type":"v1","addr":"172.21.15.2:6827","nonce":2986470392}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:12:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 23 2024-09-17T01:12:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.488+0000 7f2027854640 1 -- 172.21.15.2:0/4265834604 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f200806e530 msgr2=0x7f20080709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.488+0000 7f2027854640 1 --2- 172.21.15.2:0/4265834604 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f200806e530 0x7f20080709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2010009c20 tx=0x7f2010004d10 comp rx=0 tx=0).stop 2024-09-17T01:12:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.488+0000 7f2027854640 1 -- 172.21.15.2:0/4265834604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20200fcf80 msgr2=0x7f20201137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.488+0000 7f2027854640 1 --2- 172.21.15.2:0/4265834604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20200fcf80 0x7f20201137d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2014002a50 tx=0x7f2014004600 comp rx=0 tx=0).stop 2024-09-17T01:12:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.488+0000 7f2027854640 1 -- 172.21.15.2:0/4265834604 shutdown_connections 2024-09-17T01:12:45.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.488+0000 7f2027854640 1 --2- 172.21.15.2:0/4265834604 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f200806e530 0x7f20080709e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:45.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.488+0000 7f2027854640 1 --2- 172.21.15.2:0/4265834604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20200fcf80 0x7f20201137d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:45.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.488+0000 7f2027854640 1 --2- 172.21.15.2:0/4265834604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20200fb810 0x7f2020113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:45.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.488+0000 7f2027854640 1 -- 172.21.15.2:0/4265834604 >> 172.21.15.2:0/4265834604 conn(0x7f20200723b0 msgr2=0x7f2020064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:45.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.488+0000 7f2027854640 1 -- 172.21.15.2:0/4265834604 shutdown_connections 2024-09-17T01:12:45.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:45.488+0000 7f2027854640 1 -- 172.21.15.2:0/4265834604 wait complete. 2024-09-17T01:12:45.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:45 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/4265834604' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-17T01:12:46.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:45 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/4265834604' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-17T01:12:46.251 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-17T01:12:46.514 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:12:46.857 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:46 smithi002 ceph-mon[98018]: pgmap v271: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:47.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:46 smithi099 ceph-mon[77412]: pgmap v271: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:47.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.912+0000 7f3dd9db3640 1 -- 172.21.15.2:0/2668206051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dd4102580 msgr2=0x7f3dd4102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:47.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.912+0000 7f3dd9db3640 1 --2- 172.21.15.2:0/2668206051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dd4102580 0x7f3dd4102950 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40048d0 tx=0x7f3dc4009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:47.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.912+0000 7f3dd9db3640 1 -- 172.21.15.2:0/2668206051 shutdown_connections 2024-09-17T01:12:47.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.913+0000 7f3dd9db3640 1 --2- 172.21.15.2:0/2668206051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dd4102f20 0x7f3dd40fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:47.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.913+0000 7f3dd9db3640 1 --2- 172.21.15.2:0/2668206051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dd4102580 0x7f3dd4102950 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:47.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.913+0000 7f3dd9db3640 1 -- 172.21.15.2:0/2668206051 >> 172.21.15.2:0/2668206051 conn(0x7f3dd40f81a0 msgr2=0x7f3dd40fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:47.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.913+0000 7f3dd9db3640 1 -- 172.21.15.2:0/2668206051 shutdown_connections 2024-09-17T01:12:47.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.913+0000 7f3dd9db3640 1 -- 172.21.15.2:0/2668206051 wait complete. 2024-09-17T01:12:47.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.913+0000 7f3dd9db3640 1 Processor -- start 2024-09-17T01:12:47.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.913+0000 7f3dd9db3640 1 -- start start 2024-09-17T01:12:47.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.913+0000 7f3dd9db3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dd4102580 0x7f3dd406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:47.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.913+0000 7f3dd9db3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dd4102f20 0x7f3dd406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:47.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.913+0000 7f3dd9db3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd4070490 con 0x7f3dd4102580 2024-09-17T01:12:47.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.914+0000 7f3dd9db3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd4070600 con 0x7f3dd4102f20 2024-09-17T01:12:47.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.914+0000 7f3dd37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dd4102580 0x7f3dd406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:47.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.914+0000 7f3dd37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dd4102580 0x7f3dd406fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54758/0 (socket says 172.21.15.2:54758) 2024-09-17T01:12:47.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.914+0000 7f3dd37fe640 1 -- 172.21.15.2:0/580073457 learned_addr learned my addr 172.21.15.2:0/580073457 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:12:47.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.914+0000 7f3dcaffd640 1 --2- 172.21.15.2:0/580073457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dd4102f20 0x7f3dd406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:47.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.914+0000 7f3dd37fe640 1 -- 172.21.15.2:0/580073457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dd4102f20 msgr2=0x7f3dd406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:47.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.914+0000 7f3dd37fe640 1 --2- 172.21.15.2:0/580073457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dd4102f20 0x7f3dd406ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:47.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.914+0000 7f3dd37fe640 1 -- 172.21.15.2:0/580073457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc4005040 con 0x7f3dd4102580 2024-09-17T01:12:47.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.914+0000 7f3dd37fe640 1 --2- 172.21.15.2:0/580073457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dd4102580 0x7f3dd406fa10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4000c00 tx=0x7f3dc4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:47.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.914+0000 7f3dd0ff9640 1 -- 172.21.15.2:0/580073457 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dc4038070 con 0x7f3dd4102580 2024-09-17T01:12:47.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.914+0000 7f3dd9db3640 1 -- 172.21.15.2:0/580073457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd4070830 con 0x7f3dd4102580 2024-09-17T01:12:47.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.914+0000 7f3dd0ff9640 1 -- 172.21.15.2:0/580073457 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3dc402ade0 con 0x7f3dd4102580 2024-09-17T01:12:47.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.914+0000 7f3dd0ff9640 1 -- 172.21.15.2:0/580073457 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dc402c7e0 con 0x7f3dd4102580 2024-09-17T01:12:47.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.915+0000 7f3dd9db3640 1 -- 172.21.15.2:0/580073457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd4119850 con 0x7f3dd4102580 2024-09-17T01:12:47.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.915+0000 7f3dd9db3640 1 -- 172.21.15.2:0/580073457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd40fdd00 con 0x7f3dd4102580 2024-09-17T01:12:47.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.916+0000 7f3dd0ff9640 1 -- 172.21.15.2:0/580073457 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f3dc4030020 con 0x7f3dd4102580 2024-09-17T01:12:47.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.917+0000 7f3dd0ff9640 1 --2- 172.21.15.2:0/580073457 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f3dc006e530 0x7f3dc00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:47.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.917+0000 7f3dd0ff9640 1 -- 172.21.15.2:0/580073457 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f3dc40adf20 con 0x7f3dd4102580 2024-09-17T01:12:47.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.917+0000 7f3dcaffd640 1 --2- 172.21.15.2:0/580073457 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f3dc006e530 0x7f3dc00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:47.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.917+0000 7f3dcaffd640 1 --2- 172.21.15.2:0/580073457 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f3dc006e530 0x7f3dc00709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4071350 tx=0x7f3dbc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:47.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:47.921+0000 7f3dd0ff9640 1 -- 172.21.15.2:0/580073457 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3dc40e31b0 con 0x7f3dd4102580 2024-09-17T01:12:48.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:48.135+0000 7f3dd9db3640 1 -- 172.21.15.2:0/580073457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f3dd40fbda0 con 0x7f3dd4102580 2024-09-17T01:12:48.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:48.135+0000 7f3dd0ff9640 1 -- 172.21.15.2:0/580073457 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v45) v1 ==== 107+0+4937 (secure 0 0 0) 0x7f3dc4076f90 con 0x7f3dd4102580 2024-09-17T01:12:48.134 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:12:48.134 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"btime":"2024-09-17T01:05:19:972157+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:05:19.972153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi002.fmyyzz","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6829/1494631266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1494631266},{"type":"v1","addr":"172.21.15.2:6829","nonce":1494631266}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi099.hgawhu","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6825/4057317500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4057317500},{"type":"v1","addr":"172.21.15.99:6825","nonce":4057317500}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24279":{"gid":24279,"name":"cephfs.smithi099.heckcd","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.99:6827/689359372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":689359372},{"type":"v1","addr":"172.21.15.99:6827","nonce":689359372}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24287":{"gid":24287,"name":"cephfs.smithi002.zmrgxd","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6827/2986470392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2986470392},{"type":"v1","addr":"172.21.15.2:6827","nonce":2986470392}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464,24269]},"id":1}]} 2024-09-17T01:12:48.134 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 24 2024-09-17T01:12:48.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:48.137+0000 7f3dd9db3640 1 -- 172.21.15.2:0/580073457 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f3dc006e530 msgr2=0x7f3dc00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:48.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:48.137+0000 7f3dd9db3640 1 --2- 172.21.15.2:0/580073457 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f3dc006e530 0x7f3dc00709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4071350 tx=0x7f3dbc00b040 comp rx=0 tx=0).stop 2024-09-17T01:12:48.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:48.137+0000 7f3dd9db3640 1 -- 172.21.15.2:0/580073457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dd4102580 msgr2=0x7f3dd406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:48.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:48.137+0000 7f3dd9db3640 1 --2- 172.21.15.2:0/580073457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dd4102580 0x7f3dd406fa10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4000c00 tx=0x7f3dc4009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:48.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:48.138+0000 7f3dd9db3640 1 -- 172.21.15.2:0/580073457 shutdown_connections 2024-09-17T01:12:48.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:48.138+0000 7f3dd9db3640 1 --2- 172.21.15.2:0/580073457 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f3dc006e530 0x7f3dc00709e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:48.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:48.138+0000 7f3dd9db3640 1 --2- 172.21.15.2:0/580073457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dd4102f20 0x7f3dd406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:48.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:48.138+0000 7f3dd9db3640 1 --2- 172.21.15.2:0/580073457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3dd4102580 0x7f3dd406fa10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:48.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:48.138+0000 7f3dd9db3640 1 -- 172.21.15.2:0/580073457 >> 172.21.15.2:0/580073457 conn(0x7f3dd40f81a0 msgr2=0x7f3dd40f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:48.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:48.138+0000 7f3dd9db3640 1 -- 172.21.15.2:0/580073457 shutdown_connections 2024-09-17T01:12:48.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:48.138+0000 7f3dd9db3640 1 -- 172.21.15.2:0/580073457 wait complete. 2024-09-17T01:12:48.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:48 smithi002 ceph-mon[98018]: pgmap v272: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:48.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:48 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/580073457' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-17T01:12:48.980 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-17T01:12:49.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:48 smithi099 ceph-mon[77412]: pgmap v272: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:49.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:48 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/580073457' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-17T01:12:49.241 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:12:50.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:50 smithi002 ceph-mon[98018]: pgmap v273: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:50.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.935+0000 7fa78ec20640 1 -- 172.21.15.2:0/3863267792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7880fac80 msgr2=0x7fa7880fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:50.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.935+0000 7fa78ec20640 1 --2- 172.21.15.2:0/3863267792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7880fac80 0x7fa7880fb0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa7780048d0 tx=0x7fa778009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.935+0000 7fa78ec20640 1 -- 172.21.15.2:0/3863267792 shutdown_connections 2024-09-17T01:12:50.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.935+0000 7fa78ec20640 1 --2- 172.21.15.2:0/3863267792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7880fac80 0x7fa7880fb0f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.935+0000 7fa78ec20640 1 --2- 172.21.15.2:0/3863267792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa788102620 0x7fa7881029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.935+0000 7fa78ec20640 1 -- 172.21.15.2:0/3863267792 >> 172.21.15.2:0/3863267792 conn(0x7fa788070ce0 msgr2=0x7fa7880710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:50.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.935+0000 7fa78ec20640 1 -- 172.21.15.2:0/3863267792 shutdown_connections 2024-09-17T01:12:50.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.935+0000 7fa78ec20640 1 -- 172.21.15.2:0/3863267792 wait complete. 2024-09-17T01:12:50.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.936+0000 7fa78ec20640 1 Processor -- start 2024-09-17T01:12:50.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.936+0000 7fa78ec20640 1 -- start start 2024-09-17T01:12:50.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.937+0000 7fa78ec20640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7880fac80 0x7fa7880fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:50.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.937+0000 7fa78ec20640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa788102620 0x7fa7880fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:50.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.937+0000 7fa78ec20640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880fc8e0 con 0x7fa7880fac80 2024-09-17T01:12:50.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.937+0000 7fa78ec20640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880fca50 con 0x7fa788102620 2024-09-17T01:12:50.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.937+0000 7fa78c9bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7880fac80 0x7fa7880fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:50.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.937+0000 7fa78c9bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7880fac80 0x7fa7880fbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34986/0 (socket says 172.21.15.2:34986) 2024-09-17T01:12:50.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.937+0000 7fa78c9bc640 1 -- 172.21.15.2:0/3077427060 learned_addr learned my addr 172.21.15.2:0/3077427060 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:12:50.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.937+0000 7fa787fff640 1 --2- 172.21.15.2:0/3077427060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa788102620 0x7fa7880fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:50.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.937+0000 7fa78c9bc640 1 -- 172.21.15.2:0/3077427060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa788102620 msgr2=0x7fa7880fc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:50.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.937+0000 7fa78c9bc640 1 --2- 172.21.15.2:0/3077427060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa788102620 0x7fa7880fc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:50.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.937+0000 7fa78c9bc640 1 -- 172.21.15.2:0/3077427060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa778005040 con 0x7fa7880fac80 2024-09-17T01:12:50.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.937+0000 7fa78c9bc640 1 --2- 172.21.15.2:0/3077427060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7880fac80 0x7fa7880fbe60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa77000c830 tx=0x7fa770004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:50.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.938+0000 7fa7857fa640 1 -- 172.21.15.2:0/3077427060 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa77000a850 con 0x7fa7880fac80 2024-09-17T01:12:50.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.938+0000 7fa7857fa640 1 -- 172.21.15.2:0/3077427060 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa77000ae50 con 0x7fa7880fac80 2024-09-17T01:12:50.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.938+0000 7fa78ec20640 1 -- 172.21.15.2:0/3077427060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7880fcce0 con 0x7fa7880fac80 2024-09-17T01:12:50.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.938+0000 7fa7857fa640 1 -- 172.21.15.2:0/3077427060 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7700113a0 con 0x7fa7880fac80 2024-09-17T01:12:50.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.938+0000 7fa78ec20640 1 -- 172.21.15.2:0/3077427060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa788119900 con 0x7fa7880fac80 2024-09-17T01:12:50.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.939+0000 7fa78ec20640 1 -- 172.21.15.2:0/3077427060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7880657b0 con 0x7fa7880fac80 2024-09-17T01:12:50.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.939+0000 7fa7857fa640 1 -- 172.21.15.2:0/3077427060 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fa770012400 con 0x7fa7880fac80 2024-09-17T01:12:50.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.940+0000 7fa7857fa640 1 --2- 172.21.15.2:0/3077427060 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa77406e530 0x7fa7740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:50.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.940+0000 7fa7857fa640 1 -- 172.21.15.2:0/3077427060 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fa77008e4e0 con 0x7fa7880fac80 2024-09-17T01:12:50.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.940+0000 7fa787fff640 1 --2- 172.21.15.2:0/3077427060 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa77406e530 0x7fa7740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:50.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.940+0000 7fa787fff640 1 --2- 172.21.15.2:0/3077427060 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa77406e530 0x7fa7740709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa7880fd7a0 tx=0x7fa778035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:50.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:50.944+0000 7fa7857fa640 1 -- 172.21.15.2:0/3077427060 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa770057520 con 0x7fa7880fac80 2024-09-17T01:12:51.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:50 smithi099 ceph-mon[77412]: pgmap v273: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:51.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:51.157+0000 7fa78ec20640 1 -- 172.21.15.2:0/3077427060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fa788074c00 con 0x7fa7880fac80 2024-09-17T01:12:51.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:51.158+0000 7fa7857fa640 1 -- 172.21.15.2:0/3077427060 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v45) v1 ==== 107+0+4936 (secure 0 0 0) 0x7fa77005abe0 con 0x7fa7880fac80 2024-09-17T01:12:51.156 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:12:51.156 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":25,"btime":"2024-09-17T01:05:48:747321+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:05:47.816861+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi002.fmyyzz","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6829/1494631266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1494631266},{"type":"v1","addr":"172.21.15.2:6829","nonce":1494631266}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi099.hgawhu","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6825/4057317500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4057317500},{"type":"v1","addr":"172.21.15.99:6825","nonce":4057317500}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24279":{"gid":24279,"name":"cephfs.smithi099.heckcd","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.99:6827/689359372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":689359372},{"type":"v1","addr":"172.21.15.99:6827","nonce":689359372}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24287":{"gid":24287,"name":"cephfs.smithi002.zmrgxd","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.2:6827/2986470392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2986470392},{"type":"v1","addr":"172.21.15.2:6827","nonce":2986470392}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[24269,14464]},"id":1}]} 2024-09-17T01:12:51.156 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 25 2024-09-17T01:12:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:51.161+0000 7fa78ec20640 1 -- 172.21.15.2:0/3077427060 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa77406e530 msgr2=0x7fa7740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:51.161+0000 7fa78ec20640 1 --2- 172.21.15.2:0/3077427060 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa77406e530 0x7fa7740709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa7880fd7a0 tx=0x7fa778035040 comp rx=0 tx=0).stop 2024-09-17T01:12:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:51.161+0000 7fa78ec20640 1 -- 172.21.15.2:0/3077427060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7880fac80 msgr2=0x7fa7880fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:51.161+0000 7fa78ec20640 1 --2- 172.21.15.2:0/3077427060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7880fac80 0x7fa7880fbe60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa77000c830 tx=0x7fa770004430 comp rx=0 tx=0).stop 2024-09-17T01:12:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:51.161+0000 7fa78ec20640 1 -- 172.21.15.2:0/3077427060 shutdown_connections 2024-09-17T01:12:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:51.161+0000 7fa78ec20640 1 --2- 172.21.15.2:0/3077427060 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa77406e530 0x7fa7740709e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:51.161+0000 7fa78ec20640 1 --2- 172.21.15.2:0/3077427060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa788102620 0x7fa7880fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:51.161+0000 7fa78ec20640 1 --2- 172.21.15.2:0/3077427060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7880fac80 0x7fa7880fbe60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:51.161+0000 7fa78ec20640 1 -- 172.21.15.2:0/3077427060 >> 172.21.15.2:0/3077427060 conn(0x7fa788070ce0 msgr2=0x7fa788100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:51.161+0000 7fa78ec20640 1 -- 172.21.15.2:0/3077427060 shutdown_connections 2024-09-17T01:12:51.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:51.161+0000 7fa78ec20640 1 -- 172.21.15.2:0/3077427060 wait complete. 2024-09-17T01:12:51.760 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:51 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3077427060' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-17T01:12:51.760 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:51 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:51.786 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-17T01:12:52.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:51 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3077427060' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-17T01:12:52.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:51 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:12:52.054 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:12:52.834 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:52 smithi002 ceph-mon[98018]: pgmap v274: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:52.834 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:52.834 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:52.834 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:52 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:12:53.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:52 smithi099 ceph-mon[77412]: pgmap v274: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:53.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:12:53.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:12:53.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:52 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' 2024-09-17T01:12:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.681+0000 7faabbb17640 1 -- 172.21.15.2:0/1599880801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab4102f00 msgr2=0x7faab40fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.681+0000 7faabbb17640 1 --2- 172.21.15.2:0/1599880801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab4102f00 0x7faab40fc5c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7faaa40048d0 tx=0x7faaa4009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.681+0000 7faabbb17640 1 -- 172.21.15.2:0/1599880801 shutdown_connections 2024-09-17T01:12:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.681+0000 7faabbb17640 1 --2- 172.21.15.2:0/1599880801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab4102f00 0x7faab40fc5c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.681+0000 7faabbb17640 1 --2- 172.21.15.2:0/1599880801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faab4102560 0x7faab4102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.681+0000 7faabbb17640 1 -- 172.21.15.2:0/1599880801 >> 172.21.15.2:0/1599880801 conn(0x7faab40f8100 msgr2=0x7faab40fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.681+0000 7faabbb17640 1 -- 172.21.15.2:0/1599880801 shutdown_connections 2024-09-17T01:12:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.681+0000 7faabbb17640 1 -- 172.21.15.2:0/1599880801 wait complete. 2024-09-17T01:12:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.681+0000 7faabbb17640 1 Processor -- start 2024-09-17T01:12:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.681+0000 7faabbb17640 1 -- start start 2024-09-17T01:12:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.682+0000 7faabbb17640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faab4102560 0x7faab4113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.682+0000 7faabbb17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab4102f00 0x7faab4113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.682+0000 7faabbb17640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab4113d40 con 0x7faab4102f00 2024-09-17T01:12:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.682+0000 7faabbb17640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab410d180 con 0x7faab4102560 2024-09-17T01:12:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.682+0000 7faab90b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab4102f00 0x7faab4113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:53.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.682+0000 7faab90b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab4102f00 0x7faab4113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35014/0 (socket says 172.21.15.2:35014) 2024-09-17T01:12:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.682+0000 7faab90b2640 1 -- 172.21.15.2:0/1769559989 learned_addr learned my addr 172.21.15.2:0/1769559989 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:12:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.682+0000 7faab98b3640 1 --2- 172.21.15.2:0/1769559989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faab4102560 0x7faab4113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.682+0000 7faab90b2640 1 -- 172.21.15.2:0/1769559989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faab4102560 msgr2=0x7faab4113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.682+0000 7faab90b2640 1 --2- 172.21.15.2:0/1769559989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faab4102560 0x7faab4113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.682+0000 7faab90b2640 1 -- 172.21.15.2:0/1769559989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa4005040 con 0x7faab4102f00 2024-09-17T01:12:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.682+0000 7faab90b2640 1 --2- 172.21.15.2:0/1769559989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab4102f00 0x7faab4113740 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faaa4003080 tx=0x7faaa4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.683+0000 7faaaa7fc640 1 -- 172.21.15.2:0/1769559989 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaa4038070 con 0x7faab4102f00 2024-09-17T01:12:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.683+0000 7faaaa7fc640 1 -- 172.21.15.2:0/1769559989 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faaa4009760 con 0x7faab4102f00 2024-09-17T01:12:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.683+0000 7faabbb17640 1 -- 172.21.15.2:0/1769559989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab410d400 con 0x7faab4102f00 2024-09-17T01:12:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.683+0000 7faaaa7fc640 1 -- 172.21.15.2:0/1769559989 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaa4033420 con 0x7faab4102f00 2024-09-17T01:12:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.683+0000 7faabbb17640 1 -- 172.21.15.2:0/1769559989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab410d8e0 con 0x7faab4102f00 2024-09-17T01:12:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.684+0000 7faabbb17640 1 -- 172.21.15.2:0/1769559989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab40fdce0 con 0x7faab4102f00 2024-09-17T01:12:53.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.684+0000 7faaaa7fc640 1 -- 172.21.15.2:0/1769559989 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7faaa4030020 con 0x7faab4102f00 2024-09-17T01:12:53.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.685+0000 7faaaa7fc640 1 --2- 172.21.15.2:0/1769559989 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faaa006e530 0x7faaa00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:53.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.685+0000 7faab98b3640 1 --2- 172.21.15.2:0/1769559989 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faaa006e530 0x7faaa00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:53.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.685+0000 7faaaa7fc640 1 -- 172.21.15.2:0/1769559989 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7faaa40ae060 con 0x7faab4102f00 2024-09-17T01:12:53.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.685+0000 7faab98b3640 1 --2- 172.21.15.2:0/1769559989 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faaa006e530 0x7faaa00709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faab00041d0 tx=0x7faab0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:53.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.689+0000 7faaaa7fc640 1 -- 172.21.15.2:0/1769559989 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7faaa4077020 con 0x7faab4102f00 2024-09-17T01:12:53.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.904+0000 7faabbb17640 1 -- 172.21.15.2:0/1769559989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7faab4109620 con 0x7faab4102f00 2024-09-17T01:12:53.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.904+0000 7faaaa7fc640 1 -- 172.21.15.2:0/1769559989 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v45) v1 ==== 107+0+3370 (secure 0 0 0) 0x7faaa407a6e0 con 0x7faab4102f00 2024-09-17T01:12:53.902 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:12:53.902 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"btime":"2024-09-17T01:09:44:523690+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:09:43.527640+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi002.fmyyzz","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6829/1494631266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1494631266},{"type":"v1","addr":"172.21.15.2:6829","nonce":1494631266}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi099.hgawhu","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6825/4057317500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4057317500},{"type":"v1","addr":"172.21.15.99:6825","nonce":4057317500}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14464,"qdb_cluster":[14464,24269]},"id":1}]} 2024-09-17T01:12:53.902 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-09-17T01:12:53.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.907+0000 7faabbb17640 1 -- 172.21.15.2:0/1769559989 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faaa006e530 msgr2=0x7faaa00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.907+0000 7faabbb17640 1 --2- 172.21.15.2:0/1769559989 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faaa006e530 0x7faaa00709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faab00041d0 tx=0x7faab0009040 comp rx=0 tx=0).stop 2024-09-17T01:12:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.907+0000 7faabbb17640 1 -- 172.21.15.2:0/1769559989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab4102f00 msgr2=0x7faab4113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.907+0000 7faabbb17640 1 --2- 172.21.15.2:0/1769559989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab4102f00 0x7faab4113740 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faaa4003080 tx=0x7faaa4009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.907+0000 7faabbb17640 1 -- 172.21.15.2:0/1769559989 shutdown_connections 2024-09-17T01:12:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.907+0000 7faabbb17640 1 --2- 172.21.15.2:0/1769559989 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faaa006e530 0x7faaa00709e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.907+0000 7faabbb17640 1 --2- 172.21.15.2:0/1769559989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab4102f00 0x7faab4113740 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.907+0000 7faabbb17640 1 --2- 172.21.15.2:0/1769559989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faab4102560 0x7faab4113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.907+0000 7faabbb17640 1 -- 172.21.15.2:0/1769559989 >> 172.21.15.2:0/1769559989 conn(0x7faab40f8100 msgr2=0x7faab40f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.907+0000 7faabbb17640 1 -- 172.21.15.2:0/1769559989 shutdown_connections 2024-09-17T01:12:53.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:53.907+0000 7faabbb17640 1 -- 172.21.15.2:0/1769559989 wait complete. 2024-09-17T01:12:54.509 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-17T01:12:54.510 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-17T01:12:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:12:54.892 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:54 smithi002 ceph-mon[98018]: pgmap v275: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:54.892 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:54 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1769559989' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-17T01:12:55.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:54 smithi099 ceph-mon[77412]: pgmap v275: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:12:55.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:54 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1769559989' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-17T01:12:55.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:55 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:56.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:55 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:12:56.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.436+0000 7fa38dad1640 1 -- 172.21.15.2:0/2603277435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3880fcf80 msgr2=0x7fa3880fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.436+0000 7fa38dad1640 1 --2- 172.21.15.2:0/2603277435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3880fcf80 0x7fa3880fd3d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa3700048d0 tx=0x7fa370009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.436+0000 7fa38dad1640 1 -- 172.21.15.2:0/2603277435 shutdown_connections 2024-09-17T01:12:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.436+0000 7fa38dad1640 1 --2- 172.21.15.2:0/2603277435 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3880fcf80 0x7fa3880fd3d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.436+0000 7fa38dad1640 1 --2- 172.21.15.2:0/2603277435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3880fb810 0x7fa3880fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.436+0000 7fa38dad1640 1 -- 172.21.15.2:0/2603277435 >> 172.21.15.2:0/2603277435 conn(0x7fa3880723b0 msgr2=0x7fa3880727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.436+0000 7fa38dad1640 1 -- 172.21.15.2:0/2603277435 shutdown_connections 2024-09-17T01:12:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.436+0000 7fa38dad1640 1 -- 172.21.15.2:0/2603277435 wait complete. 2024-09-17T01:12:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.437+0000 7fa38dad1640 1 Processor -- start 2024-09-17T01:12:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.437+0000 7fa38dad1640 1 -- start start 2024-09-17T01:12:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.437+0000 7fa38dad1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3880fb810 0x7fa388112140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.437+0000 7fa38dad1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3880fcf80 0x7fa388112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.437+0000 7fa38dad1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa388112d10 con 0x7fa3880fb810 2024-09-17T01:12:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.437+0000 7fa38dad1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38810c100 con 0x7fa3880fcf80 2024-09-17T01:12:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.437+0000 7fa3877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3880fb810 0x7fa388112140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.437+0000 7fa3877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3880fb810 0x7fa388112140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35022/0 (socket says 172.21.15.2:35022) 2024-09-17T01:12:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.437+0000 7fa3877fe640 1 -- 172.21.15.2:0/4154770018 learned_addr learned my addr 172.21.15.2:0/4154770018 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:12:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.438+0000 7fa37effd640 1 --2- 172.21.15.2:0/4154770018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3880fcf80 0x7fa388112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.438+0000 7fa3877fe640 1 -- 172.21.15.2:0/4154770018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3880fcf80 msgr2=0x7fa388112680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.438+0000 7fa3877fe640 1 --2- 172.21.15.2:0/4154770018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3880fcf80 0x7fa388112680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.438+0000 7fa3877fe640 1 -- 172.21.15.2:0/4154770018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa370005040 con 0x7fa3880fb810 2024-09-17T01:12:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.438+0000 7fa37effd640 1 --2- 172.21.15.2:0/4154770018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3880fcf80 0x7fa388112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:12:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.438+0000 7fa3877fe640 1 --2- 172.21.15.2:0/4154770018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3880fb810 0x7fa388112140 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa37800b790 tx=0x7fa3780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.438+0000 7fa384ff9640 1 -- 172.21.15.2:0/4154770018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa37800c700 con 0x7fa3880fb810 2024-09-17T01:12:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.438+0000 7fa384ff9640 1 -- 172.21.15.2:0/4154770018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa37800cd00 con 0x7fa3880fb810 2024-09-17T01:12:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.438+0000 7fa38dad1640 1 -- 172.21.15.2:0/4154770018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38810c3e0 con 0x7fa3880fb810 2024-09-17T01:12:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.438+0000 7fa384ff9640 1 -- 172.21.15.2:0/4154770018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa378015e70 con 0x7fa3880fb810 2024-09-17T01:12:56.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.438+0000 7fa38dad1640 1 -- 172.21.15.2:0/4154770018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38810c900 con 0x7fa3880fb810 2024-09-17T01:12:56.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.439+0000 7fa38dad1640 1 -- 172.21.15.2:0/4154770018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3880fcbc0 con 0x7fa3880fb810 2024-09-17T01:12:56.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.440+0000 7fa384ff9640 1 -- 172.21.15.2:0/4154770018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fa378012070 con 0x7fa3880fb810 2024-09-17T01:12:56.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.440+0000 7fa384ff9640 1 --2- 172.21.15.2:0/4154770018 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa37406e530 0x7fa3740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:56.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.440+0000 7fa384ff9640 1 -- 172.21.15.2:0/4154770018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fa37808deb0 con 0x7fa3880fb810 2024-09-17T01:12:56.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.440+0000 7fa37effd640 1 --2- 172.21.15.2:0/4154770018 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa37406e530 0x7fa3740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:56.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.441+0000 7fa37effd640 1 --2- 172.21.15.2:0/4154770018 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa37406e530 0x7fa3740709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa38810da40 tx=0x7fa370035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:56.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.445+0000 7fa384ff9640 1 -- 172.21.15.2:0/4154770018 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa378056e70 con 0x7fa3880fb810 2024-09-17T01:12:56.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.660+0000 7fa38dad1640 1 -- 172.21.15.2:0/4154770018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fa38804b7b0 con 0x7fa3880fb810 2024-09-17T01:12:56.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.660+0000 7fa384ff9640 1 -- 172.21.15.2:0/4154770018 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v45) v1 ==== 107+0+3334 (secure 0 0 0) 0x7fa37805a530 con 0x7fa3880fb810 2024-09-17T01:12:56.658 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:12:56.658 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":27,"btime":"2024-09-17T01:09:44:670924+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi002.zmrgxd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/3086061169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3086061169},{"type":"v1","addr":"172.21.15.2:6827","nonce":3086061169}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44299,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/2884389025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2884389025},{"type":"v1","addr":"172.21.15.99:6827","nonce":2884389025}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":27,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:09:44.670921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:12:56.658 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 27 2024-09-17T01:12:56.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.662+0000 7fa38dad1640 1 -- 172.21.15.2:0/4154770018 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa37406e530 msgr2=0x7fa3740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:56.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.662+0000 7fa38dad1640 1 --2- 172.21.15.2:0/4154770018 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa37406e530 0x7fa3740709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa38810da40 tx=0x7fa370035040 comp rx=0 tx=0).stop 2024-09-17T01:12:56.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.662+0000 7fa38dad1640 1 -- 172.21.15.2:0/4154770018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3880fb810 msgr2=0x7fa388112140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:56.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.662+0000 7fa38dad1640 1 --2- 172.21.15.2:0/4154770018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3880fb810 0x7fa388112140 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa37800b790 tx=0x7fa3780091d0 comp rx=0 tx=0).stop 2024-09-17T01:12:56.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.662+0000 7fa38dad1640 1 -- 172.21.15.2:0/4154770018 shutdown_connections 2024-09-17T01:12:56.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.662+0000 7fa38dad1640 1 --2- 172.21.15.2:0/4154770018 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa37406e530 0x7fa3740709e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:56.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.662+0000 7fa38dad1640 1 --2- 172.21.15.2:0/4154770018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3880fcf80 0x7fa388112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:56.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.662+0000 7fa38dad1640 1 --2- 172.21.15.2:0/4154770018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3880fb810 0x7fa388112140 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:56.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.662+0000 7fa38dad1640 1 -- 172.21.15.2:0/4154770018 >> 172.21.15.2:0/4154770018 conn(0x7fa3880723b0 msgr2=0x7fa3880fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:56.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.663+0000 7fa38dad1640 1 -- 172.21.15.2:0/4154770018 shutdown_connections 2024-09-17T01:12:56.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:56.663+0000 7fa38dad1640 1 -- 172.21.15.2:0/4154770018 wait complete. 2024-09-17T01:12:56.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:56 smithi002 ceph-mon[98018]: pgmap v276: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:57.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:56 smithi099 ceph-mon[77412]: pgmap v276: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:57.308 DEBUG:tasks.fs:max_mds not reduced in epoch 27 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-17T01:12:57.309 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-17T01:12:57.309 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-17T01:12:57.574 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:12:57.903 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:57 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/4154770018' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-17T01:12:58.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:57 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/4154770018' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-17T01:12:58.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:58 smithi002 ceph-mon[98018]: pgmap v277: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:59.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:58 smithi099 ceph-mon[77412]: pgmap v277: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:12:59.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.144+0000 7f30b928d640 1 -- 172.21.15.2:0/3354212461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b40fd760 msgr2=0x7f30b40fdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:59.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.144+0000 7f30b928d640 1 --2- 172.21.15.2:0/3354212461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b40fd760 0x7f30b40fdb30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f30a40048d0 tx=0x7f30a4009da0 comp rx=0 tx=0).stop 2024-09-17T01:12:59.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.144+0000 7f30b928d640 1 -- 172.21.15.2:0/3354212461 shutdown_connections 2024-09-17T01:12:59.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.144+0000 7f30b928d640 1 --2- 172.21.15.2:0/3354212461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30b40fe100 0x7f30b41065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:59.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.144+0000 7f30b928d640 1 --2- 172.21.15.2:0/3354212461 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b40fd760 0x7f30b40fdb30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:59.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.144+0000 7f30b928d640 1 -- 172.21.15.2:0/3354212461 >> 172.21.15.2:0/3354212461 conn(0x7f30b40f7030 msgr2=0x7f30b40f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:59.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.144+0000 7f30b928d640 1 -- 172.21.15.2:0/3354212461 shutdown_connections 2024-09-17T01:12:59.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.144+0000 7f30b928d640 1 -- 172.21.15.2:0/3354212461 wait complete. 2024-09-17T01:12:59.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.145+0000 7f30b928d640 1 Processor -- start 2024-09-17T01:12:59.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.145+0000 7f30b928d640 1 -- start start 2024-09-17T01:12:59.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.145+0000 7f30b928d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30b40fd760 0x7f30b4113350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:59.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.145+0000 7f30b928d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b40fe100 0x7f30b4113890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:59.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.145+0000 7f30b928d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b4113e90 con 0x7f30b40fe100 2024-09-17T01:12:59.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.145+0000 7f30b928d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b410d2d0 con 0x7f30b40fd760 2024-09-17T01:12:59.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.146+0000 7f30aa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b40fe100 0x7f30b4113890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:59.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.146+0000 7f30aa7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b40fe100 0x7f30b4113890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35038/0 (socket says 172.21.15.2:35038) 2024-09-17T01:12:59.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.146+0000 7f30aa7fc640 1 -- 172.21.15.2:0/605760118 learned_addr learned my addr 172.21.15.2:0/605760118 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:12:59.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.146+0000 7f30b2ffd640 1 --2- 172.21.15.2:0/605760118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30b40fd760 0x7f30b4113350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:59.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.146+0000 7f30aa7fc640 1 -- 172.21.15.2:0/605760118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30b40fd760 msgr2=0x7f30b4113350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:59.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.146+0000 7f30aa7fc640 1 --2- 172.21.15.2:0/605760118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30b40fd760 0x7f30b4113350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:59.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.146+0000 7f30aa7fc640 1 -- 172.21.15.2:0/605760118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a4005040 con 0x7f30b40fe100 2024-09-17T01:12:59.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.146+0000 7f30aa7fc640 1 --2- 172.21.15.2:0/605760118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b40fe100 0x7f30b4113890 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f309c009af0 tx=0x7f309c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:59.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.146+0000 7f30abfff640 1 -- 172.21.15.2:0/605760118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f309c002e00 con 0x7f30b40fe100 2024-09-17T01:12:59.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.146+0000 7f30b928d640 1 -- 172.21.15.2:0/605760118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b410d5b0 con 0x7f30b40fe100 2024-09-17T01:12:59.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.146+0000 7f30abfff640 1 -- 172.21.15.2:0/605760118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f309c00f040 con 0x7f30b40fe100 2024-09-17T01:12:59.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.146+0000 7f30abfff640 1 -- 172.21.15.2:0/605760118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f309c00da30 con 0x7f30b40fe100 2024-09-17T01:12:59.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.146+0000 7f30b928d640 1 -- 172.21.15.2:0/605760118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b410db50 con 0x7f30b40fe100 2024-09-17T01:12:59.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.147+0000 7f30b928d640 1 -- 172.21.15.2:0/605760118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b40fac90 con 0x7f30b40fe100 2024-09-17T01:12:59.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.148+0000 7f30abfff640 1 -- 172.21.15.2:0/605760118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f309c00dcb0 con 0x7f30b40fe100 2024-09-17T01:12:59.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.148+0000 7f30abfff640 1 --2- 172.21.15.2:0/605760118 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f30a006e530 0x7f30a00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:12:59.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.148+0000 7f30abfff640 1 -- 172.21.15.2:0/605760118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f309c08e1d0 con 0x7f30b40fe100 2024-09-17T01:12:59.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.148+0000 7f30b2ffd640 1 --2- 172.21.15.2:0/605760118 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f30a006e530 0x7f30a00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:12:59.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.149+0000 7f30b2ffd640 1 --2- 172.21.15.2:0/605760118 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f30a006e530 0x7f30a00709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30a4007ac0 tx=0x7f30a4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:12:59.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.153+0000 7f30abfff640 1 -- 172.21.15.2:0/605760118 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f309c057190 con 0x7f30b40fe100 2024-09-17T01:12:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.367+0000 7f30b928d640 1 -- 172.21.15.2:0/605760118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f30b404b720 con 0x7f30b40fe100 2024-09-17T01:12:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.368+0000 7f30abfff640 1 -- 172.21.15.2:0/605760118 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v45) v1 ==== 107+0+4889 (secure 0 0 0) 0x7f309c05a850 con 0x7f30b40fe100 2024-09-17T01:12:59.365 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:12:59.366 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"btime":"2024-09-17T01:09:45:672865+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi002.zmrgxd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/3086061169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3086061169},{"type":"v1","addr":"172.21.15.2:6827","nonce":3086061169}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":34384,"name":"cephfs.smithi002.fmyyzz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/1844749656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1844749656},{"type":"v1","addr":"172.21.15.2:6829","nonce":1844749656}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":44299,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/2884389025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2884389025},{"type":"v1","addr":"172.21.15.99:6827","nonce":2884389025}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44305,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/3901555472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3901555472},{"type":"v1","addr":"172.21.15.99:6825","nonce":3901555472}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:09:44.670921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:12:59.366 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2024-09-17T01:12:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.370+0000 7f30b928d640 1 -- 172.21.15.2:0/605760118 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f30a006e530 msgr2=0x7f30a00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.370+0000 7f30b928d640 1 --2- 172.21.15.2:0/605760118 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f30a006e530 0x7f30a00709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30a4007ac0 tx=0x7f30a4035040 comp rx=0 tx=0).stop 2024-09-17T01:12:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.370+0000 7f30b928d640 1 -- 172.21.15.2:0/605760118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b40fe100 msgr2=0x7f30b4113890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:12:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.370+0000 7f30b928d640 1 --2- 172.21.15.2:0/605760118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b40fe100 0x7f30b4113890 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f309c009af0 tx=0x7f309c004570 comp rx=0 tx=0).stop 2024-09-17T01:12:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.370+0000 7f30b928d640 1 -- 172.21.15.2:0/605760118 shutdown_connections 2024-09-17T01:12:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.370+0000 7f30b928d640 1 --2- 172.21.15.2:0/605760118 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f30a006e530 0x7f30a00709e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.370+0000 7f30b928d640 1 --2- 172.21.15.2:0/605760118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30b40fe100 0x7f30b4113890 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.370+0000 7f30b928d640 1 --2- 172.21.15.2:0/605760118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30b40fd760 0x7f30b4113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:12:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.370+0000 7f30b928d640 1 -- 172.21.15.2:0/605760118 >> 172.21.15.2:0/605760118 conn(0x7f30b40f7030 msgr2=0x7f30b40f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:12:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.370+0000 7f30b928d640 1 -- 172.21.15.2:0/605760118 shutdown_connections 2024-09-17T01:12:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:12:59.370+0000 7f30b928d640 1 -- 172.21.15.2:0/605760118 wait complete. 2024-09-17T01:12:59.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:12:59 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/605760118' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-17T01:12:59.986 DEBUG:tasks.fs:max_mds not reduced in epoch 28 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-17T01:12:59.986 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-17T01:12:59.987 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-17T01:13:00.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:12:59 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/605760118' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-17T01:13:00.247 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:00.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:00 smithi002 ceph-mon[98018]: pgmap v278: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:01.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:00 smithi099 ceph-mon[77412]: pgmap v278: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.927+0000 7ff108535640 1 -- 172.21.15.2:0/2104135079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000fcf80 msgr2=0x7ff1000fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.927+0000 7ff108535640 1 --2- 172.21.15.2:0/2104135079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000fcf80 0x7ff1000fd3d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00048d0 tx=0x7ff0f0009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.927+0000 7ff108535640 1 -- 172.21.15.2:0/2104135079 shutdown_connections 2024-09-17T01:13:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.927+0000 7ff108535640 1 --2- 172.21.15.2:0/2104135079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000fcf80 0x7ff1000fd3d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:01.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.927+0000 7ff108535640 1 --2- 172.21.15.2:0/2104135079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1000fb810 0x7ff1000fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.927+0000 7ff108535640 1 -- 172.21.15.2:0/2104135079 >> 172.21.15.2:0/2104135079 conn(0x7ff1000723b0 msgr2=0x7ff1000727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.927+0000 7ff108535640 1 -- 172.21.15.2:0/2104135079 shutdown_connections 2024-09-17T01:13:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.927+0000 7ff108535640 1 -- 172.21.15.2:0/2104135079 wait complete. 2024-09-17T01:13:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.928+0000 7ff108535640 1 Processor -- start 2024-09-17T01:13:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.928+0000 7ff108535640 1 -- start start 2024-09-17T01:13:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.928+0000 7ff108535640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1000fb810 0x7ff10010e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.928+0000 7ff108535640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000fcf80 0x7ff10010e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.928+0000 7ff108535640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10010ed20 con 0x7ff1000fcf80 2024-09-17T01:13:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.928+0000 7ff108535640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10010ee90 con 0x7ff1000fb810 2024-09-17T01:13:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.928+0000 7ff105ad0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000fcf80 0x7ff10010e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.928+0000 7ff105ad0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000fcf80 0x7ff10010e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51680/0 (socket says 172.21.15.2:51680) 2024-09-17T01:13:01.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.928+0000 7ff105ad0640 1 -- 172.21.15.2:0/3765856254 learned_addr learned my addr 172.21.15.2:0/3765856254 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.928+0000 7ff1062d1640 1 --2- 172.21.15.2:0/3765856254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1000fb810 0x7ff10010e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.928+0000 7ff105ad0640 1 -- 172.21.15.2:0/3765856254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1000fb810 msgr2=0x7ff10010e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.928+0000 7ff105ad0640 1 --2- 172.21.15.2:0/3765856254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1000fb810 0x7ff10010e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.928+0000 7ff105ad0640 1 -- 172.21.15.2:0/3765856254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f0005040 con 0x7ff1000fcf80 2024-09-17T01:13:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.929+0000 7ff105ad0640 1 --2- 172.21.15.2:0/3765856254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000fcf80 0x7ff10010e6d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0000c00 tx=0x7ff0f0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.929+0000 7ff0f6ffd640 1 -- 172.21.15.2:0/3765856254 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0f0038070 con 0x7ff1000fcf80 2024-09-17T01:13:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.929+0000 7ff0f6ffd640 1 -- 172.21.15.2:0/3765856254 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff0f002ade0 con 0x7ff1000fcf80 2024-09-17T01:13:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.929+0000 7ff108535640 1 -- 172.21.15.2:0/3765856254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff100117200 con 0x7ff1000fcf80 2024-09-17T01:13:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.929+0000 7ff0f6ffd640 1 -- 172.21.15.2:0/3765856254 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0f002c7e0 con 0x7ff1000fcf80 2024-09-17T01:13:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.929+0000 7ff108535640 1 -- 172.21.15.2:0/3765856254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff100117660 con 0x7ff1000fcf80 2024-09-17T01:13:01.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.930+0000 7ff108535640 1 -- 172.21.15.2:0/3765856254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1000fcbc0 con 0x7ff1000fcf80 2024-09-17T01:13:01.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.930+0000 7ff0f6ffd640 1 -- 172.21.15.2:0/3765856254 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7ff0f0030020 con 0x7ff1000fcf80 2024-09-17T01:13:01.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.931+0000 7ff0f6ffd640 1 --2- 172.21.15.2:0/3765856254 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff0ec06e530 0x7ff0ec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:01.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.931+0000 7ff0f6ffd640 1 -- 172.21.15.2:0/3765856254 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7ff0f00adf20 con 0x7ff1000fcf80 2024-09-17T01:13:01.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.931+0000 7ff1062d1640 1 --2- 172.21.15.2:0/3765856254 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff0ec06e530 0x7ff0ec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:01.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.931+0000 7ff1062d1640 1 --2- 172.21.15.2:0/3765856254 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff0ec06e530 0x7ff0ec0709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc004ce0 tx=0x7ff0fc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:01.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:01.935+0000 7ff0f6ffd640 1 -- 172.21.15.2:0/3765856254 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff0f00e31b0 con 0x7ff1000fcf80 2024-09-17T01:13:02.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:02.147+0000 7ff108535640 1 -- 172.21.15.2:0/3765856254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7ff10004b720 con 0x7ff1000fcf80 2024-09-17T01:13:02.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:02.147+0000 7ff0f6ffd640 1 -- 172.21.15.2:0/3765856254 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v45) v1 ==== 107+0+4113 (secure 0 0 0) 0x7ff0f0076f90 con 0x7ff1000fcf80 2024-09-17T01:13:02.145 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:02.145 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"btime":"2024-09-17T01:09:48:682773+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi002.fmyyzz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/1844749656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1844749656},{"type":"v1","addr":"172.21.15.2:6829","nonce":1844749656}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":44299,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/2884389025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2884389025},{"type":"v1","addr":"172.21.15.99:6827","nonce":2884389025}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44305,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/3901555472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3901555472},{"type":"v1","addr":"172.21.15.99:6825","nonce":3901555472}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:09:44.670921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:02.145 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 29 2024-09-17T01:13:02.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:02.149+0000 7ff108535640 1 -- 172.21.15.2:0/3765856254 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff0ec06e530 msgr2=0x7ff0ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:02.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:02.149+0000 7ff108535640 1 --2- 172.21.15.2:0/3765856254 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff0ec06e530 0x7ff0ec0709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc004ce0 tx=0x7ff0fc00b040 comp rx=0 tx=0).stop 2024-09-17T01:13:02.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:02.149+0000 7ff108535640 1 -- 172.21.15.2:0/3765856254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000fcf80 msgr2=0x7ff10010e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:02.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:02.149+0000 7ff108535640 1 --2- 172.21.15.2:0/3765856254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000fcf80 0x7ff10010e6d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0000c00 tx=0x7ff0f0009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:02.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:02.149+0000 7ff108535640 1 -- 172.21.15.2:0/3765856254 shutdown_connections 2024-09-17T01:13:02.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:02.149+0000 7ff108535640 1 --2- 172.21.15.2:0/3765856254 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ff0ec06e530 0x7ff0ec0709e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:02.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:02.149+0000 7ff108535640 1 --2- 172.21.15.2:0/3765856254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1000fcf80 0x7ff10010e6d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:02.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:02.149+0000 7ff108535640 1 --2- 172.21.15.2:0/3765856254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1000fb810 0x7ff10010e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:02.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:02.149+0000 7ff108535640 1 -- 172.21.15.2:0/3765856254 >> 172.21.15.2:0/3765856254 conn(0x7ff1000723b0 msgr2=0x7ff1000fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:02.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:02.149+0000 7ff108535640 1 -- 172.21.15.2:0/3765856254 shutdown_connections 2024-09-17T01:13:02.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:02.150+0000 7ff108535640 1 -- 172.21.15.2:0/3765856254 wait complete. 2024-09-17T01:13:02.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:02 smithi002 ceph-mon[98018]: pgmap v279: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:02.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:02 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3765856254' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-17T01:13:02.896 DEBUG:tasks.fs:max_mds not reduced in epoch 29 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-17T01:13:02.896 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-17T01:13:02.897 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-17T01:13:03.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:02 smithi099 ceph-mon[77412]: pgmap v279: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:03.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:02 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3765856254' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-17T01:13:03.164 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:04.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.686+0000 7fd38841c640 1 -- 172.21.15.2:0/3946257946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd380102550 msgr2=0x7fd380102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:04.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.686+0000 7fd38841c640 1 --2- 172.21.15.2:0/3946257946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd380102550 0x7fd380102920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0048d0 tx=0x7fd37c009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:04.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.686+0000 7fd38841c640 1 -- 172.21.15.2:0/3946257946 shutdown_connections 2024-09-17T01:13:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.686+0000 7fd38841c640 1 --2- 172.21.15.2:0/3946257946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd380102ef0 0x7fd3800fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.686+0000 7fd38841c640 1 --2- 172.21.15.2:0/3946257946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd380102550 0x7fd380102920 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.686+0000 7fd38841c640 1 -- 172.21.15.2:0/3946257946 >> 172.21.15.2:0/3946257946 conn(0x7fd3800f80f0 msgr2=0x7fd3800fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.686+0000 7fd38841c640 1 -- 172.21.15.2:0/3946257946 shutdown_connections 2024-09-17T01:13:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.686+0000 7fd38841c640 1 -- 172.21.15.2:0/3946257946 wait complete. 2024-09-17T01:13:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.687+0000 7fd38841c640 1 Processor -- start 2024-09-17T01:13:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.687+0000 7fd38841c640 1 -- start start 2024-09-17T01:13:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.687+0000 7fd38841c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd380102550 0x7fd380113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.687+0000 7fd38841c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd380102ef0 0x7fd380113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.687+0000 7fd38841c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3801140d0 con 0x7fd380102550 2024-09-17T01:13:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.687+0000 7fd38841c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38010d4e0 con 0x7fd380102ef0 2024-09-17T01:13:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.687+0000 7fd3861b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd380102550 0x7fd380113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.687+0000 7fd3861b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd380102550 0x7fd380113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51698/0 (socket says 172.21.15.2:51698) 2024-09-17T01:13:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.687+0000 7fd3861b8640 1 -- 172.21.15.2:0/1470545632 learned_addr learned my addr 172.21.15.2:0/1470545632 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.687+0000 7fd3859b7640 1 --2- 172.21.15.2:0/1470545632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd380102ef0 0x7fd380113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.688+0000 7fd3861b8640 1 -- 172.21.15.2:0/1470545632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd380102ef0 msgr2=0x7fd380113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.688+0000 7fd3861b8640 1 --2- 172.21.15.2:0/1470545632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd380102ef0 0x7fd380113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.688+0000 7fd3861b8640 1 -- 172.21.15.2:0/1470545632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c005040 con 0x7fd380102550 2024-09-17T01:13:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.688+0000 7fd3859b7640 1 --2- 172.21.15.2:0/1470545632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd380102ef0 0x7fd380113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:13:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.688+0000 7fd3861b8640 1 --2- 172.21.15.2:0/1470545632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd380102550 0x7fd380113540 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd37c000c00 tx=0x7fd37c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.688+0000 7fd376ffd640 1 -- 172.21.15.2:0/1470545632 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd37c038070 con 0x7fd380102550 2024-09-17T01:13:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.688+0000 7fd376ffd640 1 -- 172.21.15.2:0/1470545632 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd37c02ade0 con 0x7fd380102550 2024-09-17T01:13:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.688+0000 7fd38841c640 1 -- 172.21.15.2:0/1470545632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38010d760 con 0x7fd380102550 2024-09-17T01:13:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.688+0000 7fd376ffd640 1 -- 172.21.15.2:0/1470545632 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd37c02c7e0 con 0x7fd380102550 2024-09-17T01:13:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.688+0000 7fd38841c640 1 -- 172.21.15.2:0/1470545632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38010dca0 con 0x7fd380102550 2024-09-17T01:13:04.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.689+0000 7fd38841c640 1 -- 172.21.15.2:0/1470545632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3800fdcd0 con 0x7fd380102550 2024-09-17T01:13:04.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.690+0000 7fd376ffd640 1 -- 172.21.15.2:0/1470545632 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fd37c030020 con 0x7fd380102550 2024-09-17T01:13:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.690+0000 7fd376ffd640 1 --2- 172.21.15.2:0/1470545632 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd36c06e530 0x7fd36c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.690+0000 7fd376ffd640 1 -- 172.21.15.2:0/1470545632 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fd37c0adf20 con 0x7fd380102550 2024-09-17T01:13:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.690+0000 7fd3859b7640 1 --2- 172.21.15.2:0/1470545632 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd36c06e530 0x7fd36c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.691+0000 7fd3859b7640 1 --2- 172.21.15.2:0/1470545632 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd36c06e530 0x7fd36c0709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd38010e7c0 tx=0x7fd37000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:04.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.695+0000 7fd376ffd640 1 -- 172.21.15.2:0/1470545632 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd37c0e31b0 con 0x7fd380102550 2024-09-17T01:13:04.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.907+0000 7fd38841c640 1 -- 172.21.15.2:0/1470545632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fd38004b720 con 0x7fd380102550 2024-09-17T01:13:04.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:04 smithi002 ceph-mon[98018]: pgmap v280: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:04.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.908+0000 7fd376ffd640 1 -- 172.21.15.2:0/1470545632 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v45) v1 ==== 107+0+4957 (secure 0 0 0) 0x7fd37c076f90 con 0x7fd380102550 2024-09-17T01:13:04.906 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:04.906 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":30,"btime":"2024-09-17T01:09:54:696468+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi002.fmyyzz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/1844749656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1844749656},{"type":"v1","addr":"172.21.15.2:6829","nonce":1844749656}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44299,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/2884389025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2884389025},{"type":"v1","addr":"172.21.15.99:6827","nonce":2884389025}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44305,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/3901555472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3901555472},{"type":"v1","addr":"172.21.15.99:6825","nonce":3901555472}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:09:44.670921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:04.906 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 30 2024-09-17T01:13:04.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.910+0000 7fd38841c640 1 -- 172.21.15.2:0/1470545632 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd36c06e530 msgr2=0x7fd36c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:04.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.910+0000 7fd38841c640 1 --2- 172.21.15.2:0/1470545632 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd36c06e530 0x7fd36c0709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd38010e7c0 tx=0x7fd37000b040 comp rx=0 tx=0).stop 2024-09-17T01:13:04.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.910+0000 7fd38841c640 1 -- 172.21.15.2:0/1470545632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd380102550 msgr2=0x7fd380113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:04.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.910+0000 7fd38841c640 1 --2- 172.21.15.2:0/1470545632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd380102550 0x7fd380113540 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd37c000c00 tx=0x7fd37c009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:04.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.910+0000 7fd38841c640 1 -- 172.21.15.2:0/1470545632 shutdown_connections 2024-09-17T01:13:04.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.910+0000 7fd38841c640 1 --2- 172.21.15.2:0/1470545632 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fd36c06e530 0x7fd36c0709e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:04.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.910+0000 7fd38841c640 1 --2- 172.21.15.2:0/1470545632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd380102ef0 0x7fd380113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:04.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.910+0000 7fd38841c640 1 --2- 172.21.15.2:0/1470545632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd380102550 0x7fd380113540 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:04.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.910+0000 7fd38841c640 1 -- 172.21.15.2:0/1470545632 >> 172.21.15.2:0/1470545632 conn(0x7fd3800f80f0 msgr2=0x7fd3800f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:04.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.910+0000 7fd38841c640 1 -- 172.21.15.2:0/1470545632 shutdown_connections 2024-09-17T01:13:04.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:04.910+0000 7fd38841c640 1 -- 172.21.15.2:0/1470545632 wait complete. 2024-09-17T01:13:05.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:04 smithi099 ceph-mon[77412]: pgmap v280: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:05.619 DEBUG:tasks.fs:max_mds not reduced in epoch 30 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-17T01:13:05.619 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-17T01:13:05.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-17T01:13:05.885 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:05.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:05 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1470545632' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-17T01:13:06.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:05 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1470545632' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-17T01:13:06.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:06 smithi002 ceph-mon[98018]: pgmap v281: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:07.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:06 smithi099 ceph-mon[77412]: pgmap v281: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:07.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.492+0000 7fa4228cd640 1 -- 172.21.15.2:0/1689174689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa41c0fac80 msgr2=0x7fa41c0fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:07.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.492+0000 7fa4228cd640 1 --2- 172.21.15.2:0/1689174689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa41c0fac80 0x7fa41c0fb0f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa4040048d0 tx=0x7fa404009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:07.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.493+0000 7fa4228cd640 1 -- 172.21.15.2:0/1689174689 shutdown_connections 2024-09-17T01:13:07.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.493+0000 7fa4228cd640 1 --2- 172.21.15.2:0/1689174689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa41c0fac80 0x7fa41c0fb0f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:07.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.493+0000 7fa4228cd640 1 --2- 172.21.15.2:0/1689174689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa41c102620 0x7fa41c1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:07.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.493+0000 7fa4228cd640 1 -- 172.21.15.2:0/1689174689 >> 172.21.15.2:0/1689174689 conn(0x7fa41c070ce0 msgr2=0x7fa41c0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:07.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.493+0000 7fa4228cd640 1 -- 172.21.15.2:0/1689174689 shutdown_connections 2024-09-17T01:13:07.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.493+0000 7fa4228cd640 1 -- 172.21.15.2:0/1689174689 wait complete. 2024-09-17T01:13:07.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.493+0000 7fa4228cd640 1 Processor -- start 2024-09-17T01:13:07.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.493+0000 7fa4228cd640 1 -- start start 2024-09-17T01:13:07.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.494+0000 7fa4228cd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa41c0fac80 0x7fa41c113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:07.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.494+0000 7fa4228cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa41c102620 0x7fa41c1136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:07.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.494+0000 7fa4228cd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c113cd0 con 0x7fa41c102620 2024-09-17T01:13:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.494+0000 7fa4228cd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c10d110 con 0x7fa41c0fac80 2024-09-17T01:13:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.494+0000 7fa413fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa41c102620 0x7fa41c1136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.494+0000 7fa413fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa41c102620 0x7fa41c1136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51724/0 (socket says 172.21.15.2:51724) 2024-09-17T01:13:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.494+0000 7fa413fff640 1 -- 172.21.15.2:0/1231756999 learned_addr learned my addr 172.21.15.2:0/1231756999 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.494+0000 7fa41bfff640 1 --2- 172.21.15.2:0/1231756999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa41c0fac80 0x7fa41c113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.494+0000 7fa413fff640 1 -- 172.21.15.2:0/1231756999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa41c0fac80 msgr2=0x7fa41c113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.494+0000 7fa413fff640 1 --2- 172.21.15.2:0/1231756999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa41c0fac80 0x7fa41c113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.494+0000 7fa413fff640 1 -- 172.21.15.2:0/1231756999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa404005040 con 0x7fa41c102620 2024-09-17T01:13:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.494+0000 7fa41bfff640 1 --2- 172.21.15.2:0/1231756999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa41c0fac80 0x7fa41c113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:13:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.494+0000 7fa413fff640 1 --2- 172.21.15.2:0/1231756999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa41c102620 0x7fa41c1136d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa404003080 tx=0x7fa404009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.495+0000 7fa4197fa640 1 -- 172.21.15.2:0/1231756999 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa404038070 con 0x7fa41c102620 2024-09-17T01:13:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.495+0000 7fa4197fa640 1 -- 172.21.15.2:0/1231756999 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa4040097e0 con 0x7fa41c102620 2024-09-17T01:13:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.495+0000 7fa4228cd640 1 -- 172.21.15.2:0/1231756999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c10d390 con 0x7fa41c102620 2024-09-17T01:13:07.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.495+0000 7fa4197fa640 1 -- 172.21.15.2:0/1231756999 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa40403d420 con 0x7fa41c102620 2024-09-17T01:13:07.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.495+0000 7fa4228cd640 1 -- 172.21.15.2:0/1231756999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c10d8d0 con 0x7fa41c102620 2024-09-17T01:13:07.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.496+0000 7fa4228cd640 1 -- 172.21.15.2:0/1231756999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c065790 con 0x7fa41c102620 2024-09-17T01:13:07.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.496+0000 7fa4197fa640 1 -- 172.21.15.2:0/1231756999 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fa404030020 con 0x7fa41c102620 2024-09-17T01:13:07.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.497+0000 7fa4197fa640 1 --2- 172.21.15.2:0/1231756999 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa40806e530 0x7fa4080709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:07.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.497+0000 7fa4197fa640 1 -- 172.21.15.2:0/1231756999 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fa4040ae770 con 0x7fa41c102620 2024-09-17T01:13:07.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.497+0000 7fa41bfff640 1 --2- 172.21.15.2:0/1231756999 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa40806e530 0x7fa4080709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:07.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.498+0000 7fa41bfff640 1 --2- 172.21.15.2:0/1231756999 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa40806e530 0x7fa4080709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa41c0652b0 tx=0x7fa40c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:07.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.502+0000 7fa4197fa640 1 -- 172.21.15.2:0/1231756999 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa4040777b0 con 0x7fa41c102620 2024-09-17T01:13:07.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.714+0000 7fa4228cd640 1 -- 172.21.15.2:0/1231756999 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fa41c109580 con 0x7fa41c102620 2024-09-17T01:13:07.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.714+0000 7fa4197fa640 1 -- 172.21.15.2:0/1231756999 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v45) v1 ==== 107+0+4181 (secure 0 0 0) 0x7fa40407ae70 con 0x7fa41c102620 2024-09-17T01:13:07.713 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:07.713 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":31,"btime":"2024-09-17T01:10:06:736497+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44299,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/2884389025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2884389025},{"type":"v1","addr":"172.21.15.99:6827","nonce":2884389025}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44305,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/3901555472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3901555472},{"type":"v1","addr":"172.21.15.99:6825","nonce":3901555472}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:09:44.670921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:07.713 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 31 2024-09-17T01:13:07.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.716+0000 7fa4228cd640 1 -- 172.21.15.2:0/1231756999 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa40806e530 msgr2=0x7fa4080709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:07.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.716+0000 7fa4228cd640 1 --2- 172.21.15.2:0/1231756999 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa40806e530 0x7fa4080709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa41c0652b0 tx=0x7fa40c009040 comp rx=0 tx=0).stop 2024-09-17T01:13:07.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.716+0000 7fa4228cd640 1 -- 172.21.15.2:0/1231756999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa41c102620 msgr2=0x7fa41c1136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:07.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.716+0000 7fa4228cd640 1 --2- 172.21.15.2:0/1231756999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa41c102620 0x7fa41c1136d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa404003080 tx=0x7fa404009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:07.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.716+0000 7fa4228cd640 1 -- 172.21.15.2:0/1231756999 shutdown_connections 2024-09-17T01:13:07.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.716+0000 7fa4228cd640 1 --2- 172.21.15.2:0/1231756999 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa40806e530 0x7fa4080709e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:07.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.716+0000 7fa4228cd640 1 --2- 172.21.15.2:0/1231756999 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa41c102620 0x7fa41c1136d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:07.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.716+0000 7fa4228cd640 1 --2- 172.21.15.2:0/1231756999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa41c0fac80 0x7fa41c113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:07.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.716+0000 7fa4228cd640 1 -- 172.21.15.2:0/1231756999 >> 172.21.15.2:0/1231756999 conn(0x7fa41c070ce0 msgr2=0x7fa41c0f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:07.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.717+0000 7fa4228cd640 1 -- 172.21.15.2:0/1231756999 shutdown_connections 2024-09-17T01:13:07.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:07.717+0000 7fa4228cd640 1 -- 172.21.15.2:0/1231756999 wait complete. 2024-09-17T01:13:08.349 DEBUG:tasks.fs:max_mds not reduced in epoch 31 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-17T01:13:08.349 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-17T01:13:08.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-17T01:13:08.609 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:08.903 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:08 smithi002 ceph-mon[98018]: pgmap v282: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:08.903 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:08 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1231756999' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-17T01:13:09.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:08 smithi099 ceph-mon[77412]: pgmap v282: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:09.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:08 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1231756999' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-17T01:13:10.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.114+0000 7f704de31640 1 -- 172.21.15.2:0/1659053261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70480fb4d0 msgr2=0x7f70480fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.114+0000 7f704de31640 1 --2- 172.21.15.2:0/1659053261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70480fb4d0 0x7f70480fb940 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f70300048d0 tx=0x7f7030009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.114+0000 7f704de31640 1 -- 172.21.15.2:0/1659053261 shutdown_connections 2024-09-17T01:13:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.114+0000 7f704de31640 1 --2- 172.21.15.2:0/1659053261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70480fb4d0 0x7f70480fb940 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.114+0000 7f704de31640 1 --2- 172.21.15.2:0/1659053261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7048101510 0x7f70481018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.114+0000 7f704de31640 1 -- 172.21.15.2:0/1659053261 >> 172.21.15.2:0/1659053261 conn(0x7f70480f7090 msgr2=0x7f70480f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.114+0000 7f704de31640 1 -- 172.21.15.2:0/1659053261 shutdown_connections 2024-09-17T01:13:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.114+0000 7f704de31640 1 -- 172.21.15.2:0/1659053261 wait complete. 2024-09-17T01:13:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.114+0000 7f704de31640 1 Processor -- start 2024-09-17T01:13:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.114+0000 7f704de31640 1 -- start start 2024-09-17T01:13:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f704de31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70480fb4d0 0x7f70481153c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f704de31640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7048101510 0x7f7048115900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f704de31640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7048115f00 con 0x7f70480fb4d0 2024-09-17T01:13:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f704de31640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7048116070 con 0x7f7048101510 2024-09-17T01:13:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f70477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70480fb4d0 0x7f70481153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f70477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70480fb4d0 0x7f70481153c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51740/0 (socket says 172.21.15.2:51740) 2024-09-17T01:13:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f70477fe640 1 -- 172.21.15.2:0/1180707103 learned_addr learned my addr 172.21.15.2:0/1180707103 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f703ffff640 1 --2- 172.21.15.2:0/1180707103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7048101510 0x7f7048115900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f70477fe640 1 -- 172.21.15.2:0/1180707103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7048101510 msgr2=0x7f7048115900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f70477fe640 1 --2- 172.21.15.2:0/1180707103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7048101510 0x7f7048115900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f70477fe640 1 -- 172.21.15.2:0/1180707103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030005040 con 0x7f70480fb4d0 2024-09-17T01:13:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f70477fe640 1 --2- 172.21.15.2:0/1180707103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70480fb4d0 0x7f70481153c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7038002a50 tx=0x7f7038004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f7044ff9640 1 -- 172.21.15.2:0/1180707103 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7038007c30 con 0x7f70480fb4d0 2024-09-17T01:13:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f704de31640 1 -- 172.21.15.2:0/1180707103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704810f4f0 con 0x7f70480fb4d0 2024-09-17T01:13:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.115+0000 7f7044ff9640 1 -- 172.21.15.2:0/1180707103 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f703800f040 con 0x7f70480fb4d0 2024-09-17T01:13:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.116+0000 7f7044ff9640 1 -- 172.21.15.2:0/1180707103 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f703800da90 con 0x7f70480fb4d0 2024-09-17T01:13:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.116+0000 7f704de31640 1 -- 172.21.15.2:0/1180707103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704810fa90 con 0x7f70480fb4d0 2024-09-17T01:13:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.117+0000 7f704de31640 1 -- 172.21.15.2:0/1180707103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70480fcc10 con 0x7f70480fb4d0 2024-09-17T01:13:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.117+0000 7f7044ff9640 1 -- 172.21.15.2:0/1180707103 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f703800dd00 con 0x7f70480fb4d0 2024-09-17T01:13:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.118+0000 7f7044ff9640 1 --2- 172.21.15.2:0/1180707103 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f703406e530 0x7f70340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.118+0000 7f7044ff9640 1 -- 172.21.15.2:0/1180707103 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f703808dba0 con 0x7f70480fb4d0 2024-09-17T01:13:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.118+0000 7f703ffff640 1 --2- 172.21.15.2:0/1180707103 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f703406e530 0x7f70340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.118+0000 7f703ffff640 1 --2- 172.21.15.2:0/1180707103 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f703406e530 0x7f70340709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7048110cc0 tx=0x7f7030035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.122+0000 7f7044ff9640 1 -- 172.21.15.2:0/1180707103 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7038056b60 con 0x7f70480fb4d0 2024-09-17T01:13:10.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.333+0000 7f704de31640 1 -- 172.21.15.2:0/1180707103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f70481084b0 con 0x7f70480fb4d0 2024-09-17T01:13:10.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.334+0000 7f7044ff9640 1 -- 172.21.15.2:0/1180707103 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v45) v1 ==== 107+0+5025 (secure 0 0 0) 0x7f703805a220 con 0x7f70480fb4d0 2024-09-17T01:13:10.333 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:10.333 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"btime":"2024-09-17T01:10:10:747648+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":34420,"name":"cephfs.smithi002.fmyyzz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/2400957585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2400957585},{"type":"v1","addr":"172.21.15.2:6829","nonce":2400957585}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44299,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/2884389025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2884389025},{"type":"v1","addr":"172.21.15.99:6827","nonce":2884389025}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44305,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/3901555472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3901555472},{"type":"v1","addr":"172.21.15.99:6825","nonce":3901555472}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:09:44.670921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:10.333 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 32 2024-09-17T01:13:10.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.336+0000 7f704de31640 1 -- 172.21.15.2:0/1180707103 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f703406e530 msgr2=0x7f70340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:10.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.336+0000 7f704de31640 1 --2- 172.21.15.2:0/1180707103 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f703406e530 0x7f70340709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7048110cc0 tx=0x7f7030035040 comp rx=0 tx=0).stop 2024-09-17T01:13:10.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.336+0000 7f704de31640 1 -- 172.21.15.2:0/1180707103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70480fb4d0 msgr2=0x7f70481153c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:10.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.336+0000 7f704de31640 1 --2- 172.21.15.2:0/1180707103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70480fb4d0 0x7f70481153c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7038002a50 tx=0x7f7038004600 comp rx=0 tx=0).stop 2024-09-17T01:13:10.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.336+0000 7f704de31640 1 -- 172.21.15.2:0/1180707103 shutdown_connections 2024-09-17T01:13:10.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.336+0000 7f704de31640 1 --2- 172.21.15.2:0/1180707103 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f703406e530 0x7f70340709e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:10.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.336+0000 7f704de31640 1 --2- 172.21.15.2:0/1180707103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7048101510 0x7f7048115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:10.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.336+0000 7f704de31640 1 --2- 172.21.15.2:0/1180707103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f70480fb4d0 0x7f70481153c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:10.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.336+0000 7f704de31640 1 -- 172.21.15.2:0/1180707103 >> 172.21.15.2:0/1180707103 conn(0x7f70480f7090 msgr2=0x7f70480f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:10.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.336+0000 7f704de31640 1 -- 172.21.15.2:0/1180707103 shutdown_connections 2024-09-17T01:13:10.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:10.336+0000 7f704de31640 1 -- 172.21.15.2:0/1180707103 wait complete. 2024-09-17T01:13:10.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:10 smithi002 ceph-mon[98018]: pgmap v283: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:10.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:10 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:10.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:10 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1180707103' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-17T01:13:10.997 DEBUG:tasks.fs:max_mds not reduced in epoch 32 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-17T01:13:10.997 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-17T01:13:10.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-17T01:13:11.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:10 smithi099 ceph-mon[77412]: pgmap v283: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:11.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:10 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:11.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:10 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1180707103' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-17T01:13:11.258 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.796+0000 7f85f4207640 1 -- 172.21.15.2:0/2158069738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85ec0716e0 msgr2=0x7f85ec06fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:12.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.796+0000 7f85f4207640 1 --2- 172.21.15.2:0/2158069738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85ec0716e0 0x7f85ec06fab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0048d0 tx=0x7f85dc009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.796+0000 7f85f4207640 1 -- 172.21.15.2:0/2158069738 shutdown_connections 2024-09-17T01:13:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.796+0000 7f85f4207640 1 --2- 172.21.15.2:0/2158069738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85ec06fff0 0x7f85ec070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.796+0000 7f85f4207640 1 --2- 172.21.15.2:0/2158069738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85ec0716e0 0x7f85ec06fab0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.796+0000 7f85f4207640 1 -- 172.21.15.2:0/2158069738 >> 172.21.15.2:0/2158069738 conn(0x7f85ec0f81a0 msgr2=0x7f85ec0fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.796+0000 7f85f4207640 1 -- 172.21.15.2:0/2158069738 shutdown_connections 2024-09-17T01:13:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.796+0000 7f85f4207640 1 -- 172.21.15.2:0/2158069738 wait complete. 2024-09-17T01:13:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.797+0000 7f85f4207640 1 Processor -- start 2024-09-17T01:13:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.797+0000 7f85f4207640 1 -- start start 2024-09-17T01:13:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.797+0000 7f85f4207640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85ec06fff0 0x7f85ec1198a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.797+0000 7f85f4207640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85ec0716e0 0x7f85ec119de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.797+0000 7f85f4207640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec11a430 con 0x7f85ec0716e0 2024-09-17T01:13:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.797+0000 7f85f4207640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec113840 con 0x7f85ec06fff0 2024-09-17T01:13:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.797+0000 7f85f17a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85ec0716e0 0x7f85ec119de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.797+0000 7f85f17a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85ec0716e0 0x7f85ec119de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34424/0 (socket says 172.21.15.2:34424) 2024-09-17T01:13:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.797+0000 7f85f17a2640 1 -- 172.21.15.2:0/3428724402 learned_addr learned my addr 172.21.15.2:0/3428724402 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.797+0000 7f85f1fa3640 1 --2- 172.21.15.2:0/3428724402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85ec06fff0 0x7f85ec1198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.797+0000 7f85f17a2640 1 -- 172.21.15.2:0/3428724402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85ec06fff0 msgr2=0x7f85ec1198a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.797+0000 7f85f17a2640 1 --2- 172.21.15.2:0/3428724402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85ec06fff0 0x7f85ec1198a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.798+0000 7f85f17a2640 1 -- 172.21.15.2:0/3428724402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc005040 con 0x7f85ec0716e0 2024-09-17T01:13:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.798+0000 7f85f17a2640 1 --2- 172.21.15.2:0/3428724402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85ec0716e0 0x7f85ec119de0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f85e000c830 tx=0x7f85e0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.798+0000 7f85ea7fc640 1 -- 172.21.15.2:0/3428724402 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85e000a850 con 0x7f85ec0716e0 2024-09-17T01:13:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.798+0000 7f85ea7fc640 1 -- 172.21.15.2:0/3428724402 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f85e000ae50 con 0x7f85ec0716e0 2024-09-17T01:13:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.798+0000 7f85f4207640 1 -- 172.21.15.2:0/3428724402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ec113b20 con 0x7f85ec0716e0 2024-09-17T01:13:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.798+0000 7f85ea7fc640 1 -- 172.21.15.2:0/3428724402 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85e00113a0 con 0x7f85ec0716e0 2024-09-17T01:13:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.798+0000 7f85f4207640 1 -- 172.21.15.2:0/3428724402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ec114040 con 0x7f85ec0716e0 2024-09-17T01:13:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.799+0000 7f85f4207640 1 -- 172.21.15.2:0/3428724402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ec0711f0 con 0x7f85ec0716e0 2024-09-17T01:13:12.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.800+0000 7f85ea7fc640 1 -- 172.21.15.2:0/3428724402 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f85e0012400 con 0x7f85ec0716e0 2024-09-17T01:13:12.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.800+0000 7f85ea7fc640 1 --2- 172.21.15.2:0/3428724402 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f85d406e530 0x7f85d40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:12.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.800+0000 7f85ea7fc640 1 -- 172.21.15.2:0/3428724402 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f85e008e410 con 0x7f85ec0716e0 2024-09-17T01:13:12.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.800+0000 7f85f1fa3640 1 --2- 172.21.15.2:0/3428724402 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f85d406e530 0x7f85d40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:12.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.801+0000 7f85f1fa3640 1 --2- 172.21.15.2:0/3428724402 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f85d406e530 0x7f85d40709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0048a0 tx=0x7f85dc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:12.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:12.805+0000 7f85ea7fc640 1 -- 172.21.15.2:0/3428724402 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f85e00574f0 con 0x7f85ec0716e0 2024-09-17T01:13:12.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:12 smithi002 ceph-mon[98018]: pgmap v284: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:13.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:13.017+0000 7f85f4207640 1 -- 172.21.15.2:0/3428724402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f85ec10fb50 con 0x7f85ec0716e0 2024-09-17T01:13:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:13.017+0000 7f85ea7fc640 1 -- 172.21.15.2:0/3428724402 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v45) v1 ==== 107+0+4246 (secure 0 0 0) 0x7f85e005abb0 con 0x7f85ec0716e0 2024-09-17T01:13:13.016 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:13.016 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":33,"btime":"2024-09-17T01:10:21:936862+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":34420,"name":"cephfs.smithi002.fmyyzz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/2400957585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2400957585},{"type":"v1","addr":"172.21.15.2:6829","nonce":2400957585}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44299,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/2884389025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2884389025},{"type":"v1","addr":"172.21.15.99:6827","nonce":2884389025}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":27,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:09:44.670921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 33 2024-09-17T01:13:13.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:13.019+0000 7f85f4207640 1 -- 172.21.15.2:0/3428724402 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f85d406e530 msgr2=0x7f85d40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:13.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:13.019+0000 7f85f4207640 1 --2- 172.21.15.2:0/3428724402 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f85d406e530 0x7f85d40709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0048a0 tx=0x7f85dc009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:13.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:13.019+0000 7f85f4207640 1 -- 172.21.15.2:0/3428724402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85ec0716e0 msgr2=0x7f85ec119de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:13.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:13.019+0000 7f85f4207640 1 --2- 172.21.15.2:0/3428724402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85ec0716e0 0x7f85ec119de0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f85e000c830 tx=0x7f85e0004430 comp rx=0 tx=0).stop 2024-09-17T01:13:13.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:13.019+0000 7f85f4207640 1 -- 172.21.15.2:0/3428724402 shutdown_connections 2024-09-17T01:13:13.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:13.019+0000 7f85f4207640 1 --2- 172.21.15.2:0/3428724402 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f85d406e530 0x7f85d40709e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:13.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:13.019+0000 7f85f4207640 1 --2- 172.21.15.2:0/3428724402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85ec0716e0 0x7f85ec119de0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:13.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:13.019+0000 7f85f4207640 1 --2- 172.21.15.2:0/3428724402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85ec06fff0 0x7f85ec1198a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:13.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:13.019+0000 7f85f4207640 1 -- 172.21.15.2:0/3428724402 >> 172.21.15.2:0/3428724402 conn(0x7f85ec0f81a0 msgr2=0x7f85ec0f93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:13.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:13.019+0000 7f85f4207640 1 -- 172.21.15.2:0/3428724402 shutdown_connections 2024-09-17T01:13:13.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:13.019+0000 7f85f4207640 1 -- 172.21.15.2:0/3428724402 wait complete. 2024-09-17T01:13:13.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:12 smithi099 ceph-mon[77412]: pgmap v284: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:13.653 DEBUG:tasks.fs:max_mds not reduced in epoch 33 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-17T01:13:13.653 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-17T01:13:13.653 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-17T01:13:13.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:13 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3428724402' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-17T01:13:13.911 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:14.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:13 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3428724402' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-17T01:13:14.984 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:14 smithi002 ceph-mon[98018]: pgmap v285: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:15.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:14 smithi099 ceph-mon[77412]: pgmap v285: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.538+0000 7f78bd920640 1 -- 172.21.15.2:0/675831309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b8102ef0 msgr2=0x7f78b80fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.538+0000 7f78bd920640 1 --2- 172.21.15.2:0/675831309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b8102ef0 0x7f78b80fc5b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0048d0 tx=0x7f78ac009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.538+0000 7f78bd920640 1 -- 172.21.15.2:0/675831309 shutdown_connections 2024-09-17T01:13:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.538+0000 7f78bd920640 1 --2- 172.21.15.2:0/675831309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b8102ef0 0x7f78b80fc5b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.538+0000 7f78bd920640 1 --2- 172.21.15.2:0/675831309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78b8102550 0x7f78b8102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.538+0000 7f78bd920640 1 -- 172.21.15.2:0/675831309 >> 172.21.15.2:0/675831309 conn(0x7f78b80f80f0 msgr2=0x7f78b80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.538+0000 7f78bd920640 1 -- 172.21.15.2:0/675831309 shutdown_connections 2024-09-17T01:13:15.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.538+0000 7f78bd920640 1 -- 172.21.15.2:0/675831309 wait complete. 2024-09-17T01:13:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.539+0000 7f78bd920640 1 Processor -- start 2024-09-17T01:13:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.539+0000 7f78bd920640 1 -- start start 2024-09-17T01:13:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.539+0000 7f78bd920640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78b8102550 0x7f78b8115740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.539+0000 7f78bd920640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b8102ef0 0x7f78b8115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.539+0000 7f78bd920640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b81162d0 con 0x7f78b8102ef0 2024-09-17T01:13:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.539+0000 7f78bd920640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b810f6e0 con 0x7f78b8102550 2024-09-17T01:13:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.539+0000 7f78b67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b8102ef0 0x7f78b8115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.539+0000 7f78b67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b8102ef0 0x7f78b8115c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34438/0 (socket says 172.21.15.2:34438) 2024-09-17T01:13:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.539+0000 7f78b67fc640 1 -- 172.21.15.2:0/2978657806 learned_addr learned my addr 172.21.15.2:0/2978657806 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.539+0000 7f78b6ffd640 1 --2- 172.21.15.2:0/2978657806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78b8102550 0x7f78b8115740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.539+0000 7f78b67fc640 1 -- 172.21.15.2:0/2978657806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78b8102550 msgr2=0x7f78b8115740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.539+0000 7f78b67fc640 1 --2- 172.21.15.2:0/2978657806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78b8102550 0x7f78b8115740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.539+0000 7f78b67fc640 1 -- 172.21.15.2:0/2978657806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac005040 con 0x7f78b8102ef0 2024-09-17T01:13:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.539+0000 7f78b67fc640 1 --2- 172.21.15.2:0/2978657806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b8102ef0 0x7f78b8115c80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f78ac003080 tx=0x7f78ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.540+0000 7f789f7fe640 1 -- 172.21.15.2:0/2978657806 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78ac038070 con 0x7f78b8102ef0 2024-09-17T01:13:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.540+0000 7f789f7fe640 1 -- 172.21.15.2:0/2978657806 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f78ac009760 con 0x7f78b8102ef0 2024-09-17T01:13:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.540+0000 7f789f7fe640 1 -- 172.21.15.2:0/2978657806 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78ac033420 con 0x7f78b8102ef0 2024-09-17T01:13:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.540+0000 7f78bd920640 1 -- 172.21.15.2:0/2978657806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b810f960 con 0x7f78b8102ef0 2024-09-17T01:13:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.540+0000 7f78bd920640 1 -- 172.21.15.2:0/2978657806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b810fe40 con 0x7f78b8102ef0 2024-09-17T01:13:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.541+0000 7f78bd920640 1 -- 172.21.15.2:0/2978657806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b80fdcd0 con 0x7f78b8102ef0 2024-09-17T01:13:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.541+0000 7f789f7fe640 1 -- 172.21.15.2:0/2978657806 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f78ac030020 con 0x7f78b8102ef0 2024-09-17T01:13:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.542+0000 7f789f7fe640 1 --2- 172.21.15.2:0/2978657806 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f78a006e530 0x7f78a00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.542+0000 7f789f7fe640 1 -- 172.21.15.2:0/2978657806 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f78ac0ade70 con 0x7f78b8102ef0 2024-09-17T01:13:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.542+0000 7f78b6ffd640 1 --2- 172.21.15.2:0/2978657806 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f78a006e530 0x7f78a00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.542+0000 7f78b6ffd640 1 --2- 172.21.15.2:0/2978657806 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f78a006e530 0x7f78a00709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f78a80041d0 tx=0x7f78a8004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:15.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.546+0000 7f789f7fe640 1 -- 172.21.15.2:0/2978657806 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f78ac076eb0 con 0x7f78b8102ef0 2024-09-17T01:13:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.762+0000 7f78bd920640 1 -- 172.21.15.2:0/2978657806 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f78b80fbd50 con 0x7f78b8102ef0 2024-09-17T01:13:15.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.762+0000 7f789f7fe640 1 -- 172.21.15.2:0/2978657806 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v45) v1 ==== 107+0+5093 (secure 0 0 0) 0x7f78ac07a570 con 0x7f78b8102ef0 2024-09-17T01:13:15.761 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:15.761 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":34,"btime":"2024-09-17T01:10:26:947392+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":34420,"name":"cephfs.smithi002.fmyyzz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/2400957585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2400957585},{"type":"v1","addr":"172.21.15.2:6829","nonce":2400957585}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44299,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/2884389025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2884389025},{"type":"v1","addr":"172.21.15.99:6827","nonce":2884389025}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":44349,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/1774556036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1774556036},{"type":"v1","addr":"172.21.15.99:6825","nonce":1774556036}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":27,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:09:44.670921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:15.761 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 34 2024-09-17T01:13:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.764+0000 7f78bd920640 1 -- 172.21.15.2:0/2978657806 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f78a006e530 msgr2=0x7f78a00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.764+0000 7f78bd920640 1 --2- 172.21.15.2:0/2978657806 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f78a006e530 0x7f78a00709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f78a80041d0 tx=0x7f78a8004330 comp rx=0 tx=0).stop 2024-09-17T01:13:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.764+0000 7f78bd920640 1 -- 172.21.15.2:0/2978657806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b8102ef0 msgr2=0x7f78b8115c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.764+0000 7f78bd920640 1 --2- 172.21.15.2:0/2978657806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b8102ef0 0x7f78b8115c80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f78ac003080 tx=0x7f78ac009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.764+0000 7f78bd920640 1 -- 172.21.15.2:0/2978657806 shutdown_connections 2024-09-17T01:13:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.764+0000 7f78bd920640 1 --2- 172.21.15.2:0/2978657806 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f78a006e530 0x7f78a00709e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.764+0000 7f78bd920640 1 --2- 172.21.15.2:0/2978657806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78b8102ef0 0x7f78b8115c80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.764+0000 7f78bd920640 1 --2- 172.21.15.2:0/2978657806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78b8102550 0x7f78b8115740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.764+0000 7f78bd920640 1 -- 172.21.15.2:0/2978657806 >> 172.21.15.2:0/2978657806 conn(0x7f78b80f80f0 msgr2=0x7f78b80f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:15.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.764+0000 7f78bd920640 1 -- 172.21.15.2:0/2978657806 shutdown_connections 2024-09-17T01:13:15.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:15.764+0000 7f78bd920640 1 -- 172.21.15.2:0/2978657806 wait complete. 2024-09-17T01:13:16.360 DEBUG:tasks.fs:max_mds not reduced in epoch 34 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-17T01:13:16.360 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-17T01:13:16.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-17T01:13:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:16.877 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:16 smithi002 ceph-mon[98018]: pgmap v286: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:16.877 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:16 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/2978657806' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-17T01:13:17.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:16 smithi099 ceph-mon[77412]: pgmap v286: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:17.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:16 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/2978657806' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-17T01:13:18.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.330+0000 7fe3c1f24640 1 -- 172.21.15.2:0/3086323036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3bc102ed0 msgr2=0x7fe3bc0fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:18.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.330+0000 7fe3c1f24640 1 --2- 172.21.15.2:0/3086323036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3bc102ed0 0x7fe3bc0fc590 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00048d0 tx=0x7fe3b0009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:18.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.330+0000 7fe3c1f24640 1 -- 172.21.15.2:0/3086323036 shutdown_connections 2024-09-17T01:13:18.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.330+0000 7fe3c1f24640 1 --2- 172.21.15.2:0/3086323036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3bc102ed0 0x7fe3bc0fc590 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:18.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.330+0000 7fe3c1f24640 1 --2- 172.21.15.2:0/3086323036 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3bc102530 0x7fe3bc102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:18.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.330+0000 7fe3c1f24640 1 -- 172.21.15.2:0/3086323036 >> 172.21.15.2:0/3086323036 conn(0x7fe3bc0f80f0 msgr2=0x7fe3bc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:18.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.330+0000 7fe3c1f24640 1 -- 172.21.15.2:0/3086323036 shutdown_connections 2024-09-17T01:13:18.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.330+0000 7fe3c1f24640 1 -- 172.21.15.2:0/3086323036 wait complete. 2024-09-17T01:13:18.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.331+0000 7fe3c1f24640 1 Processor -- start 2024-09-17T01:13:18.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.331+0000 7fe3c1f24640 1 -- start start 2024-09-17T01:13:18.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.331+0000 7fe3c1f24640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3bc102530 0x7fe3bc1131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:18.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.331+0000 7fe3c1f24640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3bc102ed0 0x7fe3bc113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:18.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.331+0000 7fe3c1f24640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc113d10 con 0x7fe3bc102ed0 2024-09-17T01:13:18.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.331+0000 7fe3c1f24640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc10d150 con 0x7fe3bc102530 2024-09-17T01:13:18.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.331+0000 7fe3baffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3bc102ed0 0x7fe3bc113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:18.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.331+0000 7fe3baffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3bc102ed0 0x7fe3bc113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34450/0 (socket says 172.21.15.2:34450) 2024-09-17T01:13:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.331+0000 7fe3baffd640 1 -- 172.21.15.2:0/1986525413 learned_addr learned my addr 172.21.15.2:0/1986525413 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.331+0000 7fe3bb7fe640 1 --2- 172.21.15.2:0/1986525413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3bc102530 0x7fe3bc1131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.332+0000 7fe3baffd640 1 -- 172.21.15.2:0/1986525413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3bc102530 msgr2=0x7fe3bc1131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.332+0000 7fe3baffd640 1 --2- 172.21.15.2:0/1986525413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3bc102530 0x7fe3bc1131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.332+0000 7fe3baffd640 1 -- 172.21.15.2:0/1986525413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b0005040 con 0x7fe3bc102ed0 2024-09-17T01:13:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.332+0000 7fe3baffd640 1 --2- 172.21.15.2:0/1986525413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3bc102ed0 0x7fe3bc113710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00043d0 tx=0x7fe3b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.332+0000 7fe3a3fff640 1 -- 172.21.15.2:0/1986525413 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3b0038070 con 0x7fe3bc102ed0 2024-09-17T01:13:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.332+0000 7fe3a3fff640 1 -- 172.21.15.2:0/1986525413 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe3b00096e0 con 0x7fe3bc102ed0 2024-09-17T01:13:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.332+0000 7fe3c1f24640 1 -- 172.21.15.2:0/1986525413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3bc10d3d0 con 0x7fe3bc102ed0 2024-09-17T01:13:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.332+0000 7fe3c1f24640 1 -- 172.21.15.2:0/1986525413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3bc10d890 con 0x7fe3bc102ed0 2024-09-17T01:13:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.332+0000 7fe3a3fff640 1 -- 172.21.15.2:0/1986525413 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3b002c8a0 con 0x7fe3bc102ed0 2024-09-17T01:13:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.334+0000 7fe3c1f24640 1 -- 172.21.15.2:0/1986525413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3bc0fdcb0 con 0x7fe3bc102ed0 2024-09-17T01:13:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.334+0000 7fe3a3fff640 1 -- 172.21.15.2:0/1986525413 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fe3b0030020 con 0x7fe3bc102ed0 2024-09-17T01:13:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.334+0000 7fe3a3fff640 1 --2- 172.21.15.2:0/1986525413 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe3a406e530 0x7fe3a40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.335+0000 7fe3a3fff640 1 -- 172.21.15.2:0/1986525413 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fe3b00adf80 con 0x7fe3bc102ed0 2024-09-17T01:13:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.335+0000 7fe3bb7fe640 1 --2- 172.21.15.2:0/1986525413 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe3a406e530 0x7fe3a40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.335+0000 7fe3bb7fe640 1 --2- 172.21.15.2:0/1986525413 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe3a406e530 0x7fe3a40709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009fd0 tx=0x7fe3ac00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:18.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.339+0000 7fe3a3fff640 1 -- 172.21.15.2:0/1986525413 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe3b0077070 con 0x7fe3bc102ed0 2024-09-17T01:13:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.552+0000 7fe3c1f24640 1 -- 172.21.15.2:0/1986525413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7fe3bc109540 con 0x7fe3bc102ed0 2024-09-17T01:13:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.553+0000 7fe3a3fff640 1 -- 172.21.15.2:0/1986525413 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v45) v1 ==== 107+0+4314 (secure 0 0 0) 0x7fe3b003e080 con 0x7fe3bc102ed0 2024-09-17T01:13:18.553 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:18.553 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":35,"btime":"2024-09-17T01:10:37:022019+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":34420,"name":"cephfs.smithi002.fmyyzz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/2400957585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2400957585},{"type":"v1","addr":"172.21.15.2:6829","nonce":2400957585}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44349,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/1774556036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1774556036},{"type":"v1","addr":"172.21.15.99:6825","nonce":1774556036}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":27,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:09:44.670921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 35 2024-09-17T01:13:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.555+0000 7fe3c1f24640 1 -- 172.21.15.2:0/1986525413 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe3a406e530 msgr2=0x7fe3a40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.555+0000 7fe3c1f24640 1 --2- 172.21.15.2:0/1986525413 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe3a406e530 0x7fe3a40709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009fd0 tx=0x7fe3ac00b040 comp rx=0 tx=0).stop 2024-09-17T01:13:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.555+0000 7fe3c1f24640 1 -- 172.21.15.2:0/1986525413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3bc102ed0 msgr2=0x7fe3bc113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.555+0000 7fe3c1f24640 1 --2- 172.21.15.2:0/1986525413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3bc102ed0 0x7fe3bc113710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe3b00043d0 tx=0x7fe3b0009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.555+0000 7fe3c1f24640 1 -- 172.21.15.2:0/1986525413 shutdown_connections 2024-09-17T01:13:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.555+0000 7fe3c1f24640 1 --2- 172.21.15.2:0/1986525413 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe3a406e530 0x7fe3a40709e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.555+0000 7fe3c1f24640 1 --2- 172.21.15.2:0/1986525413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3bc102ed0 0x7fe3bc113710 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.555+0000 7fe3c1f24640 1 --2- 172.21.15.2:0/1986525413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3bc102530 0x7fe3bc1131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.555+0000 7fe3c1f24640 1 -- 172.21.15.2:0/1986525413 >> 172.21.15.2:0/1986525413 conn(0x7fe3bc0f80f0 msgr2=0x7fe3bc0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.556+0000 7fe3c1f24640 1 -- 172.21.15.2:0/1986525413 shutdown_connections 2024-09-17T01:13:18.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:18.556+0000 7fe3c1f24640 1 -- 172.21.15.2:0/1986525413 wait complete. 2024-09-17T01:13:18.848 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:18 smithi002 ceph-mon[98018]: pgmap v287: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:18.849 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:18 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1986525413' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-17T01:13:19.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:18 smithi099 ceph-mon[77412]: pgmap v287: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:19.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:18 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1986525413' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-17T01:13:19.169 DEBUG:tasks.fs:max_mds not reduced in epoch 35 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-17T01:13:19.169 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-17T01:13:19.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-17T01:13:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:20.845 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:20 smithi002 ceph-mon[98018]: pgmap v288: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:21.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:20 smithi099 ceph-mon[77412]: pgmap v288: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:21.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.054+0000 7f4a74ef5640 1 -- 172.21.15.2:0/2598575305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a700fcf80 msgr2=0x7f4a700fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:21.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.054+0000 7f4a74ef5640 1 --2- 172.21.15.2:0/2598575305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a700fcf80 0x7f4a700fd3d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4a580048d0 tx=0x7f4a58009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.055+0000 7f4a74ef5640 1 -- 172.21.15.2:0/2598575305 shutdown_connections 2024-09-17T01:13:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.055+0000 7f4a74ef5640 1 --2- 172.21.15.2:0/2598575305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a700fcf80 0x7f4a700fd3d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.055+0000 7f4a74ef5640 1 --2- 172.21.15.2:0/2598575305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a700fb810 0x7f4a700fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.055+0000 7f4a74ef5640 1 -- 172.21.15.2:0/2598575305 >> 172.21.15.2:0/2598575305 conn(0x7f4a700723b0 msgr2=0x7f4a700727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.055+0000 7f4a74ef5640 1 -- 172.21.15.2:0/2598575305 shutdown_connections 2024-09-17T01:13:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.055+0000 7f4a74ef5640 1 -- 172.21.15.2:0/2598575305 wait complete. 2024-09-17T01:13:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.055+0000 7f4a74ef5640 1 Processor -- start 2024-09-17T01:13:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.056+0000 7f4a74ef5640 1 -- start start 2024-09-17T01:13:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.056+0000 7f4a74ef5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a700fb810 0x7f4a701120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.056+0000 7f4a74ef5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a700fcf80 0x7f4a70112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.056+0000 7f4a74ef5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a70112c10 con 0x7f4a700fcf80 2024-09-17T01:13:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.056+0000 7f4a74ef5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7010c050 con 0x7f4a700fb810 2024-09-17T01:13:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.056+0000 7f4a6dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a700fcf80 0x7f4a70112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:21.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.056+0000 7f4a6dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a700fcf80 0x7f4a70112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50528/0 (socket says 172.21.15.2:50528) 2024-09-17T01:13:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.056+0000 7f4a6dd9b640 1 -- 172.21.15.2:0/533653783 learned_addr learned my addr 172.21.15.2:0/533653783 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.056+0000 7f4a6e59c640 1 --2- 172.21.15.2:0/533653783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a700fb810 0x7f4a701120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.056+0000 7f4a6dd9b640 1 -- 172.21.15.2:0/533653783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a700fb810 msgr2=0x7f4a701120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.056+0000 7f4a6dd9b640 1 --2- 172.21.15.2:0/533653783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a700fb810 0x7f4a701120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.056+0000 7f4a6dd9b640 1 -- 172.21.15.2:0/533653783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a58005040 con 0x7f4a700fcf80 2024-09-17T01:13:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.056+0000 7f4a6e59c640 1 --2- 172.21.15.2:0/533653783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a700fb810 0x7f4a701120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:13:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.056+0000 7f4a6dd9b640 1 --2- 172.21.15.2:0/533653783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a700fcf80 0x7f4a70112610 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4a58000c00 tx=0x7f4a58009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.057+0000 7f4a66ffd640 1 -- 172.21.15.2:0/533653783 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a58038070 con 0x7f4a700fcf80 2024-09-17T01:13:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.057+0000 7f4a66ffd640 1 -- 172.21.15.2:0/533653783 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4a5802ade0 con 0x7f4a700fcf80 2024-09-17T01:13:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.057+0000 7f4a74ef5640 1 -- 172.21.15.2:0/533653783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7010c2d0 con 0x7f4a700fcf80 2024-09-17T01:13:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.057+0000 7f4a66ffd640 1 -- 172.21.15.2:0/533653783 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a5802c7e0 con 0x7f4a700fcf80 2024-09-17T01:13:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.057+0000 7f4a74ef5640 1 -- 172.21.15.2:0/533653783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7010c810 con 0x7f4a700fcf80 2024-09-17T01:13:21.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.058+0000 7f4a74ef5640 1 -- 172.21.15.2:0/533653783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a700fcbc0 con 0x7f4a700fcf80 2024-09-17T01:13:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.058+0000 7f4a66ffd640 1 -- 172.21.15.2:0/533653783 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f4a58030020 con 0x7f4a700fcf80 2024-09-17T01:13:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.059+0000 7f4a66ffd640 1 --2- 172.21.15.2:0/533653783 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4a5c06e530 0x7f4a5c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.059+0000 7f4a66ffd640 1 -- 172.21.15.2:0/533653783 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f4a580ade80 con 0x7f4a700fcf80 2024-09-17T01:13:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.059+0000 7f4a6e59c640 1 --2- 172.21.15.2:0/533653783 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4a5c06e530 0x7f4a5c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.060+0000 7f4a6e59c640 1 --2- 172.21.15.2:0/533653783 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4a5c06e530 0x7f4a5c0709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4a60004d80 tx=0x7f4a6000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:21.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.064+0000 7f4a66ffd640 1 -- 172.21.15.2:0/533653783 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4a58076f70 con 0x7f4a700fcf80 2024-09-17T01:13:21.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.279+0000 7f4a74ef5640 1 -- 172.21.15.2:0/533653783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f4a7010d770 con 0x7f4a700fcf80 2024-09-17T01:13:21.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.279+0000 7f4a66ffd640 1 -- 172.21.15.2:0/533653783 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v45) v1 ==== 107+0+5161 (secure 0 0 0) 0x7f4a5807a630 con 0x7f4a700fcf80 2024-09-17T01:13:21.278 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:21.278 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"btime":"2024-09-17T01:10:43:041888+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":34420,"name":"cephfs.smithi002.fmyyzz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/2400957585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2400957585},{"type":"v1","addr":"172.21.15.2:6829","nonce":2400957585}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44349,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/1774556036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1774556036},{"type":"v1","addr":"172.21.15.99:6825","nonce":1774556036}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44375,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/4220578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4220578351},{"type":"v1","addr":"172.21.15.99:6827","nonce":4220578351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":27,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:09:44.670921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:21.278 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2024-09-17T01:13:21.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.281+0000 7f4a74ef5640 1 -- 172.21.15.2:0/533653783 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4a5c06e530 msgr2=0x7f4a5c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:21.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.281+0000 7f4a74ef5640 1 --2- 172.21.15.2:0/533653783 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4a5c06e530 0x7f4a5c0709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4a60004d80 tx=0x7f4a6000b040 comp rx=0 tx=0).stop 2024-09-17T01:13:21.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.281+0000 7f4a74ef5640 1 -- 172.21.15.2:0/533653783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a700fcf80 msgr2=0x7f4a70112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:21.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.281+0000 7f4a74ef5640 1 --2- 172.21.15.2:0/533653783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a700fcf80 0x7f4a70112610 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4a58000c00 tx=0x7f4a58009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.281+0000 7f4a74ef5640 1 -- 172.21.15.2:0/533653783 shutdown_connections 2024-09-17T01:13:21.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.281+0000 7f4a74ef5640 1 --2- 172.21.15.2:0/533653783 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f4a5c06e530 0x7f4a5c0709e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.281+0000 7f4a74ef5640 1 --2- 172.21.15.2:0/533653783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a700fcf80 0x7f4a70112610 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.281+0000 7f4a74ef5640 1 --2- 172.21.15.2:0/533653783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a700fb810 0x7f4a701120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:21.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.282+0000 7f4a74ef5640 1 -- 172.21.15.2:0/533653783 >> 172.21.15.2:0/533653783 conn(0x7f4a700723b0 msgr2=0x7f4a700fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:21.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.282+0000 7f4a74ef5640 1 -- 172.21.15.2:0/533653783 shutdown_connections 2024-09-17T01:13:21.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:21.282+0000 7f4a74ef5640 1 -- 172.21.15.2:0/533653783 wait complete. 2024-09-17T01:13:21.903 DEBUG:tasks.fs:max_mds not reduced in epoch 36 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-17T01:13:21.903 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-09-17T01:13:21.903 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 37 2024-09-17T01:13:21.928 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:21 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/533653783' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-17T01:13:22.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:21 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/533653783' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-17T01:13:22.165 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:22.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:22 smithi002 ceph-mon[98018]: pgmap v289: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:23.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:22 smithi099 ceph-mon[77412]: pgmap v289: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.727+0000 7faabdc80640 1 -- 172.21.15.2:0/3445722859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab8101510 msgr2=0x7faab81018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.727+0000 7faabdc80640 1 --2- 172.21.15.2:0/3445722859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab8101510 0x7faab81018e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7faaa80048d0 tx=0x7faaa8009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.727+0000 7faabdc80640 1 -- 172.21.15.2:0/3445722859 shutdown_connections 2024-09-17T01:13:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.727+0000 7faabdc80640 1 --2- 172.21.15.2:0/3445722859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faab80fb4d0 0x7faab80fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.727+0000 7faabdc80640 1 --2- 172.21.15.2:0/3445722859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab8101510 0x7faab81018e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.727+0000 7faabdc80640 1 -- 172.21.15.2:0/3445722859 >> 172.21.15.2:0/3445722859 conn(0x7faab80f7090 msgr2=0x7faab80f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.727+0000 7faabdc80640 1 -- 172.21.15.2:0/3445722859 shutdown_connections 2024-09-17T01:13:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.727+0000 7faabdc80640 1 -- 172.21.15.2:0/3445722859 wait complete. 2024-09-17T01:13:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.728+0000 7faabdc80640 1 Processor -- start 2024-09-17T01:13:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.728+0000 7faabdc80640 1 -- start start 2024-09-17T01:13:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.728+0000 7faabdc80640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faab80fb4d0 0x7faab810e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.728+0000 7faabdc80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab8101510 0x7faab810e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.728+0000 7faabdc80640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab810ec80 con 0x7faab8101510 2024-09-17T01:13:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.728+0000 7faabdc80640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab810edf0 con 0x7faab80fb4d0 2024-09-17T01:13:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.728+0000 7faab6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab8101510 0x7faab810e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.728+0000 7faab6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab8101510 0x7faab810e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50550/0 (socket says 172.21.15.2:50550) 2024-09-17T01:13:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.728+0000 7faab6ffd640 1 -- 172.21.15.2:0/4194284011 learned_addr learned my addr 172.21.15.2:0/4194284011 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.728+0000 7faab77fe640 1 --2- 172.21.15.2:0/4194284011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faab80fb4d0 0x7faab810e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.729+0000 7faab6ffd640 1 -- 172.21.15.2:0/4194284011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faab80fb4d0 msgr2=0x7faab810e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.729+0000 7faab6ffd640 1 --2- 172.21.15.2:0/4194284011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faab80fb4d0 0x7faab810e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.729+0000 7faab6ffd640 1 -- 172.21.15.2:0/4194284011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa8005040 con 0x7faab8101510 2024-09-17T01:13:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.729+0000 7faab6ffd640 1 --2- 172.21.15.2:0/4194284011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab8101510 0x7faab810e680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faaa000c810 tx=0x7faaa00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.729+0000 7faaaffff640 1 -- 172.21.15.2:0/4194284011 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaa000a7a0 con 0x7faab8101510 2024-09-17T01:13:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.729+0000 7faabdc80640 1 -- 172.21.15.2:0/4194284011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab81171b0 con 0x7faab8101510 2024-09-17T01:13:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.729+0000 7faaaffff640 1 -- 172.21.15.2:0/4194284011 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faaa000ada0 con 0x7faab8101510 2024-09-17T01:13:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.729+0000 7faaaffff640 1 -- 172.21.15.2:0/4194284011 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faaa0011380 con 0x7faab8101510 2024-09-17T01:13:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.729+0000 7faabdc80640 1 -- 172.21.15.2:0/4194284011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab81176f0 con 0x7faab8101510 2024-09-17T01:13:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.730+0000 7faabdc80640 1 -- 172.21.15.2:0/4194284011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab80fcc10 con 0x7faab8101510 2024-09-17T01:13:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.731+0000 7faaaffff640 1 -- 172.21.15.2:0/4194284011 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7faaa00127d0 con 0x7faab8101510 2024-09-17T01:13:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.731+0000 7faaaffff640 1 --2- 172.21.15.2:0/4194284011 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faaa406e530 0x7faaa40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.731+0000 7faaaffff640 1 -- 172.21.15.2:0/4194284011 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7faaa008e7f0 con 0x7faab8101510 2024-09-17T01:13:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.731+0000 7faab77fe640 1 --2- 172.21.15.2:0/4194284011 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faaa406e530 0x7faaa40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.732+0000 7faab77fe640 1 --2- 172.21.15.2:0/4194284011 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faaa406e530 0x7faaa40709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009ac0 tx=0x7faaa8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.736+0000 7faaaffff640 1 -- 172.21.15.2:0/4194284011 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7faaa00577b0 con 0x7faab8101510 2024-09-17T01:13:23.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.949+0000 7faabdc80640 1 -- 172.21.15.2:0/4194284011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7faab81084f0 con 0x7faab8101510 2024-09-17T01:13:23.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.950+0000 7faaaffff640 1 -- 172.21.15.2:0/4194284011 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v45) v1 ==== 107+0+5160 (secure 0 0 0) 0x7faaa005ae70 con 0x7faab8101510 2024-09-17T01:13:23.949 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:23.949 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":37,"btime":"2024-09-17T01:10:49:571409+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":34420,"name":"cephfs.smithi002.fmyyzz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6829/2400957585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2400957585},{"type":"v1","addr":"172.21.15.2:6829","nonce":2400957585}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":44349,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/1774556036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1774556036},{"type":"v1","addr":"172.21.15.99:6825","nonce":1774556036}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44375,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/4220578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4220578351},{"type":"v1","addr":"172.21.15.99:6827","nonce":4220578351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:10:48.574583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:23.949 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 37 2024-09-17T01:13:23.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.952+0000 7faabdc80640 1 -- 172.21.15.2:0/4194284011 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faaa406e530 msgr2=0x7faaa40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.952+0000 7faabdc80640 1 --2- 172.21.15.2:0/4194284011 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faaa406e530 0x7faaa40709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009ac0 tx=0x7faaa8035040 comp rx=0 tx=0).stop 2024-09-17T01:13:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.952+0000 7faabdc80640 1 -- 172.21.15.2:0/4194284011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab8101510 msgr2=0x7faab810e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.952+0000 7faabdc80640 1 --2- 172.21.15.2:0/4194284011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab8101510 0x7faab810e680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faaa000c810 tx=0x7faaa00043c0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.952+0000 7faabdc80640 1 -- 172.21.15.2:0/4194284011 shutdown_connections 2024-09-17T01:13:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.952+0000 7faabdc80640 1 --2- 172.21.15.2:0/4194284011 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7faaa406e530 0x7faaa40709e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.952+0000 7faabdc80640 1 --2- 172.21.15.2:0/4194284011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faab8101510 0x7faab810e680 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.952+0000 7faabdc80640 1 --2- 172.21.15.2:0/4194284011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faab80fb4d0 0x7faab810e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.952+0000 7faabdc80640 1 -- 172.21.15.2:0/4194284011 >> 172.21.15.2:0/4194284011 conn(0x7faab80f7090 msgr2=0x7faab80f7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:23.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.952+0000 7faabdc80640 1 -- 172.21.15.2:0/4194284011 shutdown_connections 2024-09-17T01:13:23.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:23.952+0000 7faabdc80640 1 -- 172.21.15.2:0/4194284011 wait complete. 2024-09-17T01:13:24.526 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 37 2024-09-17T01:13:24.526 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 38 2024-09-17T01:13:24.828 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:24.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:24 smithi002 ceph-mon[98018]: pgmap v290: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:24.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:24 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/4194284011' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-17T01:13:25.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:24 smithi099 ceph-mon[77412]: pgmap v290: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:25.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:24 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/4194284011' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-17T01:13:25.876 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:25 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:26.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:25 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:26.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.400+0000 7f0590fa8640 1 -- 172.21.15.2:0/1792736365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f058c070360 msgr2=0x7f058c1088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:26.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.400+0000 7f0590fa8640 1 --2- 172.21.15.2:0/1792736365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f058c070360 0x7f058c1088d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f05740048d0 tx=0x7f0574009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:26.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.400+0000 7f0590fa8640 1 -- 172.21.15.2:0/1792736365 shutdown_connections 2024-09-17T01:13:26.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.400+0000 7f0590fa8640 1 --2- 172.21.15.2:0/1792736365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f058c070360 0x7f058c1088d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:26.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.400+0000 7f0590fa8640 1 --2- 172.21.15.2:0/1792736365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f058c06fa50 0x7f058c06fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:26.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.400+0000 7f0590fa8640 1 -- 172.21.15.2:0/1792736365 >> 172.21.15.2:0/1792736365 conn(0x7f058c0f80f0 msgr2=0x7f058c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:26.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.400+0000 7f0590fa8640 1 -- 172.21.15.2:0/1792736365 shutdown_connections 2024-09-17T01:13:26.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.400+0000 7f0590fa8640 1 -- 172.21.15.2:0/1792736365 wait complete. 2024-09-17T01:13:26.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.400+0000 7f0590fa8640 1 Processor -- start 2024-09-17T01:13:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.401+0000 7f0590fa8640 1 -- start start 2024-09-17T01:13:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.401+0000 7f0590fa8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f058c06fa50 0x7f058c1153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.401+0000 7f0590fa8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f058c070360 0x7f058c1158e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.401+0000 7f0590fa8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c115ee0 con 0x7f058c070360 2024-09-17T01:13:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.401+0000 7f0590fa8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c116050 con 0x7f058c06fa50 2024-09-17T01:13:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.401+0000 7f0583fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f058c070360 0x7f058c1158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.401+0000 7f0583fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f058c070360 0x7f058c1158e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50574/0 (socket says 172.21.15.2:50574) 2024-09-17T01:13:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.401+0000 7f0583fff640 1 -- 172.21.15.2:0/280299164 learned_addr learned my addr 172.21.15.2:0/280299164 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.401+0000 7f058a59c640 1 --2- 172.21.15.2:0/280299164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f058c06fa50 0x7f058c1153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.401+0000 7f0583fff640 1 -- 172.21.15.2:0/280299164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f058c06fa50 msgr2=0x7f058c1153a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.401+0000 7f0583fff640 1 --2- 172.21.15.2:0/280299164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f058c06fa50 0x7f058c1153a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.401+0000 7f0583fff640 1 -- 172.21.15.2:0/280299164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0574005040 con 0x7f058c070360 2024-09-17T01:13:26.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.401+0000 7f0583fff640 1 --2- 172.21.15.2:0/280299164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f058c070360 0x7f058c1158e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f05740043d0 tx=0x7f0574009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.402+0000 7f0582ffd640 1 -- 172.21.15.2:0/280299164 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0574038070 con 0x7f058c070360 2024-09-17T01:13:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.402+0000 7f0582ffd640 1 -- 172.21.15.2:0/280299164 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f05740096e0 con 0x7f058c070360 2024-09-17T01:13:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.402+0000 7f0590fa8640 1 -- 172.21.15.2:0/280299164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c10f470 con 0x7f058c070360 2024-09-17T01:13:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.402+0000 7f0582ffd640 1 -- 172.21.15.2:0/280299164 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f057403d420 con 0x7f058c070360 2024-09-17T01:13:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.402+0000 7f0590fa8640 1 -- 172.21.15.2:0/280299164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c10f990 con 0x7f058c070360 2024-09-17T01:13:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.403+0000 7f0590fa8640 1 -- 172.21.15.2:0/280299164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c071190 con 0x7f058c070360 2024-09-17T01:13:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.403+0000 7f0582ffd640 1 -- 172.21.15.2:0/280299164 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f0574030020 con 0x7f058c070360 2024-09-17T01:13:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.404+0000 7f0582ffd640 1 --2- 172.21.15.2:0/280299164 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f057806e530 0x7f05780709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.404+0000 7f0582ffd640 1 -- 172.21.15.2:0/280299164 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f05740ae610 con 0x7f058c070360 2024-09-17T01:13:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.404+0000 7f058a59c640 1 --2- 172.21.15.2:0/280299164 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f057806e530 0x7f05780709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.404+0000 7f058a59c640 1 --2- 172.21.15.2:0/280299164 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f057806e530 0x7f05780709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f057c009fd0 tx=0x7f057c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.408+0000 7f0582ffd640 1 -- 172.21.15.2:0/280299164 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0574077650 con 0x7f058c070360 2024-09-17T01:13:26.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.619+0000 7f0590fa8640 1 -- 172.21.15.2:0/280299164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f058c0fbd30 con 0x7f058c070360 2024-09-17T01:13:26.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.619+0000 7f0582ffd640 1 -- 172.21.15.2:0/280299164 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v45) v1 ==== 107+0+5251 (secure 0 0 0) 0x7f057407ad10 con 0x7f058c070360 2024-09-17T01:13:26.618 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:26.618 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":38,"btime":"2024-09-17T01:10:49:578460+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44349,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/1774556036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1774556036},{"type":"v1","addr":"172.21.15.99:6825","nonce":1774556036}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44375,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/4220578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4220578351},{"type":"v1","addr":"172.21.15.99:6827","nonce":4220578351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:10:49.578440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi002.fmyyzz","rank":1,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.2:6829/2400957585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2400957585},{"type":"v1","addr":"172.21.15.2:6829","nonce":2400957585}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:26.618 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 38 2024-09-17T01:13:26.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.622+0000 7f0590fa8640 1 -- 172.21.15.2:0/280299164 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f057806e530 msgr2=0x7f05780709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:26.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.622+0000 7f0590fa8640 1 --2- 172.21.15.2:0/280299164 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f057806e530 0x7f05780709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f057c009fd0 tx=0x7f057c00b040 comp rx=0 tx=0).stop 2024-09-17T01:13:26.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.622+0000 7f0590fa8640 1 -- 172.21.15.2:0/280299164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f058c070360 msgr2=0x7f058c1158e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:26.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.622+0000 7f0590fa8640 1 --2- 172.21.15.2:0/280299164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f058c070360 0x7f058c1158e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f05740043d0 tx=0x7f0574009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:26.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.622+0000 7f0590fa8640 1 -- 172.21.15.2:0/280299164 shutdown_connections 2024-09-17T01:13:26.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.622+0000 7f0590fa8640 1 --2- 172.21.15.2:0/280299164 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f057806e530 0x7f05780709e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:26.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.622+0000 7f0590fa8640 1 --2- 172.21.15.2:0/280299164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f058c070360 0x7f058c1158e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:26.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.622+0000 7f0590fa8640 1 --2- 172.21.15.2:0/280299164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f058c06fa50 0x7f058c1153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:26.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.622+0000 7f0590fa8640 1 -- 172.21.15.2:0/280299164 >> 172.21.15.2:0/280299164 conn(0x7f058c0f80f0 msgr2=0x7f058c0f9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:26.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.622+0000 7f0590fa8640 1 -- 172.21.15.2:0/280299164 shutdown_connections 2024-09-17T01:13:26.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:26.622+0000 7f0590fa8640 1 -- 172.21.15.2:0/280299164 wait complete. 2024-09-17T01:13:26.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:26 smithi002 ceph-mon[98018]: pgmap v291: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:26.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:26 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/280299164' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-17T01:13:27.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:26 smithi099 ceph-mon[77412]: pgmap v291: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:27.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:26 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/280299164' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-17T01:13:27.316 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 38 2024-09-17T01:13:27.317 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 39 2024-09-17T01:13:27.584 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:28.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:28 smithi002 ceph-mon[98018]: pgmap v292: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:29.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:28 smithi099 ceph-mon[77412]: pgmap v292: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:29.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.158+0000 7fbc82628640 1 -- 172.21.15.2:0/4101255617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7c102f20 msgr2=0x7fbc7c0fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:29.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.158+0000 7fbc82628640 1 --2- 172.21.15.2:0/4101255617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7c102f20 0x7fbc7c0fc5e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbc700048d0 tx=0x7fbc70009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:29.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.158+0000 7fbc82628640 1 -- 172.21.15.2:0/4101255617 shutdown_connections 2024-09-17T01:13:29.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.158+0000 7fbc82628640 1 --2- 172.21.15.2:0/4101255617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7c102f20 0x7fbc7c0fc5e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:29.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.158+0000 7fbc82628640 1 --2- 172.21.15.2:0/4101255617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc7c102580 0x7fbc7c102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.158+0000 7fbc82628640 1 -- 172.21.15.2:0/4101255617 >> 172.21.15.2:0/4101255617 conn(0x7fbc7c0f81a0 msgr2=0x7fbc7c0fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.158+0000 7fbc82628640 1 -- 172.21.15.2:0/4101255617 shutdown_connections 2024-09-17T01:13:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.158+0000 7fbc82628640 1 -- 172.21.15.2:0/4101255617 wait complete. 2024-09-17T01:13:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.159+0000 7fbc82628640 1 Processor -- start 2024-09-17T01:13:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.159+0000 7fbc82628640 1 -- start start 2024-09-17T01:13:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.159+0000 7fbc82628640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc7c102580 0x7fbc7c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.159+0000 7fbc82628640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7c102f20 0x7fbc7c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.159+0000 7fbc82628640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c070490 con 0x7fbc7c102f20 2024-09-17T01:13:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.159+0000 7fbc82628640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c070600 con 0x7fbc7c102580 2024-09-17T01:13:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.159+0000 7fbc7b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7c102f20 0x7fbc7c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.159+0000 7fbc7b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7c102f20 0x7fbc7c06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50586/0 (socket says 172.21.15.2:50586) 2024-09-17T01:13:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.159+0000 7fbc7b7fe640 1 -- 172.21.15.2:0/1332854685 learned_addr learned my addr 172.21.15.2:0/1332854685 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.159+0000 7fbc7bfff640 1 --2- 172.21.15.2:0/1332854685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc7c102580 0x7fbc7c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.160+0000 7fbc7b7fe640 1 -- 172.21.15.2:0/1332854685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc7c102580 msgr2=0x7fbc7c06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.160+0000 7fbc7b7fe640 1 --2- 172.21.15.2:0/1332854685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc7c102580 0x7fbc7c06fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.160+0000 7fbc7b7fe640 1 -- 172.21.15.2:0/1332854685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc70005040 con 0x7fbc7c102f20 2024-09-17T01:13:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.160+0000 7fbc7b7fe640 1 --2- 172.21.15.2:0/1332854685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7c102f20 0x7fbc7c06ff50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbc70003080 tx=0x7fbc70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.160+0000 7fbc78ff9640 1 -- 172.21.15.2:0/1332854685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc70038070 con 0x7fbc7c102f20 2024-09-17T01:13:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.160+0000 7fbc78ff9640 1 -- 172.21.15.2:0/1332854685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbc70009760 con 0x7fbc7c102f20 2024-09-17T01:13:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.160+0000 7fbc78ff9640 1 -- 172.21.15.2:0/1332854685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc7003d420 con 0x7fbc7c102f20 2024-09-17T01:13:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.160+0000 7fbc82628640 1 -- 172.21.15.2:0/1332854685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c070880 con 0x7fbc7c102f20 2024-09-17T01:13:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.160+0000 7fbc82628640 1 -- 172.21.15.2:0/1332854685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c119820 con 0x7fbc7c102f20 2024-09-17T01:13:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.161+0000 7fbc82628640 1 -- 172.21.15.2:0/1332854685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c0fdd00 con 0x7fbc7c102f20 2024-09-17T01:13:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.162+0000 7fbc78ff9640 1 -- 172.21.15.2:0/1332854685 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fbc70030020 con 0x7fbc7c102f20 2024-09-17T01:13:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.162+0000 7fbc78ff9640 1 --2- 172.21.15.2:0/1332854685 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbc6406e530 0x7fbc640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.162+0000 7fbc78ff9640 1 -- 172.21.15.2:0/1332854685 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fbc700ae530 con 0x7fbc7c102f20 2024-09-17T01:13:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.163+0000 7fbc7bfff640 1 --2- 172.21.15.2:0/1332854685 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbc6406e530 0x7fbc640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.163+0000 7fbc7bfff640 1 --2- 172.21.15.2:0/1332854685 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbc6406e530 0x7fbc640709e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c007fd0 tx=0x7fbc6c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.167+0000 7fbc78ff9640 1 -- 172.21.15.2:0/1332854685 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbc700774f0 con 0x7fbc7c102f20 2024-09-17T01:13:29.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.380+0000 7fbc82628640 1 -- 172.21.15.2:0/1332854685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7fbc7c070880 con 0x7fbc7c102f20 2024-09-17T01:13:29.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.381+0000 7fbc78ff9640 1 -- 172.21.15.2:0/1332854685 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v45) v1 ==== 107+0+5250 (secure 0 0 0) 0x7fbc7c070880 con 0x7fbc7c102f20 2024-09-17T01:13:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:29.379 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":39,"btime":"2024-09-17T01:10:50:581271+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44349,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/1774556036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1774556036},{"type":"v1","addr":"172.21.15.99:6825","nonce":1774556036}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44375,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/4220578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4220578351},{"type":"v1","addr":"172.21.15.99:6827","nonce":4220578351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:10:49.583940+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi002.fmyyzz","rank":1,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.2:6829/2400957585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2400957585},{"type":"v1","addr":"172.21.15.2:6829","nonce":2400957585}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:29.380 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 39 2024-09-17T01:13:29.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.385+0000 7fbc82628640 1 -- 172.21.15.2:0/1332854685 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbc6406e530 msgr2=0x7fbc640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:29.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.385+0000 7fbc82628640 1 --2- 172.21.15.2:0/1332854685 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbc6406e530 0x7fbc640709e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c007fd0 tx=0x7fbc6c009040 comp rx=0 tx=0).stop 2024-09-17T01:13:29.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.385+0000 7fbc82628640 1 -- 172.21.15.2:0/1332854685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7c102f20 msgr2=0x7fbc7c06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:29.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.385+0000 7fbc82628640 1 --2- 172.21.15.2:0/1332854685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7c102f20 0x7fbc7c06ff50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbc70003080 tx=0x7fbc70009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:29.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.385+0000 7fbc82628640 1 -- 172.21.15.2:0/1332854685 shutdown_connections 2024-09-17T01:13:29.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.385+0000 7fbc82628640 1 --2- 172.21.15.2:0/1332854685 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fbc6406e530 0x7fbc640709e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:29.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.385+0000 7fbc82628640 1 --2- 172.21.15.2:0/1332854685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc7c102f20 0x7fbc7c06ff50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:29.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.385+0000 7fbc82628640 1 --2- 172.21.15.2:0/1332854685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc7c102580 0x7fbc7c06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:29.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.385+0000 7fbc82628640 1 -- 172.21.15.2:0/1332854685 >> 172.21.15.2:0/1332854685 conn(0x7fbc7c0f81a0 msgr2=0x7fbc7c0f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:29.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.385+0000 7fbc82628640 1 -- 172.21.15.2:0/1332854685 shutdown_connections 2024-09-17T01:13:29.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:29.385+0000 7fbc82628640 1 -- 172.21.15.2:0/1332854685 wait complete. 2024-09-17T01:13:29.980 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:29 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1332854685' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-17T01:13:30.008 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 40 2024-09-17T01:13:30.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:29 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1332854685' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-17T01:13:30.268 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:31.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:30 smithi099 ceph-mon[77412]: pgmap v293: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:31.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:30 smithi002 ceph-mon[98018]: pgmap v293: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:32.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.026+0000 7fe3de3af640 1 -- 172.21.15.2:0/1608452329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d8102ed0 msgr2=0x7fe3d80fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:32.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.026+0000 7fe3de3af640 1 --2- 172.21.15.2:0/1608452329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d8102ed0 0x7fe3d80fc590 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc0048d0 tx=0x7fe3cc009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:32.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.026+0000 7fe3de3af640 1 -- 172.21.15.2:0/1608452329 shutdown_connections 2024-09-17T01:13:32.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.026+0000 7fe3de3af640 1 --2- 172.21.15.2:0/1608452329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d8102ed0 0x7fe3d80fc590 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:32.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.026+0000 7fe3de3af640 1 --2- 172.21.15.2:0/1608452329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d8102530 0x7fe3d8102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:32.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.026+0000 7fe3de3af640 1 -- 172.21.15.2:0/1608452329 >> 172.21.15.2:0/1608452329 conn(0x7fe3d80f80f0 msgr2=0x7fe3d80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:32.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.026+0000 7fe3de3af640 1 -- 172.21.15.2:0/1608452329 shutdown_connections 2024-09-17T01:13:32.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.026+0000 7fe3de3af640 1 -- 172.21.15.2:0/1608452329 wait complete. 2024-09-17T01:13:32.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.027+0000 7fe3de3af640 1 Processor -- start 2024-09-17T01:13:32.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.027+0000 7fe3de3af640 1 -- start start 2024-09-17T01:13:32.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.027+0000 7fe3de3af640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d8102530 0x7fe3d81131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:32.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.027+0000 7fe3de3af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d8102ed0 0x7fe3d8113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:32.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.027+0000 7fe3de3af640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d8113d10 con 0x7fe3d8102ed0 2024-09-17T01:13:32.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.027+0000 7fe3de3af640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d810d150 con 0x7fe3d8102530 2024-09-17T01:13:32.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.027+0000 7fe3d77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d8102ed0 0x7fe3d8113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:32.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.027+0000 7fe3d77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d8102ed0 0x7fe3d8113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38770/0 (socket says 172.21.15.2:38770) 2024-09-17T01:13:32.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.027+0000 7fe3d77fe640 1 -- 172.21.15.2:0/1001859960 learned_addr learned my addr 172.21.15.2:0/1001859960 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:32.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.027+0000 7fe3d7fff640 1 --2- 172.21.15.2:0/1001859960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d8102530 0x7fe3d81131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:32.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.028+0000 7fe3d77fe640 1 -- 172.21.15.2:0/1001859960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d8102530 msgr2=0x7fe3d81131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:32.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.028+0000 7fe3d77fe640 1 --2- 172.21.15.2:0/1001859960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d8102530 0x7fe3d81131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:32.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.028+0000 7fe3d77fe640 1 -- 172.21.15.2:0/1001859960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc005040 con 0x7fe3d8102ed0 2024-09-17T01:13:32.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.028+0000 7fe3d7fff640 1 --2- 172.21.15.2:0/1001859960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d8102530 0x7fe3d81131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:13:32.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.028+0000 7fe3d77fe640 1 --2- 172.21.15.2:0/1001859960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d8102ed0 0x7fe3d8113710 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc003080 tx=0x7fe3cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:32.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.028+0000 7fe3d4ff9640 1 -- 172.21.15.2:0/1001859960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3cc038070 con 0x7fe3d8102ed0 2024-09-17T01:13:32.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.028+0000 7fe3de3af640 1 -- 172.21.15.2:0/1001859960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d810d3d0 con 0x7fe3d8102ed0 2024-09-17T01:13:32.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.028+0000 7fe3d4ff9640 1 -- 172.21.15.2:0/1001859960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe3cc009760 con 0x7fe3d8102ed0 2024-09-17T01:13:32.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.028+0000 7fe3d4ff9640 1 -- 172.21.15.2:0/1001859960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3cc033420 con 0x7fe3d8102ed0 2024-09-17T01:13:32.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.028+0000 7fe3de3af640 1 -- 172.21.15.2:0/1001859960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d810d8b0 con 0x7fe3d8102ed0 2024-09-17T01:13:32.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.029+0000 7fe3de3af640 1 -- 172.21.15.2:0/1001859960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d80fdcb0 con 0x7fe3d8102ed0 2024-09-17T01:13:32.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.030+0000 7fe3d4ff9640 1 -- 172.21.15.2:0/1001859960 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fe3cc030020 con 0x7fe3d8102ed0 2024-09-17T01:13:32.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.030+0000 7fe3d4ff9640 1 --2- 172.21.15.2:0/1001859960 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe3c006e530 0x7fe3c00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:32.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.030+0000 7fe3d4ff9640 1 -- 172.21.15.2:0/1001859960 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fe3cc0ae060 con 0x7fe3d8102ed0 2024-09-17T01:13:32.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.030+0000 7fe3d7fff640 1 --2- 172.21.15.2:0/1001859960 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe3c006e530 0x7fe3c00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:32.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.031+0000 7fe3d7fff640 1 --2- 172.21.15.2:0/1001859960 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe3c006e530 0x7fe3c00709e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8004c80 tx=0x7fe3c8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:32.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.035+0000 7fe3d4ff9640 1 -- 172.21.15.2:0/1001859960 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe3cc077020 con 0x7fe3d8102ed0 2024-09-17T01:13:32.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.245+0000 7fe3de3af640 1 -- 172.21.15.2:0/1001859960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7fe3d804b720 con 0x7fe3d8102ed0 2024-09-17T01:13:32.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.246+0000 7fe3d4ff9640 1 -- 172.21.15.2:0/1001859960 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v45) v1 ==== 107+0+5252 (secure 0 0 0) 0x7fe3cc07a6e0 con 0x7fe3d8102ed0 2024-09-17T01:13:32.245 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:32.245 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":40,"btime":"2024-09-17T01:10:54:854330+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44349,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/1774556036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1774556036},{"type":"v1","addr":"172.21.15.99:6825","nonce":1774556036}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44375,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/4220578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4220578351},{"type":"v1","addr":"172.21.15.99:6827","nonce":4220578351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":40,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:10:53.873474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi002.fmyyzz","rank":1,"incarnation":38,"state":"up:resolve","state_seq":12,"addr":"172.21.15.2:6829/2400957585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2400957585},{"type":"v1","addr":"172.21.15.2:6829","nonce":2400957585}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:32.245 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 40 2024-09-17T01:13:32.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.248+0000 7fe3de3af640 1 -- 172.21.15.2:0/1001859960 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe3c006e530 msgr2=0x7fe3c00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:32.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.248+0000 7fe3de3af640 1 --2- 172.21.15.2:0/1001859960 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe3c006e530 0x7fe3c00709e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8004c80 tx=0x7fe3c8009040 comp rx=0 tx=0).stop 2024-09-17T01:13:32.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.248+0000 7fe3de3af640 1 -- 172.21.15.2:0/1001859960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d8102ed0 msgr2=0x7fe3d8113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:32.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.248+0000 7fe3de3af640 1 --2- 172.21.15.2:0/1001859960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d8102ed0 0x7fe3d8113710 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc003080 tx=0x7fe3cc009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:32.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.248+0000 7fe3de3af640 1 -- 172.21.15.2:0/1001859960 shutdown_connections 2024-09-17T01:13:32.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.248+0000 7fe3de3af640 1 --2- 172.21.15.2:0/1001859960 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fe3c006e530 0x7fe3c00709e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:32.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.248+0000 7fe3de3af640 1 --2- 172.21.15.2:0/1001859960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3d8102ed0 0x7fe3d8113710 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:32.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.248+0000 7fe3de3af640 1 --2- 172.21.15.2:0/1001859960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d8102530 0x7fe3d81131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:32.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.248+0000 7fe3de3af640 1 -- 172.21.15.2:0/1001859960 >> 172.21.15.2:0/1001859960 conn(0x7fe3d80f80f0 msgr2=0x7fe3d80f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:32.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.248+0000 7fe3de3af640 1 -- 172.21.15.2:0/1001859960 shutdown_connections 2024-09-17T01:13:32.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:32.248+0000 7fe3de3af640 1 -- 172.21.15.2:0/1001859960 wait complete. 2024-09-17T01:13:32.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 41 2024-09-17T01:13:33.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:32 smithi099 ceph-mon[77412]: pgmap v294: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:33.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:32 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1001859960' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-17T01:13:33.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:32 smithi002 ceph-mon[98018]: pgmap v294: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:33.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:32 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1001859960' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-17T01:13:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:34.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.701+0000 7f7c17217640 1 -- 172.21.15.2:0/3653718028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10102530 msgr2=0x7f7c10102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:34.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.701+0000 7f7c17217640 1 --2- 172.21.15.2:0/3653718028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10102530 0x7f7c10102900 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7c04009c50 tx=0x7f7c04004d10 comp rx=0 tx=0).stop 2024-09-17T01:13:34.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.701+0000 7f7c17217640 1 -- 172.21.15.2:0/3653718028 shutdown_connections 2024-09-17T01:13:34.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.701+0000 7f7c17217640 1 --2- 172.21.15.2:0/3653718028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c10102ed0 0x7f7c100fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:34.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.701+0000 7f7c17217640 1 --2- 172.21.15.2:0/3653718028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10102530 0x7f7c10102900 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:34.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.702+0000 7f7c17217640 1 -- 172.21.15.2:0/3653718028 >> 172.21.15.2:0/3653718028 conn(0x7f7c100f80f0 msgr2=0x7f7c100fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:34.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.702+0000 7f7c17217640 1 -- 172.21.15.2:0/3653718028 shutdown_connections 2024-09-17T01:13:34.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.702+0000 7f7c17217640 1 -- 172.21.15.2:0/3653718028 wait complete. 2024-09-17T01:13:34.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.702+0000 7f7c17217640 1 Processor -- start 2024-09-17T01:13:34.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.702+0000 7f7c17217640 1 -- start start 2024-09-17T01:13:34.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.703+0000 7f7c17217640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c10102530 0x7f7c1006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:34.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.703+0000 7f7c17217640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10102ed0 0x7f7c1006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:34.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.703+0000 7f7c17217640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10070490 con 0x7f7c10102ed0 2024-09-17T01:13:34.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.703+0000 7f7c17217640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10070600 con 0x7f7c10102530 2024-09-17T01:13:34.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.703+0000 7f7c0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10102ed0 0x7f7c1006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:34.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.703+0000 7f7c0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10102ed0 0x7f7c1006ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38786/0 (socket says 172.21.15.2:38786) 2024-09-17T01:13:34.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.703+0000 7f7c0ffff640 1 -- 172.21.15.2:0/3103291878 learned_addr learned my addr 172.21.15.2:0/3103291878 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:34.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.703+0000 7f7c14fb3640 1 --2- 172.21.15.2:0/3103291878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c10102530 0x7f7c1006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:34.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.703+0000 7f7c0ffff640 1 -- 172.21.15.2:0/3103291878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c10102530 msgr2=0x7f7c1006fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:34.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.703+0000 7f7c0ffff640 1 --2- 172.21.15.2:0/3103291878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c10102530 0x7f7c1006fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:34.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.703+0000 7f7c0ffff640 1 -- 172.21.15.2:0/3103291878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040098b0 con 0x7f7c10102ed0 2024-09-17T01:13:34.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.703+0000 7f7c0ffff640 1 --2- 172.21.15.2:0/3103291878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10102ed0 0x7f7c1006ff50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00eb40 tx=0x7f7bfc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:34.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.704+0000 7f7c0d7fa640 1 -- 172.21.15.2:0/3103291878 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bfc007c30 con 0x7f7c10102ed0 2024-09-17T01:13:34.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.704+0000 7f7c0d7fa640 1 -- 172.21.15.2:0/3103291878 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7bfc00f040 con 0x7f7c10102ed0 2024-09-17T01:13:34.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.704+0000 7f7c17217640 1 -- 172.21.15.2:0/3103291878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c10070830 con 0x7f7c10102ed0 2024-09-17T01:13:34.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.704+0000 7f7c0d7fa640 1 -- 172.21.15.2:0/3103291878 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bfc009600 con 0x7f7c10102ed0 2024-09-17T01:13:34.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.704+0000 7f7c17217640 1 -- 172.21.15.2:0/3103291878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c10119910 con 0x7f7c10102ed0 2024-09-17T01:13:34.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.705+0000 7f7c17217640 1 -- 172.21.15.2:0/3103291878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c100fdcb0 con 0x7f7c10102ed0 2024-09-17T01:13:34.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.705+0000 7f7c0d7fa640 1 -- 172.21.15.2:0/3103291878 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7f7bfc009760 con 0x7f7c10102ed0 2024-09-17T01:13:34.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.706+0000 7f7c0d7fa640 1 --2- 172.21.15.2:0/3103291878 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7c0006e530 0x7f7c000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:34.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.706+0000 7f7c0d7fa640 1 -- 172.21.15.2:0/3103291878 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7f7bfc08de70 con 0x7f7c10102ed0 2024-09-17T01:13:34.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.706+0000 7f7c14fb3640 1 --2- 172.21.15.2:0/3103291878 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7c0006e530 0x7f7c000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:34.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.706+0000 7f7c14fb3640 1 --2- 172.21.15.2:0/3103291878 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7c0006e530 0x7f7c000709e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7c04000f80 tx=0x7f7c04004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:34.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.710+0000 7f7c0d7fa640 1 -- 172.21.15.2:0/3103291878 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7bfc056f60 con 0x7f7c10102ed0 2024-09-17T01:13:34.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:34 smithi002 ceph-mon[98018]: pgmap v295: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.921+0000 7f7c17217640 1 -- 172.21.15.2:0/3103291878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f7c100fbd30 con 0x7f7c10102ed0 2024-09-17T01:13:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.921+0000 7f7c0d7fa640 1 -- 172.21.15.2:0/3103291878 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v45) v1 ==== 107+0+5254 (secure 0 0 0) 0x7f7bfc05a620 con 0x7f7c10102ed0 2024-09-17T01:13:34.919 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:34.919 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"btime":"2024-09-17T01:10:57:861984+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44349,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/1774556036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1774556036},{"type":"v1","addr":"172.21.15.99:6825","nonce":1774556036}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44375,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/4220578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4220578351},{"type":"v1","addr":"172.21.15.99:6827","nonce":4220578351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:10:56.891705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":0,"incarnation":38,"state":"up:resolve","state_seq":17,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi002.fmyyzz","rank":1,"incarnation":38,"state":"up:resolve","state_seq":12,"addr":"172.21.15.2:6829/2400957585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2400957585},{"type":"v1","addr":"172.21.15.2:6829","nonce":2400957585}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 41 2024-09-17T01:13:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.924+0000 7f7c17217640 1 -- 172.21.15.2:0/3103291878 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7c0006e530 msgr2=0x7f7c000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.924+0000 7f7c17217640 1 --2- 172.21.15.2:0/3103291878 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7c0006e530 0x7f7c000709e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7c04000f80 tx=0x7f7c04004d10 comp rx=0 tx=0).stop 2024-09-17T01:13:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.924+0000 7f7c17217640 1 -- 172.21.15.2:0/3103291878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10102ed0 msgr2=0x7f7c1006ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.924+0000 7f7c17217640 1 --2- 172.21.15.2:0/3103291878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10102ed0 0x7f7c1006ff50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00eb40 tx=0x7f7bfc00b040 comp rx=0 tx=0).stop 2024-09-17T01:13:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.924+0000 7f7c17217640 1 -- 172.21.15.2:0/3103291878 shutdown_connections 2024-09-17T01:13:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.924+0000 7f7c17217640 1 --2- 172.21.15.2:0/3103291878 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7f7c0006e530 0x7f7c000709e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.924+0000 7f7c17217640 1 --2- 172.21.15.2:0/3103291878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c10102ed0 0x7f7c1006ff50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.924+0000 7f7c17217640 1 --2- 172.21.15.2:0/3103291878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c10102530 0x7f7c1006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.924+0000 7f7c17217640 1 -- 172.21.15.2:0/3103291878 >> 172.21.15.2:0/3103291878 conn(0x7f7c100f80f0 msgr2=0x7f7c100f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.924+0000 7f7c17217640 1 -- 172.21.15.2:0/3103291878 shutdown_connections 2024-09-17T01:13:34.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:34.924+0000 7f7c17217640 1 -- 172.21.15.2:0/3103291878 wait complete. 2024-09-17T01:13:35.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:34 smithi099 ceph-mon[77412]: pgmap v295: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:35.571 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 42 2024-09-17T01:13:35.831 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:35.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:35 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3103291878' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-17T01:13:36.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:35 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3103291878' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-17T01:13:36.886 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:36 smithi002 ceph-mon[98018]: pgmap v296: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:37.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:36 smithi099 ceph-mon[77412]: pgmap v296: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:37.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.388+0000 7fc42bd30640 1 -- 172.21.15.2:0/1354990936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4240fd3a0 msgr2=0x7fc4240fd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.388+0000 7fc42bd30640 1 --2- 172.21.15.2:0/1354990936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4240fd3a0 0x7fc4240fd770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc4200048d0 tx=0x7fc420009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.388+0000 7fc42bd30640 1 -- 172.21.15.2:0/1354990936 shutdown_connections 2024-09-17T01:13:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.388+0000 7fc42bd30640 1 --2- 172.21.15.2:0/1354990936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4240fac80 0x7fc4240fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.388+0000 7fc42bd30640 1 --2- 172.21.15.2:0/1354990936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4240fd3a0 0x7fc4240fd770 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.388+0000 7fc42bd30640 1 -- 172.21.15.2:0/1354990936 >> 172.21.15.2:0/1354990936 conn(0x7fc424070ce0 msgr2=0x7fc4240710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.389+0000 7fc42bd30640 1 -- 172.21.15.2:0/1354990936 shutdown_connections 2024-09-17T01:13:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.389+0000 7fc42bd30640 1 -- 172.21.15.2:0/1354990936 wait complete. 2024-09-17T01:13:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.389+0000 7fc42bd30640 1 Processor -- start 2024-09-17T01:13:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.389+0000 7fc42bd30640 1 -- start start 2024-09-17T01:13:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.389+0000 7fc42bd30640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4240fac80 0x7fc424115420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:37.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc42bd30640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4240fd3a0 0x7fc424115960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc42bd30640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc424115f60 con 0x7fc4240fac80 2024-09-17T01:13:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc42bd30640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4241160d0 con 0x7fc4240fd3a0 2024-09-17T01:13:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc429acc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4240fac80 0x7fc424115420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc429acc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4240fac80 0x7fc424115420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38812/0 (socket says 172.21.15.2:38812) 2024-09-17T01:13:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc429acc640 1 -- 172.21.15.2:0/3174823496 learned_addr learned my addr 172.21.15.2:0/3174823496 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc4292cb640 1 --2- 172.21.15.2:0/3174823496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4240fd3a0 0x7fc424115960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc429acc640 1 -- 172.21.15.2:0/3174823496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4240fd3a0 msgr2=0x7fc424115960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc429acc640 1 --2- 172.21.15.2:0/3174823496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4240fd3a0 0x7fc424115960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc429acc640 1 -- 172.21.15.2:0/3174823496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc420005040 con 0x7fc4240fac80 2024-09-17T01:13:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc4292cb640 1 --2- 172.21.15.2:0/3174823496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4240fd3a0 0x7fc424115960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:13:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc429acc640 1 --2- 172.21.15.2:0/3174823496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4240fac80 0x7fc424115420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc4200043d0 tx=0x7fc420009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc41a7fc640 1 -- 172.21.15.2:0/3174823496 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc420038070 con 0x7fc4240fac80 2024-09-17T01:13:37.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc41a7fc640 1 -- 172.21.15.2:0/3174823496 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc4200096e0 con 0x7fc4240fac80 2024-09-17T01:13:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc42bd30640 1 -- 172.21.15.2:0/3174823496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42410f4f0 con 0x7fc4240fac80 2024-09-17T01:13:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc41a7fc640 1 -- 172.21.15.2:0/3174823496 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc42003d420 con 0x7fc4240fac80 2024-09-17T01:13:37.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.390+0000 7fc42bd30640 1 -- 172.21.15.2:0/3174823496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42410fa10 con 0x7fc4240fac80 2024-09-17T01:13:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.392+0000 7fc42bd30640 1 -- 172.21.15.2:0/3174823496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4240fbc90 con 0x7fc4240fac80 2024-09-17T01:13:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.392+0000 7fc41a7fc640 1 -- 172.21.15.2:0/3174823496 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fc420030020 con 0x7fc4240fac80 2024-09-17T01:13:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.392+0000 7fc41a7fc640 1 --2- 172.21.15.2:0/3174823496 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc41006e530 0x7fc4100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.393+0000 7fc41a7fc640 1 -- 172.21.15.2:0/3174823496 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fc4200ae860 con 0x7fc4240fac80 2024-09-17T01:13:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.393+0000 7fc4292cb640 1 --2- 172.21.15.2:0/3174823496 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc41006e530 0x7fc4100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:37.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.393+0000 7fc4292cb640 1 --2- 172.21.15.2:0/3174823496 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc41006e530 0x7fc4100709e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc424110d20 tx=0x7fc41400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:37.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.397+0000 7fc41a7fc640 1 -- 172.21.15.2:0/3174823496 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc420077820 con 0x7fc4240fac80 2024-09-17T01:13:37.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.608+0000 7fc42bd30640 1 -- 172.21.15.2:0/3174823496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7fc42404b750 con 0x7fc4240fac80 2024-09-17T01:13:37.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.609+0000 7fc41a7fc640 1 -- 172.21.15.2:0/3174823496 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v45) v1 ==== 107+0+5258 (secure 0 0 0) 0x7fc42007aee0 con 0x7fc4240fac80 2024-09-17T01:13:37.607 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:37.607 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":42,"btime":"2024-09-17T01:10:58:867045+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44349,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/1774556036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1774556036},{"type":"v1","addr":"172.21.15.99:6825","nonce":1774556036}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44375,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/4220578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4220578351},{"type":"v1","addr":"172.21.15.99:6827","nonce":4220578351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:10:57.910692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":0,"incarnation":38,"state":"up:reconnect","state_seq":18,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi002.fmyyzz","rank":1,"incarnation":38,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.2:6829/2400957585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2400957585},{"type":"v1","addr":"172.21.15.2:6829","nonce":2400957585}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:37.607 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 42 2024-09-17T01:13:37.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.611+0000 7fc42bd30640 1 -- 172.21.15.2:0/3174823496 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc41006e530 msgr2=0x7fc4100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:37.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.611+0000 7fc42bd30640 1 --2- 172.21.15.2:0/3174823496 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc41006e530 0x7fc4100709e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc424110d20 tx=0x7fc41400b040 comp rx=0 tx=0).stop 2024-09-17T01:13:37.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.611+0000 7fc42bd30640 1 -- 172.21.15.2:0/3174823496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4240fac80 msgr2=0x7fc424115420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:37.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.611+0000 7fc42bd30640 1 --2- 172.21.15.2:0/3174823496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4240fac80 0x7fc424115420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc4200043d0 tx=0x7fc420009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:37.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.612+0000 7fc42bd30640 1 -- 172.21.15.2:0/3174823496 shutdown_connections 2024-09-17T01:13:37.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.612+0000 7fc42bd30640 1 --2- 172.21.15.2:0/3174823496 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fc41006e530 0x7fc4100709e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:37.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.612+0000 7fc42bd30640 1 --2- 172.21.15.2:0/3174823496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4240fd3a0 0x7fc424115960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:37.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.612+0000 7fc42bd30640 1 --2- 172.21.15.2:0/3174823496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4240fac80 0x7fc424115420 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:37.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.612+0000 7fc42bd30640 1 -- 172.21.15.2:0/3174823496 >> 172.21.15.2:0/3174823496 conn(0x7fc424070ce0 msgr2=0x7fc4240f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:37.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.612+0000 7fc42bd30640 1 -- 172.21.15.2:0/3174823496 shutdown_connections 2024-09-17T01:13:37.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:37.612+0000 7fc42bd30640 1 -- 172.21.15.2:0/3174823496 wait complete. 2024-09-17T01:13:37.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:37 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3174823496' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-09-17T01:13:38.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:37 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3174823496' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-09-17T01:13:38.296 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 43 2024-09-17T01:13:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:38.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:38 smithi002 ceph-mon[98018]: pgmap v297: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:39.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:38 smithi099 ceph-mon[77412]: pgmap v297: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:40.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.197+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/411072569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa780fe460 msgr2=0x7ffa780fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:40.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.197+0000 7ffa7e4a7640 1 --2- 172.21.15.2:0/411072569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa780fe460 0x7ffa780fe830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffa680048d0 tx=0x7ffa68009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:40.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.197+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/411072569 shutdown_connections 2024-09-17T01:13:40.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.197+0000 7ffa7e4a7640 1 --2- 172.21.15.2:0/411072569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa78064fc0 0x7ffa78065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:40.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.197+0000 7ffa7e4a7640 1 --2- 172.21.15.2:0/411072569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa780fe460 0x7ffa780fe830 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:40.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.197+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/411072569 >> 172.21.15.2:0/411072569 conn(0x7ffa780723b0 msgr2=0x7ffa780727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:40.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.197+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/411072569 shutdown_connections 2024-09-17T01:13:40.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.197+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/411072569 wait complete. 2024-09-17T01:13:40.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.198+0000 7ffa7e4a7640 1 Processor -- start 2024-09-17T01:13:40.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.198+0000 7ffa7e4a7640 1 -- start start 2024-09-17T01:13:40.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.198+0000 7ffa7e4a7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa78064fc0 0x7ffa781131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:40.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.198+0000 7ffa7e4a7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa780fe460 0x7ffa781136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:40.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.198+0000 7ffa7e4a7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78113cf0 con 0x7ffa780fe460 2024-09-17T01:13:40.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.198+0000 7ffa7e4a7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7810d130 con 0x7ffa78064fc0 2024-09-17T01:13:40.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.198+0000 7ffa777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa780fe460 0x7ffa781136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:40.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.198+0000 7ffa777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa780fe460 0x7ffa781136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38822/0 (socket says 172.21.15.2:38822) 2024-09-17T01:13:40.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.198+0000 7ffa777fe640 1 -- 172.21.15.2:0/1359628777 learned_addr learned my addr 172.21.15.2:0/1359628777 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:40.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.198+0000 7ffa77fff640 1 --2- 172.21.15.2:0/1359628777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa78064fc0 0x7ffa781131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:40.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.198+0000 7ffa777fe640 1 -- 172.21.15.2:0/1359628777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa78064fc0 msgr2=0x7ffa781131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:40.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.198+0000 7ffa777fe640 1 --2- 172.21.15.2:0/1359628777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa78064fc0 0x7ffa781131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:40.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.198+0000 7ffa777fe640 1 -- 172.21.15.2:0/1359628777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa68005040 con 0x7ffa780fe460 2024-09-17T01:13:40.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.199+0000 7ffa777fe640 1 --2- 172.21.15.2:0/1359628777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa780fe460 0x7ffa781136f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00c790 tx=0x7ffa6c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:40.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.199+0000 7ffa74ff9640 1 -- 172.21.15.2:0/1359628777 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa6c00a7a0 con 0x7ffa780fe460 2024-09-17T01:13:40.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.199+0000 7ffa74ff9640 1 -- 172.21.15.2:0/1359628777 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffa6c00ada0 con 0x7ffa780fe460 2024-09-17T01:13:40.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.199+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/1359628777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7810d410 con 0x7ffa780fe460 2024-09-17T01:13:40.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.199+0000 7ffa74ff9640 1 -- 172.21.15.2:0/1359628777 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa6c0113a0 con 0x7ffa780fe460 2024-09-17T01:13:40.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.199+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/1359628777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7810d9b0 con 0x7ffa780fe460 2024-09-17T01:13:40.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.200+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/1359628777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa780fdcf0 con 0x7ffa780fe460 2024-09-17T01:13:40.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.201+0000 7ffa74ff9640 1 -- 172.21.15.2:0/1359628777 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7ffa6c00a900 con 0x7ffa780fe460 2024-09-17T01:13:40.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.201+0000 7ffa74ff9640 1 --2- 172.21.15.2:0/1359628777 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ffa6006e530 0x7ffa600709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:40.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.201+0000 7ffa74ff9640 1 -- 172.21.15.2:0/1359628777 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7ffa6c08e3b0 con 0x7ffa780fe460 2024-09-17T01:13:40.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.201+0000 7ffa77fff640 1 --2- 172.21.15.2:0/1359628777 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ffa6006e530 0x7ffa600709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:40.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.202+0000 7ffa77fff640 1 --2- 172.21.15.2:0/1359628777 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ffa6006e530 0x7ffa600709e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009ac0 tx=0x7ffa68035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:40.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.205+0000 7ffa74ff9640 1 -- 172.21.15.2:0/1359628777 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ffa6c0573f0 con 0x7ffa780fe460 2024-09-17T01:13:40.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.419+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/1359628777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 43, "format": "json"} v 0) v1 -- 0x7ffa7810e820 con 0x7ffa780fe460 2024-09-17T01:13:40.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.419+0000 7ffa74ff9640 1 -- 172.21.15.2:0/1359628777 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 43, "format": "json"}]=0 dumped fsmap epoch 43 v45) v1 ==== 107+0+5252 (secure 0 0 0) 0x7ffa6c05aab0 con 0x7ffa780fe460 2024-09-17T01:13:40.417 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":43,"btime":"2024-09-17T01:10:59:868842+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44349,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/1774556036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1774556036},{"type":"v1","addr":"172.21.15.99:6825","nonce":1774556036}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44375,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/4220578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4220578351},{"type":"v1","addr":"172.21.15.99:6827","nonce":4220578351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":43,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:10:58.872680+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":0,"incarnation":38,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi002.fmyyzz","rank":1,"incarnation":38,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.2:6829/2400957585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2400957585},{"type":"v1","addr":"172.21.15.2:6829","nonce":2400957585}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:13:40.417 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 43 2024-09-17T01:13:40.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.421+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/1359628777 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ffa6006e530 msgr2=0x7ffa600709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:40.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.421+0000 7ffa7e4a7640 1 --2- 172.21.15.2:0/1359628777 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ffa6006e530 0x7ffa600709e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009ac0 tx=0x7ffa68035040 comp rx=0 tx=0).stop 2024-09-17T01:13:40.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.421+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/1359628777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa780fe460 msgr2=0x7ffa781136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:40.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.421+0000 7ffa7e4a7640 1 --2- 172.21.15.2:0/1359628777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa780fe460 0x7ffa781136f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00c790 tx=0x7ffa6c0043c0 comp rx=0 tx=0).stop 2024-09-17T01:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.422+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/1359628777 shutdown_connections 2024-09-17T01:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.422+0000 7ffa7e4a7640 1 --2- 172.21.15.2:0/1359628777 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7ffa6006e530 0x7ffa600709e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.422+0000 7ffa7e4a7640 1 --2- 172.21.15.2:0/1359628777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa780fe460 0x7ffa781136f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.422+0000 7ffa7e4a7640 1 --2- 172.21.15.2:0/1359628777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa78064fc0 0x7ffa781131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.422+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/1359628777 >> 172.21.15.2:0/1359628777 conn(0x7ffa780723b0 msgr2=0x7ffa78105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.422+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/1359628777 shutdown_connections 2024-09-17T01:13:40.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:40.422+0000 7ffa7e4a7640 1 -- 172.21.15.2:0/1359628777 wait complete. 2024-09-17T01:13:41.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:40 smithi099 ceph-mon[77412]: pgmap v298: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:41.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:40 smithi099 ceph-mon[77412]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:41.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:40 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/1359628777' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-09-17T01:13:41.077 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:40 smithi002 ceph-mon[98018]: pgmap v298: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:41.077 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:40 smithi002 ceph-mon[98018]: from='mgr.34104 172.21.15.2:0/2468687018' entity='mgr.smithi002.vjeexr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:13:41.077 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:40 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/1359628777' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-09-17T01:13:41.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 44 2024-09-17T01:13:41.369 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:42.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:42 smithi002 ceph-mon[98018]: pgmap v299: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.972+0000 7fae31161640 1 -- 172.21.15.2:0/3186121375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae2c0fdef0 msgr2=0x7fae2c1065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.972+0000 7fae31161640 1 --2- 172.21.15.2:0/3186121375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae2c0fdef0 0x7fae2c1065c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fae20004900 tx=0x7fae20009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.972+0000 7fae31161640 1 -- 172.21.15.2:0/3186121375 shutdown_connections 2024-09-17T01:13:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.973+0000 7fae31161640 1 --2- 172.21.15.2:0/3186121375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae2c0fdef0 0x7fae2c1065c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.973+0000 7fae31161640 1 --2- 172.21.15.2:0/3186121375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae2c0fd550 0x7fae2c0fd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.973+0000 7fae31161640 1 -- 172.21.15.2:0/3186121375 >> 172.21.15.2:0/3186121375 conn(0x7fae2c0f7030 msgr2=0x7fae2c0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.973+0000 7fae31161640 1 -- 172.21.15.2:0/3186121375 shutdown_connections 2024-09-17T01:13:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.973+0000 7fae31161640 1 -- 172.21.15.2:0/3186121375 wait complete. 2024-09-17T01:13:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.973+0000 7fae31161640 1 Processor -- start 2024-09-17T01:13:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.974+0000 7fae31161640 1 -- start start 2024-09-17T01:13:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.974+0000 7fae31161640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae2c0fd550 0x7fae2c113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.974+0000 7fae31161640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae2c0fdef0 0x7fae2c1137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.974+0000 7fae31161640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c113da0 con 0x7fae2c0fd550 2024-09-17T01:13:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.974+0000 7fae31161640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c10d1e0 con 0x7fae2c0fdef0 2024-09-17T01:13:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.974+0000 7fae2ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae2c0fd550 0x7fae2c113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.974+0000 7fae2ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae2c0fd550 0x7fae2c113260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43178/0 (socket says 172.21.15.2:43178) 2024-09-17T01:13:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.974+0000 7fae2ad9d640 1 -- 172.21.15.2:0/2334177289 learned_addr learned my addr 172.21.15.2:0/2334177289 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.974+0000 7fae2ad9d640 1 -- 172.21.15.2:0/2334177289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae2c0fdef0 msgr2=0x7fae2c1137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.974+0000 7fae2ad9d640 1 --2- 172.21.15.2:0/2334177289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae2c0fdef0 0x7fae2c1137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.974+0000 7fae2ad9d640 1 -- 172.21.15.2:0/2334177289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae20005040 con 0x7fae2c0fd550 2024-09-17T01:13:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.974+0000 7fae2ad9d640 1 --2- 172.21.15.2:0/2334177289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae2c0fd550 0x7fae2c113260 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fae1c002a50 tx=0x7fae1c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.975+0000 7fae137fe640 1 -- 172.21.15.2:0/2334177289 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae1c007c30 con 0x7fae2c0fd550 2024-09-17T01:13:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.975+0000 7fae137fe640 1 -- 172.21.15.2:0/2334177289 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fae1c00f040 con 0x7fae2c0fd550 2024-09-17T01:13:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.975+0000 7fae137fe640 1 -- 172.21.15.2:0/2334177289 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae1c00da90 con 0x7fae2c0fd550 2024-09-17T01:13:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.975+0000 7fae31161640 1 -- 172.21.15.2:0/2334177289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c10d4c0 con 0x7fae2c0fd550 2024-09-17T01:13:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.975+0000 7fae31161640 1 -- 172.21.15.2:0/2334177289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c10d9e0 con 0x7fae2c0fd550 2024-09-17T01:13:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.976+0000 7fae31161640 1 -- 172.21.15.2:0/2334177289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c066070 con 0x7fae2c0fd550 2024-09-17T01:13:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.976+0000 7fae137fe640 1 -- 172.21.15.2:0/2334177289 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fae1c00dd00 con 0x7fae2c0fd550 2024-09-17T01:13:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.977+0000 7fae137fe640 1 --2- 172.21.15.2:0/2334177289 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fae1406e530 0x7fae140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.977+0000 7fae137fe640 1 -- 172.21.15.2:0/2334177289 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fae1c08dba0 con 0x7fae2c0fd550 2024-09-17T01:13:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.977+0000 7fae2a59c640 1 --2- 172.21.15.2:0/2334177289 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fae1406e530 0x7fae140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.977+0000 7fae2a59c640 1 --2- 172.21.15.2:0/2334177289 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fae1406e530 0x7fae140709e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae20003080 tx=0x7fae20009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:42.981+0000 7fae137fe640 1 -- 172.21.15.2:0/2334177289 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fae1c056b60 con 0x7fae2c0fd550 2024-09-17T01:13:43.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:42 smithi099 ceph-mon[77412]: pgmap v299: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:43.193+0000 7fae31161640 1 -- 172.21.15.2:0/2334177289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 44, "format": "json"} v 0) v1 -- 0x7fae2c109600 con 0x7fae2c0fd550 2024-09-17T01:13:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:43.194+0000 7fae137fe640 1 -- 172.21.15.2:0/2334177289 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 44, "format": "json"}]=0 dumped fsmap epoch 44 v45) v1 ==== 107+0+5267 (secure 0 0 0) 0x7fae1c05a220 con 0x7fae2c0fd550 2024-09-17T01:13:43.191 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-17T01:13:43.191 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":44,"btime":"2024-09-17T01:11:00:887144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44349,"name":"cephfs.smithi099.hgawhu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6825/1774556036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1774556036},{"type":"v1","addr":"172.21.15.99:6825","nonce":1774556036}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44375,"name":"cephfs.smithi099.heckcd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/4220578351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4220578351},{"type":"v1","addr":"172.21.15.99:6827","nonce":4220578351}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":44,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T00:59:20.485696+0000","modified":"2024-09-17T01:11:00.887141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi002.zmrgxd","rank":0,"incarnation":38,"state":"up:active","state_seq":20,"addr":"172.21.15.2:6827/2424122669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":2424122669},{"type":"v1","addr":"172.21.15.2:6827","nonce":2424122669}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi002.fmyyzz","rank":1,"incarnation":38,"state":"up:active","state_seq":16,"addr":"172.21.15.2:6829/2400957585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2400957585},{"type":"v1","addr":"172.21.15.2:6829","nonce":2400957585}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34388,"qdb_cluster":[34388,34420]},"id":1}]} 2024-09-17T01:13:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 44 2024-09-17T01:13:43.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:43.196+0000 7fae31161640 1 -- 172.21.15.2:0/2334177289 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fae1406e530 msgr2=0x7fae140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:43.196+0000 7fae31161640 1 --2- 172.21.15.2:0/2334177289 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fae1406e530 0x7fae140709e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae20003080 tx=0x7fae20009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:43.196+0000 7fae31161640 1 -- 172.21.15.2:0/2334177289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae2c0fd550 msgr2=0x7fae2c113260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:43.196+0000 7fae31161640 1 --2- 172.21.15.2:0/2334177289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae2c0fd550 0x7fae2c113260 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fae1c002a50 tx=0x7fae1c004600 comp rx=0 tx=0).stop 2024-09-17T01:13:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:43.196+0000 7fae31161640 1 -- 172.21.15.2:0/2334177289 shutdown_connections 2024-09-17T01:13:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:43.196+0000 7fae31161640 1 --2- 172.21.15.2:0/2334177289 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fae1406e530 0x7fae140709e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:43.196+0000 7fae31161640 1 --2- 172.21.15.2:0/2334177289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae2c0fdef0 0x7fae2c1137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:43.196+0000 7fae31161640 1 --2- 172.21.15.2:0/2334177289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae2c0fd550 0x7fae2c113260 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:43.196+0000 7fae31161640 1 -- 172.21.15.2:0/2334177289 >> 172.21.15.2:0/2334177289 conn(0x7fae2c0f7030 msgr2=0x7fae2c0f85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:43.196+0000 7fae31161640 1 -- 172.21.15.2:0/2334177289 shutdown_connections 2024-09-17T01:13:43.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:43.196+0000 7fae31161640 1 -- 172.21.15.2:0/2334177289 wait complete. 2024-09-17T01:13:43.826 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:43 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/2334177289' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 44, "format": "json"}]: dispatch 2024-09-17T01:13:43.852 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-17T01:13:43.866 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T01:13:43.866 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T01:13:43.866 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:13:43.885 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-17T01:13:43.885 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:13:43.943 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-17T01:13:44.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:43 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/2334177289' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 44, "format": "json"}]: dispatch 2024-09-17T01:13:44.243 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:44.905 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:44 smithi002 ceph-mon[98018]: pgmap v300: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:45.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:44 smithi099 ceph-mon[77412]: pgmap v300: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:13:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.780+0000 7fcee66f6640 1 -- 172.21.15.2:0/2360232294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee0102ed0 msgr2=0x7fcee00fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.780+0000 7fcee66f6640 1 --2- 172.21.15.2:0/2360232294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee0102ed0 0x7fcee00fc590 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcec80048d0 tx=0x7fcec8009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.780+0000 7fcee66f6640 1 -- 172.21.15.2:0/2360232294 shutdown_connections 2024-09-17T01:13:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.780+0000 7fcee66f6640 1 --2- 172.21.15.2:0/2360232294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee0102ed0 0x7fcee00fc590 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.780+0000 7fcee66f6640 1 --2- 172.21.15.2:0/2360232294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcee0102530 0x7fcee0102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.780+0000 7fcee66f6640 1 -- 172.21.15.2:0/2360232294 >> 172.21.15.2:0/2360232294 conn(0x7fcee00f80f0 msgr2=0x7fcee00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.780+0000 7fcee66f6640 1 -- 172.21.15.2:0/2360232294 shutdown_connections 2024-09-17T01:13:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.780+0000 7fcee66f6640 1 -- 172.21.15.2:0/2360232294 wait complete. 2024-09-17T01:13:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.781+0000 7fcee66f6640 1 Processor -- start 2024-09-17T01:13:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.781+0000 7fcee66f6640 1 -- start start 2024-09-17T01:13:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.781+0000 7fcee66f6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcee0102530 0x7fcee01131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.781+0000 7fcee66f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee0102ed0 0x7fcee0113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.781+0000 7fcee66f6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee0113d10 con 0x7fcee0102ed0 2024-09-17T01:13:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.781+0000 7fcee66f6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee010d150 con 0x7fcee0102530 2024-09-17T01:13:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.781+0000 7fced7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee0102ed0 0x7fcee0113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.781+0000 7fced7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee0102ed0 0x7fcee0113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43208/0 (socket says 172.21.15.2:43208) 2024-09-17T01:13:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.781+0000 7fced7fff640 1 -- 172.21.15.2:0/3594361791 learned_addr learned my addr 172.21.15.2:0/3594361791 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.781+0000 7fcedffff640 1 --2- 172.21.15.2:0/3594361791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcee0102530 0x7fcee01131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.781+0000 7fced7fff640 1 -- 172.21.15.2:0/3594361791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcee0102530 msgr2=0x7fcee01131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.781+0000 7fced7fff640 1 --2- 172.21.15.2:0/3594361791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcee0102530 0x7fcee01131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.781+0000 7fced7fff640 1 -- 172.21.15.2:0/3594361791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec8005040 con 0x7fcee0102ed0 2024-09-17T01:13:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.782+0000 7fced7fff640 1 --2- 172.21.15.2:0/3594361791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee0102ed0 0x7fcee0113710 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcec80043d0 tx=0x7fcec8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.782+0000 7fcedd7fa640 1 -- 172.21.15.2:0/3594361791 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcec8038070 con 0x7fcee0102ed0 2024-09-17T01:13:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.782+0000 7fcee66f6640 1 -- 172.21.15.2:0/3594361791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee010d3d0 con 0x7fcee0102ed0 2024-09-17T01:13:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.782+0000 7fcedd7fa640 1 -- 172.21.15.2:0/3594361791 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcec80096e0 con 0x7fcee0102ed0 2024-09-17T01:13:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.782+0000 7fcedd7fa640 1 -- 172.21.15.2:0/3594361791 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcec802c8a0 con 0x7fcee0102ed0 2024-09-17T01:13:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.782+0000 7fcee66f6640 1 -- 172.21.15.2:0/3594361791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee010d910 con 0x7fcee0102ed0 2024-09-17T01:13:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.783+0000 7fcee66f6640 1 -- 172.21.15.2:0/3594361791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee00fdcb0 con 0x7fcee0102ed0 2024-09-17T01:13:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.783+0000 7fcedd7fa640 1 -- 172.21.15.2:0/3594361791 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fcec8030020 con 0x7fcee0102ed0 2024-09-17T01:13:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.784+0000 7fcedd7fa640 1 --2- 172.21.15.2:0/3594361791 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcecc06e530 0x7fcecc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.784+0000 7fcedd7fa640 1 -- 172.21.15.2:0/3594361791 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fcec80adfb0 con 0x7fcee0102ed0 2024-09-17T01:13:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.784+0000 7fcedffff640 1 --2- 172.21.15.2:0/3594361791 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcecc06e530 0x7fcecc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.785+0000 7fcedffff640 1 --2- 172.21.15.2:0/3594361791 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcecc06e530 0x7fcecc0709e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fced0004eb0 tx=0x7fced000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:45.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.788+0000 7fcedd7fa640 1 -- 172.21.15.2:0/3594361791 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcec8077020 con 0x7fcee0102ed0 2024-09-17T01:13:45.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.978+0000 7fcee66f6640 1 -- 172.21.15.2:0/3594361791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcee0109540 con 0x7fcee0102ed0 2024-09-17T01:13:45.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.978+0000 7fcedd7fa640 1 -- 172.21.15.2:0/3594361791 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v95) v1 ==== 81+0+2396 (secure 0 0 0) 0x7fcec807a6e0 con 0x7fcee0102ed0 2024-09-17T01:13:45.976 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:6825/4057317500 2024-09-18T01:09:44.670722+0000 2024-09-17T01:13:45.976 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6829/1494631266 2024-09-18T01:09:44.670710+0000 2024-09-17T01:13:45.976 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6828/1494631266 2024-09-18T01:09:44.670710+0000 2024-09-17T01:13:45.976 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2519726568 2024-09-18T01:05:25.029104+0000 2024-09-17T01:13:45.976 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/288421810 2024-09-18T01:05:25.029104+0000 2024-09-17T01:13:45.976 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1960446881 2024-09-18T01:05:25.029104+0000 2024-09-17T01:13:45.976 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3505219593 2024-09-18T01:05:25.029104+0000 2024-09-17T01:13:45.976 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/970331290 2024-09-18T01:05:25.029104+0000 2024-09-17T01:13:45.977 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/157433590 2024-09-18T00:54:36.242935+0000 2024-09-17T01:13:45.977 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:0/2027254805 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:45.977 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:0/2282862733 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:45.977 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/1697208540 2024-09-18T01:02:16.131303+0000 2024-09-17T01:13:45.977 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1006642018 2024-09-18T00:54:36.242935+0000 2024-09-17T01:13:45.977 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2597867872 2024-09-18T00:53:05.759479+0000 2024-09-17T01:13:45.977 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2191872617 2024-09-18T00:54:36.242935+0000 2024-09-17T01:13:45.977 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:0/1507056264 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:45.977 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:6828/3228590963 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:45.977 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:6824/4057317500 2024-09-18T01:09:44.670722+0000 2024-09-17T01:13:45.977 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/4221926423 2024-09-18T00:54:36.242935+0000 2024-09-17T01:13:45.977 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:0/3676831554 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:45.977 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2143800566 2024-09-18T00:53:35.657108+0000 2024-09-17T01:13:45.978 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/1951809935 2024-09-18T00:53:05.759479+0000 2024-09-17T01:13:45.978 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2687394772 2024-09-18T00:53:05.759479+0000 2024-09-17T01:13:45.978 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:0/2100610878 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:45.978 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6826/2460632811 2024-09-18T00:59:36.469300+0000 2024-09-17T01:13:45.978 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:6829/3228590963 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:45.978 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:0/792475951 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:45.978 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1094288545 2024-09-18T01:02:16.131303+0000 2024-09-17T01:13:45.978 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/1951809935 2024-09-18T00:53:05.759479+0000 2024-09-17T01:13:45.978 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2191872617 2024-09-18T00:54:36.242935+0000 2024-09-17T01:13:45.978 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3082534604 2024-09-18T00:53:35.657108+0000 2024-09-17T01:13:45.978 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/4008124108 2024-09-18T00:53:35.657108+0000 2024-09-17T01:13:45.979 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2244315938 2024-09-18T00:53:05.759479+0000 2024-09-17T01:13:45.979 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3082534604 2024-09-18T00:53:35.657108+0000 2024-09-17T01:13:45.979 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2519726568 2024-09-18T01:05:25.029104+0000 2024-09-17T01:13:45.979 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/1697208540 2024-09-18T01:02:16.131303+0000 2024-09-17T01:13:45.979 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/179641311 2024-09-18T01:02:16.131303+0000 2024-09-17T01:13:45.979 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6827/2460632811 2024-09-18T00:59:36.469300+0000 2024-09-17T01:13:45.979 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3770177876 2024-09-18T00:53:35.657108+0000 2024-09-17T01:13:45.979 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2200948522 2024-09-18T01:02:16.131303+0000 2024-09-17T01:13:45.979 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3115391478 2024-09-18T01:02:16.131303+0000 2024-09-17T01:13:45.980 INFO:teuthology.orchestra.run.smithi002.stderr:listed 41 entries 2024-09-17T01:13:45.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.980+0000 7fcee66f6640 1 -- 172.21.15.2:0/3594361791 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcecc06e530 msgr2=0x7fcecc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:45.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.981+0000 7fcee66f6640 1 --2- 172.21.15.2:0/3594361791 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcecc06e530 0x7fcecc0709e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fced0004eb0 tx=0x7fced000b040 comp rx=0 tx=0).stop 2024-09-17T01:13:45.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.981+0000 7fcee66f6640 1 -- 172.21.15.2:0/3594361791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee0102ed0 msgr2=0x7fcee0113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:45.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.981+0000 7fcee66f6640 1 --2- 172.21.15.2:0/3594361791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee0102ed0 0x7fcee0113710 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcec80043d0 tx=0x7fcec8009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:45.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.981+0000 7fcee66f6640 1 -- 172.21.15.2:0/3594361791 shutdown_connections 2024-09-17T01:13:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.981+0000 7fcee66f6640 1 --2- 172.21.15.2:0/3594361791 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fcecc06e530 0x7fcecc0709e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.981+0000 7fcee66f6640 1 --2- 172.21.15.2:0/3594361791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcee0102ed0 0x7fcee0113710 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.981+0000 7fcee66f6640 1 --2- 172.21.15.2:0/3594361791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcee0102530 0x7fcee01131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.981+0000 7fcee66f6640 1 -- 172.21.15.2:0/3594361791 >> 172.21.15.2:0/3594361791 conn(0x7fcee00f80f0 msgr2=0x7fcee00f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.981+0000 7fcee66f6640 1 -- 172.21.15.2:0/3594361791 shutdown_connections 2024-09-17T01:13:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:45.981+0000 7fcee66f6640 1 -- 172.21.15.2:0/3594361791 wait complete. 2024-09-17T01:13:46.662 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:13:46.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:13:46.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:13:46.692 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T01:13:46.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:13:46.693 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:13:46.758 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T01:13:46.758 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:13:46.778 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-17T01:13:46.779 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:13:46.838 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f8e82564-748e-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-17T01:13:47.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:46 smithi099 ceph-mon[77412]: pgmap v301: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:47.043 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:46 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3594361791' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:13:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/mon.smithi002/config 2024-09-17T01:13:47.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:46 smithi002 ceph-mon[98018]: pgmap v301: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:47.155 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:46 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3594361791' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:13:48.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.635+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/4189939116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9b40fac80 msgr2=0x7fa9b40fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:48.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.635+0000 7fa9b8aaa640 1 --2- 172.21.15.2:0/4189939116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9b40fac80 0x7fa9b40fb0b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0048d0 tx=0x7fa99c009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:48.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.635+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/4189939116 shutdown_connections 2024-09-17T01:13:48.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.635+0000 7fa9b8aaa640 1 --2- 172.21.15.2:0/4189939116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9b40fac80 0x7fa9b40fb0b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:48.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.635+0000 7fa9b8aaa640 1 --2- 172.21.15.2:0/4189939116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b41025b0 0x7fa9b4102980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:48.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.635+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/4189939116 >> 172.21.15.2:0/4189939116 conn(0x7fa9b4070ce0 msgr2=0x7fa9b40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:48.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.635+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/4189939116 shutdown_connections 2024-09-17T01:13:48.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.635+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/4189939116 wait complete. 2024-09-17T01:13:48.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.636+0000 7fa9b8aaa640 1 Processor -- start 2024-09-17T01:13:48.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.636+0000 7fa9b8aaa640 1 -- start start 2024-09-17T01:13:48.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.636+0000 7fa9b8aaa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b40fac80 0x7fa9b4113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:48.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.636+0000 7fa9b8aaa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9b41025b0 0x7fa9b4113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:48.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.636+0000 7fa9b8aaa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4113d80 con 0x7fa9b41025b0 2024-09-17T01:13:48.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.636+0000 7fa9b8aaa640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b410d1c0 con 0x7fa9b40fac80 2024-09-17T01:13:48.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.636+0000 7fa9b1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9b41025b0 0x7fa9b4113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:48.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.636+0000 7fa9b1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9b41025b0 0x7fa9b4113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43238/0 (socket says 172.21.15.2:43238) 2024-09-17T01:13:48.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.636+0000 7fa9b1d9b640 1 -- 172.21.15.2:0/3603284552 learned_addr learned my addr 172.21.15.2:0/3603284552 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-17T01:13:48.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.636+0000 7fa9b259c640 1 --2- 172.21.15.2:0/3603284552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b40fac80 0x7fa9b4113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:48.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.637+0000 7fa9b1d9b640 1 -- 172.21.15.2:0/3603284552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b40fac80 msgr2=0x7fa9b4113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:48.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.637+0000 7fa9b1d9b640 1 --2- 172.21.15.2:0/3603284552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b40fac80 0x7fa9b4113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:48.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.637+0000 7fa9b1d9b640 1 -- 172.21.15.2:0/3603284552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c005040 con 0x7fa9b41025b0 2024-09-17T01:13:48.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.637+0000 7fa9b1d9b640 1 --2- 172.21.15.2:0/3603284552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9b41025b0 0x7fa9b4113780 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa99c000c00 tx=0x7fa99c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:48.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.637+0000 7fa9aaffd640 1 -- 172.21.15.2:0/3603284552 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa99c038070 con 0x7fa9b41025b0 2024-09-17T01:13:48.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.637+0000 7fa9aaffd640 1 -- 172.21.15.2:0/3603284552 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa99c02ade0 con 0x7fa9b41025b0 2024-09-17T01:13:48.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.637+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/3603284552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b410d440 con 0x7fa9b41025b0 2024-09-17T01:13:48.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.637+0000 7fa9aaffd640 1 -- 172.21.15.2:0/3603284552 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa99c02c7e0 con 0x7fa9b41025b0 2024-09-17T01:13:48.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.637+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/3603284552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b410d900 con 0x7fa9b41025b0 2024-09-17T01:13:48.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.638+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/3603284552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b40657d0 con 0x7fa9b41025b0 2024-09-17T01:13:48.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.639+0000 7fa9aaffd640 1 -- 172.21.15.2:0/3603284552 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 92549+0+0 (secure 0 0 0) 0x7fa99c030020 con 0x7fa9b41025b0 2024-09-17T01:13:48.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.639+0000 7fa9aaffd640 1 --2- 172.21.15.2:0/3603284552 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa9a006e530 0x7fa9a00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:13:48.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.640+0000 7fa9aaffd640 1 -- 172.21.15.2:0/3603284552 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6785+0+0 (secure 0 0 0) 0x7fa99c0adfd0 con 0x7fa9b41025b0 2024-09-17T01:13:48.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.640+0000 7fa9b259c640 1 --2- 172.21.15.2:0/3603284552 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa9a006e530 0x7fa9a00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:13:48.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.640+0000 7fa9b259c640 1 --2- 172.21.15.2:0/3603284552 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa9a006e530 0x7fa9a00709e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4004fd0 tx=0x7fa9a4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:13:48.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.644+0000 7fa9aaffd640 1 -- 172.21.15.2:0/3603284552 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa99c0e31b0 con 0x7fa9b41025b0 2024-09-17T01:13:48.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.843+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/3603284552 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa9b41095b0 con 0x7fa9b41025b0 2024-09-17T01:13:48.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.843+0000 7fa9aaffd640 1 -- 172.21.15.2:0/3603284552 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v95) v1 ==== 81+0+2396 (secure 0 0 0) 0x7fa99c076fa0 con 0x7fa9b41025b0 2024-09-17T01:13:48.841 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:6825/4057317500 2024-09-18T01:09:44.670722+0000 2024-09-17T01:13:48.841 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6829/1494631266 2024-09-18T01:09:44.670710+0000 2024-09-17T01:13:48.841 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6828/1494631266 2024-09-18T01:09:44.670710+0000 2024-09-17T01:13:48.841 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2519726568 2024-09-18T01:05:25.029104+0000 2024-09-17T01:13:48.841 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/288421810 2024-09-18T01:05:25.029104+0000 2024-09-17T01:13:48.841 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1960446881 2024-09-18T01:05:25.029104+0000 2024-09-17T01:13:48.841 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3505219593 2024-09-18T01:05:25.029104+0000 2024-09-17T01:13:48.841 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/970331290 2024-09-18T01:05:25.029104+0000 2024-09-17T01:13:48.841 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/157433590 2024-09-18T00:54:36.242935+0000 2024-09-17T01:13:48.842 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:0/2027254805 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:48.842 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:0/2282862733 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:48.842 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/1697208540 2024-09-18T01:02:16.131303+0000 2024-09-17T01:13:48.842 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1006642018 2024-09-18T00:54:36.242935+0000 2024-09-17T01:13:48.842 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2597867872 2024-09-18T00:53:05.759479+0000 2024-09-17T01:13:48.842 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2191872617 2024-09-18T00:54:36.242935+0000 2024-09-17T01:13:48.842 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:0/1507056264 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:48.842 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:6828/3228590963 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:48.842 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:6824/4057317500 2024-09-18T01:09:44.670722+0000 2024-09-17T01:13:48.842 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/4221926423 2024-09-18T00:54:36.242935+0000 2024-09-17T01:13:48.842 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:0/3676831554 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:48.842 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2143800566 2024-09-18T00:53:35.657108+0000 2024-09-17T01:13:48.842 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/1951809935 2024-09-18T00:53:05.759479+0000 2024-09-17T01:13:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2687394772 2024-09-18T00:53:05.759479+0000 2024-09-17T01:13:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:0/2100610878 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6826/2460632811 2024-09-18T00:59:36.469300+0000 2024-09-17T01:13:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:6829/3228590963 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.99:0/792475951 2024-09-18T01:03:28.494665+0000 2024-09-17T01:13:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1094288545 2024-09-18T01:02:16.131303+0000 2024-09-17T01:13:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/1951809935 2024-09-18T00:53:05.759479+0000 2024-09-17T01:13:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2191872617 2024-09-18T00:54:36.242935+0000 2024-09-17T01:13:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3082534604 2024-09-18T00:53:35.657108+0000 2024-09-17T01:13:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/4008124108 2024-09-18T00:53:35.657108+0000 2024-09-17T01:13:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2244315938 2024-09-18T00:53:05.759479+0000 2024-09-17T01:13:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3082534604 2024-09-18T00:53:35.657108+0000 2024-09-17T01:13:48.843 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2519726568 2024-09-18T01:05:25.029104+0000 2024-09-17T01:13:48.844 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/1697208540 2024-09-18T01:02:16.131303+0000 2024-09-17T01:13:48.844 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/179641311 2024-09-18T01:02:16.131303+0000 2024-09-17T01:13:48.844 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6827/2460632811 2024-09-18T00:59:36.469300+0000 2024-09-17T01:13:48.844 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3770177876 2024-09-18T00:53:35.657108+0000 2024-09-17T01:13:48.844 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2200948522 2024-09-18T01:02:16.131303+0000 2024-09-17T01:13:48.844 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3115391478 2024-09-18T01:02:16.131303+0000 2024-09-17T01:13:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:listed 41 entries 2024-09-17T01:13:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.845+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/3603284552 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa9a006e530 msgr2=0x7fa9a00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.845+0000 7fa9b8aaa640 1 --2- 172.21.15.2:0/3603284552 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa9a006e530 0x7fa9a00709e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4004fd0 tx=0x7fa9a4009040 comp rx=0 tx=0).stop 2024-09-17T01:13:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.845+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/3603284552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9b41025b0 msgr2=0x7fa9b4113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:13:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.845+0000 7fa9b8aaa640 1 --2- 172.21.15.2:0/3603284552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9b41025b0 0x7fa9b4113780 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa99c000c00 tx=0x7fa99c009da0 comp rx=0 tx=0).stop 2024-09-17T01:13:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.845+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/3603284552 shutdown_connections 2024-09-17T01:13:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.845+0000 7fa9b8aaa640 1 --2- 172.21.15.2:0/3603284552 >> [v2:172.21.15.2:6800/2189836750,v1:172.21.15.2:6801/2189836750] conn(0x7fa9a006e530 0x7fa9a00709e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.845+0000 7fa9b8aaa640 1 --2- 172.21.15.2:0/3603284552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9b41025b0 0x7fa9b4113780 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.845+0000 7fa9b8aaa640 1 --2- 172.21.15.2:0/3603284552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b40fac80 0x7fa9b4113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:13:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.845+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/3603284552 >> 172.21.15.2:0/3603284552 conn(0x7fa9b4070ce0 msgr2=0x7fa9b41052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:13:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.845+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/3603284552 shutdown_connections 2024-09-17T01:13:48.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-17T01:13:48.846+0000 7fa9b8aaa640 1 -- 172.21.15.2:0/3603284552 wait complete. 2024-09-17T01:13:49.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:48 smithi099 ceph-mon[77412]: pgmap v302: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:49.148 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:48 smithi002 ceph-mon[98018]: pgmap v302: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:13:49.511 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T01:13:49.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:13:49.511 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T01:13:49.546 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-09-17T01:13:49.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:13:49.546 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T01:13:49.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:13:49.616 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-17T01:13:49.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:13:49.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:13:49.637 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:13:49.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:13:49.709 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-17T01:13:49.792 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:49 smithi099 ceph-mon[77412]: from='client.? 172.21.15.2:0/3603284552' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:13:49.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:13:49.809 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-17T01:13:49.828 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T01:13:49.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:13:49.829 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:13:49.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:13:49.899 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-09-17T01:13:49.997 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-17T01:13:50.007 INFO:tasks.cephadm:Teardown begin 2024-09-17T01:13:50.007 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:13:50.031 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:49 smithi002 ceph-mon[98018]: from='client.? 172.21.15.2:0/3603284552' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-17T01:13:50.036 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:13:50.064 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-17T01:13:50.064 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T01:13:50.093 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T01:13:50.121 INFO:tasks.cephadm:Stopping all daemons... 2024-09-17T01:13:50.121 INFO:tasks.cephadm.mon.smithi002:Stopping mon.smithi002... 2024-09-17T01:13:50.121 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi002 2024-09-17T01:13:50.404 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:50 smithi002 systemd[1]: Stopping Ceph mon.smithi002 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:13:50.699 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:50 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[98014]: 2024-09-17T01:13:50.435+0000 7f61d53cd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi002 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:13:50.699 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:50 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002[98014]: 2024-09-17T01:13:50.435+0000 7f61d53cd640 -1 mon.smithi002@0(leader) e3 *** Got Signal Terminated *** 2024-09-17T01:13:50.699 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:50 smithi002 podman[141486]: 2024-09-17 01:13:50.497304188 +0000 UTC m=+0.163508115 container died da5247385c2d65f1e126c9457b2c858f1cfe75634e1b8723d029a18da2efdd7e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2) 2024-09-17T01:13:51.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:50 smithi002 podman[141486]: 2024-09-17 01:13:50.873504858 +0000 UTC m=+0.539708774 container cleanup da5247385c2d65f1e126c9457b2c858f1cfe75634e1b8723d029a18da2efdd7e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-17T01:13:51.147 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Sep 17 01:13:50 smithi002 bash[141486]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi002 2024-09-17T01:13:51.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi002.service' 2024-09-17T01:13:51.372 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:13:51.373 INFO:tasks.cephadm.mon.smithi002:Stopped mon.smithi002 2024-09-17T01:13:51.373 INFO:tasks.cephadm.mon.smithi099:Stopping mon.smithi099... 2024-09-17T01:13:51.373 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi099 2024-09-17T01:13:51.598 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:51 smithi099 systemd[1]: Stopping Ceph mon.smithi099 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:13:52.030 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:51 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi099[77408]: 2024-09-17T01:13:51.697+0000 7f6c6150f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi099 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:13:52.030 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:51 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi099[77408]: 2024-09-17T01:13:51.698+0000 7f6c6150f640 -1 mon.smithi099@1(peon) e3 *** Got Signal Terminated *** 2024-09-17T01:13:52.030 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:51 smithi099 podman[109927]: 2024-09-17 01:13:51.749386592 +0000 UTC m=+0.157276553 container died b92f98b2cab9e8db2193b25b9e4a1b3bc80c90318f7f44b2ff85501677494e66 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi099, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-17T01:13:52.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:52 smithi099 podman[109927]: 2024-09-17 01:13:52.232509326 +0000 UTC m=+0.640399284 container cleanup b92f98b2cab9e8db2193b25b9e4a1b3bc80c90318f7f44b2ff85501677494e66 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi099, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-17T01:13:52.293 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 17 01:13:52 smithi099 bash[109927]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-mon-smithi099 2024-09-17T01:13:52.636 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@mon.smithi099.service' 2024-09-17T01:13:52.678 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:13:52.678 INFO:tasks.cephadm.mon.smithi099:Stopped mon.smithi099 2024-09-17T01:13:52.678 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-17T01:13:52.679 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.0 2024-09-17T01:13:53.008 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:13:52 smithi002 systemd[1]: Stopping Ceph osd.0 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:13:53.405 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:13:53 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0[109154]: 2024-09-17T01:13:53.010+0000 7f5275011640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:13:53.405 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:13:53 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0[109154]: 2024-09-17T01:13:53.010+0000 7f5275011640 -1 osd.0 95 *** Got signal Terminated *** 2024-09-17T01:13:53.405 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:13:53 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0[109154]: 2024-09-17T01:13:53.010+0000 7f5275011640 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:13:58.655 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:13:58 smithi002 podman[141704]: 2024-09-17 01:13:58.356637438 +0000 UTC m=+5.466518566 container died 563188d6089b1115f2aa9caf1809ecdd5384489d347a58e334772b8dc027f31f (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-17T01:13:59.102 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:13:58 smithi002 podman[141704]: 2024-09-17 01:13:58.853439727 +0000 UTC m=+5.963320851 container cleanup 563188d6089b1115f2aa9caf1809ecdd5384489d347a58e334772b8dc027f31f (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-17T01:13:59.102 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:13:58 smithi002 bash[141704]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0 2024-09-17T01:13:59.404 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:13:59 smithi002 podman[141719]: 2024-09-17 01:13:59.104947351 +0000 UTC m=+0.746494116 container remove 563188d6089b1115f2aa9caf1809ecdd5384489d347a58e334772b8dc027f31f (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-17T01:13:59.848 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:13:59 smithi002 podman[141809]: 2024-09-17 01:13:59.338567046 +0000 UTC m=+0.016371203 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:13:59.848 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:13:59 smithi002 podman[141809]: 2024-09-17 01:13:59.481418884 +0000 UTC m=+0.159223042 container create 671be948862cfa5ba017a4d59aeed700cd01707e722a6b386a59f63d0166030e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:13:59.848 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:13:59 smithi002 podman[141809]: 2024-09-17 01:13:59.851090346 +0000 UTC m=+0.528894522 container init 671be948862cfa5ba017a4d59aeed700cd01707e722a6b386a59f63d0166030e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-17T01:14:00.155 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:13:59 smithi002 podman[141809]: 2024-09-17 01:13:59.854728914 +0000 UTC m=+0.532533071 container start 671be948862cfa5ba017a4d59aeed700cd01707e722a6b386a59f63d0166030e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-17T01:14:00.155 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:13:59 smithi002 podman[141809]: 2024-09-17 01:13:59.959430459 +0000 UTC m=+0.637234630 container attach 671be948862cfa5ba017a4d59aeed700cd01707e722a6b386a59f63d0166030e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-09-17T01:14:00.155 INFO:journalctl@ceph.osd.0.smithi002.stdout:Sep 17 01:14:00 smithi002 podman[141809]: 2024-09-17 01:14:00.050051698 +0000 UTC m=+0.727855856 container died 671be948862cfa5ba017a4d59aeed700cd01707e722a6b386a59f63d0166030e (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-17T01:14:00.679 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.0.service' 2024-09-17T01:14:00.719 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:14:00.719 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-17T01:14:00.719 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-17T01:14:00.719 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.1 2024-09-17T01:14:01.089 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:14:00 smithi002 systemd[1]: Stopping Ceph osd.1 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:14:01.360 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:14:01 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1[114908]: 2024-09-17T01:14:01.091+0000 7f75d8ec0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:14:01.360 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:14:01 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1[114908]: 2024-09-17T01:14:01.091+0000 7f75d8ec0640 -1 osd.1 95 *** Got signal Terminated *** 2024-09-17T01:14:01.360 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:14:01 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1[114908]: 2024-09-17T01:14:01.091+0000 7f75d8ec0640 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:14:06.873 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:14:06 smithi002 podman[141924]: 2024-09-17 01:14:06.573323945 +0000 UTC m=+5.599824639 container died cc26caf558d7ee13b040020935765daeecf6c68fceb102e0b78a0efce0f6f828 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-17T01:14:07.155 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:14:06 smithi002 podman[141924]: 2024-09-17 01:14:06.975005468 +0000 UTC m=+6.001506140 container cleanup cc26caf558d7ee13b040020935765daeecf6c68fceb102e0b78a0efce0f6f828 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, ceph=True) 2024-09-17T01:14:07.155 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:14:06 smithi002 bash[141924]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1 2024-09-17T01:14:07.558 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:14:07 smithi002 podman[141945]: 2024-09-17 01:14:07.226918651 +0000 UTC m=+0.646462947 container remove cc26caf558d7ee13b040020935765daeecf6c68fceb102e0b78a0efce0f6f828 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97) 2024-09-17T01:14:07.853 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:14:07 smithi002 podman[142036]: 2024-09-17 01:14:07.463859952 +0000 UTC m=+0.016628734 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:14:07.854 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:14:07 smithi002 podman[142036]: 2024-09-17 01:14:07.59469877 +0000 UTC m=+0.147467584 container create 2111944e23abd437d3e1088d109da55d8940c101eb04221069668c1a3d532b73 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-17T01:14:07.854 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:14:07 smithi002 podman[142036]: 2024-09-17 01:14:07.855921539 +0000 UTC m=+0.408690305 container init 2111944e23abd437d3e1088d109da55d8940c101eb04221069668c1a3d532b73 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-17T01:14:08.155 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:14:07 smithi002 podman[142036]: 2024-09-17 01:14:07.859452287 +0000 UTC m=+0.412221053 container start 2111944e23abd437d3e1088d109da55d8940c101eb04221069668c1a3d532b73 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:14:08.155 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:14:07 smithi002 podman[142036]: 2024-09-17 01:14:07.930643308 +0000 UTC m=+0.483412085 container attach 2111944e23abd437d3e1088d109da55d8940c101eb04221069668c1a3d532b73 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-17T01:14:08.155 INFO:journalctl@ceph.osd.1.smithi002.stdout:Sep 17 01:14:08 smithi002 podman[142036]: 2024-09-17 01:14:08.052785931 +0000 UTC m=+0.605554709 container died 2111944e23abd437d3e1088d109da55d8940c101eb04221069668c1a3d532b73 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-17T01:14:08.709 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.1.service' 2024-09-17T01:14:08.752 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:14:08.753 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-17T01:14:08.753 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-17T01:14:08.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.2 2024-09-17T01:14:09.094 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:14:08 smithi002 systemd[1]: Stopping Ceph osd.2 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:14:09.404 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:14:09 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2[120507]: 2024-09-17T01:14:09.095+0000 7f2d5fa9a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:14:09.405 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:14:09 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2[120507]: 2024-09-17T01:14:09.095+0000 7f2d5fa9a640 -1 osd.2 95 *** Got signal Terminated *** 2024-09-17T01:14:09.405 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:14:09 smithi002 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2[120507]: 2024-09-17T01:14:09.095+0000 7f2d5fa9a640 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:14:14.905 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:14:14 smithi002 podman[142139]: 2024-09-17 01:14:14.608353347 +0000 UTC m=+5.623761192 container died 0aac20af558015a4460672d2aa9cb6427f65449727967c98755c635339bb5dd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-17T01:14:15.245 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:14:14 smithi002 podman[142139]: 2024-09-17 01:14:14.988130313 +0000 UTC m=+6.003538159 container cleanup 0aac20af558015a4460672d2aa9cb6427f65449727967c98755c635339bb5dd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97) 2024-09-17T01:14:15.245 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:14:14 smithi002 bash[142139]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2 2024-09-17T01:14:15.578 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:14:15 smithi002 podman[142154]: 2024-09-17 01:14:15.247897918 +0000 UTC m=+0.638258101 container remove 0aac20af558015a4460672d2aa9cb6427f65449727967c98755c635339bb5dd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-17T01:14:15.899 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:14:15 smithi002 podman[142247]: 2024-09-17 01:14:15.484003486 +0000 UTC m=+0.016731072 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:14:15.899 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:14:15 smithi002 podman[142247]: 2024-09-17 01:14:15.582137509 +0000 UTC m=+0.114865140 container create 7dc0e936749c4782e385affc8d3722699ea643855b225215ab0038617dd9fdd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-17T01:14:15.899 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:14:15 smithi002 podman[142247]: 2024-09-17 01:14:15.818739496 +0000 UTC m=+0.351467095 container init 7dc0e936749c4782e385affc8d3722699ea643855b225215ab0038617dd9fdd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-17T01:14:15.899 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:14:15 smithi002 podman[142247]: 2024-09-17 01:14:15.822120884 +0000 UTC m=+0.354848478 container start 7dc0e936749c4782e385affc8d3722699ea643855b225215ab0038617dd9fdd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-17T01:14:16.155 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:14:15 smithi002 podman[142247]: 2024-09-17 01:14:15.901814673 +0000 UTC m=+0.434542276 container attach 7dc0e936749c4782e385affc8d3722699ea643855b225215ab0038617dd9fdd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-17T01:14:16.155 INFO:journalctl@ceph.osd.2.smithi002.stdout:Sep 17 01:14:16 smithi002 podman[142247]: 2024-09-17 01:14:16.014092183 +0000 UTC m=+0.546819777 container died 7dc0e936749c4782e385affc8d3722699ea643855b225215ab0038617dd9fdd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-17T01:14:16.592 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.2.service' 2024-09-17T01:14:16.634 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:14:16.634 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-17T01:14:16.634 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-17T01:14:16.634 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.3 2024-09-17T01:14:17.024 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:14:16 smithi099 systemd[1]: Stopping Ceph osd.3 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:14:17.292 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:14:17 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3[86670]: 2024-09-17T01:14:17.025+0000 7f182fa07640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:14:17.293 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:14:17 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3[86670]: 2024-09-17T01:14:17.025+0000 7f182fa07640 -1 osd.3 95 *** Got signal Terminated *** 2024-09-17T01:14:17.293 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:14:17 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3[86670]: 2024-09-17T01:14:17.025+0000 7f182fa07640 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:14:19.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:18 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:18.974+0000 7fe00ff6d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:52.878185+0000 front 2024-09-17T01:13:52.878123+0000 (oldest deadline 2024-09-17T01:14:18.778024+0000) 2024-09-17T01:14:20.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:19 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:19.988+0000 7fe00ff6d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:52.878185+0000 front 2024-09-17T01:13:52.878123+0000 (oldest deadline 2024-09-17T01:14:18.778024+0000) 2024-09-17T01:14:21.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:20 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:20.978+0000 7fe00ff6d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:52.878185+0000 front 2024-09-17T01:13:52.878123+0000 (oldest deadline 2024-09-17T01:14:18.778024+0000) 2024-09-17T01:14:22.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:22 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:22.003+0000 7fe00ff6d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:52.878185+0000 front 2024-09-17T01:13:52.878123+0000 (oldest deadline 2024-09-17T01:14:18.778024+0000) 2024-09-17T01:14:22.793 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:14:22 smithi099 podman[110059]: 2024-09-17 01:14:22.540830843 +0000 UTC m=+5.706907067 container died 0740cf987fef35ee53b2ce5b50dc0b64a1eab23a28aa5779e9a0172b86775ea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-17T01:14:23.258 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:23 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:23.046+0000 7fe00ff6d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:52.878185+0000 front 2024-09-17T01:13:52.878123+0000 (oldest deadline 2024-09-17T01:14:18.778024+0000) 2024-09-17T01:14:23.258 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:23 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:23.024+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:23.258 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:14:23 smithi099 podman[110059]: 2024-09-17 01:14:23.017457637 +0000 UTC m=+6.183533853 container cleanup 0740cf987fef35ee53b2ce5b50dc0b64a1eab23a28aa5779e9a0172b86775ea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-17T01:14:23.258 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:14:23 smithi099 bash[110059]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3 2024-09-17T01:14:23.543 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:14:23 smithi099 podman[110074]: 2024-09-17 01:14:23.260777423 +0000 UTC m=+0.716267150 container remove 0740cf987fef35ee53b2ce5b50dc0b64a1eab23a28aa5779e9a0172b86775ea3 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-17T01:14:23.878 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:14:23 smithi099 podman[110164]: 2024-09-17 01:14:23.480930091 +0000 UTC m=+0.015604689 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:14:23.878 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:14:23 smithi099 podman[110164]: 2024-09-17 01:14:23.595073593 +0000 UTC m=+0.129748233 container create 0a178905dd982e1e4076986123770e70628ec9b9090a19a1daaa2f3d126de029 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:14:23.878 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:14:23 smithi099 podman[110164]: 2024-09-17 01:14:23.80606537 +0000 UTC m=+0.340739968 container init 0a178905dd982e1e4076986123770e70628ec9b9090a19a1daaa2f3d126de029 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-17T01:14:23.878 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:14:23 smithi099 podman[110164]: 2024-09-17 01:14:23.809559699 +0000 UTC m=+0.344234300 container start 0a178905dd982e1e4076986123770e70628ec9b9090a19a1daaa2f3d126de029 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-17T01:14:23.878 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:14:23 smithi099 podman[110164]: 2024-09-17 01:14:23.880831363 +0000 UTC m=+0.415505973 container attach 0a178905dd982e1e4076986123770e70628ec9b9090a19a1daaa2f3d126de029 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, ceph=True) 2024-09-17T01:14:24.252 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:24 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:24.030+0000 7fe00ff6d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:52.878185+0000 front 2024-09-17T01:13:52.878123+0000 (oldest deadline 2024-09-17T01:14:18.778024+0000) 2024-09-17T01:14:24.252 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:23 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:23.996+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:24.252 INFO:journalctl@ceph.osd.3.smithi099.stdout:Sep 17 01:14:23 smithi099 podman[110164]: 2024-09-17 01:14:23.994603029 +0000 UTC m=+0.529277628 container died 0a178905dd982e1e4076986123770e70628ec9b9090a19a1daaa2f3d126de029 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-17T01:14:24.718 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.3.service' 2024-09-17T01:14:24.756 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:14:24.757 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-17T01:14:24.757 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-17T01:14:24.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.4 2024-09-17T01:14:24.958 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:24 smithi099 systemd[1]: Stopping Ceph osd.4 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:14:25.233 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:24 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:24.959+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:25.233 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:25 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:25.067+0000 7fe00ff6d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:52.878185+0000 front 2024-09-17T01:13:52.878123+0000 (oldest deadline 2024-09-17T01:14:18.778024+0000) 2024-09-17T01:14:25.234 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:25 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:25.105+0000 7fe017970640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:14:25.234 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:25 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:25.105+0000 7fe017970640 -1 osd.4 95 *** Got signal Terminated *** 2024-09-17T01:14:25.234 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:25 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:25.105+0000 7fe017970640 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:14:26.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:26 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:26.066+0000 7fe00ff6d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:52.878185+0000 front 2024-09-17T01:13:52.878123+0000 (oldest deadline 2024-09-17T01:14:18.778024+0000) 2024-09-17T01:14:26.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:25 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:25.916+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:27.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:27 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:27.100+0000 7fe00ff6d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:52.878185+0000 front 2024-09-17T01:13:52.878123+0000 (oldest deadline 2024-09-17T01:14:18.778024+0000) 2024-09-17T01:14:27.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:26 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:26.867+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:28.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:28 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:28.072+0000 7fe00ff6d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:52.878185+0000 front 2024-09-17T01:13:52.878123+0000 (oldest deadline 2024-09-17T01:14:18.778024+0000) 2024-09-17T01:14:28.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:28 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:28.072+0000 7fe00ff6d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-17T01:14:03.979409+0000 front 2024-09-17T01:14:03.979368+0000 (oldest deadline 2024-09-17T01:14:27.479145+0000) 2024-09-17T01:14:28.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:27 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:27.865+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:28.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:27 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:27.865+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-17T01:14:05.145183+0000 front 2024-09-17T01:14:05.145168+0000 (oldest deadline 2024-09-17T01:14:27.445017+0000) 2024-09-17T01:14:29.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:29 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:29.076+0000 7fe00ff6d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:52.878185+0000 front 2024-09-17T01:13:52.878123+0000 (oldest deadline 2024-09-17T01:14:18.778024+0000) 2024-09-17T01:14:29.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:29 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4[91966]: 2024-09-17T01:14:29.076+0000 7fe00ff6d640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-17T01:14:03.979409+0000 front 2024-09-17T01:14:03.979368+0000 (oldest deadline 2024-09-17T01:14:27.479145+0000) 2024-09-17T01:14:29.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:28 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:28.908+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:29.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:28 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:28.908+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-17T01:14:05.145183+0000 front 2024-09-17T01:14:05.145168+0000 (oldest deadline 2024-09-17T01:14:27.445017+0000) 2024-09-17T01:14:30.194 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:29 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:29.891+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:30.195 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:29 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:29.891+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-17T01:14:05.145183+0000 front 2024-09-17T01:14:05.145168+0000 (oldest deadline 2024-09-17T01:14:27.445017+0000) 2024-09-17T01:14:30.903 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:30 smithi099 podman[110277]: 2024-09-17 01:14:30.63806078 +0000 UTC m=+5.656389812 container died df5b078898bb1fc3e6419da4cc9aef151b08e4de47925582e216d31294ef80ed (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:14:31.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:31 smithi099 podman[110277]: 2024-09-17 01:14:31.088692168 +0000 UTC m=+6.107021242 container cleanup df5b078898bb1fc3e6419da4cc9aef151b08e4de47925582e216d31294ef80ed (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:14:31.293 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:31 smithi099 bash[110277]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4 2024-09-17T01:14:31.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:30 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:30.920+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:31.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:30 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:30.920+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-17T01:14:05.145183+0000 front 2024-09-17T01:14:05.145168+0000 (oldest deadline 2024-09-17T01:14:27.445017+0000) 2024-09-17T01:14:31.762 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:31 smithi099 podman[110293]: 2024-09-17 01:14:31.423986955 +0000 UTC m=+0.779570960 container remove df5b078898bb1fc3e6419da4cc9aef151b08e4de47925582e216d31294ef80ed (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-17T01:14:32.043 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:31 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:31.872+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:32.043 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:31 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:31.872+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-17T01:14:05.145183+0000 front 2024-09-17T01:14:05.145168+0000 (oldest deadline 2024-09-17T01:14:27.445017+0000) 2024-09-17T01:14:32.043 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:31 smithi099 podman[110381]: 2024-09-17 01:14:31.66751275 +0000 UTC m=+0.015679076 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:14:32.043 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:31 smithi099 podman[110381]: 2024-09-17 01:14:31.774874146 +0000 UTC m=+0.123040456 container create 7290df024aa03813f2da82b6645cd2b6b750463c9142be065753cdd0f8354fb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:14:32.043 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:32 smithi099 podman[110381]: 2024-09-17 01:14:32.002527257 +0000 UTC m=+0.350693567 container init 7290df024aa03813f2da82b6645cd2b6b750463c9142be065753cdd0f8354fb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=) 2024-09-17T01:14:32.043 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:32 smithi099 podman[110381]: 2024-09-17 01:14:32.005905269 +0000 UTC m=+0.354071588 container start 7290df024aa03813f2da82b6645cd2b6b750463c9142be065753cdd0f8354fb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-17T01:14:32.486 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:32 smithi099 podman[110381]: 2024-09-17 01:14:32.102742711 +0000 UTC m=+0.450909031 container attach 7290df024aa03813f2da82b6645cd2b6b750463c9142be065753cdd0f8354fb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:14:32.486 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 17 01:14:32 smithi099 podman[110381]: 2024-09-17 01:14:32.196545329 +0000 UTC m=+0.544711639 container died 7290df024aa03813f2da82b6645cd2b6b750463c9142be065753cdd0f8354fb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-17T01:14:32.815 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.4.service' 2024-09-17T01:14:32.855 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:14:32.855 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-17T01:14:32.856 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-17T01:14:32.856 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.5 2024-09-17T01:14:33.042 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:32 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:32.838+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:33.043 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:32 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:32.838+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-17T01:14:05.145183+0000 front 2024-09-17T01:14:05.145168+0000 (oldest deadline 2024-09-17T01:14:27.445017+0000) 2024-09-17T01:14:33.043 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:32 smithi099 systemd[1]: Stopping Ceph osd.5 for f8e82564-748e-11ef-bceb-c7b262605968... 2024-09-17T01:14:33.542 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:33 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:33.184+0000 7f3684fc6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:14:33.543 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:33 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:33.184+0000 7f3684fc6640 -1 osd.5 95 *** Got signal Terminated *** 2024-09-17T01:14:33.543 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:33 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:33.184+0000 7f3684fc6640 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:14:34.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:33 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:33.808+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:34.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:33 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:33.808+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-17T01:14:05.145183+0000 front 2024-09-17T01:14:05.145168+0000 (oldest deadline 2024-09-17T01:14:27.445017+0000) 2024-09-17T01:14:35.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:34 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:34.845+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:35.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:34 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:34.845+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-17T01:14:05.145183+0000 front 2024-09-17T01:14:05.145168+0000 (oldest deadline 2024-09-17T01:14:27.445017+0000) 2024-09-17T01:14:36.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:35 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:35.828+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:36.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:35 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:35.828+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-17T01:14:05.145183+0000 front 2024-09-17T01:14:05.145168+0000 (oldest deadline 2024-09-17T01:14:27.445017+0000) 2024-09-17T01:14:37.292 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:36 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:36.857+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:37.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:36 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:36.857+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-17T01:14:05.145183+0000 front 2024-09-17T01:14:05.145168+0000 (oldest deadline 2024-09-17T01:14:27.445017+0000) 2024-09-17T01:14:38.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:37 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:37.829+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-09-17T01:13:54.044253+0000 front 2024-09-17T01:13:54.044181+0000 (oldest deadline 2024-09-17T01:14:22.244394+0000) 2024-09-17T01:14:38.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:37 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:37.829+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2024-09-17T01:14:05.145183+0000 front 2024-09-17T01:14:05.145168+0000 (oldest deadline 2024-09-17T01:14:27.445017+0000) 2024-09-17T01:14:38.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:37 smithi099 ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5[96986]: 2024-09-17T01:14:37.829+0000 7f36815cb640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.2:6822 osd.2 since back 2024-09-17T01:14:13.345970+0000 front 2024-09-17T01:14:13.345916+0000 (oldest deadline 2024-09-17T01:14:37.445700+0000) 2024-09-17T01:14:38.882 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:38 smithi099 podman[110482]: 2024-09-17 01:14:38.622432613 +0000 UTC m=+5.542973813 container died e26706fa8822f9739cf40a48aad96a0d86a01ef5f1ed1e38558e30ea99b9e0df (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-17T01:14:39.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:39 smithi099 podman[110482]: 2024-09-17 01:14:39.059256633 +0000 UTC m=+5.979797832 container cleanup e26706fa8822f9739cf40a48aad96a0d86a01ef5f1ed1e38558e30ea99b9e0df (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-17T01:14:39.293 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:39 smithi099 bash[110482]: ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5 2024-09-17T01:14:39.793 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:39 smithi099 podman[110497]: 2024-09-17 01:14:39.336241773 +0000 UTC m=+0.715731853 container remove e26706fa8822f9739cf40a48aad96a0d86a01ef5f1ed1e38558e30ea99b9e0df (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-c2ddf97, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:14:40.145 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:39 smithi099 podman[110585]: 2024-09-17 01:14:39.722086911 +0000 UTC m=+0.016230674 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 2024-09-17T01:14:40.145 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:39 smithi099 podman[110585]: 2024-09-17 01:14:39.828709555 +0000 UTC m=+0.122853302 container create deded23c9084d3c9b41ccf5a2fb7b4cb8203147189a1d1420d7f4dce822c64b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, ceph=True) 2024-09-17T01:14:40.145 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:40 smithi099 podman[110585]: 2024-09-17 01:14:40.06463617 +0000 UTC m=+0.358779924 container init deded23c9084d3c9b41ccf5a2fb7b4cb8203147189a1d1420d7f4dce822c64b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97) 2024-09-17T01:14:40.145 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:40 smithi099 podman[110585]: 2024-09-17 01:14:40.067956093 +0000 UTC m=+0.362099842 container start deded23c9084d3c9b41ccf5a2fb7b4cb8203147189a1d1420d7f4dce822c64b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-17T01:14:40.145 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:40 smithi099 podman[110585]: 2024-09-17 01:14:40.148079506 +0000 UTC m=+0.442223263 container attach deded23c9084d3c9b41ccf5a2fb7b4cb8203147189a1d1420d7f4dce822c64b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-09-17T01:14:40.543 INFO:journalctl@ceph.osd.5.smithi099.stdout:Sep 17 01:14:40 smithi099 podman[110585]: 2024-09-17 01:14:40.257901528 +0000 UTC m=+0.552045286 container died deded23c9084d3c9b41ccf5a2fb7b4cb8203147189a1d1420d7f4dce822c64b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-f8e82564-748e-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-09-17T01:14:40.810 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f8e82564-748e-11ef-bceb-c7b262605968@osd.5.service' 2024-09-17T01:14:40.851 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:14:40.852 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-17T01:14:40.852 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f8e82564-748e-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T01:15:02.432 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f8e82564-748e-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T01:15:15.673 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:15:15.704 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:15:15.731 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-17T01:15:15.733 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907972/remote/smithi002/crash 2024-09-17T01:15:15.734 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/crash -- . 2024-09-17T01:15:15.772 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T01:15:15.772 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now 2024-09-17T01:15:15.774 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907972/remote/smithi099/crash 2024-09-17T01:15:15.775 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/crash -- . 2024-09-17T01:15:15.799 INFO:teuthology.orchestra.run.smithi099.stderr:tar: /var/lib/ceph/f8e82564-748e-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T01:15:15.799 INFO:teuthology.orchestra.run.smithi099.stderr:tar: Error is not recoverable: exiting now 2024-09-17T01:15:15.800 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-17T01:15:15.800 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-17T01:15:15.855 INFO:teuthology.orchestra.run.smithi002.stdout:2024-09-17T01:10:00.000158+0000 mon.smithi002 (mon.0) 623 : cluster [ERR] fs cephfs is degraded 2024-09-17T01:15:15.855 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-17T01:15:15.855 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[SEC\]' /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-17T01:15:15.938 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]' /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-17T01:15:16.013 INFO:teuthology.orchestra.run.smithi002.stdout:2024-09-17T01:10:00.000158+0000 mon.smithi002 (mon.0) 623 : cluster [ERR] fs cephfs is degraded 2024-09-17T01:15:16.014 INFO:tasks.cephadm:Compressing logs... 2024-09-17T01:15:16.014 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T01:15:16.057 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T01:15:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-17T01:15:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:: No such file or directory 2024-09-17T01:15:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-17T01:15:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-17T01:15:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-17T01:15:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi099.heckcd.log 2024-09-17T01:15:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:: No such file or directory 2024-09-17T01:15:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mgr.smithi099.vswzrb.log 2024-09-17T01:15:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi099.heckcd.log: gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-17T01:15:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mgr.smithi099.vswzrb.log: gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-17T01:15:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-17T01:15:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-17T01:15:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.4.log: /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mon.smithi099.log 2024-09-17T01:15:16.088 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi099.hgawhu.log 2024-09-17T01:15:16.088 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mon.smithi099.log: gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-17T01:15:16.088 INFO:teuthology.orchestra.run.smithi099.stderr: 85.3% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-17T01:15:16.088 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi099.hgawhu.log: 91.2% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-17T01:15:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mgr.smithi002.vjeexr.log 2024-09-17T01:15:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-17T01:15:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mgr.smithi002.vjeexr.log: gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-17T01:15:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi002.fmyyzz.log 2024-09-17T01:15:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.log 2024-09-17T01:15:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi002.fmyyzz.log: 86.4% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-17T01:15:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mon.smithi002.log 2024-09-17T01:15:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.log: 91.0% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-17T01:15:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi002.zmrgxd.log 2024-09-17T01:15:16.089 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-17T01:15:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mon.smithi002.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-17T01:15:16.102 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi002.zmrgxd.log: /var/log/ceph/cephadm.log: 91.0% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-17T01:15:16.103 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.log 2024-09-17T01:15:16.104 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-17T01:15:16.104 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0%/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.log: -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-17T01:15:16.105 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-17T01:15:16.106 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-17T01:15:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-17T01:15:16.134 INFO:teuthology.orchestra.run.smithi002.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-17T01:15:16.143 INFO:teuthology.orchestra.run.smithi099.stderr: 89.7% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mgr.smithi099.vswzrb.log.gz 2024-09-17T01:15:16.439 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mgr.smithi002.vjeexr.log.gz 2024-09-17T01:15:16.474 INFO:teuthology.orchestra.run.smithi099.stderr: 92.4% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mon.smithi099.log.gz 2024-09-17T01:15:17.168 INFO:teuthology.orchestra.run.smithi002.stderr: 90.5% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mon.smithi002.log.gz 2024-09-17T01:15:19.938 INFO:teuthology.orchestra.run.smithi099.stderr: 93.4% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-17T01:15:20.528 INFO:teuthology.orchestra.run.smithi002.stderr: 93.2% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-17T01:15:21.196 INFO:teuthology.orchestra.run.smithi002.stderr: 93.4% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-17T01:15:21.857 INFO:teuthology.orchestra.run.smithi099.stderr: 95.1% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi099.heckcd.log.gz 2024-09-17T01:15:23.026 INFO:teuthology.orchestra.run.smithi099.stderr: 93.2% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-17T01:15:23.121 INFO:teuthology.orchestra.run.smithi002.stderr: 92.9% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-17T01:15:23.472 INFO:teuthology.orchestra.run.smithi099.stderr: 93.3% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-17T01:15:26.649 INFO:teuthology.orchestra.run.smithi002.stderr: 95.2% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi002.zmrgxd.log.gz 2024-09-17T01:15:52.302 INFO:teuthology.orchestra.run.smithi099.stderr: 93.7% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi099.hgawhu.log.gz 2024-09-17T01:15:52.303 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-17T01:15:52.303 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m36.232s 2024-09-17T01:15:52.303 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m58.523s 2024-09-17T01:15:52.303 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m2.006s 2024-09-17T01:16:18.365 INFO:teuthology.orchestra.run.smithi002.stderr: 93.1% -- replaced with /var/log/ceph/f8e82564-748e-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi002.fmyyzz.log.gz 2024-09-17T01:16:18.366 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-17T01:16:18.367 INFO:teuthology.orchestra.run.smithi002.stderr:real 1m2.297s 2024-09-17T01:16:18.367 INFO:teuthology.orchestra.run.smithi002.stderr:user 1m28.246s 2024-09-17T01:16:18.367 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m2.556s 2024-09-17T01:16:18.367 INFO:tasks.cephadm:Archiving logs... 2024-09-17T01:16:18.368 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907972/remote/smithi002/log 2024-09-17T01:16:18.369 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T01:16:30.772 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907972/remote/smithi099/log 2024-09-17T01:16:30.774 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T01:16:38.924 INFO:tasks.cephadm:Removing cluster... 2024-09-17T01:16:38.924 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f8e82564-748e-11ef-bceb-c7b262605968 --force 2024-09-17T01:16:39.514 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f8e82564-748e-11ef-bceb-c7b262605968 --force 2024-09-17T01:16:40.127 INFO:tasks.cephadm:Removing cephadm ... 2024-09-17T01:16:40.127 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T01:16:40.145 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T01:16:40.161 INFO:tasks.cephadm:Teardown complete 2024-09-17T01:16:40.161 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T01:16:40.173 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T01:16:40.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T01:16:40.188 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T01:16:40.273 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T01:16:40.367 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T01:16:40.367 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:16:40.370 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:16:40.384 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-17T01:16:40.384 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-09-17T01:16:40.390 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T01:16:40.391 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-09-17T01:16:40.391 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +3195us[+3240us] +/- 38ms 2024-09-17T01:16:40.391 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 -4117us[-4117us] +/- 71ms 2024-09-17T01:16:40.391 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 -2299us[-2254us] +/- 91ms 2024-09-17T01:16:40.391 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:16:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T01:16:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-17T01:16:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +3221us[+3225us] +/- 38ms 2024-09-17T01:16:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 -4107us[-4107us] +/- 71ms 2024-09-17T01:16:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 -2281us[-2281us] +/- 91ms 2024-09-17T01:16:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:16:40.392 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T01:16:40.403 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T01:16:40.403 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T01:16:40.634 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T01:16:40.728 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T01:16:40.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T01:16:40.835 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:16:40.835 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T01:16:40.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:16:40.864 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T01:16:40.876 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T01:16:40.945 INFO:teuthology.task.internal:Duration was 1866.885720 seconds 2024-09-17T01:16:40.945 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T01:16:40.959 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T01:16:40.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T01:16:40.962 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T01:16:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T01:16:41.002 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T01:16:41.457 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T01:16:41.457 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-09-17T01:16:41.457 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T01:16:41.522 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-09-17T01:16:41.523 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T01:16:41.547 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T01:16:41.548 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T01:16:41.566 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T01:16:41.615 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T01:16:41.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T01:16:41.636 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T01:16:42.312 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T01:16:42.324 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T01:16:42.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T01:16:42.350 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T01:16:42.377 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T01:16:42.516 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:16:42.519 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:16:42.541 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-09-17T01:16:42.544 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-09-17T01:16:42.557 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:16:42.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:16:42.611 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:16:42.626 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:16:42.627 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T01:16:42.720 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T01:16:42.721 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907972/remote/smithi002 2024-09-17T01:16:42.721 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T01:16:42.775 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_21:08:04-orch-squid-distro-default-smithi/7907972/remote/smithi099 2024-09-17T01:16:42.775 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T01:16:42.813 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T01:16:42.813 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T01:16:42.816 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T01:16:42.862 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T01:16:42.874 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T01:16:42.874 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T01:16:42.969 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T01:16:42.969 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T01:16:42.973 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T01:16:42.986 INFO:teuthology.orchestra.run.smithi002.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 01:16 /home/ubuntu/cephtest 2024-09-17T01:16:42.988 INFO:teuthology.orchestra.run.smithi099.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 01:16 /home/ubuntu/cephtest 2024-09-17T01:16:42.989 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T01:16:43.018 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T01:16:43.117 INFO:teuthology.run:Summary data: description: orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1866.8857202529907 failure_reason: '"2024-09-17T01:10:00.000158+0000 mon.smithi002 (mon.0) 623 : cluster [ERR] fs cephfs is degraded" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-09-17T01:16:43.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T01:16:43.207 INFO:teuthology.run:FAIL